kedro: Default and Custom Pipeline not being registered and cannot be found.
Description
Kedro Run doesn’t work and claims that I need to register my pipeline.
File “C:\Anaconda3\envs\kedro-environment\lib\site-packages\kedro\framework\context\context.py”, line 310, in _get_pipeline ) from exc kedro.framework.context.context.KedroContextError: Failed to find the pipeline named ‘de’. It needs to be generated and returned by the ‘register_pipelines’ function.
I certainly have it registered. Here is my My src\dcs_package\pipeline_registry.py:
` from typing import Dict
from kedro.pipeline import Pipeline, node from .pipelines.data_processing.pipeline import create_pipeline import logging
def register_pipelines() -> Dict[str, Pipeline]:
log = logging.getLogger(__name__)
log.info("Start register_pipelines")
data_processing_pipeline = create_pipeline()
log.info("create pipeline done")
return {
"__default__": data_processing_pipeline,
"dp": data_processing_pipeline
}`
and my pipeline file is in “src\dcs_package\pipelines\data_processing\pipeline.py”
Context
I’m trying to run a very simple pipeline that just outputs a test string “test string”
Steps to Reproduce
- Did Kedro install[all]
- Set up catalog file with a csv and an xlsx to make sure dependancies were working. No problems there.
- Tried kedro run and kedro run --pipeline de. Same response
Expected Result
Pipeline is found and runs node.
Actual Result
Pipeline is not found. “Failed to find the pipeline named ‘de’. It needs to be generated and returned by the ‘register_pipelines’ function.”
-- If you received an error, place it here.
Failed to find the pipeline named ‘de’. It needs to be generated and returned by the ‘register_pipelines’ function.
-- Separate them if you have more than one.
Your Environment
Include as many relevant details about the environment in which you experienced the bug:
- Kedro version used (
pip show kedroorkedro -V): _ _ | | _____ | | __ ___ | |/ / _ / _` | '/ _
| < / (| | | | () | |_|__|_,|_| __/ v0.17.2
kedro allows teams to create analytics projects. It is developed as part of the Kedro initiative at QuantumBlack.
No plugins installed
- Python version used (
python -V): 3.7 - Operating system and version: Windows 10
About this issue
- Original URL
- State: closed
- Created 3 years ago
- Comments: 26 (11 by maintainers)
Commits related to this issue
- Release 0.16.4 (#731) — committed to vishalbelsare/kedro by 921kiyo 4 years ago
Hi. I still have the same problem when trying to follow the space ship tutorial. When running
kedro run --node=preprocess_companies_node, I get an error message saying it cannot find defaut pipeline. I’m using kedro 0.17.2 with Python 3.8.8 on GCP AI notebook. Attached, the error log. kedro_run_node.txtOkay, problem solved. just needed to add sqlalchemy to the requirements.in. Everything works now. That was probably the biggest issue, just to forever to figure out what I had missed.
I was able to successfully install and run the Iris starter after updating to Python 3.8. 8! I’ll try replacing everything with my own project files in my 3.8.8 environment now.