Sub-pipelines (list mode)

What this builds. A main pipeline that splits a newline-delimited input into a list via SplitTextNode, then runs a sub-pipeline once per element by setting execution_mode="batch" on the PipelineNode. You’ll end up with. A saved batched-pipeline whose output is the sub-pipeline’s output_0 produced for each split line.

from vectorshift import Pipeline

# Fetch the saved sub-pipeline you want to fan out
sub_pipeline = Pipeline.fetch(name="your sub pipeline")

# Fetch the main pipeline if it already exists, otherwise create it
PIPELINE_NAME = "batched-pipeline"
try:
    pipeline = Pipeline.fetch(name=PIPELINE_NAME)
    print(f"Pipeline fetched: id={pipeline.id}, branch_id={pipeline.branch_id}")
except Exception as e:
    print(f"Error fetching pipeline: {e}")
    pipeline = Pipeline.new(name=PIPELINE_NAME)
    print(f"Pipeline created: id={pipeline.id}, branch_id={pipeline.branch_id}")

input_node = pipeline.add(name="input_0").input(input_type="string")
split_text_node = pipeline.add(name="split_text_node").split_text(
    text=input_node.text, delimiter="newline"
)
pipeline_node = pipeline.add(name="sub_pipeline").pipeline(
    pipeline=sub_pipeline,
    input_0=split_text_node.processed_text,
    execution_mode="batch",
)
pipeline.add(name="output_0").output(value=pipeline_node.output_0)

pipeline.save()

Expected output

Pipeline created: id=..., branch_id=...

execution_mode="batch" is what tells the runtime to fan the sub-pipeline out across the list — without it, the node receives the list as a single input.

Sub-pipelines

Single-shot sub-pipeline composition.

Batch config

Batch mode on individual LLM nodes.

Pipeline reference

Full method surface.

Sub-pipelines Streaming

Get started

Guides

Pipeline

Agent

Knowledge Base

Integrations

Table

Transformation

Session

Analytics

Workspace

Sub-pipelines (list mode)

Expected output

See also

Sub-pipelines

Batch config

Pipeline reference

​Expected output

​See also

Sub-pipelines

Batch config

Pipeline reference

Expected output

See also