pipeline.add(name="...").<node>(...). Each entry lists the node’s configuration parameters. See the Pipeline reference for add, run, and lifecycle methods.
ai_fill_pdf — AI Fill PDF
Fill out a PDF with form fields using AI. The AI will understand and fill each field using provided context. To convert your PDF to have fillable input fields, use: https://www.sejda.com/pdf-forms
bool
default:"False"
Whether to select specific pages to fill
str
required
The model provider
str
default:"''"
The specific model for filling the PDF
str
required
Context used by LLM to fill PDF fields
AcceptsFile
required
The PDF with form fields to be filled
str
default:"''"
PDF page range
ai_filter_list — AI Filter List
Filter items in a list given a specific AI condition. Example, Filter (Red, White, Boat) by whether it is a color: (Red, White)
str
default:"'single'"
Choose whether to filter a single list or filter by another list
One of:
another, singlestr
required
The model provider
str
default:"''"
The specific model for filtering
str
required
Write in natural language the condition to filter each item in the list
list[str]
required
The items to filter the list by
list[str]
required
The list to filter
bool
default:"False"
If true, output a blank value for values that do not meet the filter condition. If false, nothing will be outputted
SamplingConfig
Any
Any
Any
ai_operations — Leverage AI for various tasks
Leverage AI for various tasks
str
default:"''"
append_files — Append Files
Append files together in successive fashion
str
default:"'PDF'"
One of:
PDF, PPTXAcceptsFileList
default:"[]"
categorizer — Categorizer
Categorize text using AI into custom-defined buckets
bool
default:"False"
Include the AI’s justification for its score
str
required
The model provider
str
default:"''"
The specific model for categorization
str
required
The text that will be categorized
str
default:"''"
Provide any additional context or instructions
ListType | list[List[Dict[str, Any]]] | list[NameDescription]
default:"[]"
The fields to be categorized
SamplingConfig
int
The maximum number of tokens to generate
float
The temperature of the model
float
The top-p value
combine_list — Combine List
Combine multiple lists into one list. Final list is ordered in the order of the input lists.
str
default:"'string'"
The type of the list
ListType | list[List[Any]] | list[List[List[Any]]]
required
List to be combined
combine_text — Combine Text
Combine text inputs into a singular output.
list[str]
required
create_list — Create List
Create a list from input texts. Final list is ordered in the order of the inputs.
str
default:"'string'"
The type of the list
ListType | list[Any] | list[List[Any]]
required
Value to be added to the list
csv_reader — CSV Reader
Read the contents from a CSV file and output a list of the data for each column.
str
default:"'CSV'"
The type of file to read.
One of:
CSV, EXCELbool
default:"True"
dict
default:"{}"
AcceptsFile
required
The file to read.
str
required
The Excel sheet to read from.
list[str]
default:"[]"
ListType | list[ColumnItem] | list[List[Dict[str, Any]]]
default:"[]"
Define the name(s) of the columns that you want to read
ListType | list[ColumnItem]
default:"[]"
Define the name(s) of the columns that you want to read
csv_to_excel — CSV To Excel
Convert a CSV file into XLSX.
AcceptsFile
str
default:"'left'"
One of:
center, centerContinuous, distributed, fill, general, justify, left, rightint
default:"100"
str
default:"'top'"
One of:
bottom, center, distributed, justify, topbool
default:"True"
csv_writer — CSV Writer
Create a CSV from data.
str
default:"'new'"
Whether to create a new CSV or update an existing one.
One of:
new, oldstr
default:"'file'"
Whether to load the CSV from a file or a string.
One of:
file, textListType | list[ListNameTypeValue] | list[List[Dict[str, Any]]]
default:"[]"
The columns to write to the CSV.
AcceptsFile
The file to update.
str
default:"''"
The CSV string to write.
custom_smtp_email_sender — Custom Smtp Email Sender
Send emails using a custom SMTP server configuration
str
default:"'SSL'"
One of:
SSL, STARTTLS, TLSstr
default:"''"
str
required
str
required
bool
default:"''"
str
required
str
default:"''"
str
required
str
required
int
default:"465"
dataframe_aggregate — Dataframe Aggregate
Aggregate data from a dataframe.
str
default:"'table'"
The type of dataframe to be used
One of:
tablestr
required
Select a numeric column (integer or decimal) to perform aggregation
str
required
The aggregation to perform
One of:
AVG, COUNT, MAX, MIN, SUMAcceptsDataframe
required
The dataframe to aggregate
list[str]
required
The columns to group by
dataframe_get_schema — Dataframe Get Schema
Get the schema of a dataframe including columns, types, and constraints.
str
default:"'table'"
The type of dataframe to be used
One of:
tableAcceptsDataframe
required
The dataframe to get schema from
dataframe_nl_query — Dataframe NL Query
Execute natural language queries on dataframes.
str
default:"'table'"
The type of dataframe to be used
One of:
tableAcceptsDataframe
required
The dataframe to query using natural language
str
required
Ask a question about your data in natural language. Example: What are the top 10 rows?
dataframe_operations — Dataframe Operations
Dataframe Operations
str
default:"''"
dataframe_raw_query — Dataframe Raw Query
Execute custom queries on dataframes.
str
default:"'table'"
The type of dataframe to be used
One of:
tablestr
required
SQL query to execute on the dataframe. Use {df} as the table name placeholder. Example: SELECT * FROM {df} limit 10;
AcceptsDataframe
required
The dataframe to query
bool
required
Whether to preload dataframe instead of lazy load
dataframe_read_columns — Dataframe Read Columns
Read columns from a dataframe.
str
default:"'any'"
The expected type of the column values
str
default:"'table'"
The type of dataframe to be used
One of:
tablestr
required
The name of the column to read
AcceptsDataframe
required
duplicate_list — Duplicate List
Create a new list by duplicating a single item with the size of the new list either matching the size of another list, or a specified size.
bool
default:"False"
Check this box if you want to manually specify the list size. In this case ‘Match List Size’ will not be used.
str
default:"'string'"
The type of the list
Any | ListType | list[Any]
required
Item to duplicate
list[str]
required
The size of the list you want to match
int
required
The size of the new list
email_notification — Send email notifications from no-reply@vectorshiftmail.com
Send email notifications from no-reply@vectorshiftmail.com
str
default:"''"
str
required
str
required
bool
default:"''"
email_validator — Validate an email address
Validate an email address
str
default:"'regex'"
The validation model to use
One of:
custom-validator, regexstr
required
The API key to use
str
required
The email you want to validate
str
default:"'hunter'"
The validation provider to use
One of:
debounce, hunterexcel_cell_reader — Excel Cell Reader
Read data from an Excel cell.
str
required
bool
default:"False"
AcceptsFile
required
str
required
excel_cell_writer — Excel Cell Writer
Write data to an Excel cell.
bool
default:"False"
Whether to set the vertical alignment of the cell.
bool
default:"False"
Whether to set the horizontal alignment of the cell.
bool
default:"False"
Whether to set the fill color of the cell.
str
required
The cell to read from.
str
required
The value to write to the cell.
str
default:"'FFFFFF'"
The fill color of the cell.
str
default:"'left'"
The horizontal alignment of the cell.
One of:
center, centerContinuous, distributed, fill, general, justify, left, rightAcceptsFile
required
The file to read from.
str
required
The sheet to read from.
str
default:"'bottom'"
The vertical alignment of the cell.
One of:
bottom, center, distributed, justify, topexcel_file_reader — Excel File Reader
Read data from an Excel file.
bool
default:"True"
Whether to read a single sheet from the Excel file.
bool
default:"False"
Whether to read the formatting of the cell.
bool
default:"False"
Whether to read the formula of the cell.
AcceptsFile
required
The file to read from.
str
default:"''"
The sheet to read from.
excel_operations — Process and manipulate Excel files
Process and manipulate Excel files
str
default:"''"
excel_sheets_reader — Excel Sheets Reader
Get list of all sheet names from an Excel file.
AcceptsFile
required
excel_writer — Excel Writer
Write data to an Excel sheet.
bool
default:"False"
Whether to set the vertical alignment of the cells.
bool
default:"False"
Whether to set the horizontal alignment of the cells.
bool
default:"False"
Whether to set the fill color of the cells.
str
required
The cell to start writing from.
list[str]
required
The values to write to the cells.
str
default:"'FFFFFF'"
The fill color of the cells.
str
default:"'left'"
The horizontal alignment of the cells.
One of:
center, centerContinuous, distributed, fill, general, justify, left, rightAcceptsFile
required
The file to write to.
str
required
The sheet to write to.
str
default:"'bottom'"
The vertical alignment of the cells.
One of:
bottom, center, distributed, justify, topextract_data — Extract Data
Extract key pieces of information or a list of information from a input text.
str
default:"'gpt-4o'"
str
required
str
default:"''"
ListType | list[List[Dict[str, Any]]] | list[NameTypeDescription]
required
dict
required
str
default:"'openai'"
extract_to_table — Extract To Table
Extract data to a CSV using AI
str
default:"'gpt-4o'"
One of:
gpt-4o, gpt-4o-2024-08-06, gpt-4o-minibool
default:"False"
str
default:"''"
bool
default:"True"
AcceptsFile
required
ListType | list[ColumnEntry] | list[List[Dict[str, Any]]]
default:"[]"
str
default:"'openai'"
One of:
openaistr
required
file_operations — Process and manipulate files
Process and manipulate files
str
default:"''"
file_to_text — File To Text
Convert data from type File to type Text
bool
default:"False"
Whether to chunk the text into smaller pieces.
bool
default:"False"
Use a password to decrypt the file.
AcceptsFile
required
The file to convert to text.
str
default:"'default'"
The type of file parser to use.
One of:
contextual_ai, default, docling, llama_parse, mistral_ocr, reducto, textractstr
default:"''"
The password to decrypt the file.
int
default:"400"
The overlap of each chunk of text.
int
default:"1024"
The size of each chunk of text.
filter_list — Filter List
Filter items in a list given a specific condition. Example, Filter (Red, White, Blue) by (100, 95, 80)>90 is (Red, White)
str
default:"'single'"
Choose whether to filter a single list or filter by another list
One of:
another, singlestr
default:"'string'"
The type of the list
str
required
The type of condition to apply
str
default:"''"
The value to compare the list items against
ListType | list[Any] | list[List[Any]]
required
The items to filter the list by
ListType | list[Any] | list[List[Any]]
required
The list to filter
bool
required
If true, output a blank value for values that do not meet the filter condition. If false, nothing will be outputted
find_and_replace — Find And Replace
Find and replace words in a given text
ListType | list[FindReplace] | list[List[Dict[str, Any]]]
default:"[]"
str
required
flatten_list — Flatten List
Flatten list of lists into a single list. For example, [[a, b], [c, d]] becomes [a,b,c,d].
str
default:"'string'"
The type of the list
ListType | list[List[Any]] | list[List[List[Any]]]
required
List of lists to be flattened
generate_chart — Generate Chart
Use this to generate a chart from. Convert a tabular file, dataframe or table to a chart or graph visualization. Supports bar, line, pie, scatter, and donut charts/graphs.
str
default:"'bar'"
The type of chart to generate (bar, line, pie, scatter, donut)
One of:
bar, donut, line, pie, scatter, time_seriesstr
default:"'sum'"
How to aggregate values when there are multiple data points per category
One of:
average, count, max, min, sumstr
default:"''"
A brief description or subtitle explaining what the chart shows
AcceptsDataframe
required
The dataframe to visualize as a chart. In case of csv, the input should be a properly formatted valid csv string with appropriate headers. When chaining from a tool that returned a CSV file (e.g. fetch_ratios.table), set dataframe_type=“file” and pass $action.<id>.table — never paste the upstream formatted_text/XML here.
str
required
Actual column names from the dataframe. It should be a string representing the comma separated list of column names.
str
required
The type of dataframe to be used. Only available options are table, csv, md, json, file.
One of:
csv, file, json, md, tablestr
default:"'right'"
Where to display the chart legend
One of:
bottom, hidden, left, right, topstr
default:"'ascending'"
The order to sort the data
One of:
ascending, descendingstr
required
The title to display on the chart
str
required
The column name to use for the X-axis (categories). Must EXACTLY match (case-sensitive) one of the column names from the CSV header.
str
default:"''"
The label to display on the X-axis. Defaults to the field name if not provided.
str
required
Column name(s) for Y-axis values. Must EXACTLY match (case-sensitive) column name(s) from the CSV header. For multi-series charts (multiple lines/bars), use comma-separated names like ‘revenue,profit,cost’.
str
default:"''"
The label to display on the Y-axis
str
default:"''"
Currency symbol (only used with currency format)
One of: “,
eur, gbp, jpy, usdstr
default:"'max'"
Initial time period tab selection
One of:
1m, 1y, 5y, 6m, max, ytdstr
default:"'number'"
How to format values
One of:
currency, number, percent, ratiostr
default:"''"
Comma-separated icon URLs for each series (company logos, game art, product images, etc.), in same order as y_axis_fields. Leave empty for no icons.
str
default:"''"
Comma-separated display names for each Y-axis field, in same order as y_axis_fields (e.g. ‘MSFT,NVDA’ for tickers, ‘Halo,Fortnite’ for games, ‘US,EU,APAC’ for regions).
str
default:"'false'"
Set to ‘true’ to show Original/% Change toggle
str
default:"''"
Scale suffix for values
One of: “,
b, k, m, tget_list_item — Get List Item
Get a value from a list given an index. The first item in the list is index 0.
str
default:"'string'"
The type of the list
int
required
The index of the item to retrieve
ListType | list[Any] | list[List[Any]]
required
The list to retrieve the item from
join_list_item — Join List Item
Join a list of items into a single piece of text. For example, with / as the separator, [‘a’, ‘b’, ‘c’] becomes ‘a/b/c’
bool
default:"False"
Separate each line in the final output with a new line
str
default:"'string'"
The type of the list
str
default:"''"
Use a specified character to join list items into a single string
ListType | list[Any] | list[List[Any]]
required
List of items to be joined
json_operations — JSON Operations
Read, create, and update JSON data
str
default:"''"
list_deduplicator — List Deduplicator
Remove duplicate items from a list. Outputs a list of unique items.
str
default:"'string'"
The type of the list
One of:
bool, float, int32, string, timestampListType | list[Any] | list[List[Any]]
required
The list to deduplicate
list_operations — Process and manipulate lists
Process and manipulate lists
str
default:"''"
list_trimmer — List Trimmer
Trim a list to just the sections you want. Enter enter the number of items or specify the section of the list that you want to keep.
bool
default:"False"
Check this to specify a section of the list to keep. Leave unchecked to keep a specified number of items from the start.
str
default:"'string'"
The type of the list
int
required
The ending index of the section to keep (exclusive).
ListType | list[Any] | list[List[Any]]
required
The list to trim
int
required
The starting index of the section to keep (inclusive). The first item of the list is index 0.
int
required
Check this to specify a section of the list to keep. Leave unchecked to keep a specified number of items.
notifications — Notifications
Send alerts and notifications via different channels
str
default:"''"
read_json_values — Read JSON Values
Read values from a JSON object based on a provided key(s).
str
required
ListType | list[KeyItem] | list[List[Dict[str, Any]]]
required
dict
required
rename_file — Rename File
Rename an existing file, assigning a new name along with the file extension.
AcceptsFile
required
str
required
sales_data_enrichment — Sales Data Enrichment
Enhance sales data with validation and enrichment processes
str
default:"''"
scorer — Scorer
Assign a numerical score based on predefined criteria to quantitatively assess a given entity.
bool
default:"False"
Include the AI’s justification for its score
str
required
The model provider
str
default:"''"
The specific model for scoring
str
required
The text that will be scored
str
default:"''"
Provide any additional context or instructions
str
required
The criteria that the text will be scored
SamplingConfig
Any
Any
Any
sms_notification — Send text message notifications
Send text message notifications
str
required
str
required
sort_csv — Sort CSV
Sort a CSV based on a column
bool
default:"True"
Whether the file is a variable.
bool
default:"True"
Whether the CSV has headers.
int
default:"0"
The index of the column to sort by.
AcceptsFile
required
The CSV file to sort.
bool
default:"False"
Whether to reverse the sort.
str
default:"''"
The column to sort by.
split_text — Split Text
Takes input text and separate it into a List of texts based on the delimiter.
str
default:"'space'"
The delimiter to split the text on
One of:
character(s), newline, spacestr
required
The text to split
str
required
The character(s) to split the text on
summarizer — Summarizer
Summarize large texts using AI.
str
required
The model provider
str
default:"''"
The specific model for summarization
str
required
The text to be summarized
SamplingConfig
Any
Any
Any
table — Table
Table
str
default:"''"
table_add_columns — Table Add Columns
Add one or more columns to a table.
AcceptsTable
required
dict
required
table_add_row — Table Add Row
Add New Row to Table.
AcceptsTable
required
table_aggregate — Table Aggregate
Aggregate data from a table.
str
required
str
required
One of:
AVG, COUNT, MAX, MIN, SUMAcceptsTable
required
list[str]
required
table_delete_columns — Table Delete Columns
Delete one or more columns from a table.
AcceptsTable
required
list[str]
required
table_delete_values — Table Delete Values
Delete rows matching a filter.
AcceptsTable
required
str
required
table_read_columns — Table Read Columns
Select column in table to read as list.
str
default:"'any'"
The expected type of the column values
str
required
The name of the column to read
AcceptsTable
required
The table to read from
table_rename_column — Table Rename Column
Rename a column in a table.
AcceptsTable
required
str
required
str
required
table_update_values — Table Update Values
Update the values in rows matching a filter.
AcceptsTable
required
str
required
dict
required
text_formatter — Text Formatter
Format text based off a specified formatter
str
default:"'To Uppercase'"
The formatter to apply to the text
One of:
To Lowercase, To Propercase, To Uppercase, Trim Spaces, Truncatestr
required
The text to format
int
required
The maximum number of tokens to truncate the text to
text_manipulation — Process and manipulate text
Process and manipulate text
str
default:"''"
text_to_file — Text To File
Convert data from type Text to type File.
str
required
str
required
str
default:"'PDF'"
One of:
DOCX, PDF, TXTtranslator — Translator
Translate text from one language to another.
str
required
The model provider
str
default:"''"
The specific model for translation
str
required
The text to be translated
str
default:"'Detect Language'"
The language of the input text
str
default:"'English'"
The language to translate to
write_json_value — Write JSON Value
Update a specific value in a JSON.
str
default:"'new'"
Whether to update the JSON value or create a new JSON
One of:
new, oldListType | list[KeyValue] | list[List[Dict[str, Any]]]
default:"[]"
str
required
The JSON to update
