Data Loaders
File Node
Load a static file your pipeline
The file node allows you to load a static file into the workflow as a raw file or processed text from it (text extracted from the file).
The node has two toggles at the top: Select / Upload File and File Name.
If Select / Upload File is chosen, you have three options:
- Upload a file by clicking the upload button
- Use the dropdown to select a previously uploaded file to the VectorShift platform
- If switch the toggle from “Upload” to “Variable”, you can reference files from other nodes
If you switch the top toggle to File Name: you can enter the file name of a file within the VectorShift platform.
Node Inputs
If Select/Upload File selected:
- File: Select an existing file from the platform or upload a file for processing
- Type:
File
- Type:
If File Name selected:
- File Name: The name of the file from the VectorShift platform from the files tab
- Type:
Text
- Type:
Node Parameters
In the gear:
- Processing Model: The model that you want to use to extract the text from the file. The models available are: Default (Basic OCR), Llama Parse and Textract.
- Use default if your files contain primarily text.
- If your files contain complex tables, images, diagrams, etc., use Llama Parse or Textract (Note: additional costs will be charged).
Node Outputs
- File: The raw file, as-is
- Type:
File
- Example usage:
{{file_0.file}}
- Type:
- Processed Text: The processed text extracted from the inputted file
- Type:
Text
- Example usage:
{{file_0.processed_text}}
- Type:
Considerations
- Click on the “+” button on the right of the node to create and connect the node to a semantic search node to enable semantic search on the file.