Knowledge base Loader Node

This node loads data (files or scraped content from URLs) into an existing Knowledge Base.

Node Inputs

• Knowledge Base: Select the existing Knowledge Base you want to load data to

  • Type: Knowledge Base

You can choose an existing Knowledge Base in two ways:

1. Select: You can select from the dropdown a Knowledge Base in created in Vectorshift platform.

2. Variable: You can pass in a variable containing reference to the Knowledge Base you want to select.

If Data Type is File:

• Documents to load: The file to be added to the selected Knowledge Base. Note: to convert text to file, use the Text to File node.

  • Type: List<File>

If Data Type is URL:

• URL to load: The raw URL link (e.g., https://vectorshift.ai/)

  • Type: Text

Node Parameters

On the face of node:

if Data Type is URL:

• Loader Type: The type of URL loader you want to use. The available loaders are URL, Wikipedia Query, Youtube URL, Arxiv Query and Repository URL. The default value is URL.

• Recursive: Scrape sub-pages of the provided link.

• Re-scrape Frequency: The frequency that the URL will be re-scraped. The available options are Never, Hourly, Daily, Weekly and Monthly. The default value is Never.