Create Knowledge Base Node
Last updated
Last updated
This node create a new Knowledge Base with configured options.
Name: Name of the Knowledge Base
Type: Text
In the gear:
Chunk Size: The size of chunks you want for your Knowledge Base. The value ranges from 400 to 4096. The default value is 400.
Chunk Overlap: The chunk overlap is the number of tokens overlapping between chunks. This is defaulted to 0 tokens. Increase the chunk overlap if you are concerned that chunking eliminates essential data (e.g. if a chunk cuts in the middle of a word). The value ranges from 0 to 4095.
File Processing Model: The model that you want to use to process files. The models available are: Default (Basic OCR), Llama Parse and Textract.
Use default if your files contain primarily text
If your files contain complex tables, images, diagrams, etc., use Llama Parse or Textract (Note: additional costs will be charged).
Apify Key: Enter your Apify API key to integrate Apify services for web scraping or data extraction.
Do not share API key with someone you do not trust.
Embedding Model: This is used to embed the data into the knowledge/vector database. It defaults to "text-embedding-3-small," the state-of-the-art model today in terms of performance and speed. Alternatively, you can choose "embed-multilingual-v3.0" for multi-language documents. The available models are voyageai/voyage-3-large, openai/text-embedding-3-large, openai/text-embedding-ada-002, openai/text-embedding-3-small, cohere/embed-english-v3.0, cohere/embed-multilingual-v3.0, cohere/embed-english-light-v3.0, cohere/embed-multilingual-light-v3.0, cohere/embed-english-v2.0, cohere/embed-english-light-v2.0, and cohere/embed-multilingual-v2.0.
Hybrid: You can make your Knowledge Base Hybrid.
Analyze Documents: You can turn this on if you want to analyze your documents in the Knowledge Base.
Knowledge_base: The created knowledge base
Type: Knowledge Base
Example usage: {{knowledge_base_create_0.knowledge_base}}
