VectorShift home page
Search...
⌘K
Ask AI
Support
Platform
Platform
Search...
Navigation
Data Loaders
Arxiv Loader Node
Documentation
API Reference
Book a Demo
Blog
Tutorials
Get Started
Introduction
Quickstart
Pipeline Mechanics
Platform
Pipelines
Overview
Start
General
Large Language Models (LLMs)
Knowledge
Data Loaders
File Node
API Node
CSV Query Agent Node
Scrape URL Node
Get Wikipedia Article Node
Get Youtube Transcript Node
Arxiv Loader Node
RSS
Web Search
Multi-Modal
Logic
Data Transformation
Chat
Conversational
Knowledge
Interfaces
Transformations
Files
Account
Profile
Organizations
Subscriptions
On this page
Node Inputs
Node Parameters
Node Outputs
Considerations
Example
Data Loaders
Arxiv Loader Node
Retrieve relevant articles from Arxiv based on a query
This node retrieves relevant articles from Arxiv based on a query.
Node Inputs
Search Query: The query text to search Arxiv
Type:
Text
Node Parameters
In the gear:
Chunk Text: Chunk the articles returned
Chunk Size (if Chunk Text is set to True): The size of each chunks in tokens (1 token = 4 characters; default is 512 tokens)
Chunk Overlap (if Chunk Text is set to True): The number of tokens of overlap between chunks (default is 0 tokens)
Node Outputs
Output: The text from the relevant article(s)
Type:
Text
Example usage:
{{arxiv_0.output}}
Considerations
Click on the “+” button on the right of the node to create and connect the node to a
semantic search node
to enable semantic search on the articles.
Example
The below example shows a pipeline that returns relevant Arxiv articles based on a search query.
Text Node: Contains the search query
Arxiv Node: Returns relevant Arxiv articles based on a query
Search Query:
{{text_0.text}}
Output Node: Displays the articles
Output:
{{arxiv_0.output}}
Get Youtube Transcript Node
RSS Feed Reader Node
Assistant
Responses are generated using AI and may contain mistakes.