Arxiv Loader Node

This node retrieves relevant articles from Arxiv based on a Search Query.

Node Inputs

• Search Query: The search query for Arxiv articles

  • Type: Text

Node Parameters

In the gear:

• Chunk Text: Chunk the articles returned

• Chunk Size (if Chunk Text is set to True): The size of each chunks in tokens (1 token = 4 characters; default is 512 tokens)

• Chunk Overlap (if Chunk Text is set to True): The number of tokens of overlap between chunks (default is 0 tokens)

Node Outputs

• Output: The text from the relevant article(s)

  • Type: Text

  • Example usage: {{arxiv_0.output}}

Considerations

• Click on the “+” button on the right of the node to create and connect the node to a semantic node.

  • The semantic search node is a commonly connected node as you may want to embed the data for querying.