Scorer Node

This node assigns scores to an item based on custom criteria. You need to define the criteria in the scoring criteria.

Node Inputs

• Item for Scoring: The text to be scored

  • Type: Text

• Scoring Criteria: The criteria which the text will be scored

  • Type: Text

• Additional Context: The additional information or instructions for the AI when doing the scoring

  • Type: Text

Node Parameters

Face of the node

• Include Justification: When this parameter is turned on, the justification output field for why the score was given will be available.

In the gear:

1. Provider: Provider of the AI model you want to use. The default provider is OpenAI.

2. Model: Model name of the AI model you want to use. The default model is gpt-4o.

Node Outputs

• Score: The score of the text based on the criteria

  • Type: Text

  • Example usage: {{scorer_0.score}}

• Justification: The justification given by the AI for the score

  • Type: Text

  • Example usage: {{scorer_0.justification}}

Considerations

• Define the bounds of the score in the scoring criteria, specifically the upwards and lower bounds. Define what criteria warrants a high vs low score.

Example

The scorer below takes in text and grades the grammar of the text. The scoring criteria stipulates that a score of 1 means the text has bad grammar. A score of 10 means good grammar.