Evaluator

Use this flow to iteratively improve results based on specific criteria.

Loading graph...

API Reference

input

type: FlowDefinition

Flow definition to execute and evaluate.

criteria

type: string

Criteria to evaluate the response against.

max_iterations

type: number

Maximum number of iterations to attempt improvement.

Example

import { evaluate } from 'flows-ai/flows'

const optimizeFlow = evaluate({
  input: {
    agent: 'writingAgent',
    input: 'Write a compelling story'
  },
  criteria: 'The story should be engaging, have a clear plot, and be free of grammar errors',
  max_iterations: 3
})

12 collapsed lines
import { agent, execute } from 'flows-ai'

const writingAgent = agent({
  model: openai('gpt-4o'),
  system: 'You are a writer...',
})

execute(optimizeFlow, {
  agents: {
    writingAgent
  }
})