Accuracy with Given Answer

Example showing how to evaluate the accuracy of an Agno Agent’s response with a given answer.

1. Create a Python file

   accuracy_with_given_answer.py

   from typing import Optional
   
   from agno.eval.accuracy import AccuracyEval, AccuracyResult
   from agno.models.openai import OpenAIResponses
   
   evaluation = AccuracyEval(
       name="Given Answer Evaluation",
       model=OpenAIResponses(id="gpt-5.2"),
       input="What is 10*5 then to the power of 2? do it step by step",
       expected_output="2500",
   )
   result_with_given_answer: Optional[AccuracyResult] = evaluation.run_with_output(
       output="2500", print_results=True
   )
   assert result_with_given_answer is not None and result_with_given_answer.avg_score >= 8
   
2. Set up your virtual environment

   Mac

   uv venv --python 3.12
   source .venv/bin/activate
   
3. Install dependencies

   uv pip install -U openai agno
   
4. Export your OpenAI API key

   Mac/Linux

     export OPENAI_API_KEY="your_openai_api_key_here"
   
5. Run Agent

   python accuracy_with_given_answer.py