Image File Input Agent

Code

cookbook/11_models/mistral/image_file_input_agent.py

from pathlib import Path

from agno.agent import Agent
from agno.media import Image
from agno.models.mistral.mistral import MistralChat
from agno.tools.hackernews import HackerNewsTools

agent = Agent(
    model=MistralChat(id="pixtral-12b-2409"),
    tools=[
        HackerNewsTools()
    ],  # pixtral-12b-2409 is not so great at tool calls, but it might work.
    markdown=True,
)

image_path = Path(__file__).parent.joinpath("sample.jpeg")

agent.print_response(
    "Tell me about this image and give me the latest news about it from HackerNews.",
    images=[
        Image(filepath=image_path),
    ],
    stream=True,
)

Usage

1. Set up your virtual environment

   Mac

   uv venv --python 3.12
   source .venv/bin/activate
   
2. Set your API key

   export MISTRAL_API_KEY=xxx
   
3. Install dependencies

   uv pip install -U mistralai agno
   
4. Run Agent

   python cookbook/11_models/mistral/image_file_input_agent.py