Skip to content

Running eval through pytest is not saving evalset_result.json fileΒ #2602

@CloudIQTechnologies

Description

@CloudIQTechnologies

** Please make sure you read the contribution guide and file the issues in the right place. **
Contribution guide.

Describe the bug
When I run the evals either through adk web or adk eval command, I see the evalset_result.json file getting stored under .adk/eval_history folder under the agent folder. But which I run the eval through pytest, the result.json is not getting stored

To Reproduce
Steps to reproduce the behavior:

  1. Install '...'
  2. Run '....'
  3. Open '....'
  4. See error

Expected behavior
A clear and concise description of what you expected to happen.
The evalset_result.json should get stored just like what happens when we run the evals through adk web or through adk eval command

Screenshots
If applicable, add screenshots to help explain your problem.

Image

Desktop (please complete the following information):

  • OS: Windows
  • Python version(python -V): 3.12.10
  • ADK version(pip show google-adk): 1.11.0

Model Information:
For example, which model is being used.
gemini-2.5-pro

Additional context
Add any other context about the problem here.

Metadata

Metadata

Assignees

Labels

bot triaged[Bot] This issue is triaged by ADK boteval[Component] This issue is related to evaluation

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions