Skip to content

how to pass test_config to pytest for adk eval? #2604

@CloudIQTechnologies

Description

@CloudIQTechnologies

Running evals through adk web or adk eval allows us to specify as test_config.json file having tool_trajectory_avg_score and response_match_score
Why running the eval through pytest, I want my eval to succeed even if the response_match_score is just 0.7. How can I pass this parameter to pytest / AgentEvaluator ?

Metadata

Metadata

Assignees

Labels

bot triaged[Bot] This issue is triaged by ADK boteval[Component] This issue is related to evaluation

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions