Skip to content

miozilla/aiaic_quality

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

7 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

aiaic_quality πŸ§‘β€πŸ­β›²πŸ“ˆ

aiaic_quality : Agent Quality # Evaluation strategy # Logging # Tracing # Visibility # Metric

Objective

  • Understand what agent evaluation is and how to use it
  • Run evaluations and analyze results directly in the ADK web UI
  • Detect regression in the agent's performance over a period of time
  • Understand & create the necessary evaluation files (*.test.json, *.evalset.json, test_config.json).
  • Set up logging configuration
  • Create a broken agent. Use adk web UI & logs to identify exactly why the agent fails
  • Understand how to implement logging in production
  • Learn when to use built-in logging vs custom solutions

AI Agent Quality

aiaic_quality001.png

aiaic_quality002.png

aiaic_quality003.png

aiaic_quality004.png

aiaic_quality005.png

Agent Observability

Agent Evaluation

About

aiaic_quality πŸ§‘β€πŸ­β›²πŸ“ˆ : Agent Quality # Evaluation strategy # Logging # Tracing # Visibility # Metric

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors