The agent-quality flywheel: Using Gemini Enterprise Agent Platform evaluations to optimize agents

Google Cloud Tech · Intermediate ·🧠 Large Language Models ·4w ago

Key Takeaways

Optimizes agent quality using Gemini Enterprise Agent Platform evaluations and the Quality Flywheel methodology

Original Description

Treating agent quality as a rigorous engineering discipline is the only way to scale. Stop guessing and start measuring. Join this session for a deep dive into the state-of-the-art techniques Google uses to build our own agents, and learn how to make them a part of your process. We’ll demonstrate how you can adopt the “Quality Flywheel” methodology, which includes bootstrapping effective offline evaluation with synthetic test generation, using LLM-as-a-judge autoraters and trajectory evaluations, performing user and environment simulation, identifying systemic failures in production with multi-turn autoraters and loss-pattern clustering, aligning test coverage with actual usage, and using automated optimization capabilities to scientifically refine performance. Ramp up with confidence. Watch more: 100+ sessions from Google Cloud Next 26 → https://www.googlecloudevents.com/next-vegas/ Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech Speakers: Dima Melnyk, Alex Martin, Daniel Lewis BRK3-023 #GoogleCloudNext
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
Building Your First Model Context Protocol (MCP) Server with TypeScript and Zod
Learn to build a Model Context Protocol (MCP) server with TypeScript and Zod to integrate Large Language Models with external environments
Dev.to AI
📰
Beyond Code Generation: How OmniSVG Rethinks Vector Graphics with Vision-Language Models
Learn how OmniSVG uses vision-language models to rethink vector graphics beyond code generation
Dev.to · Shrijith Venkatramana
📰
LangGraph Checkpointing: Three Production Rewrites to Stop Losing State
Learn how to implement LangGraph checkpointing to prevent state loss in production environments
Dev.to · Elena Revicheva
📰
AI builder essentials: tokens, context windows and RAG 101
Learn the essentials of AI building with tokens, context windows, and RAG 101 to improve your LLM interactions
Dev.to · Tilde A. Thurium
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →