Gemma 4 production stack: Model Armor, ADK Agents, Tracing

Google Cloud Tech · Intermediate ·☁️ DevOps & Cloud ·3mo ago

Key Takeaways

Secures Gemma 4 using Model Armor, builds an ADK Agent, and implements tracing for observability

Original Description

GCP credit → https://goo.gle/handson-ep8-lab1 Lab → https://goo.gle/guardians Gemma 4 is deployed. Now we secure it, build an agent on it, and make it observable. 🛡️ Model Armor — scans every prompt and response for jailbreaks, PII, and harmful content via a Load Balancer Service Extension. 🤖 ADK Agent — built with Agent Development Kit, powered by vLLM, deployed to Cloud Run via CI/CD. 📊 Prometheus Sidecar — scrapes vLLM metrics: token throughput, GPU utilization, latency. 🔍 Cloud Trace — OpenTelemetry tracing through the agent, end to end. Security. Agents. Observability. One stack. 👇 Chapters: 0:00 - Intro 8:25 - Erecting the shield of SecOps: Setup Model Armor 38:37 - Raising the watchtower: Agent pipeline 57:17 - The palantir of performance: Metrics and tracing 1:07:46 - The boss fight 1:12:30 - Wrap up More resources: Agent Development Kit (ADK) docs → https://goo.gle/4uflScr Model Armor documentation → https://goo.gle/4mz57Ga Cloud Trace documentation → https://goo.gle/4euYyCB Watch more Hands on AI → https://www.youtube.com/watch?v=qCBreTfjFHQ&list=PLIivdWyY5sqKnJOvP89yF8t9mWuzMTcbM 🔔 Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech #Gemma4 #ModelArmor Speakers: Ayo Adedeji, Annie Wang Products Mentioned: Cloud Run, Cloud Build, Model Armor, Agent Development Kit, Cloud Trace, Gemma 4
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
Your HIPAA Posture, in Version Control
Manage HIPAA compliance using version control and infrastructure as code to ensure auditability and reproducibility
Medium · DevOps
📰
hermes-memory-installer: Avoiding Stale Commit Hashes in Consistency Notes
Learn to avoid stale commit hashes in documentation by using relative references instead of direct commit hashes
Dev.to AI
📰
Every AWS project starts with copy-pasting last repo's Terraform. I built a generator instead.
Automate Terraform generation for AWS projects with secure defaults, replacing manual copy-pasting of outdated configurations
Dev.to · Framz
📰
Kubernetes Health Probes: Liveness, Readiness, and Startup Explained
Learn to use Kubernetes health probes for liveness, readiness, and startup to ensure reliable production deployments
Dev.to · toothbrush

Chapters (6)

Intro
8:25 Erecting the shield of SecOps: Setup Model Armor
38:37 Raising the watchtower: Agent pipeline
57:17 The palantir of performance: Metrics and tracing
1:07:46 The boss fight
1:12:30 Wrap up
Up next
How to Code with Distrobox on the Steam Deck
Ian Wootten
Watch →