Build agentic testing systems to validate AI generated code | ODSP912

Microsoft Developer · Intermediate ·🤖 AI Agents & Automation ·1mo ago

Key Takeaways

Builds agentic testing systems to validate AI-generated code using autonomous agents

Original Description

AI is driving rapid expansion of software, but vibe coding lacks the rigor needed for reliability. Traditional tests can’t keep pace with agent-generated logic. To scale, we must move beyond manual checks to Agentic Testing: using autonomous agents to validate autonomous systems. Explore patterns for creating autonomous test agents, detecting failures across workflows, and continuously verifying behavior. Take away practical approaches to make AI-driven software reliable and production ready. 𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Build 2026 event. View even more sessions on-demand and learn about Microsoft Build at https://build.microsoft.com ODSP912 | English (US) | Agents & apps Pre-recorded | (300) Advanced #MSBuild Chapters: 0:00 - Exploring the challenge of validating autonomous agent-built applications 00:03:41 - Markdown-based TestMD framework integration for CI/CD 00:04:08 - Shareable evidence through video logs and trace runs 00:05:28 - Starting test case execution and opening KNCLI in interactive mode 00:07:21 - Initializing KNCLI session within agent environment 00:08:35 - Demonstration of KNCLI aiding AI agents in building and testing end-to-end workflows 00:09:23 - Order placement and test data generation for checkout 00:10:02 - First workflow completed and preparing for second step 00:10:45 - Workflow successfully completed and test passed
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
CLI Ownership Management: master, owner, and session Commands for Self-Hosted Wallets
Learn to manage CLI ownership for self-hosted wallets with master, owner, and session commands to control access and security
Dev.to AI
📰
Our drift-warning hook was silently dead for 23 days. Zero warnings looked exactly like good behavior.
Learn how a silently dead drift-warning hook can mimic good behavior and what steps to take to prevent and detect similar issues in your system.
Dev.to AI
📰
Spotify expands its AI push with a ChatGPT-like music assistant
Spotify launches a ChatGPT-like AI music assistant for Premium users to discover music and podcasts
TechCrunch AI
📰
A practical checklist for evaluating an OpenAI-compatible AI API gateway
Learn how to evaluate an OpenAI-compatible AI API gateway with a practical checklist, ensuring safe and effective testing
Dev.to · Alex

Chapters (9)

Exploring the challenge of validating autonomous agent-built applications
3:41 Markdown-based TestMD framework integration for CI/CD
4:08 Shareable evidence through video logs and trace runs
5:28 Starting test case execution and opening KNCLI in interactive mode
7:21 Initializing KNCLI session within agent environment
8:35 Demonstration of KNCLI aiding AI agents in building and testing end-to-end wor
9:23 Order placement and test data generation for checkout
10:02 First workflow completed and preparing for second step
10:45 Workflow successfully completed and test passed
Up next
Build AI Agents in 2 Minutes using Microsoft Foundry
Rajeev Kanth | BEPEC
Watch →