I Built an LLM Drift Detector — It Caught GPT-4o Changing Behaviour in Production

The story of building an automated regression testing system for LLMs — and what it found when it watched GPT-4o for 30 days.