Announcing OpenAI-compatible API support for Amazon SageMaker AI endpoints

📰 AWS Machine Learning

Amazon SageMaker AI now supports OpenAI-compatible API for real-time inference endpoints, making it easy to integrate with existing tools and frameworks

intermediate Published 20 May 2026

Action Steps

Invoke models on SageMaker AI using the OpenAI SDK by changing the endpoint URL
Use LangChain to integrate SageMaker AI endpoints with your existing workflow
Configure Strands Agents to work with SageMaker AI endpoints using the OpenAI-compatible API
Test your existing code with SageMaker AI endpoints to ensure seamless integration
Deploy your models on SageMaker AI and use the OpenAI-compatible API for real-time inference

Who Needs to Know This

Machine learning engineers and developers can benefit from this update, as it simplifies the integration of SageMaker AI endpoints with popular tools like OpenAI SDK, LangChain, and Strands Agents

Key Insight

💡 SageMaker AI endpoints can now be invoked using the OpenAI SDK, LangChain, or Strands Agents with minimal code changes