latentbrief
Back to news
Launch7h ago

Amazon SageMaker AI Supports OpenAI API

Amazon Web Services (AWS)1 min brief

In brief

  • Amazon SageMaker AI now supports OpenAI-compatible API for real-time inference endpoints.
    • This means users can invoke models on SageMaker AI by changing only their endpoint URL.
    • This change matters because it allows users to run AI models on dedicated GPU instances in their own account.
  • They can host multiple models on a single SageMaker AI endpoint using inference components.
  • Each model gets its own resource allocation and is callable through the same OpenAI SDK.
  • Users can now create time-limited bearer tokens for their endpoints and use them with OpenAI clients.
    • This makes it easier to deploy and invoke AI models without needing custom clients or code rewrites.
  • New AI applications will be built using this feature.

Terms in this brief

SageMaker AI
A service by Amazon Web Services (AWS) that provides tools and infrastructure for building, deploying, and managing machine learning models. It allows developers to easily integrate AI capabilities into their applications using a variety of machine learning frameworks.
OpenAI API
An application programming interface provided by OpenAI that enables interaction with its large language models (LLMs), such as GPT-3 and GPT-4, allowing developers to integrate AI-driven features like text generation into their own applications.

Read full story at Amazon Web Services (AWS)

More briefs