Posted On: Sep 23, 2021
You can now get real-time inference results from your models hosted by Amazon SageMaker directly from Amazon SageMaker Studio, in the Amazon Web Services China (Beijing) Region, operated by Sinnet, and the Amazon Web Services China (Ningxia) Region, operated by NWCD.
Amazon SageMaker is a fully managed service that provides developers and data scientists the ability to quickly build, train, and deploy machine learning (ML) models. Amazon SageMaker Studio provides a single, web-based visual interface where you can perform all ML development steps. Once a model is deployed to SageMaker, customers can get predictions from their models deployed on SageMaker real-time endpoints. As part of model development and verification, customers want to ensure inferences from the model are returning as expected from the endpoint. Previously, customers use third-party tooling such as curl, or write code to invoke the endpoint from Jupyter Notebook to the SageMaker endpoint to obtain inferences from a deployed model. Now, customers can provide a JSON payload, send the inference request to the endpoint, and receive results directly from SageMaker Studio. The results are displayed directly in SageMaker Studio and can be downloaded for further analysis.
Once a model is deployed to SageMaker, customers get an endpoint that can be used for inference. As part of model development and verification, customers want to ensure inferences from the model are returning as expected from the endpoint. Previously, customers use third-party tooling such as curl, or write code to send requests from Jupyter Notebook to the SageMaker endpoint to obtain inferences from a deployed model. Now, we’ve made this easier by enabling customers to provide a JSON payload, send the inference request to the endpoint, and receive results directly from SageMaker Studio. The results are displayed directly in SageMaker Studio and can be downloaded for further analysis.
This feature is generally available in all regions where SageMaker and SageMaker Studio is available, including in the Amazon Web Services China (Beijing) Region, operated by Sinnet, and the Amazon Web Services China (Ningxia) Region, operated by NWCD. To see where SageMaker is available, review the region table. To learn more about this feature, please see our documentation. To learn more about SageMaker, visit our product page.