Posted On: Oct 21, 2021
You can now manage Amazon Step Functions workflows in the Amazon Batch console, where you can automate Batch jobs to help build long-running business-critical workflows that require machine learning, data analysis or overnight batch processing.
Amazon Batch is a cloud-native batch scheduler that some - scientists, financial analysts, or developers, from enterprises to startups - can use to efficiently run batch jobs on Amazon Web Services. Amazon Step Functions is a low-code visual workflow service used to orchestrate Amazon Web Services, automate business processes, and build serverless applications.
Organizations use Amazon Batch and Amazon Step Functions together to build scalable, distributed batch computing workflows. Amazon Batch plans, schedules, and executes your batch computing workloads across Amazon Web Services compute services and features, such as Amazon Fargate and Amazon EC2. With Amazon Step Functions, you can compose workflows that integrate with multiple services, handle errors, and automatically scale to meet your business needs. Together, you can use Amazon Step Functions to preprocess data as part of your workflow then use Amazon Batch to handle the large compute executions providing an automated, scalable, and managed batch computing workflow.
Now you can visualize where and how your Batch jobs are composed into workflows without leaving the Batch console. You can navigate more easily between your Batch jobs, the workflows they are involved in, and add their workflow executions, bringing together two core Amazon services to streamline management of your business-critical workflows. With Amazon Batch, there is no need to install and manage batch computing software or server clusters that you use to run your jobs, allowing you to focus on analyzing results and solving problems.
To get started, open the Workflow Orchestration page in the Batch console. If you are new to Step Functions, select Orchestrate Batch jobs with Step Functions Workflows to deploy a sample project.
This feature is available in all regions where both Amazon Step Functions and Amazon Batch are available, including Amazon Web Services China (Beijing) Region, operated by Sinnet and Amazon Web Services China (Ningxia) Region, operated by NWCD.
To learn more, read the Orchestrating Batch jobs section in the Batch developer guide.