AWS Batch

AWS Batch is a fully managed service that enables to efficiently run hundreds of thousands of batch computing jobs on AWS. It dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory-optimized instances) based on the volume and specific resource requirements of the batch jobs submitted.

Key Features

  1. Automatically provisions and scales compute resources based on job requirements.
  2. Organizes and prioritizes jobs in queues.
  3. Specifies how jobs are to be run, including parameters, environment variables, and compute requirements.
  4. Seamlessly integrates with AWS services like Amazon EC2, Amazon ECS, AWS Fargate, and Amazon CloudWatch.

Use Cases

  1. High-Performance Computing (HPC) like, Scientific simulations, genomics processing, and financial risk modeling.
  2. Data Processing like, ETL (Extract, Transform, Load) jobs, image and video rendering.
  3. Training models(ML) with large datasets.

Question - AWS Batch job

A company is migrating an old application to AWS. The application runs a batch job every hour and is CPU intensive. The batch job takes 15 minutes on average with an on-premises server. The server has 64 virtual CPUs (vCPUs) and 512 GiB of memory.

Which solution will run the batch job within 15 minutes with the LEAST operational overhead?

Options:

A) Use AWS Lambda with functional scaling.

B) Use Amazon Elastic Container Service (Amazon ECS) with AWS Fargate.

C) Use Amazon Lightsail with AWS Auto Scaling.

D) Use AWS Batch on Amazon EC2.

Correct Answer: D) Use AWS Batch on Amazon EC2.

Explanation: AWS Batch is specifically designed to efficiently run batch computing workloads, automatically provisioning the optimal quantity and type of compute resources based on the specific requirements of the jobs submitted. It is optimized for performance and will allow the batch job, which is CPU-intensive, to complete within the required 15 minutes while minimizing the operational overhead, as AWS Batch handles job scheduling and resource management without requiring manual intervention.