Amazon FSx is a fully managed file storage service provided by Amazon Web Services (AWS), offering scalable file storage for use with Amazon EC2 instances and on-premises servers. It delivers high-performance file systems compatible with various applications and workloads, leveraging cutting-edge AWS compute, networking, and disk technologies to optimize performance and reduce the total cost of ownership (TCO).
Amazon FSx for Lustre specifically caters to high-performance computing (HPC), machine learning, and video processing tasks. It provides high-performance file systems built on the Lustre file system, ensuring optimal performance for compute-intensive workloads.
This Cloud Lab is focused on FSx for Lustre, which provides high-performance file systems built on the Lustre file system and optimized for compute-intensive tasks like high-performance computing (HPC), machine learning, and video processing. You will start the lab by setting up an S3 bucket to store the dataset and configuring security groups for FSx and EC2 instances to ensure secure access. Then, you’ll proceed to configure FSx for Lustre and set up two instances: one for training a model using the dataset and another for hosting an application that utilizes the trained model to make predictions.
By the end of this Cloud Lab, you will have gained practical experience utilizing Amazon FSx for Lustre and can configure FSx for Lustre effectively in your projects, ensuring optimal performance and scalability for compute-intensive workloads.
The provisioned infrastructure diagram at the end of this Cloud Lab will be as follows:
