AWS Storage Gateway

AWS Storage Gateway is a hybrid cloud storage service that enables on-premises applications to seamlessly access AWS cloud storage.

  1. Key Use Cases:
    1. Backup and Archival: Moving backups to AWS storage for durability and cost efficiency.
    2. File Sharing: Using file shares on-premises with AWS as the backend.
    3. Low-Latency Access: Providing low-latency access to AWS data by caching frequently accessed data locally.
  2. Supported Gateway Types:
    1. File Gateway: (Also known as S3 File Gateway) Bridges on-premises file storage with Amazon S3.
    2. FSx File Gateway: Provides on-premises access to Amazon FSx for Windows File Server.
    3. Volume Gateway: Offers block storage with backup to AWS using iSCSI.
    4. Tape Gateway: Migrates tape backups to the cloud with a virtual tape library (VTL).

alt text

1. Volume Gateway

  1. Uses the iSCSI protocol to provide block storage to your on-premises environment.
  2. Does not use NFS or SMB protocols.
  3. It Offers two modes, Volume Stored and Volume Cached.
  4. Volume Stored Mode
    1. Primary data is stored locally on-premises.
    2. Data is asynchronously uploaded to AWS for backup or archival.
  5. Volume Cached Mode
    1. Primary data is stored in Amazon S3.
    2. Only frequently accessed data is cached locally for low-latency access.

2. S3 File Gateway

  1. Provides a bridge between on-premises file storage and Amazon S3.
  2. Supported Protocols
    1. NFS: Commonly used in Linux environments.
    2. SMB: Primarily for Windows systems, with optional Active Directory integration.
  3. Use Case
    1. Files are stored locally for low-latency access and asynchronously uploaded to Amazon S3 as objects.
    2. Best for backup, archiving, and workloads that need access to data in S3 from on-premises.

3. FSx File Gateway

  1. Enables on-premises applications to access Amazon FSx for Windows File Server.
  2. SMB is the Supported Protocol used to seamless access to Windows file shares.
  3. Use Case:
    1. Provides low-latency access to FSx file shares for Windows-based workloads.
    2. Ideal for migrating Windows workloads to the cloud or supporting hybrid environments for legacy applications.

4. Tape Gateway

  1. Designed for migrating tape backups to the cloud.
  2. Does not support NFS interfaces.
  3. Features
    1. Provides a Virtual Tape Library (VTL) interface.
    2. Compatible with most backup software.
    3. Virtual tapes are stored in Amazon S3 or Amazon S3 Glacier for cost-effective archival storage.

5. NFS vs SMB Vs iSCSI Protocols

  1. iSCSI, NFS, and SMB protocols provide access to storage resources via a TCP/IP network.
  2. While iSCSI provides block device access, NFS and SMB are file-level access protocols.
Protocol AWS Services Use Case
NFS
  • Amazon EFS
  • Amazon FSx for Lustre
  • Shared file storage for Linux/Unix instances.
  • High-performance file system for large-scale workloads.
SMB
  • Amazon FSx for Windows File Server
  • Amazon WorkDocs
  • Managed file storage for Windows-based workloads.
  • Collaboration and file sharing for Windows workloads.
iSCSI, Pronounced as eye-scuzzy
  • Amazon EBS
  • AWS Storage Gateway (Volume Gateway)
  • Amazon FSx for Windows File Server
  • Block storage for EC2 instances using iSCSI protocol.
  • Hybrid cloud storage for block-level access.
  • Block-level storage behind SMB-based file services.

6. Question S3 VPC gateway

A company runs a photo processing application that needs to frequently upload and download pictures from Amazon S3 buckets that are located in the same AWS Region. A solutions architect has noticed an increased cost in data transfer fees and needs to implement a solution to reduce these costs. How can the solutions architect meet this requirement?

  1. Deploy Amazon API Gateway into a public subnet and adjust the route table to route S3 calls through it.
  2. Deploy a NAT gateway into a public subnet and attach an endpoint policy that allows access to the S3 buckets.
  3. Deploy the application into a public subnet and allow it to route through an internet gateway to access the S3 buckets.
  4. Deploy an S3 VPC gateway endpoint into the VPC and attach an endpoint policy that allows access to the S3 buckets. (Correct Ans)

Explanation: The correct answer is Option 1. Deploy an S3 VPC gateway endpoint into the VPC and attach an endpoint policy that allows access to the S3 buckets.

By deploying an S3 VPC gateway endpoint, the application can access the S3 buckets over a private network connection within the VPC, eliminating the need for data transfer over the internet. This can help reduce data transfer fees as well as improve the performance of the application. The endpoint policy can be used to specify which S3 buckets the application has access to.

Option 1, deploying Amazon API Gateway into a public subnet and adjusting the route table, would not address the issue of data transfer fees as the application would still be transferring data over the internet.

7. Question: Amazon FSx File Gateway on premises

A company has more than 5 TB of file data on Windows file servers that run on premises. Users and applications interact with the data each day. The company is moving its Windows workloads to AWS. As the company continues this process, the company requires access to AWS and on-premises file storage with minimum latency. The company needs a solution that minimizes operational overhead and requires no significant changes to the existing file access patterns. The company uses an AWS Site-to-Site VPN connection for connectivity to AWS. What should a solutions architect do to meet these requirements?

  1. Deploy and configure Amazon FSx for Windows File Server on AWS. Move the on-premises file data to FSx for Windows File Server. Reconfigure the workloads to use FSx for Windows File Server on AWS.
  2. Deploy and configure Amazon FSx for Windows File Server on AWS. Deploy and configure an Amazon FSx File Gateway on premises. Move the on-premises file data to the FSx File Gateway. Configure the cloud workloads to use FSx for Windows File Server on AWS. Configure the on-premises workloads to use the FSx File Gateway. (Correct Ans) alt text

7. List of Gateways in AWS