Docs
We make it easy to connect to your AWS S3 bucket using IAM access keys that you provide. Your S3 bucket remains fully under your organization's control—it's created, owned, and governed by you. While MLADU does not modify the bucket's properties, security settings, or contents, we're here to ensure your data transfer processes are efficient, secure, and seamless.
To optimize your data transfer experience, we recommend using a dedicated S3 bucket exclusively for MLADU transfers. This minimizes the risk of data collisions and ensures your organization's workflows in other buckets remain uninterrupted.
For enhanced security, we advise creating new IAM access keys specifically for each data transfer. After the transfer and data validation are complete, these keys should be securely destroyed. This practice protects your infrastructure while maintaining the integrity of your operations.
MLADU leverages AWS checksum values to verify the accuracy and integrity of your data during transfers. For every transfer, a detailed manifest is published, providing a clear record of your files.
MLADU adheres to AWS file size limitations, ensuring compatibility and reliability. Currently, individual AWS S3 objects can range from 0 bytes to a maximum of 5 TB. The largest file that can be uploaded in a single PUT operation is capped at 5 GB, in line with AWS guidelines. Please note that these limitations are subject to change based on AWS policy updates.
Topics