How to Optimize S3 and S3 Compatible Object Storage Solutions for End User Access with Hundreds of Millions of Files

Amazon S3 hierarchies performanceThe Enterprise File Fabric is often used with Object Storage solutions, particularly Amazon S3 but also S3 compatible object solutions that may be deployed on-premises.

More and more unstructured data stored on S3 object systems is not always just a backup or archive and there is increasingly a requirement to provide real-time access to unstructured data to end users.
Continue reading “How to Optimize S3 and S3 Compatible Object Storage Solutions for End User Access with Hundreds of Millions of Files”

Facebooktwitterredditpinterestlinkedinmailby feather

Using Rclone with the SME S3 Drive for Perfect Data Migrations

Amazon S3 DriveHere at Storage Made Easy we can quite often get involved in helping a customer clone, or move, their data from one storage provider to another. This is often a one time operation, and we have a number of in-house apps and scripts that we are able to use but today I’d like to discuss a third party free solution called  Rclone.

Continue reading “Using Rclone with the SME S3 Drive for Perfect Data Migrations”

Facebooktwitterredditpinterestlinkedinmailby feather

Using Ansible with On-premises S3 Object Storage

At Storage Made Easy we work/partner with many Object Storage vendors.

When a project required data automation and the use of an on-premises object storage buckets, I turned to Ansible and our storage partners.  However, I found that the aws_s3 module for Ansible wasn’t as friendly and well documented when working with S3 object storage that isn’t either AWS or Ceph.

Continue reading “Using Ansible with On-premises S3 Object Storage”

Facebooktwitterredditpinterestlinkedinmailby feather