In my previous article I detailed sending datasets to non-AWS S3 object storage. While working on that project I ran into another issue with the aws_s3 ansible module. The lack of a HEAD operation to pull metadata from a bucket or object.by
At Storage Made Easy we work/partner with many Object Storage vendors.
When a project required data automation and the use of an on-premises object storage buckets, I turned to Ansible and our storage partners. However, I found that the aws_s3 module for Ansible wasn’t as friendly and well documented when working with S3 object storage that isn’t either AWS or Ceph.by
Object storage platforms, such as Amazon S3 are evolving at a rapid pace. The Amazon S3 API has become a de facto standard alongside other platform like OpenStack Swift and Ceph, and with that progression, it brings us many new features and integrations.by
For those folks who use and know Amazon S3 they will be aware and know about multi-part uploads. Multipart upload enables the uploading of a (normally large) single object as a set of parts.Continue reading “Uploading to remote AWS S3 regions from EC2 is throttled to 598 MBps (~5Gbps)”by
At Storage Made Easy we are best known for our Enterprise File FabricTM, but we also sell desktop only Drives and dedicated Explorers that make using object storage systems such as S3 and compatibles, Azure Blob Storage, Google Cloud Storage and OpenStack Swift from the Windows desktop simple. These desktop tools don’t need or use the File Fabric; you just install them, point them directly at your storage (on-premises or on-cloud) and they are ready for use.
FileBox is a feature that enables files to be emailed, from any standard email client, directly into any FileBox nominated folder, or shared team folder.
The Amazon S3 API has become the de-facto standard for object storage API access. As such, many software products adopt the S3 API first. The Storage Made Easy File Fabric provides an S3 compatible API endpoint for any storage backend. This means that non-S3 storage providers such as Dropbox, Azure, Google Drive, OneDrive, Sharepoint and others can now be accessed via the S3 API.
The Amazon Web Services (AWS) Command Line Interface (CLI) is a command line tool for accessing AWS compatible services. AWS CLI is one of the most feature rich S3 tools publicly available (Free!!!) .
This article will outline the setup AWS CLI with the SME File Fabric and non-S3 compatible storage providers.