In my previous article I detailed sending datasets to non-AWS S3 object storage. While working on that project I ran into another issue with the aws_s3 ansible module. The lack of a HEAD operation to pull metadata from a bucket or object.by
At Storage Made Easy we work/partner with many Object Storage vendors.
When a project required data automation and the use of an on-premises object storage buckets, I turned to Ansible and our storage partners. However, I found that the aws_s3 module for Ansible wasn’t as friendly and well documented when working with S3 object storage that isn’t either AWS or Ceph.by
Without a doubt Amazon S3 Object Storage is the big gorilla of the storage world. Many companies, large and small, are using it to store data.
One of the challenges of using Amazon S3 has been how to secure it and how to securely share from it. There have been far too many articles with regards to S3 breaches because of mis-configuration which have been well documented, although Amazon have tried to help combat this with its recent announcement regarding public access setting for S3 buckets.
There are those that think that S3 security is flawed by design. The simple purpose of this post is to present ways in which the Enterprise File Fabric helps to make S3 data more secure.by
It is not unusual for companies to have a need to share sensitive documents either with employees or external companies / partners. Even if the link sharing is ultra secure, once the document is available outside of the security of the company perimeter all control of the document has vanished.
This is where the Enterprise File Fabric DocumentSafe feature comes in. It provides a way to securely share documents (that may be stored on any on-premises or on-cloud documents storage) that can only be viewed by the intended recipient and are marked in such a way that makes the document traceable.by
This user case study focuses on a top tier Media company which has grown from a small digital distribution company in Los Angeles to a global media services, distribution, and software solutions company, aggregating and delivering film and television digital assets on behalf of major studios, broadcasters and streaming providers to more than 600 platforms around the world.by
Object storage platforms, such as Amazon S3 are evolving at a rapid pace. The Amazon S3 API has become a de facto standard alongside other platform like OpenStack Swift and Ceph, and with that progression, it brings us many new features and integrations.by
For those folks who use and know Amazon S3 they will be aware and know about multi-part uploads. Multipart upload enables the uploading of a (normally large) single object as a set of parts.Continue reading “Uploading to remote AWS S3 regions from EC2 is throttled to 598 MBps (~5Gbps)”by