How to optimize S3 and S3 compatible object storage solutions for end user access with hundred of millions of files

Amazon S3 hierarchies performanceThe Enterprise File Fabric is often used with Object Storage solutions, particularly Amazon S3 but also S3 compatible object solutions that may be deployed on-premises.

More and more unstructured data stored on S3 object systems is not always just a backup or archive and there is increasingly a requirement to provider real-time access to unstructured data to end users.
Continue reading “How to optimize S3 and S3 compatible object storage solutions for end user access with hundred of millions of files”

Facebooktwitterredditpinterestlinkedinmailby feather

Using the File Fabric’s SFTP protocol adaptor to work with multi-cloud files from a Linux Console

multi-cloud SFTPSFTP is an acronym for the SSH File Transfer Protocol. SFTP is the preferred option to FTP because it is inherently more secure and is able to piggyback on an SSH connection.

You may have often found yourself on a linux console where you need access to a file that you have stored on Google Drive, an Amazon  S3 or Azure instance, or perhaps you want to transfer a file back from a local file system to one of these accounts. In either case it would be good to be able to do this without installing and setting up additional software.

Continue reading “Using the File Fabric’s SFTP protocol adaptor to work with multi-cloud files from a Linux Console”

Facebooktwitterredditpinterestlinkedinmailby feather

Media Focus: Validating Media Asset Integrity

Media AssetsOrganizations working with media assets often have a requirement to validate a file’s integrity.

Whether it is to detect if any corruption has occurred, through to establishing the security of a file transfer or  ensuring that a file is fully formed, the Enterprise File Fabric  is equipped to easily deal with media asset validation integrity.

Continue reading “Media Focus: Validating Media Asset Integrity”

Facebooktwitterredditpinterestlinkedinmailby feather

Using Ansible with On-premises S3 Object Storage

At Storage Made Easy we work/partner with many Object Storage vendors.

When a project required data automation and the use of an on-premises object storage buckets, I turned to Ansible and our storage partners.  However, I found that the aws_s3 module for Ansible wasn’t as friendly and well documented when working with S3 object storage that isn’t either AWS or Ceph.

Continue reading “Using Ansible with On-premises S3 Object Storage”

Facebooktwitterredditpinterestlinkedinmailby feather

Using the Enterprise File Fabric to make S3 or S3 compatible data more secure and easier to securely share

Without a doubt Amazon S3 Object Storage is the big gorilla of the storage world. Many companies, large and small, are using it to store data.

One of the challenges of using Amazon S3 has been how to secure it and how to securely share from it. There have been far too many articles with regards to S3 breaches because of mis-configuration which have been well documented, although Amazon have tried to help combat this with its recent announcement regarding public access setting for S3 buckets.

There are those that think that S3 security is flawed by design.  The simple purpose of this post is to present ways in which the Enterprise File Fabric helps to make S3 data more secure.

Continue reading “Using the Enterprise File Fabric to make S3 or S3 compatible data more secure and easier to securely share”

Facebooktwitterredditpinterestlinkedinmailby feather