The shift from working from an office to working from home / remotely due to the pandemic looks like it is here to stay for many companies, even post pandemic. End users have had to cope with moving from being always connected via a high speed line to SMB shares to working across consumer broadband from B2B2C file services. Prospects and customers have helped us create a pretty clear picture of the problems this has caused them and below we outline the top three things that we have been told:by
As pre sales engineers there are often times when we need to enable a prospect or customer to connect to the Enterprise File Fabric based on their specific infrastructure and requirements, often impacted by security and architectural topologies.
Recently I had to enable a customer to be able to synchronise local data from a windows server. Normally I would install the File Fabric’s sync app for Windows but there was a security requirement that meant no new software could be installed on this server, it was locked down.by
We recently announced a new release of the Enterprise File Fabric. Probably one of the most exhaustive updates so far. Focusing on pandemic related feature enhancements on remote working and cybersecurity, and providing a powerful combination of privacy and collaboration that works with a company’s existing file and object data sets.by
The Enterprise File Fabric provides a global file system through which users and applications can transparently access corporate file systems and object storage no matter where they or the storage is located. To provide universal browsing, search, and other services the File Fabric scans and smartly indexes file and object metadata. In this way, no data is copied or replicated, and the metadata is used to build out the high-performance global file system.
Unlike other global file system solutions, the File Fabric does not prevent direct access to the storage – what we call bi-model access. Data can be accessed and updated concurrently through the File Fabric and directly through native file and object-APIs. When objects are updated through native APIs the File Fabric metadata should also be updated to keep indexes and other metadata synchronized.
An earlier blog article outlined three general approaches for keeping metadata up to date, including a specific example using Amazon S3 object notifications. See Using AWS Lambda to Automatically Sync Metadata With S3 Events. This article describes a similar approach we have developed for file systems using the same framework we call Jibe.by
As, post Covid-19, more companies evaluate a ‘cloud first’ strategy and open up Object Storage access to end users, in addition to other strategic use cases, there are five things that Companies should check when assessing their access vendor of choice:by
Interest in letting employees to work from home has never been higher and will remain high even after the Covid-19 virus has run its course. For Companies large and small the key challenge is how to make Company data available remotely in a way that is easy for employees to use without compromising on information security. The Enterprise File Fabric™ offers an unmatched set of features to support secure remote working. In this post we’ll see how to set up the File Fabric in less than an hour to provide secure remote access to on-premises data, be that SMB, NAS / SAN or Microsoft DFS shares. The best part is that data is not copied or removed anywhere, it remains in the same secure place and the File Fabric provides web scale secure access to it .by
The Enterprise File Fabric indexes Amazon S3 metadata to provide a number of enhanced file services over S3 object storage including reading/browsing and searching. The File Fabric has its own indexing engine to provide these services.
Applications may update/upload/delete objects through the File Fabric or in a bi-modal fashion directly through S3 APIs. When objects are updated directly using S3 APIs the File Fabric metadata must also be updated. There are a number of ways that the metadata can be updated:by
More and more unstructured data stored on S3 object systems is not always just a backup or archive and there is increasingly a requirement to provide real-time access to unstructured data to end users.
Continue reading “How to Optimize S3 and S3 Compatible Object Storage Solutions for End User Access with Hundreds of Millions of Files”
You may have often found yourself on a linux console where you need access to a file that you have stored on Google Drive, an Amazon S3 or Azure instance, or perhaps you want to transfer a file back from a local file system to one of these accounts. In either case it would be good to be able to do this without installing and setting up additional software.by
Whether it is to detect if any corruption has occurred, through to establishing the security of a file transfer or ensuring that a file is fully formed, the Enterprise File Fabric is equipped to easily deal with media asset validation integrity.by
In my previous article I detailed sending datasets to non-AWS S3 object storage. While working on that project I ran into another issue with the aws_s3 ansible module. The lack of a HEAD operation to pull metadata from a bucket or object.by
At Storage Made Easy we work/partner with many Object Storage vendors.
When a project required data automation and the use of an on-premises object storage buckets, I turned to Ansible and our storage partners. However, I found that the aws_s3 module for Ansible wasn’t as friendly and well documented when working with S3 object storage that isn’t either AWS or Ceph.by