Posted on

Migrating and Tiering Video Data with Object Storage and the Storage Made Easy InfiniDrive

InfiniDriveChallenge

A blue-chip services organization receives, processes and shares almost 1/2 TB of new video each day. That’s hundreds of thousands of files from thousands of remote cameras. Their issue was that as the volume increased the existing file-based storage platform could not keep up. It would take up to a minute for videos and images to be retrieved, severely impacting worker productivity. The storage also become more expensive to maintain, in part because it was difficult to scale.

The company moved to object storage to reduce costs whilst also increasing performance and scalability. Unfortunately, the custom applications that ingested, processed and distributed video and images were written for the file-based storage. This left a gap in the ability to fulfill the storage use case and to proceed effectively with the migration.

Continue reading “Migrating and Tiering Video Data with Object Storage and the Storage Made Easy InfiniDrive”

Facebooktwitterredditpinterestlinkedinmailby feather
Posted on

Editing Office files on iOS and Android from OpenStack and other Object Storage Clouds

More and more companies are turning to Object Storage to handle the growing amounts of structured and unstructured data that is corporately generated and consumed.

As companies move to this new storage paradigm IT is struggling  to not only manage, index, and secure the newly migrated / stored data, but also having difficulty with figuring out how they can expose access to users.

Continue reading “Editing Office files on iOS and Android from OpenStack and other Object Storage Clouds”

Facebooktwitterredditpinterestlinkedinmailby feather
Posted on

Cloud Storage Security concerns ? Why Hybrid Cloud offers the best of both worlds

Hybrid Cloud

With the recent celebrity photo scandal fresh in the minds of companies who are either using or anticipating moving to use Cloud questions regarding security, architecture and governance are fair  ones to ask.

Without a doubt cloud computing offers advantages to companies that encompass ease of use, productivity and cost savings, however companies have concerns about if, how and where they store their sensitive data. This is where hybrid cloud can play a part.

What is Hybrid Cloud ? Hybrid Cloud essentially continues to offer businesses all the benefits associated with the public cloud whilst enabling them to continue to have choices of storing certain types of data privately.

The benefits of a hybrid cloud strategy are that it addresses the security concerns of sensitive data whilst offering a dual strategy, unlike a pure private cloud implementation.

The Storage Made Easy Enterprise File Fabric provides such a public / private hybrid cloud solution but takes it a step further in the following ways:

– The File Fabric integrates with many existing private data applications and public cloud solutions. Private data application examples are SMB, CMIS, SharePoint, FTP and NAS/SAN. Public cloud solution examples are Amazon S3, RackSpace Cloud Files, Google Storage, Azure Blog Storage, Salesforce etc. The File Fabric does not force you to work with other storage or data that comes with the solution. The File Fabric is storage agnostic and it works with what data sources exist within a company.

integrate clouds

-The File Fabric offers a control point for all corporate data wherever it is stored. As  a control points Storage Made Easy can be configured to audit log all file events which can be exported as an excel file or as Syslog events for use with Business DashBoards. It also enables encrypting of sensitive files through the gateway that reside on public cloud Apps, or the choice of keeping these files entirely private behind the firewall but still accessible. GEO location tracking and restrictions are also built into the platform as is secure file sharing across all data stores enabling a common file sharing policy to be set.

Cloud Control

– The File Fabric provides a single pane of glass into all cloud services  and integrates into corporate identity management systems such asSAML,  LDAP and Active Directory. It can function as a public and private cloud data control point and can also be set to enable users to add their own consumer cloud accounts if this is a company policy, and it can track which corporate documents are moved, or shared, into a users consumer cloud account.

single pane of glass

– More effective governance is provided as the File Fabric not only provides the flexibility and security of the hybrid cloud model, it also provides a cloud control point for existing private data and public cloud data sets.

 

 

Facebooktwitterredditpinterestlinkedinmailby feather
Posted on

Using Midnight Commander to work with Amazon S3, OpenStack, DropBox, OneDrive and almost any other Cloud

Midnight Commander is probably the most popular command line file manager in the world, and certainly for Linux distros. Its design was initially inspired by the classic two pane interface that was found in Norton Commander which was a DOS file manager (for those who remember !).

One of the unsung features of the Midnight Commander (also available on other platforms including phones (I used to use this on my old Nokia N900) and windows and mac) is that it can connect to server over FTP.

This is interesting from a Storage Made Easy viewpoint as although SME providers a full suite of Linux tools, SME also provider protocol interoperability as part of its Cloud Gateway features. What is this I hear you ask ? Well, simply put, it enables files you have stored on public or private storage to be accessible over any of the protocols Storage Made Easy exposes ie FTP, FTPS, WebDav, S3, SFTP.

SME Protocol Gateway

Midnight Commander supports the FTP protocol which makes it easy to get direct access to any storage that is added to a SME Account using the SME FTP cloud protocol adaptor. To do this:

Choose the Left or Right option
Choose FTP link
Enter connection to SME as follows:

username:password@storagemadeeasy.com

or if you are using the SME EU Server:

username:password@eu.storagemadeeasy.com

Midnight Commander FTP

The net result is a very easy way to bring the cloud into the linux desktop integrated with tools you already know and use. This can be used with the SME Personal CLoud plan, Business Team, and on-site enterprise editions of the product.

Facebooktwitterredditpinterestlinkedinmailby feather
Posted on

In a post PRISM world why your Company needs joined up File Sharing and Governance

The recent controversy with regards to Prism and data snooping has brought the security of corporate data to the fore however the biggest threat to corporate data lies not with the corporate nemesis that is Prism but with the number of data leaks that occur every day in companies.

These include new phenomena such as Bring Your Own Device (BYOD) and Bring your Own Cloud (BYOC) as well as the thorny issue of what files are shared over email.

Data is any companies biggest asset and not controlling how corporate data is disseminated is a ticking time bomb waiting to explode in your company. Why? Take your pick, Legislative reasons, fraudulent reason, competitive reasons. There are many reasons why not controlling data dissemination could trip your company up.

Companies need to consider how to build an Effective data governance serves ACROSS their enterprise data silos. Doing so will define a cohesive set of parameters for data management, data usage, as well as the ability to create governance processes for a companies internal use, and for their supply chain, which ultimately leads to information assets that are well managed.

SME Data Governance framework

In the world of Cloud it is key that Data Governance and data policies work not only with data behind the corporate firewall but also cloud data and cloud services.

So what should you consider as a company to manage your data assets ?

1. Understand what information is sensitive across all data silos, have a federate access control mechanism that works with your user across this private and cloud data silos. Storage Made Easy provides such a federate mechanism to assign and control user permissions and access at a very granular level that overlays one or more data stores.

SME federate permissions

2. Set policies for data access and enforce them through common tools. For employee sharing of data through tools such as email, make it easy but also set policies that can define expiry time and password protection. Storage Made Easy has plug in’s for Microsoft Outlook and Mac Mail that enables productive file sharing across all cloud / private data but which has built in support for policy enforcement.

Mac Mail large file sharing

These policies should also ripple through to the mobile Applications used in a company:

iOS secure file sharing

3. Use Cloud Encryption for sensitive data and ensure that you control the private key. See our previous post on encryption and securing data for further information.

Cloud File Encryption

4. Audit all your company data. Irrespective of the policies set you should get in the habit of auditing your company data. SME enables the setup of an automated email to a specified user of the previous day file events such as sharing, files updated etc.

Cloud Storage Audit Log

5. Set BYOD policies and device access policies that work like your company works. For example, have a contract firm that you gave access to a specific folder ? Then designate that they can only access the folder using a web browser and only from a specific IP address.

BYOD GEO Restrictions

Summary

Companies need to connect disconnected information to enable corporate governance.

Cloud Corporate Governance

Facebooktwitterredditpinterestlinkedinmailby feather
Posted on

Thoughts on Amazon’s new onsite Storage Gateway announcement

Amazon Web Services has announced that it now offers a new storage gateway appliance (virtual machine image) that can be placed on a customers site. What benefit is this ? It really provides an easy way to integrate local storage or systems with the facility to replicate data to the Amazon Cloud. For example you could add the technology to an existing data center so that it resided between servers and storage  so that you could easily start replicating data to Amazon S3.

Note,however,these are actually stored as EBS Volumes. So although users can access data stored in this fashion locally from the gateway, if they wish to access this data directly through AWS they would need to start an EC2 instance and attached the EBS volume. . This in and of itself makes it easier to then integrate S3 stored data with other AWS services (if this is important to you). Note that this is not ‘replacing’ what you already have (ie. “great, I can just use the Cloud”), it is in addition to what you already have.

Firstly lets look at what the requirements are to host the Gateway.  These are:

  • VMware ESXi hypervisor (v4.1) on a physical machine with at least 7.5GB of RAM
  • Four (4) virtual processors assigned to the appliance VM along with 75GB of disk space for the Open Virtual Alliance (OVA) image installation and data.
  • A “proper” sized network connection to Amazon.
  •  iSCSI initiators on either Windows server 2008, Windows 7 or Red Hat Enterprise Linux

(Also note that the Gateway beta is optimised for block write sizes which are more than 4Kb.  AWS warns that using smaller I/O sizes are likely to cause overhead which can result in storage space that is effectively ‘lost’. This means that prior to installation there needs to be a check made on the file systems / volumes to ensure they can use the larger allocation sizes).

Firstly we’d like to point out that it’s great to see Amazon adding their own on-premise Cloud Gateway. It’s great to see them competing with the likes of  EMC, TwinStrata, and Nasuni. It would have been nice to see NFS or CIFS supported as interfaces, as from our own interactions with customers, we believe that is what customers really want to see, but maybe we can expect to see that added as the Gateway offering matures.

(Differences between iSCSI & NFS: iSCSI and NFS both allow storage access over an IP networking infrastructure. The difference is that iSCSI enables block storage transfer whereas NFS and CIFS transfers files.)

Many customers may find that they already have the capabilities for which they would use the Gateway, such as snapshots, backup and archiving, which is a pretty old, mature and I would expect a little more cost effective mechanism of achieving similar goals. However with that said we can see many use case where, with our own Cloud File Server Appliance where customers will really embrace the Gateway.

So where does the AWS Cloud Gateway end and the SME Cloud Appliance begin ? Well, the first things to understand about the SME Cloud Appliance is that it acts at a layer ‘above’ the storage. It provides a mechanism to unify disparate data sources into one file tree, add unified user access management and permissions, add unified governance and e-compliance, has focus on enabling companies to manage ‘Cloud Sprawl’, and leverages the ability for companies to let staff “bring your own device” (BYOD). In short, as I often say when asked to comment about Storage in general, the response is “it’s all about the App”. Storage in and of itself is not a single source in companies and secondly having things stored is no good unless you have unified, search, logic, control and anytime anywhere access that supports all desktops and all devices. This is what we essentially are bringing to the table with our Cloud File Server Appliance.

To take advantage of the Amazon Cloud Gateway what would be required is for us to connect to the local iSCSI stored data within the Gateway and this is something we will be looking to do in the short term.

For further information see the Amazon Cloud Gateway Storage FAQ’s. Also note that Amazon are also doing a free webcast on 23rd February.

 

Facebooktwitterredditpinterestlinkedinmailby feather
Posted on

Cloud federation and governance will dominate in 2012

It’s seasonally topical to write a blog post that will draw a close to the old year with some predictions for the New Year, so read on for a post that fits with that trend…

2011 has been an eventful year for SMEStorage. On the business side we have always been a privately owned self funded company. We have never been VC backed and we’re profitable and have needed to be to be self sufficient. To enable us to expand the founders took a decision to raise some money to enable the company to continue to grow and expand the company. To this end Vehera, the owning entity of SMEStorage sold a small amount of equity enabling Vehera to raise a million dollars to fund the companies push for 2012. This will give the ability to add some more staff to enable us to grow the opportunity we see for our technology with ISP’s and the Enterprise.

On the Technology front we continued building out our support for Cloud’s resulting in SMEStorage now supporting over 35 Storage and SaaS Clouds. We also released a native Windows Phone Client,and also the first versions of Mac and Linux Cloud Tools and we enhanced our native browser plug in’s with support for Google Chrome and Safari. We also enhanced our iOS App for iPhone and iPad many times over the course of the year as well as releasing a native Android client for Phones and tablets. In addition to all of this we also improved our core offering with a myriad of new features which included adding protocol adaptors that exposed Clouds mapped to SMEStorage over WebDav, FTP or the Amazon S3 API, even if the underlying Cloud does not natively support these protocols.

So what for 2012, well, firstly we’ll continue to add more services that can be federated and managed. Shortly we’ll be announcing support for SugarSync, and the UbuntuOne Cloud. We’ll also be adding services less traditionally associated with file stores. The first of these will be BaseCamp, which will be followed by some CRM SaaS services and we have in mind another project / collaboration SaaS tool.

We’ll also be adding even more Cloud governance and e-compliance features. If your interested on our take on Cloud Sprawl and governance please see our prior blog post on this subject.

We intend to push out our revised Cloud Appliance in early 2012. This will give any customer the ability to have a hybrid Cloud governance application that deals with Cloud and local data and service federation that they fully control and own. Customers will be able to host this in their own data centre as it will be available as a VMWare, XEN or KVM appliance. As an alternative we intend to enable easy access to an Amazon EC2 based instance. We also intend to make it easy for resellers to get their ands on it and offer it as a value add to their own business.

It’s our firm belief that with the greater adoption of Cloud, and the increasing array of Cloud Services that 2012 will be the year of Cloud Federation and governance as companies struggle to manage and control the Cloud services deployed in their organisation. We believe that with our advanced service features, comprehensive access clients, and Hybrid on-premise Cloud Appliance that we are well placed to help companies who struggle with these issues.

For general predictions, we’ll make just one, and that is that the “free lunch” is coming to an end. In a volatile economy services that offer “free” may look appealing, but all businesses need to make money to survive and free eventually needs to become paid, and companies need a solid business model to survive. Hoping to capitalise at some point on a large user base of free users is not a business plan. There is room for some element of freemium, we use it ourselves, but our belief is that it has to be underpinned by a solid business plan. If you’d like to read more about this, see this post which goes into a little more depth.

All that remains to be said is to wish you all a “Happy New Year” and we hope all your hopes and dreams are realised in the forthcoming year.

Facebooktwitterredditpinterestlinkedinmailby feather
Posted on

Bring your own Device is changing Enterprise IT

In the not to distant past most companies had a unilateral policy on cell phones. You were given one by the company and it was a BlackBerry, or it was a Windows Mobile etc, and there was a mandate that you had to use it. The company provided it, you used it, and more often than not you walked around with another personal phone that you actually wanted to own and use.

Today, more and more companies are adopting a BYOD or ‘bring your own device’ approach. The Apple iPad was pinpointed, by research Forrester did on the subject, as what started to consolidate the shift that was preceded by the iPhone, as company executives brought it with them to the office and challenged IT to support it.

Far from IT departments having the ability to strictly dictate the mobile of their ecosystems, they are being challenged by personal smartphone preference. The Forrester report cites 59 percent of companies that were surveyed enabled employees to bring their own phones to work.

Another factor is the rise in remote or on-the-move working. Whereas in the past company workers had found themselves logging onto the corporate VPN from a laptop or PC, many companies use Google Docs or Hosted SharePoint making access easier to “just connect” using web security protocols such as OAuth. Many analysts and government bodies are predicting this as being the future of IT.

We’ve long been an advocate of this ‘martini’ anytime/anywhere type policy of working with data from mobile devices. It’s the future, plain and simple. This is why we very early built out a comprehensive mobile strategy that focused on supporting all the major mobile devices ie. iOS, Android, BlackBerry and Windows Phone.

It’s also the reason why we’ve concentrated on providing governance and e-compliance features that work against what we believe will become the real challenge of corporate IT, that of the sprawl of public and private Cloud Services.

We will continue to focus on this throughout 2012 and broaden not only our supported data cloud offerings but we will also also release support for other SaaS services, some of which are in beta now with some of our customers.

We will continue to expand governance options and integration with Corporate IT, and best of all if you want to host all this in your own data centre, you can using our Cloud Appliance which supports VMware, XEN, and KVM environments.

We believe 2012 will be looked back on as the year that two key themes converged in corporate IT, that of mobile working and Cloud Computing, and we are looking forward to working with existing and new customers to support it.

Facebooktwitterredditpinterestlinkedinmailby feather
Posted on

How to make sure your Cloud data does not disappear overnight

If you you’ve been following the IT news recently you probably saw the issue that users recently had with GMail. If not you can read more about it here. Imagine one morning firing up your Android phone or laptop and finding your data was gone!

Of course, this does not just affect email systems. It can affect any cloud service you store data with. Carbonite was another high profile example of data loss, and of course there are many others, and no doubt there will be many more.

So what can you do to prevent such loss? Well, you can backup! Exactly like you do with your laptop. At SMEStorage all users, including free users, can backup their emails to their storage cloud of choice, as long as their email provider supports IMAP, the user can start or schedule a backup and just leave it to complete. An effective solution to a horrible problem should it ever arise.

What about you Cloud data? Well, our Personal Cloud Lifetime and business users can choose to ‘pair’ a backup cloud with a primary cloud. This will instantly schedule a sync of all existing data to a backup cloud, and it will also backup any future data uploaded, giving you total piece of mind that your Cloud data is highly available as a backup copy is stored on another cloud. this could be Amazon S3 and RackSpace for example, or MobileMe to Azure Storage, whatever combination you would like to choose!

If you primary cloud goes down or your data is not available we’ll get it from your backup cloud.

The Cloud does not have to be a dangerous place, just take sensible precautions to protect your data.

Facebooktwitterredditpinterestlinkedinmailby feather