CloudFTP – Storage Made Easy Blog

November 11, 2020September 17, 2021

Customer Case Study – Data Management and Collaboration for Ceph and File Based Data Storage

ITRI (Taiwan Industrial Technology Research Institute), is a world-leading applied technology research institute which is also a key player in autonomous vehicle development.

Its technology combines real-time positioning, mapping technology, machine learning, and a range of sensors to simulate driving and capture test data in real world situations. This process generates massive amounts of data that need to be analyzed quickly and precisely, and here is where the the Storage Made Easy (SME) Enterprise File Fabric comes into play.

Continue reading “Customer Case Study – Data Management and Collaboration for Ceph and File Based Data Storage”

March 19, 2014

Using Midnight Commander to work with Amazon S3, OpenStack, DropBox, OneDrive and almost any other Cloud

Midnight Commander is probably the most popular command line file manager in the world, and certainly for Linux distros. Its design was initially inspired by the classic two pane interface that was found in Norton Commander which was a DOS file manager (for those who remember !).

One of the unsung features of the Midnight Commander (also available on other platforms including phones (I used to use this on my old Nokia N900) and windows and mac) is that it can connect to server over FTP.

This is interesting from a Storage Made Easy viewpoint as although SME providers a full suite of Linux tools, SME also provider protocol interoperability as part of its Cloud Gateway features. What is this I hear you ask ? Well, simply put, it enables files you have stored on public or private storage to be accessible over any of the protocols Storage Made Easy exposes ie FTP, FTPS, WebDav, S3, SFTP.

Midnight Commander supports the FTP protocol which makes it easy to get direct access to any storage that is added to a SME Account using the SME FTP cloud protocol adaptor. To do this:

Choose the Left or Right option
Choose FTP link
Enter connection to SME as follows:

username:password@storagemadeeasy.com

or if you are using the SME EU Server:

username:password@eu.storagemadeeasy.com

The net result is a very easy way to bring the cloud into the linux desktop integrated with tools you already know and use. This can be used with the SME Personal CLoud plan, Business Team, and on-site enterprise editions of the product.

March 10, 2014June 29, 2018

SFTP access to Cloud Storage

Storage Made Easy® have now made live a new SFTP protocol adaptor. SFTP is one of the two primary technologies for secure FTP networking, the other being FTPS, which Storage Made Easy already supports (along with FTP, WebDav, Secure WebDav and S3).

The primary reason we investigated implementing SFTP is due to a government POC in which access was required to secure AWSGov Cloud files from medical terminals. This was the primary requirement, but because Storage Made Easy works with almost any back-end Cloud. once added, it can be used as protocol gateway for any cloud mapped to an account, note that the Port is 2200

Below is an example of using the SFTP protocol to access a Storage Made Easy account using Transmit (a Mac App).

Once connected, all data and mapped clouds are accessible.

Access can also be done directly from the command line.

Once connected we can do an ‘ls’ to get a file listing and the view of the files is similar to our earlier UI view.

To find out more about the SME protocol gateway feature that is part of the File Fabric solution please check out the below video.

SFTP Cloud files Access is available for Files Fabric Enterprise, IaaS, UK Government G-Cloud, or SaaS (business plan only) solutions.

SaaS access to SFTP (for business plan users) can be achieved using the following URL’s:

US
sftp.storagemadeeasy.com

EU
sftpeu.storagemadeeasy.com

February 21, 2012February 21, 2012

PogoPlug Provider updated

We’ve enhanced the PogoPlug cloud provider so that as well as supporting PogoPlug appliances, we support also the newly announced PogoPlug Cloud. This means that you can use SMEStorage desktop and mobile access clients to manage your PogoPlug Cloud(s) and also business users can use PogoPlug as the data store for a Cloud File Server, and users who want ubiquitous access to PogoPlug from FTP and WebDav can use our CloudDav and CloudFTP protocol adaptors.

February 7, 2012

Cloud Computing Use Case: CCTV still images stored on Amazon S3 via FTP

Continuing our theme on Cloud Computing user cases, this one makes use of the SMEStorage CloudFTP protocol adaptor that adds the ability for any Cloud that SME supports to be accessible from the ubiquitous FTP protocol. For this particular use case, we now have had four businesses using SMEStorage as enabler for using S3 via FTP so we thought it would be useful to highlight.

The use case revolves around CCTV cameras that monitor a property and are configured to take pictures (.jpg files) at either intermittent points and/or on movement detection. Currently 2 of the businesses used sensr.net and two where using FTP from an ISP, but all were looking at Amazon S3 and trying to figure out how to get there images onto S3, given S3 does not support FTP.

Interestingly they had tried automated scripts and other mechanisms but none had really worked. At this point they discovered CloudFTP which simply adds FTP access to S3 (and any other Clouds SME supports).

Everything is accessed using standard FTP and using standard ports (and secure ports for FTPS).

After registering for a SMEStorage Account, adding their S3 account and then purchasing CloudFTP and then adding the correct FTP configuration to the CCTV hardware, this was done.

A Simple but effective use of the Cloud.

February 2, 2012February 2, 2012

Turning any Storage Cloud into an Amazon S3 compatible Private, Public or hybrid Cloud

In the past we have written about Amazon S3 and how, aas the 100 pound gorilla, of the Cloud Storage world, it’s S3 API has become almost a de facto interface for developers. This is one of the reasons that we originally added an S3 API protocol adaptor to our service.

Many start up’s, small businesses and even enterprises choose initially to use S3 for storage. This can be fine initially, however, when the volume increases the monthly bill can become an OPEX issue and small companies (and Enterprise) are looking for ways to slash their costs in any way they can. Aside from this other companies have stringent issues about where data is stored (for clarification, Amazon S3 is PCI DSS 2.0 compliant, SAS 70 Type II certified, and VPV ISO 27001 certified) or wish to store it within their own data centre or site.

As SMEStorage supports over 35 Clouds and SaaS services, you could very easily turn Google Docs, Box, Windows Azure or DropBox into an S3 Platform, or you could just add your own NetGear or PogoPlug appliance, or other private storage implementation.

The SME hosted service, and Cloud Appliance, provides the ability access to any Saas or cloud storage mapped to your account via multiple protocols. These include FTP, WebDav and also S3. These work even if the backend provider does not support the protocol natively. The SME protocol adaptors will do the protocol translation to the native storage provider protocol. One of the benefits of this that the users don’t need any special software to be able to access the Clouds. They can use any FTP, or WebDav client, or in the case of S3 any S3 client or code in which the host endpoint can be changed.

To demonstrate compatibility with the S3 API and tools we will now look at how to use AWS s3curl with a smestorage account.

To use s3 curl you will need to modify s3curl.pl and change the end point to

‘s3.smetorage.com’ (US Server) or ‘s3eu.storagemadeeasy.com‘ (EU Server) e.g my @endpoints = ( ‘s3.storagemadeeasy.com‘);

Your id is your smestorage account user name and you can obtain your secret key by logging into SMEStorage.com going to “My Dashboard” (from the sidebar) and copying the API key from the“Tech Info” section where the “API secret Key” resides.

Now you are all set to use s3curl. For example to list all the buckets you can use

./s3curl.pl –id smestorageusername –key API secret key http://s3.storagemadeeasy.com

For s3curl command line options please see the README file that is part of the s3curl package. Also note that the secure way to use s3curl is to use the .s3curl file in your home directory to pass the id and and key.

January 23, 2012

Cloud Computing Use Case: Enabling Cross Cloud file abstraction with unified ACLs and BYOD

Continuing our ongoing blogs on Cloud Computing Use Cases, this one is from a real customer with a complex use which details how and why they use SMEStorage:

Please tell us a little about what you do:

AlliedComm provides turn-key communication and web information applications. AlliedComm consists of four micro brands that service niche industries and organizations. These brands include JurisComm, FaithComm, Healthcomm and CiviComm

What were the technical challenge you were trying to solve:

1) Quickly allocate cloud-based ‘Private Organization Decentralized Storage’ for clients (‘pods’) that can be shed/discharged with client attrition.
2) Create a seamless management layer between cloud storage asset (pod) and respective client with flexible ACL permissions for individual client access.
3) Provide a branded, feature-rich portal with an improved GUI cloud-management experience for clients to independently manage cloud assets.

Why did you choose SMEStorage?

#1 BYOD. Whether by Windows, Mac, Android, iPhone, Blackberry, WinPhone, CloudDav, HTTP, FTP, email, fax and web, …you name it, SME’ supports it. (I wouldn’t be surprised if SME’ announces ‘messenger pigeon-to-cloud’ support coming early Q2 2012 *April fools). Our customers demand access to their cloud on their terms. SME allows us to provide all of this at a fraction of the cost compared to other vendors and with zero infrastructure.

#2 Features, features, features …they go on and on and on. They are easy to get to and intuitively laid out. EVERY setting is flexible and customizable. SME’s flexibility allows for limitless applications and ease of management specific to our business’s needs. With ‘power user’ features, we can really manipulate our settings. Nuance matters and we like the flexibility SMEstorage gives us to groom our SME’ service specific to the way we need it to operate.

#3 No ‘sky high’ corporate-centric pricing. Fair is fair. No gimmicks. No games. Pay for what you use. A la carte add-ons. We LOVE that.

#4 Easy security, backup and redundancy. With SMEstorage, we’re able to isolate our clients’ respective cloud assets as separate ‘pods’ but manage them from a layer above on one interface from within SMEstorage. SMEstorage gives us the ability to import, integrate and transfer assets between virtually EVERY cloud storage provider.

#5 Integration, inclusion and extensibility. We can can still access and manage our cloud vendor resources outside of SME’ if we choose to. SME’ provides the flexibility to integrate web storage with our web applications directly with each cloud storage vendor or, alternatively, by proxy with SME’. Often times SME’ provides integration capabilities not available directly from the cloud storage vendor.

Give us an example of how you decided to use SMEStorage

A good example of one application we use SME’ for is FaithComm’s Cloud Media Storage and CDN. Our client’s’ sites are hosted on FaithComm’s standalone servers while the large media and image files are offloaded to cloud storage ‘pods’ and broadcasted across our CDN. We’re able to manage everything from our SMEstorage account yet each client’s cloud storage assets are independent from each other as separate S3, Azure, Rackspace, etc. accounts. From the client’s point of view, the two applications are seamless. Additionally, we provide each client with group ACL login credentials to collaborate on, access, combine, transfer and manage all of their their cloud storage assets via SME’ on the device of their choice. SMEstorage, in our opinion, is a brilliant development in the storage and management of cloud-based assets.

October 10, 2011July 28, 2016

Cloud Computing Use Case: Automating Website backup to Amazon S3 using Plesk

Continuing on our theme of presenting interesting use cases that we come across when dealing with customers and businesses, this one is to do with backing up data to Amazon S3 in an automated fashion using Plesk. This was the request from the company involved. The condition being that the control panel can only backup to an external server via FTP. There is no native way to back up to S3 via Plesk.

This of course is tailor made for our CloudFTP product which turns any Storage Cloud into an FTP Server even if the Storage Cloud does not support FTP. This works with any of the Clouds you add to a SME Account, and of course S3 is one of these.

To satisfy this use case, the first thing to do is ensure the relevant S3 account is added to your account. This can even be a free account. You can do this either as part of sign up or from the Cloud DashBoard.

Once you have added the S3 Provider You can add CloudFTP to your account from “Cloud Add On’s” available on the right sidebar after login to the website. Once this is added to your account you can access any Cloud mapped to your account over ftp (Ftp://ftp.storagemadeeasy.com) with your username and password as authentication. This works even though the underlying Cloud, in this case, S3 does not natively support the FTP protocol.

Once this is done you can then automate your website backups using Plesk and your recently created S3-FTP. First login to the Plesk Control Panel:

Next navigate to the correct domain:

and finally navigate to the Backup Manager:

from here you can select to backup to a personal FTP repository:

and then enter the StorageMadeEasy.com FTP settings as outlined earlier in the post:

The end result is your website backed up safely to S3 (or any other Cloud that we support that you can choose).