Scality Ships Open Source Amazon S3 Server to Bring Dev/Test Local for Web-Scale Applications

Scality is providing developers a local option for dev/test performance and scale of their cloud apps by shipping an equivalent of Amazon’s S3 that is open source, locally-deployable and runs on a single server.

Tags: apps, Amazon, API, big data, cloud, dev/test, hyperscale, IoT, S3, scale, Scality,

Amazon Web Services S3 (simple storage service) is popular for developers building new-gen apps, thanks to an API to access and store unstructured data at web scale volumes.  That said, developers are looking for an option that would let them locally develop and test apps built for elastic web-scale. 


Scality,  a vendor of object storage technology focusing on software-defined storage, is setting out to change that, and address some nagging challenges for developers of apps that need to run (or stretch to run) at web-scale. 


The solution: Scality is shipping a new open source and single-server version of S3 that allows the local development, testing, and production of cloud applications. Scality's S3 Server is compatible with Amazon Web Services S3.


Amazon S3 typically requires signing up for this service from Amazon, and working with a cloud connection, said to Scality CEO Jérôme Lecat. Scality’s open source S3, provides the first easy solution to locally develop and test an application that can be deployed at web-scale, he added.


Scality S3 Server is actually the latest update to the Scality S3 API, now packaged as a Docker container so that it can be easily deployed on a single server. This innovative approach enables developers to code to the S3 API locally, and even to extend the API should they need it, according to Lecat.


“This version of our [Scality] S3 API has been packaged as an S3 Server in a Docker container and is extremely easy to deploy, even on a laptop. Scality S3 Server is the same code as the version that can be deployed in production for billions of objects and petabytes of storage with the Scality RING Version 6,” Lecat said in a statement.


Further, enterprises can leverage Scality S3 Server to accelerate time-to-market of cloud applications -- without having to first decide where the application will be deployed in production. Applications developed with Scality S3 Server will be freely deployable on premises, on AWS public cloud or both – without changing their code, he added.


Scality S3 Server is written in Node.js and offers rich S3 API features and fast bucket listing. Scality S3 Server offers strong S3 API compatibility allowing application developers to utilize the full set of AWS S3 language-specific bindings and wrappers, including SDKs for Java, .NET, Javascript, and Go, to simplify coding. The new offering uses Docker volumes for storage, and can be used for pilot and production deployment of several hundreds of terabytes.


How Data-Driven Analytics, Big Data and IoT Need Hyperscale Capability 

In a recent Scality blog, Lecat outlined his perspective on how software-defined storage provides big benefits to developers building apps for web-scale.

In a data/information hungry environment, in which every aspect of corporations’ and our lives is data driven and all data past, present, and future is a potential gold mine of business and other insight, traditional limited scale storage models are doomed in favor of hyperscale and performance.

Hyperscale is necessary to store and harness years and endless quantities of Big Data-, IoT- and Deep-Learning-related information nearby continuously for quick analysis. Performance is the goal when real time and low latency are required.

This level of scalability can only come from software defined storage, just as compute and networks have moved to an intelligent, scale out software defined architecture.

Travis Vigil, executive director at Dell Storage, called the new Scality S3 Server “is a great entry point into [digital] transformation,” and spelled out some reasons. “It is a simple and free way to get started with object storage. When they're ready for production, users can easily repoint their applications to Dell's solution for continuous data availability, non-disruptive upgrades, and linear scaling up to dozens of petabytes,” Vigil said.


Dell Storage is a Scality partner, working to deliver a purpose-built appliance for Scality’s object storage solutions.


Scality open sourced the code of S3 Server, so that developers can obtain an instant S3 test and development environment, either directly on their laptop or running on a container service in the cloud, according to Giorgio Regni, Scality CTO.  “We are convinced that this server software will be used by the creative community in many ways that we have not envisioned, and which in turn will develop the value and accessibility of object storage,” he said in a statement.


A community version of S3 Server can be downloaded here. Scality also offers a "Getting Started" guide.


Both free and paid support options are available on Docker Hub and Github, and at the Scality S3 Server portal. For companies that require a commercially supported version of Scality S3 Server, Scality offers the Enterprise Edition which is available as a subscription for $950 per month, per server.