OpenIO

From Infogalactic: the planetary knowledge core
Jump to: navigation, search

Lua error in package.lua at line 80: module 'strict' not found.

OpenIO
Industry Information technology, Data storage, Data processing
Founded 2015
Headquarters France
Owner OVH
Website www.openio.io

OpenIO offers object storage for a wide range of high-performance applications.[1] OpenIO was founded in 2015 by Laurent Denel (CEO), Jean-François Smigielski (CTO) and five other co-founders; it has leveraged open source software, developed since 2006,[2] based on a grid technology that enables dynamic behaviour and supports heterogenous hardware. In October 2017 OpenIO completed a $5 million funding round.[3] In July 2020 OpenIO has been acquired by OVH.[4]

Product

OpenIO is a software-defined object store that supports S3 and can be deployed on-premises, cloud-hosted or at the edge, on any hardware mix. It has been designed from the beginning for performance and cost-efficiency at any scale,[5] and it has been optimized for Big Data, HPC and AI.[6]

OpenIO stores objects within in a flat structure within a massively distributed directory with indirections, which allows the data query path to be independent of the number of nodes and the performance not to be affected by the growth of capacity. Servers are organized as a grid of nodes massively distributed, where each node takes part in directory and storage services, which ensures that there is no single point of failure and that new nodes are automatically discovered and immediately available without the need to rebalance data.[7]

The software is built on top of ConsciousGrid, a technology that ensures optimal data placement based on real-time metrics and allows the addition or removal of storage devices with automatic performance and load impact optimization.[8][9] For data protection OpenIO has synchronous and asynchronous replication with multiple copies, and an erasure coding implementation based on Reed-Solomon that can be deployed in one data center or geo-distributed or stretched clusters.[10][11]

The software has a GridForApps feature that catches all events that occur in the cluster and can pass them up in the stack or to applications running on OpenIO nodes. This enables event-driven computing directly into the storage infrastructure.[12][13]

OpenIO has native object APIs and SDKs for Python, C and Java, it integrates a HTTP REST/API and has strong compatibility with the Amazon S3 API and the OpenStack Swift API.[7] The company also offers a proprietary File System connector to access data stored in an OpenIO object store through file access methods: it is based on FUSE and presents a POSIX File System which can be shared over local networks via NFS, SMB and FTP.[14]

OpenIO is compatible with x86 and ARMv7/ARMv8 servers running Linux[15] and has low hardware requirements.[16] It can be installed also on Raspberry Pis[17][18] and on storage drives with servers embedded.[19][20][21]

The open source code is available on Github and it is licensed under AGPL3 for server code and LGPL3 for client code.

Performance

OpenIO claimed to have reached 1.372 Tbps write speed (171 GB/s) on a cluster of 350 physical machines.[22] The benchmark scenario, conducted under production conditions with standard hardware (commodity servers with 7200 rpm HDDs), consisted in backing up a 38 PB Hadoop datalake via the DistCp command.[23] This level of performance marked, according to analysts,[24] the arrival of a new generation of object storage technologies oriented toward high performance and hyper-scalability.

See also

References

  1. Lua error in package.lua at line 80: module 'strict' not found.
  2. Lua error in package.lua at line 80: module 'strict' not found.
  3. Lua error in package.lua at line 80: module 'strict' not found.
  4. Lua error in package.lua at line 80: module 'strict' not found.
  5. Lua error in package.lua at line 80: module 'strict' not found.
  6. Lua error in package.lua at line 80: module 'strict' not found.
  7. 7.0 7.1 Lua error in package.lua at line 80: module 'strict' not found.
  8. Lua error in package.lua at line 80: module 'strict' not found.
  9. Lua error in package.lua at line 80: module 'strict' not found.
  10. Lua error in package.lua at line 80: module 'strict' not found.
  11. Lua error in package.lua at line 80: module 'strict' not found.
  12. Lua error in package.lua at line 80: module 'strict' not found.
  13. Lua error in package.lua at line 80: module 'strict' not found.
  14. Lua error in package.lua at line 80: module 'strict' not found.
  15. Lua error in package.lua at line 80: module 'strict' not found.
  16. Lua error in package.lua at line 80: module 'strict' not found.
  17. Lua error in package.lua at line 80: module 'strict' not found.
  18. Lua error in package.lua at line 80: module 'strict' not found.
  19. Lua error in package.lua at line 80: module 'strict' not found.
  20. Lua error in package.lua at line 80: module 'strict' not found.
  21. Lua error in package.lua at line 80: module 'strict' not found.
  22. Lua error in package.lua at line 80: module 'strict' not found.
  23. Lua error in package.lua at line 80: module 'strict' not found.
  24. Lua error in package.lua at line 80: module 'strict' not found.

External links