ChakrDB: A Distributed RocksDB Born in the Cloud, Part 2

Overview

Salient Features of ChakrDB

Truly Elastic and Flexible

Lightweight

Future-Proof

Cloud or Remote Storage

Architecture

API Interface

SchemaManager

BgTaskManager

VNodeManager

ChakrDB Cluster

ChakrDB Instance

Chakr Cluster Manager

Configuration Store

Client Library

Architecture Highlights

Scalability

  1. The largest cluster our QA team deployed had around 1,024 ChakrDB instances, with 4 vNodes in each ChakrDB instance, totaling around 4,000 vNodes in the cluster.
  2. One of our internal clusters pushed around 25 TB of data with around 75 bytes of keys in a 128-node ChakrDB cluster, or around 200 GB with 600 MB of keys per ChakrDB instance and 50 GB with 150 MB of keys per vNode.
  3. A ChakrDB instance with 11 GB of memory handled around 8 bytes of keys and around 1.6 TB of data. This instance contained 8 vNodes, and each vNode held around 230 GB of data with 1 byte of keys. This result shows ChakrDB’s resource efficiency.
  4. We deployed most of these ChakrDB clusters on a four-node Nutanix cluster, which shows how well ChakrDB can take advantage of the underlying distributed storage fabric’s full potential.

Conclusion

  1. Cloud-native: Can run in any cloud based on a K8s platform.
  2. Any cloud storage: Can write data to any cloud or remote storage that can attach to containers on a K8s platform.
  3. Cloud-style easy workflows: Deployment, scale-up, and scale-out workflows take advantage of K8s and software-defined storage.
  4. Strong consistency, HA, and resilience: ChakrDB uses cloud infrastructure capabilities to avoid the complexities of added replication and distributed consensus protocols.
  5. Scale-out performance and low latency: A RocksDB foundation with a lightweight distribution layer allows for very high performance and low latency for applications at cloud scale.
  1. At the caching or staging layer for long-term backup software.
  2. As a replacement for our core Cassandra implementation in AOS.
  3. As a distributed storage engine for Postgres.
  1. Secondary indexing.
  2. vNode expansion and the ability to move vNodes across instances freely and easily.
  3. Distributed transactions across vNodes.

Acknowledgments

We make infrastructure invisible, elevating IT to focus on the applications and services that power their business.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

How is API technology transforming the hospitality industry?

A must know Regex trick

Coin Distraction Part 2

How to Create a Contact Page for Your Django Website

SAML SSO Azure AD, Android/iOS

Deploy Websites Like a pro

Update: Flow Reports & New Designer — oh my!

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Nutanix

Nutanix

We make infrastructure invisible, elevating IT to focus on the applications and services that power their business.

More from Medium

How To Enable Debug Logs In Athena JDBC/ODBC Driver

Bioconcrete Technology and Neglected Biotoxicity | Biomedgrid llc

Approaching the Decentralized Data Cloud Era

Op Amp Applications.