Real-time Analytics and Dashboards

< Back to Use Cases

Challenge

Zoomdata visualizing data accessed from CrateDB – querying billions of records in real-time.

Your business generates a lot of data every second. Whether it’s in-app, in-store or on-line transactions, stock trades, sensor readings, or social networking interactions, you want to analyze that data so you can understand what’s happening right now.

This creates challenges for your database management system:

  • Getting fast query performance while new data streams in at the same time?
  • Performing ad-hoc analyses?
  • Scaling to handle more users, more data, and more queries?
  • Comparing real-time readings to years of historic data? 
  • Querying non-relational data like full text and JSON?
  • Integrating with popular BI and visualization tools?

These challenges are hard for databases. Traditionally, it’s difficult to get good data insert and fast query performance at the same time from the same database, especially if there are lots of people running queries or performing ad-hoc analysis. It’s harder to scale the database over time to handle more data and more queries. Integrating non-relational data into analytics is also challenging, requiring the use of multiple databases and ETL code to integrate them.

Crate benefits

CrateDB is an open source SQL database designed to meet these challenges.

Fast INSERT performance – CrateDB can concurrently ingest hundreds of thousands of structured or unstructured records per second on multiple tables. This makes it ideal for time-series data, sensor data, or log data. 

Fast, ad-hoc querying – Analytic dashboards often aggregate data and enable users to explore results by drilling down into reports and visualizations. CrateDB’s distributed, columnar architecture enables many concurrent users to explore data like this with fast response times, even when querying billions of rows of data.   

Advanced analytics – CrateDB is a multi-model database that can query structured and unstructured data together. This means you can create geospatial, full-text, time-series, and other interesting analytical results.

Lower-costs – CrateDB is open-source and free for you to use. It’s designed to run fast and scale on inexpensive commodity hardware. Customers have reported that switching to CrateDB has reduced the size of their database platforms by over a half.

Easy to change – CrateDB is designed for change. You can add columns to support new data items and run arbitrary queries to create new insights with no performance penalty.

Works with any SQL tools – CrateDB is accessed via SQL through JDBC. This enables it to be accessed by business intelligence reporting, data visualization, data integration and pipelining tools your team enjoys using today.

Simple scalability – CrateDB is masterless and fully distributed so can run on an elastic compute cluster. Through the use of container and automatic data redistribution technology, CrateDB makes it easy to scale out to increase performance or storage by adding new container nodes to your cluster. 

Example architecture