Blog ARCHIVE

Orchestrating a SQL Database Cluster with Docker 1.12

July 19, 2016
by
Andy Ellicott

Orchestrating a SQL database cluster with Docker Services 1.12.

Crate 0.55, Our Biggest Release Yet?

July 8, 2016
by

Crate is regularly updated, so we don't normally write a blog post for each release, but our forthcoming 0.55 release is so chock-full of features that we felt it deserved something special. It's not quite ready yet, but here's a few things to look forward to.

Visualize Crate Data with Metabase

June 22, 2016
by

We have discovered that many people use Crate not only directly integrated in their applications, but also for analyzing their existing data. To help our users do this, we created a driver for Metabase, an open source database visualization tool focussed on providing you with answers created from your data.

Bulk Inserts with unnest

June 13, 2016
by
Claus Matzinger

unnest - A handy table function for bulk inserts.

Insert Performance Boost on Replicated Tables

June 8, 2016
by
Claus Matzinger

Huge performance boost: Inserting into replicated tables is now faster than ever!

How to Import from Custom Data Sources with a Plugin

May 31, 2016
by
Claus Matzinger

Common Crawl generates roughly 30 000 files per month using its own format which you cannot feed into Crate directly. Preprocessing this quantity of data would take days to complete or require building a very large distributed system. This gave us the idea to use Crate's plugin infrastructure and use COPY FROM directly.

Crate.io at Software Engineering Daily

May 20, 2016
by

An interview with Jodok Batlogg by Jeff Meyerson on Software Engineering Daily.

Alpine Linux and Docker Nautilus Protect Crate Images

May 10, 2016
by

Crate is a database, a place where you store your most valuable business assets. For this reason, it is important to detect and mitigate any vulnerabilities as soon as possible. We value security highly. Using open source libraries enables us to closely monitor any security advisories disclosed. While building and packaging Crate, we only use the latest versions with no known vulnerabilities.

A 1001 Node Crate Cluster with Microsoft Azure

April 25, 2016
by

We have clients who write and query gigabytes of data a minute, store terabytes a day and love the performance and stability that Crate offers. But the question always remained at the back of our minds - when taken to the extreme, what is Crate really capable of?

Big Bite: Ingesting Performance of Large Clusters

April 19, 2016
by

Database performance depends on many factors. There are many parameters user can tweak, but the outcome in complex setups is not always obvious. While we had a big cluster of crate instances available, we faced the challenge to load huge amounts of data into it to initialize the distributed database. A series of experiments resulted in an awesome 4.8 mio records/rate of ingesting data into our cluster! To get there, we explored the effect of network connections, number of nodes, and shard configuration.

Crate Secures $4M Seed Funding to Further Development of Distributed SQL database for Containerized Architectures

March 15, 2016
by
Christian Lutz

Investors in next generation SQL database are Dawn Capital, Sunstone Capital, Draper Esprit, Speedinvest, and Solomon Hykes, creator and CTO of Docker.

4 Things You should Know about Databases in a Microservices Environment

March 12, 2016
by
Jodok Batlogg

Why don’t all databases fit well with the Docker-driven Microservice environment revolution.

Optimizing Big Crate Clusters

March 3, 2016
by
Johannes Moser

Optimizing a big Crate cluster is a process. We show some options to get the best out of it.

Beyond Whiteboards: Crate Goes Snowsprinting

February 23, 2016
by

Once a year the Crate community interprets the 'sprint' concept in a different way. We lock ourselves in a lodge in the Austrian Alps for a week of coding, cooking and skiing.

Cr8 - a Collection of Utility Scripts for Working with Clusters

February 12, 2016
by

Another great project from Snow Sprint, Cr8, a selection of utility scripts for working with Crate clusters.

Ctop - a Top Tool for Crate Clusters

February 11, 2016
by

Fresh from Snow Sprint comes ctop, a top tool for Crate clusters.

Snowsprint 2016

January 28, 2016
by
Johannes Moser

Every once in a year it is getting quiet in the Crate Offices in Dornbirn and Berlin, when all the people are gathering somewhere in the mountains. It's Snowsprint time.

PHP 7 Support

January 12, 2016
by
Michael Beer

We are excited to announce that crate-pdo and its ORM Layer crate-dbal now support PHP 7. The current version of the Crate PDO library is fully compatible with PHP 7. No adaptions, fixes or version upgrades were necessary, awesome! However, a lot has changed since PHP 5 that you might be interested in knowing about.

Generated Columns in Crate 0.54.0

December 17, 2015
by
Ruslan Kovalov

Crate are pleased to announce the support of generated columns. The new functionality will be available from the fresh 0.54.0 testing release!

Improving on Joins

December 16, 2015
by
Christian Haudum

We've doubled the JOINs performance for almost all queries, and removed many of the previously existing restrictions!

Berlin and Geo Shapes in Crate

December 10, 2015
by
Claus Matzinger

In our last blogpost about Crate's spatial and geographic features we announced the support for the geo_point data type and related operations. Since that post, we have greatly improved our geographic features...

TechCrunch Disrupt Cup - A Year in the Life

December 8, 2015
by

We were thrilled to be invited to London to return the TechCrunch Disrupt Cup on the main stage, and we brought a video with us.

Backing up and Restoring Crate Databases

November 30, 2015
by

Our databases contain valuable and business critical information and whilst there have always been manual ways to create restorable backups of Crate databases, as of version 0.53, we are pleased to announce the 'Snapshots' feature.

Crate.IO releases support for JOINs and Geo shapes at DockerCon 15

November 16, 2015
by

A journey of a thousand miles starts with a single step, and takes a whole lot of steps to get where we know we want...

Analyzing Germany's weather with Crate.IO

September 2, 2015
by

The german weather service, DWD, publishes a vast amount of data measured at german weather stations. The data is available in monthly, daily and hourly intervals from the beginning of recorded official measurements. Temperature, humidity, cloudiness, precipitation, air pressure, soil temperature, sunshine duration, radiation, wind speed and direction and sun zenith are measured. I decided I would write a blog post about my experiments importing their 236 million rows of data into Crate.

Running Crate on Linux and Windows with Azure

August 13, 2015
by

We have had requests from many of you about the potential of running Crate on Azure cloud hosting and/or Windows. Whilst this was always possible...

Crate.IO - A Born Global Champion

July 2, 2015
by

Crate.IO - a Born Global Champion In June Crate.IO was chosen by the Austrian Federal Chamber of Commerce (WKO) to compete in the Born Global...

Running and managing Crate databases with Mesos

May 13, 2015
by

Apache Mesos is a fantastic tool for abstracting CPU, memory, storage, and other compute resources away from machines (physical or virtual). This lets you program...

Announcing Crate as a Google Click-to-Deploy Database

May 7, 2015
by

The Crate.io team is happy to announce that it is now even easier to start a Crate cluster on Google Cloud Platform. After collaborating with...

Impact Report from 451 Research

April 7, 2015
by

Analyst Jason Stamper's Impact Report on Crate.IO Respected enterprise business analyst firm 451 Research has just released an Impact Report which takes a look at...

Crate.IO is Dockercon Gold Sponsor

March 26, 2015
by
Jodok Batlogg

We are proud to announce that Crate.IO is an official gold sponsor for DockerCon 2015. After attending DockerCon in Amsterdam last year we fell...

Docker's 2nd Birthday in Berlin

March 25, 2015
by

Docker is currently one of the most spoken about tech projects right now and it's hard to believe that it's only two years old. As...

At Docker HQ for Docker's 2nd Birthday in San Francisco

March 25, 2015
by

Docker is one of the most talked about open source projects right now and it's hard to believe that it's only two years old. As...

Deploying the Crate Distributed Database Using Mesos and Marathon

March 6, 2015
by
Christian Haudum

This is a guest post originally published on Mesosphere's Blog on Feb 25, 2015. Editor's Note: This guest post is written by Christian Haudum of...

Landing the US

February 23, 2015
by
Jodok Batlogg

In October we opened our US Office in San Francisco. Since that, Crate is growing aggressively both in terms of downloads and enterprise traction. We've...

Crate.IO Snowsprint 2015 Recap: Dockerzeit

February 5, 2015
by

Crate.IO SnowSprint 2015 revived a long tradition of legendary Austrian Alpine hackathons. For a whole week we have been drinking beer, skiing...

How To Use Nginx To Make Crate Read-Only

February 5, 2015
by
Christian Haudum

tl;dr ... There's a gist of the Nginx configuration. At the moment, Crate does not have a builtin concept of ACL or user permissions, but...

Crate with Docker, Weave, Flocker, and Powerstrip at SnowSprint

January 29, 2015
by

There's been so much interesting work happening at the Crate.IO SnowSprint, but one of the most exciting has been to watch the WeaveWorks and ClusterHQ..

Crate with Docker & Weave

January 22, 2015
by
Jodok Batlogg

This is a guest post originally published on all about Weave on Jan 7, 2015. Crate is a massively scalable, distributed, and highly available database...

Crate.IO makes it to the Final 8 at Pioneers Festival

October 30, 2014
by

Crate.IO has been on a roll lately, what with our recent win at TechCrunch Disrupt London. There has been a lot of great excitement and...

SQL For ElasticSearch

September 30, 2014
by

When we started Crate.IO, we understood the power of Elasticsearch for searching through mountains of data. We wanted to leverage that power and use the...

A Dozen Intel NUCs in a Shoebox

September 11, 2014
by
Jodok Batlogg

This summer we've built a portable datacenter to demo Crate on commodity hardware. A lot of people are asking us how we did it, what...

How We Test Crate

September 2, 2014
by
Christian Haudum

Testing is an integral component of software development, especially when you develop a database that is used by developers to store millions of records. That...

FLOSS Weekly Interviews Crate's CEO Jodok Batlogg

August 21, 2014
by

TWiT.tv's FLOSS Weekly held an interview with Crate's CEO Jodok Batlogg. Randal Schwartz and Aaron Newcomb were the hosts. (hint: start at 6:43)...

Test Driven Development of a Horizontally Scaling REST-Service with Pyramids, Crate and SQLAlchemy

August 11, 2014
by
Christian Haudum

This blog post is a recap of a tutorial held by Bernd Dorn at EuroPython2014. The resulting sample web application that is publicly available on...

Using Crate And Node.js For Data Enrichment

August 5, 2014
by
Jodok Batlogg

Great post by Stefan Thies about how he used Crate and Node.js to overlay the raw data from website log files with whois information, enabling...

Using Crate in a Multi Node Setup

July 22, 2014
by
Christian Haudum

UPDATE There is now a best practice in our documentation on how to Use Crate in a Multi Node Setup. Please check the documentation first,...

Crate for Pythonistas with SQLAlchemy

July 18, 2014
by
Philip Bogensberger

In this tutorial I want you to show how to interact with Crate using SQLAlchemy. SQLAlchemy is a Python SQL toolkit and Object Relational Mapper....

How the Fastly Wordpress Plugin Helped Us Deal with a Massive Traffic Spike

July 14, 2014
by
Jodok Batlogg

In April 2014, we were preparing to launch our data store. At the time, we had a simple Wordpress site, and had chosen Fastly as...

Geospatial Queries with Crate

July 12, 2014
by
Christian Haudum

Crate is a simple to use database backend for many applications. Nowadays a huge percentage of data is geo-tagged already, no matter whether it comes...

How is Crate Different from Elasticsearch?

July 9, 2014
by
Sebastian Utz

People ask us whether Crate.IO is a SQL layer on top of Elasticsearch. Although we use Elasticsearch as a framework Crate is a data store,...

Using Crate With Rails

July 8, 2014
by
Jodok Batlogg

This is a re-post of Christoph Klocker's post \"Using Crate With Rails\". If you don\u2019t know Crate yet, Crate is a document-oriented cluster data store...

Using Crate As a BLOB Store

July 2, 2014
by
Jodok Batlogg

Crate provides BLOB storage so you can persistently store and retrieve BLOB \u2013 typically pictures, videos or large unstructured files, providing a fully distributed cluster...

Super Simple Real-Time Big Data Backend - July 8th Webinar

July 1, 2014
by
Jodok Batlogg

Presented by: Jodok Batlogg Duration: Approximately 60 minutes Cost: Free Hosted by: Ben Lorica Crate is a shared-nothing, fully searchable, document-oriented cluster data store. Today,...

Crate Wins the 2014 GigaOm Structure Launchpad Competition

June 19, 2014
by
Jodok Batlogg

Crate's win attributed to its super scalable data store and SQL interface, letting companies get into a distributed architecture for a lower cost. June 20,...

Using Elasticsearch as Part of the Crate Data Store

June 15, 2014
by
Bernd Dorn

This post will describe how we\u2019re using Elasticsearch as part of Crate. Crate is an open source data store for any data. Crate is a...

The Getting Started with Crate - Webinar

June 11, 2014
by
Jodok Batlogg

Check out the recording of our Introduction to Crate webinar...

How we chose the Facebook Presto SQL Parser for Crate

June 4, 2014
by
Bernd Dorn

Crate is an elastic SQL Data Store. We created it to provide a quick and powerful massively scalable backend for data intensive (or analytics) apps...

Crate.IO at Berlin Buzzwords

May 25, 2014
by
Jodok Batlogg

We love Berlin, we love Berlin Buzzwords! That's also one of the reasons why we're proud to be one of ...

Crate, an easy to scale, real time SQL data store, secures funding from Sunstone and DFJ Esprit

April 24, 2014
by
Jodok Batlogg

Berlin/Austria-based Crate.IO, an open source data store for developers, secures a $ 1.5 m funding round. Crate.IO, an open source data store for developers, has...

What it's like to be #1 on Hacker News

April 21, 2014
by
Jodok Batlogg

Don\u2019t get us wrong. We always wanted to get to the number 1 position on Hacker News. We thought we would plan ahead, craft a...

Meet us at the Next Web 2014

April 18, 2014
by
Jodok Batlogg

We're part of the boost program at the Next Web Europe 14, Amsterdam, April 24-25. Drop by our table and have a word with us!

Crate Hackathon, Day 2

April 11, 2014
by
Jodok Batlogg

Admin User Interface Now you can see the memory distribution and disk space of your cluster. The Coxcomb diagram provides a fast and easy overview....

Crate Hackathon, Day 1

April 10, 2014
by
Jodok Batlogg

Day 1 is almost over - time for a short blogpost, while the team enjoys some cheese and beer :) What have we been working...

Mountain Hackathon, April 9-11 2014

April 1, 2014
by
Jodok Batlogg

The roots of the Crate Team go back to the time when we were part of the Zope/Plone community. We\u2019re known to host legendary sprints...