Features
Data Import
There are multiple ways to import data in CrateDB. Depending on whether you're using CrateDB Cloud or CrateDB Self-managed, there are different options to consider:
- Import from URL (CrateDB Cloud only)
- By specifying a source URL, data format, and compression.
- CSV, JSON, and Parquet files with Gzip compression.
- Import from file (CrateDB Cloud only)
- CSV, JSON, and Parquet formats.
- CSV, JSON, and Parquet formats.
- Import from private S3 bucket with globbing support (CrateDB Cloud only)
- Directly import files from S3-compatible storage systems. Specify the bucket name, file path, S3 Access Key ID, and Secret Access Key for seamless imports. Users with non-AWS S3 buckets can specify the endpoint.
- Manual import through queries, from the Admin UI
- INSERT commands
INSERT INTO customer_data (customerid,gender,profession) SELECT 3000,'Male','Software Engineer';
-
- COPY FROM cvs/json lines/gzip
COPY customer_data FROM '/tmp/Customers.csv' RETURN SUMMARY;
- Foreign Data Wrappers
- Utilize Foreign Data Wrappers to integrate external data sources into CrateDB. This allows you to query data from foreign systems as regular user tables within CrateDB directly. With the JDBC data wrapper implementation, you can connect to foreign databases via JDBC, enabling seamless querying and manipulation of remote data.
Additional resources
On-demand workshop
Inserting and Querying Data
Timestamp: 15:40 – 24:30
Video Tutorial
August 8, 2022
This tutorial shows the basics of COPY FROM and COPY TO in CrateDB in a video format.
Community Tutorial
March 28, 2023
This tutorial presents the basics of
COPY FROM and COPY TO in CrateDB.Blog
December 19, 2023
We're introducing support for Globbing for S3 and other blob storage. This upgrade promises to make batch imports faster and more convenient.
Blog
May 12, 2023
In this tutorial, we'll walk you through three different approaches to importing data into your CrateDB Cloud cluster.