The Data Base

Educational content about databases, data warehouses, or other data infrastructure. All posts about ClickHouse should be included here. All posts about Postgres, MySQL, MongoDB, etc. should go here. If it has database in the title, it goes here.

The Data Base

Text search at scale with ClickHouse

Searching for thousands of regex patterns on millions of documents in seconds like it’s no big deal.

The Data Base

What are Materialized Views and why do they matter for real-time?

Use Materialized Views for speed, simplicity, and consistency in your data pipelines.

The Data Base

Designing a faster data model to personalize browsing in real time

Optimizing API endpoint performance for browsing personalisation.

The Data Base

Looking ahead to Kafka Summit '22

Kafka pro’s and con’s for real-time streaming

The Data Base

Spatial Indexing aids Finding which Polygons contain a Point

Speed up your queries by using a spatial index to select fewer polygons before testing if a point is inside a polygon.

The Data Base

ClickHouse Tips #12: Apply Functions to Columns with a Single Call

Clickhouse 21 allows some fancy operations packed into multiple columns with SELECT modifiers.

The Data Base

ClickHouse tips #11: Best way to get query types

A fast and simple solution to know the types returned by a query

The Data Base

ClickHouse tips #10: Null behavior with LowCardinality columns

Does it work? What's actually inserted?

The Data Base

Experimental ClickHouse: Projections

ClickHouse tags a major release around once a month, which is an order of magnitude more often than similar projects, and it does it while maintaining speed and stability.

The Data Base

ClickHouse tips #9: Filling gaps in time-series on ClickHouse

This simple trick will teach you how to fill date and datetime gaps in time-series on ClickHouse

The Data Base

ClickHouse tips #8: Generating time-series on ClickHouse

ClickHouse doesn't have a generate_series function yet, but you can achieve the same with other functions. Learn how here.

The Data Base

ClickHouse tips #7: Forward and backfilling null values

Making use of array functions to do it.

The Data Base

ClickHouse tips #6: Filtering data in subqueries to avoid joins

Sometimes you can replace joins on ClickHouse using where clauses, having the same performance as with Join engines. Learn how here.

The Data Base

ClickHouse tips #5: Adding and subtracting intervals

Tips and recipes to learn how to make the most of ClickHouse, curated weekly by the Tinybird team.

The Data Base

Coming soon on ClickHouse: Window functions

An exploration on what's possible to do with the most recent experimental feature on ClickHouse - window functions, and an overview of other interesting features to come.

The Data Base

ClickHouse Tips #4: Materializing UNION ALL queries

Learn how to materialize queries on ClickHouse when there are UNION ALL operations involved, and when you can use SimpleAggregateFunction instead of AggregateFunction.

The Data Base

ClickHouse tips #3: the transform function

Using the transform function to join two tables when joinGet is not available.

The Data Base

Clickhouse, Open Source and Tinybird

We are hiring full-time Clickhouse Developers. Find out why we contribute to Open Source (ClickHouse) and why we want to contribute much more.

The Data Base

ClickHouse tips #2: Debugging ClickHouse on Visual Studio Code

How to configure Visual Studio Code to debug ClickHouse on it.

The Data Base

Clickhouse Tips #1: Calculating Aggregations After a Given Date

Tips and recipes to learn how to make the most of ClickHouse, curated weekly by the Tinybird team.

The Data Base

Monitoring startup performance, how Cloudflare uses ClickHouse, and how surprisingly SQLite is everywhere – What our team is reading

I was able to have a relatively discrete view of current system status and performance in realtime. You need this sort of realtime data if you’re going to be...

The Data Base

Write-ahead logs, recommender systems and a clean start for the web - What our team is reading

At base, the idea was to keep each record in the database in a linked list of versions stamped with transaction IDs — in some sense, this is 'the log as data' or 'the data as a log', depending on your point of view.

The Data Base

Summer Edition – What our team is reading

From renaming genes due to a computer error to a metaphor of legacy code in a fantasy novel

The Data Base

The Fremen – What our team is reading

If you want to know how to work with new or limited resources, find a population that’s used to not having many alternatives.

The Data Base

Memory bandwith Napkin Math and more readings from our team members

Real-Time APIs and ETLs, how Github deals with database migrations, memory bandwidth math and more: most interesting articles coming from our flock