Tinybird blog

Real-time Data

Real-time Personalization: Choosing the right tools

Real-time personalization is the pathway to better user experiences. But it often feels like you must choose between complex DIY and expensive SaaS. Here's the happy middle path.

Real-time Data

A practical guide to real-time CDC with MySQL

A step-by-step guide to setting up Change Data Capture (CDC) with MySQL, Confluent Cloud, and Tinybird.

Real-time Data

Real-Time Data Ingestion: The Foundation for Real-time Analytics

Real-time data ingestion is Step 1 for building real-time data pipelines. Read this guide to master real-time data ingestion and its underlying architecture.

Real-time Data

A practical guide to real-time CDC with Postgres

A step-by-step guide to setting up Change Data Capture (CDC) with PostgreSQL, Confluent Cloud, and Tinybird.

Real-time Data

A practical guide to real-time CDC with MongoDB

A step-by-step guide to setting up Change Data Capture (CDC) with MongoDB Atlas, Confluent Cloud, and Tinybird.

Building In Public

Killing the ProcessPoolExecutor

A story about the Python GIL, threading, and fixing code that already works.

Real-time Data

Real-time Data Visualization: How to build faster dashboards

Worried about slow dashboards? Don't blame your frontend. To build real-time data visualizations, focus on an effective data model using real-time data platforms.

Real-time Data

Modern data management with real-time Change Data Capture

Change Data Capture (CDC) is an important tool in real-time, event-driven architectures. Learn about CDC and its role in real-time data in this helpful overview.

Real-time Data

Real-time data platforms: An introduction

Real-time data platforms combine streaming data ingestion, a real-time database, and a low-latency API layer. Get to know real-time data platforms in this informative introduction.

Tech

Tinybird: A ksqlDB alternative when stateful stream processing isn't enough

ksqlDB is a common stream processing choice for data engineers working in the Kafka ecosystem. Learn about ksqlDB and when to choose alternatives like Tinybird.

Real-time Data

What it takes to build a real-time recommendation system

Real-time recommendation systems power a vast number of modern customer experiences. Learn what it takes to build a real-time recommender in this comprehensive guide.

Real-time Data

Real-time streaming data architectures that scale

Data and engineering teams are turning to real-time data architectures to power revenue-generating data pipelines. This post provides a reference for building scalable streaming data architectures that can support multiple different use cases.

Product

Run analytics on files in Amazon S3 the easy way

So, you want to run analytics on data stored in S3 files? Here’s the easy way to do it, using the Tinybird S3 Connector.

Company

Tinybird connects with Confluent for real-time streaming analytics at scale

Today, Tinybird announces its partnership with Confluent. Read how to use Tinybird & Confluent to build powerful real-time analytics over streaming data.

Real-time Data

16 questions you need to ask about your Real-Time Data Strategy

Considering a real-time data initiative? Answer these 16 questions and follow these recommendations to nail your real-time data strategy.

Tech

Data-driven CI pipeline monitoring with pytest

Recently, we cut our CI pipeline execution time in half. To consummate our work, we've officially published the pytest plugin that made it possible, so you can use it, too.

Tinybird Examples

How to set up event-based ingestion of files in S3 for free

In this tutorial, I'll show you how to use S3 Event notifications and AWS Lambda to trigger downstream workflows when new files are uploaded to S3.

Data 101

Event-driven architecture best practices for databases and files

Event-driven architectures should have largely replaced poll-based workflows and batch ETLs. Here are the common patterns (and anti-patterns) I have observed for event-driven ingestion of data from both application databases and file systems.

Data 101

Using Tinybird as a serverless online feature store

Machine learning can feel like a lot of hype, but feature stores are extraordinarily practical. In this post, I'll show you why Tinybird makes for an excellent online feature store for real-time inference and game-changing user experiences.

ClickHouse

Using Bloom filter indexes for real-time text search in ClickHouse®️

A customer of ours had text-based log data and they wanted to be able to search over the text (quickly). However, in ClickHouse, text search without any special measures involves a full scan, period. And we know that full scans are not efficient.

Tinybird Examples

Designing and implementing a weather data API

When I first learned about Tinybird, its mission of helping developers build APIs caught my eye. I wondered what it would be like to design and implement a weather data API using Tinybird. In this post, I've documented my journey doing just that.

Product

A new way to create intermediate Data Sources in Tinybird

We are pleased to announce the general availability release of Copy Pipes, a new way to generate snapshots of SQL results and store them in a Tinybird Data Source.

Data 101

5 criteria of data quality and how to test for them

Data Quality Assurance is an important focus for companies seeking to advance the trustworthiness of their data pipelines. Here are 5 criteria for measurement data quality, and some sample SQL you can use to test for them.

ClickHouse

Adding JOIN support for parallel replicas on ClickHouse®️

We recently introduced a pull request to ClickHouse that enables simple JOIN support for parallel replicas on ClickHouse. The solution may be simple and naive, but the ceiling for performance on distributed queries just got WAY higher.

Product

Why we just released a huge upgrade to our VS Code Extension

Tinybird is a powerful, performant real-time data platform. But we win the hearts of engineers through an amazing developer experience. Read how and why we recently upgraded our VS Code Extension for an even better DX.