Tinybird blog

Scalable Analytics Architecture

Using Tinybird as a serverless online feature store

Machine learning can feel like a lot of hype, but feature stores are extraordinarily practical. In this post, I'll show you why Tinybird makes for an excellent online feature store for real-time inference and game-changing user experiences.

The Data Base

Using Bloom filter indexes for real-time text search in ClickHouse®️

A customer of ours had text-based log data and they wanted to be able to search over the text (quickly). However, in ClickHouse, text search without any special measures involves a full scan, period. And we know that full scans are not efficient.

I Built This!

Designing and implementing a weather data API

When I first learned about Tinybird, its mission of helping developers build APIs caught my eye. I wondered what it would be like to design and implement a weather data API using Tinybird. In this post, I've documented my journey doing just that.

Product updates

A new way to create intermediate Data Sources in Tinybird

We are pleased to announce the general availability release of Copy Pipes, a new way to generate snapshots of SQL results and store them in a Tinybird Data Source.

Scalable Analytics Architecture

5 criteria of data quality and how to test for them

Data Quality Assurance is an important focus for companies seeking to advance the trustworthiness of their data pipelines. Here are 5 criteria for measurement data quality, and some sample SQL you can use to test for them.

Engineering Excellence

Adding JOIN support for parallel replicas on ClickHouse®️

We recently introduced a pull request to ClickHouse that enables simple JOIN support for parallel replicas on ClickHouse. The solution may be simple and naive, but the ceiling for performance on distributed queries just got WAY higher.

Product updates

Why we just released a huge upgrade to our VS Code Extension

Tinybird is a powerful, performant real-time data platform. But we win the hearts of engineers through an amazing developer experience. Read how and why we recently upgraded our VS Code Extension for an even better DX.

The Data Base

5 Snowflake struggles that every Data Engineer deals with

Snowflake is the world’s leading cloud data warehouse, but it is almost always slow and costly for application development. Tinybird makes it easy to quickly and cost-effectively build applications on top of your Snowflake data. Tinybird and Snowflake are better together.

Product updates

Using custom Kafka headers for advanced message processing

Kafka headers are key-value pairs that can be attached to Kafka messages to provide metadata and additional information about the message. Read on to learn more about the use cases headers support and how to build real-time analytics pipelines using Kafka headers.

Scalable Analytics Architecture

The 8 considerations for designing public data APIs

For years I developed flood warning systems built on public data APIs. From my experience, I learned that there are 8 things you must consider to build a resilient public data API. These are those 8 things, and how Tinybird can take some of them off your plate.

I Built This!

Upgrading short link analytics by 100x with Steven Tey

We sat down with Steven Tey, Senior Developer Advocate at Vercel and creator of Dub.co, to talk about why switched Dub's analytics from Redis Sorted Sets to Tinybird.

I Built This!

Building privacy-first native app telemetry with Guilherme Oenning

Guilherme Oenning left his job to create Aptabase, a platform for mobile and desktop app developers to build telemetry and analytics using simple SDKs. We sat down with Guilherme to talk about building Aptabase and why he chose Tinybird over Postgres, BigQuery, and ClickHouse Cloud.

I Built This!

How to build a real-time fraud detection system

Digital fraud affects so many organizations. In this blog post, you'll learn the components of a real-time fraud detection system, and how to build one with Tinybird.

Scalable Analytics Architecture

The 5 rules for writing faster SQL queries

If you're building real-time analytics, you need your SQL to be fast. Fast SQL queries improve performance and reduce cost. Here are the 5 rules to follow to write the fastest SQL queries of your life.

I Built This!

Low-code analytics with James Devonport of UserLoop

James Devonport chose to build UserLoop on a no-code platform so he could quickly respond to customer feedback. Read how he found and implemented Tinybird on his journey to building the number one eCommerce customer intelligence software.

I Built This!

Automating customer usage alerts with Tinybird and Make

Here's how I used "low-code" analytics and automation to help my team be more proactive.

Engineering Excellence

7 strategies we're using to reduce cloud infrastructure costs in 2023

Cloud infrastructure costs are going up for everyone, but expectations to perform haven't receded. Here are 7 strategies that we use at Tinybird to keep our costs low as we innovate new ways to help our customers achieve more with less.

The Data Base

Real-time Databases: What developers need to know

Explore the key factors in choosing a real-time database and compare MongoDB, PostgreSQL, Tinybird, ClickHouse, Snowflake, Pinot, and Druid to determine the best fit for your application's performance, scalability, and analytics needs.

I Built This!

Chatting GraphQL with Jamie Barton of Grafbase

We sit down with Jamie Barton of Grafbase to talk about building a serverless platform to help developers build GraphQL backends, and how Tinybird has multiplied their development speed while supporting all their data integration needs.

Product updates

Generate mock data schemas with GPT

Today, we announce the release of our in-product, AI-powered demo data generator. Building off our recent release of Mockingbird, Tinybird now makes it possible to generate mock data schemas based on GPT prompts. Write your first mock data prompt today in the Tinybird UI.

Product updates

A free and open source mock data generator for your next data project

Mockingbird is a powerful and flexible mock streaming data generator for all of your data projects. With Mockingbird, you can define a data schema and stream mock data to Tinybird and external destinations. Use the headless library, CLI, or UI to generate data streams for any application.

Product updates

Building real-time solutions with Snowflake at a fraction of the cost

Snowflake is not optimized for real-time use cases. Integrate your Snowflake datasets with Tinybird to build low-latency, high-concurrency APIs over Snowflake data.

Product updates

The power of real-time streaming analytics with Confluent and Tinybird

Today, Tinybird is excited to announce the launch of our new Confluent Connector, offering Confluent users the ability to stream their data into Tinybird in real time. With today’s announcement, Confluent users have a new way to query their streaming data and build fast APIs, faster.

Tinybird news

Tinyshop: Get Tinybird swag delivered to your doorstep

Introducing Tinyshop, a less awkward and more environmentally-friendly way to share the Tinybird love. Get custom-designed Tinybird swag delivered straight to your door, starting today.

Engineering Excellence

Building a faster CI pipeline with Turborepo and pnpm

We made 3 big changes that have shortened our frontend CI execution time despite a massive increase in code size and test coverage.