Forward Writing tests sucks. Use LLMs so it sucks less. Testing is a fundamental software practice. But people don't do it in data because it's hard. We're making it less hard (and more fun).
Build fast software with big data requirements Somehow we got stuck on the idea that big data systems should be slow. We're making it fast.
Forward Vibe data engineering You're probably sick of hearing people talk about "vibe coding", but what about "vibe data engineering?" ;)
Forward Local first. Run Tinybird on your machine. Deploy your data project locally or to the cloud in the exact same way, as it should be.
Building In Public Featured Ship data as you ship code: Deploy changes with a single command We've redesigned the Tinybird CLI, codename "FORWARD". You can now test it in beta.
Building In Public Featured Ship data as you ship code: Tinybird is becoming local-first. Tinybird's local-first experience is coming. Write code. Test it locally. Push it to git. CI runs the build. It's deployed. You're done.
Product Featured Tinybird Local: Build with data on your machine You can now build and test your data projects locally using the Tinybird Local Docker container.
Building In Public Featured How to scale a real-time data platform Tinybird is an enterprise-grade data platform with large customers processing huge amounts of data. Learn how we scale to support their use cases.
ClickHouse Adding JOIN support for parallel replicas on ClickHouse®️ We recently introduced a pull request to ClickHouse that enables simple JOIN support for parallel replicas on ClickHouse. The solution may be simple and naive, but the ceiling for performance on distributed queries just got WAY higher.
Our Beliefs When you should use columnar databases and not Postgres, MySQL, or MongoDB Row-oriented, OLTP databases aren't ideal application DBs when you know you'll need to run analytics on lots of data. Choose a column-oriented OLAP instead.
Our Beliefs The hard parts of building data systems with high concurrency Here are 8 things to think about when you're trying to scale in realtime.
Tech Spatial Indexing aids Finding which Polygons contain a Point Speed up your queries by using a spatial index to select fewer polygons before testing if a point is inside a polygon.
Data 101 Starting with Kafka I just want to share my thoughts on Kafka after using it for a few months, always from a practical point of view. I don’t know anything more than the basics ...
ClickHouse ClickHouse tips #3: the transform function Using the transform function to join two tables when joinGet is not available.
ClickHouse Clickhouse, Open Source and Tinybird We are hiring full-time Clickhouse Developers. Find out why we contribute to Open Source (ClickHouse) and why we want to contribute much more.
Tech Publish SQL-based endpoints on NGINX log analysis Building a highly scalable log analytics tool with Tinybird and exporting your queries as an API.
ClickHouse Clickhouse Tips #1: Calculating Aggregations After a Given Date Tips and recipes to learn how to make the most of ClickHouse, curated weekly by the Tinybird team.
Product Product design: how our SaaS integrates with git Analytics data projects are code and code should be in a repo.
Building In Public How we processed 12 trillion rows during Black Friday In this post we explain the data architecture, infrastructure and how we scale our real-time analytics service with ClickHouse.
What We're Reading The Fremen – What our team is reading If you want to know how to work with new or limited resources, find a population that’s used to not having many alternatives.
What We're Reading Getting real – What our team is reading The best software has a vision. The best software takes sides. When someone uses software, they’re not just looking for features.
What We're Reading New ideas often emerge or are developed in response to extreme needs arising during a social crisis – What our team is reading World War II, for example, forced innovation or accelerated development and commercialization of the jet engine, pressurized aircraft cabins, helicopters, at...
What We're Reading The most sophisticated piece of software ever written – What our team is reading What is the most sophisticated piece of software ever written?
What We're Reading The Guns of August – What our team is reading Why the birds are the world's best engineers