Tech Query DynamoDB tables with SQL Want to aggregate, filter, or join DynamoDB tables with SQL? Here's how to do it, and why you should (and shouldn't) query DynamoDB tables with SQL.
Tech Simple patterns for aggregating on DynamoDB DynamoDB doesn't natively support aggregations, so here are four different approaches to aggregate data in DynamoDB tables.
Tech Top Use Cases for DynamoDB in 2024 DynamoDB… it's fast, scalable, and flexible. What's not to love? Here are the top use cases for DynamoDB in 2024 (and a few areas where it won't work).
Product 3 ways to run real-time analytics on AWS with DynamoDB DynamoDB is a great database for real-time transactions, but it isn't suited for analytical queries or real-time analytics. Explore a few ways to build real-time analytics on data you already have in DynamoDB.
Tinybird Examples Event sourcing with Kafka: A practical example Learn what event sourcing is, why Kafka works so well for event sourcing patterns, and how to implement event sourcing with Kafka and Tinybird.
Tech Tinybird: A ksqlDB alternative when stateful stream processing isn't enough ksqlDB is a common stream processing choice for data engineers working in the Kafka ecosystem. Learn about ksqlDB and when to choose alternatives like Tinybird.
Tech Data-driven CI pipeline monitoring with pytest Recently, we cut our CI pipeline execution time in half. To consummate our work, we've officially published the pytest plugin that made it possible, so you can use it, too.
ClickHouse Using Bloom filter indexes for real-time text search in ClickHouse®️ A customer of ours had text-based log data and they wanted to be able to search over the text (quickly). However, in ClickHouse, text search without any special measures involves a full scan, period. And we know that full scans are not efficient.
ClickHouse Adding JOIN support for parallel replicas on ClickHouse®️ We recently introduced a pull request to ClickHouse that enables simple JOIN support for parallel replicas on ClickHouse. The solution may be simple and naive, but the ceiling for performance on distributed queries just got WAY higher.
Tech 5 Snowflake struggles that every Data Engineer deals with Snowflake is the world’s leading cloud data warehouse, but it is almost always slow and costly for application development. Tinybird makes it easy to quickly and cost-effectively build applications on top of your Snowflake data. Tinybird and Snowflake are better together.
A privacy-first approach to building a Google Analytics alternative Respecting your web visitors' privacy and getting the data you need don't have to be mutually exclusive.
Tech Use AWS SNS to send data to Tinybird SNS is a popular pub/sub messaging system for AWS users. Here's how to use SNS to send data to Tinybird.
Tech Spatial Indexing aids Finding which Polygons contain a Point Speed up your queries by using a spatial index to select fewer polygons before testing if a point is inside a polygon.
Tech From Kafka streams to data products Productize data ingested via Kafka using API endpoints with Tinybird
Our Beliefs The era of JSON data analytics JSON is the de facto standard for data communication in the web and that's why we are supporting it natively: from a Kafka stream or from local or remote NDJSON files (and very soon in other flavours)
Tech Splitting CSV files at 3GB/s Splitting CSV files is a must when dealing with large, potentially larger than RAM, files. But how fast can it be?
Tech Performance and Kafka compression The **unmodified** support message we sent to one of our clients outlining potential performance gains through Kafka compression
Data 101 Starting with Kafka I just want to share my thoughts on Kafka after using it for a few months, always from a practical point of view. I don’t know anything more than the basics ...
Tech Publish SQL-based endpoints on NGINX log analysis Building a highly scalable log analytics tool with Tinybird and exporting your queries as an API.
Tech Low-latency APIs over your BigQuery datasets BigQuery is not designed (or priced) to withstand hundreds of requests per second. Here is how you can add Tinybird to the mix to productise that data.
Tech Querying large CSVs online with SQL Use Tinybird to query large CSVs using SQL, right from your browser.
Tech Enriching Kafka streams for real-time queries If you are using Kafka to capture large quantities of events or transactional data, you are probably also looking for ways to enrich that data in real-time. Here is how to do it with Tinybird.
Tech The cron job that will speed up your Postgres queries 100x What do you do when your transactions table in Postgres has grown way too big to handle analytical queries? How do you answer business questions when it could take minutes to even get a `SELECT count(*) FROM transactions` going?
Tech Real-time analytics API at scale with billions of rows How to create an analytics API that deals with billions of rows in a matter of minutes.