Some of us met in Denver for an Apache DataFusion meetup last week. Here are the slides and videos: github.com/apache/dataf...

Can you accelerate queries when your data is *partially* sorted (and e.g. you don't want to have to resort it). Yes. Qi Zhu and I explain how in: datafusion.apache.org/blog/2026/07...

The Apache DataFusion 54.0.0 release (2 months of development had 139 distinct contributors. 🤯 github.com/apache/dataf...

Make TPC-H data scale factor 10 faster than you can type the command (under 10 sec). The new release of tpchgen-cli is out -- try it via uvx uvx tpchgen-cli parquet --scale-factor=10 Huge thanks to @clflushopt.bsky.social and @kevinjqliu.bsky.social

Pretty great to see the DataFusion meetup in China this past weekend: github.com/apache/dataf...

If you have ever wondered what features were introduced when in Apache Parquet we have a new page that tells you: parquet.apache.org/docs/file-fo... (trying to bring sanity to the versioning, one at a time)

Call for (20 min) presos on "What cool thing are you building with @ApacheDataFusio ?" github.com/apache/dataf...

Headline Features in Apache DataFusion 54: 1. Performance (now within 10% of ClickBench leaderboard) 2. Lambda Functions 3. Content defined chunking for Parquet 4. New AVRO reader 5. Better / faster joins + spilling datafusion.apache.org/blog/output/...

Floating point values in Apache Parquet statistics 📰 parquet.apache.org/blog/2026/05...

Whenever I think we can't possibly make filtering faster in Arrow / Rust, I am proved incorrect. Huge kudos to @ClSlaid for squeezing out even more performance github.com/apache/arrow...

We recently hit 5 digit issue mark in arrow-rs. Admittedly this isn't as cool as before LLMs but it is still neat 🤩 github.com/apache/arrow...

A new milestone: @duckdb.org is following DataFusion 😎 github.com/duckdb/duckd... Admittedly this is somewhat ClickBenchmaxxing, but I think it is evidence that analytic engine performance is converging over time (we are in a race to the bottom on performance), accelerated by LLMs

BTW @samyak.me the todo could be filled out with this www.youtube.com/watch?v=FeqR...

I just had the chance to watch @samyak.me 's talk about cancellation safety and async Rust (and how a `&mut` can lead to a deadlock). If this is a topic that interests you, I recommend checking it out: samyak.me/talks/cancel/

It was great to see everyone last night in Portland for the Apache DataFusion Meetup. Thanks to Mustafa Akur for hosting and the talk about sorted analysis. Also to Lu Qiu for discussing distributed query Execution. Finally to @westonpace.bsky.social for keeping it real about Row Groups

This is a cool breakdown of what organizations / people have been contributing to DataFusion theconsensus.dev/p/2026/04/03...

DataFusion 53.0.0 is released: datafusion.apache.org/blog/output/...

In depth blog on how to write table providers for Apache DataFusion : datafusion.apache.org/blog/2026/03...

Another example of incorporating the latest Database Research (in this case Limit Pruning from ❄️) in Apache DataFusion datafusion.apache.org/blog/2026/03....

Here is a new blog about Parquet Variant, including use case, and shredding examples parquet.apache.org/blog/2026/02...

📖 Apache Parquet recently added native support for Geospatial. This post explains what that means and why it is important: parquet.apache.org/blog/2026/02...

You can use ApacheParquet for Vector Search with embedded indexes: > We don’t change the file format; we just tune it. Xiangpeng Hao explains how in blog.xiangpeng.systems/posts/vector...

A somewhat academic talk about the AI usecases driving changes in Apache Parquet and new formats in "Column Storage for the AI Era" Recording: youtu.be/k9uhw7yqPsQ Slides: docs.google.com/presentation...

Optimized implementation of SQL CASE expressions in column stores requires careful engineering. The latest Apache DataFusion blog from Pepijn Van Eeckhoudt and Raz Luvaton explains how it works datafusion.apache.org/blog/2026/02...

DataFusion 52 Release Blog is Published datafusion.apache.org/blog/2026/01...

I love it when I see a whole pile of commits I didn't review go to DataFusion main github.com/apache/dataf...

DataFusion blog from Geoffrey Claude explains how to extend DataFusion to support: -- Postgres style operators SELECT payload->'user'->>'id' FROM logs; -- Statistical sampling SELECT * FROM sensor_data TABLESAMPLE BERNOULLI(10 PERCENT); datafusion.apache.org/blog/2026/01...

Stoked to be attending North East Database Day on Friday. It is a great mini conference and highlights some of the great research work going on in this area nedbday.github.io/2026/

Great paper about pruning from Snowflake: arxiv.org/pdf/2504.11540 The LIMIT pruning they describe is 🤯 (so clever once you get it) We have implemented almost all of the techniques in Apache DataFusion, FWIW

Come meet fellow Apache DataFusion users and committers at the Stockholm meetup March 5, luma.com/ctqtiqap