Tensors vs. Tables: Why tabular tools trip over gridded data(earthmover.io)
earthmover.io
Tensors vs. Tables: Why tabular tools trip over gridded data
https://earthmover.io/blog/tensors-vs-tables/
1 comments
The scientific community works primarily with array (or "tensor") data, using tools like numpy, xarray, and zarr. People familiar with modern relational database tools such as DuckDB and Parquet often ask why can't we just use those? This article explains why: it's massively inefficient to use tabular tools on array data, and demonstrates with a benchmark showing a 10x difference in query speed.