Ibis benchmarking

A composable data system benchmark in a Python package.

Overview

Ibis is an interface, not an engine. Ibis allows you to use the best engine for your workload. The Ibis benchmarking project is used to benchmark various engines with Ibis.

Source: Voltron Data Composable Codex

Benchmarks

See the following benchmarks:

• August 2024 ad hoc analysis
• Querying 1TB on a laptop with Python dataframes
• Introducing Ibis benchmarking

Getting started

You can reproduce the benchmark easily.

Installation

Developer setup

Install gh and just, then:

gh repo clone lostmygithubaccount/ibis-bench
cd ibis-bench
just setup
. .venv/bin/activate

Pip install

Run:

pip install ibis-bench

Usage

Use the CLI to run benchmarks.

bench