Repositories list

• sail

  Public
  Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

  pythonrustmachine-learning+ 17

  pythonrustmachine-learningsqlbig-datasparkapache-sparkarrowdistributed-computingartificial-intelligence+ 10

  Rust

  •

  Apache License 2.0

  •206206 forks•3.3k3.3k stars•134134 issues•9898 pull requests•Updated Aug 4, 2026Aug 4, 2026

• datafusion

  Public
  Apache DataFusion SQL Query Engine

  Rust

  •

  Apache License 2.0

  •2.3k2.3k forks•00 stars•00 issues•1818 pull requests•Updated Aug 1, 2026Aug 1, 2026

• langchain-sail

  Public
  LangChain integration for Sail (drop-in Apache Spark replacement)

  Python

  •

  Apache License 2.0

  •00 forks•33 stars•00 issues•00 pull requests•Updated Aug 1, 2026Aug 1, 2026

• iceberg-rust

  Public
  Apache Iceberg

  Rust

  •

  Apache License 2.0

  •534534 forks•00 stars•00 issues•66 pull requests•Updated Jul 27, 2026Jul 27, 2026

• ClickBench

  Public
  ClickBench: a Benchmark For Analytical Databases

  HTML

  •

  Other

  •302302 forks•00 stars•00 issues•00 pull requests•Updated Jul 1, 2026Jul 1, 2026

• serde_arrow

  Public
  Convert sequences of Rust objects to Arrow tables

  Rust

  •

  MIT License

  •2929 forks•00 stars•00 issues•33 pull requests•Updated Jun 5, 2026Jun 5, 2026

• marrow

  Public
  Minimalist Arrow interop

  Rust

  •

  MIT License

  •33 forks•00 stars•00 issues•11 pull request•Updated May 21, 2026May 21, 2026

• dbt-sail

  Public
  dbt adapter for Sail (Spark-compatible compute engine)

  Python

  •

  Apache License 2.0

  •00 forks•1010 stars•00 issues•00 pull requests•Updated Apr 25, 2026Apr 25, 2026

• dbt-adapters

  Public archive
  Python

  •

  Apache License 2.0

  •345345 forks•00 stars•00 issues•11 pull request•Updated Apr 15, 2026Apr 15, 2026

• datafusion-functions-json

  Public
  JSON support for DataFusion (unofficial)

  Rust

  •

  Apache License 2.0

  •3131 forks•00 stars•00 issues•00 pull requests•Updated Nov 20, 2025Nov 20, 2025

• delta-rs

  Public
  A native Rust library for Delta Lake, with bindings into Python

  Rust

  •

  Apache License 2.0

  •642642 forks•00 stars•00 issues•11 pull request•Updated Nov 19, 2025Nov 19, 2025

• arrow-rs-object-store

  Public
  Rust object_store crate

  Rust

  •

  Apache License 2.0

  •196196 forks•00 stars•00 issues•00 pull requests•Updated Nov 2, 2025Nov 2, 2025

• delta-kernel-rs

  Public
  A native Delta implementation for integration with any query engine

  Rust

  •

  Apache License 2.0

  •194194 forks•00 stars•00 issues•00 pull requests•Updated Aug 28, 2025Aug 28, 2025

• sqlparser-rs

  Public
  Extensible SQL Lexer and Parser for Rust

  Rust

  •

  Apache License 2.0

  •753753 forks•22 stars•00 issues•00 pull requests•Updated Jan 14, 2025Jan 14, 2025

• pyo3

  Public
  Rust bindings for the Python interpreter

  Rust

  •

  Apache License 2.0

  •1k1k forks•00 stars•00 issues•00 pull requests•Updated Sep 12, 2024Sep 12, 2024

• fastrace

  Public
  A tracing library 10~100x faster than others

  Rust

  •

  Apache License 2.0

  •5656 forks•00 stars•00 issues•00 pull requests•Updated Sep 12, 2024Sep 12, 2024

• flink-docker-images

  Public archive
  Apache Flink Docker images by LakeSail

  Java

  •

  Apache License 2.0

  •00 forks•44 stars•00 issues•00 pull requests•Updated Mar 21, 2024Mar 21, 2024