Extremely fast Query Engine for DataFrames, written in Rust
-
Updated
Aug 26, 2026 - Rust
#
out-of-core
Here are 40 public repositories matching this topic...
Out-of-core graph processing on a single machine.
-
Updated
May 7, 2018 - C++
biglasso: Extending Lasso Model Fitting to Big Data in R
-
Updated
Aug 24, 2026 - C++
KMeans for big data using preconditioning and sparsification, Matlab implementation. Aka k-means
-
Updated
Apr 13, 2020 - MATLAB
A WebGPU-native out-of-core rendering system for large virtualized volumetric data.
-
Updated
Jul 14, 2026 - TypeScript
GraphFrames but in DataFusion
-
Updated
Aug 25, 2026 - Rust
Python bindings to the libmf c++ repo for Matrix Factorization. libmf is fast, highly parallel, and can support factoring large matrices without holding them all in memory.
-
Updated
Nov 24, 2023 - C++
Run models too big for RAM on Apple Silicon — any Hugging Face model, dense or MoE — by streaming weights from disk
-
Updated
Aug 19, 2026 - Python
Source code of my master thesis on occlusion culling for (out-of-core) path tracing
-
Updated
Jul 29, 2025 - C++
Single-pass exploratory data analysis on streaming algorithms. Bounded memory at any dataset size, pandas and Polars, self-contained HTML reports.
python exploratory-data-analysis eda pandas out-of-core streaming-algorithms data-quality data-profiling sketching-algorithms polars
-
Updated
Aug 20, 2026 - Python
Optimised multi-node MPI sorting algorithms in Julia
-
Updated
Sep 25, 2024 - Julia
Big-file data prep that never runs out of memory - an interactive shell and CLI, powered by DuckDB.
python shell cli data-science data csv etl pandas data-engineering parquet data-wrangling command-line-tool dataframe data-cleaning out-of-core duckdb larger-than-memory
-
Updated
Aug 5, 2026 - Python
A fast, bare-bones C++14/17 reader for larger-than-memory PLY files
-
Updated
Apr 13, 2020 - C++
Easy out-of-core computing with nested data structures in Python as a drop-in replacement of dict
-
Updated
Sep 4, 2025 - Python
Toolkit library for supporting high-performance, scientific applications
-
Updated
Jun 30, 2026 - C++
python image-processing dask microscopy multiscale out-of-core bioimage-analysis zarr image-pyramid ngff ome-zarr tensorstore
-
Updated
Aug 21, 2026 - Python
-
Updated
Mar 21, 2017 - Python
BLOCKSET: Efficient out of core tree ensemble inference
machine-learning aws-lambda random-forest memory-efficient out-of-core tree-ensemble gradient-boosting efficient-inference on-device-ai
-
Updated
Feb 13, 2023 - C++
MegaMmap: Blurring the Boundary Between Memory and Storage for Data-Intensive HPC Workloads. A software distributed shared memory system that enables infinite memory capacity through intelligent tiered DRAM and storage management.
machine-learning hpc mpi scientific-computing high-performance-computing cpp17 out-of-core distributed-shared-memory storage-systems memory-tiering ai4hpc data-intensive-computing
-
Updated
Nov 3, 2025 - C++
High-performance out-of-core GPU matrix multiplication using cuBLAS with NUMA-aware memory management.
-
Updated
Jan 19, 2026 - Cuda
Improve this page
Add a description, image, and links to the out-of-core topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the out-of-core topic, visit your repo's landing page and select "manage topics."