You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: CHANGELOG.md
+29-3Lines changed: 29 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,6 +5,29 @@ All notable changes to Shimmy will be documented in this file.
5
5
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
6
6
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
7
7
8
+
## [2.3.0] - 2026-07-20
9
+
10
+
### Added
11
+
-**Grammar control hooks** — schoolmarm+grammar module for structured generation
12
+
-**PPT invariant cage (B1-B3)** — golden-vault-based regression detection. Contracts verify per-layer RMS/checksum against vault oracles for 12 populated models. Run with `cargo test --test test_invariants -- --test-threads=1`.
13
+
-**Discrete GPU preference** — adapter selection now enumerates all GPUs and prefers `DiscreteGpu` over `IntegratedGpu` (commit `6ed0349`). Fixes multi-GPU laptops picking the Intel iGPU.
14
+
15
+
### Fixed
16
+
-**batch_count: 0 → batch_count: 1** in `server_inference.rs`. The QKV shader guard `if (global_id.y >= params.batch_count)` killed ALL threads when `batch_count=0` (since `0>=0` is true), producing no Q/K/V output. Root cause of the server-side gibberish regression (bisected to commit `43027d3`).
17
+
-**Rust/WGSL struct layout mismatch** — per-field quant types (Q/QK/K/V) aligned between Rust `LayerParams` and WGSL shader structs.
-`trace_callback()` — capture hook for invariant probes
28
+
29
+
---
30
+
8
31
## [2.2.1] - 2026-06-30
9
32
10
33
### Fixed
@@ -1027,9 +1050,12 @@ The systematic engineering discipline established in v1.7.3 creates a **BULLETPR
1027
1050
### Free Forever Commitment
1028
1051
Shimmy is committed to being free forever with no asterisks, no "free for now" periods, and no pivot to paid services. The MIT license ensures this commitment is legally binding.
Copy file name to clipboardExpand all lines: README.md
+5-3Lines changed: 5 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -62,9 +62,11 @@ Shimmy is a **single-binary** that provides **100% OpenAI-compatible endpoints**
62
62
63
63
**⚡ NEW in v2.1.0**: [TurboShimmy INT4 KV](#-turboshimmy-int4-kv) — ~7× less KV cache VRAM with one flag. Run Llama-3.2-3B on 4 GB GPUs.
64
64
65
-
## 🔥 Airframe Engine (v0.2.7)
65
+
**⚡ NEW in v2.3.0**: Adapter selection fix (prefers discrete GPU over integrated), grammar control hooks, 357 passing tests.
66
66
67
-
Starting in v2.0.0, Shimmy's default inference engine is **Airframe** — a pure-Rust WebGPU (WGSL) transformer runtime built from scratch. **v0.2.7** brings the Inference Saturation Fabric (ISF) refit and TDR transport integration to production.
67
+
## 🔥 Airframe Engine (v0.2.9)
68
+
69
+
Starting in v2.0.0, Shimmy's default inference engine is **Airframe** — a pure-Rust WebGPU (WGSL) transformer runtime built from scratch. **v0.2.9** brings the production batch_count fix, GPU adapter selection improvement, grammar hooks, and the PPT invariant cage.
68
70
69
71
**See [airframe CHANGELOG](https://github.com/Michael-A-Kuykendall/airframe/blob/master/CHANGELOG.md) for full release notes.**
70
72
@@ -328,7 +330,7 @@ cd shimmy
328
330
cargo build --release
329
331
```
330
332
331
-
> **Note**: The Airframe GPU engine is a private dependency and **cannot be built from source** by public users. The [pre-built release binaries](#-download-pre-built-binaries-recommended)already include Airframe compiled in — download those to get full GPU acceleration. `cargo install shimmy` installs the huggingface engine variant from crates.io.
333
+
> **Note**: The Airframe GPU engine is a public crate on [crates.io](https://crates.io/crates/airframe) and builds from source automatically. `cargo install shimmy` installs the huggingface engine variant from crates.io; for the full GPU build use the [pre-built release binaries](#-download-pre-built-binaries-recommended)or clone and build with `cargo build --release`.
0 commit comments