You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: open-log/rfcs/0001-storage.md
+8-8Lines changed: 8 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,4 +1,4 @@
1
-
# RFC 0001: Open-Log Storage
1
+
# RFC 0001: Log Storage
2
2
3
3
**Status**: Draft
4
4
@@ -7,11 +7,11 @@
7
7
8
8
## Summary
9
9
10
-
This RFC defines the storage model and core API for open-log. Keys are stored directly in the LSM with a sequence number suffix, enabling per-key log streams with global ordering. The API provides append and scan operations mirroring SlateDB's interface.
10
+
This RFC defines the storage model and core API for OpenData-Log. Keys are stored directly in the LSM with a sequence number suffix, enabling per-key log streams with global ordering. The API provides append and scan operations mirroring SlateDB's interface.
11
11
12
12
## Motivation
13
13
14
-
Open-Log is a key-oriented log system inspired by Kafka, but with a simpler model: keys are user-defined and every key is logically its own independent log. There is no concept of partitions or repartitioning—users simply write to new keys when their access patterns change.
14
+
OpenData-Log is a key-oriented log system inspired by Kafka, but with a simpler model: keys are user-defined and every key is logically its own independent log. There is no concept of partitions or repartitioning—users simply write to new keys when their access patterns change.
15
15
16
16
Logs are stored in SlateDB's LSM tree. Writes are appended to the WAL and memtable, then flushed to sorted string tables (SSTs). LSM compaction naturally organizes data for log locality, grouping entries by key prefix over time. This provides efficient sequential reads for individual logs without requiring explicit partitioning infrastructure.
17
17
@@ -63,7 +63,7 @@ If SlateDB supports multi-writer in the future, each writer would maintain its o
63
63
64
64
### SST Representation
65
65
66
-
Open-log proposes two enhancements to SlateDB's SST structure to support efficient `scan` and `count` operations.
66
+
OpenData-Log proposes two enhancements to SlateDB's SST structure to support efficient `scan` and `count` operations.
67
67
68
68
#### Block Record Counts
69
69
@@ -77,7 +77,7 @@ This enables counting records in a range by scanning the LSM at the index level
77
77
78
78
#### Bloom Filter Granularity
79
79
80
-
SlateDB SSTs include bloom filters to accelerate point lookups. For open-log, the bloom filter should be keyed on the log key alone, not the composite SlateDB key which includes the sequence number. This allows the bloom filter to indicate whether a given log is present in an SST, reducing the blocks read during `scan` or `count` queries.
80
+
SlateDB SSTs include bloom filters to accelerate point lookups. For OpenData-Log, the bloom filter should be keyed on the log key alone, not the composite SlateDB key which includes the sequence number. This allows the bloom filter to indicate whether a given log is present in an SST, reducing the blocks read during `scan` or `count` queries.
0 commit comments