From 98d9f10ff1bedb8e06b59da49d7767664b6d8782 Mon Sep 17 00:00:00 2001
From: Runxi Yu
Date: Sun, 28 Jun 2026 03:33:55 +0000
Subject: research: dynpack

---
 research/dynamic_packfiles.txt | 37 +++++++++++++++++++++++++++++++++++++
 1 file changed, 37 insertions(+)

diff --git a/research/dynamic_packfiles.txt b/research/dynamic_packfiles.txt
index e4fe7e54..e12ca530 100644
--- a/research/dynamic_packfiles.txt
+++ b/research/dynamic_packfiles.txt
@@ -1,3 +1,40 @@
+Format:
+
+* Append-only-ish rolling packfiles
+* All objects are uncompressed with no zlib framing
+* Compression relies on filesystem block-level compression instead
+
+Rationale for the lack of compression:
+
+* Non-delta objects become readable via mmap with no copies at all
+* Delta instructions become easier to stream
+
+Indexes:
+
+* B+ tree for general-purpose use
+* Extendible hashing with SipHash-2-4 when prefix scans unnecessary
+
+GC:
+
+* Reachability, compaction
+* Cheap mode: tombstones + hole-punching on live packs
+* Defragmentation: COW, then delete tombstone areas and holes
+* ofs-delta compacted by simple subtraction
+
+Ingest:
+
+* Can't stream network packs to disk
+  but you have to decompress and resolve deltas in the first place
+* Stream decompression directly into dynamic packs
+
+Serving:
+
+* Serving normal packfiles from dynamic packs
+  re-adds zlib framing
+* Many forges already serve at near-zero effective compression
+
+===================================
+
 dynamic packfiles to append objects
 
 gc/refcount process punches page-sized holes in them for pages fully
-- 
cgit v1.3.1-10-gc9f91