blob: 66c5d5a13851edcbd45e0f891e9ee7c71dd7314a (
about) (
plain) (
blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
|
dynamic packfiles to append objects
gc/refcount process punches page-sized holes in them for pages fully
within the space of unwanted objects, after setting a tombstone mark
holes are recorded in an index and re-used
then, if desired, the repack process removes all the punched holes
and anything surrounding from unwanted objects that are slightly out
of the page boundary
.idx is not a bsearch because that would cause me to need to rewrite
the entire pack every time i add objects; instead use an extendible
hash table.
genreational bloom filters
research bitcask
fetch: take current pack, remove dead objects/holes, filter objects
out, record offsets and adjust ofs_deltas since they always go
backwards, write the pack back; then stream written pack to client.
two-step necessary because pack header includes object count; could
have a custom new protocol that doesn't do so.
|
