Random reads and sequential writes are enough to build a log-structured database... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ethegwo on Dec 1, 2024 \| parent \| context \| favorite \| on: Building a distributed log using S3 (under 150 lin... Random reads and sequential writes are enough to build a log-structured database, but S3 does not really support the latter.

rad_gruchalski on Dec 1, 2024 [–]

One can do sequential writes by simply writing to a chunk objects at a key with the offset in the name. For example, sizes in MBs:

tmp/uploads/object-0, tmp/uploads/object-1024, tmp/uploads/object-2048

would be a rolled up object of size 2048MB + whatever is in the object-2048 file.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact