LiteFS

What's Changed

• Add GitHub token permissions for releases by @benbjohnson in https://github.com/superfly/litefs/pull/444

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.13...v0.5.14

What's Changed

• Fix release to use Ubuntu latest by @benbjohnson in https://github.com/superfly/litefs/pull/443

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.12...v0.5.13

What's Changed

• typo: asychronous -> asynchronous by @ruslandoga in https://github.com/superfly/litefs/pull/435
• Support overridding the default LiteFS Cloud endpoint by @stephen in https://github.com/superfly/litefs/pull/437
• Use optimized checksumming when loading database by @btoews in https://github.com/superfly/litefs/pull/441
• Dockerfile: Add sidecar support by @saleemrashid in https://github.com/superfly/litefs/pull/442

New Contributors

• @ruslandoga made their first contribution in https://github.com/superfly/litefs/pull/435
• @stephen made their first contribution in https://github.com/superfly/litefs/pull/437
• @saleemrashid made their first contribution in https://github.com/superfly/litefs/pull/442

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.11...v0.5.12

What's Changed

• Prevent WAL writes when using EXCLUSIVE locking mode by @benbjohnson in https://github.com/superfly/litefs/pull/426

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.10...v0.5.11

What's Changed

• Upgrade to Go v1.21.5 by @benbjohnson in https://github.com/superfly/litefs/pull/422

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.9...v0.5.10

What's Changed

• update golang.org/x/net to latest by @ajayk in https://github.com/superfly/litefs/pull/417
• Add proxy server timeout config options by @benbjohnson in https://github.com/superfly/litefs/pull/420

New Contributors

• @ajayk made their first contribution in https://github.com/superfly/litefs/pull/417

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.8...v0.5.9

What's Changed

• Add always-forward config to proxy server by @benbjohnson in https://github.com/superfly/litefs/pull/413
• Default data dir & FUSE dir by @benbjohnson in https://github.com/superfly/litefs/pull/414
• Implement flushing copy on proxy response by @benbjohnson in https://github.com/superfly/litefs/pull/416

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.7...v0.5.8

What's Changed

• Filter replicated databases by @benbjohnson in https://github.com/superfly/litefs/pull/407
• Proxy primary redirect timeout by @benbjohnson in https://github.com/superfly/litefs/pull/408
• Fix snapshot generation of deleted database by @benbjohnson in https://github.com/superfly/litefs/pull/409
• Exit on partial LTX by @benbjohnson in https://github.com/superfly/litefs/pull/410
• Add primary hostname to /info endpoint by @benbjohnson in https://github.com/superfly/litefs/pull/411

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.6...v0.5.7

What's Changed

• Add OS interface by @benbjohnson in https://github.com/superfly/litefs/pull/404
• Exit on WAL commit failure by @benbjohnson in https://github.com/superfly/litefs/pull/405
• Limit LTX compaction during backups by @benbjohnson in https://github.com/superfly/litefs/pull/402

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.5...v0.5.6

What's Changed

• Upgrade to Go 1.21 by @benbjohnson in https://github.com/superfly/litefs/pull/387
• Add handoff timeout by @benbjohnson in https://github.com/superfly/litefs/pull/388
• Report existing consul cluster ID by @benbjohnson in https://github.com/superfly/litefs/pull/389
• Log cluster ID on startup by @benbjohnson in https://github.com/superfly/litefs/pull/390
• Implement soft delete by @benbjohnson in https://github.com/superfly/litefs/pull/395
• Add /debug/rand endpoint by @benbjohnson in https://github.com/superfly/litefs/pull/396
• Add snapshot timeout by @benbjohnson in https://github.com/superfly/litefs/pull/397
• Make node ID ephemeral by @benbjohnson in https://github.com/superfly/litefs/pull/398
• Use ltx.Checksum type by @benbjohnson in https://github.com/superfly/litefs/pull/400
• Add event stream by @benbjohnson in https://github.com/superfly/litefs/pull/401

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.4...v0.5.5

What's Changed

• Upgrade docker/build-push-action by @benbjohnson in https://github.com/superfly/litefs/pull/383
• Rename health check endpoint by @benbjohnson in https://github.com/superfly/litefs/pull/384
• Upgrade bruceadams/get-release by @benbjohnson in https://github.com/superfly/litefs/pull/385

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.3...v0.5.4

What's Changed

• Return 503 from proxy when no primary available by @benbjohnson in https://github.com/superfly/litefs/pull/373
• Add 'enabled' flag to tracing config by @benbjohnson in https://github.com/superfly/litefs/pull/374
• Delay proxy listen until marked ready by @benbjohnson in https://github.com/superfly/litefs/pull/378
• Expose lag as prometheus metric by @benbjohnson in https://github.com/superfly/litefs/pull/379
• Fix close errors by @benbjohnson in https://github.com/superfly/litefs/pull/380
• Proxy health check by @benbjohnson in https://github.com/superfly/litefs/pull/381

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.2...v0.5.3

What's Changed

• Retry environment metadata updates by @benbjohnson in https://github.com/superfly/litefs/pull/366
• Retry proxy on connection refused error by @benbjohnson in https://github.com/superfly/litefs/pull/368

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.1...v0.5.2

What's Changed

• Periodically check backup server for updates by @benbjohnson in https://github.com/superfly/litefs/pull/362

Full Changelog: https://github.com/superfly/litefs/compare/v0.5.0...v0.5.1

What's Changed

• Log remote address of the stream client by @dangra in https://github.com/superfly/litefs/pull/309
• proxy: treat HEAD requests as reads by @tvdfly in https://github.com/superfly/litefs/pull/311
• Upgrade to LTX v0.3.1 by @benbjohnson in https://github.com/superfly/litefs/pull/314
• Backup Client by @benbjohnson in https://github.com/superfly/litefs/pull/315
• Fix CI error on close by @benbjohnson in https://github.com/superfly/litefs/pull/316
• Use ltx.TXID by @benbjohnson in https://github.com/superfly/litefs/pull/317
• Initiate backup from snapshot by @benbjohnson in https://github.com/superfly/litefs/pull/318
• Use HWM during retention enforcement by @benbjohnson in https://github.com/superfly/litefs/pull/319
• Split out Client code by @benbjohnson in https://github.com/superfly/litefs/pull/320
• Propagate high-water mark to replicas by @benbjohnson in https://github.com/superfly/litefs/pull/321
• Restore from backup when out-of-sync by @benbjohnson in https://github.com/superfly/litefs/pull/322
• Default slog to not print timestamp by @benbjohnson in https://github.com/superfly/litefs/pull/323
• Compress LTX files sent to backup service by @benbjohnson in https://github.com/superfly/litefs/pull/324
• Rename HWM response header by @benbjohnson in https://github.com/superfly/litefs/pull/330
• Implement cluster ID by @benbjohnson in https://github.com/superfly/litefs/pull/332
• Rename Liteserver client by @benbjohnson in https://github.com/superfly/litefs/pull/333
• LiteFS Cloud environment variable by @benbjohnson in https://github.com/superfly/litefs/pull/336
• lfsc: fix nil pointer dereference by @pborzenkov in https://github.com/superfly/litefs/pull/337
• Fix 'locking protocol' bug while streaming snapshot in progress by @benbjohnson in https://github.com/superfly/litefs/pull/341
• Fix checksum issue with partial checkpoint by @benbjohnson in https://github.com/superfly/litefs/pull/343
• Improve SHM write log by @benbjohnson in https://github.com/superfly/litefs/pull/344
• Refactor SHM file access through FUSE by @benbjohnson in https://github.com/superfly/litefs/pull/348
• .lag file to track replication delay by @btoews in https://github.com/superfly/litefs/pull/340
• lfsc: ask fly-proxy to route to correct node if we know it by @pborzenkov in https://github.com/superfly/litefs/pull/349
• Set mtime on pos file using timestamp from last ltx by @btoews in https://github.com/superfly/litefs/pull/345
• Wait for SHM changes to flush before exit by @benbjohnson in https://github.com/superfly/litefs/pull/351
• Revert SHM Refactor by @benbjohnson in https://github.com/superfly/litefs/pull/353
• Refactor SHM lock by @benbjohnson in https://github.com/superfly/litefs/pull/354
• Implement checksum cache by @benbjohnson in https://github.com/superfly/litefs/pull/355
• Set host environment metadata by @benbjohnson in https://github.com/superfly/litefs/pull/357
• Rename metadata field to 'role' by @benbjohnson in https://github.com/superfly/litefs/pull/359
• Log environment error instead of returning it by @benbjohnson in https://github.com/superfly/litefs/pull/360

New Contributors

• @tvdfly made their first contribution in https://github.com/superfly/litefs/pull/311
• @pborzenkov made their first contribution in https://github.com/superfly/litefs/pull/337
• @btoews made their first contribution in https://github.com/superfly/litefs/pull/340

Full Changelog: https://github.com/superfly/litefs/compare/v0.4.0...v0.5.0

What's Changed

• Implement LZ4 compression by @benbjohnson in https://github.com/superfly/litefs/pull/249
• Add allow_other FUSE mount option by @benbjohnson in https://github.com/superfly/litefs/pull/251
• Add mutex to DB.chksums by @benbjohnson in https://github.com/superfly/litefs/pull/252
• Fix typo in litefs.yml by @walterwanderley in https://github.com/superfly/litefs/pull/263
• Passthrough application exit code by @benbjohnson in https://github.com/superfly/litefs/pull/265
• Update architecture doc to reflect v0.3.0 functionality by @MarkIannucci in https://github.com/superfly/litefs/pull/267
• Implement HTTP proxy for primary redirection & consistency by @benbjohnson in https://github.com/superfly/litefs/pull/271
• Remove buffer size limit in chunked writer by @benbjohnson in https://github.com/superfly/litefs/pull/274
• Fix issue with multiple header values in proxy by @benbjohnson in https://github.com/superfly/litefs/pull/276
• Allow proxy passthrough list by @benbjohnson in https://github.com/superfly/litefs/pull/278
• Upgrade to bazil.org/fuse@v0.0.0-20230120002735-62a210ff1fd5 by @benbjohnson in https://github.com/superfly/litefs/pull/279
• Enable FUSE ExplicitInvalidateData flag by @benbjohnson in https://github.com/superfly/litefs/pull/280
• Upgrade to Go 1.20 by @benbjohnson in https://github.com/superfly/litefs/pull/281
• Use spin lock for write lock acquisition by @benbjohnson in https://github.com/superfly/litefs/pull/283
• Implement HALT lock & write forwarding by @benbjohnson in https://github.com/superfly/litefs/pull/277
• Stop proxy server on startup error by @benbjohnson in https://github.com/superfly/litefs/pull/284
• Add 'export' command by @benbjohnson in https://github.com/superfly/litefs/pull/285
• Implement drop database by @benbjohnson in https://github.com/superfly/litefs/pull/286
• Add 'run' command by @benbjohnson in https://github.com/superfly/litefs/pull/287
• Add armv6 & armv7 builds by @benbjohnson in https://github.com/superfly/litefs/pull/295
• Ensure WAL is truncated to original size on CommitWAL() failure by @benbjohnson in https://github.com/superfly/litefs/pull/302
• Implement primary handoff by @benbjohnson in https://github.com/superfly/litefs/pull/303
• Set path for proxy server cookie by @benbjohnson in https://github.com/superfly/litefs/pull/304
• Implement -promote & -if-candidate flags on run command by @benbjohnson in https://github.com/superfly/litefs/pull/305
• Add 'promote' flag to config by @benbjohnson in https://github.com/superfly/litefs/pull/306
• Allow multiple exec commands by @benbjohnson in https://github.com/superfly/litefs/pull/307

New Contributors

• @walterwanderley made their first contribution in https://github.com/superfly/litefs/pull/263
• @MarkIannucci made their first contribution in https://github.com/superfly/litefs/pull/267

Full Changelog: https://github.com/superfly/litefs/compare/v0.3.0...v0.4.0

This release adds WAL support and we've done a ton of hardening & stability work. Checksumming has been revamped so it is not so error prone which should help stability quite a bit.

What's Changed

• docs: disconnected fixup in store by @ryanrussell in https://github.com/superfly/litefs/pull/111
• Prefix FUSE debug logs by @benbjohnson in https://github.com/superfly/litefs/pull/113
• Use uppercase hex for node ID by @benbjohnson in https://github.com/superfly/litefs/pull/114
• WAL support by @benbjohnson in https://github.com/superfly/litefs/pull/120
• Add WAL checkpoint test by @benbjohnson in https://github.com/superfly/litefs/pull/121
• Fix return lock type for SHM lock by @benbjohnson in https://github.com/superfly/litefs/pull/123
• List journal filenames in root handle by @dangra in https://github.com/superfly/litefs/pull/125
• Updates workflows to support external PRs by @dangra in https://github.com/superfly/litefs/pull/126
• Force WAL fsync() by @benbjohnson in https://github.com/superfly/litefs/pull/127
• Remove dead code for WAL locking by @benbjohnson in https://github.com/superfly/litefs/pull/129
• Consolidate locks & guards by @benbjohnson in https://github.com/superfly/litefs/pull/130
• Fix snapshot in WAL mode by @benbjohnson in https://github.com/superfly/litefs/pull/131
• Continue running on error by @benbjohnson in https://github.com/superfly/litefs/pull/137
• Reduce logging by @benbjohnson in https://github.com/superfly/litefs/pull/143
• Rollback journal on startup by @benbjohnson in https://github.com/superfly/litefs/pull/144
• Validate that mount & data directories are different by @benbjohnson in https://github.com/superfly/litefs/pull/145
• Ensure mount directory exists before mounting by @benbjohnson in https://github.com/superfly/litefs/pull/146
• refactor: replace Readdir(-1) with os.ReadDir by @Juneezee in https://github.com/superfly/litefs/pull/147
• Fix locking when applying LTX file to replica in WAL mode by @benbjohnson in https://github.com/superfly/litefs/pull/148
• Retain OS page cache on open(2) by @benbjohnson in https://github.com/superfly/litefs/pull/150
• Attempt unmount for unclean exit by @benbjohnson in https://github.com/superfly/litefs/pull/151
• Specify 'exec' command from CLI by @benbjohnson in https://github.com/superfly/litefs/pull/152
• Add SHM locks to /debug/vars by @benbjohnson in https://github.com/superfly/litefs/pull/154
• Add endpoint for dynamically setting debug logging by @benbjohnson in https://github.com/superfly/litefs/pull/156
• Replay last LTX on recovery by @benbjohnson in https://github.com/superfly/litefs/pull/157
• Fix recovery on replication position mismatch by @benbjohnson in https://github.com/superfly/litefs/pull/158
• Clear LTX files on snapshot received by @benbjohnson in https://github.com/superfly/litefs/pull/160
• Remove pre-exec sleep by @benbjohnson in https://github.com/superfly/litefs/pull/161
• Print version & commit info on startup by @benbjohnson in https://github.com/superfly/litefs/pull/162
• Initialize DB.mode on open by @benbjohnson in https://github.com/superfly/litefs/pull/163
• Add support for PERSIST journal mode by @benbjohnson in https://github.com/superfly/litefs/pull/168
• Add support for TRUNCATE journal mode by @benbjohnson in https://github.com/superfly/litefs/pull/169
• Show position file in readdir output by @benbjohnson in https://github.com/superfly/litefs/pull/175
• Allow simple expressions in env var expansion by @benbjohnson in https://github.com/superfly/litefs/pull/177
• Reduce Consul lock delay by @benbjohnson in https://github.com/superfly/litefs/pull/180
• Fix FUSE connection close deadlock by @benbjohnson in https://github.com/superfly/litefs/pull/181
• Add END frame to HTTP stream by @benbjohnson in https://github.com/superfly/litefs/pull/183
• Recover from invalid database on startup by @benbjohnson in https://github.com/superfly/litefs/pull/184
• Improve snapshot logging by @benbjohnson in https://github.com/superfly/litefs/pull/185
• Acquire all SHM read locks on snapshot by @benbjohnson in https://github.com/superfly/litefs/pull/186
• Read page count after verify by @benbjohnson in https://github.com/superfly/litefs/pull/187
• Move functionality to 'mount' subcommand by @benbjohnson in https://github.com/superfly/litefs/pull/188
• Update page count on apply by @benbjohnson in https://github.com/superfly/litefs/pull/189
• Implement StrictVerify for WAL by @benbjohnson in https://github.com/superfly/litefs/pull/190
• Add 'strict-verify' to YAML config by @benbjohnson in https://github.com/superfly/litefs/pull/191
• Fix compilation on Darwin by @benbjohnson in https://github.com/superfly/litefs/pull/193
• Fix JournalNode.Read() by @benbjohnson in https://github.com/superfly/litefs/pull/194
• Restrict dirty pgno to commit size by @benbjohnson in https://github.com/superfly/litefs/pull/195
• Allow retention enforcement to be disabled by @benbjohnson in https://github.com/superfly/litefs/pull/196
• Add litefs-bench test program by @benbjohnson in https://github.com/superfly/litefs/pull/198
• Fix frame count calculation on journal recovery by @benbjohnson in https://github.com/superfly/litefs/pull/197
• Upgrade to LTX v0.2.7 by @benbjohnson in https://github.com/superfly/litefs/pull/199
• Check for journal header magic after first segment by @benbjohnson in https://github.com/superfly/litefs/pull/200
• Set journal mode in litefs-bench by @benbjohnson in https://github.com/superfly/litefs/pull/201
• Skip dirty page tracking in WAL mode by @benbjohnson in https://github.com/superfly/litefs/pull/202
• Add -debug CLI flag to mount command by @benbjohnson in https://github.com/superfly/litefs/pull/203
• Move WAL commit to after WAL_WRITE_LOCK release by @benbjohnson in https://github.com/superfly/litefs/pull/205
• Fix Pos() deadlock with file system invalidation by @benbjohnson in https://github.com/superfly/litefs/pull/206
• Fix WriteSnapshotTo() lock in WAL mode by @benbjohnson in https://github.com/superfly/litefs/pull/207
• Add 'query' command to litefs-bench by @benbjohnson in https://github.com/superfly/litefs/pull/208
• Add latency metrics by @benbjohnson in https://github.com/superfly/litefs/pull/209
• Add skip-sync config flag by @benbjohnson in https://github.com/superfly/litefs/pull/210
• Acquire shared CKPT & RECOVER lock during snapshot by @benbjohnson in https://github.com/superfly/litefs/pull/211
• Add 'import' command by @benbjohnson in https://github.com/superfly/litefs/pull/212
• Disable fail-fast on CI by @benbjohnson in https://github.com/superfly/litefs/pull/214
• Remove journal on import by @benbjohnson in https://github.com/superfly/litefs/pull/213
• Make FUSE layer thinner by @benbjohnson in https://github.com/superfly/litefs/pull/215
• Fix journal checksum validation by @benbjohnson in https://github.com/superfly/litefs/pull/216
• Consolidate Remaining DB API by @benbjohnson in https://github.com/superfly/litefs/pull/218
• Add trace logging by @benbjohnson in https://github.com/superfly/litefs/pull/219
• Implement page-level checksum tracking by @benbjohnson in https://github.com/superfly/litefs/pull/221
• Sync WAL to LTX on startup by @benbjohnson in https://github.com/superfly/litefs/pull/222
• Rewrite SHM after replica LTX apply by @benbjohnson in https://github.com/superfly/litefs/pull/224
• Move debug flag to FUSE config section by @benbjohnson in https://github.com/superfly/litefs/pull/225
• Implement rolling trace log by @benbjohnson in https://github.com/superfly/litefs/pull/226
• Skip lock page on checksum by @benbjohnson in https://github.com/superfly/litefs/pull/227
• Skip lock page on snapshot by @benbjohnson in https://github.com/superfly/litefs/pull/228
• Checkpoint on primary/replica state change by @benbjohnson in https://github.com/superfly/litefs/pull/229
• Remove FUSE debugging on CI testing by @benbjohnson in https://github.com/superfly/litefs/pull/231
• Implicit CKPT lock on WRITE lock by @benbjohnson in https://github.com/superfly/litefs/pull/230
• Add additional trace logging to CommitWAL() by @benbjohnson in https://github.com/superfly/litefs/pull/232
• Prevent partial WAL rewind by @benbjohnson in https://github.com/superfly/litefs/pull/233
• Continue init on database early EOF by @benbjohnson in https://github.com/superfly/litefs/pull/235
• Increase default retention by @benbjohnson in https://github.com/superfly/litefs/pull/236
• Require explicit Consul key by @benbjohnson in https://github.com/superfly/litefs/pull/237
• Commit WAL on Handle Close by @benbjohnson in https://github.com/superfly/litefs/pull/238
• Move mount directory to FUSE config by @benbjohnson in https://github.com/superfly/litefs/pull/239
• Move data-dir to data section by @benbjohnson in https://github.com/superfly/litefs/pull/240
• Consolidate consul & static lease configs by @benbjohnson in https://github.com/superfly/litefs/pull/241
• Fail unless lease type is valid by @dangra in https://github.com/superfly/litefs/pull/242
• Add ref_name to Docker builds by @benbjohnson in https://github.com/superfly/litefs/pull/243
• Remove static.primary config field by @benbjohnson in https://github.com/superfly/litefs/pull/244
• Strict config type checking by @benbjohnson in https://github.com/superfly/litefs/pull/245
• Minor updates to litefs.yml reference by @benbjohnson in https://github.com/superfly/litefs/pull/246
• Refactor config comments by @benbjohnson in https://github.com/superfly/litefs/pull/247
• Add test for rollback on database creation by @benbjohnson in https://github.com/superfly/litefs/pull/248

New Contributors

• @ryanrussell made their first contribution in https://github.com/superfly/litefs/pull/111
• @dangra made their first contribution in https://github.com/superfly/litefs/pull/125
• @Juneezee made their first contribution in https://github.com/superfly/litefs/pull/147

Full Changelog: https://github.com/superfly/litefs/compare/v0.2.0...v0.3.0

What's Changed

• Fix WriteSnapshotTo() lock in WAL mode by @benbjohnson in https://github.com/superfly/litefs/pull/207
• Add 'query' command to litefs-bench by @benbjohnson in https://github.com/superfly/litefs/pull/208
• Add latency metrics by @benbjohnson in https://github.com/superfly/litefs/pull/209
• Add skip-sync config flag by @benbjohnson in https://github.com/superfly/litefs/pull/210
• Acquire shared CKPT & RECOVER lock during snapshot by @benbjohnson in https://github.com/superfly/litefs/pull/211
• Add 'import' command by @benbjohnson in https://github.com/superfly/litefs/pull/212
• Disable fail-fast on CI by @benbjohnson in https://github.com/superfly/litefs/pull/214
• Remove journal on import by @benbjohnson in https://github.com/superfly/litefs/pull/213
• Make FUSE layer thinner by @benbjohnson in https://github.com/superfly/litefs/pull/215
• Fix journal checksum validation by @benbjohnson in https://github.com/superfly/litefs/pull/216

Full Changelog: https://github.com/superfly/litefs/compare/v0.3.0-beta6...v0.3.0-beta7