2
2
mirror of https://github.com/octoleo/restic.git synced 2024-12-26 20:30:19 +00:00
restic/internal/repository
Michael Eischer 666a0b0bdb repository: streamPack: replace streaming with chunked download
Due to the interface of streamPack, we cannot guarantee that operations
progress fast enough that the underlying connections remains open. This
introduces partial failures which massively complicate the error
handling.

Switch to a simpler approach that retrieves the pack in chunks of 32MB.
If a blob is larger than this limit, then it is downloaded separately.

To avoid multiple copies in memory, an auxiliary interface
`discardReader` is introduced that allows directly accessing the
downloaded byte slices, while still supporting the streaming used by the
`check` command.
2024-04-22 21:21:23 +02:00
..
testdata internal/repository: Fix LoadBlob + fuzz test 2022-06-06 17:02:28 +02:00
doc.go gofmt all files 2022-08-19 19:12:26 +02:00
fuzz_test.go repository: make repo.Options configurable for test repos 2024-02-03 18:22:47 +01:00
key.go repository: fix test setup race conditions 2024-03-28 23:17:02 +01:00
lock_test.go repository: unify repository initialization in tests 2024-03-28 23:17:02 +01:00
lock.go repository: parallelize lock tests 2024-03-28 23:17:02 +01:00
packer_manager_test.go repository: store oversized blobs in separate pack files 2023-10-17 22:52:16 +02:00
packer_manager.go Fix typos 2023-12-06 13:11:55 +01:00
packer_uploader.go repository: Rework blob saving to use an async pack uploader 2022-07-02 22:42:34 +02:00
repack_test.go rename --no-verify-pack to --no-extra-verify 2024-02-04 17:01:05 +01:00
repack.go repository: Add blob loading fallback to LoadBlobsFromPack 2024-04-21 21:35:55 +02:00
repair_pack_test.go rename --no-verify-pack to --no-extra-verify 2024-02-04 17:01:05 +01:00
repair_pack.go Fix linter errors (except for tests) 2024-02-10 22:58:10 +01:00
repository_internal_test.go repository: Add blob loading fallback to LoadBlobsFromPack 2024-04-21 21:35:55 +02:00
repository_test.go repository: unify repository initialization in tests 2024-03-28 23:17:02 +01:00
repository.go repository: streamPack: replace streaming with chunked download 2024-04-22 21:21:23 +02:00
testing.go repository: fix test setup race conditions 2024-03-28 23:17:02 +01:00