2
2
mirror of https://github.com/octoleo/restic.git synced 2024-12-25 12:09:59 +00:00
restic/internal/checker
Michael Eischer 666a0b0bdb repository: streamPack: replace streaming with chunked download
Due to the interface of streamPack, we cannot guarantee that operations
progress fast enough that the underlying connections remains open. This
introduces partial failures which massively complicate the error
handling.

Switch to a simpler approach that retrieves the pack in chunks of 32MB.
If a blob is larger than this limit, then it is downloaded separately.

To avoid multiple copies in memory, an auxiliary interface
`discardReader` is introduced that allows directly accessing the
downloaded byte slices, while still supporting the streaming used by the
`check` command.
2024-04-22 21:21:23 +02:00
..
testdata Moves files 2017-07-23 14:19:13 +02:00
checker_test.go repository: unify repository initialization in tests 2024-03-28 23:17:02 +01:00
checker.go repository: streamPack: replace streaming with chunked download 2024-04-22 21:21:23 +02:00
testing.go check: add index loading progress bar 2023-10-01 19:55:29 +02:00