2
2
mirror of https://github.com/octoleo/restic.git synced 2024-12-18 08:34:20 +00:00
restic/internal
Michael Eischer 666a0b0bdb repository: streamPack: replace streaming with chunked download
Due to the interface of streamPack, we cannot guarantee that operations
progress fast enough that the underlying connections remains open. This
introduces partial failures which massively complicate the error
handling.

Switch to a simpler approach that retrieves the pack in chunks of 32MB.
If a blob is larger than this limit, then it is downloaded separately.

To avoid multiple copies in memory, an auxiliary interface
`discardReader` is introduced that allows directly accessing the
downloaded byte slices, while still supporting the streaming used by the
`check` command.
2024-04-22 21:21:23 +02:00
..
archiver backup: Ignore xattr.list permission error for parent directories 2024-04-10 20:46:15 +02:00
backend Merge pull request #4743 from MichaelEischer/deprecate-s3legacy-layout 2024-04-11 22:09:34 +02:00
bloblru bloblru: Upgrade to hashicorp/golang-lru/v2 2022-11-27 17:18:13 +01:00
cache move Backend interface to backend package 2023-10-25 23:00:18 +02:00
checker repository: streamPack: replace streaming with chunked download 2024-04-22 21:21:23 +02:00
crypto Remove redundant poly1305 key masking 2024-01-20 12:36:59 +01:00
debug Rename unused testing parameter to _ 2023-05-18 21:17:53 +02:00
dump archiver: refactor summary collection from ui into the archiver 2024-02-23 20:27:13 +01:00
errors Add CombineErrors helper function 2024-02-22 16:57:00 -07:00
feature Deprecate s3legacy layout 2024-04-10 21:27:56 +02:00
filter remove no longer necessary conditional compiles 2022-11-27 13:18:44 +01:00
fs Fix struct names 2024-04-18 10:02:09 +08:00
fuse Fix linter errors (except for tests) 2024-02-10 22:58:10 +01:00
hashing Replace most usages of ioutil with the underlying function 2022-12-02 19:36:43 +01:00
index repository: unify repository initialization in tests 2024-03-28 23:17:02 +01:00
migrations repository: make repo.Options configurable for test repos 2024-02-03 18:22:47 +01:00
options backend, options: Prefer strings.Cut to SplitN 2022-12-02 19:19:14 +01:00
pack Apply changelog entry / documentation improvements from review 2024-02-04 18:55:41 +01:00
repository repository: streamPack: replace streaming with chunked download 2024-04-22 21:21:23 +02:00
restic backup: Ignore xattr.list permission error for parent directories 2024-04-10 20:46:15 +02:00
restorer Merge pull request #4705 from MichaelEischer/snapshot-statistics 2024-03-28 22:41:45 +01:00
selfupdate Replace lots of unused parameters with _ 2023-05-18 21:17:53 +02:00
test use consistent alias for interal/test package 2024-03-29 00:24:03 +01:00
textfile Replace most usages of ioutil with the underlying function 2022-12-02 19:36:43 +01:00
ui backup: rename data_added_in_repo statistic to data_added_packed 2024-02-25 20:40:52 +01:00
walker Fix struct names 2024-04-18 10:02:09 +08:00