Alexander Neumann
b2307cafa2
Seed chunker with random per-repository polynomial
2015-04-06 00:22:19 +02:00
Alexander Neumann
1954680c9e
Go1.3: Fix range over channel
2015-03-28 15:52:15 +01:00
Alexander Neumann
223108c6ae
Remove unused vars and const
2015-03-28 15:28:08 +01:00
Alexander Neumann
f157f775da
Add checks for Server.Load(), use Blob for load
2015-03-28 15:07:08 +01:00
Alexander Neumann
5e69788eac
Refactor backends
2015-03-28 14:36:50 +01:00
Alexander Neumann
662e07d17a
Refactor crypto layer, switch HMAC for Poyl1305-AES
...
HMAC-SHA256 calls SHA256() twice which is very expensive. Therefore,
this commit uses Poly1305-AES instead of HMAC-SHA256.
benchcmp:
benchmark old ns/op new ns/op delta
BenchmarkChunkEncrypt 261033772 195114818 -25.25%
BenchmarkChunkEncryptParallel 260973195 195787368 -24.98%
BenchmarkArchiveDirectory 1050500651 1002615884 -4.56%
BenchmarkPreload 23544286 24994508 +6.16%
BenchmarkLoadTree 350065 427665 +22.17%
BenchmarkEncryptWriter 87789753 31069126 -64.61%
BenchmarkEncrypt 88283197 38259043 -56.66%
BenchmarkDecryptReader 90478843 40714818 -55.00%
BenchmarkEncryptDecryptReader 179917626 81231730 -54.85%
BenchmarkDecrypt 87871591 37784207 -57.00%
BenchmarkSaveJSON 52481 56861 +8.35%
BenchmarkSaveFrom 75404085 51108596 -32.22%
BenchmarkLoadJSONID 90545437 82696805 -8.67%
benchmark old MB/s new MB/s speedup
BenchmarkChunkEncrypt 40.17 53.74 1.34x
BenchmarkChunkEncryptParallel 40.18 53.56 1.33x
BenchmarkEncryptWriter 95.55 270.00 2.83x
BenchmarkEncrypt 95.02 219.26 2.31x
BenchmarkDecryptReader 92.71 206.03 2.22x
BenchmarkEncryptDecryptReader 46.62 103.27 2.22x
BenchmarkDecrypt 95.46 222.01 2.33x
BenchmarkSaveFrom 55.62 82.07 1.48x
benchmark old allocs new allocs delta
BenchmarkChunkEncrypt 112 110 -1.79%
BenchmarkChunkEncryptParallel 103 100 -2.91%
BenchmarkArchiveDirectory 383704 392083 +2.18%
BenchmarkPreload 21765 21874 +0.50%
BenchmarkLoadTree 341 436 +27.86%
BenchmarkEncryptWriter 20 17 -15.00%
BenchmarkEncrypt 14 13 -7.14%
BenchmarkDecryptReader 18 15 -16.67%
BenchmarkEncryptDecryptReader 46 39 -15.22%
BenchmarkDecrypt 16 12 -25.00%
BenchmarkSaveJSON 81 86 +6.17%
BenchmarkSaveFrom 117 121 +3.42%
BenchmarkLoadJSONID 80525 80264 -0.32%
benchmark old bytes new bytes delta
BenchmarkChunkEncrypt 118956 64697 -45.61%
BenchmarkChunkEncryptParallel 118972 64681 -45.63%
BenchmarkArchiveDirectory 160236600 177498232 +10.77%
BenchmarkPreload 2772488 3302992 +19.13%
BenchmarkLoadTree 49102 46484 -5.33%
BenchmarkEncryptWriter 28927 8388146 +28897.64%
BenchmarkEncrypt 2473 1950 -21.15%
BenchmarkDecryptReader 527827 2774 -99.47%
BenchmarkEncryptDecryptReader 4100875 1528036 -62.74%
BenchmarkDecrypt 2509 2154 -14.15%
BenchmarkSaveJSON 4971 5892 +18.53%
BenchmarkSaveFrom 40117 31742 -20.88%
BenchmarkLoadJSONID 9444217 9442106 -0.02%
This closes #102 .
2015-03-14 20:00:41 +01:00
Alexander Neumann
f69a39cff5
Add ID to repository
...
This allows identifying a repository regardless if it's accessed over
SFTP or locally. Introduced for having a per-repository cache.
2015-03-14 12:06:27 +01:00
Alexander Neumann
c056382c9c
Remove zlib compression
2015-03-02 10:02:55 +01:00
Alexander Neumann
b4cb75693e
Do not close file if it could not be opened
2015-02-22 00:21:56 +01:00
Alexander Neumann
a59b0ec1f6
Add progress report for loading blobs
2015-02-21 15:32:48 +01:00
Alexander Neumann
2f3aa344af
Make decryptReader fulfill flate.Reader
...
benchmark old ns/op new ns/op delta
BenchmarkLoadJSONID 50232171 48596972 -3.26%
benchmark old allocs new allocs delta
BenchmarkLoadJSONID 43643 42884 -1.74%
benchmark old bytes new bytes delta
BenchmarkLoadJSONID 5773048 3785517 -34.43%
2015-02-18 23:30:59 +01:00
Alexander Neumann
a0fea201d9
Reenable Preloading
2015-02-18 23:10:59 +01:00
Alexander Neumann
f214dce87c
Add tests for Archiver.Preload() and a few more
2015-02-18 22:48:59 +01:00
Alexander Neumann
d3fe4a7f6d
Close Reader after read
2015-02-17 23:37:45 +01:00
Alexander Neumann
b6f25aa690
Remove Each(), add basic stats
2015-02-17 23:11:56 +01:00
Alexander Neumann
5a16a66973
Add 'plaintext' parameter to key.Decrypt()
...
% benchcmp /tmp/{before,after}
benchmark old ns/op new ns/op delta
BenchmarkChunkEncrypt 261144414 260252046 -0.34%
BenchmarkChunkEncryptParallel 261201438 261267029 +0.03%
BenchmarkArchiveDirectory 0.00 0.00 +0.00%
BenchmarkEncryptWriter 88297245 87526529 -0.87%
BenchmarkEncrypt 87406446 87917897 +0.59%
BenchmarkDecryptReader 89948630 90042541 +0.10%
BenchmarkEncryptDecryptReader 178374144 179477306 +0.62%
BenchmarkDecrypt 88289705 87937073 -0.40%
BenchmarkSaveJSON 213917 213571 -0.16%
BenchmarkSaveFrom 74881361 75111148 +0.31%
benchmark old MB/s new MB/s speedup
BenchmarkChunkEncrypt 40.15 40.29 1.00x
BenchmarkChunkEncryptParallel 40.14 40.13 1.00x
BenchmarkEncryptWriter 95.00 95.84 1.01x
BenchmarkEncrypt 95.97 95.41 0.99x
BenchmarkDecryptReader 93.26 93.16 1.00x
BenchmarkEncryptDecryptReader 47.03 46.74 0.99x
BenchmarkDecrypt 95.01 95.39 1.00x
BenchmarkSaveFrom 56.01 55.84 1.00x
benchmark old allocs new allocs delta
BenchmarkChunkEncrypt 113 112 -0.88%
BenchmarkChunkEncryptParallel 104 103 -0.96%
BenchmarkArchiveDirectory 0 0 +0.00%
BenchmarkEncryptWriter 20 20 +0.00%
BenchmarkEncrypt 14 14 +0.00%
BenchmarkDecryptReader 18 18 +0.00%
BenchmarkEncryptDecryptReader 40 45 +12.50%
BenchmarkDecrypt 17 16 -5.88%
BenchmarkSaveJSON 125 125 +0.00%
BenchmarkSaveFrom 116 119 +2.59%
benchmark old bytes new bytes delta
BenchmarkChunkEncrypt 8515750 118956 -98.60%
BenchmarkChunkEncryptParallel 8515766 118972 -98.60%
BenchmarkArchiveDirectory 0 0 +0.00%
BenchmarkEncryptWriter 28927 28927 +0.00%
BenchmarkEncrypt 422313 2473 -99.41%
BenchmarkDecryptReader 527827 527827 +0.00%
BenchmarkEncryptDecryptReader 4100824 4100870 +0.00%
BenchmarkDecrypt 8391127 2509 -99.97%
BenchmarkSaveJSON 9208 9208 +0.00%
BenchmarkSaveFrom 39694 40541 +2.13%
2015-02-17 21:10:26 +01:00
Alexander Neumann
a5e13f1280
Switch SaveFrom() to Reader/Writer
...
benchcmp:
benchmark old ns/op new ns/op delta
BenchmarkSaveFrom 76159512 74795081 -1.79%
benchmark old MB/s new MB/s speedup
BenchmarkSaveFrom 55.07 56.08 1.02x
benchmark old allocs new allocs delta
BenchmarkSaveFrom 97 117 +20.62%
benchmark old bytes new bytes delta
BenchmarkSaveFrom 433826 40117 -90.75%
benchmark old ns/op new ns/op delta
BenchmarkArchiveDirectory-4 29539886128 29262480891 -0.94%
benchmark old allocs new allocs delta
BenchmarkArchiveDirectory-4 540048 709662 +31.41%
benchmark old bytes new bytes delta
BenchmarkArchiveDirectory-4 404573416 443098816 +9.52%
2015-02-16 22:42:11 +01:00
Alexander Neumann
731e81ef06
Re-use zlib writers to reduce memory usage
...
benchcmp:
benchmark old ns/op new ns/op delta
BenchmarkArchiveDirectory-4 29624960475 29511001504 -0.38%
BenchmarkSaveJSON-4 379833 225609 -40.60%
benchmark old allocs new allocs delta
BenchmarkArchiveDirectory-4 546736 540642 -1.11%
BenchmarkSaveJSON-4 150 126 -16.00%
benchmark old bytes new bytes delta
BenchmarkArchiveDirectory-4 1372476952 438519336 -68.05%
BenchmarkSaveJSON-4 1462773 9087 -99.38%
2015-02-16 22:35:26 +01:00
Alexander Neumann
b762a342d3
SaveJSON: use streams
2015-02-16 00:24:58 +01:00
Alexander Neumann
68911ef11d
server: use streams for LoadJSON*()
2015-02-15 23:49:06 +01:00
Alexander Neumann
72c951a6ec
Simply backend interface
...
Rename CreateBlob() method to Create(), remove old Create* methods
2015-02-15 17:26:20 +01:00
Alexander Neumann
35636a9d92
Introduce CreateBlob() method for backend
2015-02-15 17:09:49 +01:00
Alexander Neumann
0f36b19a4c
Update Server to match new Backend interface
2015-02-11 22:46:40 +01:00
Alexander Neumann
bda33e612c
Implement streaming chunker using io.Reader
2015-02-09 00:28:54 +01:00
Alexander Neumann
e2a407babb
Create large buffer when encrypting a large tree
...
This fixes #80
2015-01-31 21:18:51 +01:00
Alexander Neumann
203a911de9
Refactor repository structure
...
Merge Map data type into Tree.
2015-01-14 16:34:30 +01:00
Alexander Neumann
ef41a77aff
Remove explicit key handling
2014-12-21 18:10:19 +01:00
Alexander Neumann
cc147c002e
Introduce type Server
2014-12-21 17:37:29 +01:00
