Commit Graph

842 Commits

Author SHA1 Message Date
Guy
6067af6ef1 Fix read concurrency to work in parallel count
When the prefetch size is limited to the multipart size, the entire parallel logic of the read flow does not have an opportunity to use parallel get.
This fix increases the read performance significantly over our own s3 on-premise solution.
2015-11-30 18:38:15 +02:00
Takeshi Nakatani
d7a4fc2927 Merge pull request #304 from ggtakec/master
Fixed a bug about mtime - #299
2015-11-30 01:53:13 +09:00
Takeshi Nakatani
7b62de80f6 Fixed a bug about mtime - #299 2015-11-29 15:53:53 +00:00
Takeshi Nakatani
8ffff5ba96 Merge remote-tracking branch 'upstream/macosx' 2015-11-29 15:47:47 +00:00
Takeshi Nakatani
e804441234 Added FAQ wiki page link in README.md 2015-11-26 21:31:03 +09:00
Takeshi Nakatani
9cc0fd2240 Merge pull request #302 from RobbKistler/syslog-level
Fix syslog level used by S3FS_PRN_EXIT()
2015-11-26 20:35:32 +09:00
Robb Kistler
fff2952d5f Fix syslog level used by S3FS_PRN_EXIT()
Without converting from s3fs log levels to syslog levels, the syslog
ends up being LOG_EMERG which can cause a broadcast message to all
users.
2015-11-25 13:53:08 -08:00
bazeli
b85bd53336 Update integration-test-main.sh
new test for mtime preservation copying file with `cp -p`
2015-11-24 17:29:54 +09:00
Takeshi Nakatani
e1de134d94 Merge branch 'master' into macosx 2015-11-08 06:06:05 +00:00
Takeshi Nakatani
5af6d4bd82 Merge pull request #295 from ggtakec/fixissue
File opened with O_TRUNC is not flushed - changed #291
2015-11-08 14:14:42 +09:00
Takeshi Nakatani
c673d9d935 File opened with O_TRUNC is not flushed - changed #291 2015-11-08 04:55:17 +00:00
Takeshi Nakatani
0fdda61fb5 Merge pull request #293 from SnakeHunt2012/master
Fix a small spelling issue.
2015-11-08 13:26:01 +09:00
Takeshi Nakatani
331b8456a0 Merge pull request #291 from RobbKistler/truncate
Issue #290: File opened with O_TRUNC is not flushed
2015-11-08 13:23:06 +09:00
Takeshi Nakatani
63b6f3635b Merge pull request #289 from RobbKistler/log-source-file
Print source file in log messages
2015-11-08 13:14:33 +09:00
SnakeHunt2012
c04bcce206 Fix a small spelling issue. 2015-11-06 16:49:37 +08:00
Robb Kistler
dd7d9268f2 Force flush in s3fs_open() if file is truncated. 2015-11-03 22:06:25 -08:00
Robb Kistler
a3ef5c820d Add file truncate test
This test creates a file with contents, truncates it to
zero and verifies that it is zero length.
2015-11-03 21:47:15 -08:00
Robb Kistler
e4da5c59b6 Print source file in log messages 2015-11-03 08:34:02 -08:00
Takeshi Nakatani
ad2a406205 Merge pull request #288 from ggtakec/master
Fixed a bug about head request(copy) for SSE - issue#286
2015-11-01 23:10:04 +09:00
Takeshi Nakatani
001206f7c1 Fixed a bug about head request(copy) for SSE - issue#286 2015-11-01 14:05:47 +00:00
Takeshi Nakatani
2ef7f497f6 Fixed a bug about head request(copy) for SSE - issue#286 2015-11-01 13:54:47 +00:00
Takeshi Nakatani
497b108109 Merge pull request #285 from andrewgaul/symlink-test
Add test for symlink
2015-11-01 18:46:06 +09:00
Andrew Gaul
86f95b05bf Add test for symlink 2015-10-24 14:20:26 -07:00
Takeshi Nakatani
70db77af38 Merge pull request #280 from ggtakec/master
Supported a object which is larger than free disk space
2015-10-21 00:53:07 +09:00
Takeshi Nakatani
8dd234dd8f Fixed bugs about cppcheck error 2015-10-20 15:47:07 +00:00
Takeshi Nakatani
83d46ef8c6 Fixed bugs about a object larger than free disk space 2015-10-20 15:19:04 +00:00
Takeshi Nakatani
1b323a6252 Changed debug option to dbglevel in test script. 2015-10-18 17:31:31 +00:00
Takeshi Nakatani
d102eb752d Supported a object which is larger than free disk space 2015-10-18 17:03:41 +00:00
Takeshi Nakatani
4252fab685 Merge pull request #248 from andrewgaul/travis-docker
Enable integration tests for Travis
2015-10-19 00:40:28 +09:00
Andrew Gaul
94e3dbb2dc Enable integration tests for Travis
http://blog.travis-ci.com/2015-10-14-opening-up-ubuntu-trusty-beta/
2015-10-14 15:57:15 -07:00
Takeshi Nakatani
8f115078cd Merge pull request #278 from ggtakec/master
Supported for SSE KMS(#270)
2015-10-07 00:01:38 +09:00
Takeshi Nakatani
f51ad1f33e Supported for SSE KMS 2015-10-06 14:46:14 +00:00
Takeshi Nakatani
e29069b8dc Merge pull request #275 from ggtakec/master
Changed and cleaned the logic for debug message.
2015-10-01 05:01:39 +09:00
Takeshi Nakatani
92e52dadd4 Changed and cleaned the logic for debug message. 2015-09-30 19:41:27 +00:00
Takeshi Nakatani
a4b00897c1 Merge pull request #274 from ggtakec/master
Modified man page for storage_class option(#271)
2015-09-28 22:52:59 +09:00
Takeshi Nakatani
f1b7f5ea95 Modified man page for storage_class option(#271) 2015-09-28 13:47:39 +00:00
Takeshi Nakatani
6a9082f126 Merge pull request #271 from andrewgaul/storage-class
Add support for standard_ia storage class
2015-09-28 22:18:32 +09:00
Takeshi Nakatani
48f0a6f811 Merge pull request #268 from RobbKistler/loopback
Use 127.0.0.1 not localhost in s3proxy wait loop
2015-09-28 22:12:29 +09:00
Takeshi Nakatani
1b39b2d450 Merge pull request #267 from nickstinger/master
Added the _netdev option to the fstab example.
2015-09-28 22:11:00 +09:00
Andrew Gaul
785ed642ba Add support for standard_ia storage class
This enables storage with lower at-rest prices, higher request prices,
and lower availability.  Also rework existing reduced redundancy
parsing into a more generic storage class.  More background on
standard_ia:

https://aws.amazon.com/blogs/aws/aws-storage-update-new-lower-cost-s3-storage-option-glacier-price-reduction/
2015-09-17 13:35:25 -07:00
Robb Kistler
3d5b8a7672 Use 127.0.0.1 not localhost in s3proxy wait loop
localhost doesn't always resolve to 127.0.0.1
2015-09-16 00:06:41 -07:00
Nick Stinger
0aef0cf765 Added the _netdev option to the fstab example.
Although the network device option (_netdev) may not work everywhere, the option likely does no harm on systems where it's not supported. By adding the option to the example, it will inform users of the necessity for post-network activation and how that might be accomplished.
2015-09-15 10:34:15 +09:00
Takeshi Nakatani
489f9edec7 Merge pull request #266 from RobbKistler/fix-integration-test
Cleanup from PR #265
2015-09-13 16:44:41 +09:00
Robb Kistler
718db57ade Code review changes
Missed some cleanup from the code review
2015-09-13 00:31:56 -07:00
Takeshi Nakatani
639dcf19b0 Merge pull request #265 from RobbKistler/fix-integration-test
Fix integration tests
2015-09-13 15:59:36 +09:00
Takeshi Nakatani
53bc960224 Merge pull request #263 from RobbKistler/aws
Allow integration testing against Amazon S3
2015-09-13 15:55:28 +09:00
Takeshi Nakatani
ead346c6d3 Merge pull request #261 from andrewgaul/help-timeouts
Correct help timeouts
2015-09-13 15:49:15 +09:00
Takeshi Nakatani
375059d9f8 Merge pull request #260 from andrewgaul/help-wrap
Wrap help text at 80 characters
2015-09-13 15:48:28 +09:00
Robb Kistler
6b21d9d424 Code review changes 2015-09-11 16:09:00 -07:00
Robb Kistler
dac9844765 Fix remove_nonempty_directory test bug
Wrap the attempt to rmdir in an if statement, otherwise the entire
test process exists (errexit is set). This test expects the rmdir
to fail.
2015-09-11 15:24:17 -07:00