Commit Graph

836 Commits

Author SHA1 Message Date
Takeshi Nakatani
8b457133da Merge pull request #341 from hryang/master
Fix the memory leak issue in fdcache.
2016-02-06 14:41:28 +09:00
Robb Kistler
7bfaa24d25 Integration test summary, continue on error
Details in README.md and s3fs-integration-test-common.sh

Factor out s3fs-fuse and s3proxy start/stop.  The plan is to make it easier to
add test suites besides small-integration-test.sh that can test with various
s3fs options.

Each test run starts in a uniquely named at the top of the bucket.  This allows
multiple runs against persistent storage without worrying about cleaning
up in error conditions that leave artifiacts behind.

Tests continues if a test case fails.

Results are summarized at the end of the test run

Environment variable to control debug level of s3fs-fuse

Environment variable to enable public bucket (makes it easier to poke
around with tools like curl)

Environment variable to start s3fs-fuse under valgrind

Environment variable that casues script sets up s3fs-fuse and then wait
indefinitely, making it easy to experiment manually with the mount
point.

Additional test case
2016-02-05 05:40:28 -08:00
Robb Kistler
4eff6b4dd1 Fix empty directory check against AWS S3
For ListBucketResult on an empty directory, AWS S3 and S3Proxy 1.4
differ.  AWS will match the directory name, S3Proxy does not.

Changing max-keys=1 to max-keys-2 works for both implementations.
append_objects_from_xml() will swallow the directory key.  The log
level of this message is changed from ERROR to DBG.

Fixes #345
2016-02-04 23:13:00 -08:00
haoran.yanghr
e3765ad497 Tune the code indent. 2016-01-28 11:16:06 +08:00
haoran.yanghr
dd9f3aed36 Fix the memory leak issue in fdcache. See issue #340 2016-01-28 11:11:53 +08:00
Takeshi Nakatani
ccfa13f295 Merge pull request #339 from ggtakec/master
Updated README.md for fstab example.
2016-01-24 14:38:48 +09:00
Takeshi Nakatani
540c04e6cc Updated README.md for fstab example. 2016-01-24 05:34:28 +00:00
Takeshi Nakatani
4b40727644 Merge pull request #338 from ggtakec/master
Fixed a bug about IAMCRED type could not be retried.
2016-01-24 14:10:39 +09:00
Takeshi Nakatani
83937700dd Fixed a bug about IAMCRED type could not be retried. 2016-01-24 05:01:50 +00:00
Takeshi Nakatani
2c156ceea2 Merge pull request #336 from Jirapong/master
update REAME.md for fstab
2016-01-22 00:10:02 +09:00
Jirapong Nanta
0615338592 update about netfs on boot 2016-01-19 12:06:10 +07:00
Jirapong Nanta
b847872622 update README.md for fstab 2016-01-19 11:22:55 +07:00
Takeshi Nakatani
e932583309 Merge pull request #334 from andrewgaul/bucket-host
Bucket host should include port and not path
2016-01-17 14:46:40 +09:00
Takeshi Nakatani
7410b7525f Merge pull request #329 from andrewgaul/v4-signature-get
Correct multiple issues with GET and v4 signing
2016-01-17 14:46:19 +09:00
Andrew Gaul
88a4f04217 Bucket host should include port and not path
This resolves issues when using v4 signing with path-style requests.
2016-01-16 15:58:54 -08:00
Andrew Gaul
ff607e1a2d Correct multiple issues with ListBucketRequest
* provide correct path
* sign query string
* URL encode query string
2016-01-16 10:17:20 -08:00
Takeshi Nakatani
4bfbfa3621 Merge pull request #331 from andrewgaul/clang
Address various clang warnings
2016-01-16 16:14:50 +09:00
Takeshi Nakatani
43b91d3235 Merge pull request #330 from andrewgaul/pass-by-reference
Pass by const reference where possible
2016-01-16 16:14:31 +09:00
Takeshi Nakatani
9fa205f1c3 Merge pull request #328 from andrewgaul/v4-signature-path-request-style
Fix v4 signature with use_path_request_style
2016-01-16 16:14:00 +09:00
Andrew Gaul
e003732f18 Address various clang warnings
Found with:

-Wc++11-extensions
-Wc++11-extra-semi
-Wmissing-variable-declarations
-Wundef
2016-01-11 00:52:24 -08:00
Andrew Gaul
b946b59522 Pass by const reference where possible 2016-01-10 16:58:24 -08:00
Andrew Gaul
ea6b287d1a Fix v4 signature with use_path_request_style
Previously s3fs omitted the bucket name when using path request style
causing SignatureDoesNotMatch with v4 signatures.
2016-01-10 13:41:56 -08:00
Takeshi Nakatani
a6455ef1bc Merge pull request #323 from andrewgaul/readme
Add goofys to references
2016-01-10 04:26:52 +09:00
Andrew Gaul
8e5e44bfce Add goofys to references 2016-01-07 16:14:11 -08:00
Takeshi Nakatani
ea151a70c4 Merge pull request #321 from mcellis33/320
320: delete stat cache entry in s3fs_fsync so st_size is refreshed
2015-12-20 15:05:28 +09:00
Takeshi Nakatani
1e1f2a66de Merge pull request #319 from RobbKistler/clean-exit
Clean up mount point on errors in s3fs_init()
2015-12-20 15:04:54 +09:00
Mark Ellis
163daa5de1 320: delete stat cache entry in s3fs_fsync so st_size is refreshed 2015-12-18 15:39:25 -08:00
Robb Kistler
b581290c30 Cleanly exit fuse loop on error in s3fs_init
This allows FUSE to clean the mount point up, preventing
"Transport endpoint not connected" errors on subsequent
access to the mount.
2015-12-15 15:25:56 -08:00
Robb Kistler
1927ccfe0a Don't loop on fusermount if mountpoint is gone 2015-12-15 15:07:00 -08:00
Takeshi Nakatani
8162d4925d Merge pull request #313 from mcellis33/gitignore
fix gitignore
2015-12-08 00:04:52 +09:00
Takeshi Nakatani
2b3ece467b Merge pull request #311 from RobbKistler/dbg-message
Change error log to debug log in s3fs_read()
2015-12-08 00:03:48 +09:00
Mark Ellis
c2f9b38a95 fix gitignore 2015-12-04 15:21:32 -08:00
Robb Kistler
8e688816d4 Change error log to debug log in s3fs_read() 2015-12-03 21:25:27 -08:00
Takeshi Nakatani
8dbd5a3f65 Merge pull request #310 from ggtakec/master
Update integration-test-main.sh as additional change for #300
2015-12-03 22:49:55 +09:00
Takeshi Nakatani
4bd5ffb0fa Update integration-test-main.sh as additional change for #300 2015-12-03 13:44:43 +00:00
Takeshi Nakatani
7b2e963636 Merge pull request #300 from bazeli/patch-1
Update integration-test-main.sh
(but it does not work now, I will fix it as soon as possible.)
2015-12-03 22:36:45 +09:00
Takeshi Nakatani
87d04acb2f Merge pull request #309 from ggtakec/master
Check pthread prtability in configure as additional change for #307
2015-12-03 16:58:23 +09:00
Takeshi Nakatani
759b44135a Check pthread prtability in configure as additional change for #307 2015-12-03 07:47:17 +00:00
Takeshi Nakatani
8b53e0d931 Merge pull request #307 from rockuw/master
Fix pthread portability problem
2015-12-03 16:35:30 +09:00
Takeshi Nakatani
7db23f9d03 Merge pull request #308 from ggtakec/master
Changed ensure free disk space as additional change for #306
2015-12-03 14:49:40 +09:00
Tianlong Wu
3e655bad3b PTHREAD_MUTEX_RECURSIVE_NP is a enum not macro 2015-12-03 13:44:11 +08:00
Takeshi Nakatani
5e97cb0f48 Changed ensure free disk space as additional change for #306 2015-12-03 05:40:26 +00:00
Takeshi Nakatani
ef90e0deed Merge pull request #306 from guymguym/patch-1
Fix read concurrency to work in parallel count
2015-12-03 14:26:40 +09:00
Tianlong Wu
f44b61c403 Fix pthread portability problem 2015-12-03 10:44:38 +08:00
Guy
6067af6ef1 Fix read concurrency to work in parallel count
When the prefetch size is limited to the multipart size, the entire parallel logic of the read flow does not have an opportunity to use parallel get.
This fix increases the read performance significantly over our own s3 on-premise solution.
2015-11-30 18:38:15 +02:00
Takeshi Nakatani
d7a4fc2927 Merge pull request #304 from ggtakec/master
Fixed a bug about mtime - #299
2015-11-30 01:53:13 +09:00
Takeshi Nakatani
7b62de80f6 Fixed a bug about mtime - #299 2015-11-29 15:53:53 +00:00
Takeshi Nakatani
8ffff5ba96 Merge remote-tracking branch 'upstream/macosx' 2015-11-29 15:47:47 +00:00
Takeshi Nakatani
e804441234 Added FAQ wiki page link in README.md 2015-11-26 21:31:03 +09:00
Takeshi Nakatani
9cc0fd2240 Merge pull request #302 from RobbKistler/syslog-level
Fix syslog level used by S3FS_PRN_EXIT()
2015-11-26 20:35:32 +09:00