Commit Graph

497 Commits

Author SHA1 Message Date
Takeshi Nakatani
6b6567ec9b Merge pull request #134 from andrewgaul/mpu-v2
Include Content-Type in complete MPU V2 signature
2015-03-01 22:50:54 +09:00
Takeshi Nakatani
c8c71650eb Merge pull request #131 from kahing/test-ls
Test ls
2015-03-01 22:47:55 +09:00
Andrew Gaul
a07e804f57 Include Content-Type in complete MPU V2 signature
Previously this failed with SignatureDoesNotMatch since the headers
included it but the signature did not.  Fixes #125.
2015-02-28 18:03:21 -08:00
Andrew Gaul
e9656810e3 Correct V4 signature for initiate multipart upload
Query parameters need a trailing = for V4 signatures.  Send correct
content-sha256 although Amazon does not seem to enforce this for
zero-length bodies.  Finally remove a stale comment.  Fixes #133.
2015-02-28 17:50:06 -08:00
Ka-Hing Cheung
4ee32d7559 test ls after creating files and dirs 2015-02-27 10:55:25 -08:00
Takeshi Nakatani
53083202ba Merge pull request #132 from andrewgaul/s3proxy-integration-test
Use S3Proxy to run integration tests
2015-02-27 00:17:46 +09:00
Takeshi Nakatani
574a48f81f Merge pull request #130 from kahing/refactor-integration-test
refactor integration tests create/cleanup file
2015-02-27 00:06:23 +09:00
Takeshi Nakatani
1b1cf2d4bd Merge pull request #124 from timuralp/bug/fix_fallback_v2
Fallback to v2 signatures correctly.
2015-02-27 00:02:12 +09:00
Andrew Gaul
e811ae1104 Use s3proxy to run integration tests
References #129.
2015-02-24 12:08:22 -08:00
Ka-Hing Cheung
d65bf4128d refactor integration tests create/cleanup file 2015-02-23 12:08:14 -08:00
Timur Alperovich
be5735edb8 Fallback to v2 signatures correctly.
Missing parameter to SetSignatureV4() call in the fallback code path
results in not actually falling back.
2015-02-16 17:35:09 -08:00
Takeshi Nakatani
5bf2b46fa3 Merge pull request #119 from s3fs-fuse/issue#107
Added new mp_umask option about issue#107, pr#110
2015-02-08 02:19:54 +09:00
Takeshi Nakatani
cf2b0cca22 Added new mp_umask option about issue#107, pr#110 2015-02-07 17:16:45 +00:00
Takeshi Nakatani
4ae5043534 Merge pull request #116 from s3fs-fuse/dev_sv4
Supported signature version 4
2015-02-03 01:43:48 +09:00
Takeshi Nakatani
1424f87754 Supported signature version 4 for GnuTLS/NSS and automatically set endpoint/sigv2 2015-02-02 16:36:08 +00:00
Takeshi Nakatani
4f953f9bd7 Clean codes for signature v4 and added new sigv2 option 2015-01-28 17:13:11 +00:00
Takeshi Nakatani
0d2f3e2dc4 Fixed bugs, segfault and signature error at listing. 2015-01-24 16:36:30 +00:00
Takeshi Nakatani
bb1f1d3faa Merged manually from caxapniy/s3fs-fuse/tree/1.77v4merge for signature v4 - #102 2015-01-20 16:31:36 +00:00
Takeshi Nakatani
98daf16681 Merge pull request #104 from kahing/rename_before_close
fix rename before close
2015-01-14 00:40:41 +09:00
Takeshi Nakatani
939ba2b4b3 Merge pull request #101 from adobos/directory_empty_optimization
Optimized function "bool directory_empty()"
2015-01-14 00:21:47 +09:00
Takeshi Nakatani
d0b82428d5 Merge pull request #100 from adobos/dns_ssl_switch_bugfix
CURL handles not properly initialized to use DNS or SSL session caching.
2015-01-14 00:11:46 +09:00
Takeshi Nakatani
902911765e Merge pull request #93 from andrewgaul/unit-test
Add simple unit tests for trim functions
2015-01-14 00:07:01 +09:00
Ka-Hing Cheung
03d84a07d1 fix rename before close
nautilus does this when you drag and drop to overwrite a file:

1) create .goutputstream-XXXXXX to write to
2) fsync the fd for .goutputstream-XXXXXX
3) rename .goutputstream-XXXXXX to target file
4) close the fd for .goutputstream-XXXXXX

previously, doing this on s3fs would result in an empty target file
because after the rename, s3fs would not flush the content of
.goutputstream-XXXXXX to target file.

this change moves the FdEntity from the old path to the new path
whenever rename happens. On flush s3fs would now flush the correct
content to the rename target.
2015-01-12 15:05:54 -08:00
Takeshi Nakatani
1f686d93ff Merge pull request #103 from s3fs-fuse/issue#87
Remove prefix option in s3fs man page - issue#87
2015-01-06 23:49:11 +09:00
Takeshi Nakatani
d95b9ef1ac Remove prefix option in s3fs man page - issue#87 2015-01-06 14:43:19 +00:00
Andrej Dobos
045f1e7906 CURL handles were not properly initialized to use DNS caching, or SSL session caching. 2014-12-23 22:31:54 -08:00
Andrej Dobos
69ef7fbefb Optimized function directory_empty: check for at most one entry when evaluating whether a directory is empty or not (as opposed to doing full directory listing) 2014-12-23 22:29:13 -08:00
Andrew Gaul
a56b8db410 Add simple unit tests for trim functions
Subsequent commits will use this infrastructure.  Also reparent
prepare_url which relies on unrelated bucket, foreground2, and
pathrequeststyle symbols.
2014-12-06 18:07:14 -08:00
Takeshi Nakatani
082eb24c12 Merge pull request #83 from tmwong2003/develop
Changed option processing to use strtol() to get a umask
2014-11-16 23:49:24 +09:00
Theodore Wong
f04b659f5e Changed option processing to use strtol() to get a umask
get_mode()/s3fs_strtoofft() does not handle octal umask values, which
results in unexpected behavior when trying to set a world-readable umask
value.
2014-11-12 23:29:41 +00:00
Takeshi Nakatani
eedc621637 Merge pull request #79 from buptUnixGuys/master
Update curl.cpp
2014-11-09 00:05:04 +09:00
bupt_tengteng
b31ec5c4af Update curl.cpp
The space causes signature mismatch when using "ahbe_conf" file to add additional headers.When s3 use the" x-amaz" header to calculates the signature, the format is as follow:
PUT

application/octet-stream
Wed, 05 Nov 2014 03:05:08 GMT
x-amz-acl:private
x-amz-meta-gid:0
x-amz-meta-mode:33188
x-amz-meta-mtime:1415156708
x-amz-meta-uid:0
There is no space after colon.
2014-11-05 11:28:33 +08:00
Takeshi Nakatani
651e8c3158 Merge pull request #64 from andrewgaul/failed-read-eio
Return EIO on failed read
2014-11-03 01:03:32 +09:00
Takeshi Nakatani
77d4d066b5 Merge pull request #74 from vincentbernat/fix/url-may-omit-scheme
url: handle scheme omission
2014-10-26 16:18:03 +09:00
Takeshi Nakatani
1e97e99aa0 Merge pull request #73 from vincentbernat/fix/git-ignore
Small gitignore fixes
2014-10-26 16:12:44 +09:00
Vincent Bernat
7212072ff0 url: handle scheme omission
When the scheme is omitted in URL overriding (for example `example.com`
instead of `https://example.com`), s3fs is modifying the URL by
inserting `s3.` in the middle of the name  (`examples3..com`).

This can be a bit difficult to troubleshoot and curl seems to handle
schema-less requests just fine. So, just handle this case correctly.
2014-10-23 10:25:17 +02:00
Vincent Bernat
8bcab645e1 gitignore: add test-driver and compile
Those are generated by latest versions of autotools.
2014-10-23 10:02:59 +02:00
Vincent Bernat
9013917d58 gitignore: use absolute path
The current content of `.gitignore` is using relative paths. For
example, `test/config.log` would be ignored while it doesn't seem to be
the intent. Use absolute paths. They are still relative to the root of
the repository.
2014-10-23 10:01:08 +02:00
Takeshi Nakatani
1eddf92c35 Merge pull request #72 from s3fs-fuse/issue#68
Fixed #68(FreeBSD issue)
2014-10-22 23:30:32 +09:00
Takeshi Nakatani
28d82c9ccd Fixed #68(FreeBSD issue) 2014-10-22 14:21:01 +00:00
Takeshi Nakatani
2f90a04513 Merge pull request #71 from s3fs-fuse/issue#68
Fixed for #68(FreeBSD issue)
2014-10-21 23:58:20 +09:00
Takeshi Nakatani
2724728476 Merge pull request #70 from s3fs-fuse/master
Fixed for #68(FreeBSD issue)
2014-10-21 23:56:41 +09:00
Takeshi Nakatani
ed8f424c1a Merge pull request #69 from andrewgaul/always-true
Address clang always true warnings
2014-10-21 23:53:30 +09:00
Andrew Gaul
50137fe026 Address clang always true warnings 2014-10-16 23:34:12 -07:00
Takeshi Nakatani
9237d07226 Merge pull request #63 from jollyroger/spelling
Fix spelling errors
2014-10-13 11:38:13 +09:00
Takeshi Nakatani
8c2be4aa85 Merge pull request #62 from jollyroger/fix-stray-chars
Remove stray chars from source files
2014-10-13 11:34:52 +09:00
Takeshi Nakatani
ccaed9a91c Merge pull request #60 from andrewgaul/check-bucket-disable-fail-on-error
Emit user-friendly log messages on failed CheckBucket requests
2014-10-13 11:33:17 +09:00
Andrew Gaul
a1ca8b7124 Return EIO on failed read
Previously S3fsMultiCurl::MultiRead did not report read errors since
it did not treat failed callback setup as a fatal operation error.
Failed callback setups usually result from exceeding the number of
allowed retries.  Previously cp did not report an error during a
network outage but now does:

$ cp ~/s3-path/s3-file .
cp: error reading ‘/home/gaul/s3-path/s3-file’: Input/output error
cp: failed to extend ‘./s3-file’: Input/output error
2014-10-03 21:30:11 -07:00
Andriy Senkovych
6633366218 Fix spelling errors 2014-10-01 13:42:39 +03:00
Andriy Senkovych
22ea65f02c Remove stray chars from source files 2014-10-01 13:20:29 +03:00