Commit Graph

1725 Commits

Author SHA1 Message Date
Andrew Dunn
601482eff5 Added support for path API request style.
Rather than using virtual host style requests, path style requests can be used
instead.

i.e. rather than bucketname.s3.amazon.com/... the s3fs will be able to request
from s3.amazon.com/bucketname/...

This is useful for S3 compatible APIs which don't support the virtual host style
request.

It is enabled with the new option, `use_path_style_request`.

Example:

    /usr/bin/s3fs data ~/netcdf -o url="https://swift.rc.nectar.org.au:8888/" -o use_path_request_style -o allow_other -o uid=500 -o gid=500
2014-06-04 00:03:49 +10:00
Takeshi Nakatani
f141bbd4b4 Merge pull request #36 from s3fs-fuse/gc#417
Changed codes for CR code in passwd file(googlecode issue#417).
2014-06-03 01:16:03 +09:00
Takeshi Nakatani
61020370d5 Changed codes for CR code in passwd file(googlecode issue#417). 2014-06-02 16:12:55 +00:00
Takeshi Nakatani
f1f7e76be5 Merge pull request #35 from s3fs-fuse/cryptlibs
Supports more two SSL libraries for NSS and GnuTLS.
2014-06-01 23:15:59 +09:00
Takeshi Nakatani
160196798b Changed initializing logic for nss lib/openssl lib/s3fs own. 2014-06-01 03:54:02 +00:00
Takeshi Nakatani
edad91186f Changed configuration switch from 'enable' to 'with' for libs 2014-05-10 16:45:46 +00:00
Takeshi Nakatani
cd27f0aa54 Supported another crypt libraries as GnuTLS and NSS, and added configure options 2014-05-06 14:23:05 +00:00
Takeshi Nakatani
c7665f80ab Merge pull request #33 from s3fs-fuse/for_v1.77
changed for version v1.77 and fixed man page
2014-04-20 01:10:21 +09:00
Takeshi Nakatani
1a4065b0fb changed for version v1.77 and fixed man page 2014-04-19 16:08:10 +00:00
Takeshi Nakatani
a4465105f7 Merge pull request #32 from s3fs-fuse/sslproblem#23
Retry to send request at CURLE_SSL_CONNECT_ERROR
2014-04-20 00:53:09 +09:00
Takeshi Nakatani
8bba566774 Retry to send request at CURLE_SSL_CONNECT_ERROR 2014-04-04 16:23:56 +00:00
Takeshi Nakatani
157612e7e7 Merge pull request #28 from andrewgaul/fdcache-init-signedness-warning
Address signedness warning in FdCache::Init
2014-04-05 01:02:13 +09:00
Takeshi Nakatani
6148415b4b Merge pull request #31 from s3fs-fuse/upperlimit#16
Added multipart_size option for #16
2014-04-05 00:53:04 +09:00
Andrew Gaul
d475e22774 Address signedness warning in FdCache::Init
This commit allows GCC 4.8 to compile s3fs withing warnings.
2014-04-01 23:50:08 -07:00
Takeshi Nakatani
4762e53b5d Added multipart_size option for #16 2014-03-30 07:53:41 +00:00
Takeshi Nakatani
e23ea87953 Merge pull request #26 from s3fs-fuse/bugfix#18
Fixed a bug #18(losing check retry error)
2014-03-30 15:44:59 +09:00
Takeshi Nakatani
d7563309a2 Fixed a bug #18(losing check retry error) 2014-03-30 06:40:49 +00:00
Takeshi Nakatani
c003076053 Merge pull request #22 from theasci/max_stat_cache_size_typo
Fix typos in docs for max_stat_cache_size (the default is actually 1000)
2014-03-16 13:48:21 +09:00
Mason Malone
74fb29d9fb Fix typos in docs for max_stat_cache_size (the default is actually 1000) 2014-03-06 12:44:10 -05:00
Takeshi Nakatani
b35f8ded46 Merge pull request #20 from s3fs-fuse/fix_bugs
Fixed a bug: issue #14, s3fs -u should return 0 if there are no lost multiparts
2014-03-04 02:02:59 +09:00
Takeshi Nakatani
16487c4e26 Fixed a bug: issue #14, s3fs -u should return 0 if there are no lost multiparts 2014-03-03 17:00:20 +00:00
Takeshi Nakatani
39402696ce Merge pull request #19 from s3fs-fuse/test_md5
Fixed a bug(googlecode issue 405), enable_content_md5 Input/output error
2014-03-04 01:24:23 +09:00
Takeshi Nakatani
52d56d15e4 Fixed a bug(googlecode issue 405), enable_content_md5 Input/output error 2014-03-03 16:19:08 +00:00
Takeshi Nakatani
36509351f0 Merge branch 'master' of https://github.com/s3fs-fuse/s3fs-fuse 2014-01-21 15:49:24 +00:00
Takeshi Nakatani
00792a6555 Update ChangeLog 2014-01-21 15:47:58 +00:00
Takeshi Nakatani
fdabb7cbbe Merge pull request #9 from s3fs-fuse/issue/#8
version number up to v1.76 for new.
2014-01-21 07:37:38 -08:00
Takeshi Nakatani
775d8758ef version number up to v1.76 for new. 2014-01-21 15:33:02 +00:00
Takeshi Nakatani
31c979b290 Merge pull request #7 from s3fs-fuse/issue#5
Fixed a bug - issue#5
2014-01-16 08:09:50 -08:00
Takeshi Nakatani
5fd33405af Fixed a bug - issue#5 2014-01-16 16:04:41 +00:00
Takeshi Nakatani
1d1e8f3e7d Update ChangeLog 2014-01-06 17:12:41 +00:00
rrizun
654c58c90a Merge pull request #4 from pdeschen/patch-1
Fix compilation error on MacOSX with missing const
2014-01-05 05:24:54 -08:00
Pascal Deschênes
db3bd7c366 Fix compilation error on MacOSX with missing const 2014-01-04 21:24:27 -05:00
rrizun
26187b954e Merge pull request #3 from worpet/master
Fixed local timezone was incorrectly being applied to IAM and Last-Modified dates.
2014-01-01 05:15:51 -08:00
worpet
33ec3739e2 Update s3fs_util.cpp
Fixed local time was incorrectly being applied to IAM and Last-Modified dates.
2013-12-30 09:35:39 -06:00
rrizun
d9f13dbdcb Merge pull request #1 from dejaeghd/master
Using %20 instead of the plus (+) sign for encoding spaces
2013-12-17 07:57:15 -08:00
root
d5626fe595 Changed url encoding of space character to use %20 instead of the plus (+) sign. 2013-12-17 15:12:03 +01:00
ggtakec@gmail.com
d121bab3e5 Summary of Changes(1.73 -> 1.74)
==========================
List of Changes
==========================
1) Fixed bugs - r478, r480, r481, r482, r483, r484, r486, r489,
                r491, r492, r493, r494, r495, r496, r497, r498
   - Fixed wrong printf format.
   - Fixed a bug at changing umask.
   - Fixed a bug at changing utimens.
   - When changing object size, could not update stat cache.
   - Fixed some memory leak.
   - Fixed a bug about ftruncate(Issue 371).
   - Fixed a bug about multipart post request(Issue 371).
   - Fixed a bug about multipart post/head retrying(Issue 389).
   - Fixed public_bucket option bug
   - Fixed file size over flow on 32bit OS

2) Changed codes - r479, r480, r482, r485, r488, r490, r493
   - Calling curl_global_init function once.
   - Adds dynamic lock callback for OpenSSL.
   - Checking strict for s3fs command parameters.
   - Caches SSL session.
   - Changes parallel count 500 to 20 for multipart head req.
   - Adds --enable-nss-init configure option.
   - Changes updating timing for object cache(Issue 368).
   - Changes level for some debugging codes.
   - Adds casting for curl_ott_t variables.
   - Adds IAM role option.
   - Adds function on utility mode for removing failed multipart req.



git-svn-id: http://s3fs.googlecode.com/svn/trunk@499 df820570-a93a-0410-bd06-b72b767a4274
2013-11-25 12:04:13 -05:00
rrizun
9011a0bb73 .gitignore 2013-11-22 15:28:55 -05:00
ggtakec@gmail.com
74db6748dd Changes codes
1) Changed condition for retrying multipart error
   Changes condition that 404 is not retrying, other case is retrying,
   when multipart request failed.

2) file type wrong
   fdcache.h file type is wrong, so that fixed it.



git-svn-id: http://s3fs.googlecode.com/svn/trunk@498 df820570-a93a-0410-bd06-b72b767a4274
2013-11-19 01:48:53 +00:00
ggtakec@gmail.com
8acbaf7199 Fixed a bug.
* Fixed a bug
  Fixes a bug that is dead loop when s3fs listed in a directory with
  directory objects which was not object(no information).
  This bug made by r493, and reported by issue 389.




git-svn-id: http://s3fs.googlecode.com/svn/trunk@497 df820570-a93a-0410-bd06-b72b767a4274
2013-11-18 02:29:41 +00:00
ggtakec@gmail.com
40b9f0a408 Changes codes
1) Changed buffer size for file size
   Changes a internal buffer size from size_t to offt_t.
   It is a bug for 32 bit OS enviroment.



git-svn-id: http://s3fs.googlecode.com/svn/trunk@496 df820570-a93a-0410-bd06-b72b767a4274
2013-11-17 08:50:41 +00:00
ggtakec@gmail.com
882f13020e Fixed bugs(overflow)
1) Overflow
   About over 4GB file, when st_size which is member stat structure,
   the value is overflow.
   Fixed this bug and fixed like this bug in all sources. 

2) Changed retrying request
   If s3fs gets 500 HTTP status for multipart request, s3fs retry
   to send same request.





git-svn-id: http://s3fs.googlecode.com/svn/trunk@495 df820570-a93a-0410-bd06-b72b767a4274
2013-11-13 16:26:50 +00:00
ggtakec@gmail.com
c785be917f Changed a code
* Cut a #ifdef
  Cuts a code for clearing r493.




git-svn-id: http://s3fs.googlecode.com/svn/trunk@494 df820570-a93a-0410-bd06-b72b767a4274
2013-11-11 15:03:04 +00:00
ggtakec@gmail.com
09fc2593e3 Fixed bugs and Changed utility mode
1) Fixed bugs
 * Rename objects
   Fixes s3fs specifies wrong part number of multipart rename.
   And s3fs adds x-amz-acl and x-amz-server-side-encryption
   header when rename objects.

2) Changed retry logic for multipart uploading(and renaming)
   Sometimes, s3fs gets 400 HTTP response for one of part from
   S3 when s3fs uploads a large object by multipart.
   New logic retries uploading failed part until "retries"
   option count.

3) Added action on utility mode.
   s3fs have had utility mode for displaying the result of REST
   listing multipart uploading.
   Changed this row result(xml) to list, after that, s3fs starts
   conversation for removing it.
   Then you can remove the object which is failed uploading by
   multipart, and do not need to pay for that ever.




git-svn-id: http://s3fs.googlecode.com/svn/trunk@493 df820570-a93a-0410-bd06-b72b767a4274
2013-11-11 13:45:35 +00:00
ggtakec@gmail.com
1bae39e21f Fixed a bug.
* Fixed a bug
   Fixes a bug that the retrying multipart post request is not 
   complete, then it is fixed.
   This is reported by Issue 371#32.



git-svn-id: http://s3fs.googlecode.com/svn/trunk@492 df820570-a93a-0410-bd06-b72b767a4274
2013-10-09 01:44:56 +00:00
ggtakec@gmail.com
33431dec46 Fixed a bug.
* Fixed a bug
   Fixes a bug that is mis-coding about retrying Multipart Post.
   This is reported by Issue 371#28.




git-svn-id: http://s3fs.googlecode.com/svn/trunk@491 df820570-a93a-0410-bd06-b72b767a4274
2013-10-08 08:19:10 +00:00
ggtakec@gmail.com
99db6d13af Changes codes
1) Supported IAM role
   Supports IAM role by option, that is instead of AccessKeyID/
   SecretAccessKey.
   Adds new option "iam_role" which is specified as IAM role
   name.(like s3fs-c)



git-svn-id: http://s3fs.googlecode.com/svn/trunk@490 df820570-a93a-0410-bd06-b72b767a4274
2013-10-06 13:45:32 +00:00
ggtakec@gmail.com
44468ba00f Fixed a bug(public_bucket)
1) Fixed a bug(about public_bucket)
   Fixes a bug that public_bucket option does not work.




git-svn-id: http://s3fs.googlecode.com/svn/trunk@489 df820570-a93a-0410-bd06-b72b767a4274
2013-09-29 13:24:30 +00:00
ggtakec@gmail.com
e6038f74ed Fixed a bug
1) Fixed a bug(about curl_off_t)
   Fixes a bug which is not use cast to curl_off_t from off_t(ssize_t) 
   at calling curl_easy_setopt with CURLOPT_POSTFIELDSIZE and 
   CURLOPT_INFILESIZE_LARGE.
   Maybe this forgot cast occurred issue 471(failed multipart uploading).



git-svn-id: http://s3fs.googlecode.com/svn/trunk@488 df820570-a93a-0410-bd06-b72b767a4274
2013-09-27 07:39:07 +00:00
ggtakec@gmail.com
a6884f1c3a Changes codes
1) Changed debug message level
   Changes a level and format for a debugging message about 
   parallel multipart upload in curl.cpp



git-svn-id: http://s3fs.googlecode.com/svn/trunk@487 df820570-a93a-0410-bd06-b72b767a4274
2013-09-26 05:00:21 +00:00