ben.lemasurier@gmail.com
79ee801b94
cleanup HTTP DELETE operations to use the same curl interface
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@381 df820570-a93a-0410-bd06-b72b767a4274
2011-08-31 22:20:20 +00:00
ben.lemasurier@gmail.com
9fb05fba4f
moved calc_signature to curl.cpp
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@380 df820570-a93a-0410-bd06-b72b767a4274
2011-08-31 20:36:40 +00:00
ben.lemasurier@gmail.com
8d941f42b5
file handle error checking
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@379 df820570-a93a-0410-bd06-b72b767a4274
2011-08-31 20:17:53 +00:00
ben.lemasurier@gmail.com
9b7b63cbba
simplified remote_mouthpath_exists, now uses s3fs_getattr()
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@378 df820570-a93a-0410-bd06-b72b767a4274
2011-08-31 19:27:50 +00:00
ben.lemasurier@gmail.com
a00c220062
s3fs_getattr simplified, now uses get_headers()
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@377 df820570-a93a-0410-bd06-b72b767a4274
2011-08-31 19:02:30 +00:00
ben.lemasurier@gmail.com
f333ad5d22
cleaning up x-amz-meta retrieval
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@376 df820570-a93a-0410-bd06-b72b767a4274
2011-08-31 17:37:55 +00:00
ben.lemasurier@gmail.com
191506e2e8
handle possible memory leaks, trivial cleanup
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@375 df820570-a93a-0410-bd06-b72b767a4274
2011-08-31 17:00:00 +00:00
ben.lemasurier@gmail.com
cc4d19b3c6
cleaned up s3fs_check_service
...
This _should_ handle issue #153 alongside simplifying s3fs_check_service;
determining if the network is up/down duplicated a lot of functionality
availble in my_curl_easy_perform. This will need some testing, of course.
git-svn-id: http://s3fs.googlecode.com/svn/trunk@374 df820570-a93a-0410-bd06-b72b767a4274
2011-08-30 22:09:17 +00:00
ben.lemasurier@gmail.com
4ba385d1be
return -EPERM on 403 (access forbidden) instead of -EIO
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@373 df820570-a93a-0410-bd06-b72b767a4274
2011-08-30 19:44:26 +00:00
ben.lemasurier@gmail.com
ac54fad06e
cleaning up rmdir
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@372 df820570-a93a-0410-bd06-b72b767a4274
2011-08-30 19:08:01 +00:00
ben.lemasurier@gmail.com
b481fa1d71
s3fs 1.61
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@368 df820570-a93a-0410-bd06-b72b767a4274
2011-08-30 15:21:46 +00:00
ben.lemasurier@gmail.com
cf43a2a260
Fixes a compile-time bug in 32bit systems and a memory leak in md5sum()
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@367 df820570-a93a-0410-bd06-b72b767a4274
2011-08-30 15:20:49 +00:00
ben.lemasurier@gmail.com
7412edd904
s3fs 1.60
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@364 df820570-a93a-0410-bd06-b72b767a4274
2011-08-29 22:06:48 +00:00
ben.lemasurier@gmail.com
c933b6a9b1
Support for modifying files > 5GB (fixes issue #215 )
...
Modified rename_object and put_headers to handle objects larger than
5GB. Files larger than 5GB are required to use the multi interface.
git-svn-id: http://s3fs.googlecode.com/svn/trunk@363 df820570-a93a-0410-bd06-b72b767a4274
2011-08-29 22:01:32 +00:00
ben.lemasurier@gmail.com
f623a395bc
fixes memory leaks associated with the fuse option parser and curl handles
...
Passing s3fs through valgrind revealed a few more memory leaks assocated with
the fuse option parser. We'll no longer directly return main from fuse_main().
In the event that s3fs_check_service failed, many of the curl handles were not
being cleaned up properly.
git-svn-id: http://s3fs.googlecode.com/svn/trunk@362 df820570-a93a-0410-bd06-b72b767a4274
2011-08-25 20:32:56 +00:00
ben.lemasurier@gmail.com
979ed21d5a
close directory handle after checking mountpoint
...
running s3fs through several valgrind checks found a bug in s3fs_check_service()
git-svn-id: http://s3fs.googlecode.com/svn/trunk@361 df820570-a93a-0410-bd06-b72b767a4274
2011-08-25 17:11:25 +00:00
ben.lemasurier@gmail.com
f29986f4c6
Simplified s3fs_check_service
...
simply using strstr to see if the bucket is available.
removed the check to see if the service has any buckets at all.
git-svn-id: http://s3fs.googlecode.com/svn/trunk@360 df820570-a93a-0410-bd06-b72b767a4274
2011-08-25 16:34:10 +00:00
ben.lemasurier@gmail.com
5a6ef54b36
trivial change to fix some valgrind warnings regarding unititialized values.
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@359 df820570-a93a-0410-bd06-b72b767a4274
2011-08-02 15:08:28 +00:00
ben.lemasurier@gmail.com
b41f982d59
Fixes issue #205
...
when s3fs is linked against libcurl < 7.20.0 we'd receive CURLM_CALL_MULTI_PERFORM
git-svn-id: http://s3fs.googlecode.com/svn/trunk@358 df820570-a93a-0410-bd06-b72b767a4274
2011-07-29 20:03:38 +00:00
ben.lemasurier@gmail.com
07baba972a
Handle curl send and recv errors a little more gracefully
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@357 df820570-a93a-0410-bd06-b72b767a4274
2011-07-29 15:48:15 +00:00
ben.lemasurier@gmail.com
824431712e
s3fs-1.59 release
...
- fixes issue #206
git-svn-id: http://s3fs.googlecode.com/svn/trunk@356 df820570-a93a-0410-bd06-b72b767a4274
2011-07-28 19:46:14 +00:00
ben.lemasurier@gmail.com
40fde1e0ea
Possible fix for issue #206
...
- handle bad xml data from Amazon
git-svn-id: http://s3fs.googlecode.com/svn/trunk@355 df820570-a93a-0410-bd06-b72b767a4274
2011-07-28 15:43:52 +00:00
mooredan@suncup.net
b54b2ddfda
Fixed issue #210
...
Applied user supplied patch
git-svn-id: http://s3fs.googlecode.com/svn/trunk@353 df820570-a93a-0410-bd06-b72b767a4274
2011-07-19 19:52:38 +00:00
ben.lemasurier@gmail.com
f484ea00ae
Fixes issue #172
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@352 df820570-a93a-0410-bd06-b72b767a4274
2011-07-07 22:09:40 +00:00
ben.lemasurier@gmail.com
a16617a5d5
bump version for bugfix ( #205 )
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@351 df820570-a93a-0410-bd06-b72b767a4274
2011-07-07 16:26:07 +00:00
ben.lemasurier@gmail.com
913fee101e
fix for issue #205
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@350 df820570-a93a-0410-bd06-b72b767a4274
2011-07-07 16:25:04 +00:00
ben.lemasurier@gmail.com
ee1915ff93
missed this on the last commit
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@349 df820570-a93a-0410-bd06-b72b767a4274
2011-07-02 18:52:44 +00:00
ben.lemasurier@gmail.com
2eafa487d7
Massive speed improvements for readdir operations
...
complete s3fs_readdir() refactor
- multi interface now batches HTTP requests
- proper HTTP KeepAlive sessions are back! (CURLOPT_FORBID_REUSE is no longer required)
- use xpath to quickly grab xml nodes
- lots of cleanup
- fixes some strange stat cache behavior
- huge readdir performance benefits (8-14x in my case) on large directories
git-svn-id: http://s3fs.googlecode.com/svn/trunk@348 df820570-a93a-0410-bd06-b72b767a4274
2011-07-02 02:11:54 +00:00
ben.lemasurier@gmail.com
1a6885359c
Ability to disable multipart uploads
...
- Added 'nomultipart' option to disable multipart uploads
- see issue #181
git-svn-id: http://s3fs.googlecode.com/svn/trunk@347 df820570-a93a-0410-bd06-b72b767a4274
2011-06-27 02:21:38 +00:00
ben.lemasurier@gmail.com
6db8dafca4
bump version number
...
- removed debugging line
git-svn-id: http://s3fs.googlecode.com/svn/trunk@346 df820570-a93a-0410-bd06-b72b767a4274
2011-06-26 00:42:45 +00:00
ben.lemasurier@gmail.com
1597dfe659
Support for mounting a remote directory (issue #7 ).
...
- fixed a bug in the file cache, it was attempting to set the mtime
on symlinks
- general code cleanup; moved some string functions to string_util.cpp
git-svn-id: http://s3fs.googlecode.com/svn/trunk@345 df820570-a93a-0410-bd06-b72b767a4274
2011-06-26 00:37:52 +00:00
ben.lemasurier@gmail.com
94d72bdaf3
trivial compiler warning fix.
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@344 df820570-a93a-0410-bd06-b72b767a4274
2011-06-22 22:32:08 +00:00
mooredan@suncup.net
30abdff53f
resolves issue #155
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@340 df820570-a93a-0410-bd06-b72b767a4274
2011-04-06 15:06:28 +00:00
ben.lemasurier@gmail.com
2e09e5201b
fixes issue #23 and issue #160 . validate the file cache by comparing the local/remote size/mtime values instead of an md5 sum
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@338 df820570-a93a-0410-bd06-b72b767a4274
2011-03-10 00:11:55 +00:00
mooredan@suncup.net
ebdde932a6
Strip the trailing '/' characters off of the url= option's
...
argument
Resolves issue #171
git-svn-id: http://s3fs.googlecode.com/svn/trunk@336 df820570-a93a-0410-bd06-b72b767a4274
2011-03-09 20:55:31 +00:00
ben.lemasurier@gmail.com
6cd9e9e65d
moved generic curl routines to their own file
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@332 df820570-a93a-0410-bd06-b72b767a4274
2011-03-01 19:35:55 +00:00
ben.lemasurier@gmail.com
60f96aa8fb
header file inclusion required for make dist-gzip/zip/etc
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@331 df820570-a93a-0410-bd06-b72b767a4274
2011-02-28 20:10:40 +00:00
mooredan@suncup.net
c16925bb10
Added check to check for illegal characters in bucket name
...
Resolves issue #163
git-svn-id: http://s3fs.googlecode.com/svn/trunk@330 df820570-a93a-0410-bd06-b72b767a4274
2011-02-26 14:48:02 +00:00
mooredan@suncup.net
2fe1abc66b
First attempt to resolve issue 161 -- added handler for
...
curl error code 23 - CURLE_WRITE_ERROR
When encountered, it does a retry.
git-svn-id: http://s3fs.googlecode.com/svn/trunk@329 df820570-a93a-0410-bd06-b72b767a4274
2011-02-26 14:11:46 +00:00
ben.lemasurier@gmail.com
48d1a73e06
cleanup only; s3fs.cpp is getting huge, split caching to its own file
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@328 df820570-a93a-0410-bd06-b72b767a4274
2011-02-25 17:35:12 +00:00
ben.lemasurier@gmail.com
ec4c5b3627
reduced the number of keys returned to see if a directory is empty, we only need to know if 1 exists. Minor cleanups.
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@327 df820570-a93a-0410-bd06-b72b767a4274
2011-02-23 17:16:12 +00:00
ben.lemasurier@gmail.com
6c89527aed
minor cleanup, no functional changes.
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@326 df820570-a93a-0410-bd06-b72b767a4274
2011-02-23 16:03:08 +00:00
ben.lemasurier@gmail.com
c07e27eff1
only delete stat cache entries when file could have been modified.
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@324 df820570-a93a-0410-bd06-b72b767a4274
2011-02-22 23:01:42 +00:00
ben.lemasurier@gmail.com
9b5f694497
update to r322, this only works when local file cache is turned on. Initial 'make check' erroneously passed
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@323 df820570-a93a-0410-bd06-b72b767a4274
2011-02-22 22:28:57 +00:00
ben.lemasurier@gmail.com
0fb4427444
Fixes issues #134 , "double upload". This _should_ result in a large performance improvment.
...
- s3fs_flush() now checks to see whether the file on the remote end is the same as the local copy.
- md5sum() now requires a file descriptor instead of a path.
git-svn-id: http://s3fs.googlecode.com/svn/trunk@322 df820570-a93a-0410-bd06-b72b767a4274
2011-02-22 21:28:01 +00:00
apetresc@gmail.com
fe47e37a98
Adding a dist-hook to remove .svn directories from things in EXTRA_DIST.
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@321 df820570-a93a-0410-bd06-b72b767a4274
2011-02-21 19:56:00 +00:00
ben.lemasurier@gmail.com
1496f6a81e
Further multipart cleanup/error checking, in preparation for multi-threaded uploads.
...
"Last-Modified" is now returned with get_headers() data
git-svn-id: http://s3fs.googlecode.com/svn/trunk@320 df820570-a93a-0410-bd06-b72b767a4274
2011-02-17 17:31:43 +00:00
ben.lemasurier@gmail.com
cfa0fd2992
clean up get_local_fd() to use md5sum()
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@319 df820570-a93a-0410-bd06-b72b767a4274
2011-02-16 16:52:45 +00:00
ben.lemasurier@gmail.com
00bde54d0a
A large amount of cleanup for multipart uploads; preparation work for upcoming multi-threaded upload support.
...
Functional changes are limited to the multipart upload process. Each uploaded part is now verified against a local md5sum.
git-svn-id: http://s3fs.googlecode.com/svn/trunk@318 df820570-a93a-0410-bd06-b72b767a4274
2011-02-15 23:32:27 +00:00
ben.lemasurier@gmail.com
1a79d451c5
Fixes an issue reintroduced in r315: s3fs_readdir was not populating the file stat cache
...
git-svn-id: http://s3fs.googlecode.com/svn/trunk@317 df820570-a93a-0410-bd06-b72b767a4274
2011-02-14 18:54:30 +00:00