279 Commits

Author	SHA1	Message	Date
yongqingliu	b72f4b43a4	use correct content-type when complete multipart upload	2020-02-10 16:58:28 +09:00
Andrew Gaul	bc9126d774	Set directory MIME type to application/x-directory ... Previously s3fs auto-detected the MIME type of directories like "TOYOTA TRUCK 8.2.2" as application/x-troff-man. This caused get_mode to not set S_IFDIR which failed directory creation. Instead force all object names ending in / to application/x-directory. Fixes #1183.	2020-02-04 20:03:21 +09:00
rallister	4e26728cbf	break recursion when calling GetIAMCredentials (#1233) ... break recursion when calling GetIAMCredentials	2020-01-31 16:48:37 +09:00
Andrei Precup	39102608aa	Add intelligent tiering as option for storage class ... Resolves Issue #1219	2020-01-13 20:24:35 +09:00
Alvaro Huarte	a24f78f5a4	Adds requester_pays option to enable requests involving Requester Pays buckets	2019-11-18 12:38:16 +01:00
Bryce Larson	0c42a74a8a	handle edge case when bucket name and first part of endpoint match	2019-10-26 00:51:19 -06:00
Takeshi Nakatani	1db94a0b30	Fixed to use copy api in multipart upload	2019-09-25 19:30:58 -07:00
Takeshi Nakatani	bedd648d47	Fixed build error by cppcheck 1.89	2019-09-23 10:49:49 +00:00
Takeshi Nakatani	58b3cce320	Merge pull request #1066 from gaul/sign-requests ... Sign request immediately before sending	2019-09-23 15:58:21 +09:00
Takeshi Nakatani	81102a5963	Merge pull request #1149 from ggtakec/fix_retry ... Fixed a bug that type and op are not inherited	2019-09-08 20:32:43 +09:00
Takeshi Nakatani	42fb30852b	Merge pull request #1145 from gaul/bool ... Fix a few bool types	2019-09-08 20:04:30 +09:00
Takeshi Nakatani	e2129001eb	Fixed a bug that type and op are not inherited	2019-09-08 09:59:04 +00:00
Andrew Gaul	805cc064af	Fix a few bool types ... Found via clang-tidy.	2019-09-05 10:42:42 -07:00
Andrew Gaul	412876ca33	Expose base parameter in s3fs_strtoofft ... This fixes a regression from ccf3e7bfa2 which caused the misparsing of octal inputs for the mp_umask and umask flags. It also allows some callers to be more precise about their decimal inputs.	2019-09-04 20:41:47 -07:00
Andrew Gaul	461a346bf4	Sign request immediately before sending ... Previously s3fs could create a long list of pre-signed requests which could take longer than the default S3 clock skew limit of 15 minutes. This also changes SHA-256 computation from single- to multi-threaded since this is now computed in the worker threads. Regression from 88cd8feb05. Fixes #1019.	2019-08-29 15:35:27 -07:00
liuyongqing	ae4bcd405c	use correct content-type when overwriting and copying files	2019-08-28 22:25:09 -07:00
Takeshi Nakatani	0536dc1112	Refixed strict processing of MultiRead method	2019-08-25 20:46:01 -07:00
Andrew Gaul	cc2eed84a5	Promote default ACL to enum ... This sanity checks ACLs during initialization and also omits sending the header when set to PRIVATE which is the default.	2019-08-20 15:05:58 -07:00
Takeshi Nakatani	873e376098	Strict processing of MultiRead method	2019-08-13 15:23:13 +00:00
Takeshi Nakatani	4a0c23258e	Fixed MultiRead method to exit after waiting other parts at error	2019-08-12 14:45:06 -07:00
Takeshi Nakatani	5c4a0a862a	Fixed multipart copy and its retry handler	2019-08-11 16:21:26 +00:00
Takeshi Nakatani	f74c7407db	Merge pull request #1118 from gaul/atoi ... Prefer s3fs_strtoofft over atoi and strtol	2019-08-06 21:23:37 +09:00
Takeshi Nakatani	433c04af26	Merge pull request #1116 from gaul/bodydata ... Do not heap allocate BodyData	2019-08-06 21:08:02 +09:00
Andrew Gaul	ccf3e7bfa2	Prefer s3fs_strtoofft over atoi and strtol ... The former propagates errors consistently.	2019-08-03 16:13:48 -07:00
Andrew Gaul	7ecfba811e	Do not heap allocate BodyData ... Callers already manage lifetimes via Clear().	2019-08-03 15:50:46 -07:00
Andrew Gaul	a5c20175a1	Use length from s3fs_HMAC256 for consistency ... EVP_MAX_MD_SIZE can range up to 64. Found by Coverity.	2019-08-02 10:40:55 -07:00
Andrew Gaul	bacd15714a	Use consistent default for readwrite_timeout ... Previously curl threads mutated this shared state without a lock. Found via ThreadSanitizer.	2019-07-16 22:03:56 -07:00
Takeshi Nakatani	543aed2a32	Merge pull request #1096 from gaul/pthread/lock-checking ... Expand error checking to all pthread_mutex_t	2019-07-15 11:43:56 +09:00
Andrew Gaul	43ec064fb9	Expand error checking to all pthread_mutex_t	2019-07-14 18:21:23 -07:00
Andrew Gaul	ffac4c8417	Avoid narrowing time_t and off_t args in logging ... This displays correct results on 32-bit platforms.	2019-07-14 17:02:36 -07:00
Takeshi Nakatani	e936854493	Merge pull request #1094 from larsch/master ... Fix multipart upload not setting curl options	2019-07-15 05:13:37 +09:00
Lars Christensen	58037da061	Fix multipart upload not setting curl options	2019-07-14 14:09:37 +02:00
Andrew Gaul	6fd42d9fe4	Prefer modern C headers ... Found and fixed via clang-tidy.	2019-07-12 03:50:59 -07:00
Takeshi Nakatani	e5e63d6ac3	Merge pull request #1067 from gaul/mismatched-free ... Fix mismatched new[]/free	2019-07-07 16:55:07 +09:00
Takeshi Nakatani	7a65a414c3	Merge pull request #1080 from gaul/xml/simplification ... Add simple XML parsing wrapper	2019-07-07 16:44:18 +09:00
Andrew Gaul	944d21cabb	Fix mismatched new[]/free ... Found via Valgrind.	2019-07-07 00:36:48 -07:00
Andrew Gaul	b8ff6a647e	Add simple XML parsing wrapper ... Also simplify check_region_error.	2019-07-05 17:39:09 -07:00
Andrew Gaul	bbfa91141a	Configure clang-tidy target ... Also fix nits.	2019-07-03 14:04:11 -07:00
Takeshi Nakatani	fbebc6fa57	Merge pull request #1048 from gaul/log/curl ... Emit older curl warnings only once	2019-06-24 00:42:44 +09:00
Andrew Gaul	738eaadcbf	Emit older curl warnings only once ... This makes Travis logs actually readable.	2019-06-22 10:01:20 -07:00
Andrew Gaul	15b7450713	Convert file offsets from size_t to off_t ... The latter is 64-bits on 32-bit platforms when specifying -D_FILE_OFFSET_BITS=64. This allows early Raspberry Pis to use files larger than 2 GB. It also cleans up some ugly casting. Fixes #620. Fixes #656.	2019-06-15 17:05:37 -07:00
Michal Lula	0d4847596e	fix issue with aws session token provided inside ~/.aws/credentials file	2019-04-25 14:29:35 +02:00
Andrew Gaul	0677a096a9	Prefer simple over compound statements in macros ... This prohibits missing semicolons.	2019-04-17 21:46:24 +09:00
Michal Lula	f9cd43b684	add session token support	2019-04-16 16:53:05 +02:00
Andrew Gaul	6f8ecb28c5	Correctly calculate MD5 hash for SSE-C keys ... Previously s3fs calculated the strlen of a binary input instead of using the stored length. This yielded IO errors when interacting with SSE-encrypted objects. Fixes #696.	2019-04-08 21:49:42 +09:00
Andrew Gaul	6f6a67807b	Prefer new over malloc ... The former cannot return NULL and will allow use of scoped pointers.	2019-04-07 16:54:24 +09:00
Takeshi Nakatani	71766039ff	Support undefined CURLoption in libcurl library used in build	2019-03-22 10:47:42 +00:00
Andrew Gaul	1e86cc643d	Fix lazy typo	2019-03-09 17:46:02 +09:00
Takeshi Nakatani	10d9f75366	Improvement of curl session pool for multipart ... Improvement of curl session pool for multipart(2) Improvement of curl session pool for multipart(3)	2019-02-25 14:46:24 +00:00
Takeshi Nakatani	eeb839242b	Fixed code for latest cppcheck error on OSX	2019-02-17 13:59:11 +00:00