1664 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Andrew Gaul	79bd3441eb	Add test for mv non-empty directory	2019-01-22 22:13:17 -08:00
Andrew Gaul	5f5da4b2cb	Load tail range during overwrite ... Previously s3fs experienced data loss when writing to the middle of a file. Corrupt files would have the expected data from 0..offset+size but unexpected NUL bytes from offset+size..EOF. References #808.	2019-01-22 22:02:40 -08:00
Andrew Gaul	dede19d8c0	Reference better-known AWS CLI for compatibility	2019-01-21 17:32:57 -08:00
Takeshi Nakatani	fada95f58e	Merge pull request #914 from gaul/readdir/head-of-line ... Issue readdir HEAD requests without batching	2019-01-21 22:10:50 +09:00
Takeshi Nakatani	014b8c5982	Merge pull request #913 from gaul/assert ... Prefer abort over assert(false)	2019-01-21 21:56:41 +09:00
Andrew Gaul	46d79c5bc2	Issue readdir HEAD requests without batching ... Previously s3fs would issue a batch of HEAD requests and wait for all to succeed before issuing the next batch. Now it issues the first batch and only waits for a single call to succeed before issuing the next call. This can improve performance when one call lags due to network errors. I measured 25% improvement with the same level of parallelism. This commit also reparents parallelism knobs for consistency. Follows on to 88cd8feb05. Fixes #223.	2019-01-20 18:07:22 -08:00
Andrew Gaul	40ba3b44a1	Prefer abort over assert(false) ... The compiler can remove the latter when compiled with NDEBUG which may cause unintended control flow.	2019-01-20 12:30:27 -08:00
Takeshi Nakatani	beadf95975	Merge pull request #912 from ggtakec/master ... Automatic region change made possible other than us-east-1(default)	2019-01-20 20:13:07 +09:00
Takeshi Nakatani	2887f8916b	Automatic region change made possible other than us-east-1(default)	2019-01-20 10:51:49 +00:00
Takeshi Nakatani	0c9a8932f7	Merge pull request #911 from ggtakec/master ... Added detail error message when HTTP 301/307 status	2019-01-20 19:31:04 +09:00
Takeshi Nakatani	ac72431195	Added detail error message when HTTP 301/307 status	2019-01-20 10:07:58 +00:00
Takeshi Nakatani	2a7877beff	Merge pull request #910 from ggtakec/master ... Added a missing extension to .gitignore, and formatted dot files	2019-01-20 18:38:37 +09:00
Takeshi Nakatani	7a56459103	Added a missing extension to .gitignore, and formatted dot files	2019-01-20 09:18:40 +00:00
Takeshi Nakatani	5292fa74d1	Merge pull request #909 from ggtakec/master ... Ignore after period character of floating point in x-amz-meta-mtime	2019-01-20 17:58:55 +09:00
Takeshi Nakatani	f2184e34dd	Ignore after period character of floating point in x-amz-meta-mtime	2019-01-20 08:28:06 +00:00
Takeshi Nakatani	1d4867830b	Merge pull request #908 from ggtakec/master ... Added an error message when HTTP 301 status	2019-01-20 16:59:43 +09:00
Takeshi Nakatani	36a4903843	Added an error message when HTTP 301 status	2019-01-20 07:17:40 +00:00
Takeshi Nakatani	c83a3e67c9	Merge pull request #885 from LutzFinsterle2019/master ... Update s3fs_util.cpp for correspondence of Nextcloud contype	2019-01-20 15:32:58 +09:00
Takeshi Nakatani	05014c49c8	Merge pull request #906 from gaul/doc/https ... Prefer HTTPS links where possible	2019-01-20 15:10:51 +09:00
Takeshi Nakatani	aa69107165	Merge pull request #905 from gaul/clang-tidy/redundant ... Fix comparison in s3fs_strtoofft	2019-01-20 15:01:40 +09:00
Takeshi Nakatani	d373b0eca3	Merge pull request #904 from gaul/clang-tidy/c-str ... Remove unnecessary calls to std::string::c_str	2019-01-20 14:13:46 +09:00
Takeshi Nakatani	6aa40b2747	Merge pull request #903 from gaul/clang-tidy/find_char ... Prefer find(char) over find(const char *)	2019-01-20 14:05:06 +09:00
Takeshi Nakatani	34c3bfe408	Merge pull request #902 from gaul/clang-tidy/pass-by-value ... Avoid pass-by-value when not necessary	2019-01-20 13:45:44 +09:00
Takeshi Nakatani	6ac56e722d	Merge pull request #901 from gaul/clang-tidy/leaks ... Plug memory leaks	2019-01-20 12:41:08 +09:00
Takeshi Nakatani	61dc7f0a70	Merge pull request #900 from gaul/leak ... Plug memory leak	2019-01-20 12:30:31 +09:00
Takeshi Nakatani	9f000957dd	Merge pull request #899 from gaul/response-code ... Tighten up HTTP response code check	2019-01-20 11:16:23 +09:00
Takeshi Nakatani	b2141313e2	Merge pull request #898 from gaul/rename-before-close ... Flush file before renaming	2019-01-20 10:13:20 +09:00
Andrew Gaul	aa9bd1fa3c	Prefer HTTPS links where possible ... Fix a few stale links as well.	2019-01-18 11:09:08 -08:00
Andrew Gaul	5a2dc03a1c	Fix comparison in s3fs_strtoofft ... Also backfill unit tests. Document limitations. Found via clang-tidy.	2019-01-17 22:59:25 -08:00
Andrew Gaul	508fafbe62	Remove unnecessary calls to std::string::c_str ... Found via clang-tidy.	2019-01-17 22:05:16 -08:00
Andrew Gaul	e29548178b	Prefer find(char) over find(const char *) ... The former can be faster. Found via clang-tidy.	2019-01-17 20:24:24 -08:00
Andrew Gaul	ab2f36f202	Plug memory leaks ... Found via clang-tidy.	2019-01-17 18:54:34 -08:00
Andrew Gaul	b8c9fcfd70	Avoid pass-by-value when not necessary ... This requires unnecessary memcpy. Found via clang-tidy.	2019-01-17 18:22:11 -08:00
Andrew Gaul	58ce544e83	Plug memory leak ... Previously this appended to an empty list, zeroed the list, then appended to the list. Instead zero the list first and then append. This also enables sending Content-MD5 which can eagerly detect transmission errors. Found via Valgrind.	2019-01-17 16:24:34 -08:00
Andrew Gaul	e98ce36301	Tighten up HTTP response code check ... Previously s3fs considered 3xx codes as successful. When writing an object to a misconfigured region, s3fs did not propagate the 301 as a write error to the client. References #693.	2019-01-17 15:04:59 -08:00
Andrew Gaul	6401b4ae92	Flush file before renaming ... Previously s3fs could copy the zero-byte stub object without including any pending writes. Fixes #145.	2019-01-17 12:05:10 -08:00
Takeshi Nakatani	25b49e1a2e	Merge pull request #894 from gaul/default-mode ... Default uid/gid/mode when object lacks permissions	2019-01-16 18:48:54 +09:00
Takeshi Nakatani	c7def35b54	Merge pull request #895 from gaul/bucket-name-dot ... Emit more friendly error for buckets with dots	2019-01-16 18:39:47 +09:00
Takeshi Nakatani	ddba1c63c5	Merge pull request #893 from gaul/ctime ... Store and retrieve file change time	2019-01-16 18:30:15 +09:00
Andrew Gaul	c512516e14	Emit more friendly error for buckets with dots ... These fail SSL certificate checks due to the *.s3.amazon.com wildcard. Fixes #284.	2019-01-14 18:47:36 -08:00
Andrew Gaul	2c43b1e12b	Store and retrieve file change time ... This introduces a new header with the change time; existing objects will report modification time. Fixes #771.	2019-01-14 10:05:11 -08:00
Takeshi Nakatani	b68d97c6bf	Merge pull request #892 from gaul/test/xattr ... Repair xattr tests	2019-01-14 21:26:46 +09:00
Takeshi Nakatani	f1757e4343	Merge pull request #888 from gaul/readme ... Add Server Fault to FAQs	2019-01-14 21:17:06 +09:00
Andrew Gaul	e2d5641d99	Default uid/gid/mode when object lacks permissions ... This addresses a common use case when interacting with objects from both s3fs and other S3 tools. Fixes #890.	2019-01-13 21:57:23 -08:00
Andrew Gaul	523fe1e309	Repair xattr tests ... These did not run due to missing use_xattr flag and Travis misconfiguration.	2019-01-13 18:54:16 -08:00
LutzFinsterle2019	c985b5e4d0	Corrected Comment to C++ style	2019-01-12 10:19:48 +01:00
Andrew Gaul	786f1a8fc7	Add Server Fault to FAQs ... Also correctly format Stack Overflow.	2019-01-10 11:17:32 -08:00
LutzFinsterle2019	18cb2e2662	Update s3fs_util.cpp ... Sorry for answering late, have been busy lately. The comment is: "Nextcloud stores Directory objects with this mime type when mounting a Bucket as external Storage"	2019-01-10 07:44:36 +01:00
LutzFinsterle2019	743c706b0a	Update s3fs_util.cpp ... Nextcloud Compatibility in directory mime-types	2019-01-07 07:41:27 +01:00
Takeshi Nakatani	4ed0e5f35a	Merge pull request #882 from earlchew/issue-817 ... [curl] Assume long encryption keys are base64 encoded	2019-01-06 17:29:04 +09:00