108 Commits

Author	SHA1	Message	Date
Takeshi Nakatani	2c4c78fd65	Merge pull request #1102 from gaul/test/concurrent-write ... Add a test for concurrent writes	2019-07-17 22:24:45 +09:00
Takeshi Nakatani	80f598f439	Merge pull request #1099 from ggtakec/filter_log ... Add log output filter script at test failure	2019-07-17 22:01:28 +09:00
Andrew Gaul	5cb7a31c09	Add a test for concurrent writes	2019-07-16 21:57:43 -07:00
Takeshi Nakatani	c7f8f61d09	Change test_concurrency test	2019-07-15 15:58:54 -07:00
Takeshi Nakatani	159cd2c682	Add log output filter script at test failure	2019-07-15 06:37:43 +00:00
Andrew Gaul	4a192ffdf9	Run xattr tests on macOS	2019-07-07 00:39:45 -07:00
Takeshi Nakatani	6177d7b096	Merge pull request #1073 from gaul/deps/s3proxy ... Upgrade to S3Proxy 1.6.2	2019-07-07 15:19:00 +09:00
Takeshi Nakatani	3161bf4608	Merge pull request #1070 from gaul/bash/nounset ... Prohibit pipeline failures	2019-07-07 15:10:53 +09:00
Takeshi Nakatani	2349dafb98	Merge pull request #1069 from gaul/macos/sed ... Use system sed on macOS	2019-07-07 15:00:48 +09:00
Andrew Gaul	4f23f38583	Individually test multiple s3fs flags ... Remove unneeded comments; single part limits ensure that the tests exercise multipart code paths even with smaller files. References #971.	2019-07-03 21:09:40 -07:00
Andrew Gaul	f439c6382f	Upgrade to S3Proxy 1.6.2 ... Notably this includes support for List Objects v2 which AWS CLI uses. Release notes: https://github.com/gaul/s3proxy/releases/tag/s3proxy-1.6.2	2019-07-03 10:37:26 -07:00
Andrew Gaul	9472ee4a01	Prohibit pipeline failures	2019-07-03 02:57:40 -07:00
Andrew Gaul	1f1f824da7	Use system sed on macOS ... This requires fewer developer customizations to work on macOS. Requires some GNU workarounds.	2019-07-02 22:17:02 -07:00
Andrew Gaul	c596441f58	Flush file when opening second fd ... Previously when s3fs had dirty local data and an application opened a second fd it would remove the stat cache entry, query S3 for the size which was still zero, then reinitialize FdEntry with this incorrect size. Instead flush local data to S3 so this query works. It is possible that a more involved patch could do this with a less heavyweight approach but this requires changing open. This does not completely fix git clone but allows it to proceed further. Also make some cache methods const-correct. References #839.	2019-07-02 01:12:09 -07:00
Andrew Gaul	048aea1151	Remove litter from test_concurrency	2019-06-26 20:29:27 -07:00
Takeshi Nakatani	a78d8d1da4	Merge pull request #1049 from gaul/external-modication ... Remove cache file when object time differs	2019-06-24 00:51:54 +09:00
Andrew Gaul	9e5eaad79b	Remove cache file when object time differs ... Check the modification times to determine whether an object has updated. This relies on low clock skew between s3fs and the S3 server; a more robust approach could use the ETag. Fixes #1047.	2019-06-22 19:09:00 -07:00
Andrew Gaul	1cf3d2452e	Correct macOS integration test umount ... Previously errexit could prevent this from succeeding.	2019-06-19 11:01:32 -07:00
Andrew Gaul	0176fc712b	Address shellcheck errors	2019-04-09 21:11:31 +09:00
Andrew Gaul	e5785d4690	Prefer HTTPS links in documentation where possible ... This also corrects a test URL which was HTTPS in practice.	2019-04-05 17:31:06 +09:00
Jay Caines-Gooby	ddbcec5c96	Work with filenames that include spaces ... • Simplified the stat generation line (single exec using only stat) • Quote variables so that the cache directory can also include spaces • while/read loop to handle spaces in cached files (IFS was causing problems when all the files were saved into a single variable)	2019-04-02 10:35:25 +01:00
Andrew Gaul	f53503438c	Increase FdEntity reference count when returning ... Previously s3fs had a race condition where one client could delete FdEntity that another client was using. Add a simple concurrent test which previously failed but now succeeds. Fixes #964.	2019-03-09 15:55:04 +09:00
Andrew Gaul	e9297f39ea	Upgrade to S3Proxy 1.6.1 ... Notably, this improve performance when listing objects using the filesystem backend, allowing new tests like expanding large tar files. Release notes: https://github.com/gaul/s3proxy/releases/tag/s3proxy-1.6.1	2019-02-06 17:06:43 -08:00
Takeshi Nakatani	c0cf90cf8b	Checked and corrected all typo	2019-01-27 12:04:29 +00:00
Takeshi Nakatani	d487348d21	Merge pull request #919 from gaul/test/mv-nonempty-dir ... Add test for mv non-empty directory	2019-01-23 19:21:12 +09:00
Andrew Gaul	79bd3441eb	Add test for mv non-empty directory	2019-01-22 22:13:17 -08:00
Andrew Gaul	5f5da4b2cb	Load tail range during overwrite ... Previously s3fs experienced data loss when writing to the middle of a file. Corrupt files would have the expected data from 0..offset+size but unexpected NUL bytes from offset+size..EOF. References #808.	2019-01-22 22:02:40 -08:00
Andrew Gaul	6401b4ae92	Flush file before renaming ... Previously s3fs could copy the zero-byte stub object without including any pending writes. Fixes #145.	2019-01-17 12:05:10 -08:00
Andrew Gaul	2c43b1e12b	Store and retrieve file change time ... This introduces a new header with the change time; existing objects will report modification time. Fixes #771.	2019-01-14 10:05:11 -08:00
Andrew Gaul	523fe1e309	Repair xattr tests ... These did not run due to missing use_xattr flag and Travis misconfiguration.	2019-01-13 18:54:16 -08:00
Andrew Gaul	1b86e4d414	Upgrade to S3Proxy 1.6.0 ... Release notes: https://github.com/gaul/s3proxy/releases/tag/s3proxy-1.6.0 https://github.com/gaul/s3proxy/releases/tag/s3proxy-1.5.5 https://github.com/gaul/s3proxy/releases/tag/s3proxy-1.5.4	2018-05-16 16:38:17 -07:00
Takeshi Nakatani	f4515b5cfa	Merge pull request #646 from andrewgaul/s3proxy-pid ... Simplify S3Proxy PID handling	2017-09-20 05:17:00 +09:00
Andrew Gaul	5014c1827b	Simplify S3Proxy PID handling ... Also remove log prefixing since newer S3Proxy versions do this already. Finally remove unnecessary wait.	2017-09-17 20:19:56 -07:00
Andrew Gaul	f531e6aff2	Configure S3Proxy for SSL ... This also demonstrates that SSL certificate checking occurs and the tests must disable it for S3Proxy's self-signed certificate. References #640.	2017-09-17 16:16:18 -07:00
Takeshi Nakatani	96d8e6d823	Merge remote-tracking branch 'upstream/macosx' into macosx	2017-08-11 14:20:12 +00:00
Takeshi Nakatani	62b8084300	Added travis test on osx for #601	2017-08-11 14:09:43 +00:00
Andrew Gaul	98b724391f	Upgrade to S3Proxy 1.5.3 ... Release notes: https://github.com/andrewgaul/s3proxy/releases/tag/s3proxy-1.5.3	2017-07-09 22:41:39 -07:00
Andrew Gaul	25a03c370a	Upgrade to S3Proxy 1.5.2 ... Release notes: https://github.com/andrewgaul/s3proxy/releases/tag/s3proxy-1.5.2	2017-03-02 10:55:24 -08:00
Takeshi Nakatani	8a11d7bc2f	Merge pull request #505 from andrewgaul/spelling ... Correct typos	2016-11-20 09:10:27 +09:00
Takeshi Nakatani	7aae4782d9	Merge pull request #504 from andrewgaul/test ... Use describe helper function	2016-11-20 09:10:16 +09:00
Andrew Gaul	d375bca0d0	Correct typos	2016-11-19 15:57:41 -08:00
Andrew Gaul	cd0c8599cc	Use describe helper function	2016-11-19 15:36:02 -08:00
Andrew Gaul	20878a1618	Add missing call to mtime test	2016-11-19 15:10:41 -08:00
Andrew Gaul	cafe6015e3	Upgrade to S3Proxy 1.5.1 ... Enabled previously broken tests and test with default v4 signer. Release notes: https://github.com/andrewgaul/s3proxy/releases/tag/s3proxy-1.5.0 https://github.com/andrewgaul/s3proxy/releases/tag/s3proxy-1.5.1	2016-11-15 23:09:48 -08:00
Takeshi Nakatani	ec110bb0f3	Added small logic in test script for test_chown	2016-09-11 13:41:50 +00:00
Takeshi Nakatani	232befb52a	Added small logic in test script for test_chown	2016-09-11 13:37:53 +00:00
Takeshi Nakatani	f363c21ff5	Added comments in failure message for test_chown	2016-09-11 13:28:40 +00:00
Tianlong Wu	cf23dc78ab	Use 'return' instead of 'exit' in test	2016-04-22 16:24:26 +08:00
Tianlong Wu	115bd51f3f	Fix a bug of truncating empty file	2016-04-22 14:49:37 +08:00
Robb Kistler	4e583583cd	Test for writing after an lseek past end of file ... This is a test to demonstrate Issue #375	2016-03-23 16:03:38 -07:00