Commit Graph

2177 Commits

Author SHA1 Message Date
Takeshi Nakatani b0eeaa6679 Reflected the result of the review in the code 2022-07-17 22:20:45 +09:00
Takeshi Nakatani d22e1dc018 Add the stream upload which starts uploading parts before Flush 2022-07-17 22:20:45 +09:00
Andrew Gaul 3a0799ec18
Re-re-re-fix propagating the return code (#1984)
This shell incantation is necessary to have errexit take effect for
test bodies.  Previous only the _last_ command's exit code was
propagated to the test runner, masking real failures.  Reverts
ea3c21f270.
2022-07-17 02:13:06 +09:00
Andrew Gaul 4e163b2888
Allow listing implicit directories (#1986)
This fixes an issue when using -o notsup_compat_dir flag, dating back
to its introduction 3ac39d61f8.  The new
default exposed this in my local testing but a test runner bug masked
a test failure in test_external_directory_creation.  References #927.
References #1984.
2022-07-17 01:54:29 +09:00
Andrew Gaul 86da2eed3a
Do not call exit in individual test functions (#1985)
This could prevent the test runner from reporting failures.
2022-07-17 01:33:50 +09:00
Andrew Gaul e7ed01b35f
Consume return code from get_object_attribute (#1976)
Found via clang-analyzer.
2022-07-09 16:45:23 +09:00
Andrew Gaul 4d303caa62
Add Valgrind to sanitizer script (#1978)
Theoretically msan can do this but practically it requires a custom
libc++.
2022-07-09 16:40:23 +09:00
Takeshi Nakatani 3f55c98a3f Fixed a bug when the pool of curl handler exceeds the upper limit 2022-07-08 21:14:29 +09:00
Andrew Gaul 2723e1049e
Add missing paragraph to help (#1974) 2022-07-03 12:35:02 +09:00
Takeshi Nakatani f11eb7d69b Fixed a bug that regular files could not be created by mknod 2022-06-29 16:56:19 +09:00
Takeshi Nakatani 73b49c1038 Fixed a bug that regular files could not be created by mknod 2022-06-29 16:56:19 +09:00
Andrew Gaul 4bec68713a
Add CSI for S3 to references (#1971) 2022-06-28 22:56:12 +09:00
Andrew Gaul 8b90cd6ba1
Enable notsup_compat_dir by default (#1970)
Few applications create the dir_$folder$ objects and users can enable
compat_dir if required.  This commit reduces readdir latency by 33%.
Also remove notsup_compat_dir from tests since these directories are
never created.  Fixes #927.  References #1643.
2022-06-28 07:56:06 +09:00
Andrew Gaul ac72bf34dd
Run test_external_directory_creation for all flags (#1969) 2022-06-28 07:50:24 +09:00
Andrew Gaul a282cb7a84
Update CI runners to Fedora 36 and Ubuntu 22.04 (#1965)
Also remove Debian stretch which is no longer supported by LTS.
2022-06-22 17:40:08 +09:00
Andrew Gaul b52f916af6
Avoid extended initializer lists in C++03 (#1960)
C++11 introduces these.
2022-06-12 23:52:16 +09:00
Takeshi Nakatani ec7810f08e Fixed a bug could not change the mode while the file was opened 2022-06-12 13:48:42 +09:00
Andrew Gaul 904682b856
Fix double-iteration in curl_slist_remove (#1951)
Also backfill tests.  Fixes #1948.
2022-05-27 22:56:20 +09:00
Takeshi Nakatani 92fd5bc3e1
Fixed errors reported by cppcheck 2.8 (#1949) 2022-05-26 01:48:53 +09:00
Takeshi Nakatani d75c6d6538
Changed the message level(ERR to INFO) of skip cleanup cache (#1946) 2022-05-22 14:36:56 +09:00
Takeshi Nakatani a30beded1c Removed unnecessary debug options for aws command 2022-04-22 22:36:06 +09:00
Takeshi Nakatani df7bbb28d5 Replace awscli version 1 to 2 2022-04-19 23:11:25 +09:00
Andrew Gaul dc40f16161
Upgrade to S3Proxy 2.0.0 (#1929)
Release notes:

https://github.com/gaul/s3proxy/releases/tag/s3proxy-2.0.0

This enables Java 17 compatibility.
2022-04-04 23:03:16 +09:00
Andrew Gaul 1abfb7e965
Reference docker-s3fs-client (#1925) 2022-03-21 20:44:07 +09:00
Andrew Gaul d2d75787d2
Specify bash strictness options (#1924) 2022-03-12 17:01:27 +09:00
Andrew Gaul 5c57e17b77
Enable noobj_cache by default (#1922)
This should improve performance in many situations.  s3fs already
enables the stat cache by default so memorizing noobj makes this more
consistent.  Fixes #1901.
2022-03-12 16:57:31 +09:00
Andrew Gaul deaa85c40e
Document glacier_ir storage class (#1921)
Announcement:
https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-s3-glacier-instant-retrieval-storage-class/

This does not require code changes due to
bbcccd6e98.
2022-03-12 16:20:38 +09:00
Andrew Gaul 49d92c7022
Update ChangeLog and configure.ac for 1.91 (#1920)
Fixes #1876.
2022-03-08 07:48:15 +09:00
Takeshi Nakatani d842d45b2b Fixed a bug about truncation for shrinking file 2022-03-02 22:41:10 +09:00
Takeshi Nakatani 684ced5a41 Changed handling the credential in S3fsCred more robust 2022-03-02 22:39:15 +09:00
Carsten Grohmann afb0897553 Typos 2022-02-24 19:15:00 +09:00
Andrew Gaul 8a5c4306f5
Preserve sub-second precision where possible (#1915) 2022-02-23 23:58:51 +09:00
Andrew Gaul 01e24967b6
Add test for external object creation (#1900)
This test demonstrates the behavior before and after the stat cache
timeout when using noobj_cache.
2022-02-23 23:34:58 +09:00
Andrew Gaul 08adffd2fe
Fix typos (#1916) 2022-02-23 23:31:52 +09:00
Andrew Gaul 0842c5718f
Use more new file names for every test (#1902)
This makes the tests more robust.  Also fix filename to end in .txt.
2022-02-23 22:59:21 +09:00
Takeshi Nakatani 5452e9cb10 Dynamically generate dates for man page file 2022-02-23 21:51:47 +09:00
Andrew Gaul 232ff28cc7
Re-re-fix propagating the return code (#1903)
Previously the integration tests were exiting after the first failed
test instead of running all of them an reporting their statuses.
Follows on to dbf93c0152.
2022-02-23 14:27:29 +09:00
Andrew Gaul 81ed2bd91e
Propagate deferred exit status from main (#1912)
Previously s3fs always returned zero when the bucket did not mount.
Fixes #1911.
2022-02-23 10:09:12 +09:00
Andrew Gaul 305d660e39
Use custom CA bundle instead of ignoring errors (#1910)
Fixes #1846.
2022-02-23 10:04:05 +09:00
Carsten Grohmann a716c72d37 Update notsup_compat_dir in --help 2022-02-21 19:29:15 +09:00
Andrew Gaul 302150b4f5
Filter mountpoints via mount -t (#1905)
This is portable between Linux and macOS.
2022-02-20 20:49:35 +09:00
Andrew Gaul 3fa03d4e1e
Pass explicit -p option to ps (#1904)
This ensures that a pid follows.
2022-02-20 20:40:29 +09:00
Takeshi Nakatani e014d6e646 Changed Rocky Linux 8 instead of CentOS 8 2022-02-20 19:29:34 +09:00
Carsten Grohmann c2a49b7b1a Rephrase the description of notsup_compat_dir 2022-02-20 16:06:57 +09:00
Carsten Grohmann 265fa9e47a Add performance considerations section to man page 2022-02-20 16:06:57 +09:00
Takeshi Nakatani d31cbda7b6 Fixed a bug about checking credential 2022-02-19 23:22:15 +09:00
Takeshi Nakatani b64dc7749c Moved parameter analysis processing to S3fsCred class 2022-02-19 17:23:40 +09:00
Takeshi Nakatani b9e2be5c21 Fixed two typos in configure.ac 2022-02-19 17:22:43 +09:00
Takeshi Nakatani 839a33de49
Fixed not to call Flush even if the file size is increased (#1887)
Changed s3fs_truncate function.
This change reduces the number of file uploads if the file size is changed.

On macOS, I have found that the truncate call when "size=0" cannot reflect the file size.(This reason is not understood...)
To avoid this, only when "size=0", the flush method is called as before.

Other than that, I found a bug in FdEntity::Open() and fixed it.

Fixes #1875.
2022-02-15 21:29:07 +09:00
Petr Vaněk 4dfe2bfdd7 Include climits to support musl libc
PATH_MAX constant is not visible from any of currently included header
files in system with musl libc, where compilation fails with an error
below. The constant is defined in limits.h which is directly include via
climits header file.

fdcache.cpp: In static member function 'static FILE* FdManager::MakeTempFile()':
fdcache.cpp:381:14: error: 'PATH_MAX' was not declared in this scope
  381 |     char cfn[PATH_MAX];
      |              ^~~~~~~~

Fixes: d67b83e671 ("Allow configuration for temporary files directory")
2022-02-14 09:19:30 +09:00