Andrew Gaul
8b90cd6ba1
Enable notsup_compat_dir by default ( #1970 )
...
Few applications create the dir_$folder$ objects and users can enable
compat_dir if required. This commit reduces readdir latency by 33%.
Also remove notsup_compat_dir from tests since these directories are
never created. Fixes #927 . References #1643 .
2022-06-28 07:56:06 +09:00
Andrew Gaul
ac72bf34dd
Run test_external_directory_creation for all flags ( #1969 )
2022-06-28 07:50:24 +09:00
Andrew Gaul
a282cb7a84
Update CI runners to Fedora 36 and Ubuntu 22.04 ( #1965 )
...
Also remove Debian stretch which is no longer supported by LTS.
2022-06-22 17:40:08 +09:00
Andrew Gaul
b52f916af6
Avoid extended initializer lists in C++03 ( #1960 )
...
C++11 introduces these.
2022-06-12 23:52:16 +09:00
Takeshi Nakatani
ec7810f08e
Fixed a bug could not change the mode while the file was opened
2022-06-12 13:48:42 +09:00
Andrew Gaul
904682b856
Fix double-iteration in curl_slist_remove ( #1951 )
...
Also backfill tests. Fixes #1948 .
2022-05-27 22:56:20 +09:00
Takeshi Nakatani
92fd5bc3e1
Fixed errors reported by cppcheck 2.8 ( #1949 )
2022-05-26 01:48:53 +09:00
Takeshi Nakatani
d75c6d6538
Changed the message level(ERR to INFO) of skip cleanup cache ( #1946 )
2022-05-22 14:36:56 +09:00
Takeshi Nakatani
a30beded1c
Removed unnecessary debug options for aws command
2022-04-22 22:36:06 +09:00
Takeshi Nakatani
df7bbb28d5
Replace awscli version 1 to 2
2022-04-19 23:11:25 +09:00
Andrew Gaul
dc40f16161
Upgrade to S3Proxy 2.0.0 ( #1929 )
...
Release notes:
https://github.com/gaul/s3proxy/releases/tag/s3proxy-2.0.0
This enables Java 17 compatibility.
2022-04-04 23:03:16 +09:00
Andrew Gaul
1abfb7e965
Reference docker-s3fs-client ( #1925 )
2022-03-21 20:44:07 +09:00
Andrew Gaul
d2d75787d2
Specify bash strictness options ( #1924 )
2022-03-12 17:01:27 +09:00
Andrew Gaul
5c57e17b77
Enable noobj_cache by default ( #1922 )
...
This should improve performance in many situations. s3fs already
enables the stat cache by default so memorizing noobj makes this more
consistent. Fixes #1901 .
2022-03-12 16:57:31 +09:00
Andrew Gaul
deaa85c40e
Document glacier_ir storage class ( #1921 )
...
Announcement:
https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-s3-glacier-instant-retrieval-storage-class/
This does not require code changes due to
bbcccd6e98
2022-03-12 16:20:38 +09:00
Andrew Gaul
49d92c7022
Update ChangeLog and configure.ac for 1.91 ( #1920 )
...
Fixes #1876 .
2022-03-08 07:48:15 +09:00
Takeshi Nakatani
d842d45b2b
Fixed a bug about truncation for shrinking file
2022-03-02 22:41:10 +09:00
Takeshi Nakatani
684ced5a41
Changed handling the credential in S3fsCred more robust
2022-03-02 22:39:15 +09:00
Carsten Grohmann
afb0897553
Typos
2022-02-24 19:15:00 +09:00
Andrew Gaul
8a5c4306f5
Preserve sub-second precision where possible ( #1915 )
2022-02-23 23:58:51 +09:00
Andrew Gaul
01e24967b6
Add test for external object creation ( #1900 )
...
This test demonstrates the behavior before and after the stat cache
timeout when using noobj_cache.
2022-02-23 23:34:58 +09:00
Andrew Gaul
08adffd2fe
Fix typos ( #1916 )
2022-02-23 23:31:52 +09:00
Andrew Gaul
0842c5718f
Use more new file names for every test ( #1902 )
...
This makes the tests more robust. Also fix filename to end in .txt.
2022-02-23 22:59:21 +09:00
Takeshi Nakatani
5452e9cb10
Dynamically generate dates for man page file
2022-02-23 21:51:47 +09:00
Andrew Gaul
232ff28cc7
Re-re-fix propagating the return code ( #1903 )
...
Previously the integration tests were exiting after the first failed
test instead of running all of them an reporting their statuses.
Follows on to dbf93c0152
2022-02-23 14:27:29 +09:00
Andrew Gaul
81ed2bd91e
Propagate deferred exit status from main ( #1912 )
...
Previously s3fs always returned zero when the bucket did not mount.
Fixes #1911 .
2022-02-23 10:09:12 +09:00
Andrew Gaul
305d660e39
Use custom CA bundle instead of ignoring errors ( #1910 )
...
Fixes #1846 .
2022-02-23 10:04:05 +09:00
Carsten Grohmann
a716c72d37
Update notsup_compat_dir in --help
2022-02-21 19:29:15 +09:00
Andrew Gaul
302150b4f5
Filter mountpoints via mount -t ( #1905 )
...
This is portable between Linux and macOS.
2022-02-20 20:49:35 +09:00
Andrew Gaul
3fa03d4e1e
Pass explicit -p option to ps ( #1904 )
...
This ensures that a pid follows.
2022-02-20 20:40:29 +09:00
Takeshi Nakatani
e014d6e646
Changed Rocky Linux 8 instead of CentOS 8
2022-02-20 19:29:34 +09:00
Carsten Grohmann
c2a49b7b1a
Rephrase the description of notsup_compat_dir
2022-02-20 16:06:57 +09:00
Carsten Grohmann
265fa9e47a
Add performance considerations section to man page
2022-02-20 16:06:57 +09:00
Takeshi Nakatani
d31cbda7b6
Fixed a bug about checking credential
2022-02-19 23:22:15 +09:00
Takeshi Nakatani
b64dc7749c
Moved parameter analysis processing to S3fsCred class
2022-02-19 17:23:40 +09:00
Takeshi Nakatani
b9e2be5c21
Fixed two typos in configure.ac
2022-02-19 17:22:43 +09:00
Takeshi Nakatani
839a33de49
Fixed not to call Flush even if the file size is increased ( #1887 )
...
Changed s3fs_truncate function.
This change reduces the number of file uploads if the file size is changed.
On macOS, I have found that the truncate call when "size=0" cannot reflect the file size.(This reason is not understood...)
To avoid this, only when "size=0", the flush method is called as before.
Other than that, I found a bug in FdEntity::Open() and fixed it.
Fixes #1875 .
2022-02-15 21:29:07 +09:00
Petr Vaněk
4dfe2bfdd7
Include climits to support musl libc
...
PATH_MAX constant is not visible from any of currently included header
files in system with musl libc, where compilation fails with an error
below. The constant is defined in limits.h which is directly include via
climits header file.
fdcache.cpp: In static member function 'static FILE* FdManager::MakeTempFile()':
fdcache.cpp:381:14: error: 'PATH_MAX' was not declared in this scope
381 | char cfn[PATH_MAX];
| ^~~~~~~~
Fixes: d67b83e671
2022-02-14 09:19:30 +09:00
Takeshi Nakatani
1678803566
Added S3fsCred class and moved Credential related processing in it
2022-02-13 21:38:30 +09:00
Takeshi Nakatani
d7e929e0a8
Fixed some Github Actions errors. ( #1886 )
...
- Fix knownConditionTrueFalse cppcheck(2.7) error on MacOS
- Fixed package installing failure of appstream download on centos8
2022-02-13 14:23:35 +09:00
Takeshi Nakatani
94e8e23eef
Fixed test_external_directory_creation test when cache enabled ( #1885 )
2022-02-13 13:32:19 +09:00
Andrew Gaul
dbf93c0152
Propagate return code properly ( #1884 )
...
Previously this did not propagate test failures. A bad rebase
introduced this logic in 495d51113c
2022-02-06 22:45:20 +09:00
Andrew Gaul
9224f792f0
Use CLOCK_REALTIME for UTIME_NOW ( #1881 )
...
Previously s3fs_utimens used CLOCK_MONOTONIC_COARSE which was not
1970-based. Found via pjdfstest. References #1589 .
2022-01-30 22:19:15 +09:00
Andrew Gaul
f6ed972926
Always flush open files with O_CREAT flag ( #1879 )
...
Previously s3fs only created files that had dirty data and not those
with zero-bytes. Regression from
771bbfeac5#1013 . Found
via pjdfstest. References #1589 .
2022-01-30 22:02:37 +09:00
Andrew Gaul
0c75a63184
Preserve sub-second precision with utimens ( #1880 )
...
Found via pjdfstest. References #1589 .
2022-01-30 21:45:51 +09:00
Takeshi Nakatani
30cf7a50bb
Added stat check for subdir created with awscli
2022-01-30 18:31:36 +09:00
Takeshi Nakatani
e452ef3940
Fixed the fault tolerance when time stamp getting fails
2022-01-30 18:31:36 +09:00
Andrew Gaul
cd5a69b9eb
Handle UTIME_NOW and UTIME_OMIT special values ( #1868 )
...
FUSE 3 will require this behavior. References #1159 .
2022-01-29 11:35:37 +09:00
Andrew Gaul
74c11ef226
Check bucket before trying to create it ( #1874 )
...
This makes it easier to run tests against S3 other than S3Proxy.
2022-01-26 23:42:12 +09:00
Andrew Gaul
662882d2f0
Always call clock_gettime(2) ( #1871 )
...
e01ded9e27https://stackoverflow.com/a/39801564 . Also remove fallback to
time(3) which loses precision.
2022-01-25 08:36:27 +09:00
