octoleo/qpdf
2
1
Fork 0
mirror of https://github.com/qpdf/qpdf.git synced 2024-12-22 02:49:00 +00:00
Code Issues Releases Wiki Activity
b45e3420d6
qpdf/ChangeLog

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

4882 lines
190 KiB
Plaintext
Raw Normal View History

Prepare 11.9.1 release
2024-06-07 12:15:26 +00:00
2024-06-07 Jay Berkenbilt <ejb@ql.org>
* 11.9.1: release
2024-06-06 Jay Berkenbilt <ejb@ql.org>
* Rewrite a recursive function to be iterative in linearization to
enable more complex files to be linearized, especially on Windows.
2024-02-24 Jay Berkenbilt <ejb@ql.org>
* Avoid non-standard use of `std::basic_string_view`. Contribution
from Zoe Clifford.
Prepare 11.9.0 release
2024-02-24 15:38:04 +00:00
2024-02-24 Jay Berkenbilt <ejb@ql.org>
* 11.9.0: release
Add ENABLE_COVERAGE option to build
2024-02-17 19:52:06 +00:00
2024-02-17 Jay Berkenbilt <ejb@ql.org>
* Add ENABLE_COVERAGE cmake option to assist with generating
coverage reports.
* From M. Holger: add QPDFObjectHandle::writeJSON to directly
write a JSON representation to a pipeline. This is much faster
than writing the serialized result of getJSON.
Fix previous fix to setting checkbox value (fixes #1056) The code accepted values other than /Yes but still used /Yes as the checked value instead of obeying the normal appearance dictionary.
2024-02-11 20:32:02 +00:00
2024-02-11 Jay Berkenbilt <ejb@ql.org>
* The previous fix to #1056 was incomplete. When setting a check
box value, the previous fix allowed any value other than /Off to
mean checked. Now we also set the actual value based on the
allowable non-/Off value in the normal appearance dictionary.
Fixes #1056.
Add json fuzzer with seed files from #1123 and test suite ...as well as some cases generated in CI from earlier attempts at fixing this.
2024-02-04 21:00:36 +00:00
2024-02-03 Jay Berkenbilt <ejb@ql.org>
* Add fuzz testing for JSON.
ChangeLog from last PR
2024-01-15 16:08:25 +00:00
2024-01-15 Jay Berkenbilt <ejb@ql.org>
* Add JSON::getDictItem (from m-holger)
Honor repeated overlay/underlay
2024-01-10 21:07:47 +00:00
2024-01-10 Jay Berkenbilt <ejb@ql.org>
* Allow --overlay and --underlay to be repeated. They may appear
multiple times on the command-line and will be stacked in the
order in which they appear. In QPDFJob JSON, the overlay and
underlay keys may contain arrays. For compatibility, they may also
contain a single dictionary.
Allow --file with --overlay and --underlay
2024-01-09 18:25:04 +00:00
2024-01-09 Jay Berkenbilt <ejb@ql.org>
* Add new command-line arguments --file and --range which can be
used within --pages in place of positional arguments. Allow --file
to be used inside of --overlay and --underlay as well. These new
options can be freely intermixed with positional arguments. Also
add file(), range(), and password() to QPDFJob::PagesConfig as an
alternative to pageSpec.
Prepare 11.8.0 release
2024-01-07 22:39:38 +00:00
2024-01-08 Jay Berkenbilt <ejb@ql.org>
* 11.8.0: release
Bug fix: treat old generations of reused objects as null
2024-01-07 22:05:35 +00:00
2024-01-07 Jay Berkenbilt <ejb@ql.org>
* Bug fix: treat references to older generations of objects as
null.
Attempt to find xref streams during recovery (fixes #1103)
2024-01-06 21:51:03 +00:00
2024-01-06 Jay Berkenbilt <ejb@ql.org>
* When recovering a file's xref table, attempt to find xref
streams if a traditional trailer dictionary is not found. Fixes
#1103.
Implement --set-page-labels and supporting API (fixes #939)
2024-01-05 21:11:09 +00:00
2024-01-05 Jay Berkenbilt <ejb@ql.org>
* Add --set-page-labels command-line argument and supporting API.
Fixes #939.
- QPDFJob::Config::setPageLabels
- pdf_page_label_e enumerated type
- QPDFPageLabelDocumentHelper::pageLabelDict
Support excluding values from numeric ranges (fixes #564, #790)
2024-01-01 15:14:01 +00:00
2024-01-01 Jay Berkenbilt <ejb@ql.org>
Support comma-separated numeric values with --collate (fixes #505)
2024-01-01 23:55:45 +00:00
* Support comma-separated numeric values with --collate to select
different group sizes from different files. Fixes #505.
Support excluding values from numeric ranges (fixes #564, #790)
2024-01-01 15:14:01 +00:00
* Support "x" before a group in a numeric range to exclude a group
Support comma-separated numeric values with --collate (fixes #505)
2024-01-01 23:55:45 +00:00
from the previous group. Details are in the manual. Fixes #564,
#790.
Support excluding values from numeric ranges (fixes #564, #790)
2024-01-01 15:14:01 +00:00
Preserve annotations that inherently lack appearance (fixes #1039) ...when flattening annotations. This includes /Link, /Popup, and /Projection.
2023-12-29 18:35:29 +00:00
2023-12-29 Jay Berkenbilt <ejb@ql.org>
* When flattening annotations, preserve annotations without any
appearance information at all, such as types /Link, /Popup, and
/Projection. Fixes #1039.
Detect overlong UTF-8 strings
2023-12-25 15:51:40 +00:00
2023-12-25 Jay Berkenbilt <ejb@ql.org>
* Detect overlong UTF-8 in the UTF-8 decoder, and fix detection of
8-bit characters in erroneous UTF-8 strings.
Prepare 11.7.0 release
2023-12-24 12:16:58 +00:00
2023-12-24 Jay Berkenbilt <ejb@ql.org>
* 11.7.0: release
Implement --disable-signatures (fixes #1015)
2023-12-23 13:44:42 +00:00
2023-12-23 Jay Berkenbilt <ejb@ql.org>
Have Windows installers modify PATH (fixes #1054)
2023-12-23 13:58:16 +00:00
* Define CPACK_NSIS_MODIFY_PATH for the Windows builds so the
official installers will offer to modify PATH when installing
qpdf. Fixes #1054.
Remove --disable-signatures; incorporate into --remove-restrictions Rather than adding yet another flag that is almost never useful on its own, just have --remove-restrictions disable digital signatures. The operations are still separate in the API.
2023-12-24 12:12:32 +00:00
* Add QPDFAcroFormDocumentHelper::disableDigitalSignatures, which
disables any digital signature fields, leaving their visual
representations intact. The --remove-restrictions command-line
argument now calls this. Fixes #1015.
Implement --disable-signatures (fixes #1015)
2023-12-23 13:44:42 +00:00
Allow other than /Yes and /Off in a check box (fixes #1056)
2023-12-22 19:42:16 +00:00
2023-12-22 Jay Berkenbilt <ejb@ql.org>
Generate a UNIX man page (fixes #874)
2023-12-23 02:03:47 +00:00
* Generate a more complete qpdf "man page" from the same source as
Close UNIX man page issue (fixes #1064) The commit was assigned to the previously fixed issue by mistake.
2023-12-23 02:48:16 +00:00
qpdf --help. Fixes #1064.
Generate a UNIX man page (fixes #874)
2023-12-23 02:03:47 +00:00
Implement new --encrypt args and completion (fixes #784) Positional arguments are supported in a backward-compatible way, but completion no longer guides users to it.
2023-12-22 23:14:11 +00:00
* Allow the syntax "--encrypt --user-password=user-password
--owner-password=owner-password --bits={40,128,256}" when
encrypting PDF files. This is an alternative to the syntax
"--encrypt user-password owner-password {40,128,256}", which will
continue to be supported. The new syntax works better with shell
completion and allows creation of passwords that start with "-".
Fixes #874.
Allow other than /Yes and /Off in a check box (fixes #1056)
2023-12-22 19:42:16 +00:00
* When setting a check box value, allow any value other than /Off
to mean checked. This is permitted by the spec. Previously, any
value other than /Yes or /Off was rejected. Fixes #1056.
Tweak comment in QPDFParser refactor
2023-12-21 20:45:34 +00:00
2023-12-21 Jay Berkenbilt <ejb@ql.org>
Convert scientific notation in JSON to fixed point (fixes #1079) JSON accepts scientific notation, but PDF doesn't.
2023-12-21 22:38:49 +00:00
* Fix to QPDF JSON: a floating point number that appears in
scientific notation will be converted to fixed-point notation,
rounded to six digits after the decimal point. Fixes #1079.
Add "n:/pdf-name" to qpdf JSON for binary names (fixes #1072)
2023-12-21 22:14:28 +00:00
* Fix to QPDF JSON: the syntax "n:/pdf-syntax" is now accepted as
an alternative way to represent names. This can be used for any
name (e.g. "n:/text#2fplain"), but it is necessary when the name
contains binary characters. For example, /one#a0two must be
represented as "n:/one#a0two" since the single byte a0 is not
valid in JSON. Fixes #1072.
Tweak comment in QPDFParser refactor
2023-12-21 20:45:34 +00:00
* From M. Holger: Refactor QPDFParser for performance. See #1059
for a discussion.
Bug fix: don't compress object/xref streams with --compress-streams=n
2023-12-20 15:51:56 +00:00
2023-12-20 Jay Berkenbilt <ejb@ql.org>
Update documentation on zlib compatibility
2023-12-20 19:16:39 +00:00
* Update code and tests so that qpdf's test suite no longer
depends on the output of any specific zlib implementation. This
makes it possible to get a fully passing test suite with any
API-compatible zlib library. CI tests with the default zlib as
well as zlib-ng (including verifying that zlib-ng is not the
default), but any zlib implementation should work. Fixes #774.
Bug fix: don't compress hint streams when --compress-streams=n
2023-12-20 16:08:36 +00:00
* Bug fix: with --compress-streams=n, don't compress object, XRef,
or linearization hint streams.
Bug fix: don't compress object/xref streams with --compress-streams=n
2023-12-20 15:51:56 +00:00
Allow regular C++ functions to interoperate with the C API
2023-12-16 14:46:44 +00:00
2023-12-16 Jay Berkenbilt <ejb@ql.org>
* Add new C++ functions "qpdf_c_get_qpdf" and "qpdf_c_wrap" to
qpdf-c.h that make it possible to write your own extern "C"
functions in C++ that interoperate with the C API. See
examples/extend-c-api for more information.
Add ChangeLog for previous pull requests
2023-12-21 19:53:35 +00:00
* Bug fix from M. Holger: the default for /Columns in PNG filter
is 1, but libqpdf was acting like it was 0.
* Enhancement from M. Holger: add methods to Buffer to work more
easily with std::string.
Prepare 11.6.4 release
2023-12-10 16:23:10 +00:00
2023-12-10 Jay Berkenbilt <ejb@ql.org>
* 11.6.4: release
Install cmake files with dev component
2023-12-09 11:25:30 +00:00
2023-12-09 Jay Berkenbilt <ejb@ql.org>
* Install fix: include cmake files with the dev component.
Build AppImage and linux binary using Ubuntu 18.04 (fixes #1068) This is needed to get an old enough version of glibc to run the Linux binary as an AWS Lambda layer and to support some versions of CentOS.
2023-11-20 16:01:27 +00:00
2023-11-20 Jay Berkenbilt <ejb@ql.org>
* Build AppImage with an older Linux distribution to support AWS
Lambda. Fixes #1086.
Prepare 11.6.3 release
2023-10-14 23:49:29 +00:00
2023-10-15 Jay Berkenbilt <ejb@ql.org>
* 11.6.3: release
Don't lose character after \d or \dd parsing string (fixes #1050)
2023-10-14 21:04:58 +00:00
2023-10-14 Jay Berkenbilt <ejb@ql.org>
Write offsets as unsigned in linearization hint tables (fixes #1023)
2023-10-14 22:03:34 +00:00
* Tweak linearization code to better handle files between 2 GB and
4 GB in size. Fixes #1023.
Prepare 11.6.3 release
2023-10-14 23:49:29 +00:00
* Fix data loss bug: qpdf could discard a the character after an
escaped octal string consisting of less than three digits. For
content, this would only happen with QDF or when normalizing
content. Outside of content, it could have happened in any binary
string, such as /ID, if the encoding software used octal escape
strings with less than three digits. This bug was introduced
between 10.6.3 and 11.0.0. Fixes #1050.
Don't lose character after \d or \dd parsing string (fixes #1050)
2023-10-14 21:04:58 +00:00
Fix error with stream recovery (fixes #1042)
2023-10-07 17:29:10 +00:00
2023-10-07 Jay Berkenbilt <ejb@ql.org>
Prepare 11.6.2 release
2023-10-07 21:47:09 +00:00
* 11.6.2: release
Fix error with stream recovery (fixes #1042)
2023-10-07 17:29:10 +00:00
* Bug fix: when piping stream data, don't call finish on failure
if the failure was caused by a previous call to finish. Fixes
#1042.
ChangeLog: mention sharing .idea files
2023-10-07 17:30:48 +00:00
* Push .idea directory with the beginning of a sharable JetBrains
CLion configuration.
Prepare 11.6.1 release
2023-09-05 17:59:15 +00:00
2023-09-05 Jay Berkenbilt <ejb@ql.org>
* 11.6.1: release
* Fix a logic error introduced in 11.6.0 in the fix to
copyForeignObject. The bug could result in some pages not being
copied.
Move random number device check to runtime (fixes #1022) Having it at compile time breaks cross-compilation and isn't really right anyway.
2023-09-03 13:35:28 +00:00
2023-09-03 Jay Berkenbilt <ejb@ql.org>
Prepare 11.6.0 release
2023-09-03 18:07:17 +00:00
* 11.6.0: release
ascii85: ignore whitespace between ~ and > (fixes #973)
2023-09-03 17:56:02 +00:00
* ascii85 parser: ignore spaces everywhere including between ~
and >. Fixes #973.
Restore accidentally deleted ChangeLog entry
2023-09-03 17:16:49 +00:00
* Bug fix: with --pages, if one of the external files had warnings
but the main file did not, the warning was previously not taken
into consideration when determining the exit status.
Quote program name in completion output (fixes #1021)
2023-09-03 14:13:02 +00:00
* Put quotation marks around the command in completion output to
better handle spaces in paths. It is not a perfect fix (ideally,
full shell-compatible quoting should be used), but it handles more
cases than the old code and should handle all reasonable cases of
qpdf being in a directory with a space in its name, which is
common in Windows. Fixes #1021.
Move random number device check to runtime (fixes #1022) Having it at compile time breaks cross-compilation and isn't really right anyway.
2023-09-03 13:35:28 +00:00
* Move check for random number device to runtime instead of
compile time. Since, by default, the crypto provider provides
Spell check
2023-09-03 18:06:38 +00:00
random numbers, runtime determination of a random number device is
usually not needed. Fixes #1022.
Move random number device check to runtime (fixes #1022) Having it at compile time breaks cross-compilation and isn't really right anyway.
2023-09-03 13:35:28 +00:00
Add test cases for fix-qpdf from pipe
2023-09-02 19:23:52 +00:00
2023-09-02 Jay Berkenbilt <ejb@ql.org>
Tweak ChangeLog wording
2023-09-03 17:14:56 +00:00
* Maintain links to foreign pages when copying foreign objects.
This allows hyperlinks in imported files to work. Fixes #1003.
Add test cases for fix-qpdf from pipe
2023-09-02 19:23:52 +00:00
Tweak ChangeLog wording
2023-09-03 17:14:56 +00:00
* Bug fix: Return a null object if an attempt is made to to copy a
foreign /Pages object with copyForeignObject. This corrects a
possible crash. Fixes #1010.
* Bug fix: Return a null object if an attempt is made to to copy a
foreign /Pages object with copyForeignObject. Fixes #1003.
Add test cases for fix-qpdf from pipe
2023-09-02 19:23:52 +00:00
* Add /MediaBox to a page if absent. Thanks M. Holger.
* Use std::vector internally for Pl_Buffer to
avoid incompatibility with C++20. Thanks to Zoe Clifford. Fixes #1024.
Update ChangeLog and release notes
2023-07-09 13:51:18 +00:00
2023-07-09 Jay Berkenbilt <ejb@ql.org>
Prepare 11.5.0 release
2023-07-09 14:00:51 +00:00
* 11.5.0: release
Update ChangeLog and release notes
2023-07-09 13:51:18 +00:00
* This release consists entirely of changes made by M. Holger.
Mostly this is changes to the private API, performance
enhancements, code cleanup, and reformatting to 100 columns
instead of 80. For qpdf development, we are starting to use
JetBrains CLion, so a lot of the changes are moving us toward a
cleaner development experience in that environment.
2023-06-15 Jay Berkenbilt <ejb@ql.org>
* Bug fix: when a the same page is copied multiple times, copy
the annotations rather than having multiple pages share an
annotation object. Thanks to M. Holger for the fix. Fixes #600.
2023-06-14 Jay Berkenbilt <ejb@ql.org>
* Add "FUTURE" build option for enabling experimental APIs. Do not
package qpdf built with the FUTURE option as there are no binary
compatibility or even source compatibility guarantees. The option
is intended for developers who want to ensure that future
potentially breaking changes are compatible with their code or
provide feedback on upcoming changes. At present, the only feature
enabled by FUTURE is a move constructor for QPDFObjectHandle.
While this shouldn't break any code, it would change details about
how many copies of a specific QPDFObjectHandle were in existence,
so it could potentially break code that was relying on internal
shared pointer reference counts. Thanks to M. Holger for the idea
and contribution.
2023-05-25 Jay Berkenbilt <ejb@ql.org>
* Add new method Buffer::copy and deprecate Buffer copy
constructor and assignment operator. Buffer copy operations are
expensive as they always involve copying the buffer content. Use
"buffer2 = buffer1.copy();" or "Buffer buffer2{buffer1.copy()};"
to make it explicit that copying is intended. This change was
contributed by M. Holger.
Prepare 11.4.0 release
2023-05-21 18:42:37 +00:00
2023-05-21 Jay Berkenbilt <ejb@ql.org>
* 11.4.0: release
Add ChangeLog and release notes for last change
2023-05-20 19:31:33 +00:00
2023-05-20 Jay Berkenbilt <ejb@ql.org>
* From M. Holger: add QPDF::newReserved as a better alternative to
QPDFObjectHandle::newReserved. The operation of creating a new
reserved object fits better in the QPDF API. The old call just
delegates to the new one.
Disregard appearance state when irrelevant (fixes #949) If /AP is a dictionary of streams rather than a dictionary of dictionaries, disregard /AS, which is supposed to point to a subkey of one of the dictionaries. This fix prevents qpdf's annotation flattening from discarding some annotations when /AS is erroneously set.
2023-05-13 20:27:07 +00:00
2023-05-13 Jay Berkenbilt <ejb@ql.org>
* When an annotation dictionary's appearance dictionary (`/AP`)
has a key that is a stream, disregard `/AS` (which is supposed to
point to a subkey). This enables qpdf to not ignore annotations
that have incorrect values for `/AS` when the appearance stream is
directly in the `/AP` dictionary instead of in a subkey. Fixes
#949.
Add release notes and ChangeLog for previous PR
2023-05-13 20:26:32 +00:00
2023-04-02 Jay Berkenbilt <ejb@ql.org>
* Allow QPDFJob's workflow to be split into a reading phase and a
writing phase to allow the caller to operate on the QPDF object
before it is written. This adds methods QPDFJob::createQPDF and
QPDFJob::writeQPDF and corresponding C API functions
qpdfjob_create_qpdf and qpdfjob_write_qpdf. Thanks to M. Holger
Spell check
2023-05-21 18:25:31 +00:00
for the contribution.
Add release notes and ChangeLog for previous PR
2023-05-13 20:26:32 +00:00
Prepare 11.4.0 release
2023-05-21 18:42:37 +00:00
2023-04-01 Jay Berkenbilt <ejb@ql.org>
* From M. Holger: throw a logic error if an uninitialized or
foreign QPDFObjectHandle is added to an array.
Add ChangeLog and release notes for previous fix (fixes #923)
2023-03-18 19:38:31 +00:00
2023-03-18 Jay Berkenbilt <ejb@ql.org>
* Enhance --optimize-images to support images nested inside of
form XObjects. Thanks to Connor Osborne (github user cdosborn) for
the contribution. Fixes #923.
Overlay/underlay: capture origial page as form XObject (fixes #904)
2023-02-25 17:55:47 +00:00
2023-02-25 Jay Berkenbilt <ejb@ql.org>
Prepare 11.3.0 release
2023-02-25 21:24:41 +00:00
* 11.3.0: release
Overlay/underlay: capture origial page as form XObject (fixes #904)
2023-02-25 17:55:47 +00:00
* When performing overlay or underlay operations, convert the
Spell check
2023-02-25 19:19:38 +00:00
original page to a form XObject instead of simply isolating its
Overlay/underlay: capture origial page as form XObject (fixes #904)
2023-02-25 17:55:47 +00:00
contents with q/Q operators. This prevents unbalanced q/Q
operators in any of the original pages from messing up the
graphics state of anything that is overlaid on top of it. Fixes
#904.
Handle linearization warnings as proper warning (fixes #851)
2023-02-19 00:37:38 +00:00
2023-02-18 Jay Berkenbilt <ejb@ql.org>
* Treat all linearization errors and warnings as warnings, and
issue them through the normal warning system using the new error
code qpdf_e_linearization. That means that --no-warn will suppress
them, and the file name is included in the warning. Fixes #851.
Implement --remove-restrictions (fixes #833)
2023-01-28 18:41:58 +00:00
2023-01-28 Jay Berkenbilt <ejb@ql.org>
* New option --remove-restrictions removes security restrictions
from digitally signed files. Fixes #833.
Fix annotations properly for page with no /Resources (fixes #827)
2023-01-09 12:31:39 +00:00
2023-01-09 Jay Berkenbilt <ejb@ql.org>
* Bug fix: flatten annotations should handle a page with no
/Resources key. Fixes #827.
Fix release notes and ChangeLog for 11.2
2022-11-20 20:33:13 +00:00
2022-11-20 Jay Berkenbilt <ejb@ql.org>
Prepare 11.2.0 release
2022-11-20 20:33:34 +00:00
* 11.2.0: release
Fix release notes and ChangeLog for 11.2
2022-11-20 20:33:13 +00:00
* Add a few convenience methods to QPDFTokenizer::Token for
checking token types. thanks to M. Holger for the contribution.
* Add stream creation methods to the QPDF class as a better
alternative to the ones in the QPDFObjectHandle class. Thanks to
M. Holger for the contribution.
Correctly handle reuse of xref stream (fixes #809)
2022-11-19 21:01:54 +00:00
2022-11-19 Jay Berkenbilt <ejb@ql.org>
* Bug fix: handle special case of an earlier xref stream object's
object number being reused by an update made by appending the
file. Fixes #809.
Allow specific performance tests to be run
2022-10-08 20:10:15 +00:00
2022-10-08 Jay Berkenbilt <ejb@ql.org>
Fix major performance bug with openssl crypto (fixes #798) Lazily load MD5 and RC4 once in the life of the program. Only load the legacy provider if RC4 is actually being used.
2022-10-08 20:34:12 +00:00
* Fix major performance bug with the openssl crypto provider when
using OpenSSL 3. The legacy loader and rc4 algorithm was being
loaded with every call to the crypto provider instead of once in
the life of the program. Fixes #798.
Allow specific performance tests to be run
2022-10-08 20:10:15 +00:00
* performance_check: add --test option to limit which tests are
run.
Require a C++-17 compiler
2022-10-06 10:58:25 +00:00
2022-10-06 Jay Berkenbilt <ejb@ql.org>
* Change minimum required C++ version from C++-14 to C++-17.
Fix release notes and ChangeLog for 11.2
2022-11-20 20:33:13 +00:00
* Fix another symbol export issue with the MinGW build.
Prepare 11.1.1 release
2022-10-01 15:33:12 +00:00
2022-10-01 Jay Berkenbilt <ejb@ql.org>
* 11.1.1: release
2022-09-27 Jay Berkenbilt <ejb@ql.org>
* Bug fix: avoid having the AppImage discard the first argument
when renamed to one of the embedded executables. Fixes #789.
* Add AppImage-specific tests to CI. These test different
invocation styles and loading of the proper shared library.
Fix edge case in character encoding (fixes #778) Avoid representing as PDF Doc encoding any string whose PDF Doc encoding representation starts with a UTF-16 or UTF-8 marker.
2022-09-26 12:05:28 +00:00
2022-09-26 Jay Berkenbilt <ejb@ql.org>
* Bug fix: avoid using PDF Doc encoding for strings whose PDF Doc
encoding representation starts with UTF-16 or UTF-8 markers. Fixes
#778.
Prepare 11.1.1 release
2022-10-01 15:33:12 +00:00
2022-09-27 Jay Berkenbilt <ejb@ql.org>
* Add tests to CI for char being unsigned by default.
Force project includes before system includes (fixes #763) From time to time, someone has a problem because their build is grabbing an old version of qpdf header files that are installed somewhere on their system. I am hoping this will put an end to that.
2022-09-14 11:38:15 +00:00
2022-09-14 Jay Berkenbilt <ejb@ql.org>
Prepare 11.1.0 release
2022-09-14 14:49:18 +00:00
* 11.1.0: release
* Add notes to documentation clarifying that installing the dev
component usually requires the lib component to also be installed.
Force project includes before system includes (fixes #763) From time to time, someone has a problem because their build is grabbing an old version of qpdf header files that are installed somewhere on their system. I am hoping this will put an end to that.
2022-09-14 11:38:15 +00:00
* Set CMAKE_INCLUDE_DIRECTORIES_PROJECT_BEFORE ON in cmake to
(hopefully) solve the problem of older installed qpdf headers
interfering with building qpdf from source. Fixes #763.
Remove obsolete LL_FMT check from build (fixes #768) This was broken for cross-compilation and has probably been unnecessary for several years now. Also fix extraneous whitespace in related some tests.
2022-09-12 15:35:04 +00:00
2022-09-12 Jay Berkenbilt <ejb@ql.org>
Add some missing QPDF_DLL markers These markers are being added for nested classes that are already marked with QPDF_DLL_CLASS. They don't make any different on Linux, but they matter on Windows.
2022-09-12 17:13:33 +00:00
* Add some missing DLL exports that only affect the Windows build.
Remove obsolete LL_FMT check from build (fixes #768) This was broken for cross-compilation and has probably been unnecessary for several years now. Also fix extraneous whitespace in related some tests.
2022-09-12 15:35:04 +00:00
* Remove compile-time test for LL_FMT. It's unlikely that any
compiler new enough to build qpdf still doesn't support %lld.
Prepare 11.0.0 release
2022-09-10 13:46:09 +00:00
2022-09-10 Jay Berkenbilt <ejb@ql.org>
* 11.0.0: release
Add C API functions for using custom loggers Expose functions to the C API to create new loggers and to setLogger and getLogger for QPDF and QPDFJob.
2022-09-09 12:03:21 +00:00
2022-09-09 Jay Berkenbilt <ejb@ql.org>
Change QPDFObjectHandle == to isSameObjectAs Replace operator== and operator!=, which were testing for the same underlying object, with isSameObjectAs. This change was motivated by the fact that pikepdf internally had its own operator== method for QPDFObjectHandle that did structural comparison. I backed out qpdf's operator== as a courtesy to pikepdf (in my own testing) but also because I think people might naturally assume that operator== does a structural comparison, and isSameObjectAs is clearer in its intent.
2022-09-09 19:40:02 +00:00
* Add QPDFObjectHandle::isSameObjectAs to test whether two
QPDFObjectHandle objects point to the same underlying object.
Add C API functions for using custom loggers Expose functions to the C API to create new loggers and to setLogger and getLogger for QPDF and QPDFJob.
2022-09-09 12:03:21 +00:00
* Expose ability to create custom loggers and to get and set the
logger for QPDF and QPDFJob through the C API.
Create a special "destroyed" type rather than using null When a QPDF is destroyed, changing indirect objects to direct nulls makes them effectively disappear silently when they sneak into other places. Instead, we should treat this as an error. Adding a destroyed object type makes this possible.
2022-09-08 12:03:57 +00:00
2022-09-08 Jay Berkenbilt <ejb@ql.org>
Add JSON v2 support to C API
2022-09-08 19:57:33 +00:00
* Added new functions to the C API to support qpdf JSON:
qpdf_create_from_json_file, qpdf_create_from_json_data,
qpdf_update_from_json_file, qpdf_update_from_json_data, and
qpdf_write_json. Examples can be found in qpdf-ctest.c (in the
source tree), tests 42 through 47.
Create a special "destroyed" type rather than using null When a QPDF is destroyed, changing indirect objects to direct nulls makes them effectively disappear silently when they sneak into other places. Instead, we should treat this as an error. Adding a destroyed object type makes this possible.
2022-09-08 12:03:57 +00:00
* Add QPDFObjectHandle::isDestroyed() to test whether an indirect
object was from a QPDF that has been destroyed.
Revert getOwningQPDF, and add getQPDF that returns a reference
2022-09-07 15:29:17 +00:00
2022-09-07 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::getQPDF(), which returns a reference, as
an alternative to QPDFObjectHandle::getOwningQPDF().
Support --show-encryption without a valid password (fixes #598)
2022-09-06 15:18:56 +00:00
2022-09-06 Jay Berkenbilt <ejb@ql.org>
Clarify and improve QPDFPageObjectHelper::get*Box methods Add copy_if_fallback and explain how it differs from copy_if_shared.
2022-09-06 23:00:40 +00:00
* For all bounding box methods in QPDFPageObjectHelper other than
MediaBox, add a parameter `copy_if_fallback`, and add comments
explaining in depth exactly what copy_if_shared and
copy_if_fallback mean. Fixes #664.
* Add new methods getArtBox and getBleedBox to
QPDFPageObjectHelper, completing the set of bounding box methods.
Support --show-encryption without a valid password (fixes #598)
2022-09-06 15:18:56 +00:00
* The --show-encryption option now works even if a correct
password is not supplied. If you were using --show-encryption to
test whether you have the right password, use --requires-password
instead. Fixes #598.
Update formatting a documentation from last PR
2022-09-05 22:50:55 +00:00
2022-09-05 Jay Berkenbilt <ejb@ql.org>
* Add a move constructor to Buffer, making it possible to move
rather than copy the internal buffer. Thanks to jbarlow83 for the
contribution.
Disable copying/assigning to QPDF objects, add QPDF::create()
2022-09-02 12:53:27 +00:00
2022-09-02 Jay Berkenbilt <ejb@ql.org>
* Add new QPDF::create() factory method that returns
std::shared_ptr<QPDF>.
* Prevent copying/assigning to QPDF objects in the API. It has
never been safe to do this, but the API wasn't preventing it.
Update ChangeLog and Release Notes from previous pull requests
2022-09-01 19:40:49 +00:00
2022-09-01 Jay Berkenbilt <ejb@ql.org>
Remove QPDFObject::object_type_e as alias for qpdf_object_type_e
2022-09-01 21:39:52 +00:00
* Remove QPDFObject.hh from include/qpdf. The only reason to
include was to get QPDFObject::object_type_e. Instead, include
qpdf/Constants.h, and change `QPDFObject::ot_` to `::ot_`.
Update ChangeLog and Release Notes from previous pull requests
2022-09-01 19:40:49 +00:00
* More optimizations and cleanup from m-holger (#726, #730)
including major refactor of QPDF's internal representations of
objects. In addition to a large performance improvement, this also
made it possible for QPDFObjectHandle::getOwningQPDF() to return a
null pointer if the owning QPDF had been destroyed. (A more
complete solution to this problem will be introduced for qpdf 12.)
This work also paves the way for a future alternative to
QPDFObjectHandle that is more idiomatic C++ and has greater type
safety.
Add ChangeLog for previous contribution Also remove no-longer-needed #include
2022-08-31 19:06:37 +00:00
2022-08-31 Jay Berkenbilt <ejb@ql.org>
* From m-holger (#729): refactor QPDF's parser into a new
QPDFParser class, cleaning the code, significantly improving
performance.
Add ChangeLog/release-notes (with credit) for last pull request
2022-08-27 12:14:36 +00:00
2022-08-27 Jay Berkenbilt <ejb@ql.org>
* From m-holger: major refactoring of QPDFTokenizer to improve
readability and to optimize performance. This also included some
optimizations to some InputSource classes. Thanks for this
excellent contribution. Fixes #749, #442.
Disable QTC inside the library by default (fixes #714) This results in measurable performance improvements to packaged binary libqpdf distributions. QTC remains available for library users and is still selectively enabled in CI.
2022-08-07 19:49:54 +00:00
2022-08-07 Jay Berkenbilt <ejb@ql.org>
* Add new build configuration option ENABLE_QTC, which is off by
default when not running in MAINTAINER_MODE. When this is off,
QTC coverage calls sprinkled throughout the qpdf source code are
compiled out for increased performance. See "Build Options" in the
manual for a discussion. Fixes #714.
Update ChangeLog for recent changes
2022-08-06 20:35:11 +00:00
2022-08-06 Jay Berkenbilt <ejb@ql.org>
* Added by m-holger: QPDF::getObject() method as a simpler form of
getObjectByID or getObjectByObjGen. The older methods are being
retained for compatibility and are not deprecated.
Add ChangeLog and release notes for previous contribution
2022-07-24 18:46:16 +00:00
2022-07-24 Jay Berkenbilt <ejb@ql.org>
JSON schema -- accept single item in place of array When the schema wants a variable-length array, allow a single item as well as allowing an array.
2022-07-24 20:17:03 +00:00
* include/qpdf/JSON.hh: Schema validation: allow a single item to
appear anywhere that the schema has an array of a single item.
This makes it possible to change an element of the schema from an
item to an array to allow the data to accept an array where a
single value was previously required. This change is needed to
allow QPDFJob JSON to start accepting multiple items where a
single item used to be expected without breaking backward
compatibility. Without this change, the earlier fix to
JSON schema: support multi-element array validation
2022-07-24 20:44:51 +00:00
removeAttachment would be a breaking change. Also allow the schema
to contain a multi-element array, which means that the output has
to have an array of the same length in the corresponding location,
and each element is validated against the corresponding schema
element.
JSON schema -- accept single item in place of array When the schema wants a variable-length array, allow a single item as well as allowing an array.
2022-07-24 20:17:03 +00:00
Tweak "AndGet" mutator functions again Remove any ambiguity around whether old or new value is being returned.
2022-07-24 19:42:23 +00:00
* QPDFObjectHandle: for the methods insertItem, appendItem,
eraseItem, replaceKey, and removeKey, add a corresponding
"AndGetNew" and/or "AndGetOld" methods. The ones that end with
"AndGetNew" return the newly added item. The ones that end with
"AndGetOld" return the old value. The AndGetNew methods make it
possible to create a new object, add it to an array or dictionary,
and get a handle to it all in one line. The AndGetOld methods make
it easier to retrieve an old value when removing or replacing it.
Add ChangeLog and release notes for previous contribution
2022-07-24 18:46:16 +00:00
* Thanks to m-holger for doing significant cleanup of private APIs
and internals around QPDFObjGen and for significantly improving
the performance of QPDFObjGen -- See #731. This includes a few
user-visible changes:
- Addition of QPDFObjectHandle::StreamDataProvider::provideStreamData
overloads that take QPDFObjGen
- Addition of an optional argument to QPDFObjGen::unparse allowing
specification of a separator character, with the default
resulting in the old behavior
Examples have been updated to use improved APIs. The old
provideStreamData overloads will continue to be supported, so
updating older code to use the new interfaces is entirely at the
Spell check
2022-07-31 14:30:36 +00:00
programmer's discretion.
Add ChangeLog and release notes for previous contribution
2022-07-24 18:46:16 +00:00
Add ChangeLog for last commit
2022-06-25 18:50:33 +00:00
2022-06-25 Jay Berkenbilt <ejb@ql.org>
* Add tracking methods QPDF::everCalledGetAllPages() and
QPDF::everPushedInheritedAttributesToPages(). Since those methods
may have the side effect of creating new objects and replace
objects in various places in the pages tree, it's useful to be
able to find out whether they've ever been called.
Use "save" logger when saving data to standard output This includes the output PDF, streams from --show-object and attachments from --save-attachment. This also enables --verbose and --progress to work with saving to stdout.
2022-06-18 13:40:41 +00:00
2022-06-18 Jay Berkenbilt <ejb@ql.org>
Add qpdfjob_register_progress_reporter
2022-06-19 01:04:44 +00:00
* Add QPDFJob::registerProgressReporter, making it possible to
override the progress reporter that is used when --progress (or
the equivalent) is configured with QPDFJob. This is
qpdfjob_register_progress_reporter in the C API.
Add C API to QPDFLogger
2022-06-18 17:38:36 +00:00
* Add examples that show how to capture QPDFJob's output by
configuring the default logger (qpdfjob-save-attachment.cc,
qpdfjob-c-save-attachment.c). Fixes #691.
* Add C API for QPDFLogger -- see qpdflogger-c.h
Add more flexible funtions to qpdfjob C API
2022-06-19 12:20:43 +00:00
* Add additional qpdfjob C API functions take a handle.
Expose exit code values to C API via Constants.h
2022-06-18 15:36:11 +00:00
* Add qpdf_exit_code_e to Constants.h so that exit codes from
QPDFJob are accessible to the C API.
Use "save" logger when saving data to standard output This includes the output PDF, streams from --show-object and attachments from --save-attachment. This also enables --verbose and --progress to work with saving to stdout.
2022-06-18 13:40:41 +00:00
* When --progress or --verbose is combined with writing to
standard output, progress reporting and verbose messages go to
standard error. Previously it was disabled in this case.
Add integer types to Pipeline::operator<<
2022-06-05 16:33:36 +00:00
2022-06-05 Jay Berkenbilt <ejb@ql.org>
QPDF, QPDFJob: use QPDFLogger instead of custom output streams
2022-06-05 17:30:42 +00:00
* QPDFJob: API breaking change: QPDFJob::doIfVerbose passes a
Pipeline& rather than a std::ostream& to the the callback
function.
Add integer types to Pipeline::operator<<
2022-06-05 16:33:36 +00:00
* Add integer types to pipeline's operator<<: short, int, long,
long long, unsigned short, unsigned int, unsigned long, unsigned
long long.
Add conversions to ISO-8601 date format
2022-05-30 13:00:36 +00:00
2022-05-30 Jay Berkenbilt <ejb@ql.org>
ChangeLog, release notes for json v2
2022-05-31 11:20:47 +00:00
* qpdf JSON is now at version 2. New command-line arguments:
--json-output, --json-input, --update-from-json. New methods
QPDF::writeJSON, QPDF::createFromJSON, QPDF::updateFromJSON. For
details, see the "qpdf JSON" chapter of the manual.
In json mode, reveal recovered user password when otherwise unavailable
2022-05-30 14:55:07 +00:00
* When showing encryption data in json output, when the user
password was recovered with by the owner password and the
specified password does not match the user password, reveal the
user password. This is not possible with 256-bit keys.
Add additional information when listing attachments
2022-05-30 13:23:48 +00:00
* Include additional information in --list-attachments --verbose
and in --json --json-key=attachments.
Add conversions to ISO-8601 date format
2022-05-30 13:00:36 +00:00
* Add QUtil::qpdf_time_to_iso8601 and QUtil::pdf_time_to_iso8601
for converting PDF/qpdf timestamps to ISO-8601 date format.
Add QUtil::FileCloser to the public API
2022-05-18 14:45:54 +00:00
2022-05-18 Jay Berkenbilt <ejb@ql.org>
* Add QUtil::FileCloser to the public API. This is a simple inline
class to help with automatic file closing.
replaceStreamData: accept uninitialized filter/decode_parms These mean to leave the original values alone. This is needed for reconstructing streams from JSON given that the stream data and stream dictionary may appear in any order in the JSON.
2022-05-17 22:35:35 +00:00
2022-05-17 Jay Berkenbilt <ejb@ql.org>
* Allow passing *uninitialized* (not null) objects to
replaceStreamData as filter and/or decode_parms to leave any
existing values for /Filter and /DecodeParms untouched.
Add QUtil::is_long_long
2022-05-15 18:56:04 +00:00
2022-05-15 Jay Berkenbilt <ejb@ql.org>
* Add QUtil::is_long_long to test whether a string can be
converted to a long long and back without loss of information.
Make "objects" and "pages" consistent in JSON output
2022-05-04 11:32:30 +00:00
2022-05-04 Jay Berkenbilt <ejb@ql.org>
JSON: add blob type that generates base64-encoded binary data
2022-05-04 20:28:12 +00:00
* JSON: add a new "blob" type that takes a function to write data
into. The blob is serialized as a base64-encoded representation of
whatever is written to the function.
Add new FileInputSource constructors
2022-05-04 16:02:39 +00:00
* FileInputSource has new constructors that eliminate the need to
call setFilename or setFile in most cases.
JSON: add write methods and implement unparse() in terms of those
2022-05-04 12:32:54 +00:00
* Enhance JSON by adding a write method that takes a Pipeline* and
depth, and add several helper methods to make it easier to write
large amounts of JSON incrementally without having to have the
whole thing in memory.
Make "objects" and "pages" consistent in JSON output
2022-05-04 11:32:30 +00:00
* json v1 output: make "pages" and "objects" consistent.
Previously, "objects" always reflected the objects exactly as they
appeared in the original file, while "pages" reflected objects
after repair of the pages tree. This could be misleading. Now, if
"pages" is specified, "objects" shows the effects of repairing the
page tree, and if not, it doesn't. This makes no difference for
correct PDF files that don't have problems in the pages tree. JSON
v2 will behave in a similar way.
Make Pipeline::write take an unsigned char const* (API change)
2022-05-03 21:43:07 +00:00
2022-05-03 Jay Berkenbilt <ejb@ql.org>
Add new Pl_String Pipeline
2022-05-03 22:54:44 +00:00
* Add new Pipeline class Pl_String which appends to a std::string&
passed to it at construction.
Add new Pl_OStream Pipeline
2022-05-03 22:40:42 +00:00
* Add new Pipeline class Pl_OStream, similar to Pl_StdioFile but
takes a std::ostream instead of a FILE*.
Add new Pipeline convenience methods
2022-05-03 21:58:58 +00:00
* Add new convenience methods to Pipeline: writeCStr and
writeString. Also add a limit << operator that takes C strings and
std::strings. Also add an overloaded version of write that takes
"char const*".
Make Pipeline::write take an unsigned char const* (API change)
2022-05-03 21:43:07 +00:00
* API change: Pipeline::write now takes "unsigned char const *"
instead of "unsigned char*". Callers shouldn't have to change
anything, though can stop using writable strings or
QUtil::unsigned_char_pointer. If you have implemented your own
pipelines, you should change your write method to take a const
pointer.
Add reactors to the JSON parser
2022-05-01 18:06:31 +00:00
2022-05-01 Jay Berkenbilt <ejb@ql.org>
* JSON: add reactors to the JSON parser, making it possible to
react to JSON parsing events as they occur and to block the
results from being stored. This makes it possible to incrementally
parse arbitrarily large JSON inputs.
Using insecure crytpo from the CLI is now an error by default
2022-04-30 19:41:14 +00:00
2022-04-30 Jay Berkenbilt <ejb@ql.org>
Mark weak encryption with API changes (fixes #576)
2022-04-30 20:05:28 +00:00
* QPDFWriter: change encryption API calls
- Remove deprecated versions of setR*EncryptionParameters
methods from before qpdf 8.4.0
- Replace setR2EncryptionParameters with
setR2EncryptionParametersInsecure
- Replace setR3EncryptionParameters with
setR3EncryptionParametersInsecure
- Replace setR4EncryptionParameters with
setR4EncryptionParametersInsecure
* C API: change encryption API calls to match C++ interface
- Remove pre-8.4.0 functions:
- qpdf_set_r3_encryption_parameters
- qpdf_set_r4_encryption_parameters
- qpdf_set_r5_encryption_parameters
- qpdf_set_r6_encryption_parameters
- Add "_insecure" to insecure encryption triggers:
- Replace void qpdf_set_r2_encryption_parameters
with qpdf_set_r2_encryption_parameters_insecure
- Replace void qpdf_set_r3_encryption_parameters2
with qpdf_set_r3_encryption_parameters_insecure
- Replace void qpdf_set_r4_encryption_parameters2
with qpdf_set_r4_encryption_parameters_insecure
Using insecure crytpo from the CLI is now an error by default
2022-04-30 19:41:14 +00:00
* Make attempting to write encrypted files that use RC4 (40-bit or
128-bit without AES) an error rather than a warning when
Mark weak encryption with API changes (fixes #576)
2022-04-30 20:05:28 +00:00
--allow-weak-crypto is not specified. Fixes #576.
Using insecure crytpo from the CLI is now an error by default
2022-04-30 19:41:14 +00:00
Deprecate replaceOrRemoveKey -- it's the same as replaceKey
2022-04-24 13:31:32 +00:00
2022-04-24 Jay Berkenbilt <ejb@ql.org>
QPDFJob json: make removeAttachment take an array (fixes #693)
2022-04-24 16:47:24 +00:00
* Bug fix: "removeAttachment" in the job JSON now takes an array
of strings instead of a string. It should have taken an array of
strings since the corresponding command-line argument,
--remove-attachment, is repeatable. Fixes #693.
Deprecate replaceOrRemoveKey -- it's the same as replaceKey
2022-04-24 13:31:32 +00:00
* Deprecate QPDFObjectHandle::replaceOrRemoveKey -- it does and
always has done the same thing as replaceKey.
Expose QUtil::get_next_utf8_codepoint
2022-04-23 20:39:27 +00:00
2022-04-23 Jay Berkenbilt <ejb@ql.org>
Add new QPDF::warn that takes most of QPDFExc's arguments
2022-04-23 22:03:44 +00:00
* Add a new QPDF::warn method that takes the parameters of
QPDFExc's constructor except for the filename, which is taken from
the QPDF object. This is a shorter way to issue warnings on behalf
of a QPDF object.
Expose QUtil::get_next_utf8_codepoint
2022-04-23 20:39:27 +00:00
* Add new method QUtil::is_explicit_utf8 that tests whether a
string is explicitly marked as being UTF-8 encoded, as allowed by
the PDF 2.0 spec. Such a string starts with the bytes 0xEF 0xBB
0xBF, which is the UTF-8 encoding of U+FEFF.
* Add new method QUtil::get_next_utf8_codepoint as a low-level
helper for iterating through the UTF-8 characters in a byte
string.
Add ChangeLog entries and release notes for previous work
2022-04-16 16:46:35 +00:00
2022-04-16 Jay Berkenbilt <ejb@ql.org>
Change default --json from 1 to latest
2022-04-16 16:57:33 +00:00
* Breaking CLI change: the default value for --json is now
"latest" rather than "1". At this moment, "1" is the latest
version, but version "2" will be added before the release of
qpdf 11.
Add ChangeLog entries and release notes for previous work
2022-04-16 16:46:35 +00:00
* Perform code cleanup including some source-compatible but not
Use anonymous namespaces for file-private classes
2022-04-16 17:21:57 +00:00
binary compatible changes to function signatures, use of anonymous
namespaces, and use of "= default" and "= delete" in declarations.
Add ChangeLog entries and release notes for previous work
2022-04-16 16:46:35 +00:00
2022-04-09 Jay Berkenbilt <ejb@ql.org>
* Replace PointerHolder with std::shared_ptr through the QPDF API.
A backward-compatible interface is provided and enabled by default
with a warning that can be turned off. See "Smart Pointers" in the
"Design and Library Notes" section of the manual for information
including a detailed migration process to assist with migrating
code that uses the qpdf library.
2022-04-03 Jay Berkenbilt <ejb@ql.org>
* Add automatic code formatting with clang-format. See "Code
Formatting" in the "Contributing to qpdf" chapter of the manual.
Update ChangeLog and release notes
2022-03-18 22:22:29 +00:00
2022-03-19 Jay Berkenbilt <ejb@ql.org>
* 10.6.3.0cmake1: unofficial release
* Conversion of build system to cmake. This change doesn't include
any user-visible functional changes to the library API or CLI but
completely replaces the build system. Details can be found in the
manual in the "Building and Installing QPDF" and "Notes for
Packagers" sections, especially "Converting From autoconf to
cmake" in "Building and Installing QPDF". Highlights of the
changes can be found in the release notes.
Prepare 10.6.3 release
2022-03-07 23:19:08 +00:00
2022-03-08 Jay Berkenbilt <ejb@ql.org>
* 10.6.3: release
Run Windows build on Windows 2022 runner
2022-03-08 14:26:40 +00:00
* Use Windows 2022 github runners and therefore Visual Studio 2022
to create Windows distributions
* Fix DLL export issue with mingw (Windows)
Spell check, update release notes for 10.6.3
2022-03-07 23:17:17 +00:00
2022-03-07 Jay Berkenbilt <ejb@ql.org>
* Minor internal changes to assist with building in other
environments: rename internal bits.icc to qpdf/bits_functions.hh
(not part of public API), enforce reordering of header files to
prevent jpeglib.h from interfering with other headers, remove an
unused header that was accidentally added in 10.6.0 but never
referenced by any code.
* Make build work and tests work when NDEBUG is defined. This
involved a few changes to some test files but no changes to any
library code.
Allow \/ in a json string
2022-02-25 16:42:50 +00:00
2022-02-25 Jay Berkenbilt <ejb@ql.org>
* Bug fix in JSON parser: accept \/ in a string as valid input per
JSON spec even though we don't translate / to \/ on output.
Recognize explicit UTF-8 strings (fixes #654)
2022-02-22 13:04:11 +00:00
2022-02-22 Jay Berkenbilt <ejb@ql.org>
* Recognize PDF strings explicitly marked as UTF-8 as allowed by
the PDF 2.0 spec. Fixes #654.
Fix logic error with Tf when generating appearances (fixes #655)
2022-02-18 18:43:26 +00:00
2022-02-18 Jay Berkenbilt <ejb@ql.org>
* Bug fix: when generating appearance streams, the font size was
substituted incorrectly from /DA if Tf was absent or the number
preceding Tf was out of range. Fixes #655.
Prepare 10.6.2 release
2022-02-16 00:36:39 +00:00
2022-02-16 Jay Berkenbilt <ejb@ql.org>
* 10.6.2: release
Handle odd PDFDoc codepoints in UTF-8 during transcoding (fixes #650) There are codepoints in PDFDoc that are not valid UTF-8 but map to valid UTF-8. We were handling those correctly with bidirectional mapping. However, if those same code points appeared in UTF-8, where they have no meaning, they were left as fixed points when converting to PDFDoc, where they do have meaning. This change recognizes them as errors.
2022-02-15 13:29:29 +00:00
2022-02-15 Jay Berkenbilt <ejb@ql.org>
Fix asymmetry between newUnicodeString and getUTF8Value
2022-02-16 00:22:35 +00:00
* Fix asymmetrical logic between
QPDFObjectHandle::newUnicodeString() and
QPDFObjectHandle::getUTF8Val(). The asymmetrical logic didn't
matter before fixing the PDF Doc transcoding bugs.
Silently/transparently recognize UTF-16LE as UTF-16 (fixes #649) The PDF spec only allows UTF-16BE, but most readers seem to accept UTF-16LE as well, so now qpdf does too.
2022-02-15 20:56:06 +00:00
* When analyzing PDF strings, recognize UTF-16LE as UTF-16. The
PDF spec only allows UTF-16BE, but most readers seem to allow
both. Fixes #649.
Ignore -- at the top level arg parser (fixes #652) This was unintended behavior that was added back for backward compatibility. It is intentionally undocumented.
2022-02-15 20:34:35 +00:00
* Bug fix: 10.6.0 inadvertently removed an unknown/undocumented
CLI parsing feature, which has been restored in 10.6.2. Fixes #652.
Handle odd PDFDoc codepoints in UTF-8 during transcoding (fixes #650) There are codepoints in PDFDoc that are not valid UTF-8 but map to valid UTF-8. We were handling those correctly with bidirectional mapping. However, if those same code points appeared in UTF-8, where they have no meaning, they were left as fixed points when converting to PDFDoc, where they do have meaning. This change recognizes them as errors.
2022-02-15 13:29:29 +00:00
* Don't map 0x18 through 0x1f, 0x7f, 0x9f, or 0xad as fixed points
Spell check
2022-02-16 00:36:12 +00:00
when transcoding UTF-8 to PDFDoc. These code points have different
Handle odd PDFDoc codepoints in UTF-8 during transcoding (fixes #650) There are codepoints in PDFDoc that are not valid UTF-8 but map to valid UTF-8. We were handling those correctly with bidirectional mapping. However, if those same code points appeared in UTF-8, where they have no meaning, they were left as fixed points when converting to PDFDoc, where they do have meaning. This change recognizes them as errors.
2022-02-15 13:29:29 +00:00
meanings in those two encoding systems. Fixes #650.
Prepare 10.6.1 release
2022-02-11 14:36:01 +00:00
2022-02-11 Jay Berkenbilt <ejb@ql.org>
* 10.6.1: release
* Fix some compilation issues from use of abs without including
proper headers.
Fix one more PDF doc encoding error for 10.6 release (fixes #637)
2022-02-09 10:47:58 +00:00
2022-02-09 Jay Berkenbilt <ejb@ql.org>
Add PDFVersion class
2022-02-08 15:50:55 +00:00
Prepare 10.6.0 release
2022-02-08 21:54:03 +00:00
* 10.6.0: release
Fix one more PDF doc encoding error for 10.6 release (fixes #637)
2022-02-09 10:47:58 +00:00
* Fix one more PDF doc encoding omission: 0xAD is also undefined.
Fixes #637.
2022-02-08 Jay Berkenbilt <ejb@ql.org>
Preserve input PDF version on pages/split-pages (fixes #610)
2022-02-08 16:27:38 +00:00
* Bug fix: when splitting pages with --split-pages or selecting
pages with --pages, set the output PDF version to the maximum of
all the input PDF versions. This is a fix to QPDFJob. If you are
creating output PDF files yourself from multiple inputs, you will
need to code the same thing. The new PDFVersion object, its
updateIfGreater() method, and the new QPDF and QPDFWriter methods
described below make this very easy to do. Fixes #610.
Add PDFVersion class
2022-02-08 15:50:55 +00:00
* Add new class PDFVersion for more convenient comparison of PDF
version numbers from the %!PDF header.
Add QPDF::getVersionAsPDFVersion
2022-02-08 16:07:37 +00:00
* Add QPDF::getVersionAsPDFVersion() to return the PDF version and
extension together as a PDFVersion object instead of a string.
Preserve input PDF version on pages/split-pages (fixes #610)
2022-02-08 16:27:38 +00:00
* Add a QPDFWriter::setMinimumPDFVersion() that takes a PDFVersion
object.
Comment, ChangeLog, release note for new contribution
2022-02-06 16:26:27 +00:00
2022-02-06 Jay Berkenbilt <ejb@ql.org>
Add getBufferSharedPointer() to Pl_Buffer and QPDFWriter
2022-02-06 17:30:18 +00:00
* Pl_Buffer and QPDFWriter: add getBufferSharedPointer(), which
turns a PointerHolder<Buffer> but will return a
std::shared_ptr<Buffer> in qpdf 11.
Comment, ChangeLog, release note for new contribution
2022-02-06 16:26:27 +00:00
* From m-holger: add getKeyIfDict(), which calls getKey for
dictionaries and returns null if called on null. This is for
easier access to optional, lower-level dictionaries.
Improve use of std::unique_ptr * Use unique_ptr in place of shared_ptr in some cases * unique_ptr for arrays does not require a custom deleter * use std::make_unique (c++14) where possible
2022-02-05 13:15:07 +00:00
2022-02-05 Jay Berkenbilt <ejb@ql.org>
Update ChangeLog for contributions from m-holger
2022-02-05 16:29:20 +00:00
* Add several new accessors to QPDFObjectHandle: the bool
getValueAsX(X&) accessors allow an alternative way to retrieve
values from QPDFObjectHandle objects and can result in more
concise code in many situations. Thanks to m-holger for the
contribution.
* Add qpdf_oh_new_binary_unicode_string and
qpdf_oh_get_binary_utf8_value to the C API. This makes it possible
to handle UTF-8-encoded strings with embedded NUL characters. Thanks
to m-holger for the contribution.
Add operator ""_qpdf for creating QPDFObjectHandle literals
2022-02-05 14:18:58 +00:00
* Add a global user-defined string literal "_qpdf" as a shorthand
for QPDFObjectHandle::parse, allowing you to create
QPDFObjectHandle objects with
QPDFObjectHandle oh = "<</Some (PDF)>>"_qpdf;
Add qpdf_empty_pdf to C API
2022-02-05 13:50:39 +00:00
* Expose QPDF::emptyPDF to the C API as qpdf_empty_pdf()
API contract: qpdf_get_qpdf_version() returns a static
2022-02-05 13:26:32 +00:00
* Add comments letting people know that the version string
returned by QPDF::QPDFVersion and qpdf_get_qpdf_version is static.
Improve use of std::unique_ptr * Use unique_ptr in place of shared_ptr in some cases * unique_ptr for arrays does not require a custom deleter * use std::make_unique (c++14) where possible
2022-02-05 13:15:07 +00:00
* Add QUtil::make_unique_cstr to return a std::unique_ptr<char[]>
as an alternative to QUtil::copy_string and
QUtil::make_shared_cstr.
PointerHolder: add get() and use_count() for forward compatibility PointerHolder will be replaced with shared_ptr, so let people start moving.
2022-02-04 14:46:55 +00:00
2022-02-04 Jay Berkenbilt <ejb@ql.org>
Add qpdf version macros to qpdf/DLL.h
2022-02-04 17:21:52 +00:00
* New preprocessor symbols QPDF_MAJOR_VERSION, QPDF_MINOR_VERSION,
QPDF_PATCH_VERSION as numbers and QPDF_VERSION as a string. These
can be used for feature testing in code. These are in qpdf/DLL.h,
which is included by every header that adds to the public API.
Since these constants are introduced in version 10.6, it's
important for them to be in a header that everyone already
includes so you don't have to try to include a header that won't
be there.
PointerHolder: add get() and use_count() for forward compatibility PointerHolder will be replaced with shared_ptr, so let people start moving.
2022-02-04 14:46:55 +00:00
* PointerHolder: add a get() method and a use_count() method for
compatibility with std::shared_ptr. In qpdf 11, qpdf's APIs will
switch to using std::shared_ptr instead of PointerHolder, though
there will be a PointerHolder class with a backward-compatible
API. To ease the transition, we are adding get() now with the same
semantics as std::shared_ptr's get. Note that there is a
difference in behavior: const PointerHolder has always behaved
incorrectly. const PointerHolder objects only returned const
pointers. This is wrong. If you want a const pointer, use
PointerHolder<T const>. A const PointerHolder just shouldn't allow
its pointer to be reassigned. The new get() method behaves
correctly in that calling get() on a const PointerHolder to a
non-const pointer returns a non-const pointer. This is the way
regular pointers behave.
Add ChangeLog entries for refactoring work
2022-02-01 19:47:20 +00:00
2022-02-01 Jay Berkenbilt <ejb@ql.org>
* Major refactor: all functionality from the qpdf CLI is now
available for library users using the QPDFJob class. See comments
in include/qpdf/QPDFJob.hh and a new chapter about QPDFJob in the
manual. QPDFJob provides fluent interfaces for setting options
that exactly map to command-line arguments. There are also methods
for initializing QPDFJob from an argv array and from a JSON
object.
* A light C API around basic QPDFJob functionality is in
Prepare release notes for 10.6 (so far)
2022-02-05 20:32:53 +00:00
include/qpdf/qpdfjob-c.h.p
Add ChangeLog entries for refactoring work
2022-02-01 19:47:20 +00:00
* Add new functions version of QUtil::call_main_from_wmain that
takes a constant argv array.
Add optional version to --json
2022-01-31 19:20:06 +00:00
2022-01-31 Jay Berkenbilt <ejb@ql.org>
Clean up documentation and help around json options
2022-01-31 23:40:04 +00:00
* Have --json-help just output the JSON object, leaving a
description to --help and the manual.
Remove duplicate ChangeLog entry
2022-02-04 12:43:25 +00:00
* The --json flag now takes a version number as an optional
Prepare release notes for 10.6 (so far)
2022-02-05 20:32:53 +00:00
parameter. The default will remain version 1 for compatibility
until the release of qpdf 11, after which it will become "latest".
At this time, there's only version 1, but a version 2 may appear
in a future qpdf.
Add optional version to --json
2022-01-31 19:20:06 +00:00
Use QPDFUsage exception for cli, json, and QPDFJob errors
2022-01-28 12:46:04 +00:00
2022-01-28 Jay Berkenbilt <ejb@ql.org>
Add ChangeLog entries for refactoring work
2022-02-01 19:47:20 +00:00
* Add QPDFUsage exception, which is thrown by QPDFJob to indicate
command-line usage or job configuration errors.
Use QPDFUsage exception for cli, json, and QPDFJob errors
2022-01-28 12:46:04 +00:00
Add ChangeLog for previous contribution
2022-01-22 14:16:55 +00:00
2022-01-22 Jay Berkenbilt <ejb@ql.org>
Add QUtil::make_shared_cstr Replace most of the calls to QUtil::copy_string with this instead.
2022-01-22 22:33:53 +00:00
* Add QUtil::make_shared_cstr to return a std::shared_ptr<char>
instead of a char* like QUtil::copy_string
Allow optional fields in json "schema" checks
2022-01-22 19:33:26 +00:00
* JSON: for (qpdf-specific, not official) "schema" checking, add
the ability to treat missing fields as optional. Also ensure that
values in the schema are dictionary, array, or string.
Add ChangeLog for previous contribution
2022-01-22 14:16:55 +00:00
* Add convenience methods isNameAndEquals and isDictionaryOfType
to QPDFObjectHandle with corresponding functions added to the C
API. Thanks to m-holger for the contribution.
Add JSON::isDictionary and JSON::isArray
2022-01-17 23:38:05 +00:00
2022-01-17 Jay Berkenbilt <ejb@ql.org>
Add JSON::parse
2022-01-17 23:40:38 +00:00
* Add JSON::parse. Now qpdf's JSON class implements a
general-purpose JSON parser and serializer, but there are better
options for general use. This is really designed for qpdf's
internal use and is set up to be compatible with qpdf's existing
API and to hook into a planned JSON-based API to the QPDFJob
class.
Add JSON::isDictionary and JSON::isArray
2022-01-17 23:38:05 +00:00
* Add isDictionary and isArray to JSON
Add missing characters from PDF doc encoding (fixes #606)
2022-01-11 20:06:17 +00:00
2022-01-11 Jay Berkenbilt <ejb@ql.org>
Add ChangeLog entries for refactoring work
2022-02-01 19:47:20 +00:00
* Major overhaul of documentation and help for the qpdf
command-line tool. qpdf --help is now broken into topics rather
than being one great wall of text, and the command-line arguments
are indexed in the manual. The entire text of the "Running qpdf"
chapter has been reviewed thoroughly. Many thanks once again to
M. Holger for a detailed review and editorial assistance with the
manual.
Add missing characters from PDF doc encoding (fixes #606)
2022-01-11 20:06:17 +00:00
* Bug fix: add missing characters from PDF doc encoding.
Fixes #606.
Add QUtil::file_can_be_opened
2021-12-29 15:36:15 +00:00
2021-12-29 Jay Berkenbilt <ejb@ql.org>
* Add method QUtil::file_can_be_opened
Stop adding pre-built documentation to the source distribution
2021-12-21 14:23:20 +00:00
2021-12-21 Jay Berkenbilt <ejb@ql.org>
Prepare 10.5.0 release (take 2)
2021-12-21 14:53:13 +00:00
* 10.5.0: release
Prepare 10.5.0 release (take 3)
2021-12-21 15:21:13 +00:00
* Add documentation link to top-level README
Stop adding pre-built documentation to the source distribution
2021-12-21 14:23:20 +00:00
* Discontinue inclusion of the pre-built documentation in the
source distribution. Consult the packaging documentation in the
manual for details. The file README-doc.txt is installed in the
doc directory by default and contains information that users will
need to know to find the documentation.
Further improvements to handling binary strings
2021-12-19 18:52:19 +00:00
2021-12-19 Jay Berkenbilt <ejb@ql.org>
* C API: clarify documentation around string lengths. Add two new
methods: qpdf_oh_get_binary_string_value and
qpdf_oh_new_binary_string to make the need to handle the length
and data separate in more explicit in cases in which the string
data may contain embedded null characters.
Add Pl_Buffer::getMallocBuffer
2021-12-17 12:33:42 +00:00
2021-12-17 Jay Berkenbilt <ejb@ql.org>
C API: simplify new error handling and improve documentation
2021-12-17 20:30:47 +00:00
* C API: simplify error handling for uncaught errors (never in a
released version) and clarify documentation in qpdf-c.h around
error handling. See qpdf-c.h for details, including how to check
for errors and the new function qpdf_silence_errors.
ChangeLog/doc for previous commit
2021-12-17 19:28:20 +00:00
* C API: expose getTypeCode and getTypeName from QPDFObjectHandle.
Fixes #597.
C API: add several stream functions (fixes #596)
2021-12-17 18:28:11 +00:00
* C API: add functions for working with stream data. Search for
"STREAM FUNCTIONS" in qpdf-c.h. Fixes #596.
Make object types available to C API
2021-12-17 17:34:48 +00:00
* QPDFObjectHandle object types have been moved from
QPDFObject::object_type_e to qpdf_object_type_e (defined in
Constants.h). Old values are available for backward compatibility.
Add Pl_Buffer::getMallocBuffer
2021-12-17 12:33:42 +00:00
* Add Pl_Buffer::getMallocBuffer() to initialize a buffer with
malloc in support of the C API
C API: add functions for working with pages (fixes #594)
2021-12-16 19:36:21 +00:00
2021-12-16 Jay Berkenbilt <ejb@ql.org>
* Add several functions to the C API for working with pages. C
Spell check
2021-12-17 17:38:18 +00:00
wrappers around several of the "Legacy" page operations from
C API: add functions for working with pages (fixes #594)
2021-12-16 19:36:21 +00:00
QPDFObjectHandle.hh have been added. See "PAGE FUNCTIONS" in
qpdf-c.h for details. Fixes #594.
ChangeLog/release note on doc change
2021-12-12 22:57:11 +00:00
2021-12-12 Jay Berkenbilt <ejb@ql.org>
* Convert documentation from docbook to reStructuredText/Sphinx.
C API: overhaul error handling * Handle error conditions that occur when using the object handle interfaces. In the past, some exceptions were not correctly converted to errors or warnings. * Add more detailed information to qpdf-c.h * Make it possible to work more explicitly with uninitialized objects
2021-12-10 16:09:42 +00:00
2021-12-10 Jay Berkenbilt <ejb@ql.org>
Handle bitstream overflow errors more gracefully (fixes #581) * Make it a runtime error, not a logic error * Include additional information * Capture it properly in checkLinearization
2021-12-10 20:14:26 +00:00
* Handle bitstream overflow errors more gracefully. Fixes #581.
C API: expose functions for indirect objects (fixes #588)
2021-12-10 19:57:11 +00:00
* C API: add qpdf_get_object_by_id, qpdf_make_indirect_object, and
qpdf_replace_object, exposing the corresponding methods in QPDF
and QPDFObjectHandle. Fixes #588.
Expose QPDFObjectHandle::addTokenFilter (fixes #580)
2021-12-10 18:37:01 +00:00
* Add missing QPDF_DLL to QPDFObjectHandle::addTokenFilter so that
it is actually accessible as part of the public interface as
intended. Fixes #580.
C API: overhaul error handling * Handle error conditions that occur when using the object handle interfaces. In the past, some exceptions were not correctly converted to errors or warnings. * Add more detailed information to qpdf-c.h * Make it possible to work more explicitly with uninitialized objects
2021-12-10 16:09:42 +00:00
* C API: Overhaul how errors are handle the C API's object handle
interfaces. Clarify documentation regarding object accessors and
how type errors and warnings are handled. Many cases that used to
crash code that used the C API can now be trapped and will be
C API: simplify new error handling and improve documentation
2021-12-17 20:30:47 +00:00
written stderr if not trapped. See qpdf-c.h for details.
C API: overhaul error handling * Handle error conditions that occur when using the object handle interfaces. In the past, some exceptions were not correctly converted to errors or warnings. * Add more detailed information to qpdf-c.h * Make it possible to work more explicitly with uninitialized objects
2021-12-10 16:09:42 +00:00
* C API: Add qpdf_oh_new_uninitialized to explicitly create
uninitialized object handles.
* Add new error code qpdf_e_object that is used for exceptions
(including warnings) that are caused by using QPDFObjectHandle
methods on object handles of the wrong type.
C API: qpdf_get_last_string_length
2021-12-02 12:54:33 +00:00
2021-12-02 Jay Berkenbilt <ejb@ql.org>
C API: qpdf_oh_is_initialized
2021-12-02 13:04:59 +00:00
* C API: Add qpdf_oh_is_initialized.
C API: qpdf_get_last_string_length
2021-12-02 12:54:33 +00:00
* C API: Add qpdf_get_last_string_length to return the length of
the last string returned. This is necessary in order to fully
retrieve values of strings that may contain embedded null characters.
Add changelog and release note for #587
2021-12-02 19:02:44 +00:00
* C API: Add qpdf_oh_new_object to clone an object handle. Change
implemented by m-holger in #587.
Prepare 10.4.0 release
2021-11-16 20:19:01 +00:00
2021-11-16 Jay Berkenbilt <ejb@ql.org>
* 10.4.0: release
First increment of improving handling of weak crypto (fixes #358)
2021-11-10 22:57:12 +00:00
2021-11-10 Jay Berkenbilt <ejb@ql.org>
* Add --allow-weak-crypto option to suppress warnings about use of
weak cryptographic algorithms. Update documentation around this
issue. Fixes #358.
Make recovery logic flexible about where objects end (fixes #573) Don't assume endobj is at the beginning of the line. This means we are looking at tokens for every line, but the odds of n n obj appearing in the middle of the object are likely much lower than endobj not being at the beginning of the line or missing entirely. This will probably have a negative impact on recovery time for very large files. Hopefully it will be worth it.
2021-11-07 20:23:29 +00:00
2021-11-07 Jay Berkenbilt <ejb@ql.org>
* Relax xref recovery logic a bit so that files whose objects are
either missing endobj or have endobj at other than the beginning
of a line can still be recovered. Fixes #573.
Check object ownership when adding When adding a QPDFObjectHandle to an array or dictionary, if possible, check if the new object belongs to the same QPDF. This makes it much easier to find incorrect code than waiting for the situation to be detected when the file is written.
2021-11-04 15:55:36 +00:00
2021-11-04 Jay Berkenbilt <ejb@ql.org>
Support OpenSSL 3 (fixes #568)
2021-11-04 21:21:34 +00:00
* Add support for OpenSSL 3. Fixes #568.
The OpenSSL version is detected at compile-time. If you want to
build with OpenSSL 3 on a system that has OpenSSL 1 installed, you
can run configure like this (or similar to this depending on how
you installed openssl3):
pc_openssl_CFLAGS=-I/path/to/openssl3/include \
pc_openssl_LIBS='-L/path/to/openssl3/lib64 -lssl -lcrypto' \
./configure
where /path/to/openssl3 is wherever your OpenSSL 3 distribution is
installed. You may also need to set the LD_LIBRARY_PATH
environment variable if it's not installed in a standard location.
Add range check in QPDFNumberTreeObjectHelper (fuzz issue 37740)
2021-11-04 17:52:47 +00:00
* Add range check in QPDFNumberTreeObjectHelper (fuzz issue 37740).
Spell check
2021-11-16 20:15:48 +00:00
* Add QIntC::range_check_subtract to do range checking on
Add QIntC::range_check_subtract
2021-11-04 17:52:41 +00:00
subtraction, which has different boundary conditions from
addition.
Fix bug in merging resources /DR from foreign AcroForm (fixes #548) When making resources indirect in from_dr, the code was using the wrong owning QPDF, forgetting that from_dr had already been copied using CopyForeignObject.
2021-11-04 16:11:48 +00:00
* Bug fix: fix crash that could occur under certain conditions
when using --pages with files that had form fields. Fixes #548.
Check object ownership when adding When adding a QPDFObjectHandle to an array or dictionary, if possible, check if the new object belongs to the same QPDF. This makes it much easier to find incorrect code than waiting for the situation to be detected when the file is written.
2021-11-04 15:55:36 +00:00
* Add an extra check to the library to detect when foreign objects
are inserted directly (instead of using
<function>QPDF::copyForeignObject</function>) at the time of
insertion rather than when the file is written. Catching the error
sooner makes it much easier to locate the incorrect code.
Fix overlay/underlay on page with no resources (fixes #527)
2021-11-03 14:12:50 +00:00
2021-11-03 Jay Berkenbilt <ejb@ql.org>
* Bug fix: make overlay/underlay work on a page with no resource
dictionary. Fixes #527.
Better diagnostics when --pages is not closed (fixes #555)
2021-11-02 20:22:37 +00:00
2021-11-02 Jay Berkenbilt <ejb@ql.org>
Make QPDF::findPage public (fixes #516) This was originally not public because I wanted to get rid fo the pages cache, but I recently realized there were deep reasons not to do that, and the author of pikepdf wanted this, so I decided to make it public.
2021-11-02 22:12:39 +00:00
* Add QPDF::findPage to the public API. This is primarily to help
improve the efficiency of code that wraps the qpdf library, such
as pikepdf. Fixes #516.
Detect recoverable but invalid zlib data streams (fixes #562)
2021-11-02 21:54:10 +00:00
* zlib-flate: warn and exit with code 3 when there is corrupted
input data even when decompression is possible. We do this in the
zlib-flate CLI so that it can be more reliably used to test the
validity of zlib streams, but we don't warn by default in qpdf
itself because PDF files in the wild exist with this problem and
other readers appear to tolerate it. There is a PDF in the qpdf
test suite (form-filled-by-acrobat.pdf) that was written by a
version of Adobe Acrobat that exhibits this problem. Fixes #562.
* Add Pl_Flate::setWarnCallback to make it possible to be notified
of data errors that are recoverable but still indicate invalid
data.
Better diagnostics when --pages is not closed (fixes #555)
2021-11-02 20:22:37 +00:00
* Improve error reporting when someone forgets the -- after
--pages. Fixes #555.
Fix string bounds checking in completion code (fixes #441)
2021-05-12 12:55:10 +00:00
2021-05-12 Jay Berkenbilt <ejb@ql.org>
* Bug fix: ensure we don't overflow any string bounds while
handling completion, even when we are given bogus input values.
Fixes #441.
Performance fix on preserveObjectStreams
2021-05-09 11:51:14 +00:00
2021-05-09 Jay Berkenbilt <ejb@ql.org>
* Improve performance of preservation of object streams by
avoiding unnecessary traversal of objects when there are no object
streams.
Exclude unreferenced objects in object streams (fixes #520)
2021-05-08 13:07:59 +00:00
2021-05-08 Jay Berkenbilt <ejb@ql.org>
Prepare 10.3.2 release
2021-05-08 14:05:26 +00:00
* 10.3.2: release
Include manuals in windows distributions again (fixes #521)
2021-05-08 13:12:16 +00:00
* Fix problem that caused the generated manual from being included
in the Windows distributions. Fixes #521.
Exclude unreferenced objects in object streams (fixes #520)
2021-05-08 13:07:59 +00:00
* Fix 11-year-old bug of leaving unreferenced objects in preserved
object streams. Fixes #520.
Fix timezone portability issue (fixes #515)
2021-04-17 22:12:55 +00:00
2021-04-17 Jay Berkenbilt <ejb@ql.org>
* Portability fix: use tm_gmtoff rather than global timezone
variable if available to get timezone offset. This fixes
compilation on BSD and also results in a daylight saving
time-aware offset for Linux or other GNU systems. Fixes #515.
QPDF::addPage*: handle duplicate pages more robustly
2021-04-05 14:45:18 +00:00
2021-04-05 Jay Berkenbilt <ejb@ql.org>
* When adding a page, if the page already exists, make a shallow
copy of the page instead of throwing an exception. This makes the
behavior of adding a page from the library consistent with what
the CLI does and also with what the library does if it starts with
a file that already has a duplicated page. Note that this means
that, in some cases, the page you pass to addPage or addPageAt
(either in QPDF or QPDFPageDocumentHelper) will not be the same
object that actually gets added. (This has actually always been
the case.) That means that, if you are going to do subsequent
modification on the page, you should retrieve it again.
Allow /DR to be direct in /AcroForm Also handle direct annotation, though this is much less likely.
2021-03-11 16:38:58 +00:00
2021-03-11 Jay Berkenbilt <ejb@ql.org>
Prepare 10.3.1 release
2021-03-11 17:59:41 +00:00
* 10.3.1: release
Allow /DR to be direct in /AcroForm Also handle direct annotation, though this is much less likely.
2021-03-11 16:38:58 +00:00
* Bug fix: allow /DR to be direct in /AcroForm
Major rework of handling form fields when copying pages (fixes #509)
2021-03-04 19:46:07 +00:00
2021-03-04 Jay Berkenbilt <ejb@ql.org>
Prepare 10.3.0 release
2021-03-04 20:21:14 +00:00
* 10.3.0: release
Major rework of handling form fields when copying pages (fixes #509)
2021-03-04 19:46:07 +00:00
* The last several changes are in support of fixing more complex
cases of keeping form fields working properly through page copying
operations. Fixes #509.
* Deprecated QPDFAcroFormDocumentHelper::copyFieldsFromForeignPage
-- use QPDFAcroFormDocumentHelper::fixCopiedAnnotations instead.
The API for dealing with annotations and form fields around
copying pages is extremely complex and very hard to get right. It
is planned for a future version of qpdf to have a higher level
interface for dealing with copying pages around and preserving
document-level constructs.
* Add QPDFAcroFormDocumentHelper::getFieldsWithQualifiedName for
returning a list of fields by name.
* Add QPDFAcroFormDocumentHelper::addAndRenameFormFields to add a
collection of fields while ensuring that, within the collection,
fields with the same name continue to have the same name, but that
they don't conflict with exiting fields in the document.
* Add QPDFAcroFormDocumentHelper::setFormFieldName for changing
the name of a form field in a manner that preserves
QPDFAcroFormDocumentHelper's cache.
Add optional conflict detection to mergeResources Also improve behavior around direct vs. indirect resources.
2021-03-02 11:28:55 +00:00
2021-03-03 Jay Berkenbilt <ejb@ql.org>
Major rework of handling form fields when copying pages (fixes #509)
2021-03-04 19:46:07 +00:00
* Handle /DR properly when copying form fields. This is a
significant rework of the form field copying from 10.2.0. It
ensures that when copy fields from different files, we resolve any
conflicting names in resources.
Add QPDFMatrix::operator==
2021-03-03 20:02:38 +00:00
* Add QPDFMatrix::operator==
Add optional conflict detection to mergeResources Also improve behavior around direct vs. indirect resources.
2021-03-02 11:28:55 +00:00
* Add QPDFObjectHandle::makeResourcesIndirect
2021-03-02 Jay Berkenbilt <ejb@ql.org>
* Add an optional resource_names argument to getUniqueResourceName
for added efficiency.
* Add conflict detection QPDFObjectHandle::mergeResources.
Add QPDF::numWarnings
2021-03-01 22:33:34 +00:00
2021-03-01 Jay Berkenbilt <ejb@ql.org>
Remove unreferenced: ignore names that are not Fonts or XObjects Converted ResourceFinder to ParserCallbacks so we can better detect the name that precedes various operators and use the operators to sort the names into resource types. This enables us to be smarter about detecting unreferenced resources in pages and also sets the stage for reconciling differences in /DR across documents.
2021-03-01 21:43:35 +00:00
* Improve code that finds unreferenced resources to ignore names
in the content stream that are not fonts or XObjects. This should
reduce the number of cases when qpdf needlessly decides not to
remove unreferenced resources. Hopefully it doesn't create any new
bugs where it removes unreferenced resources that it isn't
supposed to.
Add QPDF::numWarnings
2021-03-01 22:33:34 +00:00
* Add QPDF::numWarnings() -- useful to tell whether any warnings
were issued by a specific bit of code.
Fix behavior for finding /Q, /DA, and /DR for form fields If not found in the field hierarchy, /Q and /DA are supposed to be looked up in the document-level form dictionary. /DR is supposed to only come from the document dictionary.
2021-02-26 19:47:52 +00:00
2021-02-26 Jay Berkenbilt <ejb@ql.org>
* Bug fix: QPDFFormFieldObjectHelper was mis-handling /DA, /Q, and
/DR in ways that usually didn't matter but were still wrong. /DA
and /Q were being found in the field hierarchy, but if not found,
the default values in the /AcroForm dictionary were not being
used. /DR was being treated as an inherited field in the field
dictionary, which is wrong. It is actually supposed to come from
the /AcroForm dictionary. We were getting away with this since
many popular form writers seem to copy it to the field as well,
even though the spec makes no mention of doing this. To support
this, QPDFFormFieldObjectHelper::getDefaultResources was added.
Have QPDFObjectHandle notice when replaceObject was called This results in a performance penalty of 1% to 2% when replaceObject and swapObjects are never called and a somewhat larger penalty if they are called, but it's worth it to avoid very confusing behavior as discussed in depth in qpdf#507.
2021-02-25 11:34:03 +00:00
2021-02-25 Jay Berkenbilt <ejb@ql.org>
Update examples to use copyStream()
2021-02-25 17:32:45 +00:00
* Update StreamDataProvider examples to use copyStream() when they
want to get to the original stream data from the provider. Prior
to 10.2.0, we had to copy the stream to another QPDF, but now we
can just use copyStream().
Have QPDFObjectHandle notice when replaceObject was called This results in a performance penalty of 1% to 2% when replaceObject and swapObjects are never called and a somewhat larger penalty if they are called, but it's worth it to avoid very confusing behavior as discussed in depth in qpdf#507.
2021-02-25 11:34:03 +00:00
* Bug fix/behavior change: when QPDF::replaceObject or
QPDF::swapObjects is called, existing QPDFObjectHandle instances
will now notice the change. This removes a long-standing source of
bugs and confusing behavior.
Fix input file = output file test for split pages
2021-02-23 13:08:48 +00:00
2021-02-23 Jay Berkenbilt <ejb@ql.org>
Add missing release entry in ChangeLog
2021-02-25 16:45:53 +00:00
* 10.2.0: release
Fix input file = output file test for split pages
2021-02-23 13:08:48 +00:00
* The test for the input and output files being the same wasn't
implemented correctly for --split-pages since the specified output
file is really a pattern, not the actual output file.
Add new placeFormXObject that takes a matrix reference
2021-02-22 21:02:47 +00:00
2021-02-22 Jay Berkenbilt <ejb@ql.org>
Preserve form fields when splitting pages (fixes #340)
2021-02-22 23:36:05 +00:00
* From qpdf CLI, --pages and --split-pages will properly preserve
interactive form functionality. Fixes #340.
Add methods for copying form fields
2021-02-22 22:44:13 +00:00
* Add QPDFAcroFormDocumentHelper::copyFieldsFromForeignPage to
Major rework of handling form fields when copying pages (fixes #509)
2021-03-04 19:46:07 +00:00
copy form fields from a foreign page into the current file. (This
method didn't work and was deprecated in 10.3.0.)
Add methods for copying form fields
2021-02-22 22:44:13 +00:00
* Add QPDFFormFieldObjectHelper::getTopLevelField to get the
top-level field for a given form field.
Update pdf-overlay-page example to copy annotations
2021-02-22 21:09:02 +00:00
* Update pdf-overlay-page example to include copying of
annotations.
Add new placeFormXObject that takes a matrix reference
2021-02-22 21:02:47 +00:00
* Add a new version of QPDFPageObjectHelper::placeFormXObject that
initializes the transformation matrix that was used so you don't
have to call both placeFormXObject and
getMatrixForFormXObjectPlacement.
Enhance QPDFMatrix API
2021-02-21 10:11:31 +00:00
2021-02-21 Jay Berkenbilt <ejb@ql.org>
Add copyAnnotations, use with overlay/underlay (fixes #395)
2021-02-21 21:14:52 +00:00
* From qpdf CLI, --overlay and --underlay will copy annotations
and form fields from overlay/underlay file. Fixes #395.
* Add QPDFPageObjectHelper::copyAnnotations, which copies
annotations and, if applicable, associated form fields, from one
page to another, possibly transforming the rectangles.
Add transformAnnotations and fix flattenRotations to use it
2021-02-21 21:06:58 +00:00
* Bug fix: --flatten-rotation now applies the required
transformation to annotations on the page.
* Add QPDFAcroFormDocumentHelper::transformAnnotations to apply a
transformation to a group of annotations.
Add QPDFObjGen::unparse
2021-02-21 21:09:16 +00:00
* Add QPDFObjGen::unparse()
QPDFObjectHandle::copyStream
2021-02-21 11:35:53 +00:00
* Add QPDFObjectHandle::copyStream() for making a copy of a stream
within the same QPDF instance.
Enhance QPDFMatrix API
2021-02-21 10:11:31 +00:00
* Allow QPDFObjectHandle::newArray and
QPDFObjectHandle::newFromMatrix take QPDFMatrix as well as
QPDFObjectHandle::Matrix
* Make member variables a--f of QPDFMatrix public
Allow --rotate=0
2021-02-20 21:28:58 +00:00
2021-02-20 Jay Berkenbilt <ejb@ql.org>
* Allow --rotate=0 to clear rotation from a page.
Add file attachment example
2021-02-18 01:14:04 +00:00
2021-02-18 Jay Berkenbilt <ejb@ql.org>
Add QPDFAcroFormDocumentHelper::addFormField
2021-02-18 16:18:24 +00:00
* Add QPDFAcroFormDocumentHelper::addFormField, which adds a new
form field, initializing the AcroForm dictionary if needed.
Add QPDFPageObjectHelper::getMatrixForFormXObjectPlacement
2021-02-18 14:14:05 +00:00
* Add QPDFPageObjectHelper::getMatrixForFormXObjectPlacement,
which returns the transformation matrix required to map from a
form field's coordinate system into a specific rectangle within
the page.
Add QUtil::path_basename
2021-02-18 12:55:39 +00:00
* Add QUtil::path_basename to get last element of a path.
Add file attachment example
2021-02-18 01:14:04 +00:00
* Add examples/pdf-attach-file.cc to illustrate new file
attachment method and also new parse that takes indirect objects.
Add numeric argument to --collate This takes pages from the file in groups of n with default = 1. This partially fixes the enhancement in issue #505 but doesn't implement the entire suggestion.
2021-02-18 01:04:55 +00:00
2021-02-17 Jay Berkenbilt <ejb@ql.org>
* Allow optional numeric argument to --collate. If --collate=n is
given, pull n pages from the first file, n pages from the second
file, etc., until we run out of pages.
Add QPDFObjectHandle::parse for strings with context
2021-02-15 16:32:56 +00:00
2021-02-15 Jay Berkenbilt <ejb@ql.org>
* Add a version of QPDFObjectHandle::parse that takes a QPDF* as
context so that it can parse strings containing indirect object
references.
Add functional versions of QPDFObjectHandle::replaceStreamData Also fix a bug in checking consistency of length for stream data providers. Length should not be checked or recorded if the provider says it failed to generate the data.
2021-02-14 19:04:40 +00:00
2021-02-14 Jay Berkenbilt <ejb@ql.org>
* Add new versions of QPDFObjectHandle::replaceStreamData that
take std::function objects for cases when you need something
between a static string and a full-fledged StreamDataProvider.
Using this with QUtil::file_provider is a very easy way to create
a stream from the contents of a file.
QUtil::double_to_string: trim trailing zeroes with option to disable
2021-02-12 08:44:12 +00:00
2021-02-12 Jay Berkenbilt <ejb@ql.org>
Move QPDFMatrix into the public API
2021-02-12 09:44:15 +00:00
* Move formerly internal QPDFMatrix class to the public API. This
class provides convenience methods for working with transformation
matrices.
QUtil::double_to_string: trim trailing zeroes with option to disable
2021-02-12 08:44:12 +00:00
* QUtil::double_to_string: trim trailing zeroes by default, and
add option to not trim trailing zeroes. This causes a syntactic
but semantically preserving change in output when doubles are
converted to strings. The library uses double_to_string in only a
few places. In practice, output will be different (trailing zeroes
removed) in code that creates form XObjects (mostly generation of
appearance streams for form fields as well as overlay and
underlay) and in the flatten rotation code that was added in qpdf
10.1.
Add CLI support for working with attachments
2021-02-09 20:30:56 +00:00
2021-02-10 Jay Berkenbilt <ejb@ql.org>
Require C++14 instead of C++11
2021-02-10 19:26:54 +00:00
* Require a C++-14 compiler.
Fix loop in QPDFOutlineDocumentHelper (fuzz issue 30507)
2021-02-10 21:26:32 +00:00
* Detect loops when adding when reading outlines dictionary upon
initialization of QPDFOutlineDocumentHelper (fuzz issue 30507).
Add attachment information to the json output
2021-02-10 20:35:01 +00:00
* Add "attachments" as an additional json key, and add some
information about attachments to the json output.
Add CLI support for working with attachments
2021-02-09 20:30:56 +00:00
* Add new command-line arguments for operating on attachments:
--list-attachments, --add-attachment, --remove-attachment,
--copy-attachments-from. See --help and manual for details.
Add QUtil methods for dealing with PDF timestamp strings
2021-02-09 19:56:35 +00:00
2021-02-09 Jay Berkenbilt <ejb@ql.org>
* Add methods to QUtil for working with PDF timestamp strings:
pdf_time_to_qpdf_time, qpdf_time_to_pdf_time,
get_current_qpdf_time.
Implement helpers for file attachments
2021-02-08 23:07:21 +00:00
2021-02-08 Jay Berkenbilt <ejb@ql.org>
* Add helper classes for file attachments:
QPDFEmbeddedFileDocumentHelper, QPDFFileSpecObjectHelper,
QPDFEFStreamObjectHelper. See their header files for details.
Add QUtil::pipe_file and QUtil::file_provider
2021-02-07 21:54:16 +00:00
2021-02-07 Jay Berkenbilt <ejb@ql.org>
* Add new functions QUtil::pipe_file and QUtil::file_provider for
sending the contents of a file through a pipeline as binary data.
Require --allow-insecure to create certain encrypted files (fixes #501) For now, --allow-insecure allows creation of files with the owner passwords empty or matching the user password.
2021-02-04 20:55:41 +00:00
2021-02-04 Jay Berkenbilt <ejb@ql.org>
Spell check
2021-02-23 14:23:35 +00:00
* Add new option --password-file=file for reading the decryption
Add --password-file=filename option (fixes #499)
2021-02-04 21:46:59 +00:00
password from a file. file may be "-" to read from standard input.
Fixes #499.
Require --allow-insecure to create certain encrypted files (fixes #501) For now, --allow-insecure allows creation of files with the owner passwords empty or matching the user password.
2021-02-04 20:55:41 +00:00
* By default, give an error if a user attempts to encrypt a file
Better fix to insecure password check (fixes #501)
2021-02-05 01:32:00 +00:00
with a 256-bit key, a non-empty user password, and an empty owner
password. Such files are insecure since they can be opened with no
password. To allow explicit creation of files like this, pass the
new --allow-insecure option. Thanks to github user RobK88 for a
detailed analysis and for reporting this issue. Fixes #501.
Require --allow-insecure to create certain encrypted files (fixes #501) For now, --allow-insecure allows creation of files with the owner passwords empty or matching the user password.
2021-02-04 20:55:41 +00:00
Handle older PDFs whose form XObjects inherit resources (fixes #494) When removing unreferenced resources, notice if a page (recursively) contains a form XObject with unreferenced resources, and count any such resources as referenced by the page.
2021-02-02 20:55:18 +00:00
2021-02-02 Jay Berkenbilt <ejb@ql.org>
* Bug fix: if a form XObject lacks a resources dictionary,
consider any names in that form XObject to be referenced from the
containing page. This is compliant with older PDF versions. Also
detect if any form XObjects have any unresolved names and, if so,
don't remove unreferenced resources from them or from the page
that contains them. Fixes #494.
Handle strings in inline image dictionaries We need to use token.getRawValue, not token.getValue
2021-01-31 12:47:43 +00:00
2021-01-31 Jay Berkenbilt <ejb@ql.org>
* Bug fix: properly handle strings if they appear in inline image
dictionaries while externalizing inline images.
Add example of name/number trees and dictionary/array iteration
2021-01-30 12:34:08 +00:00
2021-01-30 Jay Berkenbilt <ejb@ql.org>
* Add examples/pdf-name-number-tree.cc to illustrate new
name/number tree API and new array/dictionary iterator API.
Make QPDFObjectHandle::is* return false for uninitialized objects
2021-01-29 15:17:13 +00:00
2021-01-29 Jay Berkenbilt <ejb@ql.org>
Change from QPDF{Array,Dict}Items to aitems() and ditems()
2021-02-22 16:02:18 +00:00
* Add methods to QPDFObjectHandle that provide a C++ iterator API,
including C++11 range-for iteration, over arrays and dictionaries.
With this, you can do
Add C++ iterator API around array and dictionary objects
2021-01-29 15:02:05 +00:00
Change from QPDF{Array,Dict}Items to aitems() and ditems()
2021-02-22 16:02:18 +00:00
for (auto i: dict_oh.ditems())
Add C++ iterator API around array and dictionary objects
2021-01-29 15:02:05 +00:00
{
// i.first is a string, i.second is a QPDFObjectHandle
}
Change from QPDF{Array,Dict}Items to aitems() and ditems()
2021-02-22 16:02:18 +00:00
for (auto i: array_oh.aitems())
Add C++ iterator API around array and dictionary objects
2021-01-29 15:02:05 +00:00
{
// i is a QPDFObjectHandle
}
Make QPDFObjectHandle::is* return false for uninitialized objects
2021-01-29 15:17:13 +00:00
* QPDFObjectHandle::is* methods to check type now return false on
uninitialized objects rather than crashing or throwing a logic
error.
name/number trees: remove
2021-01-24 16:48:46 +00:00
2021-01-24 Jay Berkenbilt <ejb@ql.org>
* Implement remove for name and number trees as well as exposing
remove and insertAfter methods for iterators. With this addition,
qpdf now has robust read/write support for name and number trees.
QPDFObjectHandle::newUnicodeString to uses UTF-16 only when needed Use the first of ASCII, PDFDocEncoding, or UTF-16 that is capable of encoding the string.
2021-01-23 22:58:23 +00:00
2021-01-23 Jay Berkenbilt <ejb@ql.org>
Implement repair and insert for name/number trees
2021-01-23 23:33:55 +00:00
* Add an insert method to QPDFNameTreeObjectHelper and
QPDFNumberTreeObjectHelper.
* QPDFNameTreeObjectHelper and QPDFNumberTreeObjectHelper will
automatically repair broken name and number trees by default. This
behavior can be turned off.
QPDFObjectHandle::newUnicodeString to uses UTF-16 only when needed Use the first of ASCII, PDFDocEncoding, or UTF-16 that is capable of encoding the string.
2021-01-23 22:58:23 +00:00
* Change behavior of QPDFObjectHandle::newUnicodeString so that it
encodes ASCII or PDFDocEncoding if those encodings will support
all the characters in the string, resorting to UTF-16 only if the
other encodings are insufficient. This is a cleaner implementation
of the intention of encoding strings for use outside of contents
and results in fewer instances of ASCII strings being needlessly
encoded as UTF-16. This change may cause qpdf to generate
different output from the same input when form field values are
set using methods from QPDFFormFieldObjectHelper.
Add warn() to QPDF's public API
2021-01-16 23:35:04 +00:00
2021-01-16 Jay Berkenbilt <ejb@ql.org>
Add new constructors for name/number tree helpers Add constructors that take a QPDF object so we can issue warnings and create new indirect objects.
2021-01-16 23:35:30 +00:00
* Add new constructors for QPDFNameTreeObjectHelper and
QPDFNumberTreeObjectHelper that take a QPDF object so they can
create indirect objects and issue warnings. The old constructors
are deprecated and will be removed in qpdf 11. Just pass in the
owning QPDF of the object handle used to initialize the helpers.
Use QPDFNameTreeObjectHelper's iterator directly
2021-01-16 17:11:35 +00:00
* Re-implement QPDFNameTreeObjectHelper and
QPDFNumberTreeObjectHelper to be much more efficient and to have
an iterator-based API in addition to the existing one. This makes
it possible to use "range-for" loops over these helpers and to
iterate through name and number trees without creating a map
containing all the keys and values, which is slow and potentially
consumes a lot of memory.
Add warn() to QPDF's public API
2021-01-16 23:35:04 +00:00
* Add warn() to QPDF's public API.
Treat /EmbeddedFiles as a proper name tree If we ever had an encrypted file with different filters for attachments and either the /EmbeddedFiles name tree was deep or some of the file specs didn't have /Type, we would have overlooked those as attachment streams. The code now properly handles /EmbeddedFiles as a name tree.
2021-01-11 15:50:39 +00:00
2021-01-11 Jay Berkenbilt <ejb@ql.org>
* Fix very old error in code that was finding attachment streams.
Probably this error never mattered, but the code was still not
exactly right.
Warn rather than segv on access after closing input source (fixes #495)
2021-01-06 14:49:10 +00:00
2021-01-06 Jay Berkenbilt <ejb@ql.org>
* Give warnings instead of segfaulting if a QPDF operation is
attempted after calling closeInputSource(). Fixes #495.
Prepare version 10.1.0
2021-01-04 21:59:55 +00:00
2021-01-05 Jay Berkenbilt <ejb@ql.org>
* 10.1.0: release
Fix some pipelines to be safe if downstream write fails (fuzz issue 28262)
2021-01-04 16:55:28 +00:00
2021-01-04 Jay Berkenbilt <ejb@ql.org>
Remove unreferenced resources only from relevant pages
2021-01-04 19:56:44 +00:00
* When qpdf CLI extracts pages, it now only attempts to remove
Spell check
2021-01-04 21:09:33 +00:00
unreferenced resources from the pages that it is keeping. This
Remove unreferenced resources only from relevant pages
2021-01-04 19:56:44 +00:00
change dramatically reduces the time it takes to extract a small
number of pages from a large, complex file.
Fix some pipelines to be safe if downstream write fails (fuzz issue 28262)
2021-01-04 16:55:28 +00:00
* Move getNext()->write() calls in some pipelines to ensure that
state gates properly reset even if the next pipeline's write
throws an exception (fuzz issue 28262).
Fix zsh completion arguments (fixes #473)
2021-01-03 21:46:54 +00:00
2021-01-03 Jay Berkenbilt <ejb@ql.org>
* Don't include -o nospace with zsh completion setup so file
completion works normally. Fixes #473.
Externalize inline images now includes form XObjects
2021-01-02 14:47:27 +00:00
2021-01-02 Jay Berkenbilt <ejb@ql.org>
Make more QPDFPageObjectHelper methods work with form XObject
2021-01-02 19:05:17 +00:00
* Make QPDFPageObjectHelper methods pipeContents, parseContents,
and addContentTokenFilter work with form XObjects.
* Rename some QPDFPageObjectHelper methods and make them support
form XObjects as well as pages. The old names will be preserved
from compatibility.
- pipePageContents -> pipeContents
- parsePageContents -> parseContents
* Add QPDFObjectHandle::parseAsContents to apply ParserCallbacks
to a form XObject.
Externalize inline images now includes form XObjects
2021-01-02 14:47:27 +00:00
* QPDFPageObjectHelper::externalizeInlineImages can be called with
form XObjects as well as pages.
* Bug fix: QPDFPageObjectHelper::externalizeInlineImages was not
descending into form XObjects on a page. It now does this by
default. In the extremely unlikely event that anyone was actually
depending on the old behavior, it is available by passing
shallow=true to the externalizeInlineImages call.
* Bug fix: QPDFObjectHandle::filterPageContents was broken for
pages with an array of content streams. This caused
externalize-inline-images to also be broken for this case.
Add several methods for working with form XObjects (fixes #436) Make some more methods in QPDFPageObjectHelper work with form XObjects, provide forEach methods to walk through nested form XObjects, possibly recursively. This should make it easier to work with form XObjects from user code.
2021-01-01 12:31:54 +00:00
2021-01-01 Jay Berkenbilt <ejb@ql.org>
* Add methods to QPDFPageObjectHelper: forEachXObject,
forEachImage, forEachFormXObject to call a function on each
XObject (or image or form XObject) in a page or form XObject,
possibly recursing into nested form XObjects.
* Add method QPDFPageObjectHelper::getFormXObjects to return a map
of keys to form XObjects (non-recursively) from a page or form
XObject.
* Add method QPDFObjectHandle::isImage to test whether an object
is an image.
Add QPDFObjectHandle::isFormXObject
2020-12-31 18:05:02 +00:00
2020-12-31 Jay Berkenbilt <ejb@ql.org>
QPDFPageObjectHelper::removeUnreferencedResources works with form XObjects
2020-12-31 19:06:18 +00:00
* QPDFPageObjectHelper::removeUnreferencedResources can now be
called with a QPDFPageObjectHelper created from a form XObject.
The method already recursed into form XObjects.
QPDFPageObjectHelper: filterPageContents -> filterContents + form XObject
2020-12-31 18:57:21 +00:00
* Rename some QPDFPageObjectHelper methods and make them support
form XObjects as well as pages. The old names will be preserved
from compatibility.
- getPageImages -> getImages
- filterPageContents -> filterContents
QPDFPageObjectHelper: getPageImages -> getImages
2020-12-31 18:23:49 +00:00
Add QPDFObjectHandle::isFormXObject
2020-12-31 18:05:02 +00:00
* Add QPDFObjectHandle::isFormXObject to test whether an object is
a form XObject.
Add QPDFPageObjectHelper::flattenRotation and --flatten-rotation
2020-12-30 17:51:04 +00:00
2020-12-30 Jay Berkenbilt <ejb@ql.org>
* Add QPDFPageObjectHelper::flattenRotation and --flatten-rotation
option to the qpdf CLI. The flattenRotation method removes any
/Rotate key from a page dictionary and implements the same
rotation by modifying the page's contents such that the various
page boxes are altered and the page renders identically. This can
be used to work around buggy PDF applications that don't properly
handle page rotation. The --flatten-rotation option to the qpdf
CLI calls flattenRotation for every page.
Add ostream << for QPDFObjGen
2020-12-26 22:49:04 +00:00
2020-12-26 Jay Berkenbilt <ejb@ql.org>
Add QPDFObjectHandle::setFilterOnWrite
2020-12-27 00:45:01 +00:00
* Add QPDFObjectHandle::setFilterOnWrite, which can be used to
tell QPDFWriter not to filter a stream on output even if it can.
You can use this to prevent QPDFWriter from touching a stream
(either uncompressing or compressing) that you have optimized or
otherwise ensured looks exactly the way you want it, even if
decode level or stream compression would otherwise cause
QPDFWriter to modify the stream.
Add ostream << for QPDFObjGen
2020-12-26 22:49:04 +00:00
* Add ostream << for QPDFObjGen. (Don't ask why it took 7.5 years
for me to decide to do this.)
Let optimize filter stream parameters instead of making them direct Also removes preclusion of stream references in stream parameters of filterable streams and reduces write times by about 8% by eliminating an extra traversal of the objects.
2020-12-25 14:51:20 +00:00
2020-12-25 Jay Berkenbilt <ejb@ql.org>
* Refactor write code to eliminate an extra full traversal of
objects in the file and to remove assumptions that preclude stream
references from appearing in /DecodeParms of filterable streams.
This results in an approximately 8% performance reduction in write
times.
Implement user-provided stream filters Refactor QPDF_Stream to use stream filter classes to handle supported stream filters as well.
2020-12-23 11:12:49 +00:00
2020-12-23 Jay Berkenbilt <ejb@ql.org>
* Allow library users to provide their own decoders for stream
filters by deriving classes from QPDFStreamFilter and registering
them using QPDF::registerStreamFilter. Registered stream filters
provide code to validate and interpret /DecodeParms for a specific
/Filter and also to provide a pipeline that will decode. Note that
it is possible to encode to a filter type that is not supported
Add pdf-custom-filter example
2020-12-26 16:13:00 +00:00
even without this feature. See examples/pdf-custom-filter.cc for
an example of using custom stream filters.
Implement user-provided stream filters Refactor QPDF_Stream to use stream filter classes to handle supported stream filters as well.
2020-12-23 11:12:49 +00:00
Add QPDFObjectHandle::makeDirect(bool allow_streams)
2020-12-22 14:31:26 +00:00
2020-12-22 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::makeDirect(bool allow_streams) -- if
allow_streams is true, preserve indirect references to streams
rather than throwing an exception. This allows the object to be
made as direct as possible while preserving stream references.
Provide qpdf write progress reporting from C API (fixes #487)
2020-12-20 19:43:08 +00:00
2020-12-20 Jay Berkenbilt <ejb@ql.org>
* Add qpdf_register_progress_reporter method to C API,
corresponding to QPDFWriter::registerProgressReporter. Fixes #487.
Add QPDFObjectHandle manipulation to C API
2020-11-29 00:48:07 +00:00
2020-11-28 Jay Berkenbilt <ejb@ql.org>
* Add new functions to the C API for manipulating
QPDFObjectHandles. The new functions allow creation and
modification of objects, which brings a lot of additional power to
the C API. See include/qpdf/qpdf-c.h for details and
examples/pdf-c-objects.c for a simple example.
Handle negative numbers in QIntC::range_check (fuzz issue 26994)
2020-11-21 18:12:31 +00:00
2020-11-21 Jay Berkenbilt <ejb@ql.org>
Prepare 10.0.4 release
2020-11-21 18:49:22 +00:00
* 10.0.4: release
Handle negative numbers in QIntC::range_check (fuzz issue 26994)
2020-11-21 18:12:31 +00:00
* Fix QIntC::range_check to handle negative numbers properly (fuzz
issue 26994).
Treat direct page as runtime rather than logic error (fuzz issue 27393)
2020-11-11 14:50:43 +00:00
2020-11-11 Jay Berkenbilt <ejb@ql.org>
* Treat a direct page object as a runtime error rather than a
logic error since it is actually possible to create a file that
has this (fuzz issue 27393).
Small enhancement to --pages argument parsing
2020-11-09 16:12:34 +00:00
2020-11-09 Jay Berkenbilt <ejb@ql.org>
* Handle "." appearing in --pages not preceded by a numeric range
Spell check
2020-11-21 16:22:05 +00:00
as a special case in command-line parsing code.
Small enhancement to --pages argument parsing
2020-11-09 16:12:34 +00:00
Ignore unused field in xref entry, avoiding range error (fixes #482)
2020-11-04 12:46:46 +00:00
2020-11-04 Jay Berkenbilt <ejb@ql.org>
* Ignore the value of the offset/generation field in an xref entry
for a deleted object. Also attempt file recovery on lower-level
exceptions thrown while reading the xref table. Fixes #482.
Fix foreign stream copying bug (fixes #478) This reverts an incorrect fix to #449 and codes it properly. The real problem was that we were looking at the local dictionaries rather than the foreign dictionaries when saving the foreign stream data. In the case of direct objects, these happened to be the same, but in the case of indirect objects, the object references could be pointing anywhere since object numbers don't match up between the old and new files.
2020-10-31 15:43:31 +00:00
2020-10-31 Jay Berkenbilt <ejb@ql.org>
Prepare 10.0.3 release
2020-10-31 17:45:35 +00:00
* 10.0.3: release
Fix stack overflow on direct root (fuzz issue 26761)
2020-10-31 17:10:39 +00:00
* Don't enter extension initialization in QPDFWriter on a direct
object. Fixes stack overflow in pathological case of /Root being a
direct object (fuzz issue 26761).
Fix foreign stream copying bug (fixes #478) This reverts an incorrect fix to #449 and codes it properly. The real problem was that we were looking at the local dictionaries rather than the foreign dictionaries when saving the foreign stream data. In the case of direct objects, these happened to be the same, but in the case of indirect objects, the object references could be pointing anywhere since object numbers don't match up between the old and new files.
2020-10-31 15:43:31 +00:00
* My previous fix to #449 (handling foreign streams with indirect
objects in /Filter and/or /DecodeParms) was incorrect and caused
other problems. There is a now a correct fix to the original
problem. Fixes #478.
Prepare 10.0.2 release
2020-10-27 15:50:02 +00:00
2020-10-27 Jay Berkenbilt <ejb@ql.org>
* 10.0.2: release
Build Windows releases with openssl; automate external libraries External libraries for Windows are now built automatically in the qpdf/external-libs repository and include openssl in addition to zlib and jpeg. Use these, and update the Windows build to build with the openssl crypto provider by default. We leave the native crypto provider enabled in case there is a problem with openssl and also to continue to exercise that code.
2020-10-24 23:31:09 +00:00
2020-10-25 Jay Berkenbilt <ejb@ql.org>
Use sha256 for signing release files
2020-10-25 21:59:34 +00:00
* When signing distribution files, generate sha256 checksums
instead of md5, sha1, and sha512. sha256 seems to be more widely
used, and there's no reason to use md5 or sha1 anymore.
Build Windows releases with openssl; automate external libraries External libraries for Windows are now built automatically in the qpdf/external-libs repository and include openssl in addition to zlib and jpeg. Use these, and update the Windows build to build with the openssl crypto provider by default. We leave the native crypto provider enabled in case there is a problem with openssl and also to continue to exercise that code.
2020-10-24 23:31:09 +00:00
* Official Windows releases are now built using the openssl crypto
provider. The native provider is still available for selection at
runtime using the QPDF_CRYPTO_PROVIDER environment variable.
Add some missing ChangeLog entries
2020-10-26 15:51:33 +00:00
* Bug fix: --no-warn was not suppressing some warnings that might
be generated by --split-pages.
Fix fix-qdf for empty streams
2020-10-23 08:02:53 +00:00
2020-10-23 Jay Berkenbilt <ejb@ql.org>
Avoid merging adjacent tokens when concatenating contents (fixes #444)
2020-10-23 10:40:27 +00:00
* Bug fix: when concatenating content streams, insert a newline if
needed to prevent the last token from the old stream from being
merged with the first token of the new stream. Qpdf was mistakenly
concatenating the streams without regard to the specification that
content streams are to be broken on token boundaries. Fixes #444.
Add some missing ChangeLog entries
2020-10-26 15:51:33 +00:00
* fix-qdf: handle empty streams better with ignore newline by
treating them as empty even though, technically, a blank line
would be required inside the Stream. This just makes it easier to
add place-holder empty streams while editing qdf files by hand.
Fix fix-qdf for empty streams
2020-10-23 08:02:53 +00:00
Fix loop detection error (fuzz issue 23172)
2020-10-22 09:11:58 +00:00
2020-10-22 Jay Berkenbilt <ejb@ql.org>
Add some missing ChangeLog entries
2020-10-26 15:51:33 +00:00
* Fix memory leak that could occur if objects in object streams
were resolved more than once and the objects within the object
streams contained circular references. This leak could be
triggered when qpdf was run with --object-streams=generate on
files that already had object streams containing circular
references (fuzz issue 23642).
* Add QIntC::range_check for checking to see whether adding two
numbers together will cause an overflow.
Fix loop detection error (fuzz issue 23172)
2020-10-22 09:11:58 +00:00
* Fix loop detection problem when traversing page thumbnails
during optimization (fuzz issue 23172).
Create a minimal Linux binary distribution (fixes #352) This is suitable for use as a Lambda layer in AWS, inclusion in a docker container, or other places where a minimal binary distribution is desired.
2020-10-21 14:07:34 +00:00
2020-10-21 Jay Berkenbilt <ejb@ql.org>
Obscure bug fix copying foreign streams in special cases (fixes #449) Specifically, if a stream had its stream data replaced and had indirect /Filter or /DecodeParms, it would result in non-silent loss of data and/or internal error.
2020-10-21 22:50:29 +00:00
* Bug fix: properly handle copying foreign streams that have
indirect /Filter or /DecodeParms keys when stream data has been
replaced. The circumstances leading to this bug are very unusual
but would cause qpdf to either generate an internal error or some
other kind of warning situation if it would occur. Fixes #449.
Turn off azure pipelines, completing migration to GitHub Actions
2020-10-21 19:33:20 +00:00
* Qpdf's build and CI has been migrated from Azure Pipelines
Spell check
2020-10-26 23:42:23 +00:00
(Azure DevOps) to GitHub Actions.
Turn off azure pipelines, completing migration to GitHub Actions
2020-10-21 19:33:20 +00:00
Add some missing ChangeLog entries
2020-10-26 15:51:33 +00:00
* Remove some fuzz files that triggered Mal/PDFEx-H with some
virus scanners. There's plenty of coverage in the fuzz corpus
without these files, and it's a nuisance to have virus checkers
remove them. Fixes #460.
Protect numeric conversion against user's locale (fixes #459)
2020-10-21 19:29:28 +00:00
* Ensure that numeric conversion is not affected by the user's
global locale setting. Fixes #459.
Create a minimal Linux binary distribution (fixes #352) This is suitable for use as a Lambda layer in AWS, inclusion in a docker container, or other places where a minimal binary distribution is desired.
2020-10-21 14:07:34 +00:00
* Add qpdf-<version>-linux-x86_64.zip to the list of built
distributions. This is a simple zip file that contains just the
qpdf executables and the dependent shared libraries that would not
ordinarily be present on a base system. This minimal binary
distribution works as is when used as a Lambda layer in AWS and
could be suitable for inclusion in a docker image or other
standalone Linux/x86_64 environment where you want minimal support
for running the qpdf executable. Fixes #352.
Add --disable-rpath to configure (fixes #422)
2020-10-20 21:17:46 +00:00
2020-10-20 Jay Berkenbilt <ejb@ql.org>
Add option --warning-exit-0 to exit 0 instead of 3 with warnings
2020-10-20 21:58:47 +00:00
* Add --warning-exit-0 option to the qpdf command line. When
specified, qpdf will exit with a status of 0 rather than 3 when
there are warnings without errors. Combine with --no-warn to
completely ignore warnings.
* Bug fix: fix further cases in which errors were written to
stdout. Fixes #438.
Add --disable-rpath to configure (fixes #422)
2020-10-20 21:17:46 +00:00
* Build option: add --disable-rpath option to ./configure, which
disables passing -rpath to the linker when building shared
libraries with libtool. Fixes #422.
Minor notes on GitHub Actions migration
2020-10-16 21:52:43 +00:00
2020-10-16 Jay Berkenbilt <ejb@ql.org>
TODO and ChangeLog updates from merged pull requests
2020-10-17 00:15:14 +00:00
* Accept pull request that improves how the Windows native crypto
provider is obtained.
* Accept pull request that improves performance in processing
files in memory.
* Accept pull requests that improve openssl configuration and
error reporting.
Minor notes on GitHub Actions migration
2020-10-16 21:52:43 +00:00
* Build using GitHub Actions. The intention is that this will
replace Azure Pipelines as the official CI for qpdf for the next
release.
Add some missing ChangeLog entries
2020-10-26 15:51:33 +00:00
2020-10-15 Jay Berkenbilt <ejb@ql.org>
* Make many minor improvements to the build process and code
health, including fixing a lgtm warning and compiler warnings from
newer version of gcc and MSVC toolchains. Add several cosmetic
improvements to build output in CI.
Release notes for 10.0.2
2020-10-26 23:39:36 +00:00
* Added LL_FMT to config.h.in. This is populated automatically by
autoconf, but if build with your own build system, you may need to
define it as whatever the format string needed by printf for long
long is. Usually this is "%lld", but it can be "%I64d" for some
older Windows-based compilers.
Write linearization errors to stderr (fixes #438)
2020-04-29 21:33:11 +00:00
2020-04-29 Jay Berkenbilt <ejb@ql.org>
* Bug fix: qpdf --check was writing errors and warnings reported
by checkLinearization to stdout instead of stderr. Fixes #438.
Prepare 10.0.1 release
2020-04-09 15:48:26 +00:00
2020-04-09 Jay Berkenbilt <ejb@ql.org>
* 10.0.1: release
Bug fix: getStreamData should on unfilterable stream (fixes #425)
2020-04-08 22:47:29 +00:00
2020-04-08 Jay Berkenbilt <ejb@ql.org>
* Bug fix: qpdf 10.0.0 introduced a bug in which
QPDFObjectHandle::getStreamData would return the raw data when
called on an unfilterable stream instead of throwing an exception
like it's supposed to. Fixes #425.
Improve pdf-invert-images example
2020-04-07 22:11:00 +00:00
2020-04-07 Jay Berkenbilt <ejb@ql.org>
* Improve pdf-invert-images example to show a pattern of copying
streams into another QPDF object to enable a stream data provider
to access the original stream data.
* Fix error that caused a compilation error with clang. Fixes
#424.
Update ChangeLog and manual for openssl crypto provider
2020-04-06 13:24:12 +00:00
2020-04-06 Jay Berkenbilt <ejb@ql.org>
Prepare 10.0.0 release
2020-04-06 15:27:01 +00:00
* 10.0.0: release
Delegate random number generation to crypto provider (fixes #418)
2020-04-06 14:19:37 +00:00
* Move random number generation into the crypto providers. The old
os-based secure random number generation with fallback to insecure
random number generation (only if allowed at build time) has moved
into the native crypto provider. If using other providers
(currently gnutls or openssl), random number generation will use
those libraries. The old interfaces for supplying your own random
number generator are still in place. Fixes #418.
Remove QUtil::srandom
2020-04-06 13:49:02 +00:00
* Source-level incompatibility: remove QUtil::srandom. There was
no reason to ever call this, and it didn't do anything unless
insecure random number generation was compiled in, which it is not
by default. If you were calling this, just remove the call because
it wasn't doing anything anyway.
Update ChangeLog and manual for openssl crypto provider
2020-04-06 13:24:12 +00:00
* Add openssl crypto provider, contributed by Dean Scarff. This
provider is implemented using OpenSSL and also works with
BoringSSL.
Add --remove-unreferenced-resources option
2020-04-04 15:32:27 +00:00
2020-04-04 Jay Berkenbilt <ejb@ql.org>
Allow propagation of errors and retry through StreamDataProvider StreamDataProvider::provideStreamData now has a rich enough API for it to effectively proxy to pipeStreamData.
2020-04-05 03:35:35 +00:00
* Add a new provideStreamData method for StreamDataProvider that
allows a success code to be returned and that accepts the
suppress_warnings and will_retry methods. This makes it possible
to have a StreamDataProvider call pipeStreamData and propagate its
results back. This change allows better error handling and
recovery when objects are copied from other files and when
"immediate copy from" is enabled.
Correction to ChangeLog
2020-04-07 21:54:47 +00:00
* When copying foreign streams, the same type of recovery from
streams with filtering errors is performed as when dealing with
streams in the original input. This could happen, for example, if
you are using the --pages option to take pages from another file
and that file has errors in it.
Fixes to ChangeLog and manual for 10.0.0 changes
2020-04-06 01:46:21 +00:00
Allow propagation of errors and retry through StreamDataProvider StreamDataProvider::provideStreamData now has a rich enough API for it to effectively proxy to pipeStreamData.
2020-04-05 03:35:35 +00:00
* Add a new version of QPDFObjectHandle::pipeStreamData whose
return value indicates overall success or failure rather than
whether nor not filtering was attempted. It should have always
been this way. This change was done in a backward-compatible
fashion. Previously existing pipeStreamData methods' return values
mean the same as always.
Add objectinfo to json
2020-04-04 21:59:53 +00:00
* Add "objectinfo" section to json output. In this release,
information about whether each object is a stream or not is
provided. There's otherwise no way to tell conclusively from the
json output. Over time, other computed information about objects
may be added here.
Add --remove-unreferenced-resources option
2020-04-04 15:32:27 +00:00
* Add new option --remove-unreferenced-resources that takes auto,
yes, or no as options. This tells qpdf whether to attempt to
remove unreferenced resources from pages when doing page splitting
operations. Prior to this change, the default was to attempt to
remove unreferenced resources, but this operation was very slow,
especially for large and complex files. The new default is "auto",
which tells qpdf to analyze the file for shared resources. This is
a relatively quick test. If no shared resources are found, then we
don't attempt to remove unreferenced resources, because
unreferenced resources never occur in files without shared
resources. To force qpdf to look for and remove unreferenced
resources, use --remove-unreferenced-resources=yes. The option
--preserve-unreferenced-resources is now a synonym for
--remove-unreferenced-resources=no.
Fixes to ChangeLog and manual for 10.0.0 changes
2020-04-06 01:46:21 +00:00
* Use std::atomic for unique ID generation internally within the
library. This eliminates the already extremely low chance of a
collision, improves thread safety, and removes a dependency on a
random number generator. Thanks to Dean Scarff for the
contribution.
placeFormXObject: allow control of shrink/expand (fixes #409)
2020-04-03 20:48:20 +00:00
2020-04-03 Jay Berkenbilt <ejb@ql.org>
Allow qpdf to be built on systems without wchar_t (fixes #406)
2020-04-04 01:34:45 +00:00
* Allow qpdf to be built on systems without wchar_t. All "normal"
systems have wchar_t because it is part of the C++ standard, but
there are some stripped down environments that don't have it. See
README.md (search for wchar_t) for instructions and a discussion.
Fixes #406.
placeFormXObject: allow control of shrink/expand (fixes #409)
2020-04-03 20:48:20 +00:00
* Add two extra optional arguments to
QPDFPageObjectHelper::placeFormXObject to control whether the
placed item is allowed to be shrunk or expanded to fit within or
maximally fill the destination rectangle. Prior to this change,
placeFormXObject might shrink it but would never expand it.
Fixes to ChangeLog and manual for 10.0.0 changes
2020-04-06 01:46:21 +00:00
* When calling the C API, accept any non-zero value as TRUE rather
than just 1. This appears to resolve issues on Windows when
calling some versions of the DLL directly from other languages.
Performance: remove Members indirection for QPDFObjectHandle
2020-04-02 19:14:53 +00:00
2020-04-02 Jay Berkenbilt <ejb@ql.org>
Add QPDFObjectHandle::unsafeShallowCopy
2020-04-02 21:52:21 +00:00
* Add method QPDFObjectHandle::unsafeShallowCopy for copying only
top-level dictionary keys or array items. See comments in
QPDFObjectHandle.hh for when this should be used.
Performance: remove Members indirection for QPDFObjectHandle
2020-04-02 19:14:53 +00:00
* Remove Members class indirection for QPDFObjectHandle. Those are
copied and assigned too often, and that change caused a very
substantial performance hit.
Use QPDF_EXECUTABLE as a hint for completion
2020-03-31 15:38:05 +00:00
2020-03-31 Jay Berkenbilt <ejb@ql.org>
Look in form XObjects when removing unreferenced resources (fixes #373) If a page contains a form XObject, also filter the form XObject and remove its unreferenced resources.
2020-03-31 16:58:06 +00:00
* When detecting unreferenced images during page splitting, if any
XObjects are form XObjects, recursively descend into them and
remove any unreferenced objects from them too. Fixes #373.
Refactor QPDFPageObjectHelper::removeUnreferencedResources() Refactor removeUnreferencedResources to prepare for filtering form XObjects.
2020-03-31 16:28:54 +00:00
* Add QPDFObjectHandle::filterAsContents, which filters a stream's
data as if it were page contents. This can be useful to filter
form XObjects the same way we would filter page contents.
Use QPDF_EXECUTABLE as a hint for completion
2020-03-31 15:38:05 +00:00
* If QPDF_EXECUTABLE is set, use it as the path to qpdf for
purposes of completion. This variable is only read during the
Spell check
2020-04-06 15:22:57 +00:00
execution of `qpdf --completion-zsh` and `qpdf
Use QPDF_EXECUTABLE as a hint for completion
2020-03-31 15:38:05 +00:00
--completion-bash`. It is not used during the actual evaluation of
completions.
Handle root /Pages pointing to other than page tree root (fixes #398)
2020-02-22 16:00:38 +00:00
2020-02-22 Jay Berkenbilt <ejb@ql.org>
Mention appearances in pdf-set-form-values example
2020-02-22 17:10:13 +00:00
* Update pdf-set-form-values.cc to use and mention
generateAppearance, which hadn't been added when the example was
originally created.
Handle root /Pages pointing to other than page tree root (fixes #398)
2020-02-22 16:00:38 +00:00
* Detect, warn, and correct the case of /Pages in the document
catalog incorrectly pointing to a page or intermediate node
instead of the root of the pages tree. Fixes #398.
Add --is-encrypted and --requires-password (fixes #390) Allow exit status-based checking of whether a file is encrypted or requires a password without necessarily supplying the correct password. Useful for scripting.
2020-01-26 14:19:50 +00:00
2020-01-26 Jay Berkenbilt <ejb@ql.org>
Prepare 9.1.1 release
2020-01-26 23:46:19 +00:00
* 9.1.1: release
In qdf mode, don't write extra XRef streams (fixes #386) fix-qdf assumes there is exactly one XRef stream and that it is at the end of the file.
2020-01-26 21:43:55 +00:00
* Bug fix: in qdf mode, do not write out any XRef streams that may
have appeared in the original file. These are usually
unreferenced, but with --preserve-unreferenced, they could be
written out, which breaks fix-qdf's assumption that there is at
most one XRef stream and that it appears at the end of the file.
Fixes #386.
Bug fix: handle ColorSpace lookup for inline images (fixes #392) If the value of /CS in the inline image dictionary was is key in the page's /Resource -> /ColorSpace dictionary, properly resolve it by referencing the proper colorspace, and not just the name, in the external image dictionary.
2020-01-26 20:07:18 +00:00
* Bug fix: when externalizing inline images, a colorspace value
that was a lookup key in the page's /Resource -> /ColorSpace
dictionary was not properly handled. Fixes #392.
Add encrypt key to json
2020-01-26 19:38:56 +00:00
* Add "encrypt" key to the json output. This contains largely the
same information as given by --show-encryption but in a
consistent, parseable format.
Add --is-encrypted and --requires-password (fixes #390) Allow exit status-based checking of whether a file is encrypted or requires a password without necessarily supplying the correct password. Useful for scripting.
2020-01-26 14:19:50 +00:00
* Add options --is-encrypted and --requires-password. These can be
used with files, including encrypted files with unknown passwords,
to determine whether or not a file is encrypted and whether a
password is required to open the file. The --requires-password
option can also be used to determine whether a supplied password
is correct. Information is supplied through exit codes, making
these options particularly useful for shell scripts. Fixes #390.
Pull wmain -> main code from qpdf.cc into QUtil.cc
2020-01-14 16:38:48 +00:00
2020-01-14 Jay Berkenbilt <ejb@ql.org>
Fix for Windows unable to acquire crypt context with new keyset (fixes #387) Fix is based on guidance https://support.microsoft.com/en-us/help/238187/cryptacquirecontext-use-and-troubleshooting and is the proper fix for #285/#286
2019-11-29 20:20:28 +00:00
* Fix for Windows being unable to acquire crypt context with a new
keyset. Thanks to Cloudmersive for the fix. Fixes #387.
Rewrite fix-qdf in C++
2020-01-03 03:01:10 +00:00
* Rewrite fix-qdf in C++. This means fix-qdf is a proper
executable now, and there is no longer a runtime requirement on
perl.
Pull wmain -> main code from qpdf.cc into QUtil.cc
2020-01-14 16:38:48 +00:00
* Add QUtil::call_main_from_wmain, a helper function that can be
called in the body of wmain to convert UTF-16 arguments to UTF-8
arguments and then call another main function.
QUtil::read_lines_from_file: optional EOL preservation
2020-01-13 14:16:43 +00:00
2020-01-13 Jay Berkenbilt <ejb@ql.org>
* QUtil::read_lines_from_file: add new versions that use FILE*,
use FILE* instead if std::ifstream internally to support correct
handling of Unicode filenames in Windows, and add the option to
preserve line endings.
Prepare 9.1.0 release
2019-11-16 19:18:09 +00:00
2019-11-17 Jay Berkenbilt <ejb@ql.org>
* 9.1.0: release
Historical note in ChangeLog I keep looking here to find out when I started requiring C++-11, and now I will find the answer in the first place I look.
2020-04-04 12:46:14 +00:00
* This is the first version of qpdf that requires C++-11.
Allow /P in encryption dictionary to be positive (fixes #382) Even though this is disallowed by the spec, files like this have been encountered in the wild.
2019-11-09 16:29:52 +00:00
2019-11-09 Jay Berkenbilt <ejb@ql.org>
Prepare 9.1.rc1 release
2019-11-10 02:10:21 +00:00
* 9.1.rc1: release
Link with setargv or wsetargv with MSVC (fixes #224) For wildcard expansion to work properly with the msvc binary, it is necessary to link with setargv.obj or wsetargv.obj, depending on whether wmain is in use.
2019-11-09 20:01:15 +00:00
* Improve behavior of wildcard expansion for msvc executable when
Fix up documentation around Windows wildcard fix
2019-11-11 01:19:38 +00:00
run from the Windows cmd.exe shell. Unlike in UNIX environments,
Windows leaves it up to the executable to expand its own
wildcards. Fixes #224.
Link with setargv or wsetargv with MSVC (fixes #224) For wildcard expansion to work properly with the msvc binary, it is necessary to link with setargv.obj or wsetargv.obj, depending on whether wmain is in use.
2019-11-09 20:01:15 +00:00
Add missing ChangeLog entry for :even and :odd
2020-02-24 17:27:46 +00:00
* Allow :even or :odd to be appended to numeric ranges for
--pages, --rotate, and other options that take page ranges.
Allow /P in encryption dictionary to be positive (fixes #382) Even though this is disallowed by the spec, files like this have been encountered in the wild.
2019-11-09 16:29:52 +00:00
* When reading /P from the encryption dictionary, use static_cast
instead of QIntC to convert the value to a signed integer. The
value of /P is a bit field, and PDF files have been found in the
wild where /P is represented as an unsigned integer even though
the spec states that it is a signed 32-bit value. By using
static_cast, we allow qpdf to compensate for writers that
incorrectly represent the correct bit field as an unsigned value.
Fixes #382.
Update docs for crypto providers
2019-11-09 13:17:54 +00:00
2019-11-05 Jay Berkenbilt <ejb@ql.org>
* Add support for pluggable crypto providers, enabling multiple
implementations of the cryptographic functions needed by qpdf.
This feature was added by request of Red Hat, which recognized the
use of qpdf's native crypto implementations as a potential
security liability, preferring instead to get all crypto
functionality from a third-party library that receives a lot of
scrutiny. However it was also important to me to not impose any
Spell check
2019-11-10 00:03:56 +00:00
unnecessary third party dependencies on my users or packagers,
Update docs for crypto providers
2019-11-09 13:17:54 +00:00
some of which build qpdf for lots of environments, some of which
may not easily support gnutls. Starting in qpdf 9.1.0, it is be
possible to build qpdf with both the native and gnutls crypto
providers or with either in isolation. In support of this feature,
new classes QPDFCryptoProvider and QPDFCryptoImpl have been added
to the public interface. See QPDFCryptoImpl.hh for details about
adding your own crypto provider and QPDFCryptoProvider.hh for
details about choosing which one is used. Note that selection of
crypto providers is invisible to anyone who doesn't explicitly
care. Neither end users nor developers have to be concerned about
it.
* The environment variable QPDF_CRYPTO_PROVIDER can be used to
override qpdf's default choice of crypto provider. The
--show-crypto flag to the qpdf CLI can be used to present a list
of supported crypto providers with the default provider always
listed first.
* Add gnutls crypto provider. Thanks to Zdenek Dohnal for
contributing the code that I ultimately used in the gnutls crypto
provider and for engaging in an extended discussion about this
feature. Fixes #218.
Add ChangeLog and documentation for signature dict enhancements
2019-10-22 20:44:27 +00:00
2019-10-22 Jay Berkenbilt <ejb@ql.org>
* Incorporate changes from Masamichi Hosoda <trueroad@trueroad.jp>
to properly handle signature in the following ways:
- Always represent /Contents in a signature dictionary as a hex
string
- Do not compress signature dictionaries when generating object
streams
- Do not encrypt/decrypt the /Contents field of the signature
dictionary when creating or reading encrypted files
* Incorporate changes from Masamichi Hosoda <trueroad@trueroad.jp>
to add additional methods for making it possible to gain deeper
insight into cross reference tables and object renumbering. These
new API calls make it possible for applications to go into PDF
files created by qpdf and make changes to them that go beyond
working with the PDF at the object level. The specific use case
for these changes was to write an external tool to perform digital
signature, but there could be other uses as well. New methods
include the following, all of which are described in their
respective headers:
- QPDF::getXRefTable()
- QPDFObjectHandle::getParsedOffset()
- QPDFWriter::getRenumberedObjGen(QPDFObjGen)
- QPDFWriter::getWrittenXRefTable()
Make --replace-input work with / in path (fixes #365)
2019-10-12 23:25:09 +00:00
2019-10-12 Jay Berkenbilt <ejb@ql.org>
Prepare 9.0.2 release
2019-10-12 23:32:08 +00:00
* 9.0.2: release
Make --replace-input work with / in path (fixes #365)
2019-10-12 23:25:09 +00:00
* Change the name of the temporary file used by --replace-input to
work with arbitrary absolute or relative paths without requiring
path splitting logic. Fixes #365.
Prepare 9.0.1 release
2019-09-20 11:37:54 +00:00
2019-09-20 Jay Berkenbilt <ejb@ql.org>
* 9.0.1: release
Warn for duplicated dictionary keys (fixes #345)
2019-09-20 00:22:34 +00:00
2019-09-19 Jay Berkenbilt <ejb@ql.org>
Correct reversed Rectangle coordinates (fixes #363)
2019-09-20 01:03:58 +00:00
* When converting an array to a Rectangle, ensure that llx <= urx
and lly <= ury. This prevents flatten-annotations from flipping
fields whose coordinates are messed up in the input. Fixes #363.
Warn for duplicated dictionary keys (fixes #345)
2019-09-20 00:22:34 +00:00
* Warn when duplicated dictionary keys are found during parsing.
The behavior remains as before: later keys override earlier ones.
However, this generates a warning now rather than being silently
ignored. Fixes #345.
Don't assume char is signed in int conversion tests (fixes #361)
2019-09-17 16:13:19 +00:00
2019-09-17 Jay Berkenbilt <ejb@ql.org>
Update release notes for upcoming 9.0.1 release
2019-09-20 01:22:55 +00:00
* Fix a few integer warnings for big-endian systems.
Don't assume char is signed in int conversion tests (fixes #361)
2019-09-17 16:13:19 +00:00
* QIntC tests: don't assume char is signed. Fixes #361.
Add remove_file and rename_file to QUtil
2019-08-31 15:00:53 +00:00
2019-08-31 Jay Berkenbilt <ejb@ql.org>
Prepare 9.0.0 release
2019-09-01 00:01:10 +00:00
* 9.0.0: release
Add methods QPDF::anyWarnings and QPDF::closeInputSource
2019-08-31 19:10:29 +00:00
* Add QPDF::anyWarnings() method to find out whether there have
been any warnings without resetting the list.
* Add QPDF::closeInputSource() method to release the input source
so the input file can be deleted or renamed.
Add remove_file and rename_file to QUtil
2019-08-31 15:00:53 +00:00
* Add methods rename_file and remove_file to QUtil.
Track separately whether password was user/owner (fixes #159)
2019-08-24 13:34:48 +00:00
2019-08-24 Jay Berkenbilt <ejb@ql.org>
* Add QPDF::userPasswordMatched() and QPDF::ownerPasswordMatched()
spell check
2019-08-31 12:43:18 +00:00
methods so it can be determined separately whether the supplied
Track separately whether password was user/owner (fixes #159)
2019-08-24 13:34:48 +00:00
password matched the user password, the owner password, or both.
Fixes #159.
Add ability to set zlib compression level globally
2019-08-23 23:54:08 +00:00
2019-08-23 Jay Berkenbilt <ejb@ql.org>
Add flags to control zlib compression level (fixes #113)
2019-08-23 23:59:38 +00:00
* Add --recompress-streams option to qpdf and
QPDFWriter::setRecompressFlate to cause QPDFWriter to recompress
streams that are already compressed with /FlateDecode.
Add ability to set zlib compression level globally
2019-08-23 23:54:08 +00:00
* Add option Pl_Flate::setCompressionLevel to globally set the
zlib compression level used by all Pl_Flate pipelines.
Add flags to control zlib compression level (fixes #113)
2019-08-23 23:59:38 +00:00
* Add --compression-level flag to qpdf to set the zlib compression
level. When combined with --recompress-flate, this will cause most
of qpdf's streams to use the maximum compression level. This
results in only a very small amount of savings in size that comes
at a fairly significant performance cost, but it could be useful
for archival files or other cases where every byte counts and
creation time doesn't matter so much. Note that using
--object-streams=generate in combination with these options gives
you the biggest advantage. Fixes #113.
Remove array null flattening For some reason, qpdf from the beginning was replacing indirect references to null with literal null in arrays even after removing the old behavior of flattening scalar references. This seems like a bad idea.
2019-08-22 17:20:36 +00:00
2019-08-22 Jay Berkenbilt <ejb@ql.org>
Pass offset and length to ParserCallbacks::handleObject
2019-08-22 23:16:25 +00:00
* In QPDFObjectHandle::ParserCallbacks, in addition to
handleObject(QPDFObjectHandle), allow developers to override
handleObject(QPDFObjectHandle, size_t offset, size_t length). If
this method appears instead, it is called with the offset of the
object in the content stream (which may be concatenated from an
array of streams) and the length of the object. Intervening
whitespace and comments are not included in offset and length.
* Add method
QPDFObjectHandle::ParserCallbacks::contentSize(size_t). If
defined, it is called by the content stream parser before the
first call to handleObject, and the argument is the total size in
bytes of the content streams.
Test for direct, rather than resolved nulls in parser Just because we know an indirect reference is null, doesn't mean we shouldn't keep it indirect.
2019-08-22 21:53:20 +00:00
* Add QPDFObjectHandle::isDirectNull() -- a const method that
allows determining whether an object is a literal null without
attempting to resolve it.
Remove array null flattening For some reason, qpdf from the beginning was replacing indirect references to null with literal null in arrays even after removing the old behavior of flattening scalar references. This seems like a bad idea.
2019-08-22 17:20:36 +00:00
* Stop replacing indirect references to null with literal null in
arrays when writing output with QPDFWriter.
Handle invalid name tokens symmetrically for PDF < 1.2 (fixes #332)
2019-08-19 01:26:19 +00:00
2019-08-19 Jay Berkenbilt <ejb@ql.org>
Accept extraneous space before xref (fixes #341)
2019-08-20 01:43:28 +00:00
* Accept (and warn for) extraneous whitespace preceding the xref
table. Fixes #341.
Accept extraneous space after stream keyword (fixes #329)
2019-08-20 01:23:39 +00:00
* Accept (and warn for) extraneous whitespace between the stream
keyword and newline. Fixes #329.
Handle invalid name tokens symmetrically for PDF < 1.2 (fixes #332)
2019-08-19 01:26:19 +00:00
* Properly handle name tokens containing # not preceding two
hexadecimal digits. Such names are invalid in PDF >= 1.2 but valid
in PDF 1.0 and 1.1. Prior to this fix, qpdf's behavior was to
treat such tokens as an error for PDF >= 1.2, but for older PDF
tokens, the name was silently accepted, and when the name token
was written out, the # was changed to #23, which is the correct
way to represent a # character. This behavior was problematic for
several reasons: one is that, ordinarily, content streams are not
parsed, so this would cause things like image references whose
names contained # to break. Also, even if the input file was 1.0
or 1.1, there's no guarantee that the output file wouldn't be
written at a new version, resulting in invalid name tokens. The
new behavior is to issue a warning upon encountering such a token
but to accept it, regardless of the PDF version. Such tokens are
written out properly as well. Additionally, the warning message
indicates that the tokens are invalid for PDF >= 1.2. Fixes #332.
* Non-compatible API change: remove
QPDFTokenizer::allowPoundAnywhereInName(). There were a lot of
problems with this. When it was used, any name tokens read would
always be modified on output, which is never the correct behavior.
This method used to signal QPDFTokenizer to not treat # specially
in name tokens, which resulted in the incorrect behavior whose fix
is described in the preceding item.
Attempt to repair /Type key in pages nodes (fixes #349)
2019-08-18 22:54:08 +00:00
2019-08-18 Jay Berkenbilt <ejb@ql.org>
* When traversing the pages tree, if an invalid /Type key is
encountered, fix it. This is not done for all operations, but it
will be done for any case in which getAllPages is called. This
includes all page-based CLI operations. (Hopefully) Fixes #349.
Array optimization fixes performance issues (fixes #305, #311)
2019-08-18 02:37:05 +00:00
2019-08-17 Jay Berkenbilt <ejb@ql.org>
* Change internal implementation of QPDF arrays to use sparse
arrays, which results in using much less memory for arrays with
large numbers of nulls. Various files have been encountered in the
wild that contains thousands of arrays with millions of nulls.
Fixes #305, #311.
Change list to vector for outline helpers (fixes #297) This change works around STL problems with Embarcadero C++ Builder version 10.2, but std::vector is more common than std::list in qpdf, and this is a relatively new API, so an API change is tolerable. Thanks to Thorsten Schöning <6223655+ams-tschoening@users.noreply.github.com> for the fix.
2019-07-03 17:34:02 +00:00
2019-07-03 Jay Berkenbilt <ejb@ql.org>
* Non-compatible API change: change
QPDFOutlineDocumentHelper::getTopLevelOutlines and
QPDFOutlineObjectHelper::getKids to return a std::vector instead
of a std::list of QPDFOutlineObjectHelper objects. This is to work
around bugs with some compilers' STL implementations that are
choking with list here. There's no deep reason for these to be
lists instead of vectors. Fixes #297.
Add QUtil::read_file_into_memory This code was essentially duplicated between test_driver and standalone_fuzz_target_runner.
2019-06-22 14:12:10 +00:00
2019-06-22 Jay Berkenbilt <ejb@ql.org>
Handle invalid encryption Length (fixes #333)
2019-06-23 00:45:10 +00:00
* Handle encrypted files with missing or invalid /Length entries
in the encryption dictionary.
Allow set*EncryptionParameters before filename iset (fixes #336)
2019-06-23 00:05:18 +00:00
* QPDFWriter: allow calling set*EncryptionParameters before
calling setFilename. Fixes #336.
Fix --completion-* args to work from AppImage (fixes #285)
2019-06-22 20:38:17 +00:00
* It now works to run --completion-bash and --completion-zsh when
qpdf is started from an AppImage.
Provide error message in Windows crypto code (fixes #286) Thanks to github user zdenop for supplying some additional error-handling code.
2019-06-22 19:32:18 +00:00
* Provided a more useful error message when Windows can't get
security context. Thanks to user zdenop for supplying some code.
Fixes #286.
In shippable code, favor smart pointers (fixes #235) Use PointerHolder in several places where manually memory allocation and deallocation were being used. This helps to protect against memory leaks when exceptions are thrown in surprising places.
2019-06-22 18:24:49 +00:00
* Favor PointerHolder over manual memory allocation in shippable
code where possible. Fixes #235.
Try to use pkg-config to find external dependencies (fixes #324)
2019-06-22 18:11:58 +00:00
* If pkg-config is available, use it to local libjpeg and zlib. If
not, fall back to old behavior. Fixes #324.
Override umask on install (fixes #326)
2019-06-22 17:28:27 +00:00
* The "make install" target explicitly sets a mode rather than
relying the user's umask. Fixes #326.
qpdf: exit 3 for linearization warnings without errors (fixes #50)
2019-06-22 17:18:26 +00:00
* When a file has linearization warnings but no errors, qpdf
--check and --check-linearization now exit with code 3 instead
of 2. Fixes #50.
Add QUtil::read_file_into_memory This code was essentially duplicated between test_driver and standalone_fuzz_target_runner.
2019-06-22 14:12:10 +00:00
* Add new function QUtil::read_file_into_memory.
Rename QUtil::strcasecmp to QUtil::str_compare_nocase (fixes #242)
2019-06-21 22:38:03 +00:00
2019-06-21 Jay Berkenbilt <ejb@ql.org>
Build with -fvisibility=hidden when supported
2019-06-22 00:27:31 +00:00
* When supported, qpdf builds with -fvisibility=hidden, which
removes non-exported symbols from the shared library in a manner
similar to how Windows DLLs work. This is better for performance
and also better for safety and protection of private interfaces.
See https://gcc.gnu.org/wiki/Visibility. *NOTE*: If you are
getting linker errors trying to catch exceptions or derive things
from a base class in the qpdf library, it's possible that a
QPDF_DLL_CLASS declaration is missing somewhere. Please report
this as a bug at https://github.com/qpdf/qpdf/issues.
Remove QPDF::copyForeignObject with unused parameter
2019-06-21 22:41:42 +00:00
* Source-level incompatibility: remove the version
QPDF::copyForeignObject with an unused boolean parameter. If you
were, for some reason, calling this, just take the parameter away.
Remove broken QPDFTokenizer::expectInlineImage
2019-06-21 22:49:09 +00:00
* Source-level incompatibility: remove the version
ChangeLog: fix errors in previous entries
2019-06-22 16:32:32 +00:00
QPDFTokenizer::expectInlineImage with no arguments. It didn't
produce correct inline images. This is a very low-level routine.
There is little reason to call it outside of qpdf's lexical
engine.
Remove broken QPDFTokenizer::expectInlineImage
2019-06-21 22:49:09 +00:00
Rename QUtil::strcasecmp to QUtil::str_compare_nocase (fixes #242)
2019-06-21 22:38:03 +00:00
* Source-level incompatibility: rename QUtil::strcasecmp to
QUtil::str_compare_nocase. This is a non-compatible change, but
QUtil::strcasecmp is hardly the most important part of qpdf's API.
The reason for this change is that strcasecmp is a macro on some
systems, and that was causing problems when QUtil.hh was included
in certain circumstances. Fixes #242.
New safe type converters in QIntC
2019-06-19 22:53:22 +00:00
2019-06-20 Jay Berkenbilt <ejb@ql.org>
Enable int warnings by default Now that there aren't any more...
2019-06-21 01:08:04 +00:00
* Enable compilation with additional warnings for integer
conversion and sign (-Wsign-conversion, -Wconversion for gcc and
similar; -W3 for msvc) if supported. These warnings are on by
default can be turned off by passing --disable-int-warnings
Fix sign and conversion warnings (major) This makes all integer type conversions that have potential data loss explicit with calls that do range checks and raise an exception. After this commit, qpdf builds with no warnings when -Wsign-conversion -Wconversion is used with gcc or clang or when -W3 -Wd4800 is used with MSVC. This significantly reduces the likelihood of potential crashes from bogus integer values. There are some parts of the code that take int when they should take size_t or an offset. Such places would make qpdf not support files with more than 2^31 of something that usually wouldn't be so large. In the event that such a file shows up and is valid, at least qpdf would raise an error in the right spot so the issue could be legitimately addressed rather than failing in some weird way because of a silent overflow condition.
2019-06-21 03:35:23 +00:00
* Fix all integer sign and conversion warnings. This makes all
integer type conversions that have potential data loss explicit
with calls that do range checks and raise an exception.
Pl_Flate: constructor's out_bufsize is now unsigned int This is the type we need for the underlying zlib implementation.
2019-06-21 04:01:36 +00:00
* Change out_bufsize argument to Pl_Flate's constructor for int to
unsigned int for compatibility with underlying zlib
implementation.
Fix sign and conversion warnings (major) This makes all integer type conversions that have potential data loss explicit with calls that do range checks and raise an exception. After this commit, qpdf builds with no warnings when -Wsign-conversion -Wconversion is used with gcc or clang or when -W3 -Wd4800 is used with MSVC. This significantly reduces the likelihood of potential crashes from bogus integer values. There are some parts of the code that take int when they should take size_t or an offset. Such places would make qpdf not support files with more than 2^31 of something that usually wouldn't be so large. In the event that such a file shows up and is valid, at least qpdf would raise an error in the right spot so the issue could be legitimately addressed rather than failing in some weird way because of a silent overflow condition.
2019-06-21 03:35:23 +00:00
* Change QPDFObjectHandle::pipeStreamData's encode_flags argument
from unsigned long to int since int is the underlying type of the
enumerated type values that are passed to it. This change should
be invisible to virtually all code unless you are compiling with
strict warning flags and explicitly casting to unsigned long.
Add new integer accessors to QPDFObjectHandle
2019-06-20 17:04:57 +00:00
* Add methods to QPDFObjectHandle to return the value of Integer
objects as int and unsigned int with range checking and fallback
behavior to avoid silent underflow/overflow conditions.
QUtil: add unsigned int/string functions
2019-06-20 23:48:53 +00:00
* Add functions to QUtil to convert unsigned integers to strings,
avoiding implicit conversion between unsigned and signed integer
types.
ChangeLog: fix errors in previous entries
2019-06-22 16:32:32 +00:00
* Add QIntC.hh, containing integer type converters that do range
New safe type converters in QIntC
2019-06-19 22:53:22 +00:00
checking.
Remove qpdf_read_memory_fuzzer
2019-06-18 12:40:18 +00:00
2019-06-18 Jay Berkenbilt <ejb@ql.org>
* Remove previously submitted qpdf_read_memory_fuzzer as it is a
small subset of qpdf_fuzzer.
Give up reading objects with too many consecutive errors
2019-06-15 12:51:54 +00:00
2019-06-15 Jay Berkenbilt <ejb@ql.org>
Run tests with sanitizers in CI
2019-06-15 19:34:29 +00:00
* Update CI (Azure Pipelines) to run tests with some sanitizers.
As a test suite, run stand-alone fuzzer on seed corpus Temporarily skip fuzz tests on Windows. There are Windows-specific failures to address later.
2019-06-15 15:37:10 +00:00
* Do "ideal integration" with oss-fuzz. This includes adding a
better fuzzer with a seed corpus and adding automated tests of the
fuzzer with the test data.
Give up reading objects with too many consecutive errors
2019-06-15 12:51:54 +00:00
* When parsing files, while reading an object, if there are too
many consecutive errors without enough intervening successes, give
up on the specific object. This reduces cases in which very badly
damaged files send qpdf into a tail spin reading one character at
a time and reporting warnings.
oss-fuzz initial integration
2019-06-13 13:28:38 +00:00
2019-06-13 Jay Berkenbilt <ejb@ql.org>
* Perform initial integration of Google's oss-fuzz project by
copying the fuzzer someone from Google already did into the qpdf
repository and adding build support. This shift in control is in
preparation for an ideal integration with oss-fuzz.
Handle empty DecodeParams array for (fixes #331) On read, ignore /DecodeParms when empty list; on write, delete it. Some files have been found that include an empty list for /DecodeParms, but this is not technically compliant with the spec, and the only sensible interpretation is to treat it as if there are no decode parameters.
2019-06-09 21:19:07 +00:00
2019-06-09 Jay Berkenbilt <ejb@ql.org>
* When /DecodeParms is an empty list, ignore it on read and delete
it on write. Fixes #331.
Prepare 8.4.2 release
2019-05-18 12:56:37 +00:00
2019-05-18 Jay Berkenbilt <ejb@ql.org>
* 8.4.2: release
Fix Windows memory error (fixes #330)
2019-05-16 17:54:14 +00:00
2019-05-16 Jay Berkenbilt <ejb@ql.org>
* Fix memory error in Windows-only code from typo. Fixes #330.
Prepare 8.4.1 release
2019-04-21 17:01:14 +00:00
2019-04-27 Jay Berkenbilt <ejb@ql.org>
* 8.4.1: release
Revert preservations of outlines with --split-pages The preservation of outlines didn't provide very useful behavior anyway as it copied all outlines but most didn't work. This implementation also caused a very significant performance hit and so is being reverted until a proper solution can be coded. The eventual solution will not be compatible with the reverted solution anyway, so it's best not to leave this in.
2019-04-20 20:30:22 +00:00
2019-04-20 Jay Berkenbilt <ejb@ql.org>
Compare versions between CLI and library
2019-04-21 00:03:59 +00:00
* When qpdf --version is run, it will detect if the qpdf CLI was
built with a different version of qpdf than the library. This
usually indicates that multiple versions of qpdf are installed and
that the library path is not set up properly. This situation
sometimes causes confusing behavior for users who are not actually
running the version of qpdf they think they are running.
Add --remove-page-labels option (fixes #317)
2019-04-20 23:13:49 +00:00
* Add parameter --remove-page-labels to remove page labels from
output. In qpdf 8.3.0, the behavior changed so that page labels
were preserved when merging and splitting files. Some users were
relying on the fact that if you ran qpdf --empty --pages ... all
page labels were dropped. This option makes it possible to get
that behavior if it is explicitly desired. Fixes #317.
Add --keep-files-open-threshold (fixes #288)
2019-04-20 22:46:33 +00:00
* Add parameter --keep-files-open-threshold to override the
maximum number of files that qpdf will allow to be kept open at
once. Fixes #288.
Prepare 8.4.1 release
2019-04-21 17:01:14 +00:00
* Handle Unicode characters in filenames properly on Windows. The
changes to support Unicode on the CLI in Windows broke Unicode
filenames on that platform. Fixes #298.
Support Unicode in filenames (fixes #298)
2019-04-20 22:14:32 +00:00
Tighten isPageObject (fixes #310)
2019-04-20 21:47:51 +00:00
* Slightly tighten logic that determines whether an object is a
page. The previous logic was sometimes failing to preserve
annotations because they were passing the overly loose test for
whether something was a page. This fix has a slight risk of
causing some extraneous objects to be copied during page splitting
and merging for erroneous PDF files whose page objects contain
invalid types or are missing the /Type key entirely, both of which
would be invalid according to the PDF specification.
Revert preservations of outlines with --split-pages The preservation of outlines didn't provide very useful behavior anyway as it copied all outlines but most didn't work. This implementation also caused a very significant performance hit and so is being reverted until a proper solution can be coded. The eventual solution will not be compatible with the reverted solution anyway, so it's best not to leave this in.
2019-04-20 20:30:22 +00:00
* Revert change that included preservation of outlines (bookmarks)
in --split-pages. The way it was implemented caused a very
significant performance penalty when splitting pages with
outlines. We need a better solution that only copies the relevant
items, not the whole tree.
Fix json serialization for {x | -1 < x < 1} (fixes #308) JSON serialization was preserving the value as presented, but JSON doesn't accept decimal values without a 0 before the decimal point.
2019-03-11 20:21:27 +00:00
2019-03-11 Jay Berkenbilt <ejb@ql.org>
* JSON serialization: add missing leading 0 to decimal values
between -1 and 1. Fixes #308.
Prepare 8.4.0 release
2019-02-02 02:29:40 +00:00
2019-02-01 Jay Berkenbilt <ejb@ql.org>
* 8.4.0: release
Remove acroread from tests This hasn't worked or been exercised in years since Adobe stopped releasing a Linux version of reader.
2019-01-31 13:39:05 +00:00
2019-01-31 Jay Berkenbilt <ejb@ql.org>
Don't optimize non-8-bit images Also add test cases for additional coverage on image optimization.
2019-01-31 21:07:33 +00:00
* Bug fix: do better pre-checks on images before optimizing;
refuse to optimize images that can't be converted to JPEG because
of colorspace or depth.
Externalize inline images (fixes #278)
2019-01-30 22:56:47 +00:00
* Add new options --externalize-inline-images, which converts
inline images larger than a specified size to regular images, and
--ii-min-bytes, which tweaks that size.
* When optimizing images, inline images are now included in the
optimization, first being converted to regular images. Use
--keep-inline-images to exclude them from optimization. Fixes #278.
* Add method QPDFPageObjectHelper::externalizeInlineImages, which
converts inline images whose size is at least a specified amount
to regular images.
Remove acroread from tests This hasn't worked or been exercised in years since Adobe stopped releasing a Linux version of reader.
2019-01-31 13:39:05 +00:00
* Remove traces of acroread, which hasn't been available in Linux
for a long time.
Improve locating inline image's EI We've actually seen a PDF file in the wild that contained EI surrounded by delimiters inside the image data, which confused qpdf's naive code. This significantly improves EI detection.
2019-01-30 19:26:08 +00:00
2019-01-30 Jay Berkenbilt <ejb@ql.org>
Exclude space after ID in image data
2019-01-31 04:24:09 +00:00
* Do not include space after ID operator in inline image data. The
token now correctly contains the image data, the EI operator,
and the delimiter that precedes the EI operator.
Improve locating inline image's EI We've actually seen a PDF file in the wild that contained EI surrounded by delimiters inside the image data, which confused qpdf's naive code. This significantly improves EI detection.
2019-01-30 19:26:08 +00:00
* Improve locating of an inline image's EI operator to correctly
handle the case of EI appearing inside the image data.
* Very low-level QPDFTokenizer API now includes an
expectInlineImage method that takes an input stream, enabling it
Make inline image token exactly contain the image data Do not include the trailing EI, and handle cases where EI is not preceded by a delimiter. Such cases have been seen in the wild.
2019-01-31 20:51:52 +00:00
to locate an inline image's EI operator better. When this method
is called, the inline image token returned will not contain the EI
operator and will contain correct image data. This is called
Improve locating inline image's EI We've actually seen a PDF file in the wild that contained EI surrounded by delimiters inside the image data, which confused qpdf's naive code. This significantly improves EI detection.
2019-01-30 19:26:08 +00:00
automatically everywhere within the qpdf library. Most user code
will never have to use the low-level tokenizer API. If you use
Make inline image token exactly contain the image data Do not include the trailing EI, and handle cases where EI is not preceded by a delimiter. Such cases have been seen in the wild.
2019-01-31 20:51:52 +00:00
Pl_QPDFTokenizer, this will be done automatically for you. If you
use the low-level API and call expectInlineImage, you should call
the new version.
Improve locating inline image's EI We've actually seen a PDF file in the wild that contained EI surrounded by delimiters inside the image data, which confused qpdf's naive code. This significantly improves EI detection.
2019-01-30 19:26:08 +00:00
Handle direct page objects (fixes #164)
2019-01-29 22:01:36 +00:00
2019-01-29 Jay Berkenbilt <ejb@ql.org>
Inline image token value ends with EI, not delimiter The inline image token erroneously included the delimiter that followed EI. The ObjectHandle created from it was correct.
2019-01-30 19:14:46 +00:00
* Bug fix: when returning an inline image token, the tokenizer no
longer includes the delimiter that follows EI. The
QPDFObjectHandle created from the token was correct.
Handle direct page objects (fixes #164)
2019-01-29 22:01:36 +00:00
* Handle files with direct page objects, which is not allowed by
the PDF spec but has been seen in the wild. Fixes #164.
Resolve duplicated page objects (fixes #268) When linearizing a file or getting the list of all pages in a file, detect if the pages tree contains a duplicated page object and, if so, shallow copy it. This makes it possible to have a one to one mapping of page positions to page objects.
2019-01-29 01:13:10 +00:00
2019-01-28 Jay Berkenbilt <ejb@ql.org>
Fix logic for when to compress object and xref streams (fixes #271)
2019-01-29 02:43:06 +00:00
* Bug fix: when using --stream-data=compress, object streams and
xref streams were not compressed. They were compressed if no
--stream-data option was specified. Fixes #271.
Resolve duplicated page objects (fixes #268) When linearizing a file or getting the list of all pages in a file, detect if the pages tree contains a duplicated page object and, if so, shallow copy it. This makes it possible to have a one to one mapping of page positions to page objects.
2019-01-29 01:13:10 +00:00
* When linearizing or getting the list of all pages in a file,
replace duplicated page objects with a shallow copy of the page
object. Linearization and all page manipulation APIs require page
objects to be unique. Pages that were originally duplicated will
still share contents and any other indirect resources. Fixes #268.
Convert pages to form XObjects Support conversion of pages to form XObjects and placement of form XObjects on pages.
2019-01-26 21:48:48 +00:00
2019-01-26 Jay Berkenbilt <ejb@ql.org>
Add --overlay and --underlay to qpdf CLI (fixes #207)
2019-01-26 23:45:34 +00:00
* Add --overlay and --underlay options. Fixes #207.
Example of form XObject, page overlay
2019-01-26 22:33:06 +00:00
* Create examples/pdf-overlay-page.cc to demonstrate use of
page/form XObject interaction
Convert pages to form XObjects Support conversion of pages to form XObjects and placement of form XObjects on pages.
2019-01-26 21:48:48 +00:00
* Add new methods QPDFPageObjectHelper::getFormXObjectForPage,
which creates a form XObject equivalent to a page, and
QPDFObjectHandle::placeFormXObject, which generates content stream
code to placing a form XObject on a page.
Handle inheritable page attributes Add getAttribute for handling inheritable page attributes, and fix getPageImages and annotation flattening code to use it.
2019-01-25 11:55:31 +00:00
2019-01-25 Jay Berkenbilt <ejb@ql.org>
Add QPDFObjectHandle::getUniqueResourceName
2019-01-25 23:15:23 +00:00
* Add new method QPDFObjectHandle::getUniqueResourceName() to
return an unused key available to be used in a resource
dictionary.
Handle inheritable page attributes Add getAttribute for handling inheritable page attributes, and fix getPageImages and annotation flattening code to use it.
2019-01-25 11:55:31 +00:00
* Add new method QPDFPageObjectHelper::getAttribute() that
properly handles inherited attributes and allows for creation of a
copy of shared attributes. This is very useful if you are getting
an attribute of a page dictionary with the intent to modify it
privately for that page.
* Fix QPDFPageObjectHelper::getPageImages (and the legacy
QPDFObjectHandle::getPageImages()) to properly handle images in
inherited resources dictionaries.
When flattening, remove annotations with no appearance stream With the exception of form field annotations when /NeedAppearances is true, remove annotations that don't have appearance streams when flattening. There is no reason to keep these when flattening since they are invisible. This may include unchecked checkboxes, unshown popup windows, etc.
2019-01-21 01:40:56 +00:00
2019-01-20 Jay Berkenbilt <ejb@ql.org>
Handle fallback font size in text appearances If we end up using our fallback font size when generating appearances for text fields, reflect that in the Tf operator used in the appearance stream.
2019-01-21 03:48:24 +00:00
* Tweak the content code generated for variable text fields to
better handle font sizes and multi-line text.
Fix omissions in text appearance generation When generating appearance streams for variable text annotations, properly handle the cases of there being no appearance dictionary, no appearance stream, or an appearance stream with no BMC..EMC marker.
2019-01-21 02:52:44 +00:00
* When generating appearance streams for variable text
annotations, properly handle the cases of there being no
appearance dictionary, no appearance stream, or an appearance
stream with no BMC..EMC marker.
When flattening, remove annotations with no appearance stream With the exception of form field annotations when /NeedAppearances is true, remove annotations that don't have appearance streams when flattening. There is no reason to keep these when flattening since they are invisible. This may include unchecked checkboxes, unshown popup windows, etc.
2019-01-21 01:40:56 +00:00
* When flattening annotations, remove annotations from the file
that don't have appearance streams. These were previously being
preserved, but since they are invisible, there is no reason to
preserve them when flattening annotations.
Implement password recovery suppression and password mode (fixes #215) Allow fine control over how passwords are encoded for writing, and allow password for reading to be given as a hexademical encoded string. Allow suppression of password recovery as a means to ensure that the password you specify is actually the right one.
2019-01-18 02:51:30 +00:00
2019-01-19 Jay Berkenbilt <ejb@ql.org>
* NOTE: qpdf CLI: some non-compatible changes were made to how
qpdf interprets password arguments that contain Unicode characters
that fall outside of ASCII. On Windows, the non-compatibility was
unavoidable, as explained in the release notes. On all platforms,
it is possible to get the old behavior if desired, though the old
behavior would almost always result in files that other
applications were unable to open. As it stands, qpdf should now be
able to open passwords encrypted with a wide range of passwords
that some other viewers might not handle, though even now, qpdf's
Unicode password handling is not 100% complete.
* Add --password-mode option, which allows fine-grained control of
how password arguments are treated. This is discussed fully in the
manual. Fixes #215.
* Add option --suppress-password-recovery to disable the behavior
of searching for a correct password by re-encoding the provided
password. This option can be useful if you want to ensure you know
exactly what password is being used.
Add tests for shared font/xobject The tests are in a separate commit so the bug-fix commit can be taken as a patch for older versions.
2019-01-17 14:29:59 +00:00
2019-01-17 Jay Berkenbilt <ejb@ql.org>
Try passwords with different string encodings
2019-01-18 00:44:18 +00:00
* When attempting to open an encrypted file with a password, if
the password doesn't work, try alternative passwords created by
re-interpreting the supplied password with different string
encodings. This makes qpdf able to recover passwords with
non-ASCII characters when either the decryption or encryption
operation was performed with an incorrectly encoded password.
Add tests for shared font/xobject The tests are in a separate commit so the bug-fix commit can be taken as a patch for older versions.
2019-01-17 14:29:59 +00:00
* Fix data loss bug: qpdf was discarding referenced resources in
the case in which a page's resource dictionary contained an
indirect reference for either /Font or /XObject that contained
fonts or XObjects not referenced on all pages that shared the
resource. This was a "typo" in the code. The comment explained the
correct behavior, and the code was clearly intended to handle this
issue, but the implementation had an error in it. This is fixed by
a single-line change, which can be found in git commit
4bc434000c42a7191e705c8a38216ca6743ad9ff. That commit can be used
as a patch that applies cleanly against qpdf 8.1.0 and forward.
The bug was introduced in version 8.1.0. For the record, this is
the first bug in qpdf's history that could result in silent loss
of data when processing a correct input file. Fixes #276.
Add QUtil::possible_repaired_encodings
2019-01-16 02:06:38 +00:00
2019-01-15 Jay Berkenbilt <ejb@ql.org>
* Add QUtil::possible_repaired_encodings which, given a string,
generates other strings that represent re-interpretation of the
bytes in a different coding system. This is used to help recover
passwords if the password string was improperly encoded on a
different system due to user error or a software bug.
Add status-reporting transcoders to QUtil
2019-01-14 13:39:13 +00:00
2019-01-14 Jay Berkenbilt <ejb@ql.org>
Update CLI and manual for new encryption granularity (fixes #214)
2019-01-15 03:42:36 +00:00
* Add new CLI flags to 128-bit and 256-bit encryption: --assemble,
--annotate, --form, and --modify-other to control encryption
permissions with more granularity than was allowed with the
--modify flag. Fixes #214.
Modernize encryption API for more granularity Setting encryption permissions for R >= 3 set permission bits in groups corresponding to menu options in Acrobat 5. The new API allows the bits to be set individually.
2019-01-15 01:45:08 +00:00
* Add new versions of
QPDFWriter::setR{3,4,5,6}EncryptionParameters that allow
individual setting of the various permission bits. The old
interfaces are retained for backward compatibility. In the "C"
API, add qpdf_set_r{3,4,5,6}_encryption_parameters2. The new
interfaces use separate booleans for various permissions instead
of the qpdf_r3_modify_e enumerated type, which set permission bits
in predefined groups.
Add status-reporting transcoders to QUtil
2019-01-14 13:39:13 +00:00
* Add versions of utf8 to single-byte character transcoders that
return a success code.
QUtil::analyze_encoding
2019-01-13 14:41:13 +00:00
2019-01-13 Jay Berkenbilt <ejb@ql.org>
* Add several more string transcoding and analysis methods to
QUtil for bidirectional conversion between PDF Doc, Win Ansi, Mac
Roman, UTF-6, and UTF-16 along with detection of valid UTF-8 and
UTF-16.
Interpret . in --pages as a shortcut for the primary file
2019-01-12 14:21:52 +00:00
2019-01-12 Jay Berkenbilt <ejb@ql.org>
Allow adding the same page more than once in --pages (fixes #272)
2019-01-12 14:14:20 +00:00
* In the --pages option, allow the same page to be specified more
than once. You can now do "--pages A.pdf 1,1 --" or
"--pages A.pdf 1 A.pdf 1" instead of having to use two different
paths to specify A.pdf. Fixes #272.
* Add QPDFPageObjectHelper::shallowCopyPage(). This method creates
a new page object that is a "shallow copy" of the given page as
described in the comments in QPDFPageObjectHelper. The resulting
object has not been added anywhere but is ready to be passed to
QPDFPageDocumentHelper::addPage of its own QPDF or another QPDF
object.
* Add QPDF::getUniqueId() method to return an identifier that is
intended to be unique within the scope of all QPDF objects created
by the calling application in a single run.
Interpret . in --pages as a shortcut for the primary file
2019-01-12 14:21:52 +00:00
* In --pages, allow "." as a replacement for the current input
file, making it possible to say "qpdf A.pdf --pages . 1-3 --"
instead of having to repeat the input filename.
Add QPDF::setImmediateCopyFrom
2019-01-11 03:11:38 +00:00
2019-01-10 Jay Berkenbilt <ejb@ql.org>
Add configure option AVOID_WINDOWS_HANDLE If set, we avoid using Windows I/O HANDLE, which is disallowed in some versions of the Windows SDK, such as for Windows phones. QUtil::same_file will always return false in this case. Only applies to Windows builds.
2019-01-11 03:28:15 +00:00
* Add new configure option --enable-avoid-windows-handle, which
causes the symbol AVOID_WINDOWS_HANDLE to be defined. If set, we
avoid using Windows I/O HANDLE, which is disallowed in some
versions of the Windows SDK, such as for Windows phones.
QUtil::same_file will always return false in this case. Only
applies to Windows builds.
Add QPDF::setImmediateCopyFrom
2019-01-11 03:11:38 +00:00
* Add new method QPDF::setImmediateCopyFrom. When called on a
source QPDF object, streams can be copied FROM that object to
other ones without having to keep the source QPDF or its input
source around. The cost is copying the streams into RAM. See
comments in QPDF.hh for setImmediateCopyFrom for a detailed
explanation.
Prepare 8.3.0 release
2019-01-07 16:11:49 +00:00
2019-01-07 Jay Berkenbilt <ejb@ql.org>
* 8.3.0: release
Add completion files for packagers
2019-01-08 00:56:46 +00:00
* Add sample completion files in completions. These can be used by
packagers to install on the system wherever bash and zsh keep
their vendor-supplied completions.
Add --disable-check-autofiles to configure
2019-01-08 00:56:36 +00:00
* Add configure flag --enable-check-autofiles, which is on by
default. Packagers whose packaging systems automatically refresh
autoconf or libtool files should pass --disable-check-autofiles to
./configure to suppress warnings about automatically generated
files being outdated.
Mostly don't require original QPDF for copyForeignObject (fixes #219) The original QPDF is only required now when the source QPDFObjectHandle is a stream that gets its stream data from a QPDFObjectHandle::StreamDataProvider.
2019-01-07 02:18:36 +00:00
2019-01-06 Jay Berkenbilt <ejb@ql.org>
* Remove the restriction in most cases that the source QPDF used
in a copyForeignObject call has to stick around until the
destination QPDF is written. The exceptional case is when the
source stream gets is data using a
QPDFObjectHandle::StreamDataProvider. For a more in-depth
discussion, see comments around copyForeignObject in QPDF.hh.
Fixes #219.
Move utf8_to_utf16 into QUtil
2019-01-05 18:00:18 +00:00
2019-01-05 Jay Berkenbilt <ejb@ql.org>
Honor other base encodings when generating appearances
2019-01-05 18:42:31 +00:00
* When generating appearances, if the font uses one of the
standard, built-in encodings, restrict the character set to that
rather than just to ASCII. This will allow most appearances to
contain characters from the ISO-Latin-1 range plus a few
additional characters.
Add WinAnsi and MacRoman encoding
2019-01-05 18:13:16 +00:00
* Add methods QUtil::utf8_to_win_ansi and
QUtil::utf8_to_mac_roman.
Move utf8_to_utf16 into QUtil
2019-01-05 18:00:18 +00:00
* Add method QUtil::utf8_to_utf16.
Fix dangling references (fixes #240) On certain operations, such as iterating through all objects and adding new indirect objects, walk through the entire object structure and explicitly resolve any indirect references to non-existent objects. That prevents new objects from springing into existence and causing the previously dangling references to point to them.
2019-01-04 15:17:33 +00:00
2019-01-04 Jay Berkenbilt <ejb@ql.org>
Add CLI flags for image optimization
2019-01-04 23:06:56 +00:00
* Add new option --optimize-images, which recompresses every image
using DCT (JPEG) compression as long as the image is not already
compressed with lossy compression and recompressing the image
reduces its size. The additional options --oi-min-width,
--oi-min-height, and --oi-min-area prevent recompression of images
whose width, height, or pixel area (width * height) are below a
specified threshold.
Support page collation with --collate (fixes #259)
2019-01-04 20:12:31 +00:00
* Add new option --collate. When specified, the semantics of
--pages change from concatenation to collation. See the manual for
a more detailed discussion. Fixes #259.
Add QPDFWriter::getFinalVersion (fixes #266)
2019-01-04 17:32:02 +00:00
* Add new method QPDFWriter::getFinalVersion, which returns the
PDF version that will ultimately be written to the final file. See
comments in QPDFWriter.hh for some restrictions on its use. Fixes
#266.
Don't call assert while checking linearization data (fixes #209, #231) Instead of calling assert for problems found during checking linearization data, throw an exception which is later caught and issued as an error. Ideally we would handle errors more robustly, but this is still a significant improvement.
2019-01-04 16:50:02 +00:00
* When unexpected errors are found while checking linearization
data, print an error message instead of calling assert, which
cause the program to crash. Fixes #209, #231.
Fix dangling references (fixes #240) On certain operations, such as iterating through all objects and adding new indirect objects, walk through the entire object structure and explicitly resolve any indirect references to non-existent objects. That prevents new objects from springing into existence and causing the previously dangling references to point to them.
2019-01-04 15:17:33 +00:00
* Detect and recover from dangling references. If a PDF file
contained an indirect reference to a non-existent object (which is
valid), when adding a new object to the file, it was possible for
the new object to take the object ID of the dangling reference,
thereby causing the dangling reference to point to the new object.
This case is now prevented. Fixes #240.
Add QUtil::utf8_to_ascii
2019-01-04 01:03:30 +00:00
2019-01-03 Jay Berkenbilt <ejb@ql.org>
Update release notes for 8.3.0
2019-01-07 14:26:27 +00:00
* Add --generate-appearances flag to the qpdf command-line tool to
trigger generation of appearance streams.
Add basic appearance stream generation
2019-01-04 00:09:00 +00:00
* Fix behavior of form field value setting to handle the following
cases:
- Strings are always written as UTF-16
- Check boxes and radio buttons are handled properly with
synchronization of values and appearance states
* Define constants in qpdf/Constants.h for interpretation of
annotation and form field flags
* Add QPDFAnnotationObjectHelper::getFlags
* Add many new methods to QPDFFormFieldObjectHelper for querying
flags and field types
* Add new methods for appearance stream generation. See comments
in QPDFFormFieldObjectHelper.hh for generateAppearance() for a
description of limitations.
- QPDFAcroFormDocumentHelper::generateAppearancesIfNeeded
- QPDFFormFieldObjectHelper::generateAppearance
* Bug fix: when writing form field values, always write string
values encoded as UTF-16.
Add QUtil::utf8_to_ascii
2019-01-04 01:03:30 +00:00
* Add method QUtil::utf8_to_ascii, which returns an ASCII string
for a UTF-8 string, replacing out-of-range characters with a
specified substitute.
Minor fixes
2019-01-03 13:17:59 +00:00
2019-01-02 Jay Berkenbilt <ejb@ql.org>
* Add method QPDFObjectHandle::getResourceNames that returns a set
of strings representing all second-level keys in a dictionary
(i.e. all keys of all direct dictionary members).
Add Matrix class under QPDFObjectHandle
2018-12-25 00:29:30 +00:00
2018-12-31 Jay Berkenbilt <ejb@ql.org>
Honor flags when flattening annotations
2019-01-03 16:51:58 +00:00
* Add --flatten-annotations flag to the qpdf command-line tool for
annotation flattening.
Switch annotation flattening to use the form xobjects Instead of directly putting the contents of the annotation appearance streams into the page's content stream, add commands to render the form xobjects directly. This is a more robust way to do it than the original solution as it works properly with patterns and avoids problems with resource name clashes between the pages and the form xobjects.
2019-01-03 02:44:10 +00:00
* Add methods for flattening form fields and annotations:
Annotation flattening including form fields Flatten annotations by integrating their appearance streams into the content stream of the containing page. In the case of form fields, only flatten if /NeedAppearance is false (or equivalently absent). If flattening form fields, also remove /AcroForm from the document catalog.
2019-01-01 04:08:57 +00:00
- QPDFPageDocumentHelper::flattenAnnotations - integrate
annotation appearance streams into page contents with special
handling for form fields: if appearance streams are up to date
(/NeedAppearances is false in /AcroForm), the /AcroForm key of
the document catalog is removed. Otherwise, a warning is
issued, and form fields are ignored. Non-form-field
annotations are always flattened if an appearance stream can
be found.
- QPDFAnnotationObjectHelper::getPageContentForAppearance -
generate the content stream fragment to render an appearance
Switch annotation flattening to use the form xobjects Instead of directly putting the contents of the annotation appearance streams into the page's content stream, add commands to render the form xobjects directly. This is a more robust way to do it than the original solution as it works properly with patterns and avoids problems with resource name clashes between the pages and the form xobjects.
2019-01-03 02:44:10 +00:00
stream in a page's content stream as a form xobject. Called by
flattenAnnotations.
* Add method QPDFObjectHandle::mergeResources(), which merges
resource dictionaries. See detailed description in
Add QPDFObjectHandle::mergeDictionary()
2018-12-31 22:12:38 +00:00
QPDFObjectHandle.hh.
Add Matrix class under QPDFObjectHandle
2018-12-25 00:29:30 +00:00
* Add QPDFObjectHandle::Matrix, similar to
QPDFObjectHandle::Rectangle, as a convenience class for
six-element arrays that are used as matrices.
Support zsh completion
2018-12-23 15:45:24 +00:00
2018-12-23 Jay Berkenbilt <ejb@ql.org>
Don't crash on @file when file doesn't exist (fixes #265) When @file is used and file doesn't exist, just treat it as a normal argument.
2018-12-23 16:46:08 +00:00
* When specifying @arg on the command line, if the file "arg" does
not exist, just treat this is a normal argument. This makes it
easier to deal with files whose names start with the @ character.
Fixes #265.
Support zsh completion
2018-12-23 15:45:24 +00:00
* Tweak completion so it works with zsh as well using
bashcompinit.
Document json support
2018-12-22 19:04:55 +00:00
2018-12-22 Jay Berkenbilt <ejb@ql.org>
* Add new options --json, --json-key, and --json-object to
generate a json representation of the PDF file. This is described
in more depth in the manual. You can also run qpdf --json-help to
get a description of the json format.
Support bash completion using complete -C
2018-12-21 17:00:13 +00:00
2018-12-21 Jay Berkenbilt <ejb@ql.org>
Allow --show-object=trailer
2018-12-21 19:30:22 +00:00
* Allow --show-object=trailer for showing the document trailer.
Support bash completion using complete -C
2018-12-21 17:00:13 +00:00
* You can now use eval $(qpdf --completion-bash) to enable bash
completion for qpdf. It's not perfect, but it works pretty well.
Add document and object helpers for outlines (bookmarks)
2018-12-19 02:08:53 +00:00
2018-12-19 Jay Berkenbilt <ejb@ql.org>
Preserve some outline functionality in page splitting
2018-12-19 22:01:56 +00:00
* When splitting pages using --split-pages, the outlines
dictionary and some supporting metadata are copied into the split
files. The result is that all bookmarks from the original file
appear, and those that point to pages that are preserved work
while those that point to pages that are not preserved don't do
anything. This is an interim step toward proper support for
bookmark preservation in split files.
Add document and object helpers for outlines (bookmarks)
2018-12-19 02:08:53 +00:00
* Add QPDFOutlineDocumentHelper and QPDFOutlineObjectHelper for
handling outlines (bookmarks) including bidirectionally mapping
between bookmarks and pages. Initially there is no support for
modifying the outlines hierarchy.
Add QPDFObjectHandle::wrapInArray() Wrap an object in an array if it is not already an array.
2018-12-17 22:36:06 +00:00
2018-12-18 Jay Berkenbilt <ejb@ql.org>
Add QPDFObjectHandle::getJSON()
2018-12-17 22:40:29 +00:00
* New method QPDFObjectHandle::getJSON() returns a JSON object
with a partial representation of the object. See
QPDFObjectHandle.hh for a detailed description.
Add simple JSON serializer
2018-12-17 16:55:11 +00:00
* Add a simple JSON serializer. This is not a complete or
general-purpose JSON library. It allows assembly and serialization
of JSON structures with some restrictions, which are described in
the header file.
Add QPDFNameTreeObjectHelper
2018-12-19 02:56:56 +00:00
* Add QPDFNameTreeObjectHelper class. This class provides useful
methods for dealing with name trees, which are discussed in
section 7.9.6 of the PDF spec (ISO-32000).
Preserve page labels (numbers) when splitting and merging
2018-12-18 19:59:14 +00:00
* Preserve page labels when merging and splitting files. Prior
versions of qpdf simply preserved the page label information from
the first file, which usually wouldn't make any sense in the
merged file. Now any page that had a page number in any original
file will have the same page number after merging or splitting.
Add QPDFPageLabelDocumentHelper
2018-12-18 16:29:00 +00:00
* Add QPDFPageLabelDocumentHelper class. This is a document helper
class that provides useful methods for dealing with page labels.
It abstracts the fact that they are stored as number trees and
deals with interpolating intermediate values that are not in the
tree. It also has helper functions used by the qpdf command line
tool to preserve page labels when merging and splitting files.
Add QPDFNumberTreeObjectHelper
2018-12-18 18:08:55 +00:00
* Add QPDFNumberTreeObjectHelper class. This class provides useful
methods for dealing with number trees, which are discussed in
section 7.9.7 of the PDF spec (ISO-32000). Page label dictionaries
are represented as number trees.
Add QPDFObjectHandle::wrapInArray() Wrap an object in an array if it is not already an array.
2018-12-17 22:36:06 +00:00
* New method QPDFObjectHandle::wrapInArray returns the object
itself if it is an array. Otherwise, it returns an array
containing the object. This is useful for dealing with PDF data
that is sometimes expressed as a single element and sometimes
expressed as an array, which is a somewhat common PDF idiom.
Set up Azure Pipelines Use free Azure Pipelines to do Linux, Windows, and Mac build and test and to generate Windows binary distributions.
2018-10-11 17:35:07 +00:00
2018-10-11 Jay Berkenbilt <ejb@ql.org>
ChangeLog
2018-10-11 23:16:26 +00:00
* Files generated by autogen.sh are now committed so that it is
possible to build on platforms without autoconf directly from a
clean checkout of the repository. The configure script detects if
the files are out of date when it also determines that the tools
are present to regenerate them.
Set up Azure Pipelines Use free Azure Pipelines to do Linux, Windows, and Mac build and test and to generate Windows binary distributions.
2018-10-11 17:35:07 +00:00
* Add build in Azure Pipelines, now that it is free for open
source projects.
Add --keep-files-open flag (fixes #237)
2018-08-18 13:47:39 +00:00
2018-08-18 Jay Berkenbilt <ejb@ql.org>
Prepare 8.2.1 release
2018-08-18 14:56:19 +00:00
* 8.2.1: release
Add --keep-files-open flag (fixes #237)
2018-08-18 13:47:39 +00:00
* Add new option --keep-files-open=[yn] to control whether qpdf
keeps files open when merging. Prior to version 8.1.0, qpdf always
kept all files open, but this meant that the number of files that
could be merged was limited by the operating system's open file
limit. Version 8.1.0 opened files as they were referenced, but
this caused a major performance impact. Version 8.2.0 optimized
the performance but did so in a way that, for local file systems,
there was a small but unavoidable performance hit, but for
networked file systems, the performance impact could be very high.
Starting with version 8.2.1, the default behavior is that files
are kept open if no more than 200 files are specified, but that
the behavior can be explicitly overridden with the
--keep-files-open flag. If you are merging more than 200 files but
less than the operating system's max open files limit, you may
want to use --keep-files-open=y. If you are using a local file
system where the overhead is low and you might sometimes merge
more than the OS limit's number of files, you may want to specify
--keep-files-open=n. Fixes #237.
Prepare 8.2.0 release
2018-08-16 15:29:32 +00:00
2018-08-16 Jay Berkenbilt <ejb@ql.org>
* 8.2.0: release
Clarify static vs. import library on Windows (fixes #225)
2018-08-14 20:28:52 +00:00
2018-08-14 Jay Berkenbilt <ejb@ql.org>
* For the mingw builds, change the name of the DLL import library
from libqpdf.a to libqpdf.dll.a to avoid confusing it with a
static library. This potentially clears the way for supporting a
static library in the future, though presently, the qpdf Windows
build only builds the DLL and executables. Fixes #225.
New exception class QPDFSystemError (fixes #221)
2018-08-13 23:48:02 +00:00
2018-08-13 Jay Berkenbilt <ejb@ql.org>
* Add new class QPDFSystemError, derived from std::runtime_error,
which is now thrown by QUtil::throw_system_error. This enables the
triggering errno value to be retrieved. Fixes #221.
Pl_Buffer: reduce memory growth (fixes #228) Rather than keeping a list of buffers for every write, accumulate bytes in a single buffer, doubling the size of the buffer when needed to accommodate new data. This is not the best possible implementation, but the change was implemented in this way to avoid changing the shape of Pl_Buffer and thus breaking backward compatibility.
2018-08-12 21:26:40 +00:00
2018-08-12 Jay Berkenbilt <ejb@ql.org>
Add --no-warn option to suppress warnings (fixes #232)
2018-08-13 02:20:40 +00:00
* qpdf command line: add --no-warn option to suppress issuing
warning messages. If there are any conditions that would have
caused warnings to be issued, the exit status is still 3.
Pl_Buffer: reduce memory growth (fixes #228) Rather than keeping a list of buffers for every write, accumulate bytes in a single buffer, doubling the size of the buffer when needed to accommodate new data. This is not the best possible implementation, but the change was implemented in this way to avoid changing the shape of Pl_Buffer and thus breaking backward compatibility.
2018-08-12 21:26:40 +00:00
* Rewrite the internals of Pl_Buffer to be much more efficient in
use of memory at a very slight performance cost. The old
implementation could cause memory usage to go out of control for
files with large images compressed using the TIFF predictor.
Fixes #228.
Fix infinite loop on small files with progress reporting (fixes #230) Turns out you can keep adding zero to a number over and over again and it just doesn't get any bigger. Who would have known?
2018-08-05 19:42:01 +00:00
2018-08-05 Jay Berkenbilt <ejb@ql.org>
Fix EOL handling inside strings (fixes #226) CR, CRLF, and LF are all supposed to be treated as LF; only one EOL is to be ignored after backslash.
2018-08-05 22:59:41 +00:00
* Bug fix: end of line characters were not properly handled inside
strings in some cases. Fixes #226.
Fix infinite loop on small files with progress reporting (fixes #230) Turns out you can keep adding zero to a number over and over again and it just doesn't get any bigger. Who would have known?
2018-08-05 19:42:01 +00:00
* Bug fix: infinite loop on progress reporting for very small
files. Fixes #230.
ClosedFileInputSource: add method to keep file open During periods of intensive operation on a specific file, this method can reduce the overhead of repeated open/close operations.
2018-08-04 23:50:21 +00:00
2018-08-04 Jay Berkenbilt <ejb@ql.org>
Keep file open while adding its pages during merge (fixes #217)
2018-08-04 23:58:13 +00:00
* Performance fix: optimize page merging operation to avoid
unnecessary open/close calls on files being merged. Fixes #217.
ClosedFileInputSource: add method to keep file open During periods of intensive operation on a specific file, this method can reduce the overhead of repeated open/close operations.
2018-08-04 23:50:21 +00:00
* Add ClosedFileInputSource::stayOpen method, enabling a
ClosedFileInputSource to stay open during manually indicated
periods of high activity, thus reducing the overhead of frequent
open/close operations.
Prepare 8.1.0 release
2018-06-23 01:12:26 +00:00
2018-06-23 Jay Berkenbilt <ejb@ql.org>
* 8.1.0: release
Don't prune resource dictionaries on errors or by request If we are unable to filter a page's content streams, don't attempt to remove objects from the page's resource dictionary. Also provide a command line option to suppress resource removal in case we ever need this as a workaround for some bug or broken PDF files.
2018-06-22 14:45:31 +00:00
2018-06-22 Jay Berkenbilt <ejb@ql.org>
Prepare 8.1.0 release
2018-06-23 01:12:26 +00:00
* Bug fix: properly decrypt files with 40-bit keys that use
revision 3 of the security handler. Prior to this, qpdf was
reporting "invalid password" in this case. Fixes #212.
With --verbose, give information on processing merge inputs
2018-06-22 19:51:41 +00:00
* With --verbose, print information about each input file when
merging files.
Add progress reporting for QPDFWriter (fixes #200)
2018-06-22 19:22:29 +00:00
* Add progress reporting to QPDFWriter. Programmatically, you can
register a progress reporter with registerProgressReporter(). From
the command line, passing --progress will give progress indicators
in increments of no less than 1% as output files are written.
Fixes #200.
Add method to get count of objects in QPDF
2018-06-22 18:52:03 +00:00
* Add new method QPDF::getObjectCount(). This gives an approximate
(upper bound) account of objects in the QPDF object.
Use ClosedFileInputSource when merging files (fixes #154)
2018-06-22 16:17:36 +00:00
* Don't leave files open when merging. This makes it possible
merge more files at once than the operating system's open file
limit. Fixes #154.
Add ClosedFileInputSource ClosedFileInputSource is an input source that keeps the file closed when not reading it.
2018-06-22 16:15:22 +00:00
* Add ClosedFileInputSource class, and input source that keeps its
input file closed when not reading it. At the expense of some
performance, this allows you to operate on many files without
opening too many files at the operating system level.
Prepare 8.1.0 release
2018-06-23 01:12:26 +00:00
* Add new option --preserve-unreferenced-resources, which
Don't prune resource dictionaries on errors or by request If we are unable to filter a page's content streams, don't attempt to remove objects from the page's resource dictionary. Also provide a command line option to suppress resource removal in case we ever need this as a workaround for some bug or broken PDF files.
2018-06-22 14:45:31 +00:00
suppresses removal of unreferenced objects from page resource
dictionaries during page splitting operations.
Better support for creating Unicode strings
2018-06-21 18:03:45 +00:00
2018-06-21 Jay Berkenbilt <ejb@ql.org>
When splitting files, remove unreferenced objects (fixes #203)
2018-06-22 00:16:05 +00:00
* Add method QPDFPageObjectHelper::removeUnreferencedResources and
also QPDFPageDocumentHelper::removeUnreferencedResources that
calls the former on every page. This method removes any XObject or
Font references from the page's resource dictionary if they are
not referenced anywhere in any of the content streams. This
significantly reduces the size of split files whose pages
internally share resource dictionaries. Fixes #203.
Make page range optional in --rotate (fixes #211)
2018-06-21 20:28:44 +00:00
* The --rotate option to qpdf no longer requires an explicit page
range. You can now rotate all pages of a document with
qpdf --rotate=angle in.pdf out.pdf. Fixes #211.
Add interactive form example
2018-06-21 19:54:02 +00:00
* Create examples/pdf-set-form-values.cc to illustrate use of
interactive form helpers.
Allow setting a form field's value
2018-06-21 19:00:00 +00:00
* Added methods QPDFAcroFormDocumentHelper::setNeedAppearances and
added methods to QPDFFormFieldObjectHelper to set a field's value,
optionally updating the document to indicate that appearance
streams need to be regenerated.
Better support for creating Unicode strings
2018-06-21 18:03:45 +00:00
* Added QPDFObject::newUnicodeString and QPDFObject::unparseBinary
to allow for more convenient creation of strings that are
explicitly encoded in UTF-16 BE. This is useful for creating
Unicode strings that appear outside of content streams, such as in
page labels, outlines, form field values, etc.
Add QPDFPageDocumentHelper and QPDFPageObjectHelper This is the beginning of higher-level API support using helper classes. The goal is to be able to add more helpers without continuing to pollute QPDF's and QPDFObjectHandle's public interfaces.
2018-06-18 19:05:53 +00:00
2018-06-20 Jay Berkenbilt <ejb@ql.org>
Implement helper class for interactive forms
2018-06-19 13:26:41 +00:00
* Added new classes QPDFAcroFormDocumentHelper,
QPDFFormFieldObjectHelper, and QPDFAnnotationObjectHelper to
assist with working with interactive forms in PDF files. At
present, API methods for reading forms, form fields, and widget
annotations have been added. It is likely that some additional
methods for modifying forms will be added in the future. Note that
qpdf remains a library whose function is primarily focused around
document structure and metadata rather than content. As such, it
is not expected that qpdf will have higher level APIs for
generating form contents, but qpdf will hopefully gain the
capability to deal with the bookkeeping aspects of wiring up all
the objects, which could make it a useful library for other
software that works with PDF interactive forms. PDF forms are
complex, and the terminology around them is confusing. Please see
comments at the top of QPDFAcroFormDocumentHelper.hh for
additional discussion.
When splitting files, remove unreferenced objects (fixes #203)
2018-06-22 00:16:05 +00:00
* Added new classes QPDFPageDocumentHelper and QPDFPageObjectHelper
Add QPDFPageDocumentHelper and QPDFPageObjectHelper This is the beginning of higher-level API support using helper classes. The goal is to be able to add more helpers without continuing to pollute QPDF's and QPDFObjectHandle's public interfaces.
2018-06-18 19:05:53 +00:00
for page-level API functions. These classes introduce a new API
pattern of document helpers and object helpers in qpdf. The helper
classes provide a higher level API for working with certain types
of structural features of PDF while still staying true to qpdf's
philosophy of not isolating the user from the underlying
structure. Please see the chapter in the documentation entitled
Convert examples to use new page helper classes
2018-06-18 19:06:51 +00:00
"Design and Library Notes" for additional discussion. The examples
have also been updated to use QPDFPageDocumentHelper and
When splitting files, remove unreferenced objects (fixes #203)
2018-06-22 00:16:05 +00:00
QPDFPageObjectHelper when performing page-level operations.
Add QPDFPageDocumentHelper and QPDFPageObjectHelper This is the beginning of higher-level API support using helper classes. The goal is to be able to add more helpers without continuing to pollute QPDF's and QPDFObjectHandle's public interfaces.
2018-06-18 19:05:53 +00:00
Add QPDFObjectHandle::Rectangle type Provide a convenient way of accessing rectangles.
2018-06-19 15:00:15 +00:00
2018-06-19 Jay Berkenbilt <ejb@ql.org>
* New QPDFObject::Rectangle class will convert to and from arrays
of four numerical values. Rectangles are used in various places
within the PDF file format and are called out as a specific data
type in the PDF specification.
newline before endstream fix for object streams (fixes #205)
2018-05-12 17:09:13 +00:00
2018-05-12 Jay Berkenbilt <ejb@ql.org>
* In newline before endstream mode, an extra newline was not
inserted prior to the endstream that ends object streams.
Fixes #205.
Limit depth of nesting in direct objects (fixes #202) This fixes CVE-2018-9918.
2018-04-15 20:11:22 +00:00
2018-04-15 Jay Berkenbilt <ejb@ql.org>
* Arbitrarily limit the depth of data structures represented by
direct object. This is CVE-2018-9918. Fixes #202.
Properly handle pages with no contents (fixes #194) Remove calls to assertPageObject(). All cases in the library that called assertPageObject() work fine if you don't call assertPageObject() because nothing assumes anything that was being checked by that call. Removing the calls enables more files to be successfully processed.
2018-03-06 16:25:09 +00:00
2018-03-06 Jay Berkenbilt <ejb@ql.org>
Prepare 8.0.2 release
2018-03-06 16:30:03 +00:00
* 8.0.2: release
Properly handle pages with no contents (fixes #194) Remove calls to assertPageObject(). All cases in the library that called assertPageObject() work fine if you don't call assertPageObject() because nothing assumes anything that was being checked by that call. Removing the calls enables more files to be successfully processed.
2018-03-06 16:25:09 +00:00
* Properly handle pages with no contents. Fixes #194.
Treat loop in xref tables as damage (fixes #192) Prior to this fix, if there was a loop detected in following /Prev pointers in xref streams/tables, it would cause qpdf to lose data. Note that this condition causes many PDF readers to hang or fail.
2018-03-05 19:25:17 +00:00
2018-03-05 Jay Berkenbilt <ejb@ql.org>
* Improve handling of loops while following cross reference
tables. Fixes #192.
Support "r" in page ranges (fixes #155)
2018-03-04 11:59:12 +00:00
2018-03-04 Jay Berkenbilt <ejb@ql.org>
Prepare 8.0.1 release
2018-03-04 12:14:36 +00:00
* 8.0.1: release
Support "r" in page ranges (fixes #155)
2018-03-04 11:59:12 +00:00
* On the command line when specifying page ranges, support
preceding a page number by "r" to indicate that it should be
counted from the end. For example, the range r3-r1 would indicate
the last three pages of a document.
Ignore zlib data check errors (fixes #191)
2018-03-03 16:35:01 +00:00
2018-03-03 Jay Berkenbilt <ejb@ql.org>
* Ignore zlib data check errors while uncompressing streams. This
is consistent with behaviors of other readers and enables handling
Spell check
2018-08-16 14:49:24 +00:00
of some incorrectly written zlib streams. Fixes #191.
Ignore zlib data check errors (fixes #191)
2018-03-03 16:35:01 +00:00
Release 8.0.0
2018-02-25 20:03:04 +00:00
2018-02-25 Jay Berkenbilt <ejb@ql.org>
* 8.0.0: release
Include filename in object stream parse error
2018-02-16 04:24:45 +00:00
2018-02-17 Jay Berkenbilt <ejb@ql.org>
Properly handle strings with PDF Doc Encoding (fixes #179) The QPDF_String::getUTF8Val() method was not treating strings that weren't explicitly Unicode as PDF Doc Encoded. This only affects characters in the range 0x80 through 0xa0.
2018-02-17 23:47:57 +00:00
* Fix QPDFObjectHandle::getUTF8Val() to properly handle strings
that are encoded with PDF Doc Encoding. Fixes #179.
Add C API for checking PDF files
2018-02-17 16:51:10 +00:00
* Add qpdf_check_pdf to the "C" API. This method just attempts to
read the entire file and produce no output, making possible to
assess whether the file has any errors that qpdf can detect.
More robust handling of type errors Give objects descriptions and context so it is possible to issue warnings instead of fatal errors for attempts to access objects of the wrong type.
2018-02-16 22:25:27 +00:00
* Major enhancements to handling of type errors within the qpdf
library. This fix is intended to eliminate those annoying cases
where qpdf would exit with a message like "operation for
Spell check
2018-08-16 14:49:24 +00:00
dictionary object attempted on object of wrong type" without
More robust handling of type errors Give objects descriptions and context so it is possible to issue warnings instead of fatal errors for attempts to access objects of the wrong type.
2018-02-16 22:25:27 +00:00
providing any context. Now qpdf keeps enough context to be able to
issue a proper warning and to handle such conditions in a sensible
way. This should greatly increase the number of bad files that
qpdf can recover, and it should make it much easier to figure out
what's broken when a file contains errors.
Replace "file position" with "offset" in error messages Sometimes it's an offset in an object stream or a content stream, so file position is confusing in some cases.
2018-02-16 23:38:05 +00:00
* Error message fix: replace "file position" with "offset" in
error messages that report lexical or parsing errors. Sometimes
it's an offset in an object stream or a content stream rather than
a file position, so this makes the error message less confusing in
those cases. It still requires some knowledge to find the exact
position of the error, since when it's not a file offset, it's
probably an offset into a stream after uncompressing it.
Include omitted object description in error message
2018-02-16 23:34:43 +00:00
* Error message fix: correct some cases in which the object that
contained a lexical error was omitted from the error message.
Include filename in object stream parse error
2018-02-16 04:24:45 +00:00
* Error message fix: improve file name in the error message when
there is a parser error inside an object stream.
Add additional interface for filtering page contents
2018-02-11 20:41:02 +00:00
2018-02-11 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::filterPageContents method to provide a
different interface for applying token filters to page contents
without modifying the ultimate output.
Lexer enhancements: EOF, comment, space Significant enhancements to the lexer to improve EOF handling and to support comments and spaces as tokens. Various other minor issues were fixed as well.
2018-01-28 23:28:45 +00:00
2018-02-04 Jay Berkenbilt <ejb@ql.org>
General comment in ChangeLog
2018-02-04 13:33:23 +00:00
* Changes listed on today's date are numerous and reflect
significant enhancements to qpdf's lexical layer. While many
nuances are discussed and a handful of small bugs were fixed, it
should be emphasized that none of these issues have any impact on
any output or behavior of qpdf under "normal" operation. There are
some changes that have an effect on content stream normalization
as with qdf mode or on code that interacts with PDF files
lexically using QPDFTokenizer. There are no incompatible changes
for normal operation. There are a few changes that will affect the
exact error messages issued on certain bad files, and there is a
small non-compatible enhancement regarding the behavior of
manually constructed QPDFTokenizer::Token objects. Users of the
qpdf command line tool will see no changes other than the addition
of a new command-line flag and possibly some improved error
messages.
Lexer enhancements: EOF, comment, space Significant enhancements to the lexer to improve EOF handling and to support comments and spaces as tokens. Various other minor issues were fixed as well.
2018-01-28 23:28:45 +00:00
* Significant lexer (tokenizer) enhancements. These are changes to
Inline image token type
2018-01-30 01:57:04 +00:00
the QPDFTokenizer class. These changes are of concern only to
people who are operating with PDF files at the lexical layer using
qpdf. They have little or no impact on most high-level interfaces
or the command-line tool.
New token types tt_space and tt_comment to recognize whitespace
and comments. this makes it possible to tokenize a PDF file or
stream and preserve everything about it.
For backward compatibility, space and comment tokens are not
returned by the tokenizer unless QPDFTokenizer.includeIgnorable()
is called.
Better handling of null bytes. These are now included in space
tokens rather than being their own "tt_word" tokens. This should
have no impact on any correct PDF file and has no impact on
output, but it may change offsets in some error messages when
trying to parse contents of bad files. Under default operation,
qpdf does not attempt to parse content streams, so this change is
mostly invisible.
Bug fix to handling of bad tokens at ends of streams. Now, when
allowEOF() has been called, these are treated as bad tokens
(tt_bad or an exception, depending on invocation), and a
separate tt_eof token is returned. Before the bad token
contents were returned as the value of a tt_eof token. tt_eof
tokens are always empty now.
Fix a bug that would, on rare occasions, report the offset in an
error message in the wrong space because of spaces or comments
adjacent to a bad token.
Clarify in comments exactly where the input source is positioned
surrounding calls to readToken and getToken.
* Add a new token type for inline images. This token type is only
returned by QPDFTokenizer immediately following a call to
expectInlineImage(). This change includes internal refactoring of
a handful of places that all separately handled inline images, The
logic of detecting inline images in content streams is now handled
in one place in the code. Also we are more flexible about what
characters may surround the EI operator that marks the end of an
inline image.
Lexer enhancements: EOF, comment, space Significant enhancements to the lexer to improve EOF handling and to support comments and spaces as tokens. Various other minor issues were fixed as well.
2018-01-28 23:28:45 +00:00
Refactor parseContentStream
2018-01-31 02:25:51 +00:00
* New method QPDFObjectHandle::parsePageContents() to improve upon
QPDFObjectHandle::parseContentStream(). The parseContentStream
method used to operate on a single content stream, but was fixed
to properly handle pages with contents split across multiple
streams in an earlier release. The new method parsePageContents()
can be called on the page object rather than the value of the
page dictionary's /Contents key. This removes a few lines of
boiler-plate code from any code that uses parseContentStream, and
it also enables creation of more helpful error messages if
problems are encountered as the error messages can include
information about which page the streams come from.
Switch from parseContentStream to parsePageContents
2018-01-31 02:39:38 +00:00
* Update content stream parsing example
(examples/pdf-parse-content.cc) to use new
QPDFObjectHandle::parsePageContents() method in favor of the older
QPDFObjectHandle::parseContentStream() method.
Bug fix: content normalizer should not add trailing newline Adding a trailing newline in content normalization damages files whose contents are split across streams in the middle of tokens. Let QPDFWriter add the newline with the indicator to ignore the newline, which it already does. This changes the way some qdf files look.
2018-01-31 16:59:02 +00:00
* Bug fix: change where the trailing newline is added to a stream
in QDF mode when content normalization is enabled (the default for
QDF mode). Before, the content normalizer ensured that the output
ended with a trailing newline, but this had the undesired side
effect of including the newline in the stream data for purposes of
length computation. QPDFWriter already appends a newline without
counting in length for better readability. Ordinarily this makes
no difference, but in the rare case of a page's contents being
split in the middle of a token, the old behavior could cause the
Spell check
2018-08-16 14:49:24 +00:00
extra newline to be interpreted as part of the token. This bug
Bug fix: content normalizer should not add trailing newline Adding a trailing newline in content normalization damages files whose contents are split across streams in the middle of tokens. Let QPDFWriter add the newline with the indicator to ignore the newline, which it already does. This changes the way some qdf files look.
2018-01-31 16:59:02 +00:00
could only be triggered in qdf mode, which is a mode intended for
manual inspection of PDF files' contents, so it is very unlikely
to have caused any actual problems for people using qpdf for
production use. Even if it did, it would be very unusual for a PDF
file to actually be adversely affected by this issue.
Add coalesce contents capability
2018-01-31 14:47:58 +00:00
* Add support for coalescing a page's contents into a single
stream if they are represented as an array of streams. This can be
performed from the command line using the --coalesce-contents
option. Coalescing content streams can simplify things for
software that wants to operate on a page's content streams without
having to handle weird edge cases like content streams split in
the middle of tokens. Note that
QPDFObjectHandle::parsePageContents and
QPDFObjectHandle::parseContentStream already handled split content
streams. This is mainly to set the stage for new methods of
operating on page contents. The new method
QPDFObjectHandle::pipeContentStreams will pipe all of a page's
content streams though a single pipeline. The new method
QPDFObjectHandle.coalesceContentStreams, when called on a page
object, will do nothing if the page's contents are a single
stream, but if they are an array of streams, it will replace the
page's contents with a single stream whose contents are the
concatenation of the original streams.
* A few library routines throw exceptions if called on non-page
objects. These constraints have been relaxed somewhat to make qpdf
more tolerant of files whose page dictionaries are not properly
marked as such. Mostly exceptions about page operations being
called on non page objects will only be thrown in cases where the
operation had no chance of succeeding anyway. This change has no
impact on any default mode operations, but it could allow
applications that use page-level APIs in QPDFObjectHandle to be
more tolerant of certain types of damaged files.
Implement TokenFilter and refactor Pl_QPDFTokenizer Implement a TokenFilter class and refactor Pl_QPDFTokenizer to use a TokenFilter class called ContentNormalizer. Pl_QPDFTokenizer is now a general filter that passes data through a TokenFilter.
2018-02-02 23:21:34 +00:00
* Add QPDFObjectHandle::TokenFilter class and methods to use it to
perform lexical filtering on content streams. You can call
QPDFObjectHandle::addTokenFilter on stream object, or you can call
the higher level QPDFObjectHandle::addContentTokenFilter on a page
object to cause the stream's contents to passed through a token
filter while being retrieved by QPDFWriter or any other consumer.
For details on using TokenFilter, please see comments in
QPDFObjectHandle.hh.
* Enhance the string, type QPDFTokenizer::Token constructor to
initialize a raw value in addition to a value. Tokens have a
value, which is a canonical representation, and a raw value. For
all tokens except strings and names, the raw value and the value
are the same. For strings, the value excludes the outer delimiters
and has non-printing characters normalized. For names, the value
resolves non-printing characters. In order to better facilitate
token filters that mostly preserve contents and to enable
developers to be mostly unconcerned about the nuances of token
values and raw values, creating string and name tokens now
properly handles this subtlety of values and raw values. When
constructing string tokens, take care to avoid passing in the
outer delimiters. This has always been the case, but it is now
clarified in comments in QPDFObjectHandle.hh::TokenFilter. This
has no impact on any existing code unless there's some code
somewhere that was relying on Token::getRawValue() returning an
empty string for a manually constructed token. The token class's
operator== method still only looks at type and value, not raw
value. For example, string tokens for <41> and (A) would still be
equal because both are representations of the string "A".
* Add QPDFObjectHandle::isDataModified method. This method just
returns true if addTokenFilter has been called on the stream. It
enables a caller to determine whether it is safe to optimize away
piping of stream data in cases where the input and output are
expected to be the same. QPDFWriter uses this internally to skip
the optimization of not re-compressing already compressed streams
if addTokenFilter has been called. Most developers will not have
to worry about this as it is used internally in the library in the
places that need it. If you are manually retrieving stream data
with QPDFObjectHandle::getStreamData or
QPDFObjectHandle::pipeStreamData, you don't need to worry about
this at all.
Spell check
2018-08-16 14:49:24 +00:00
* Provide heavily annotated examples/pdf-filter-tokens.cc example
Filter tokens example
2018-02-03 19:52:40 +00:00
that illustrates use of some simple token filters.
Detect and report bad tokens in content normalization
2018-02-03 02:16:40 +00:00
* When normalizing content streams, as in qdf mode, issue warning
about bad tokens. Content streams are only normalized when this is
explicitly requested, so this has no impact on normal operation.
However, in qdf mode, if qpdf detects a bad token, it means that
either there's a bug in qpdf's lexer, that the file is damaged, or
that the page's contents are split in a weird way. In any of those
cases, qpdf could potentially damage the stream's contents by
Spell check
2018-08-16 14:49:24 +00:00
replacing carriage returns with newlines or otherwise messing with
Detect and report bad tokens in content normalization
2018-02-03 02:16:40 +00:00
spaces. The mostly likely case of this would be an inline image's
compressed data being divided across two streams and having the
compressed data in the second stream contain a carriage return as
part of its binary data. If you are using qdf mode just to look at
PDF files in text editors, this usually doesn't matter. In cases
of contents split across multiple streams, coalescing streams
would eliminate the problem, so the warning mentions this. Prior
to this enhancement, the chances of qdf mode writing incorrect
data were already very low. This change should make it nearly
impossible for qdf mode to unknowingly write invalid data.
Add option to save pass 1 of lineariziation This is useful only for debugging the linearization code.
2018-01-31 21:45:52 +00:00
2018-02-04 Jay Berkenbilt <ejb@ql.org>
* Add QPDFWriter::setLinearizationPass1Filename method and
--linearize-pass1 command line option to allow specification of a
file into which QPDFWriter will write its intermediate
linearization pass 1 file. This is useful only for debugging qpdf.
qpdf creates linearized files by computing the output in two
passes. Ordinarily the first pass is discarded and not written
anywhere. This option allows it to be inspected.
Prepare 7.1.1 release
2018-02-04 23:31:42 +00:00
2018-02-04 Jay Berkenbilt <ejb@ql.org>
* 7.1.1: release
* Bug fix: properly linearize files whose /ID has a length of
other than 16 bytes.
* Rename some test files to avoid files with three dots in their
names. Fixes #173.
* Fix various build and compilation issues on some platforms and
compilers. Fixes #176, #172, #177
* Fix a few typos and clarify a few comments in header files.
Allow raw encryption key to be specified Add options to enable the raw encryption key to be directly shown or specified. Thanks to Didier Stevens <didier.stevens@gmail.com> for the idea and contribution of one implementation of this idea.
2018-01-14 15:17:17 +00:00
2018-01-14 Jay Berkenbilt <ejb@ql.org>
Update version numbers for 7.1.0
2018-01-14 19:10:04 +00:00
* 7.1.0: release
Spell check
2018-08-16 14:49:24 +00:00
* Allow raw encryption key to be specified in library and command
Allow raw encryption key to be specified Add options to enable the raw encryption key to be directly shown or specified. Thanks to Didier Stevens <didier.stevens@gmail.com> for the idea and contribution of one implementation of this idea.
2018-01-14 15:17:17 +00:00
line with the QPDF::setPasswordIsHexKey method and
--password-is-hex-key option. Allow encryption key to be displayed
with --show-encryption-key option. Thanks to Didier Stevens
<didier.stevens@gmail.com> for the idea and contribution of one
implementation of this idea. See his blog post at
https://blog.didierstevens.com/2017/12/28/cracking-encrypted-pdfs-part-3/
for a discussion of using this for cracking encrypted PDFs. I hope
that a future release of qpdf will include some additional
recovery options that may also make use of this capability.
Support TIFF Predictor (fixes #171)
2018-01-13 19:24:09 +00:00
2018-01-13 Jay Berkenbilt <ejb@ql.org>
Allow trailing . in numeric token (fixes #165)
2018-01-14 01:05:13 +00:00
* Fix lexical error: the PDF specification allows floating point
numbers to end with ".". Fixes #165.
Use correct link directory order (fixes #158) Make sure to link from the source tree before linking from the system. In many environments, this is necessary to allow a newly built qpdf to link properly instead of trying to link or resolve libraries from an older installed version.
2018-01-14 00:51:31 +00:00
* Fix link order in the build to avoid conflicts when building
Allow trailing . in numeric token (fixes #165)
2018-01-14 01:05:13 +00:00
from source while an older version of qpdf is installed. Fixes #158.
Use correct link directory order (fixes #158) Make sure to link from the source tree before linking from the system. In many environments, this is necessary to allow a newly built qpdf to link properly instead of trying to link or resolve libraries from an older installed version.
2018-01-14 00:51:31 +00:00
Support TIFF Predictor (fixes #171)
2018-01-13 19:24:09 +00:00
* Add support for TIFF predictor for LZW and Flate streams. Now
Allow trailing . in numeric token (fixes #165)
2018-01-14 01:05:13 +00:00
all predictor functions are supported. Fixes #171.
Support TIFF Predictor (fixes #171)
2018-01-13 19:24:09 +00:00
Update TODO and ChangeLog. Fixes #166, #83
2017-12-25 23:28:17 +00:00
2017-12-25 Jay Berkenbilt <ejb@ql.org>
Clarify documentation of advanced parsing options
2017-12-25 23:42:33 +00:00
* Clarify documentation around options that control parsing but
not output creation. Two options: --suppress-recovery and
--ignore-xref-streams, were documented in the "Advanced
Transformation Options" section of the manual and --help output
even though they are not related to output. These are now
described in a separate section called "Advanced Parsing Options."
Update TODO and ChangeLog. Fixes #166, #83
2017-12-25 23:28:17 +00:00
* Implement remaining PNG filters for decode. Prior versions could
decode only the "up" filter. Now all PNG filters (sub, up,
average, Paeth, optimal) are supported for decoding. Thanks to
Tobias Hoffmann for providing a test PDF file that has images with
all PNG filters along with different numbers of bits per sample
and samples per pixel, and thanks to Casey Rojas for providing
implementations of the remaining PNG filters.
The implementation of the remaining PNG filters changed the
interface to the private Pl_PNGFilter class, but this class's
header file is not in the installation, and there is no public
interface to the class. Within the library, the class is never
allocated on the stack; it is only ever dynamically allocated. As
such, this does not actually break binary compatibility of the
library.
Prepare 7.0.0 release
2017-09-16 01:23:02 +00:00
2017-09-15 Jay Berkenbilt <ejb@ql.org>
* 7.0.0: release
Update C API with new QPDFWriter methods
2017-09-12 00:11:10 +00:00
2017-09-12 Jay Berkenbilt <ejb@ql.org>
Additionally license under Apache License version 2.0 The Apache License version 2.0 is now the primary license for qpdf. However, users may, at their option, continue to use Artistic version 2.0.
2017-09-14 16:44:31 +00:00
* Relicense qpdf under version 2.0 of the Apache License rather
than version 2.0 of the Artistic License. Both are fine, but the
Apache License is in more widespread use, and I like it a little
better than Artistic-2.0. It is my intention that there be no
change in what you can or can't do with qpdf. Versions of qpdf
prior to version 7 were released under the terms of version 2.0 of
the Artistic License. At your option, you may continue to consider
qpdf to be licensed under those terms. Please see the manual for
additional information.
Improve message for stream decoding error Tweak the message so that we inform the user that we are mitigating data loss.
2017-09-12 19:48:08 +00:00
* Improve the error message that is issued when QPDFWriter
encounters a stream that can't be decoded. In particular, mention
that the stream will be copied without filtering to avoid data
loss.
Update C API with new QPDFWriter methods
2017-09-12 00:11:10 +00:00
* Add new methods to the C API to correspond to new additions to
QPDFWriter:
- qpdf_set_compress_streams
- qpdf_set_decode_level
- qpdf_set_preserve_unreferenced_objects
- qpdf_set_newline_before_endstream
Detect xref pointer infinite loop (fixes #149)
2017-08-25 23:58:31 +00:00
2017-08-25 Jay Berkenbilt <ejb@ql.org>
Parse iteratively to avoid stack overflow (fixes #146)
2017-08-26 01:52:29 +00:00
* Re-implement parser iteratively to avoid stack overflow on very
deeply nested arrays and dictionaries. Fixes #146.
Detect xref pointer infinite loop (fixes #149)
2017-08-25 23:58:31 +00:00
* Detect infinite loop while finding additional xref tables. Fixes
#149.
Update references to README files Most of the README files have been renamed. Refer to the new names.
2017-08-22 17:10:47 +00:00
2017-08-22 Jay Berkenbilt <ejb@ql.org>
Bump soname to 18 and version to 7.0.b1
2017-08-22 18:11:06 +00:00
* 7.0.b1: release
Update references to README files Most of the README files have been renamed. Refer to the new names.
2017-08-22 17:10:47 +00:00
* Convert all README files to markdown. Names changed as follows:
- README --> README.md
- README.hardening --> README-hardening.md
- README.maintainer --> README-maintainer.md
- README-what-to-download.txt --> README-what-to-download.md
- README-windows.txt --> README-windows.md
The file README-windows-install.txt remains a text file.
Update header documentation and ChangeLog entry for PCLm
2017-08-21 22:53:14 +00:00
2017-08-21 Jay Berkenbilt <ejb@ql.org>
* Add support for writing PCLm files. Most of the work was done by
Sahil Arora <sahilarora.535@gmail.com> as part of a Google Summer
of Code project in 2017. PCLm support is useful only for clients
that specifically know how to create PCLm files. Support in qpdf
is just for ensuring that objects are written in the correct order
and for including some additional material in the output that is
required by the PCLm standard.
Enable finer grained control of stream decoding This commit adds several API methods that enable control over which types of filters QPDF will attempt to decode. It also adds support for /RunLengthDecode and /DCTDecode filters for both encoding and decoding.
2017-08-19 13:18:14 +00:00
2017-08-19 Jay Berkenbilt <ejb@ql.org>
* Remove --precheck-streams. This is enabled by default now
without any efficiency cost. This feature was never released.
* Update pdf-create example to illustrate use of additional image
compression filters.
* Add support for /RunLengthDecode and /DCTDecode:
- New pipeline types Pl_RunLength and Pl_DCT
- New command-line flags --compress-streams and --decode-level
to replace/enhance --stream-data
- New QPDFWriter::setCompressStreams and
QPDFWriter::setDecodeLevel methods
Please see documentation, header files, and help messages for
details on these new features.
Change --single-pages to --split-pages This is in preparation for implementing page groups.
2017-08-12 15:49:04 +00:00
2017-08-12 Jay Berkenbilt <ejb@ql.org>
Add page rotation (fixes #132)
2017-08-12 17:22:46 +00:00
* Add QPDFObjectHandle::rotatePage to apply rotation to a page
object. Add --rotate option to qpdf to specify page rotation from
the command line.
Add --verbose flag
2017-08-12 16:30:18 +00:00
* Provide --verbose option that causes qpdf to print an indication
of what files it is writing.
Change --single-pages to --split-pages This is in preparation for implementing page groups.
2017-08-12 15:49:04 +00:00
* Change --single-pages to --split-pages and make it take an
optional argument specifying the number of pages per file.
Pad encryption parameters that are too short (fixes #96)
2017-08-11 23:53:56 +00:00
2017-08-11 Jay Berkenbilt <ejb@ql.org>
Fix --newline-before-endstream option (fixes #133) Add a newline unconditionally before endstream even if a newline was already written as part of the stream data.
2017-08-12 00:57:05 +00:00
* Fix --newline-before-endstream to always add a newline before
endstream even if the last character was already a newline. This
is actually what's required by PDF/A. Fixes #133.
Pad encryption parameters that are too short (fixes #96)
2017-08-11 23:53:56 +00:00
* Handle encrypted files whose encryption parameters are too
short. Fixes #96.
Remove unused PointerHolder interface Also fix a bug resulting from incorrect use of PointerHolder because of this unused parameter.
2017-08-10 22:17:24 +00:00
2017-08-10 Jay Berkenbilt <ejb@ql.org>
Remove PCRE
2017-08-11 00:24:16 +00:00
* Remove dependency on libpcre.
Read xref table without PCRE Also accept more errors than before.
2017-08-10 23:37:05 +00:00
* Be more forgiving of certain types of errors in the xref table
that don't interfere with interpreting the table.
Remove unused PointerHolder interface Also fix a bug resulting from incorrect use of PointerHolder because of this unused parameter.
2017-08-10 22:17:24 +00:00
* Remove unused "tracing" parameter from PointerHolder's
(T*, bool) constructor. This change breaks source code
compatibility, but since this argument to PointerHolder has not
used for a long time and the presence of a boolean parameter in
the primary constructor makes it too easy to use that by mistake
when trying to use PointerHolder for arrays, it seems like it's
finally time to take it out. If you have a compile error because
of this change, please check to see whether you intended to use
the (bool, T*) version of the constructor instead. If not, just
remove the second parameter.
Improve stream length recovery Eliminate PCRE and find endobj not preceded by endstream. Be more lax about placement of endstream and endobj.
2017-08-10 01:14:48 +00:00
2017-08-09 Jay Berkenbilt <ejb@ql.org>
* When recovering stream length, find endobj without endstream as
well as just looking for endstream. Be a little more lax about
where we allow it to be found.
Move page spec processing earlier
2017-08-05 12:29:26 +00:00
2017-08-05 Jay Berkenbilt <ejb@ql.org>
Add --split-pages option (fixes #30)
2017-08-05 14:01:34 +00:00
* Add --single-pages option to cause output to be written to a
separate file for each page rather than one big file.
Move page spec processing earlier
2017-08-05 12:29:26 +00:00
* Process --pages options earlier so that certain inspection
options, like --show-pages, can show the state after the merging
operations.
Fix off-by-one error in --pages argument parsing (fixes #129)
2017-08-03 01:06:41 +00:00
2017-08-02 Jay Berkenbilt <ejb@ql.org>
* Fix off-by-one error in parsing pages options. Fixes #129.
Better handle split content streams (fixes #73) When parsing content streams, allow content to be split arbitrarily across stream boundaries.
2017-07-29 14:40:31 +00:00
2017-07-29 Jay Berkenbilt <ejb@ql.org>
Allow reading command-line args from files (fixes #16)
2017-07-30 02:23:21 +00:00
* Support @filename and @- in the qpdf command-line tool to read
command-line arguments, one per line, from the named file. @-
reads from standard input. Fixes #16.
Detect input file = output file (fixes #29)
2017-07-30 00:19:54 +00:00
* Detect when input file and output file are the same and exit to
avoid overwriting and losing input file. Fixes #29.
Allow --check to coexist with and precede other operations (fixes #42)
2017-07-29 23:56:21 +00:00
* When passing multiple inspection arguments, run --check first,
and defer exit until after all the checks have been run. This
makes it possible to force operations such as --show-xref to be
delayed until after recovery attempts have been made. For example,
if you have a file with a syntactically valid xref table that has
some offsets that are incorrect, running qpdf --check --show-xref
on that file will first recover the xref and the dump the
recovered xref, while just running qpdf --show-xref will show the
xref table as present in the file. Fixes #42.
When recover stream length, indicate the length (fixes #44)
2017-07-29 23:15:06 +00:00
* When recovering stream length, indicate the recovered length.
Fixes #44.
Add newline-before-endstream option (fixes #103)
2017-07-29 16:18:03 +00:00
* Add --newline-before-endstream command-line option and
setNewlineBeforeEndstream method to QPDFWriter. This forces qpdf
to always add a newline before the endstream keyword. It is a
necessary but not sufficient condition for PDF/A compliance. Fixes
#103.
Handle zlib data errors better (fixes #106)
2017-07-29 16:07:19 +00:00
* Handle zlib data errors when decoding streams. Fixes #106.
Better recovery of bad stream start (fixes #104)
2017-07-29 15:59:15 +00:00
* Improve handling of files where the "stream" keyword is not
followed by proper line terminators. Fixes #104.
Better handle split content streams (fixes #73) When parsing content streams, allow content to be split arbitrarily across stream boundaries.
2017-07-29 14:40:31 +00:00
* Fix content stream parsing to handle cases of structures within
the stream split across stream boundaries. Fixes #73.
Add option to preserve unreferenced objects
2017-07-28 23:18:57 +00:00
2017-07-28 Jay Berkenbilt <ejb@ql.org>
* Add --preserve-unreferenced command-line option and
setPreserveUnreferencedObjects method to QPDFWriter. This option
causes QPDFWriter to write all objects from the input file to the
output file regardless of whether the objects are referenced.
Objects are written to the output file in numerical order from the
input file. This option has no effect for linearized files.
Convert object parsing errors to warnings QPDFObjectHandle::parseInternal now issues warnings instead of throwing exceptions for all error conditions that it finds (except internal logic errors) and has stronger recovery for things like invalid tokens and malformed dictionaries. This should improve qpdf's ability to recover from a wide range of broken files that currently cause it to fail.
2017-07-26 18:38:49 +00:00
2017-07-27 Jay Berkenbilt <ejb@ql.org>
Add precheck streams capability When requested, QPDFWriter will do more aggress prechecking of streams to make sure it can actually succeed in decoding them before attempting to do so. This will allow preservation of raw data even when the raw data is corrupted relative to the specified filters.
2017-07-28 03:42:27 +00:00
* Add --precheck-streams command-line option and setStreamPrecheck
Add option to preserve unreferenced objects
2017-07-28 23:18:57 +00:00
method to QPDFWriter to tell QPDFWriter to attempt decoding a
Add precheck streams capability When requested, QPDFWriter will do more aggress prechecking of streams to make sure it can actually succeed in decoding them before attempting to do so. This will allow preservation of raw data even when the raw data is corrupted relative to the specified filters.
2017-07-28 03:42:27 +00:00
stream fully before deciding whether to filter it or not.
Convert stream filtering errors to warnings
2017-07-27 22:18:18 +00:00
* Recover gracefully from streams that aren't filterable because
the filter parameters are invalid in the stream dictionary or the
dictionary itself is invalid.
Convert object parsing errors to warnings QPDFObjectHandle::parseInternal now issues warnings instead of throwing exceptions for all error conditions that it finds (except internal logic errors) and has stronger recovery for things like invalid tokens and malformed dictionaries. This should improve qpdf's ability to recover from a wide range of broken files that currently cause it to fail.
2017-07-26 18:38:49 +00:00
* Significantly improve recoverability from invalid qpdf objects.
Most conditions in basic object parsing that used to cause qpdf to
exit are now warnings. There are still many more opportunities for
improvements of this sort beyond just object parsing.
Fix infinite loop while reporting an error (fixes #101) This is CVE-2017-9210. The description string for an error message included unparsing an object, which is too complex of a thing to try to do while throwing an exception. There was only one example of this in the entire codebase, so it is not a pervasive problem. Fixing this eliminated one class of infinite loop errors.
2017-07-25 14:13:30 +00:00
2017-07-26 Jay Berkenbilt <ejb@ql.org>
Include tests for other infinite loop bugs fixes #117 fixes #118 fixes #119 fixes #120 Several other infinite loop bugs were fixed by previous changes. Include their test files in the test suite.
2017-07-26 10:19:19 +00:00
* Fixes to infinite loops below also fix problems reported in
other issues and cover CVE-2017-11624, CVE-2017-11625,
CVE-2017-11626, and CVE-2017-11627.
Don't interpret word tokens in content streams (fixes #82)
2017-07-26 09:35:34 +00:00
* Don't attempt to interpret syntactic keywords (like R and
endobj) found while parsing content streams.
Detect recursion loops resolving objects (fixes #51) During parsing of an object, sometimes parts of the object have to be resolved. An example is stream lengths. If such an object directly or indirectly points to the object being parsed, it can cause an infinite loop. Guard against all cases of re-entrant resolution of objects.
2017-07-26 09:03:38 +00:00
* Detect infinite loops while resolving objects. This could happen
if something inside an object that had to be resolved during
parsing, such as a stream length, recursively referenced the
object being resolved.
Handle object ID 0 (fixes #99) This is CVE-2017-9208. The QPDF library uses object ID 0 internally as a sentinel to represent a direct object, but prior to this fix, was not blocking handling of 0 0 obj or 0 0 R as a special case. Creating an object in the file with 0 0 obj could cause various infinite loops. The PDF spec doesn't allow for object 0. Having qpdf handle object 0 might be a better fix, but changing all the places in the code that assumes objid == 0 means direct would be risky.
2017-07-26 08:30:32 +00:00
* CVE-2017-9208: Handle references to and appearance of object 0
as a special case. Object 0 is not allowed, and qpdf was using it
internally to represent direct objects.
Avoid xref reconstruction infinite loop (fixes #100) This is CVE-2017-9209.
2017-07-25 14:21:27 +00:00
* CVE-2017-9209: Fix infinite loop caused by attempting to
reconstruct the xref table while already in the process of
reconstructing the xref table.
Fix infinite loop while reporting an error (fixes #101) This is CVE-2017-9210. The description string for an error message included unparsing an object, which is too complex of a thing to try to do while throwing an exception. There was only one example of this in the entire codebase, so it is not a pervasive problem. Fixing this eliminated one class of infinite loop errors.
2017-07-25 14:13:30 +00:00
* CVE-2017-9210: Fix infinite loop caused by attempting to unparse
an object for inclusion in the text of an exception.
Prepare 6.0.0 release
2015-11-10 17:48:52 +00:00
2015-11-10 Jay Berkenbilt <ejb@ql.org>
* 6.0.0: release
* No changes from 5.2.0. The 5.2.0 release broke binary
compatibility and was withdrawn.
Tolerate some mangled xref tables If xref table entries lack the spec-required trailing whitespace or contain a small amount of extra space, handle them anyway.
2015-10-31 21:03:55 +00:00
2015-10-31 Jay Berkenbilt <ejb@ql.org>
Prepare 5.2.0 release
2015-10-31 22:56:26 +00:00
* 5.2.0: release
Tolerate some mangled xref tables If xref table entries lack the spec-required trailing whitespace or contain a small amount of extra space, handle them anyway.
2015-10-31 21:03:55 +00:00
* libqpdf/QPDF.cc (read_xrefTable): Be tolerant of some malformed
xref tables that don't have the required trailing space after each
line.
Implement deterministic ID For non-encrypted files, determinstic ID generation uses file contents instead of timestamp and file name. At a small runtime cost, this enables generation of the same /ID if the same inputs are converted in the same way multiple times.
2015-10-25 15:09:25 +00:00
2015-10-29 Jay Berkenbilt <ejb@ql.org>
* Implement QPDFWriter::setDeterministicID and --deterministic-id
Switch spelling checker to cspell
2021-09-13 15:10:09 +00:00
command-line flag to qpdf to request generation of a deterministic
Implement deterministic ID For non-encrypted files, determinstic ID generation uses file contents instead of timestamp and file name. At a small runtime cost, this enables generation of the same /ID if the same inputs are converted in the same way multiple times.
2015-10-25 15:09:25 +00:00
/ID for non-encrypted files.
include time.h in QUtil.hh QUtil.hh needs time.h to get time_t on some platforms. Thanks Peter Korsgaard <peter@korsgaard.com>
2015-05-24 19:34:56 +00:00
2015-05-24 Jay Berkenbilt <ejb@ql.org>
Prepare 5.1.3 release
2015-05-24 21:26:37 +00:00
* 5.1.3: release
fix-qdf: handle object streams with > 255 objects fix-qdf was previously hard-coding the number of bytes for the f2 field of the xref stream entry. This addresses issue #37. Thanks aluebcke for reporting.
2015-05-24 20:20:22 +00:00
* Bug fix: fix-qdf was not handling object streams with more than
255 objects in them.
Handle Microsoft crypt provider without prior keys As reported in issue #40, a call to CryptAcquireContext in SecureRandomDataProvider fails in a fresh windows install prior to any user keys being created in AppData\Roaming\Microsoft\Crypto\RSA. Thanks michalrames.
2015-05-24 19:41:28 +00:00
* Handle Microsoft crypt provider initialization properly for case
where no keys have been previously created, such as in a fresh
Windows installation.
include time.h in QUtil.hh QUtil.hh needs time.h to get time_t on some platforms. Thanks Peter Korsgaard <peter@korsgaard.com>
2015-05-24 19:34:56 +00:00
* Include time.h in QUtil.hh for time_t
Avoid resolving arguments to R When checking two objects preceding R while parsing, ensure that the objects are direct. This avoids stuff like 1 0 obj containing 1 0 R 0 R from causing an infinite loop in object resolution.
2015-02-21 22:40:41 +00:00
2015-02-21 Jay Berkenbilt <ejb@ql.org>
Detect loops in /Pages structure Pushing inherited objects to pages and getting all pages were both prone to stack overflow infinite loops if there were loops in the Pages dictionary. There is a general weakness in the code in that any part of the code that traverses the Pages structure would be prone to this and would have to implement its own loop detection. A more robust fix may provide some general method for handling the Pages structure, but it's probably not worth doing. Note: addition of *Internal2 private functions was done rather than changing signatures of existing methods to avoid breaking compatibility.
2015-02-21 23:22:32 +00:00
* Detect loops in Pages structure. Thanks to Gynvael Coldwind and
Mateusz Jurczyk of the Google Security Team for providing a sample
file with this problem.
Avoid buffer overrun copying digest Converting a password to an encryption key is supposed to copy up to a certain number of bytes from a digest. Make sure never to copy more than the size of the digest.
2015-02-21 22:30:45 +00:00
* Prevent buffer overrun when converting a password to an
encryption key. Thanks to Gynvael Coldwind and Mateusz Jurczyk of
the Google Security Team for providing a sample file with this
problem.
Avoid resolving arguments to R When checking two objects preceding R while parsing, ensure that the objects are direct. This avoids stuff like 1 0 obj containing 1 0 R 0 R from causing an infinite loop in object resolution.
2015-02-21 22:40:41 +00:00
* Ensure that arguments to "R" when parsing the file are direct
objects before trying to resolve them. This prevents specially
crafted files from causing qpdf to crash with a stack overflow.
Thanks to Gynvael Coldwind and Mateusz Jurczyk of the Google
Security Team for providing a sample file with this problem.
Handle page tree node with no /Type Original reported here: https://bugs.launchpad.net/ubuntu/+source/qpdf/+bug/1397413 The PDF specification says that the /Type key for nodes in the pages dictionary (both /Page and /Pages) is required, but some PDF files omit them. Use the presence of other keys to determine the type of pages tree node this is if the type key is not found.
2014-12-01 19:44:47 +00:00
2014-12-01 Jay Berkenbilt <ejb@ql.org>
* Some broken PDF files lack the required /Type key for /Page and
/Pages nodes in the page dictionary. QPDF now uses other methods
to figure out what kind of node it is looking at so that it can
handle those files. Original reported at
https://bugs.launchpad.net/ubuntu/+source/qpdf/+bug/1397413
Handle pages with no /Contents from getPageContents() The spec allows /Contents to be omitted for pages that are blank, but QPDFObjectHandle::getPageContents() was throwing an exception in this case.
2014-11-14 18:43:34 +00:00
2014-11-14 Jay Berkenbilt <ejb@ql.org>
* Bug fix: QPDFObjectHandle::getPageContents() no longer throws an
exception when called on a page that has no /Contents key in its
dictionary. This is allowed by the spec, and some software
packages generate files like this for pages that are blank in the
original.
Handle indirect stream filter/decode parameters QPDFWriter was trying to make /Filter and /DecodeParms direct in all cases, but there are some cases where /DecodeParms may refer to a stream, which can't be direct. QPDFWriter doesn't actually need /DecodeParms to be direct in that case because it won't be able to filter the stream. Until we can handle this type of stream, just don't make /Filter and /DecodeParms direct if we can't filter the stream anyway. Fixes #34
2014-06-07 16:31:22 +00:00
2014-06-07 Jay Berkenbilt <ejb@ql.org>
Prepare 5.1.2 release
2014-06-07 20:37:13 +00:00
* 5.1.2: release
Windows build (msvc): target Windows 5.0.1 (XP) Without this, qpdf executables work only on Vista or newer. Fixes #35
2014-06-07 21:01:14 +00:00
* MS Visual C++ build: explicitly target Windows 5.0.1 (XP)
Example: fast split into single pages This is faster than using qpdf --pages to do it.
2014-06-07 17:04:30 +00:00
* New example program: pdf-split-pages: efficiently split PDF
files into individual pages.
Handle indirect stream filter/decode parameters QPDFWriter was trying to make /Filter and /DecodeParms direct in all cases, but there are some cases where /DecodeParms may refer to a stream, which can't be direct. QPDFWriter doesn't actually need /DecodeParms to be direct in that case because it won't be able to filter the stream. Until we can handle this type of stream, just don't make /Filter and /DecodeParms direct if we can't filter the stream anyway. Fixes #34
2014-06-07 16:31:22 +00:00
* Bug fix: don't fail on files that contain streams where /Filter
or /DecodeParms references a stream. Before, qpdf would try to
convert these to direct objects, which would fail because of the
stream.
Fix calculation of xref stream stream columns Fix problem: if the last object in the first part of a linearized file had an offset that was below 65536 by less than the size of the hint stream, the xref stream was invalid and the resulting file is not usable.
2014-02-23 03:12:34 +00:00
2014-02-22 Jay Berkenbilt <ejb@ql.org>
* Bug fix: if the last object in the first part of a linearized
file had an offset that was below 65536 by less than the size of
the hint stream, the xref stream was invalid and the resulting file
is not usable. This is now fixed.
Prepare 5.1.1 release
2014-01-14 20:45:35 +00:00
2014-01-14 Jay Berkenbilt <ejb@ql.org>
* 5.1.1: release
Avoid traversing same object twice when copying objects This is a performance fix. The output is unchanged. Fixes #28.
2013-12-26 16:51:50 +00:00
2013-12-26 Jay Berkenbilt <ejb@ql.org>
* Bug fix: when copying foreign objects (which occurs during page
splitting among other cases), avoid traversing the same object
more than once if it appears more than once in the same direct
object. This bug is performance-only and does not affect the
actual output.
Prepare 5.1.0 release
2013-12-17 20:26:07 +00:00
2013-12-17 Jay Berkenbilt <ejb@ql.org>
* 5.1.0: release
Increase random data provider support Add a method to get the current random data provider, and document and test the method for resetting it.
2013-12-16 21:03:54 +00:00
2013-12-16 Jay Berkenbilt <ejb@ql.org>
* Document and make explicit that passing null to
QUtil::setRandomDataProvider() resets the random data provider.
* Provide QUtil::getRandomDataProvider().
Allow arbitrary whitespace, not just newline, after xref Fixes #27.
2013-12-14 20:08:54 +00:00
2013-12-14 Jay Berkenbilt <ejb@ql.org>
Spell check
2018-08-16 14:49:24 +00:00
* Allow any space rather than just newline to follow xref header.
Allow arbitrary whitespace, not just newline, after xref Fixes #27.
2013-12-14 20:08:54 +00:00
This allows qpdf to read a wider range of damaged files.
Refactor random data generation Add new RandomDataProvider object and implement existing random number generation in terms of that. This enables end users to supply their own random data providers.
2013-11-30 17:02:56 +00:00
2013-11-30 Jay Berkenbilt <ejb@ql.org>
* Allow user-supplied random data provider to be used in place of
OS-provided or insecure random number generation. See
documentation for 5.1.0 for details.
Allow OS-provided secure random to be disabled
2013-11-30 17:25:01 +00:00
* Add configure option --enable-os-secure-random (enabled by
default). Pass --disable-os-secure-random or define
SKIP_OS_SECURE_RANDOM to avoid attempts to use the operating
system-provided secure random number generation. This can be
especially useful on Windows if you wish to avoid any dependency
on Microsoft's cryptography system.
Include <algorithm> for std::min, std::max
2013-11-29 15:20:50 +00:00
2013-11-29 Jay Berkenbilt <ejb@ql.org>
Allow -DNO_GET_ENVIRONMENT to avoid GetEnvironmentVariable If NO_GET_ENVIRONMENT is #defined at compile time on Windows, do not call GetEnvironmentVariable. QUtil::get_env will always return false. This option is not available through configure. This was added to support a specific user's requirements to avoid calling GetEnvironmentVariable from the Windows API. Nothing in qpdf outside the test coverage system in qtest relies on QUtil::get_env.
2013-11-30 03:08:25 +00:00
* If NO_GET_ENVIRONMENT is #defined, for Windows only,
QUtil::get_env will always return false. This was added to
support a user who needs to avoid calling GetEnvironmentVariable
from the Windows API. QUtil::get_env is not used for any
functionality in qpdf and exists only to support the test suite
including test coverage support with QTC (part of qtest).
Add /FS flag (msvc) for parallel builds
2013-11-30 03:08:01 +00:00
* Add /FS to msvc builds to allow parallel builds to work with
Visual C++ 2013.
Include <algorithm> for std::min, std::max
2013-11-29 15:20:50 +00:00
* Add missing #include <algorithm> in some files that use std::min
and std::max.
Use 8 bit per sample images in tests In compare image tests, use the gs device tiff24nc instead of tiff12nc since the 4 bit per sample images created by tiff12nc could sometimes trigger a bug in tiffcmp. Fixes #20.
2013-11-21 18:41:37 +00:00
2013-11-21 Jay Berkenbilt <ejb@ql.org>
* Change image comparison tests, which are disabled by default, to
use tiff files with 8 bits per sample rather than 4. This works
around a bug in tiffcmp but also increases time and disk space for
image comparison tests.
Add a ChangeLog note for previous fix
2013-11-21 18:30:58 +00:00
2013-10-28 Jay Berkenbilt <ejb@ql.org>
Add more detail to previous ChangeLog entry
2013-11-29 15:34:24 +00:00
* Fix MacOS compilation errors by adding a missing #include
<string> in a header file.
Add a ChangeLog note for previous fix
2013-11-21 18:30:58 +00:00
Warn when -accessibility=n will be ignored Also accept -accessibility=n with 256 bit keys even though it will be ignored.
2013-10-18 13:18:45 +00:00
2013-10-18 Jay Berkenbilt <ejb@ql.org>
Prepare for 5.0.1 release
2013-10-18 13:53:07 +00:00
* 5.0.1: release
Warn when -accessibility=n will be ignored Also accept -accessibility=n with 256 bit keys even though it will be ignored.
2013-10-18 13:18:45 +00:00
* Warn when -accessibility=n is specified with a modern encryption
format (R > 3). Also, accept this flag (and ignore with warning)
with 256-bit encryption. qpdf has always ignored the
accessibility setting with R > 3, but it previously did so
silently.
Security: keep cur_byte pointing into bytes array
2013-10-05 09:48:56 +00:00
2013-10-05 Jay Berkenbilt <ejb@ql.org>
Security: replace operator[] with at For std::string and std::vector, replace operator[] with at. This was done using an automated process. See README.hardening for details.
2013-10-05 23:42:39 +00:00
* Replace operator[] in std::string and std::vector with "at" in
order to get bounds checking. This reduces the chances that
incorrect code will result in data exposure or buffer overruns.
See README.hardening for additional notes.
Security: use a secure random number generator If not available, give an error. The user may also configure qpdf to use an insecure random number generator.
2013-10-05 21:36:33 +00:00
* Use cryptographically secure random number generation when
available. See additional notes in README.
Replace some assertions with std::logic_error Ideally, the library should never call assert outside of test code, but it does in several places. For some cases where the assertion might conceivably fail because of a problem with the input data, replace assertions with exceptions so that they can be trapped by the calling application. This commit surely misses some cases and replaced some cases unnecessarily, but it should still be an improvement.
2013-10-05 20:37:27 +00:00
* Replace some assert() calls with std::logic_error exceptions.
Ideally there shouldn't be assert() calls outside of testing.
This change may make a few more potential code errors in handling
invalid data recoverable.
Security: avoid pre-allocating vectors based on file data In places where std::vector<T>(size_t) was used, either validate that the size parameter is sane or refactor code to avoid the need to pre-allocate the vector.
2013-10-05 15:30:27 +00:00
* Security fix: In places where std::vector<T>(size_t) was used,
either validate that the size parameter is sane or refactor code
to avoid the need to pre-allocate the vector. This reduces the
likelihood of allocating a lot of memory in response to invalid
data in linearization hint streams.
Security: sanitize /W in xref stream The /W array was not sanitized, possibly causing an integer overflow in a multiplication. An analysis of the code suggests that there were no possible exploits based on this since the problems were in checking expected values but bounds checks were performed on actual values.
2013-10-05 16:28:52 +00:00
* Security fix: sanitize /W array in cross reference stream to
avoid a potential integer overflow in a multiplication. It is
unlikely that any exploits were possible from this bug as
additional checks were also performed.
Security: better bounds checks for linearization data The faulty code was only used during explicit checks of linearization data. Those checks are not part of normal reading or writing of PDF files.
2013-10-05 10:26:06 +00:00
* Security fix: avoid buffer overrun that could be caused by bogus
data in linearization hint streams. The incorrect code could only
be triggered when checking linearization data, which must be
invoked explicitly. qpdf does not check linearization data when
reading or writing linearized files, but the qpdf --check command
does check linearization data.
Security: handle empty name in normalizeName
2013-10-05 09:52:42 +00:00
* Security fix: properly handle empty strings in
QPDF_Name::normalizeName. The empty string is not a valid name
and would never be parsed as a name, so there were no known
conditions where this method could be called with an empty string.
Security: fix potential multiplication overflow Better sanity check inputs to bit stream reader
2013-10-05 09:51:54 +00:00
* Security fix: perform additional argument sanity checks when
reading bit streams.
Security: keep cur_byte pointing into bytes array
2013-10-05 09:48:56 +00:00
* Security fix: in QUtil::toUTF8, change bounds checking to avoid
having a pointer point temporarily outside the bounds of an
array. Some compiler optimizations could have made the original
code unsafe.
Change API/ABI and withdraw 4.2.0 4.2.0 was binary incompatible in spite of there being no deletions or changes to any public methods. As such, we have to bump the ABI and are fixing some API breakage while we're at it. Previous 4.3.0 target is now 5.1.0.
2013-07-10 15:07:40 +00:00
2013-07-10 Jay Berkenbilt <ejb@ql.org>
Prepare 5.0.0 release
2013-07-10 15:33:18 +00:00
* 5.0.0: release
Change API/ABI and withdraw 4.2.0 4.2.0 was binary incompatible in spite of there being no deletions or changes to any public methods. As such, we have to bump the ABI and are fixing some API breakage while we're at it. Previous 4.3.0 target is now 5.1.0.
2013-07-10 15:07:40 +00:00
* 4.2.0 turned out to be binary incompatible on some platforms
even though there were no changes to the public API. Therefore
the 4.2.0 release has been withdrawn, and is being replaced with a
5.0.0 release that acknowledges the ABI change and also removes
some problematic methods from the public API.
* Remove methods from public API that were only intended to be
used by QPDFWriter and really didn't make sense to call from
anywhere else as they required internal knowledge that only
QPDFWriter had:
- QPDF::getLinearizedParts
- QPDF::generateHintStream
- QPDF::getObjectStreamData
- QPDF::getCompressibleObjGens
- QPDF::getCompressibleObjects
Allow numeric range to be omitted qpdf --pages Detect a missing page range and assume 1-z.
2013-07-07 20:29:28 +00:00
2013-07-07 Jay Berkenbilt <ejb@ql.org>
Change API/ABI and withdraw 4.2.0 4.2.0 was binary incompatible in spite of there being no deletions or changes to any public methods. As such, we have to bump the ABI and are fixing some API breakage while we're at it. Previous 4.3.0 target is now 5.1.0.
2013-07-10 15:07:40 +00:00
* 4.2.0: release [withdrawn]
Prepare 4.2.0 release
2013-07-07 22:57:56 +00:00
Ignore broken DecodeParms for stream with no filters
2013-07-07 21:26:03 +00:00
* Ignore error case of a stream's decode parameters having invalid
length when there are no stream filters.
Add --show-npages option to qpdf
2013-07-07 21:04:41 +00:00
* qpdf: add --show-npages command-line option, which causes the
number of pages in the input file to be printed on a line by
itself.
Allow numeric range to be omitted qpdf --pages Detect a missing page range and assume 1-z.
2013-07-07 20:29:28 +00:00
* qpdf: allow omission of range in --pages. If range is omitted
such that an argument that is supposed to be a range is an invalid
range and a valid file name, the range of 1-z is assumed. This
makes it possible to merge a bunch of files with something like
qpdf --empty out.pdf --pages *.pdf --
Handle more broken files Space rather than newline after xref, missing /ID in trailer for encrypted file. This enables qpdf to handle some files that xpdf can handle. Adobe reader can't necessarily handle them.
2013-06-15 16:38:25 +00:00
2013-06-15 Jay Berkenbilt <ejb@ql.org>
* Handle some additional broken files with missing /ID in trailer
for encrypted files and with space rather than newline after xref.
Promote QPDF::ObjGen to top-level object QPDFObjGen
2013-06-14 15:22:04 +00:00
2013-06-14 Jay Berkenbilt <ejb@ql.org>
Handle /Outlines dictionary being a direct object Even though this case is not valid according to the spec, it has been seen, and caused an internal error.
2013-06-15 01:35:10 +00:00
* Detect and correct /Outlines dictionary being a direct object
when linearizing files. This is not allowed by the spec but has
been seen in the wild. Prior to this change, such a file would
cause an internal error in the linearization code, which assumed
/Outlines was indirect.
Add optional /Length key in crypt filter dictionary
2013-06-15 00:40:20 +00:00
* Add /Length key to crypt filter dictionary for encrypted files.
This key is optional, but some version of MacOS reportedly fail to
open encrypted PDF files without this key.
Bug fix: handle generation > 0 when generating object streams Rework QPDFWriter to always track old object IDs and QPDFObjGen instead of int, thus not discarding the generation number. Switch to QPDF::getCompressibleObjGen() to properly handle the case of an old object eligible for compression that has a generation of other than zero.
2013-06-14 18:53:47 +00:00
* Bug fix: properly handle object stream generation when the
original file has some compressible objects with generation != 0.
* Add QPDF::getCompressibleObjGens() and deprecate
QPDF::getCompressibleObjects(), which had a flaw in its logic.
Spell check
2018-08-16 14:49:24 +00:00
* Add new QPDFObjectHandle::getObjGen() method and indicate in
Add QPDFObjectHandle::getObjGen() This is safer than getObjectID() and getGeneration() for many uses.
2013-06-14 15:27:15 +00:00
comments that its use is favored over getObjectID() and
getGeneration() for most cases.
Promote QPDF::ObjGen to top-level object QPDFObjGen
2013-06-14 15:22:04 +00:00
* Add new QPDFObjGen object to represent an object ID/generation
pair.
Final preparation for 4.1.0 release
2013-04-14 18:39:59 +00:00
2013-04-14 Jay Berkenbilt <ejb@ql.org>
* 4.1.0: release
Document casting policy
2013-03-25 18:37:25 +00:00
2013-03-25 Jay Berkenbilt <ejb@ql.org>
* manual/qpdf-manual.xml: Document the casting policy that is
followed in qpdf's implementation.
Windows install: check DLL type When copying dlls, make sure to only consider DLLs whose type matches the type of what is loading them.
2013-03-11 16:34:31 +00:00
2013-03-11 Jay Berkenbilt <ejb@ql.org>
* When creating Windows binary distributions, make sure to only
copy DLLs of the correct type. The ensures that the 32-bit
distributions contain 32-bit DLLs and the 64-bit distributions
contain 64-bit DLLs.
Use ./install-sh instead of install -c
2013-03-07 16:28:06 +00:00
2013-03-07 Jay Berkenbilt <ejb@ql.org>
* Use ./install-sh (already present) instead of "install -c" to
install executables to fix portability problems against different
UNIX variants.
Add method to terminate content stream parsing
2013-03-03 20:48:31 +00:00
2013-03-03 Jay Berkenbilt <ejb@ql.org>
* Add protected terminateParsing method to
QPDFObjectHandle::ParserCallbacks that implementor can call to
terminate parsing of a content stream.
Remove all calls to sprintf
2013-02-28 21:20:45 +00:00
2013-02-28 Jay Berkenbilt <ejb@ql.org>
Favor strerror_s and fopen_s on MSVC Make remaining calls to fopen and strerror use strerror_s and fopen_s on MSVC.
2013-02-28 22:10:30 +00:00
* Favor fopen_s and strerror_s on MSVC to avoid CRT security
warnings. This is useful for people who may want to use qpdf in
an application that is Windows 8 certified.
Call QUtil::safe_fopen in place of fopen fopen was previuosly called wrapped by QUtil::fopen_wrapper, but QUtil::safe_fopen does this itself, which is less cumbersome.
2013-02-28 21:45:11 +00:00
* New method QUtil::safe_fopen to wrap calls to fopen. This is
less cumbersome than calling QUtil::fopen_wrapper.
Remove all calls to sprintf
2013-02-28 21:20:45 +00:00
* Remove all calls to sprintf
* New method QUtil::int_to_string_base to convert to octal or
Spell check
2018-08-16 14:49:24 +00:00
hexadecimal (or decimal) strings without using sprintf
Remove all calls to sprintf
2013-02-28 21:20:45 +00:00
Rewrite QUtil::int_to_string and QUtil::double_to_string Make them safer by avoiding any internal limits and replacing sprintf with std::ostringstream.
2013-02-26 17:31:00 +00:00
2013-02-26 Jay Berkenbilt <ejb@ql.org>
* Rewrite QUtil::int_to_string and QUtil::double_to_string to
remove internal length limits but to remain backward compatible
with the old versions for valid inputs.
Bug fix: properly handle overridden compressed objects When caching objects in an object stream, only cache objects that still resolve to that stream. See Changelog mod from this commit for details.
2013-02-23 22:41:27 +00:00
2013-02-23 Jay Berkenbilt <ejb@ql.org>
* Bug fix: properly handle overridden compressed objects. When
caching objects from an object stream, only cache objects that,
based on the xref table, would actually be resolved into this
stream. Prior to this fix, if an object stream A contained an
object B that was overridden by an appended section of the file,
qpdf would cache the old value of B if any non-overridden member
of A was accessed before B. This commit fixes that bug.
Do not remove libqpdf.la Some distributions (like debian) don't want .la files to be installed, but the responsibility for doing this should like in the packaging, not in qpdf itself.
2013-01-31 21:16:45 +00:00
2013-01-31 Jay Berkenbilt <ejb@ql.org>
* Do not remove libtool's .la file during the make install step.
Note to packagers: if your distribution wants to you remove the
.la file, you will have to do that yourself now.
Improve qpdf --check Fix exit status for case of errors without warnings, continue after errors when possible, add test case for parsing a file with content stream errors on some but not all pages.
2013-01-25 16:08:50 +00:00
2013-01-25 Jay Berkenbilt <ejb@ql.org>
Replace many calls to sprintf with QUtil::hex_encode Add QUtil::hex_encode to encode binary data has a hexadecimal string, and use it in place of sprintf where possible.
2013-01-25 13:59:55 +00:00
* New method QUtil::hex_encode to encode binary data as a
hexadecimal string
Improve qpdf --check Fix exit status for case of errors without warnings, continue after errors when possible, add test case for parsing a file with content stream errors on some but not all pages.
2013-01-25 16:08:50 +00:00
* qpdf --check was exiting with status 0 in some rare cases even
when errors were found. It now always exits with one of the
document error codes (0 for success, 2 for errors, 3 or warnings).
Have qpdf --check parse content streams Also move writing to null and parsing of content streams out of the wrong if block.
2013-01-24 15:47:29 +00:00
2013-01-24 Jay Berkenbilt <ejb@ql.org>
Handle warning flags better Make --enable-werror work properly on msvc, handle extra warnings flags for msvc in configure.ac instead of hardcoding into make/msvc.mk, separate warnings flags into WFLAGS in autoconf.mk to avoid duplication and to make it easier to override.
2013-01-24 16:18:28 +00:00
* Make --enable-werror work for MSVC, and generally handle warning
options better for that compiler. Warning flags for that compiler
were previous hard-coded into the build with /WX enabled
unconditionally.
* Split warning flags into WFLAGS in autoconf.mk to make them
easier to override. Before they were repeated in CFLAGS and
CXXFLAGS and were commingled with other compiler flags.
Have qpdf --check parse content streams Also move writing to null and parsing of content streams out of the wrong if block.
2013-01-24 15:47:29 +00:00
* qpdf --check now does syntactic checks all pages' content
streams as well as checking overall document structure. Semantic
errors are still not checked, and there are no plans to add
semantic checks.
Add getTypeCode() and getTypeName() Add virtual methods to QPDFObject, wrappers to QPDFObjectHandle, and implementations to all the QPDF_Object types.
2013-01-22 14:57:07 +00:00
2013-01-22 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::getTypeCode(). This method returns a
unique integer (enumerated type) value corresponding to the object
type of the QPDFObjectHandle. It can be used as an alternative to
the QPDFObjectHandle::is* methods for type testing, particularly
where there is a desire to use a switch statement or optimize for
performance when testing object types.
* Add QPDFObjectHandle::getTypeName(). This method returns a
string literal describing the object type. It is useful for
testing and debugging.
Added new QPDFObjectHandle types Keyword and InlineImage These object types are to facilitate content stream parsing.
2013-01-20 19:55:01 +00:00
2013-01-20 Jay Berkenbilt <ejb@ql.org>
Add getTypeCode() and getTypeName() Add virtual methods to QPDFObject, wrappers to QPDFObjectHandle, and implementations to all the QPDF_Object types.
2013-01-22 14:57:07 +00:00
* Add QPDFObjectHandle::parseContentStream, which parses the
Add QPDFObjectHandle::parseContentStream method This method allows parsing of the PDF objects in a content stream or array of content streams.
2013-01-20 20:26:45 +00:00
objects in a content stream and calls handlers in a callback
class. The example pdf-parse-content illustrates it use.
Cosmetic changes to be closer to Adobe terminology Change object type Keyword to Operator, and place the order of the object types in object_type_e in the same order as they are mentioned in the PDF specification. Note that this change only breaks backward compatibility with code that has not yet been released.
2013-01-23 14:38:05 +00:00
* Add QPDF_Operator and QPDF_InlineImage types along with
Added new QPDFObjectHandle types Keyword and InlineImage These object types are to facilitate content stream parsing.
2013-01-20 19:55:01 +00:00
appropriate wrapper methods in QPDFObjectHandle. These new object
types are to facilitate content stream parsing.
Prepare 4.0.1 release
2013-01-17 14:51:04 +00:00
2013-01-17 Jay Berkenbilt <ejb@ql.org>
* 4.0.1: release
* Add clarifying comment in QPDF.hh for methods that return the
user password to state that it is no longer possible with newer
encryption formats to recover the user password knowing the owner
password.
* Fix detection of binary attachments in the test suite. This
resolves false test failures on some platforms. No changes to the
actual QPDF code were made.
Update "C" API with functions for new features
2012-12-31 11:47:11 +00:00
2012-12-31 Jay Berkenbilt <ejb@ql.org>
Update versions for 4.0.0 release
2012-12-31 15:48:54 +00:00
* 4.0.0: release
Update "C" API with functions for new features
2012-12-31 11:47:11 +00:00
* Add new methods qpdf_get_pdf_extension_level,
qpdf_set_r5_encryption_parameters,
qpdf_set_r6_encryption_parameters,
qpdf_set_minimum_pdf_version_and_extension, and
qpdf_force_pdf_version_and_extension to support new functionality
from the C API.
Update ChangeLog with recent changes
2012-12-31 01:59:38 +00:00
2012-12-30 Jay Berkenbilt <ejb@ql.org>
* Fix long-standing bug that could theoretically have resulted in
possible misinterpretation of decode parameters in streams. As
far as I can tell, it is extremely unlikely that files with the
characteristics that would have triggered the bug actually exist
in cases that qpdf versions prior to 4.0.0 could have read.
Unencrypted files with encrypted attachments would have triggered
this bug, but qpdf versions prior to 4.0.0 already refused to open
such files.
* Fix long-standing bug in which a stream that used a crypt
filter and was otherwise not filterable by qpdf would be decrypted
properly but would retain the crypt filter indication in the
file. There are no known ways to create files like this, so it is
unlikely that anyone ever hit this bug.
2012-12-29 Jay Berkenbilt <ejb@ql.org>
* Add read/write support for both the deprecated Acrobat IX
encryption format and the Acrobat X/PDF 2.0 encryption format
using 256-bit AES keys. Using the Acrobat IX format (R=5) forces
the version of the file to 1.7 with extension level 3. Using the
PDF 2.0 format (R=6) forces it to 1.7 extension level 8.
* Add new method QPDF::getEncryptionKey to return the actual
encryption key used for encryption of data in the file. The key
is returned as a std::string.
* Non-compatible API change: change signature of
QPDF::compute_data_key to take the R and V values from the
encryption dictionary. There is no reason for any application
code to call this method since handling of encryption is done
Spell check
2018-08-16 14:49:24 +00:00
automatically by the qpdf library. It is used internally by
Update ChangeLog with recent changes
2012-12-31 01:59:38 +00:00
QPDFWriter.
* Support reading and decryption of files whose main text is not
encrypted but whose attachments are. More generally, support the
case of files and streams encrypted differently with some
limitations, described in the documentation. This was not
previously supported due to lack of test files, but I created test
files using a trial version of Acrobat XI to fully implement this
case.
* Incorporate sha2 code from sphlib 3.0. See README for
licensing. Create private pipeline class for computing hashes
with sha256, sha384, and sha512.
* Allow specification of initialization vector when using AES
filtering. This is required to compute the hash used in /R=6 (PDF
2.0) encryption.
2012-12-28 Jay Berkenbilt <ejb@ql.org>
* Add random number generation functions to QUtil.
* Fix old bug that could cause an infinite loop if user password
recovery methods were called and a password contained the "("
character (which happens to be the first byte of padding used by
older PDF encryption formats). This bug was noticed while reading
code and would not happen under ordinary usage patterns even if
the password contained that character.
Eliminate flattenScalarReferences
2012-12-27 16:39:01 +00:00
2012-12-27 Jay Berkenbilt <ejb@ql.org>
Update ChangeLog with recent changes
2012-12-31 01:59:38 +00:00
* Add awareness of extension level to PDF Version methods for both
reading and writing. This includes adding method
QPDF::getExtensionLevel and new versions of
QPDFWriter::setMinimumPDFVersion and QPDFWriter::forcePDFVersion
that support extension levels. The qpdf command-line tool
interprets version numbers of the form x.y.z as version x.y at
extension level z.
* Update AES classes to support use of 256-bit keys.
* Non-compatible API change: Removed public method
QPDF::flattenScalarReferences. Instead, just flatten the scalar
references we actually need to flatten. Flattening scalar
references was a wrong decision years ago and has occasionally
caused other problems, among which were that it caused qpdf to
visit otherwise unreferenced and possibly erroneous objects in the
file when it didn't have to. There's no reason that any
non-internal code would have had to call this.
* Non-compatible API change: Removed public method
QPDF::decodeStreams which was previously used by qpdf --check but
is no longer used. The decodeStreams method could generate false
positives since it would attempt to access all objects in the file
including those that were not referenced. There's no reason that
any non-internal code would have had to call this.
* Non-compatible API change: Removed public method
QPDF::trimTrailerForWrite, which was only intended for use by
QPDFWriter and which is no longer used.
2012-12-26 Jay Berkenbilt <ejb@ql.org>
* Add new fields to QPDF::EncryptionData to support newer
encryption formats (V=5, R=5 and R=6)
* Non-compatible API change: Change public nested class
QPDF::EncryptionData to make all member fields private and to add
method calls. This is a non-compatible API change, but changing
EncryptionData is necessary to support newer encryption formats,
and making this change will prevent the need from making a
non-compatible change in the future if new fields are added. A
public nested class should never have had public members to begin
with.
Eliminate flattenScalarReferences
2012-12-27 16:39:01 +00:00
Find PDF header anywhere in the first 1024 bytes
2012-12-25 19:38:18 +00:00
2012-12-25 Jay Berkenbilt <ejb@ql.org>
* Allow PDF header to appear anywhere in the first 1024 bytes of
the file as recommended in the implementation notes of the Adobe
version of the PDF spec.
Ignore objects with offset 0
2012-11-20 18:15:14 +00:00
2012-11-20 Jay Berkenbilt <ejb@ql.org>
Add Requires.private to libqpdf.pc for static linking
2012-11-20 18:36:02 +00:00
* Add zlib and libpcre to Requires.private in the pkg-config file
to support static linking. Thanks Tobias Hoffmann for pointing
out the omission.
Ignore objects with offset 0
2012-11-20 18:15:14 +00:00
* Ignore (with warning) non-freed objects in the xref table whose
offset is 0. Some PDF producers (incorrectly) do this. See
https://bugs.linuxfoundation.org/show_bug.cgi?id=1081.
Allow reading from InputSource and writing to Pipeline Allowing users to subclass InputSource and Pipeline to read and write from/to arbitrary sources provides the maximum flexibility for users who want to read and write from other than files or memory.
2012-09-23 21:42:26 +00:00
2012-09-23 Jay Berkenbilt <ejb@ql.org>
* Add public methods QPDF::processInputSource and
QPDFWriter::setOutputPipeline to allow users to read from custom
input sources and to write to custom pipelines. This allows the
maximum flexibility in sources for reading and writing PDF files.
Fix segmentation fault with use of QPDFWriter::setOutputMemory
2012-09-06 18:39:06 +00:00
2012-09-06 Jay Berkenbilt <ejb@ql.org>
Prepare 3.0.2 release
2012-09-06 19:47:58 +00:00
* 3.0.2: release
Add QPDFWriter::setExtraHeaderText
2012-09-06 19:30:13 +00:00
* Add new method QPDFWriter::setExtraHeaderText to add extra text,
such as application-specific comments, to near the beginning of a
PDF file. For linearized files, this appears after the
linearization parameter dictionary. For non-linearized files, it
appears right after the PDF header and non-ASCII comment.
Reset state in QPDF::calculateLinearizationData This makes it possible to use two different writers to write linearized files from the same QPDF object.
2012-09-06 19:28:16 +00:00
* Make it possible to write the same QPDF object with two
different QPDFWriter objects that have both called
setLinearization(true) by making private method
QPDF::calculateLinearizationData() properly initialize its state.
Fix segmentation fault with use of QPDFWriter::setOutputMemory
2012-09-06 18:39:06 +00:00
* Bug fix: Writing after calling QPDFWriter::setOutputMemory()
would cause a segmentation fault because of an internal field not
being initialized, rendering that method useless. This has been
corrected.
Bug fix: let EOF resolve literal token Previously only whitespace and comments did it. This fix is needed for object streams whose last object is a literal (name, integer, real, string) not terminated by space or newline.
2012-08-11 13:27:30 +00:00
2012-08-11 Jay Berkenbilt <ejb@ql.org>
Prepare 3.0.1 release
2012-08-11 17:39:19 +00:00
* 3.0.1: release
Bug fix: let EOF resolve literal token Previously only whitespace and comments did it. This fix is needed for object streams whose last object is a literal (name, integer, real, string) not terminated by space or newline.
2012-08-11 13:27:30 +00:00
* Bug fix: let EOF terminate a literal token as well as
whitespace or comments.
Update version to 3.0.0
2012-08-02 10:52:33 +00:00
2012-07-31 Jay Berkenbilt <ejb@ql.org>
* 3.0.0: release
Make release entry in ChangeLog
2012-07-29 18:34:10 +00:00
2012-07-29 Jay Berkenbilt <ejb@ql.org>
* 3.0.rc1: release
Restore coverage case Previous commit lost coverage case for buffer-based replaceStreamData.
2012-07-26 02:32:14 +00:00
2012-07-25 Jay Berkenbilt <ejb@ql.org>
* From Tobias: add QPDFObjectHandle::replaceStreamData that takes
a std::string analogous to the QPDFObjectHandle::newStream that
takes a string that was added earlier.
Implement QPDFObjectHandle::parse Move object parsing code from QPDF to QPDFObjectHandle and parameterize the parts of it that are specific to a QPDF object. Provide a version that can't handle indirect objects and that can be called on an arbitrary string. A side effect of this change is that the offset used when reporting invalid stream length has changed, but since the new value seems like a better value than the old one, the test suite has been updated rather than making the code backward compatible. This only effects the offset reported for invalid streams that lack /Length or have an invalid /Length key. Updated some test code and exmaples to use QPDFObjectHandle::parse. Supporting changes include adding a BufferInputSource constructor that takes a string.
2012-07-21 13:00:06 +00:00
2012-07-21 Jay Berkenbilt <ejb@ql.org>
Image comparison tests are off by default
2012-07-22 00:35:00 +00:00
* Change configure to have image comparison tests disabled by
default. Update README and README.maintainer with information
about running them.
Command-line page merging and splitting Implement --pages ... -- option for qpdf. Update TODO with remaining things to document.
2012-07-22 00:24:02 +00:00
* Add --pages command-line option to qpdf to enable page-based
merging and splitting.
Implement QPDFObjectHandle::parse Move object parsing code from QPDF to QPDFObjectHandle and parameterize the parts of it that are specific to a QPDF object. Provide a version that can't handle indirect objects and that can be called on an arbitrary string. A side effect of this change is that the offset used when reporting invalid stream length has changed, but since the new value seems like a better value than the old one, the test suite has been updated rather than making the code backward compatible. This only effects the offset reported for invalid streams that lack /Length or have an invalid /Length key. Updated some test code and exmaples to use QPDFObjectHandle::parse. Supporting changes include adding a BufferInputSource constructor that takes a string.
2012-07-21 13:00:06 +00:00
* Add new method QPDFObjectHandle::replaceDict to replace a
stream's dictionary. Use with caution; see comments in
QPDFObjectHandle.hh.
* Add new method QPDFObjectHandle::parse for creation of
QPDFObjectHandle objects from string representations of the
objects. Thanks to Tobias Hoffmann for the idea.
Bug fix: preserve AES when copying encryption parameters
2012-07-15 23:07:59 +00:00
2012-07-15 Jay Berkenbilt <ejb@ql.org>
Add command line option to copy encryption from other file Add --copy-encryption and --encryption-file-password options to qpdf. Also strengthen test suite for copying encryption. The strengthened test suite would have caught the failure to preserve AES and the failure to update the file version, which was invalidating the encrypted data.
2012-07-16 01:15:24 +00:00
* add new QPDF::isEncrypted method that returns some additional
information beyond other versions.
* libqpdf/QPDFWriter.cc: fix copyEncryptionParameters to fix the
minimum PDF version based on other file's encryption needs. This
is a fix to code added on 2012-07-14 and did not impact previously
released code.
Bug fix: preserve AES when copying encryption parameters
2012-07-15 23:07:59 +00:00
* libqpdf/QPDFWriter.cc (copyEncryptionParameters): Bug fix: qpdf
was not preserving whether or not AES encryption was being used
Add command line option to copy encryption from other file Add --copy-encryption and --encryption-file-password options to qpdf. Also strengthen test suite for copying encryption. The strengthened test suite would have caught the failure to preserve AES and the failure to update the file version, which was invalidating the encrypted data.
2012-07-16 01:15:24 +00:00
when copying encryption parameters. The file would still have
been properly encrypted, but a file that started off encrypted
with AES could have become encrypted with RC4.
Bug fix: preserve AES when copying encryption parameters
2012-07-15 23:07:59 +00:00
Have QPDFWriter detect foreign objects while writing Throw an exception that directs the user to QPDF::copyForeignObject.
2012-07-14 12:07:23 +00:00
2012-07-14 Jay Berkenbilt <ejb@ql.org>
Add public QPDFWriter::copyEncryptionParameters Method to copy encryption parameters from another file. Adapted from existing code to copy encryption parameters from the original file.
2012-07-14 13:13:49 +00:00
* QPDFWriter: add public copyEncryptionParameters to allow copying
encryption parameters from another file.
Have QPDFWriter detect foreign objects while writing Throw an exception that directs the user to QPDF::copyForeignObject.
2012-07-14 12:07:23 +00:00
* QPDFWriter: detect if the user has inserted an indirect object
from another QPDF object and throw an exception directing the user
to copyForeignObject.
Support copying objects from another QPDF object This includes QPDF::copyForeignObject and supporting foreign objects as arguments to addPage*.
2012-07-11 19:29:41 +00:00
2012-07-11 Jay Berkenbilt <ejb@ql.org>
* Added new APIs to copy objects from one QPDF to another. This
includes letting QPDF::addPage() (and QPDF::addPageAt()) accept a
page object from another QPDF and adding
QPDF::copyForeignObject(). See QPDF.hh for details.
* Add method QPDFObjectHandle::getOwningQPDF() to return the QPDF
object associated with an indirect QPDFObjectHandle.
* Add convenience methods to QPDFObjectHandle: assertIndirect(),
isPageObject(), isPagesObject()
* Cache when QPDF::pushInheritedAttributesToPage() has been called
to avoid traversing the pages trees multiple times. This state is
cleared by QPDF::updateAllPagesCache() and ignored by
QPDF::flattenPagesTree().
Add concept of reserved objects QPDFObjectHandle::{new,is,assert}Reserved, QPDF::replaceReserved provide a mechanism to add objects to a PDF file when there are circular references. This is a prerequisite to copying objects from one PDF to another.
2012-07-08 18:19:19 +00:00
2012-07-08 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::newReserved to create a reserved object
and QPDF::replaceReserved to replace it with a real object.
QPDFObjectHandle::newReserved reserves an object ID in a QPDF
object and ensures that any references to it remain unresolved.
When QPDF::replaceReserved is later called, previous references to
the reserved object will properly resolve to the replaced object.
Don't require stream data provider to know length in advance Breaking API change: length parameter has disappeared from the StreamDataProvider version of QPDFObjectHandle::replaceStreamData since it is no longer necessary to compute it in advance. This breaking change is justified by the fact that removing the length parameter provides the caller an opportunity to simplify the calling code.
2012-07-07 21:33:45 +00:00
2012-07-07 Jay Berkenbilt <ejb@ql.org>
* NOTE: BREAKING API CHANGE. Remove previously required length
parameter from the version QPDFObjectHandle::replaceStreamData
that uses a stream data provider. Prior to qpdf 3.0.0, you had to
compute the stream length in advance so that qpdf could internally
verify that the stream data had the same length every time the
provider was invoked. Now this requirement is enforced a
different way, and the length parameter is no longer required.
Note that I take API-breaking changes very seriously and only did
it in this case since the lack of need to know length in advance
could significantly simplify people's code. If you were
previously going to a lot of trouble to compute the length of the
new stream data in advance, you now no longer have to do that.
You can just drop the length parameter and remove any code that
was previously computing the length. Thanks to Tobias Hoffmann
for pointing out how annoying the original interface was.
Add QPDFWriter method to output to FILE*
2012-07-06 01:22:27 +00:00
2012-07-05 Jay Berkenbilt <ejb@ql.org>
* Add QPDFWriter methods to write to an already open stdio FILE*.
Implementation and idea area based on contributions from Tobias
Hoffmann.
Added test code for Tobias's changes
2012-07-05 03:19:32 +00:00
2012-07-04 Jay Berkenbilt <ejb@ql.org>
* Accept changes from Tobias Hoffmann: add public method
QPDF::pushInheritedAttributesToPage including warnings for
non-inherited keys that may be discarded from /Pages by
non-conformant PDF files when the /Pages tree is flattened.
Update ChangeLog and TODO
2012-06-27 14:18:29 +00:00
2012-06-27 Jay Berkenbilt <ejb@ql.org>
* Add Pl_Concatenate pipeline for stream concatenation also
implemented by Tobias Hoffmann. Also added test code
(libtests/concatenate.cc).
* Add new methods implemented by Tobias Hoffmann:
QPDFObjectHandle::newReal(double) and
QPDFObjectHandle::newStream(QPDF*, std::string const&).
2012-06-26 Jay Berkenbilt <ejb@ql.org>
* Minor changes so that support for PDF files larger than 4GB
works well with 32-bit and 64-bit Linux and also with 32-bit and
64-bit Windows with both MSVC and mingw.
* Rework internal methods for doing recovery of the cross
reference tables for much greater efficiency both in terms of time
and memory usage.
Update ChangeLog for previous fixes
2012-06-24 19:32:48 +00:00
2012-06-24 Jay Berkenbilt <ejb@ql.org>
* Support PDF files larger than 4 GB. This involved many changes
to the ABI to increase the size of integer types used in various
places as well as increasing the amount of padding used when
creating linearized files. Automated tests for large files are
disabled by default. Run ./configure --help for information on
enabling them. Running the tests requires 11 GB of free disk
space and takes several minutes.
Add factory methods for creating empty arrays and dictionaries. Also updated pdf_from_scratch test driver to use the new factories, and made some cosmetic improvements and documentation updates for the emptyPDF() method.
2012-06-22 13:46:33 +00:00
2012-06-22 Jay Berkenbilt <ejb@ql.org>
Add pdf-from-scratch example
2012-06-23 02:07:58 +00:00
* examples/pdf-create.cc: Provide an example of creating a PDF
from scratch. This simple PDF has a single page with some text
and an image.
Add factory methods for creating empty arrays and dictionaries. Also updated pdf_from_scratch test driver to use the new factories, and made some cosmetic improvements and documentation updates for the emptyPDF() method.
2012-06-22 13:46:33 +00:00
* Add empty QPDFObjectHandle factories for array and dictionary.
With PDF-from-scratch capability, it is useful to be able to
create empty arrays and dictionaries and add keys to them.
Updated pdf_from_scratch.cc to use these interfaces.
Add QPDF::processFile that takes an open FILE*
2012-06-21 11:59:56 +00:00
2012-06-21 Jay Berkenbilt <ejb@ql.org>
Add QPDF::emptyPDF() and pdf_from_scratch test code
2012-06-22 03:06:48 +00:00
* Add QPDF::emptyPDF() to create an empty QPDF object suitable for
adding pages and other objects to. pdf_from_scratch.cc is test
code that exercises it.
Fix order of build flags. Place user-specified CPPFLAGS and LDFLAGS later so that user-specified non-standard paths that have old versions of qpdf don't cause the build to fail.
2012-06-22 01:20:35 +00:00
* make/libtool.mk: Place user-specified CPPFLAGS and LDFLAGS later
in the compilation so that if a user installs things in a
non-standard place that they have to tell the build about, earlier
versions of qpdf installed there won't break the build. Thanks to
Macports for reporting this. (Fixes bug 3468860.)
Use qpdf_offset_t in place of off_t in public APIs. off_t is used internally only when needed to talk to standard libraries. This requires that the "long long" type be supported by the compiler.
2012-06-21 23:32:21 +00:00
* Instead of using off_t in the public APIs, use qpdf_offset_t
instead. This is defined as long long in qpdf/Types.h. If your
system doesn't support long long, you can redefine it.
ChangeLog entry for pkg-config files
2012-06-21 20:40:31 +00:00
* Add pkg-config files
Add QPDFObjectHandle::shallowCopy()
2012-06-21 20:14:34 +00:00
* QPDFObjectHandle: add shallowCopy() method
ChangeLog entries for page API
2012-06-21 19:28:58 +00:00
* QPDF: add new APIs for adding and removing pages. This includes
addPage(), addPageAt(), and removePage(). Also a method
updateAllPagesCache() is now available to force update of the
internal pages cache if you should modify the pages structure
manually.
* QPDF: new processFile method that takes an open FILE*
Add QPDF::processFile that takes an open FILE*
2012-06-21 11:59:56 +00:00
instead of a filename.
add ChangeLog entries for previous work
2012-06-21 11:58:44 +00:00
2012-06-20 Jay Berkenbilt <ejb@ql.org>
* Add new array mutation routines to QPDFObjectHandle.
Fix spelling of Tobias's last name. Sorry about that!
2012-06-21 14:55:02 +00:00
Implemented by Tobias Hoffmann.
add ChangeLog entries for previous work
2012-06-21 11:58:44 +00:00
Spell check
2018-08-16 14:49:24 +00:00
* Rework APIs that use size_t, off_t, and primitive integer types
add ChangeLog entries for previous work
2012-06-21 11:58:44 +00:00
so that size_t is used for sizes of memory and off_t is used for
file offsets. Also set _FILE_OFFSET_BITS so that large files can
be supported on 32-bit UNIX/Linux platforms. The code assumes in
places that sizeof(off_t) >= sizeof(size_t). This resulted in
non-compatible ABI changes and hopefully clears the way for QPDF
to work with files that are larger than 4 GiB in size.
* Add support for versioned symbols on ELF platforms.
* Various fixes for gcc 4.7
2011-04-06 Jay Berkenbilt <ejb@ql.org>
* Fix PCRE to stop using deprecated (and now dropped) interfaces.
Don't declare any PCRE objects static.
2011-12-28 19:30:16 +00:00
2011-12-28 Jay Berkenbilt <ejb@ql.org>
Update for 2.3.1
2011-12-28 22:19:40 +00:00
* 2.3.1: release
fix MSVC 2010 issues
2011-12-28 21:40:33 +00:00
* include <stdint.h> if available to support MSVC 2010
Don't declare any PCRE objects static.
2011-12-28 19:30:16 +00:00
* Since PCRE is not necessarily thread safe, don't declare any
PCRE objects to be static.
* Disregard stderr output from ghostscript when using it to
compare images in the test suite; see comments in qpdf.test for
details.
* Fixed a few documentation errors.
qpdf_set_info_key, qpdf_get_info_key
2011-08-11 14:48:37 +00:00
2011-08-11 Jay Berkenbilt <ejb@ql.org>
ready for 2.3.0 release
2011-08-11 19:34:41 +00:00
* 2.3.0: release
* include/qpdf/qpdf-c.h ("C"): add new methods
qpdf_init_write_memory, qpdf_get_buffer_length, and
qpdf_get_buffer to support writing to memory from the C API.
qpdf_set_info_key, qpdf_get_info_key
2011-08-11 14:48:37 +00:00
* include/qpdf/qpdf-c.h ("C"): add new methods qpdf_get_info_key
and qpdf_set_info_key for manipulating text fields of the /Info
dictionary.
implement ability to save PDF to memory, also update ChangeLog
2011-08-10 20:34:29 +00:00
2011-08-10 Jay Berkenbilt <ejb@ql.org>
preserve /EncryptMetadata when copying encryption parameters
2011-08-10 23:47:18 +00:00
* libqpdf/QPDFWriter.cc (copyEncryptionParameters): preserve
whether metadata is encryption. This fixes part of bug 3173659:
the password becomes invalid if qpdf copies an encrypted file with
cleartext-metadata.
implement ability to save PDF to memory, also update ChangeLog
2011-08-10 20:34:29 +00:00
* include/qpdf/QPDFWriter.hh: add a new constructor that takes
only a QPDF reference and leaves specification of output for
later. Add methods setOutputFilename() to set the output to a
filename or stdout, and setOutputMemory() to indicate that output
should go to a memory buffer. Add method getBuffer() to retrieve
the buffer used if output was saved to a memory buffer.
* include/qpdf/QPDF.hh: add methods replaceObject() and
swapObjects() to allow replacement of an object and swapping of
two objects by object ID.
* include/qpdf/QPDFObjectHandle.hh: add new methods getDictAsMap()
and getArrayAsVector() for returning the elements of a dictionary
or an array as a map or vector.
update libtool and autoconf files git-svn-id: svn+q:///qpdf/trunk@1061 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-06-25 16:52:09 +00:00
2011-06-25 Jay Berkenbilt <ejb@ql.org>
2.2.4 git-svn-id: svn+q:///qpdf/trunk@1062 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-06-25 18:39:05 +00:00
* 2.2.4: release
disable -Werror by default, don't strip shared libraries and executables during install git-svn-id: svn+q:///qpdf/trunk@1058 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-06-23 18:40:37 +00:00
2011-06-23 Jay Berkenbilt <ejb@ql.org>
* make/libtool.mk (install): Do not strip executables and shared
libraries during installation. Leave that up to the packager.
* configure.ac: disable -Werror by default.
gcc 4.6 warnings git-svn-id: svn+q:///qpdf/trunk@1057 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-05-07 13:45:28 +00:00
2011-05-07 Jay Berkenbilt <ejb@ql.org>
* libqpdf/QPDF_linearization.cc (isLinearized): remove unused
offset variable, found by a gcc 4.6 warning.
be less conservative when skipping over inline images in content normalization git-svn-id: svn+q:///qpdf/trunk@1050 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-04-30 18:20:35 +00:00
2011-04-30 Jay Berkenbilt <ejb@ql.org>
update version to 2.2.3, update copyright to 2011 git-svn-id: svn+q:///qpdf/trunk@1051 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-04-30 19:19:30 +00:00
* 2.2.3: release
accept stream keyword with CR only git-svn-id: svn+q:///qpdf/trunk@1052 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-04-30 21:46:09 +00:00
* libqpdf/QPDF.cc (readObjectInternal): Accept the case of the
stream keyword being followed by carriage return by itself. While
this is not permitted by the specification, there are PDF files
that do this, and other readers can read them.
be less conservative when skipping over inline images in content normalization git-svn-id: svn+q:///qpdf/trunk@1050 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-04-30 18:20:35 +00:00
* libqpdf/Pl_QPDFTokenizer.cc (processChar): When an inline image
is detected, suspend normalization only up to the end of the
inline image rather than for the remainder of the content stream.
(Fixes qpdf-Bugs 3152169.)
handle files with object 0 as a real object git-svn-id: svn+q:///qpdf/trunk@1049 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-01-31 14:59:42 +00:00
2011-01-31 Jay Berkenbilt <ejb@ql.org>
* libqpdf/QPDF.cc (readObjectAtOffset): use -1 rather than 0 when
reading an object at a given to indicate that no object number is
expected. This allows xref recovery to proceed even if a file
uses the invalid object number 0 as a regular object.
* libqpdf/QPDF_linearization.cc (isLinearized): use -1 rather than
Spell check
2018-08-16 14:49:24 +00:00
0 as a sentinel for not having found the first object in the
handle files with object 0 as a real object git-svn-id: svn+q:///qpdf/trunk@1049 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-01-31 14:59:42 +00:00
file. Since -1 can never match the regular expression, this
prevents an infinite loop when checking a file that starts with
(erroneous) 0 0 obj. (Fixes qpdf-Bugs-3159950.)
2.2.2 git-svn-id: svn+q:///qpdf/trunk@1045 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-04 15:26:40 +00:00
2010-10-04 Jay Berkenbilt <ejb@ql.org>
* 2.2.2: release
* include/qpdf/qpdf-c.h: Add qpdf_read_memory to C API to call
QPDF::processMemoryFile.
add QPDF::processMemoryFile and API additions to support it git-svn-id: svn+q:///qpdf/trunk@1034 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-01 10:20:38 +00:00
2010-10-01 Jay Berkenbilt <ejb@ql.org>
2.2.1 git-svn-id: svn+q:///qpdf/trunk@1037 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-01 11:07:12 +00:00
* 2.2.1: release
setOutputStreams git-svn-id: svn+q:///qpdf/trunk@1035 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-01 11:02:35 +00:00
* include/qpdf/QPDF.hh: Add setOutputStreams method to allow
redirection of library-generated output/error to alternative
streams.
add QPDF::processMemoryFile and API additions to support it git-svn-id: svn+q:///qpdf/trunk@1034 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-01 10:20:38 +00:00
* include/qpdf/QPDF.hh: Add processMemoryFile method for
processing a PDF file from a memory buffer instead of a file.
update git-svn-id: svn+q:///qpdf/trunk@1032 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-09-24 20:47:10 +00:00
2010-09-24 Jay Berkenbilt <ejb@ql.org>
* libqpdf/QPDF.cc: change private "file" method to be a
PointerHolder<InputSource> to prepare qpdf for being able to work
with PDF files loaded into memory in addition to working with
files on disk.
* include/qpdf/PointerHolder.hh: add operator* and operator->
methods so that PointerHolder objects can be used like pointers.
This is consistent with the smart pointer objects in the next
revision of C++.
handle stream filter abbreviations from table H.1 git-svn-id: svn+q:///qpdf/trunk@1025 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-09-05 15:00:44 +00:00
2010-09-05 Jay Berkenbilt <ejb@ql.org>
treat empty objects as null git-svn-id: svn+q:///qpdf/trunk@1027 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-09-06 02:17:55 +00:00
* libqpdf/QPDF.cc (readObjectInternal): Recognize empty objects
and treat them as null.
handle stream filter abbreviations from table H.1 git-svn-id: svn+q:///qpdf/trunk@1025 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-09-05 15:00:44 +00:00
* libqpdf/QPDF_Stream.cc (filterable): Handle inline image filter
abbreviations as stream filter abbreviations. Although this is
not technically allowed by the PDF specification, table H.1 in the
pre-ISO spec indicates that Adobe's readers accept them. Thanks
to Jian Ma <stronghorse@tom.com> for bringing this to my
attention.
document VC6 port git-svn-id: svn+q:///qpdf/trunk@1015 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-14 16:39:50 +00:00
2010-08-14 Jay Berkenbilt <ejb@ql.org>
2.2.0 git-svn-id: svn+q:///qpdf/trunk@1016 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-14 16:43:18 +00:00
* 2.2.0: release
document VC6 port git-svn-id: svn+q:///qpdf/trunk@1015 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-14 16:39:50 +00:00
* Rename README.windows to README-windows.txt and convert its line
endings to Windows-style line endings. Also mention Jian Ma's VC6
port in the manual and README-windows.txt.
getRawStreamData() git-svn-id: svn+q:///qpdf/trunk@1010 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-09 23:33:40 +00:00
2010-08-09 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::getRawStreamData to return raw
(unfiltered) stream data.
update version numbers git-svn-id: svn+q:///qpdf/trunk@1004 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-08 21:19:58 +00:00
2010-08-08 Jay Berkenbilt <ejb@ql.org>
* 2.2.rc1: release
addPageContents git-svn-id: svn+q:///qpdf/trunk@995 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:06:49 +00:00
2010-08-05 Jay Berkenbilt <ejb@ql.org>
add double-page-size example git-svn-id: svn+q:///qpdf/trunk@996 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:51:19 +00:00
* Add QPDFObjectHandle::addPageContents, a convenience routine for
appending or prepending new streams to a page's content streams.
invert images example git-svn-id: svn+q:///qpdf/trunk@1001 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-06 01:27:47 +00:00
The "pdf-double-page-size" example illustrates its use.
add double-page-size example git-svn-id: svn+q:///qpdf/trunk@996 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:51:19 +00:00
addPageContents git-svn-id: svn+q:///qpdf/trunk@995 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:06:49 +00:00
* Add new methods to QPDFObjectHandle: replaceStreamData and
newStream. These methods allow users of the qpdf library to add
notes git-svn-id: svn+q:///qpdf/trunk@997 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:54:15 +00:00
new streams and to replace data of existing streams. The
invert images example git-svn-id: svn+q:///qpdf/trunk@1001 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-06 01:27:47 +00:00
"pdf-double-page-size" and "pdf-invert-images" examples illustrate
their use.
addPageContents git-svn-id: svn+q:///qpdf/trunk@995 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:06:49 +00:00
fix memory leak git-svn-id: svn+q:///qpdf/trunk@976 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-06-06 13:32:08 +00:00
2010-06-06 Jay Berkenbilt <ejb@ql.org>
* Fix memory leak for QPDF objects whose underlying PDF objects
contain circular references. Thanks to Jian Ma
<stronghorse@tom.com> for calling my attention to the memory leak.
2.1.5 git-svn-id: svn+q:///qpdf/trunk@962 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-04-25 15:05:11 +00:00
2010-04-25 Jay Berkenbilt <ejb@ql.org>
* 2.1.5: release
* libqpdf/QPDF_encryption.cc (compute_encryption_key): remove
restrictions on length of file identifier string. (Fixes
qpdf-Bugs-2991412.)
fix linearization padding bug for second xref stream as well as first, which was previously fixed git-svn-id: svn+q:///qpdf/trunk@957 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-04-18 23:19:54 +00:00
2010-04-18 Jay Berkenbilt <ejb@ql.org>
* 2.1.4: release
* libqpdf/QPDFWriter.cc (writeLinearized): the padding calculation
fix in 2.1.2 was applied in only one place but it was needed in
two places since there are actually two cross reference streams in
a linearized file. The new padding calculation is now used for
both streams. Hopefully this should put an end to linearization
padding problems. (Fixes qpdf-Bugs-2979219.)
change output message from qpdf --check when no errors are found git-svn-id: svn+q:///qpdf/trunk@955 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-04-10 13:43:16 +00:00
2010-04-10 Jay Berkenbilt <ejb@ql.org>
* qpdf/qpdf.cc (main): Since qpdf --check only checks syntax and
stream encoding without doing any semantic checks, make the output
clearer when no errors around found. This is inspired by
qpdf-Bugs-2983225.
updated ChangeLog git-svn-id: svn+q:///qpdf/trunk@947 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-03-27 15:53:44 +00:00
2010-03-27 Jay Berkenbilt <ejb@ql.org>
update for 2.1.3 git-svn-id: svn+q:///qpdf/trunk@949 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-03-27 16:03:04 +00:00
* 2.1.3: release
updated ChangeLog git-svn-id: svn+q:///qpdf/trunk@947 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-03-27 15:53:44 +00:00
* libqpdf/QPDF_optimization.cc (flattenScalarReferences): Flatten
scalar references for unreferenced objects as well as those seen
during traversal of the file. This matters when preserving object
streams that contain unreferenced objects with indirect scalars.
(Fixes qpdf-Bugs-2974522.) Updated TODO with a description of a
possibly better fix involving removal of flattenScalarReferences.
* libqpdf/Pl_AES_PDF.cc (finish): Don't complain if an AES input
buffer is not a multiple of 16 bytes. Instead, just pad with
nulls and hope for the best. PDF files have been encountered "in
the wild" that contain AES buffers that aren't a multiple of 16
bytes.
update for 2.1.2 git-svn-id: svn+q:///qpdf/trunk@934 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-01-25 01:21:06 +00:00
2010-01-24 Jay Berkenbilt <ejb@ql.org>
* 2.1.2: release
* libqpdf/QPDFWriter.cc: fix logic error in padding calculation.
When writing linearized files with cross reference streams, the
padding calculation failed to take differences in sizes of
compressed data between pass 1 and pass 2 into consideration.
update test suite for 2.1.1 release git-svn-id: svn+q:///qpdf/trunk@927 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-12-14 19:50:37 +00:00
2009-12-14 Jay Berkenbilt <ejb@ql.org>
2.1.1 -- gcc 4.4 fixes git-svn-id: svn+q:///qpdf/trunk@925 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-12-14 02:35:31 +00:00
* 2.1.1: release
update test suite for 2.1.1 release git-svn-id: svn+q:///qpdf/trunk@927 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-12-14 19:50:37 +00:00
* qpdf/qtest/qpdf.test: improve test for acroread to make sure it
actually works and is not just present in the path.
2009-12-13 Jay Berkenbilt <ejb@ql.org>
2.1.1 -- gcc 4.4 fixes git-svn-id: svn+q:///qpdf/trunk@925 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-12-14 02:35:31 +00:00
* libqpdf/qpdf/Pl_AES_PDF.hh: include <stdint.h>, if available, so
we have valid definitions of uint32_t.
2.1 -- changelog git-svn-id: svn+q:///qpdf/trunk@912 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-30 23:57:02 +00:00
2009-10-30 Jay Berkenbilt <ejb@ql.org>
* 2.1: release
* libqpdf/QPDF.cc: be more forgiving of extraneous whitespace in
the xref table and while recovering from error conditions.
minor tweaks so rpm creation works properly in rhel5 git-svn-id: svn+q:///qpdf/trunk@911 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-27 01:51:56 +00:00
2009-10-26 Jay Berkenbilt <ejb@ql.org>
* Work around failure of PCRE test case; this test case exercises
an aspect of PCRE that qpdf does not use, and the test fails with
the version of PCRE on Red Hat Enterprise Linux 5, so we ignore
failure on this particular test case.
* Fix RPM .spec file to include "C" examples
set release date git-svn-id: svn+q:///qpdf/trunk@904 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 13:23:45 +00:00
2009-10-24 Jay Berkenbilt <ejb@ql.org>
prepare 2.1.rc1 for release git-svn-id: svn+q:///qpdf/trunk@901 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 04:47:17 +00:00
* 2.1.rc1: release
add C interface for getting software version git-svn-id: svn+q:///qpdf/trunk@903 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 13:23:20 +00:00
* Provide interfaces for getting qpdf's own version number
2009-10-19 Jay Berkenbilt <ejb@ql.org>
categorize all error messages and include object information if available git-svn-id: svn+q:///qpdf/trunk@829 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-19 23:09:19 +00:00
update C API for error retrieval git-svn-id: svn+q:///qpdf/trunk@830 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-20 00:24:44 +00:00
* include/qpdf/QPDF.hh (QPDF): getWarnings now returns a list of
QPDFExc rather than a list of strings. This way, warnings may be
inspected in more detail.
categorize all error messages and include object information if available git-svn-id: svn+q:///qpdf/trunk@829 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-19 23:09:19 +00:00
* Include information about the last object read in most error
messages. Most of the time, this will provide a good hint as to
which object contains the error, but it's possible that the last
object read may not necessarily be the one that has the error if
the erroneous object was previously read and cached.
only seed randon number generater once for aes-cbc, try to avoid compressing Metadata streams git-svn-id: svn+q:///qpdf/trunk@818 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-18 14:09:10 +00:00
2009-10-18 Jay Berkenbilt <ejb@ql.org>
more testing, bug fix for linearized aes encrypted files git-svn-id: svn+q:///qpdf/trunk@824 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-19 00:17:11 +00:00
* If forcing version, disable object stream creation and/or
encryption if previous specifications are incompatible with new
version. It is still possible that PDF content, compression
schemes, etc., may be incompatible with the new version, but at
least this way, older viewers will at least have a chance.
only seed randon number generater once for aes-cbc, try to avoid compressing Metadata streams git-svn-id: svn+q:///qpdf/trunk@818 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-18 14:09:10 +00:00
* libqpdf/QPDFWriter.cc (unparseObject): avoid compressing
Metadata streams if possible.
prepare 2.1.rc1 for release git-svn-id: svn+q:///qpdf/trunk@901 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 04:47:17 +00:00
2009-10-13 Jay Berkenbilt <ejb@ql.org>
* Upgrade embedded qtest to version 1.4, which allows the test
suite to be run in Windows with MSYS and ActiveState Perl rather
than requiring Cygwin perl.
only seed randon number generater once for aes-cbc, try to avoid compressing Metadata streams git-svn-id: svn+q:///qpdf/trunk@818 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-18 14:09:10 +00:00
2009-10-04 Jay Berkenbilt <ejb@ql.org>
* Implement support AES encrypt and crypt filters. Implementation
is not fully tested due to lack of test data but has been tested
for several cases.
bug fix: more gracefully handle xref stream with too many entries git-svn-id: svn+q:///qpdf/trunk@747 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-04 23:56:56 +00:00
2009-10-04 Jay Berkenbilt <ejb@ql.org>
Implement changes suggested by Zarko and our subsequent conversations: - Add a way to set the minimum PDF version - Add a way to force the PDF version - Have isEncrypted return true if an /Encrypt dictionary exists even when we can't read the file - Allow qpdf_init_write to be called multiple times - Update some comments in headers git-svn-id: svn+q:///qpdf/trunk@748 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-05 00:42:48 +00:00
* Add methods to QPDFWriter and corresponding command line
arguments to qpdf to set the minimum output PDF version and also
to force the version to a particular value.
bug fix: more gracefully handle xref stream with too many entries git-svn-id: svn+q:///qpdf/trunk@747 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-04 23:56:56 +00:00
* libqpdf/QPDF.cc (processXRefStream): warn and ignore extra xref
stream entries when stream is larger than reported size. This
used to be a fatal error. (Fixes qpdf-Bugs-2872265.)
more tests of C API git-svn-id: svn+q:///qpdf/trunk@728 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-27 16:55:24 +00:00
2009-09-27 Jay Berkenbilt <ejb@ql.org>
add methods for getting encryption data git-svn-id: svn+q:///qpdf/trunk@733 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-27 20:05:38 +00:00
* Add several methods to query permissions controlled by the
encryption dictionary. Note that qpdf does not enforce these
permissions even though it allows the user to query them.
more tests of C API git-svn-id: svn+q:///qpdf/trunk@728 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-27 16:55:24 +00:00
* The function QPDF::getUserPassword returned the user password
with the required padding as specified by the PDF specification.
This is seldom useful to users. This function has been replaced
by QPDF::getPaddedUserPassword. Call the new
Spell check
2018-08-16 14:49:24 +00:00
QPDF::getTrimmedUserPassword to retrieve the user password in a
more tests of C API git-svn-id: svn+q:///qpdf/trunk@728 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-27 16:55:24 +00:00
human-readable format.
* qpdf/qpdf.cc (main): qpdf --check now prints the PDF version
number in addition to its other output.
removed qexc; non-compatible ABI change git-svn-id: svn+q:///qpdf/trunk@709 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-26 18:36:04 +00:00
2009-09-26 Jay Berkenbilt <ejb@ql.org>
* Removed all references to QEXC; now using std::runtime_error and
std::logic_error and their subclasses for all exceptions.
2.0.6 git-svn-id: svn+q:///qpdf/trunk@673 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-05-03 16:38:04 +00:00
2009-05-03 Jay Berkenbilt <ejb@ql.org>
prepare 2.1.rc1 for release git-svn-id: svn+q:///qpdf/trunk@901 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 04:47:17 +00:00
* 2.0.6: release
2.0.6 git-svn-id: svn+q:///qpdf/trunk@673 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-05-03 16:38:04 +00:00
* libqpdf/QPDF_Stream.cc (filterable): ignore /DecodeParms if it's
not a type we recognize. (Fixes qpdf-Bugs-2779746.)
2.0.5 git-svn-id: svn+q:///qpdf/trunk@669 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-10 16:26:57 +00:00
2009-03-10 Jay Berkenbilt <ejb@ql.org>
update test suite to handle original object ID comments git-svn-id: svn+q:///qpdf/trunk@663 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 16:27:13 +00:00
prepare for 2.0.5 release git-svn-id: svn+q:///qpdf/trunk@667 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 16:59:37 +00:00
* 2.0.5: release
2.0.5 git-svn-id: svn+q:///qpdf/trunk@669 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-10 16:26:57 +00:00
2009-03-09 Jay Berkenbilt <ejb@ql.org>
update test suite to handle original object ID comments git-svn-id: svn+q:///qpdf/trunk@663 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 16:27:13 +00:00
* libqpdf/Pl_LZWDecoder.cc: adjust LZWDecoder full table
detection, now having been able to adequately test boundary
conditions both and with and without early code change. Also
compared implementation with other LZW decoders.
decode streams on check, always exit abnormally when warnings are detected git-svn-id: svn+q:///qpdf/trunk@660 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-08 19:00:19 +00:00
2009-03-08 Jay Berkenbilt <ejb@ql.org>
* qpdf/fix-qdf (write_ostream): Adjust offsets while writing
object streams to account for changes in the length of the
dictionary and offset tables.
* qpdf/qpdf.cc (main): In check mode, in addition to checking
structure of file, attempt to decode all stream data.
* libqpdf/QPDFWriter.cc (QPDFWriter::writeObject): In QDF mode,
checkpoint -- will have to finish another day git-svn-id: svn+q:///qpdf/trunk@661 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 01:11:06 +00:00
write a comment to the QDF file before each object that indicates
the object ID of the corresponding object from the original file.
update test suite to handle original object ID comments git-svn-id: svn+q:///qpdf/trunk@663 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 16:27:13 +00:00
Add --no-original-object-ids flag to qpdf and
setSuppressOriginalObjectIDs() method to QPDFWriter to turn this
behavior off.
decode streams on check, always exit abnormally when warnings are detected git-svn-id: svn+q:///qpdf/trunk@660 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-08 19:00:19 +00:00
* libqpdf/QPDF.cc (QPDF::pipeStreamData): Issue a warning instead
of failing if there is a problem found while decoding stream.
* qpdf/qpdf.cc: Exit with a status of 3 if warnings were found
regardless of what mode we're in.
update version to 2.0.4 git-svn-id: svn+q:///qpdf/trunk@653 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 14:10:40 +00:00
2009-02-21 Jay Berkenbilt <ejb@ql.org>
* 2.0.4: release
better recovery for appended files with damaged cross-reference tables git-svn-id: svn+q:///qpdf/trunk@649 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 02:31:32 +00:00
2009-02-20 Jay Berkenbilt <ejb@ql.org>
fix many typos in comments and strings git-svn-id: svn+q:///qpdf/trunk@651 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 02:54:31 +00:00
* Fix many typos in comments and strings.
special exit status in --check mode with warnings and no errors git-svn-id: svn+q:///qpdf/trunk@650 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 02:38:33 +00:00
* qpdf/qpdf.cc: in --check mode, if there are warnings but no
errors, exit with a status of 3.
better recovery for appended files with damaged cross-reference tables git-svn-id: svn+q:///qpdf/trunk@649 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 02:31:32 +00:00
* libqpdf/QPDF.cc (QPDF::insertXrefEntry): when recovering the
cross-reference table, have objects we encounter later in the file
supersede those we found earlier. This improves the chances of
being able to recover appended files with damaged cross-reference
tables.
fix problem with lzw decoder when run without early code change, now that we actually have test input git-svn-id: svn+q:///qpdf/trunk@646 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-20 02:27:36 +00:00
2009-02-19 Jay Berkenbilt <ejb@ql.org>
* libqpdf/Pl_LZWDecoder.cc: correct logic error for previously
untested case of running the LZW decoder without the "early code
change" flag. Thanks to a bug report from "Atom Smasher", I
finally was able to obtain an input stream compressed in this way.
update copyright, release 2.0.3 git-svn-id: svn+q:///qpdf/trunk@644 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-15 16:31:12 +00:00
2009-02-15 Jay Berkenbilt <ejb@ql.org>
* 2.0.3: release
-help and -version git-svn-id: svn+q:///qpdf/trunk@643 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-12-12 03:17:25 +00:00
2008-12-11 Jay Berkenbilt <ejb@ql.org>
* qpdf/qpdf.cc (main): Accept -help and -version as well as --help
and --version
handle UTF-16BE fully git-svn-id: svn+q:///qpdf/trunk@639 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-11-23 18:49:13 +00:00
2008-11-23 Jay Berkenbilt <ejb@ql.org>
gcc 4.4 fixes git-svn-id: svn+q:///qpdf/trunk@642 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-11-23 19:11:24 +00:00
* Include stdio.h in a few files for proper compilation with (yet
to be released) gcc 4.4
updated qtest git-svn-id: svn+q:///qpdf/trunk@641 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-11-23 19:01:11 +00:00
* updated embedded qtest to version 1.3
handle UTF-16BE fully git-svn-id: svn+q:///qpdf/trunk@639 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-11-23 18:49:13 +00:00
* libqpdf/QPDF_String.cc (QPDF_String::getUTF8Val): handle
UTF-16BE properly rather than just treating the string as a string
of 16-bit characters.
2.0.2 git-svn-id: svn+q:///qpdf/trunk@634 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-06-30 14:48:16 +00:00
2008-06-30 Jay Berkenbilt <ejb@ql.org>
* 2.0.2: release
* updated embedded qtest to version 1.2 (includes previous
changes)
fix bashism git-svn-id: svn+q:///qpdf/trunk@633 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-06-08 00:46:06 +00:00
2008-06-07 Jay Berkenbilt <ejb@ql.org>
* qpdf/qtest/qpdf/diff-encrypted: change == to = so that the test
suite passes when /bin/sh is not bash
changelog update git-svn-id: svn+q:///qpdf/trunk@629 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-07 15:43:35 +00:00
2008-05-07 Jay Berkenbilt <ejb@ql.org>
* qtest/bin/qtest-driver (run_test): increase timeout for qtest to
be more tolerant of slow machines
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
2008-05-06 Jay Berkenbilt <ejb@ql.org>
changelog update git-svn-id: svn+q:///qpdf/trunk@629 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-07 15:43:35 +00:00
* 2.0.1: release
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* make/rules.mk: fix logic with .dep generation for .lo files so
that dependencies work properly with libtool
changelog date git-svn-id: svn+q:///qpdf/trunk@620 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 14:45:06 +00:00
2008-05-05 Jay Berkenbilt <ejb@ql.org>
missing strlen.h causes problems with gcc 4.3 git-svn-id: svn+q:///qpdf/trunk@606 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-04 02:09:53 +00:00
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* libqpdf/qpdf/MD5.hh: fix header to be 64-bit clean
* configure.ac: add tests for sized integer types
update changelog git-svn-id: svn+q:///qpdf/trunk@619 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 14:33:34 +00:00
changelog date git-svn-id: svn+q:///qpdf/trunk@620 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 14:45:06 +00:00
2008-05-04 Jay Berkenbilt <ejb@ql.org>
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* libqpdf/QPDF_encryption.cc: do not assume size_t is unsigned int
64-bit fix git-svn-id: svn+q:///qpdf/trunk@611 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 02:08:47 +00:00
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* qpdf/qtest/qpdf.test: removed locale-specific tests. These were
really to check bugs in perl 5.8.0 and are obsolete now. They
also make the test suite fail in some environments that don't have
all the locales fully configured.
64-bit fix git-svn-id: svn+q:///qpdf/trunk@611 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 02:08:47 +00:00
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* various: updated several files for gcc 4.3 by adding missing
includes (string.h, stdlib.h)
missing strlen.h causes problems with gcc 4.3 git-svn-id: svn+q:///qpdf/trunk@606 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-04 02:09:53 +00:00
update release date to actual date git-svn-id: svn+q:///qpdf/trunk@599 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-04-29 12:55:25 +00:00
2008-04-26 Jay Berkenbilt <ejb@ql.org>
* 2.0: initial public release
Copy Permalink