octoleo/qpdf
2
1
Fork 0
mirror of https://github.com/qpdf/qpdf.git synced 2024-12-22 02:49:00 +00:00
Code Issues Releases Wiki Activity
b8ccbff413
qpdf/ChangeLog

1788 lines
69 KiB
Plaintext
Raw Normal View History

Limit depth of nesting in direct objects (fixes #202) This fixes CVE-2018-9918.
2018-04-15 20:11:22 +00:00
2018-04-15 Jay Berkenbilt <ejb@ql.org>
* Arbitrarily limit the depth of data structures represented by
direct object. This is CVE-2018-9918. Fixes #202.
Properly handle pages with no contents (fixes #194) Remove calls to assertPageObject(). All cases in the library that called assertPageObject() work fine if you don't call assertPageObject() because nothing assumes anything that was being checked by that call. Removing the calls enables more files to be successfully processed.
2018-03-06 16:25:09 +00:00
2018-03-06 Jay Berkenbilt <ejb@ql.org>
Prepare 8.0.2 release
2018-03-06 16:30:03 +00:00
* 8.0.2: release
Properly handle pages with no contents (fixes #194) Remove calls to assertPageObject(). All cases in the library that called assertPageObject() work fine if you don't call assertPageObject() because nothing assumes anything that was being checked by that call. Removing the calls enables more files to be successfully processed.
2018-03-06 16:25:09 +00:00
* Properly handle pages with no contents. Fixes #194.
Treat loop in xref tables as damage (fixes #192) Prior to this fix, if there was a loop detected in following /Prev pointers in xref streams/tables, it would cause qpdf to lose data. Note that this condition causes many PDF readers to hang or fail.
2018-03-05 19:25:17 +00:00
2018-03-05 Jay Berkenbilt <ejb@ql.org>
* Improve handling of loops while following cross reference
tables. Fixes #192.
Support "r" in page ranges (fixes #155)
2018-03-04 11:59:12 +00:00
2018-03-04 Jay Berkenbilt <ejb@ql.org>
Prepare 8.0.1 release
2018-03-04 12:14:36 +00:00
* 8.0.1: release
Support "r" in page ranges (fixes #155)
2018-03-04 11:59:12 +00:00
* On the command line when specifying page ranges, support
preceding a page number by "r" to indicate that it should be
counted from the end. For example, the range r3-r1 would indicate
the last three pages of a document.
Ignore zlib data check errors (fixes #191)
2018-03-03 16:35:01 +00:00
2018-03-03 Jay Berkenbilt <ejb@ql.org>
* Ignore zlib data check errors while uncompressing streams. This
is consistent with behaviors of other readers and enables handling
of some incorrectly written zlib strems. Fixes #191.
Release 8.0.0
2018-02-25 20:03:04 +00:00
2018-02-25 Jay Berkenbilt <ejb@ql.org>
* 8.0.0: release
Include filename in object stream parse error
2018-02-16 04:24:45 +00:00
2018-02-17 Jay Berkenbilt <ejb@ql.org>
Properly handle strings with PDF Doc Encoding (fixes #179) The QPDF_String::getUTF8Val() method was not treating strings that weren't explicitly Unicode as PDF Doc Encoded. This only affects characters in the range 0x80 through 0xa0.
2018-02-17 23:47:57 +00:00
* Fix QPDFObjectHandle::getUTF8Val() to properly handle strings
that are encoded with PDF Doc Encoding. Fixes #179.
Add C API for checking PDF files
2018-02-17 16:51:10 +00:00
* Add qpdf_check_pdf to the "C" API. This method just attempts to
read the entire file and produce no output, making possible to
assess whether the file has any errors that qpdf can detect.
More robust handling of type errors Give objects descriptions and context so it is possible to issue warnings instead of fatal errors for attempts to access objects of the wrong type.
2018-02-16 22:25:27 +00:00
* Major enhancements to handling of type errors within the qpdf
library. This fix is intended to eliminate those annoying cases
where qpdf would exit with a message like "operation for
dictionary object attemped on object of wrong type" without
providing any context. Now qpdf keeps enough context to be able to
issue a proper warning and to handle such conditions in a sensible
way. This should greatly increase the number of bad files that
qpdf can recover, and it should make it much easier to figure out
what's broken when a file contains errors.
Replace "file position" with "offset" in error messages Sometimes it's an offset in an object stream or a content stream, so file position is confusing in some cases.
2018-02-16 23:38:05 +00:00
* Error message fix: replace "file position" with "offset" in
error messages that report lexical or parsing errors. Sometimes
it's an offset in an object stream or a content stream rather than
a file position, so this makes the error message less confusing in
those cases. It still requires some knowledge to find the exact
position of the error, since when it's not a file offset, it's
probably an offset into a stream after uncompressing it.
Include omitted object description in error message
2018-02-16 23:34:43 +00:00
* Error message fix: correct some cases in which the object that
contained a lexical error was omitted from the error message.
Include filename in object stream parse error
2018-02-16 04:24:45 +00:00
* Error message fix: improve file name in the error message when
there is a parser error inside an object stream.
Add additional interface for filtering page contents
2018-02-11 20:41:02 +00:00
2018-02-11 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::filterPageContents method to provide a
different interface for applying token filters to page contents
without modifying the ultimate output.
Lexer enhancements: EOF, comment, space Significant enhancements to the lexer to improve EOF handling and to support comments and spaces as tokens. Various other minor issues were fixed as well.
2018-01-28 23:28:45 +00:00
2018-02-04 Jay Berkenbilt <ejb@ql.org>
General comment in ChangeLog
2018-02-04 13:33:23 +00:00
* Changes listed on today's date are numerous and reflect
significant enhancements to qpdf's lexical layer. While many
nuances are discussed and a handful of small bugs were fixed, it
should be emphasized that none of these issues have any impact on
any output or behavior of qpdf under "normal" operation. There are
some changes that have an effect on content stream normalization
as with qdf mode or on code that interacts with PDF files
lexically using QPDFTokenizer. There are no incompatible changes
for normal operation. There are a few changes that will affect the
exact error messages issued on certain bad files, and there is a
small non-compatible enhancement regarding the behavior of
manually constructed QPDFTokenizer::Token objects. Users of the
qpdf command line tool will see no changes other than the addition
of a new command-line flag and possibly some improved error
messages.
Lexer enhancements: EOF, comment, space Significant enhancements to the lexer to improve EOF handling and to support comments and spaces as tokens. Various other minor issues were fixed as well.
2018-01-28 23:28:45 +00:00
* Significant lexer (tokenizer) enhancements. These are changes to
Inline image token type
2018-01-30 01:57:04 +00:00
the QPDFTokenizer class. These changes are of concern only to
people who are operating with PDF files at the lexical layer using
qpdf. They have little or no impact on most high-level interfaces
or the command-line tool.
New token types tt_space and tt_comment to recognize whitespace
and comments. this makes it possible to tokenize a PDF file or
stream and preserve everything about it.
For backward compatibility, space and comment tokens are not
returned by the tokenizer unless QPDFTokenizer.includeIgnorable()
is called.
Better handling of null bytes. These are now included in space
tokens rather than being their own "tt_word" tokens. This should
have no impact on any correct PDF file and has no impact on
output, but it may change offsets in some error messages when
trying to parse contents of bad files. Under default operation,
qpdf does not attempt to parse content streams, so this change is
mostly invisible.
Bug fix to handling of bad tokens at ends of streams. Now, when
allowEOF() has been called, these are treated as bad tokens
(tt_bad or an exception, depending on invocation), and a
separate tt_eof token is returned. Before the bad token
contents were returned as the value of a tt_eof token. tt_eof
tokens are always empty now.
Fix a bug that would, on rare occasions, report the offset in an
error message in the wrong space because of spaces or comments
adjacent to a bad token.
Clarify in comments exactly where the input source is positioned
surrounding calls to readToken and getToken.
* Add a new token type for inline images. This token type is only
returned by QPDFTokenizer immediately following a call to
expectInlineImage(). This change includes internal refactoring of
a handful of places that all separately handled inline images, The
logic of detecting inline images in content streams is now handled
in one place in the code. Also we are more flexible about what
characters may surround the EI operator that marks the end of an
inline image.
Lexer enhancements: EOF, comment, space Significant enhancements to the lexer to improve EOF handling and to support comments and spaces as tokens. Various other minor issues were fixed as well.
2018-01-28 23:28:45 +00:00
Refactor parseContentStream
2018-01-31 02:25:51 +00:00
* New method QPDFObjectHandle::parsePageContents() to improve upon
QPDFObjectHandle::parseContentStream(). The parseContentStream
method used to operate on a single content stream, but was fixed
to properly handle pages with contents split across multiple
streams in an earlier release. The new method parsePageContents()
can be called on the page object rather than the value of the
page dictionary's /Contents key. This removes a few lines of
boiler-plate code from any code that uses parseContentStream, and
it also enables creation of more helpful error messages if
problems are encountered as the error messages can include
information about which page the streams come from.
Switch from parseContentStream to parsePageContents
2018-01-31 02:39:38 +00:00
* Update content stream parsing example
(examples/pdf-parse-content.cc) to use new
QPDFObjectHandle::parsePageContents() method in favor of the older
QPDFObjectHandle::parseContentStream() method.
Bug fix: content normalizer should not add trailing newline Adding a trailing newline in content normalization damages files whose contents are split across streams in the middle of tokens. Let QPDFWriter add the newline with the indicator to ignore the newline, which it already does. This changes the way some qdf files look.
2018-01-31 16:59:02 +00:00
* Bug fix: change where the trailing newline is added to a stream
in QDF mode when content normalization is enabled (the default for
QDF mode). Before, the content normalizer ensured that the output
ended with a trailing newline, but this had the undesired side
effect of including the newline in the stream data for purposes of
length computation. QPDFWriter already appends a newline without
counting in length for better readability. Ordinarily this makes
no difference, but in the rare case of a page's contents being
split in the middle of a token, the old behavior could cause the
extra newline to be interprted as part of the token. This bug
could only be triggered in qdf mode, which is a mode intended for
manual inspection of PDF files' contents, so it is very unlikely
to have caused any actual problems for people using qpdf for
production use. Even if it did, it would be very unusual for a PDF
file to actually be adversely affected by this issue.
Add coalesce contents capability
2018-01-31 14:47:58 +00:00
* Add support for coalescing a page's contents into a single
stream if they are represented as an array of streams. This can be
performed from the command line using the --coalesce-contents
option. Coalescing content streams can simplify things for
software that wants to operate on a page's content streams without
having to handle weird edge cases like content streams split in
the middle of tokens. Note that
QPDFObjectHandle::parsePageContents and
QPDFObjectHandle::parseContentStream already handled split content
streams. This is mainly to set the stage for new methods of
operating on page contents. The new method
QPDFObjectHandle::pipeContentStreams will pipe all of a page's
content streams though a single pipeline. The new method
QPDFObjectHandle.coalesceContentStreams, when called on a page
object, will do nothing if the page's contents are a single
stream, but if they are an array of streams, it will replace the
page's contents with a single stream whose contents are the
concatenation of the original streams.
* A few library routines throw exceptions if called on non-page
objects. These constraints have been relaxed somewhat to make qpdf
more tolerant of files whose page dictionaries are not properly
marked as such. Mostly exceptions about page operations being
called on non page objects will only be thrown in cases where the
operation had no chance of succeeding anyway. This change has no
impact on any default mode operations, but it could allow
applications that use page-level APIs in QPDFObjectHandle to be
more tolerant of certain types of damaged files.
Implement TokenFilter and refactor Pl_QPDFTokenizer Implement a TokenFilter class and refactor Pl_QPDFTokenizer to use a TokenFilter class called ContentNormalizer. Pl_QPDFTokenizer is now a general filter that passes data through a TokenFilter.
2018-02-02 23:21:34 +00:00
* Add QPDFObjectHandle::TokenFilter class and methods to use it to
perform lexical filtering on content streams. You can call
QPDFObjectHandle::addTokenFilter on stream object, or you can call
the higher level QPDFObjectHandle::addContentTokenFilter on a page
object to cause the stream's contents to passed through a token
filter while being retrieved by QPDFWriter or any other consumer.
For details on using TokenFilter, please see comments in
QPDFObjectHandle.hh.
* Enhance the string, type QPDFTokenizer::Token constructor to
initialize a raw value in addition to a value. Tokens have a
value, which is a canonical representation, and a raw value. For
all tokens except strings and names, the raw value and the value
are the same. For strings, the value excludes the outer delimiters
and has non-printing characters normalized. For names, the value
resolves non-printing characters. In order to better facilitate
token filters that mostly preserve contents and to enable
developers to be mostly unconcerned about the nuances of token
values and raw values, creating string and name tokens now
properly handles this subtlety of values and raw values. When
constructing string tokens, take care to avoid passing in the
outer delimiters. This has always been the case, but it is now
clarified in comments in QPDFObjectHandle.hh::TokenFilter. This
has no impact on any existing code unless there's some code
somewhere that was relying on Token::getRawValue() returning an
empty string for a manually constructed token. The token class's
operator== method still only looks at type and value, not raw
value. For example, string tokens for <41> and (A) would still be
equal because both are representations of the string "A".
* Add QPDFObjectHandle::isDataModified method. This method just
returns true if addTokenFilter has been called on the stream. It
enables a caller to determine whether it is safe to optimize away
piping of stream data in cases where the input and output are
expected to be the same. QPDFWriter uses this internally to skip
the optimization of not re-compressing already compressed streams
if addTokenFilter has been called. Most developers will not have
to worry about this as it is used internally in the library in the
places that need it. If you are manually retrieving stream data
with QPDFObjectHandle::getStreamData or
QPDFObjectHandle::pipeStreamData, you don't need to worry about
this at all.
Filter tokens example
2018-02-03 19:52:40 +00:00
* Provide heavily annoated examples/pdf-filter-tokens.cc example
that illustrates use of some simple token filters.
Detect and report bad tokens in content normalization
2018-02-03 02:16:40 +00:00
* When normalizing content streams, as in qdf mode, issue warning
about bad tokens. Content streams are only normalized when this is
explicitly requested, so this has no impact on normal operation.
However, in qdf mode, if qpdf detects a bad token, it means that
either there's a bug in qpdf's lexer, that the file is damaged, or
that the page's contents are split in a weird way. In any of those
cases, qpdf could potentially damage the stream's contents by
replacing carrige returns with newlines or otherwise messing with
spaces. The mostly likely case of this would be an inline image's
compressed data being divided across two streams and having the
compressed data in the second stream contain a carriage return as
part of its binary data. If you are using qdf mode just to look at
PDF files in text editors, this usually doesn't matter. In cases
of contents split across multiple streams, coalescing streams
would eliminate the problem, so the warning mentions this. Prior
to this enhancement, the chances of qdf mode writing incorrect
data were already very low. This change should make it nearly
impossible for qdf mode to unknowingly write invalid data.
Add option to save pass 1 of lineariziation This is useful only for debugging the linearization code.
2018-01-31 21:45:52 +00:00
2018-02-04 Jay Berkenbilt <ejb@ql.org>
* Add QPDFWriter::setLinearizationPass1Filename method and
--linearize-pass1 command line option to allow specification of a
file into which QPDFWriter will write its intermediate
linearization pass 1 file. This is useful only for debugging qpdf.
qpdf creates linearized files by computing the output in two
passes. Ordinarily the first pass is discarded and not written
anywhere. This option allows it to be inspected.
Prepare 7.1.1 release
2018-02-04 23:31:42 +00:00
2018-02-04 Jay Berkenbilt <ejb@ql.org>
* 7.1.1: release
* Bug fix: properly linearize files whose /ID has a length of
other than 16 bytes.
* Rename some test files to avoid files with three dots in their
names. Fixes #173.
* Fix various build and compilation issues on some platforms and
compilers. Fixes #176, #172, #177
* Fix a few typos and clarify a few comments in header files.
Allow raw encryption key to be specified Add options to enable the raw encryption key to be directly shown or specified. Thanks to Didier Stevens <didier.stevens@gmail.com> for the idea and contribution of one implementation of this idea.
2018-01-14 15:17:17 +00:00
2018-01-14 Jay Berkenbilt <ejb@ql.org>
Update version numbers for 7.1.0
2018-01-14 19:10:04 +00:00
* 7.1.0: release
Allow raw encryption key to be specified Add options to enable the raw encryption key to be directly shown or specified. Thanks to Didier Stevens <didier.stevens@gmail.com> for the idea and contribution of one implementation of this idea.
2018-01-14 15:17:17 +00:00
* Allow raw encryption key to be specified in libary and command
line with the QPDF::setPasswordIsHexKey method and
--password-is-hex-key option. Allow encryption key to be displayed
with --show-encryption-key option. Thanks to Didier Stevens
<didier.stevens@gmail.com> for the idea and contribution of one
implementation of this idea. See his blog post at
https://blog.didierstevens.com/2017/12/28/cracking-encrypted-pdfs-part-3/
for a discussion of using this for cracking encrypted PDFs. I hope
that a future release of qpdf will include some additional
recovery options that may also make use of this capability.
Support TIFF Predictor (fixes #171)
2018-01-13 19:24:09 +00:00
2018-01-13 Jay Berkenbilt <ejb@ql.org>
Allow trailing . in numeric token (fixes #165)
2018-01-14 01:05:13 +00:00
* Fix lexical error: the PDF specification allows floating point
numbers to end with ".". Fixes #165.
Use correct link directory order (fixes #158) Make sure to link from the source tree before linking from the system. In many environments, this is necessary to allow a newly built qpdf to link properly instead of trying to link or resolve libraries from an older installed version.
2018-01-14 00:51:31 +00:00
* Fix link order in the build to avoid conflicts when building
Allow trailing . in numeric token (fixes #165)
2018-01-14 01:05:13 +00:00
from source while an older version of qpdf is installed. Fixes #158.
Use correct link directory order (fixes #158) Make sure to link from the source tree before linking from the system. In many environments, this is necessary to allow a newly built qpdf to link properly instead of trying to link or resolve libraries from an older installed version.
2018-01-14 00:51:31 +00:00
Support TIFF Predictor (fixes #171)
2018-01-13 19:24:09 +00:00
* Add support for TIFF predictor for LZW and Flate streams. Now
Allow trailing . in numeric token (fixes #165)
2018-01-14 01:05:13 +00:00
all predictor functions are supported. Fixes #171.
Support TIFF Predictor (fixes #171)
2018-01-13 19:24:09 +00:00
Update TODO and ChangeLog. Fixes #166, #83
2017-12-25 23:28:17 +00:00
2017-12-25 Jay Berkenbilt <ejb@ql.org>
Clarify documentation of advanced parsing options
2017-12-25 23:42:33 +00:00
* Clarify documentation around options that control parsing but
not output creation. Two options: --suppress-recovery and
--ignore-xref-streams, were documented in the "Advanced
Transformation Options" section of the manual and --help output
even though they are not related to output. These are now
described in a separate section called "Advanced Parsing Options."
Update TODO and ChangeLog. Fixes #166, #83
2017-12-25 23:28:17 +00:00
* Implement remaining PNG filters for decode. Prior versions could
decode only the "up" filter. Now all PNG filters (sub, up,
average, Paeth, optimal) are supported for decoding. Thanks to
Tobias Hoffmann for providing a test PDF file that has images with
all PNG filters along with different numbers of bits per sample
and samples per pixel, and thanks to Casey Rojas for providing
implementations of the remaining PNG filters.
The implementation of the remaining PNG filters changed the
interface to the private Pl_PNGFilter class, but this class's
header file is not in the installation, and there is no public
interface to the class. Within the library, the class is never
allocated on the stack; it is only ever dynamically allocated. As
such, this does not actually break binary compatibility of the
library.
Prepare 7.0.0 release
2017-09-16 01:23:02 +00:00
2017-09-15 Jay Berkenbilt <ejb@ql.org>
* 7.0.0: release
Update C API with new QPDFWriter methods
2017-09-12 00:11:10 +00:00
2017-09-12 Jay Berkenbilt <ejb@ql.org>
Additionally license under Apache License version 2.0 The Apache License version 2.0 is now the primary license for qpdf. However, users may, at their option, continue to use Artistic version 2.0.
2017-09-14 16:44:31 +00:00
* Relicense qpdf under version 2.0 of the Apache License rather
than version 2.0 of the Artistic License. Both are fine, but the
Apache License is in more widespread use, and I like it a little
better than Artistic-2.0. It is my intention that there be no
change in what you can or can't do with qpdf. Versions of qpdf
prior to version 7 were released under the terms of version 2.0 of
the Artistic License. At your option, you may continue to consider
qpdf to be licensed under those terms. Please see the manual for
additional information.
Improve message for stream decoding error Tweak the message so that we inform the user that we are mitigating data loss.
2017-09-12 19:48:08 +00:00
* Improve the error message that is issued when QPDFWriter
encounters a stream that can't be decoded. In particular, mention
that the stream will be copied without filtering to avoid data
loss.
Update C API with new QPDFWriter methods
2017-09-12 00:11:10 +00:00
* Add new methods to the C API to correspond to new additions to
QPDFWriter:
- qpdf_set_compress_streams
- qpdf_set_decode_level
- qpdf_set_preserve_unreferenced_objects
- qpdf_set_newline_before_endstream
Detect xref pointer infinite loop (fixes #149)
2017-08-25 23:58:31 +00:00
2017-08-25 Jay Berkenbilt <ejb@ql.org>
Parse iteratively to avoid stack overflow (fixes #146)
2017-08-26 01:52:29 +00:00
* Re-implement parser iteratively to avoid stack overflow on very
deeply nested arrays and dictionaries. Fixes #146.
Detect xref pointer infinite loop (fixes #149)
2017-08-25 23:58:31 +00:00
* Detect infinite loop while finding additional xref tables. Fixes
#149.
Update references to README files Most of the README files have been renamed. Refer to the new names.
2017-08-22 17:10:47 +00:00
2017-08-22 Jay Berkenbilt <ejb@ql.org>
Bump soname to 18 and version to 7.0.b1
2017-08-22 18:11:06 +00:00
* 7.0.b1: release
Update references to README files Most of the README files have been renamed. Refer to the new names.
2017-08-22 17:10:47 +00:00
* Convert all README files to markdown. Names changed as follows:
- README --> README.md
- README.hardening --> README-hardening.md
- README.maintainer --> README-maintainer.md
- README-what-to-download.txt --> README-what-to-download.md
- README-windows.txt --> README-windows.md
The file README-windows-install.txt remains a text file.
Update header documentation and ChangeLog entry for PCLm
2017-08-21 22:53:14 +00:00
2017-08-21 Jay Berkenbilt <ejb@ql.org>
* Add support for writing PCLm files. Most of the work was done by
Sahil Arora <sahilarora.535@gmail.com> as part of a Google Summer
of Code project in 2017. PCLm support is useful only for clients
that specifically know how to create PCLm files. Support in qpdf
is just for ensuring that objects are written in the correct order
and for including some additional material in the output that is
required by the PCLm standard.
Enable finer grained control of stream decoding This commit adds several API methods that enable control over which types of filters QPDF will attempt to decode. It also adds support for /RunLengthDecode and /DCTDecode filters for both encoding and decoding.
2017-08-19 13:18:14 +00:00
2017-08-19 Jay Berkenbilt <ejb@ql.org>
* Remove --precheck-streams. This is enabled by default now
without any efficiency cost. This feature was never released.
* Update pdf-create example to illustrate use of additional image
compression filters.
* Add support for /RunLengthDecode and /DCTDecode:
- New pipeline types Pl_RunLength and Pl_DCT
- New command-line flags --compress-streams and --decode-level
to replace/enhance --stream-data
- New QPDFWriter::setCompressStreams and
QPDFWriter::setDecodeLevel methods
Please see documentation, header files, and help messages for
details on these new features.
Change --single-pages to --split-pages This is in preparation for implementing page groups.
2017-08-12 15:49:04 +00:00
2017-08-12 Jay Berkenbilt <ejb@ql.org>
Add page rotation (fixes #132)
2017-08-12 17:22:46 +00:00
* Add QPDFObjectHandle::rotatePage to apply rotation to a page
object. Add --rotate option to qpdf to specify page rotation from
the command line.
Add --verbose flag
2017-08-12 16:30:18 +00:00
* Provide --verbose option that causes qpdf to print an indication
of what files it is writing.
Change --single-pages to --split-pages This is in preparation for implementing page groups.
2017-08-12 15:49:04 +00:00
* Change --single-pages to --split-pages and make it take an
optional argument specifying the number of pages per file.
Pad encryption parameters that are too short (fixes #96)
2017-08-11 23:53:56 +00:00
2017-08-11 Jay Berkenbilt <ejb@ql.org>
Fix --newline-before-endstream option (fixes #133) Add a newline unconditionally before endstream even if a newline was already written as part of the stream data.
2017-08-12 00:57:05 +00:00
* Fix --newline-before-endstream to always add a newline before
endstream even if the last character was already a newline. This
is actually what's required by PDF/A. Fixes #133.
Pad encryption parameters that are too short (fixes #96)
2017-08-11 23:53:56 +00:00
* Handle encrypted files whose encryption parameters are too
short. Fixes #96.
Remove unused PointerHolder interface Also fix a bug resulting from incorrect use of PointerHolder because of this unused parameter.
2017-08-10 22:17:24 +00:00
2017-08-10 Jay Berkenbilt <ejb@ql.org>
Remove PCRE
2017-08-11 00:24:16 +00:00
* Remove dependency on libpcre.
Read xref table without PCRE Also accept more errors than before.
2017-08-10 23:37:05 +00:00
* Be more forgiving of certain types of errors in the xref table
that don't interfere with interpreting the table.
Remove unused PointerHolder interface Also fix a bug resulting from incorrect use of PointerHolder because of this unused parameter.
2017-08-10 22:17:24 +00:00
* Remove unused "tracing" parameter from PointerHolder's
(T*, bool) constructor. This change breaks source code
compatibility, but since this argument to PointerHolder has not
used for a long time and the presence of a boolean parameter in
the primary constructor makes it too easy to use that by mistake
when trying to use PointerHolder for arrays, it seems like it's
finally time to take it out. If you have a compile error because
of this change, please check to see whether you intended to use
the (bool, T*) version of the constructor instead. If not, just
remove the second parameter.
Improve stream length recovery Eliminate PCRE and find endobj not preceded by endstream. Be more lax about placement of endstream and endobj.
2017-08-10 01:14:48 +00:00
2017-08-09 Jay Berkenbilt <ejb@ql.org>
* When recovering stream length, find endobj without endstream as
well as just looking for endstream. Be a little more lax about
where we allow it to be found.
Move page spec processing earlier
2017-08-05 12:29:26 +00:00
2017-08-05 Jay Berkenbilt <ejb@ql.org>
Add --split-pages option (fixes #30)
2017-08-05 14:01:34 +00:00
* Add --single-pages option to cause output to be written to a
separate file for each page rather than one big file.
Move page spec processing earlier
2017-08-05 12:29:26 +00:00
* Process --pages options earlier so that certain inspection
options, like --show-pages, can show the state after the merging
operations.
Fix off-by-one error in --pages argument parsing (fixes #129)
2017-08-03 01:06:41 +00:00
2017-08-02 Jay Berkenbilt <ejb@ql.org>
* Fix off-by-one error in parsing pages options. Fixes #129.
Better handle split content streams (fixes #73) When parsing content streams, allow content to be split arbitrarily across stream boundaries.
2017-07-29 14:40:31 +00:00
2017-07-29 Jay Berkenbilt <ejb@ql.org>
Allow reading command-line args from files (fixes #16)
2017-07-30 02:23:21 +00:00
* Support @filename and @- in the qpdf command-line tool to read
command-line arguments, one per line, from the named file. @-
reads from standard input. Fixes #16.
Detect input file = output file (fixes #29)
2017-07-30 00:19:54 +00:00
* Detect when input file and output file are the same and exit to
avoid overwriting and losing input file. Fixes #29.
Allow --check to coexist with and precede other operations (fixes #42)
2017-07-29 23:56:21 +00:00
* When passing multiple inspection arguments, run --check first,
and defer exit until after all the checks have been run. This
makes it possible to force operations such as --show-xref to be
delayed until after recovery attempts have been made. For example,
if you have a file with a syntactically valid xref table that has
some offsets that are incorrect, running qpdf --check --show-xref
on that file will first recover the xref and the dump the
recovered xref, while just running qpdf --show-xref will show the
xref table as present in the file. Fixes #42.
When recover stream length, indicate the length (fixes #44)
2017-07-29 23:15:06 +00:00
* When recovering stream length, indicate the recovered length.
Fixes #44.
Add newline-before-endstream option (fixes #103)
2017-07-29 16:18:03 +00:00
* Add --newline-before-endstream command-line option and
setNewlineBeforeEndstream method to QPDFWriter. This forces qpdf
to always add a newline before the endstream keyword. It is a
necessary but not sufficient condition for PDF/A compliance. Fixes
#103.
Handle zlib data errors better (fixes #106)
2017-07-29 16:07:19 +00:00
* Handle zlib data errors when decoding streams. Fixes #106.
Better recovery of bad stream start (fixes #104)
2017-07-29 15:59:15 +00:00
* Improve handling of files where the "stream" keyword is not
followed by proper line terminators. Fixes #104.
Better handle split content streams (fixes #73) When parsing content streams, allow content to be split arbitrarily across stream boundaries.
2017-07-29 14:40:31 +00:00
* Fix content stream parsing to handle cases of structures within
the stream split across stream boundaries. Fixes #73.
Add option to preserve unreferenced objects
2017-07-28 23:18:57 +00:00
2017-07-28 Jay Berkenbilt <ejb@ql.org>
* Add --preserve-unreferenced command-line option and
setPreserveUnreferencedObjects method to QPDFWriter. This option
causes QPDFWriter to write all objects from the input file to the
output file regardless of whether the objects are referenced.
Objects are written to the output file in numerical order from the
input file. This option has no effect for linearized files.
Convert object parsing errors to warnings QPDFObjectHandle::parseInternal now issues warnings instead of throwing exceptions for all error conditions that it finds (except internal logic errors) and has stronger recovery for things like invalid tokens and malformed dictionaries. This should improve qpdf's ability to recover from a wide range of broken files that currently cause it to fail.
2017-07-26 18:38:49 +00:00
2017-07-27 Jay Berkenbilt <ejb@ql.org>
Add precheck streams capability When requested, QPDFWriter will do more aggress prechecking of streams to make sure it can actually succeed in decoding them before attempting to do so. This will allow preservation of raw data even when the raw data is corrupted relative to the specified filters.
2017-07-28 03:42:27 +00:00
* Add --precheck-streams command-line option and setStreamPrecheck
Add option to preserve unreferenced objects
2017-07-28 23:18:57 +00:00
method to QPDFWriter to tell QPDFWriter to attempt decoding a
Add precheck streams capability When requested, QPDFWriter will do more aggress prechecking of streams to make sure it can actually succeed in decoding them before attempting to do so. This will allow preservation of raw data even when the raw data is corrupted relative to the specified filters.
2017-07-28 03:42:27 +00:00
stream fully before deciding whether to filter it or not.
Convert stream filtering errors to warnings
2017-07-27 22:18:18 +00:00
* Recover gracefully from streams that aren't filterable because
the filter parameters are invalid in the stream dictionary or the
dictionary itself is invalid.
Convert object parsing errors to warnings QPDFObjectHandle::parseInternal now issues warnings instead of throwing exceptions for all error conditions that it finds (except internal logic errors) and has stronger recovery for things like invalid tokens and malformed dictionaries. This should improve qpdf's ability to recover from a wide range of broken files that currently cause it to fail.
2017-07-26 18:38:49 +00:00
* Significantly improve recoverability from invalid qpdf objects.
Most conditions in basic object parsing that used to cause qpdf to
exit are now warnings. There are still many more opportunities for
improvements of this sort beyond just object parsing.
Fix infinite loop while reporting an error (fixes #101) This is CVE-2017-9210. The description string for an error message included unparsing an object, which is too complex of a thing to try to do while throwing an exception. There was only one example of this in the entire codebase, so it is not a pervasive problem. Fixing this eliminated one class of infinite loop errors.
2017-07-25 14:13:30 +00:00
2017-07-26 Jay Berkenbilt <ejb@ql.org>
Include tests for other infinite loop bugs fixes #117 fixes #118 fixes #119 fixes #120 Several other infinite loop bugs were fixed by previous changes. Include their test files in the test suite.
2017-07-26 10:19:19 +00:00
* Fixes to infinite loops below also fix problems reported in
other issues and cover CVE-2017-11624, CVE-2017-11625,
CVE-2017-11626, and CVE-2017-11627.
Don't interpret word tokens in content streams (fixes #82)
2017-07-26 09:35:34 +00:00
* Don't attempt to interpret syntactic keywords (like R and
endobj) found while parsing content streams.
Detect recursion loops resolving objects (fixes #51) During parsing of an object, sometimes parts of the object have to be resolved. An example is stream lengths. If such an object directly or indirectly points to the object being parsed, it can cause an infinite loop. Guard against all cases of re-entrant resolution of objects.
2017-07-26 09:03:38 +00:00
* Detect infinite loops while resolving objects. This could happen
if something inside an object that had to be resolved during
parsing, such as a stream length, recursively referenced the
object being resolved.
Handle object ID 0 (fixes #99) This is CVE-2017-9208. The QPDF library uses object ID 0 internally as a sentinel to represent a direct object, but prior to this fix, was not blocking handling of 0 0 obj or 0 0 R as a special case. Creating an object in the file with 0 0 obj could cause various infinite loops. The PDF spec doesn't allow for object 0. Having qpdf handle object 0 might be a better fix, but changing all the places in the code that assumes objid == 0 means direct would be risky.
2017-07-26 08:30:32 +00:00
* CVE-2017-9208: Handle references to and appearance of object 0
as a special case. Object 0 is not allowed, and qpdf was using it
internally to represent direct objects.
Avoid xref reconstruction infinite loop (fixes #100) This is CVE-2017-9209.
2017-07-25 14:21:27 +00:00
* CVE-2017-9209: Fix infinite loop caused by attempting to
reconstruct the xref table while already in the process of
reconstructing the xref table.
Fix infinite loop while reporting an error (fixes #101) This is CVE-2017-9210. The description string for an error message included unparsing an object, which is too complex of a thing to try to do while throwing an exception. There was only one example of this in the entire codebase, so it is not a pervasive problem. Fixing this eliminated one class of infinite loop errors.
2017-07-25 14:13:30 +00:00
* CVE-2017-9210: Fix infinite loop caused by attempting to unparse
an object for inclusion in the text of an exception.
Prepare 6.0.0 release
2015-11-10 17:48:52 +00:00
2015-11-10 Jay Berkenbilt <ejb@ql.org>
* 6.0.0: release
* No changes from 5.2.0. The 5.2.0 release broke binary
compatibility and was withdrawn.
Tolerate some mangled xref tables If xref table entries lack the spec-required trailing whitespace or contain a small amount of extra space, handle them anyway.
2015-10-31 21:03:55 +00:00
2015-10-31 Jay Berkenbilt <ejb@ql.org>
Prepare 5.2.0 release
2015-10-31 22:56:26 +00:00
* 5.2.0: release
Tolerate some mangled xref tables If xref table entries lack the spec-required trailing whitespace or contain a small amount of extra space, handle them anyway.
2015-10-31 21:03:55 +00:00
* libqpdf/QPDF.cc (read_xrefTable): Be tolerant of some malformed
xref tables that don't have the required trailing space after each
line.
Implement deterministic ID For non-encrypted files, determinstic ID generation uses file contents instead of timestamp and file name. At a small runtime cost, this enables generation of the same /ID if the same inputs are converted in the same way multiple times.
2015-10-25 15:09:25 +00:00
2015-10-29 Jay Berkenbilt <ejb@ql.org>
* Implement QPDFWriter::setDeterministicID and --deterministic-id
commandline-flag to qpdf to request generation of a deterministic
/ID for non-encrypted files.
include time.h in QUtil.hh QUtil.hh needs time.h to get time_t on some platforms. Thanks Peter Korsgaard <peter@korsgaard.com>
2015-05-24 19:34:56 +00:00
2015-05-24 Jay Berkenbilt <ejb@ql.org>
Prepare 5.1.3 release
2015-05-24 21:26:37 +00:00
* 5.1.3: release
fix-qdf: handle object streams with > 255 objects fix-qdf was previously hard-coding the number of bytes for the f2 field of the xref stream entry. This addresses issue #37. Thanks aluebcke for reporting.
2015-05-24 20:20:22 +00:00
* Bug fix: fix-qdf was not handling object streams with more than
255 objects in them.
Handle Microsoft crypt provider without prior keys As reported in issue #40, a call to CryptAcquireContext in SecureRandomDataProvider fails in a fresh windows install prior to any user keys being created in AppData\Roaming\Microsoft\Crypto\RSA. Thanks michalrames.
2015-05-24 19:41:28 +00:00
* Handle Microsoft crypt provider initialization properly for case
where no keys have been previously created, such as in a fresh
Windows installation.
include time.h in QUtil.hh QUtil.hh needs time.h to get time_t on some platforms. Thanks Peter Korsgaard <peter@korsgaard.com>
2015-05-24 19:34:56 +00:00
* Include time.h in QUtil.hh for time_t
Avoid resolving arguments to R When checking two objects preceding R while parsing, ensure that the objects are direct. This avoids stuff like 1 0 obj containing 1 0 R 0 R from causing an infinite loop in object resolution.
2015-02-21 22:40:41 +00:00
2015-02-21 Jay Berkenbilt <ejb@ql.org>
Detect loops in /Pages structure Pushing inherited objects to pages and getting all pages were both prone to stack overflow infinite loops if there were loops in the Pages dictionary. There is a general weakness in the code in that any part of the code that traverses the Pages structure would be prone to this and would have to implement its own loop detection. A more robust fix may provide some general method for handling the Pages structure, but it's probably not worth doing. Note: addition of *Internal2 private functions was done rather than changing signatures of existing methods to avoid breaking compatibility.
2015-02-21 23:22:32 +00:00
* Detect loops in Pages structure. Thanks to Gynvael Coldwind and
Mateusz Jurczyk of the Google Security Team for providing a sample
file with this problem.
Avoid buffer overrun copying digest Converting a password to an encryption key is supposed to copy up to a certain number of bytes from a digest. Make sure never to copy more than the size of the digest.
2015-02-21 22:30:45 +00:00
* Prevent buffer overrun when converting a password to an
encryption key. Thanks to Gynvael Coldwind and Mateusz Jurczyk of
the Google Security Team for providing a sample file with this
problem.
Avoid resolving arguments to R When checking two objects preceding R while parsing, ensure that the objects are direct. This avoids stuff like 1 0 obj containing 1 0 R 0 R from causing an infinite loop in object resolution.
2015-02-21 22:40:41 +00:00
* Ensure that arguments to "R" when parsing the file are direct
objects before trying to resolve them. This prevents specially
crafted files from causing qpdf to crash with a stack overflow.
Thanks to Gynvael Coldwind and Mateusz Jurczyk of the Google
Security Team for providing a sample file with this problem.
Handle page tree node with no /Type Original reported here: https://bugs.launchpad.net/ubuntu/+source/qpdf/+bug/1397413 The PDF specification says that the /Type key for nodes in the pages dictionary (both /Page and /Pages) is required, but some PDF files omit them. Use the presence of other keys to determine the type of pages tree node this is if the type key is not found.
2014-12-01 19:44:47 +00:00
2014-12-01 Jay Berkenbilt <ejb@ql.org>
* Some broken PDF files lack the required /Type key for /Page and
/Pages nodes in the page dictionary. QPDF now uses other methods
to figure out what kind of node it is looking at so that it can
handle those files. Original reported at
https://bugs.launchpad.net/ubuntu/+source/qpdf/+bug/1397413
Handle pages with no /Contents from getPageContents() The spec allows /Contents to be omitted for pages that are blank, but QPDFObjectHandle::getPageContents() was throwing an exception in this case.
2014-11-14 18:43:34 +00:00
2014-11-14 Jay Berkenbilt <ejb@ql.org>
* Bug fix: QPDFObjectHandle::getPageContents() no longer throws an
exception when called on a page that has no /Contents key in its
dictionary. This is allowed by the spec, and some software
packages generate files like this for pages that are blank in the
original.
Handle indirect stream filter/decode parameters QPDFWriter was trying to make /Filter and /DecodeParms direct in all cases, but there are some cases where /DecodeParms may refer to a stream, which can't be direct. QPDFWriter doesn't actually need /DecodeParms to be direct in that case because it won't be able to filter the stream. Until we can handle this type of stream, just don't make /Filter and /DecodeParms direct if we can't filter the stream anyway. Fixes #34
2014-06-07 16:31:22 +00:00
2014-06-07 Jay Berkenbilt <ejb@ql.org>
Prepare 5.1.2 release
2014-06-07 20:37:13 +00:00
* 5.1.2: release
Windows build (msvc): target Windows 5.0.1 (XP) Without this, qpdf executables work only on Vista or newer. Fixes #35
2014-06-07 21:01:14 +00:00
* MS Visual C++ build: explicitly target Windows 5.0.1 (XP)
Example: fast split into single pages This is faster than using qpdf --pages to do it.
2014-06-07 17:04:30 +00:00
* New example program: pdf-split-pages: efficiently split PDF
files into individual pages.
Handle indirect stream filter/decode parameters QPDFWriter was trying to make /Filter and /DecodeParms direct in all cases, but there are some cases where /DecodeParms may refer to a stream, which can't be direct. QPDFWriter doesn't actually need /DecodeParms to be direct in that case because it won't be able to filter the stream. Until we can handle this type of stream, just don't make /Filter and /DecodeParms direct if we can't filter the stream anyway. Fixes #34
2014-06-07 16:31:22 +00:00
* Bug fix: don't fail on files that contain streams where /Filter
or /DecodeParms references a stream. Before, qpdf would try to
convert these to direct objects, which would fail because of the
stream.
Fix calculation of xref stream stream columns Fix problem: if the last object in the first part of a linearized file had an offset that was below 65536 by less than the size of the hint stream, the xref stream was invalid and the resulting file is not usable.
2014-02-23 03:12:34 +00:00
2014-02-22 Jay Berkenbilt <ejb@ql.org>
* Bug fix: if the last object in the first part of a linearized
file had an offset that was below 65536 by less than the size of
the hint stream, the xref stream was invalid and the resulting file
is not usable. This is now fixed.
Prepare 5.1.1 release
2014-01-14 20:45:35 +00:00
2014-01-14 Jay Berkenbilt <ejb@ql.org>
* 5.1.1: release
Avoid traversing same object twice when copying objects This is a performance fix. The output is unchanged. Fixes #28.
2013-12-26 16:51:50 +00:00
2013-12-26 Jay Berkenbilt <ejb@ql.org>
* Bug fix: when copying foreign objects (which occurs during page
splitting among other cases), avoid traversing the same object
more than once if it appears more than once in the same direct
object. This bug is performance-only and does not affect the
actual output.
Prepare 5.1.0 release
2013-12-17 20:26:07 +00:00
2013-12-17 Jay Berkenbilt <ejb@ql.org>
* 5.1.0: release
Increase random data provider support Add a method to get the current random data provider, and document and test the method for resetting it.
2013-12-16 21:03:54 +00:00
2013-12-16 Jay Berkenbilt <ejb@ql.org>
* Document and make explicit that passing null to
QUtil::setRandomDataProvider() resets the random data provider.
* Provide QUtil::getRandomDataProvider().
Allow arbitrary whitespace, not just newline, after xref Fixes #27.
2013-12-14 20:08:54 +00:00
2013-12-14 Jay Berkenbilt <ejb@ql.org>
* Allow anyspace rather than just newline to follow xref header.
This allows qpdf to read a wider range of damaged files.
Refactor random data generation Add new RandomDataProvider object and implement existing random number generation in terms of that. This enables end users to supply their own random data providers.
2013-11-30 17:02:56 +00:00
2013-11-30 Jay Berkenbilt <ejb@ql.org>
* Allow user-supplied random data provider to be used in place of
OS-provided or insecure random number generation. See
documentation for 5.1.0 for details.
Allow OS-provided secure random to be disabled
2013-11-30 17:25:01 +00:00
* Add configure option --enable-os-secure-random (enabled by
default). Pass --disable-os-secure-random or define
SKIP_OS_SECURE_RANDOM to avoid attempts to use the operating
system-provided secure random number generation. This can be
especially useful on Windows if you wish to avoid any dependency
on Microsoft's cryptography system.
Include <algorithm> for std::min, std::max
2013-11-29 15:20:50 +00:00
2013-11-29 Jay Berkenbilt <ejb@ql.org>
Allow -DNO_GET_ENVIRONMENT to avoid GetEnvironmentVariable If NO_GET_ENVIRONMENT is #defined at compile time on Windows, do not call GetEnvironmentVariable. QUtil::get_env will always return false. This option is not available through configure. This was added to support a specific user's requirements to avoid calling GetEnvironmentVariable from the Windows API. Nothing in qpdf outside the test coverage system in qtest relies on QUtil::get_env.
2013-11-30 03:08:25 +00:00
* If NO_GET_ENVIRONMENT is #defined, for Windows only,
QUtil::get_env will always return false. This was added to
support a user who needs to avoid calling GetEnvironmentVariable
from the Windows API. QUtil::get_env is not used for any
functionality in qpdf and exists only to support the test suite
including test coverage support with QTC (part of qtest).
Add /FS flag (msvc) for parallel builds
2013-11-30 03:08:01 +00:00
* Add /FS to msvc builds to allow parallel builds to work with
Visual C++ 2013.
Include <algorithm> for std::min, std::max
2013-11-29 15:20:50 +00:00
* Add missing #include <algorithm> in some files that use std::min
and std::max.
Use 8 bit per sample images in tests In compare image tests, use the gs device tiff24nc instead of tiff12nc since the 4 bit per sample images created by tiff12nc could sometimes trigger a bug in tiffcmp. Fixes #20.
2013-11-21 18:41:37 +00:00
2013-11-21 Jay Berkenbilt <ejb@ql.org>
* Change image comparison tests, which are disabled by default, to
use tiff files with 8 bits per sample rather than 4. This works
around a bug in tiffcmp but also increases time and disk space for
image comparison tests.
Add a ChangeLog note for previous fix
2013-11-21 18:30:58 +00:00
2013-10-28 Jay Berkenbilt <ejb@ql.org>
Add more detail to previous ChangeLog entry
2013-11-29 15:34:24 +00:00
* Fix MacOS compilation errors by adding a missing #include
<string> in a header file.
Add a ChangeLog note for previous fix
2013-11-21 18:30:58 +00:00
Warn when -accessibility=n will be ignored Also accept -accessibility=n with 256 bit keys even though it will be ignored.
2013-10-18 13:18:45 +00:00
2013-10-18 Jay Berkenbilt <ejb@ql.org>
Prepare for 5.0.1 release
2013-10-18 13:53:07 +00:00
* 5.0.1: release
Warn when -accessibility=n will be ignored Also accept -accessibility=n with 256 bit keys even though it will be ignored.
2013-10-18 13:18:45 +00:00
* Warn when -accessibility=n is specified with a modern encryption
format (R > 3). Also, accept this flag (and ignore with warning)
with 256-bit encryption. qpdf has always ignored the
accessibility setting with R > 3, but it previously did so
silently.
Security: keep cur_byte pointing into bytes array
2013-10-05 09:48:56 +00:00
2013-10-05 Jay Berkenbilt <ejb@ql.org>
Security: replace operator[] with at For std::string and std::vector, replace operator[] with at. This was done using an automated process. See README.hardening for details.
2013-10-05 23:42:39 +00:00
* Replace operator[] in std::string and std::vector with "at" in
order to get bounds checking. This reduces the chances that
incorrect code will result in data exposure or buffer overruns.
See README.hardening for additional notes.
Security: use a secure random number generator If not available, give an error. The user may also configure qpdf to use an insecure random number generator.
2013-10-05 21:36:33 +00:00
* Use cryptographically secure random number generation when
available. See additional notes in README.
Replace some assertions with std::logic_error Ideally, the library should never call assert outside of test code, but it does in several places. For some cases where the assertion might conceivably fail because of a problem with the input data, replace assertions with exceptions so that they can be trapped by the calling application. This commit surely misses some cases and replaced some cases unnecessarily, but it should still be an improvement.
2013-10-05 20:37:27 +00:00
* Replace some assert() calls with std::logic_error exceptions.
Ideally there shouldn't be assert() calls outside of testing.
This change may make a few more potential code errors in handling
invalid data recoverable.
Security: avoid pre-allocating vectors based on file data In places where std::vector<T>(size_t) was used, either validate that the size parameter is sane or refactor code to avoid the need to pre-allocate the vector.
2013-10-05 15:30:27 +00:00
* Security fix: In places where std::vector<T>(size_t) was used,
either validate that the size parameter is sane or refactor code
to avoid the need to pre-allocate the vector. This reduces the
likelihood of allocating a lot of memory in response to invalid
data in linearization hint streams.
Security: sanitize /W in xref stream The /W array was not sanitized, possibly causing an integer overflow in a multiplication. An analysis of the code suggests that there were no possible exploits based on this since the problems were in checking expected values but bounds checks were performed on actual values.
2013-10-05 16:28:52 +00:00
* Security fix: sanitize /W array in cross reference stream to
avoid a potential integer overflow in a multiplication. It is
unlikely that any exploits were possible from this bug as
additional checks were also performed.
Security: better bounds checks for linearization data The faulty code was only used during explicit checks of linearization data. Those checks are not part of normal reading or writing of PDF files.
2013-10-05 10:26:06 +00:00
* Security fix: avoid buffer overrun that could be caused by bogus
data in linearization hint streams. The incorrect code could only
be triggered when checking linearization data, which must be
invoked explicitly. qpdf does not check linearization data when
reading or writing linearized files, but the qpdf --check command
does check linearization data.
Security: handle empty name in normalizeName
2013-10-05 09:52:42 +00:00
* Security fix: properly handle empty strings in
QPDF_Name::normalizeName. The empty string is not a valid name
and would never be parsed as a name, so there were no known
conditions where this method could be called with an empty string.
Security: fix potential multiplication overflow Better sanity check inputs to bit stream reader
2013-10-05 09:51:54 +00:00
* Security fix: perform additional argument sanity checks when
reading bit streams.
Security: keep cur_byte pointing into bytes array
2013-10-05 09:48:56 +00:00
* Security fix: in QUtil::toUTF8, change bounds checking to avoid
having a pointer point temporarily outside the bounds of an
array. Some compiler optimizations could have made the original
code unsafe.
Change API/ABI and withdraw 4.2.0 4.2.0 was binary incompatible in spite of there being no deletions or changes to any public methods. As such, we have to bump the ABI and are fixing some API breakage while we're at it. Previous 4.3.0 target is now 5.1.0.
2013-07-10 15:07:40 +00:00
2013-07-10 Jay Berkenbilt <ejb@ql.org>
Prepare 5.0.0 release
2013-07-10 15:33:18 +00:00
* 5.0.0: release
Change API/ABI and withdraw 4.2.0 4.2.0 was binary incompatible in spite of there being no deletions or changes to any public methods. As such, we have to bump the ABI and are fixing some API breakage while we're at it. Previous 4.3.0 target is now 5.1.0.
2013-07-10 15:07:40 +00:00
* 4.2.0 turned out to be binary incompatible on some platforms
even though there were no changes to the public API. Therefore
the 4.2.0 release has been withdrawn, and is being replaced with a
5.0.0 release that acknowledges the ABI change and also removes
some problematic methods from the public API.
* Remove methods from public API that were only intended to be
used by QPDFWriter and really didn't make sense to call from
anywhere else as they required internal knowledge that only
QPDFWriter had:
- QPDF::getLinearizedParts
- QPDF::generateHintStream
- QPDF::getObjectStreamData
- QPDF::getCompressibleObjGens
- QPDF::getCompressibleObjects
Allow numeric range to be omitted qpdf --pages Detect a missing page range and assume 1-z.
2013-07-07 20:29:28 +00:00
2013-07-07 Jay Berkenbilt <ejb@ql.org>
Change API/ABI and withdraw 4.2.0 4.2.0 was binary incompatible in spite of there being no deletions or changes to any public methods. As such, we have to bump the ABI and are fixing some API breakage while we're at it. Previous 4.3.0 target is now 5.1.0.
2013-07-10 15:07:40 +00:00
* 4.2.0: release [withdrawn]
Prepare 4.2.0 release
2013-07-07 22:57:56 +00:00
Ignore broken DecodeParms for stream with no filters
2013-07-07 21:26:03 +00:00
* Ignore error case of a stream's decode parameters having invalid
length when there are no stream filters.
Add --show-npages option to qpdf
2013-07-07 21:04:41 +00:00
* qpdf: add --show-npages command-line option, which causes the
number of pages in the input file to be printed on a line by
itself.
Allow numeric range to be omitted qpdf --pages Detect a missing page range and assume 1-z.
2013-07-07 20:29:28 +00:00
* qpdf: allow omission of range in --pages. If range is omitted
such that an argument that is supposed to be a range is an invalid
range and a valid file name, the range of 1-z is assumed. This
makes it possible to merge a bunch of files with something like
qpdf --empty out.pdf --pages *.pdf --
Handle more broken files Space rather than newline after xref, missing /ID in trailer for encrypted file. This enables qpdf to handle some files that xpdf can handle. Adobe reader can't necessarily handle them.
2013-06-15 16:38:25 +00:00
2013-06-15 Jay Berkenbilt <ejb@ql.org>
* Handle some additional broken files with missing /ID in trailer
for encrypted files and with space rather than newline after xref.
Promote QPDF::ObjGen to top-level object QPDFObjGen
2013-06-14 15:22:04 +00:00
2013-06-14 Jay Berkenbilt <ejb@ql.org>
Handle /Outlines dictionary being a direct object Even though this case is not valid according to the spec, it has been seen, and caused an internal error.
2013-06-15 01:35:10 +00:00
* Detect and correct /Outlines dictionary being a direct object
when linearizing files. This is not allowed by the spec but has
been seen in the wild. Prior to this change, such a file would
cause an internal error in the linearization code, which assumed
/Outlines was indirect.
Add optional /Length key in crypt filter dictionary
2013-06-15 00:40:20 +00:00
* Add /Length key to crypt filter dictionary for encrypted files.
This key is optional, but some version of MacOS reportedly fail to
open encrypted PDF files without this key.
Bug fix: handle generation > 0 when generating object streams Rework QPDFWriter to always track old object IDs and QPDFObjGen instead of int, thus not discarding the generation number. Switch to QPDF::getCompressibleObjGen() to properly handle the case of an old object eligible for compression that has a generation of other than zero.
2013-06-14 18:53:47 +00:00
* Bug fix: properly handle object stream generation when the
original file has some compressible objects with generation != 0.
* Add QPDF::getCompressibleObjGens() and deprecate
QPDF::getCompressibleObjects(), which had a flaw in its logic.
Add QPDFObjectHandle::getObjGen() This is safer than getObjectID() and getGeneration() for many uses.
2013-06-14 15:27:15 +00:00
* Add new QPDFObjectHandle::getObjGen() method and indiciate in
comments that its use is favored over getObjectID() and
getGeneration() for most cases.
Promote QPDF::ObjGen to top-level object QPDFObjGen
2013-06-14 15:22:04 +00:00
* Add new QPDFObjGen object to represent an object ID/generation
pair.
Final preparation for 4.1.0 release
2013-04-14 18:39:59 +00:00
2013-04-14 Jay Berkenbilt <ejb@ql.org>
* 4.1.0: release
Document casting policy
2013-03-25 18:37:25 +00:00
2013-03-25 Jay Berkenbilt <ejb@ql.org>
* manual/qpdf-manual.xml: Document the casting policy that is
followed in qpdf's implementation.
Windows install: check DLL type When copying dlls, make sure to only consider DLLs whose type matches the type of what is loading them.
2013-03-11 16:34:31 +00:00
2013-03-11 Jay Berkenbilt <ejb@ql.org>
* When creating Windows binary distributions, make sure to only
copy DLLs of the correct type. The ensures that the 32-bit
distributions contain 32-bit DLLs and the 64-bit distributions
contain 64-bit DLLs.
Use ./install-sh instead of install -c
2013-03-07 16:28:06 +00:00
2013-03-07 Jay Berkenbilt <ejb@ql.org>
* Use ./install-sh (already present) instead of "install -c" to
install executables to fix portability problems against different
UNIX variants.
Add method to terminate content stream parsing
2013-03-03 20:48:31 +00:00
2013-03-03 Jay Berkenbilt <ejb@ql.org>
* Add protected terminateParsing method to
QPDFObjectHandle::ParserCallbacks that implementor can call to
terminate parsing of a content stream.
Remove all calls to sprintf
2013-02-28 21:20:45 +00:00
2013-02-28 Jay Berkenbilt <ejb@ql.org>
Favor strerror_s and fopen_s on MSVC Make remaining calls to fopen and strerror use strerror_s and fopen_s on MSVC.
2013-02-28 22:10:30 +00:00
* Favor fopen_s and strerror_s on MSVC to avoid CRT security
warnings. This is useful for people who may want to use qpdf in
an application that is Windows 8 certified.
Call QUtil::safe_fopen in place of fopen fopen was previuosly called wrapped by QUtil::fopen_wrapper, but QUtil::safe_fopen does this itself, which is less cumbersome.
2013-02-28 21:45:11 +00:00
* New method QUtil::safe_fopen to wrap calls to fopen. This is
less cumbersome than calling QUtil::fopen_wrapper.
Remove all calls to sprintf
2013-02-28 21:20:45 +00:00
* Remove all calls to sprintf
* New method QUtil::int_to_string_base to convert to octal or
hexademical (or decimal) strings without using sprintf
Rewrite QUtil::int_to_string and QUtil::double_to_string Make them safer by avoiding any internal limits and replacing sprintf with std::ostringstream.
2013-02-26 17:31:00 +00:00
2013-02-26 Jay Berkenbilt <ejb@ql.org>
* Rewrite QUtil::int_to_string and QUtil::double_to_string to
remove internal length limits but to remain backward compatible
with the old versions for valid inputs.
Bug fix: properly handle overridden compressed objects When caching objects in an object stream, only cache objects that still resolve to that stream. See Changelog mod from this commit for details.
2013-02-23 22:41:27 +00:00
2013-02-23 Jay Berkenbilt <ejb@ql.org>
* Bug fix: properly handle overridden compressed objects. When
caching objects from an object stream, only cache objects that,
based on the xref table, would actually be resolved into this
stream. Prior to this fix, if an object stream A contained an
object B that was overridden by an appended section of the file,
qpdf would cache the old value of B if any non-overridden member
of A was accessed before B. This commit fixes that bug.
Do not remove libqpdf.la Some distributions (like debian) don't want .la files to be installed, but the responsibility for doing this should like in the packaging, not in qpdf itself.
2013-01-31 21:16:45 +00:00
2013-01-31 Jay Berkenbilt <ejb@ql.org>
* Do not remove libtool's .la file during the make install step.
Note to packagers: if your distribution wants to you remove the
.la file, you will have to do that yourself now.
Improve qpdf --check Fix exit status for case of errors without warnings, continue after errors when possible, add test case for parsing a file with content stream errors on some but not all pages.
2013-01-25 16:08:50 +00:00
2013-01-25 Jay Berkenbilt <ejb@ql.org>
Replace many calls to sprintf with QUtil::hex_encode Add QUtil::hex_encode to encode binary data has a hexadecimal string, and use it in place of sprintf where possible.
2013-01-25 13:59:55 +00:00
* New method QUtil::hex_encode to encode binary data as a
hexadecimal string
Improve qpdf --check Fix exit status for case of errors without warnings, continue after errors when possible, add test case for parsing a file with content stream errors on some but not all pages.
2013-01-25 16:08:50 +00:00
* qpdf --check was exiting with status 0 in some rare cases even
when errors were found. It now always exits with one of the
document error codes (0 for success, 2 for errors, 3 or warnings).
Have qpdf --check parse content streams Also move writing to null and parsing of content streams out of the wrong if block.
2013-01-24 15:47:29 +00:00
2013-01-24 Jay Berkenbilt <ejb@ql.org>
Handle warning flags better Make --enable-werror work properly on msvc, handle extra warnings flags for msvc in configure.ac instead of hardcoding into make/msvc.mk, separate warnings flags into WFLAGS in autoconf.mk to avoid duplication and to make it easier to override.
2013-01-24 16:18:28 +00:00
* Make --enable-werror work for MSVC, and generally handle warning
options better for that compiler. Warning flags for that compiler
were previous hard-coded into the build with /WX enabled
unconditionally.
* Split warning flags into WFLAGS in autoconf.mk to make them
easier to override. Before they were repeated in CFLAGS and
CXXFLAGS and were commingled with other compiler flags.
Have qpdf --check parse content streams Also move writing to null and parsing of content streams out of the wrong if block.
2013-01-24 15:47:29 +00:00
* qpdf --check now does syntactic checks all pages' content
streams as well as checking overall document structure. Semantic
errors are still not checked, and there are no plans to add
semantic checks.
Add getTypeCode() and getTypeName() Add virtual methods to QPDFObject, wrappers to QPDFObjectHandle, and implementations to all the QPDF_Object types.
2013-01-22 14:57:07 +00:00
2013-01-22 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::getTypeCode(). This method returns a
unique integer (enumerated type) value corresponding to the object
type of the QPDFObjectHandle. It can be used as an alternative to
the QPDFObjectHandle::is* methods for type testing, particularly
where there is a desire to use a switch statement or optimize for
performance when testing object types.
* Add QPDFObjectHandle::getTypeName(). This method returns a
string literal describing the object type. It is useful for
testing and debugging.
Added new QPDFObjectHandle types Keyword and InlineImage These object types are to facilitate content stream parsing.
2013-01-20 19:55:01 +00:00
2013-01-20 Jay Berkenbilt <ejb@ql.org>
Add getTypeCode() and getTypeName() Add virtual methods to QPDFObject, wrappers to QPDFObjectHandle, and implementations to all the QPDF_Object types.
2013-01-22 14:57:07 +00:00
* Add QPDFObjectHandle::parseContentStream, which parses the
Add QPDFObjectHandle::parseContentStream method This method allows parsing of the PDF objects in a content stream or array of content streams.
2013-01-20 20:26:45 +00:00
objects in a content stream and calls handlers in a callback
class. The example pdf-parse-content illustrates it use.
Cosmetic changes to be closer to Adobe terminology Change object type Keyword to Operator, and place the order of the object types in object_type_e in the same order as they are mentioned in the PDF specification. Note that this change only breaks backward compatibility with code that has not yet been released.
2013-01-23 14:38:05 +00:00
* Add QPDF_Operator and QPDF_InlineImage types along with
Added new QPDFObjectHandle types Keyword and InlineImage These object types are to facilitate content stream parsing.
2013-01-20 19:55:01 +00:00
appropriate wrapper methods in QPDFObjectHandle. These new object
types are to facilitate content stream parsing.
Prepare 4.0.1 release
2013-01-17 14:51:04 +00:00
2013-01-17 Jay Berkenbilt <ejb@ql.org>
* 4.0.1: release
* Add clarifying comment in QPDF.hh for methods that return the
user password to state that it is no longer possible with newer
encryption formats to recover the user password knowing the owner
password.
* Fix detection of binary attachments in the test suite. This
resolves false test failures on some platforms. No changes to the
actual QPDF code were made.
Update "C" API with functions for new features
2012-12-31 11:47:11 +00:00
2012-12-31 Jay Berkenbilt <ejb@ql.org>
Update versions for 4.0.0 release
2012-12-31 15:48:54 +00:00
* 4.0.0: release
Update "C" API with functions for new features
2012-12-31 11:47:11 +00:00
* Add new methods qpdf_get_pdf_extension_level,
qpdf_set_r5_encryption_parameters,
qpdf_set_r6_encryption_parameters,
qpdf_set_minimum_pdf_version_and_extension, and
qpdf_force_pdf_version_and_extension to support new functionality
from the C API.
Update ChangeLog with recent changes
2012-12-31 01:59:38 +00:00
2012-12-30 Jay Berkenbilt <ejb@ql.org>
* Fix long-standing bug that could theoretically have resulted in
possible misinterpretation of decode parameters in streams. As
far as I can tell, it is extremely unlikely that files with the
characteristics that would have triggered the bug actually exist
in cases that qpdf versions prior to 4.0.0 could have read.
Unencrypted files with encrypted attachments would have triggered
this bug, but qpdf versions prior to 4.0.0 already refused to open
such files.
* Fix long-standing bug in which a stream that used a crypt
filter and was otherwise not filterable by qpdf would be decrypted
properly but would retain the crypt filter indication in the
file. There are no known ways to create files like this, so it is
unlikely that anyone ever hit this bug.
2012-12-29 Jay Berkenbilt <ejb@ql.org>
* Add read/write support for both the deprecated Acrobat IX
encryption format and the Acrobat X/PDF 2.0 encryption format
using 256-bit AES keys. Using the Acrobat IX format (R=5) forces
the version of the file to 1.7 with extension level 3. Using the
PDF 2.0 format (R=6) forces it to 1.7 extension level 8.
* Add new method QPDF::getEncryptionKey to return the actual
encryption key used for encryption of data in the file. The key
is returned as a std::string.
* Non-compatible API change: change signature of
QPDF::compute_data_key to take the R and V values from the
encryption dictionary. There is no reason for any application
code to call this method since handling of encryption is done
automatically by the qpdf libary. It is used internally by
QPDFWriter.
* Support reading and decryption of files whose main text is not
encrypted but whose attachments are. More generally, support the
case of files and streams encrypted differently with some
limitations, described in the documentation. This was not
previously supported due to lack of test files, but I created test
files using a trial version of Acrobat XI to fully implement this
case.
* Incorporate sha2 code from sphlib 3.0. See README for
licensing. Create private pipeline class for computing hashes
with sha256, sha384, and sha512.
* Allow specification of initialization vector when using AES
filtering. This is required to compute the hash used in /R=6 (PDF
2.0) encryption.
2012-12-28 Jay Berkenbilt <ejb@ql.org>
* Add random number generation functions to QUtil.
* Fix old bug that could cause an infinite loop if user password
recovery methods were called and a password contained the "("
character (which happens to be the first byte of padding used by
older PDF encryption formats). This bug was noticed while reading
code and would not happen under ordinary usage patterns even if
the password contained that character.
Eliminate flattenScalarReferences
2012-12-27 16:39:01 +00:00
2012-12-27 Jay Berkenbilt <ejb@ql.org>
Update ChangeLog with recent changes
2012-12-31 01:59:38 +00:00
* Add awareness of extension level to PDF Version methods for both
reading and writing. This includes adding method
QPDF::getExtensionLevel and new versions of
QPDFWriter::setMinimumPDFVersion and QPDFWriter::forcePDFVersion
that support extension levels. The qpdf command-line tool
interprets version numbers of the form x.y.z as version x.y at
extension level z.
* Update AES classes to support use of 256-bit keys.
* Non-compatible API change: Removed public method
QPDF::flattenScalarReferences. Instead, just flatten the scalar
references we actually need to flatten. Flattening scalar
references was a wrong decision years ago and has occasionally
caused other problems, among which were that it caused qpdf to
visit otherwise unreferenced and possibly erroneous objects in the
file when it didn't have to. There's no reason that any
non-internal code would have had to call this.
* Non-compatible API change: Removed public method
QPDF::decodeStreams which was previously used by qpdf --check but
is no longer used. The decodeStreams method could generate false
positives since it would attempt to access all objects in the file
including those that were not referenced. There's no reason that
any non-internal code would have had to call this.
* Non-compatible API change: Removed public method
QPDF::trimTrailerForWrite, which was only intended for use by
QPDFWriter and which is no longer used.
2012-12-26 Jay Berkenbilt <ejb@ql.org>
* Add new fields to QPDF::EncryptionData to support newer
encryption formats (V=5, R=5 and R=6)
* Non-compatible API change: Change public nested class
QPDF::EncryptionData to make all member fields private and to add
method calls. This is a non-compatible API change, but changing
EncryptionData is necessary to support newer encryption formats,
and making this change will prevent the need from making a
non-compatible change in the future if new fields are added. A
public nested class should never have had public members to begin
with.
Eliminate flattenScalarReferences
2012-12-27 16:39:01 +00:00
Find PDF header anywhere in the first 1024 bytes
2012-12-25 19:38:18 +00:00
2012-12-25 Jay Berkenbilt <ejb@ql.org>
* Allow PDF header to appear anywhere in the first 1024 bytes of
the file as recommended in the implementation notes of the Adobe
version of the PDF spec.
Ignore objects with offset 0
2012-11-20 18:15:14 +00:00
2012-11-20 Jay Berkenbilt <ejb@ql.org>
Add Requires.private to libqpdf.pc for static linking
2012-11-20 18:36:02 +00:00
* Add zlib and libpcre to Requires.private in the pkg-config file
to support static linking. Thanks Tobias Hoffmann for pointing
out the omission.
Ignore objects with offset 0
2012-11-20 18:15:14 +00:00
* Ignore (with warning) non-freed objects in the xref table whose
offset is 0. Some PDF producers (incorrectly) do this. See
https://bugs.linuxfoundation.org/show_bug.cgi?id=1081.
Allow reading from InputSource and writing to Pipeline Allowing users to subclass InputSource and Pipeline to read and write from/to arbitrary sources provides the maximum flexibility for users who want to read and write from other than files or memory.
2012-09-23 21:42:26 +00:00
2012-09-23 Jay Berkenbilt <ejb@ql.org>
* Add public methods QPDF::processInputSource and
QPDFWriter::setOutputPipeline to allow users to read from custom
input sources and to write to custom pipelines. This allows the
maximum flexibility in sources for reading and writing PDF files.
Fix segmentation fault with use of QPDFWriter::setOutputMemory
2012-09-06 18:39:06 +00:00
2012-09-06 Jay Berkenbilt <ejb@ql.org>
Prepare 3.0.2 release
2012-09-06 19:47:58 +00:00
* 3.0.2: release
Add QPDFWriter::setExtraHeaderText
2012-09-06 19:30:13 +00:00
* Add new method QPDFWriter::setExtraHeaderText to add extra text,
such as application-specific comments, to near the beginning of a
PDF file. For linearized files, this appears after the
linearization parameter dictionary. For non-linearized files, it
appears right after the PDF header and non-ASCII comment.
Reset state in QPDF::calculateLinearizationData This makes it possible to use two different writers to write linearized files from the same QPDF object.
2012-09-06 19:28:16 +00:00
* Make it possible to write the same QPDF object with two
different QPDFWriter objects that have both called
setLinearization(true) by making private method
QPDF::calculateLinearizationData() properly initialize its state.
Fix segmentation fault with use of QPDFWriter::setOutputMemory
2012-09-06 18:39:06 +00:00
* Bug fix: Writing after calling QPDFWriter::setOutputMemory()
would cause a segmentation fault because of an internal field not
being initialized, rendering that method useless. This has been
corrected.
Bug fix: let EOF resolve literal token Previously only whitespace and comments did it. This fix is needed for object streams whose last object is a literal (name, integer, real, string) not terminated by space or newline.
2012-08-11 13:27:30 +00:00
2012-08-11 Jay Berkenbilt <ejb@ql.org>
Prepare 3.0.1 release
2012-08-11 17:39:19 +00:00
* 3.0.1: release
Bug fix: let EOF resolve literal token Previously only whitespace and comments did it. This fix is needed for object streams whose last object is a literal (name, integer, real, string) not terminated by space or newline.
2012-08-11 13:27:30 +00:00
* Bug fix: let EOF terminate a literal token as well as
whitespace or comments.
Update version to 3.0.0
2012-08-02 10:52:33 +00:00
2012-07-31 Jay Berkenbilt <ejb@ql.org>
* 3.0.0: release
Make release entry in ChangeLog
2012-07-29 18:34:10 +00:00
2012-07-29 Jay Berkenbilt <ejb@ql.org>
* 3.0.rc1: release
Restore coverage case Previous commit lost coverage case for buffer-based replaceStreamData.
2012-07-26 02:32:14 +00:00
2012-07-25 Jay Berkenbilt <ejb@ql.org>
* From Tobias: add QPDFObjectHandle::replaceStreamData that takes
a std::string analogous to the QPDFObjectHandle::newStream that
takes a string that was added earlier.
Implement QPDFObjectHandle::parse Move object parsing code from QPDF to QPDFObjectHandle and parameterize the parts of it that are specific to a QPDF object. Provide a version that can't handle indirect objects and that can be called on an arbitrary string. A side effect of this change is that the offset used when reporting invalid stream length has changed, but since the new value seems like a better value than the old one, the test suite has been updated rather than making the code backward compatible. This only effects the offset reported for invalid streams that lack /Length or have an invalid /Length key. Updated some test code and exmaples to use QPDFObjectHandle::parse. Supporting changes include adding a BufferInputSource constructor that takes a string.
2012-07-21 13:00:06 +00:00
2012-07-21 Jay Berkenbilt <ejb@ql.org>
Image comparison tests are off by default
2012-07-22 00:35:00 +00:00
* Change configure to have image comparison tests disabled by
default. Update README and README.maintainer with information
about running them.
Command-line page merging and splitting Implement --pages ... -- option for qpdf. Update TODO with remaining things to document.
2012-07-22 00:24:02 +00:00
* Add --pages command-line option to qpdf to enable page-based
merging and splitting.
Implement QPDFObjectHandle::parse Move object parsing code from QPDF to QPDFObjectHandle and parameterize the parts of it that are specific to a QPDF object. Provide a version that can't handle indirect objects and that can be called on an arbitrary string. A side effect of this change is that the offset used when reporting invalid stream length has changed, but since the new value seems like a better value than the old one, the test suite has been updated rather than making the code backward compatible. This only effects the offset reported for invalid streams that lack /Length or have an invalid /Length key. Updated some test code and exmaples to use QPDFObjectHandle::parse. Supporting changes include adding a BufferInputSource constructor that takes a string.
2012-07-21 13:00:06 +00:00
* Add new method QPDFObjectHandle::replaceDict to replace a
stream's dictionary. Use with caution; see comments in
QPDFObjectHandle.hh.
* Add new method QPDFObjectHandle::parse for creation of
QPDFObjectHandle objects from string representations of the
objects. Thanks to Tobias Hoffmann for the idea.
Bug fix: preserve AES when copying encryption parameters
2012-07-15 23:07:59 +00:00
2012-07-15 Jay Berkenbilt <ejb@ql.org>
Add command line option to copy encryption from other file Add --copy-encryption and --encryption-file-password options to qpdf. Also strengthen test suite for copying encryption. The strengthened test suite would have caught the failure to preserve AES and the failure to update the file version, which was invalidating the encrypted data.
2012-07-16 01:15:24 +00:00
* add new QPDF::isEncrypted method that returns some additional
information beyond other versions.
* libqpdf/QPDFWriter.cc: fix copyEncryptionParameters to fix the
minimum PDF version based on other file's encryption needs. This
is a fix to code added on 2012-07-14 and did not impact previously
released code.
Bug fix: preserve AES when copying encryption parameters
2012-07-15 23:07:59 +00:00
* libqpdf/QPDFWriter.cc (copyEncryptionParameters): Bug fix: qpdf
was not preserving whether or not AES encryption was being used
Add command line option to copy encryption from other file Add --copy-encryption and --encryption-file-password options to qpdf. Also strengthen test suite for copying encryption. The strengthened test suite would have caught the failure to preserve AES and the failure to update the file version, which was invalidating the encrypted data.
2012-07-16 01:15:24 +00:00
when copying encryption parameters. The file would still have
been properly encrypted, but a file that started off encrypted
with AES could have become encrypted with RC4.
Bug fix: preserve AES when copying encryption parameters
2012-07-15 23:07:59 +00:00
Have QPDFWriter detect foreign objects while writing Throw an exception that directs the user to QPDF::copyForeignObject.
2012-07-14 12:07:23 +00:00
2012-07-14 Jay Berkenbilt <ejb@ql.org>
Add public QPDFWriter::copyEncryptionParameters Method to copy encryption parameters from another file. Adapted from existing code to copy encryption parameters from the original file.
2012-07-14 13:13:49 +00:00
* QPDFWriter: add public copyEncryptionParameters to allow copying
encryption parameters from another file.
Have QPDFWriter detect foreign objects while writing Throw an exception that directs the user to QPDF::copyForeignObject.
2012-07-14 12:07:23 +00:00
* QPDFWriter: detect if the user has inserted an indirect object
from another QPDF object and throw an exception directing the user
to copyForeignObject.
Support copying objects from another QPDF object This includes QPDF::copyForeignObject and supporting foreign objects as arguments to addPage*.
2012-07-11 19:29:41 +00:00
2012-07-11 Jay Berkenbilt <ejb@ql.org>
* Added new APIs to copy objects from one QPDF to another. This
includes letting QPDF::addPage() (and QPDF::addPageAt()) accept a
page object from another QPDF and adding
QPDF::copyForeignObject(). See QPDF.hh for details.
* Add method QPDFObjectHandle::getOwningQPDF() to return the QPDF
object associated with an indirect QPDFObjectHandle.
* Add convenience methods to QPDFObjectHandle: assertIndirect(),
isPageObject(), isPagesObject()
* Cache when QPDF::pushInheritedAttributesToPage() has been called
to avoid traversing the pages trees multiple times. This state is
cleared by QPDF::updateAllPagesCache() and ignored by
QPDF::flattenPagesTree().
Add concept of reserved objects QPDFObjectHandle::{new,is,assert}Reserved, QPDF::replaceReserved provide a mechanism to add objects to a PDF file when there are circular references. This is a prerequisite to copying objects from one PDF to another.
2012-07-08 18:19:19 +00:00
2012-07-08 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::newReserved to create a reserved object
and QPDF::replaceReserved to replace it with a real object.
QPDFObjectHandle::newReserved reserves an object ID in a QPDF
object and ensures that any references to it remain unresolved.
When QPDF::replaceReserved is later called, previous references to
the reserved object will properly resolve to the replaced object.
Don't require stream data provider to know length in advance Breaking API change: length parameter has disappeared from the StreamDataProvider version of QPDFObjectHandle::replaceStreamData since it is no longer necessary to compute it in advance. This breaking change is justified by the fact that removing the length parameter provides the caller an opportunity to simplify the calling code.
2012-07-07 21:33:45 +00:00
2012-07-07 Jay Berkenbilt <ejb@ql.org>
* NOTE: BREAKING API CHANGE. Remove previously required length
parameter from the version QPDFObjectHandle::replaceStreamData
that uses a stream data provider. Prior to qpdf 3.0.0, you had to
compute the stream length in advance so that qpdf could internally
verify that the stream data had the same length every time the
provider was invoked. Now this requirement is enforced a
different way, and the length parameter is no longer required.
Note that I take API-breaking changes very seriously and only did
it in this case since the lack of need to know length in advance
could significantly simplify people's code. If you were
previously going to a lot of trouble to compute the length of the
new stream data in advance, you now no longer have to do that.
You can just drop the length parameter and remove any code that
was previously computing the length. Thanks to Tobias Hoffmann
for pointing out how annoying the original interface was.
Add QPDFWriter method to output to FILE*
2012-07-06 01:22:27 +00:00
2012-07-05 Jay Berkenbilt <ejb@ql.org>
* Add QPDFWriter methods to write to an already open stdio FILE*.
Implementation and idea area based on contributions from Tobias
Hoffmann.
Added test code for Tobias's changes
2012-07-05 03:19:32 +00:00
2012-07-04 Jay Berkenbilt <ejb@ql.org>
* Accept changes from Tobias Hoffmann: add public method
QPDF::pushInheritedAttributesToPage including warnings for
non-inherited keys that may be discarded from /Pages by
non-conformant PDF files when the /Pages tree is flattened.
Update ChangeLog and TODO
2012-06-27 14:18:29 +00:00
2012-06-27 Jay Berkenbilt <ejb@ql.org>
* Add Pl_Concatenate pipeline for stream concatenation also
implemented by Tobias Hoffmann. Also added test code
(libtests/concatenate.cc).
* Add new methods implemented by Tobias Hoffmann:
QPDFObjectHandle::newReal(double) and
QPDFObjectHandle::newStream(QPDF*, std::string const&).
2012-06-26 Jay Berkenbilt <ejb@ql.org>
* Minor changes so that support for PDF files larger than 4GB
works well with 32-bit and 64-bit Linux and also with 32-bit and
64-bit Windows with both MSVC and mingw.
* Rework internal methods for doing recovery of the cross
reference tables for much greater efficiency both in terms of time
and memory usage.
Update ChangeLog for previous fixes
2012-06-24 19:32:48 +00:00
2012-06-24 Jay Berkenbilt <ejb@ql.org>
* Support PDF files larger than 4 GB. This involved many changes
to the ABI to increase the size of integer types used in various
places as well as increasing the amount of padding used when
creating linearized files. Automated tests for large files are
disabled by default. Run ./configure --help for information on
enabling them. Running the tests requires 11 GB of free disk
space and takes several minutes.
Add factory methods for creating empty arrays and dictionaries. Also updated pdf_from_scratch test driver to use the new factories, and made some cosmetic improvements and documentation updates for the emptyPDF() method.
2012-06-22 13:46:33 +00:00
2012-06-22 Jay Berkenbilt <ejb@ql.org>
Add pdf-from-scratch example
2012-06-23 02:07:58 +00:00
* examples/pdf-create.cc: Provide an example of creating a PDF
from scratch. This simple PDF has a single page with some text
and an image.
Add factory methods for creating empty arrays and dictionaries. Also updated pdf_from_scratch test driver to use the new factories, and made some cosmetic improvements and documentation updates for the emptyPDF() method.
2012-06-22 13:46:33 +00:00
* Add empty QPDFObjectHandle factories for array and dictionary.
With PDF-from-scratch capability, it is useful to be able to
create empty arrays and dictionaries and add keys to them.
Updated pdf_from_scratch.cc to use these interfaces.
Add QPDF::processFile that takes an open FILE*
2012-06-21 11:59:56 +00:00
2012-06-21 Jay Berkenbilt <ejb@ql.org>
Add QPDF::emptyPDF() and pdf_from_scratch test code
2012-06-22 03:06:48 +00:00
* Add QPDF::emptyPDF() to create an empty QPDF object suitable for
adding pages and other objects to. pdf_from_scratch.cc is test
code that exercises it.
Fix order of build flags. Place user-specified CPPFLAGS and LDFLAGS later so that user-specified non-standard paths that have old versions of qpdf don't cause the build to fail.
2012-06-22 01:20:35 +00:00
* make/libtool.mk: Place user-specified CPPFLAGS and LDFLAGS later
in the compilation so that if a user installs things in a
non-standard place that they have to tell the build about, earlier
versions of qpdf installed there won't break the build. Thanks to
Macports for reporting this. (Fixes bug 3468860.)
Use qpdf_offset_t in place of off_t in public APIs. off_t is used internally only when needed to talk to standard libraries. This requires that the "long long" type be supported by the compiler.
2012-06-21 23:32:21 +00:00
* Instead of using off_t in the public APIs, use qpdf_offset_t
instead. This is defined as long long in qpdf/Types.h. If your
system doesn't support long long, you can redefine it.
ChangeLog entry for pkg-config files
2012-06-21 20:40:31 +00:00
* Add pkg-config files
Add QPDFObjectHandle::shallowCopy()
2012-06-21 20:14:34 +00:00
* QPDFObjectHandle: add shallowCopy() method
ChangeLog entries for page API
2012-06-21 19:28:58 +00:00
* QPDF: add new APIs for adding and removing pages. This includes
addPage(), addPageAt(), and removePage(). Also a method
updateAllPagesCache() is now available to force update of the
internal pages cache if you should modify the pages structure
manually.
* QPDF: new processFile method that takes an open FILE*
Add QPDF::processFile that takes an open FILE*
2012-06-21 11:59:56 +00:00
instead of a filename.
add ChangeLog entries for previous work
2012-06-21 11:58:44 +00:00
2012-06-20 Jay Berkenbilt <ejb@ql.org>
* Add new array mutation routines to QPDFObjectHandle.
Fix spelling of Tobias's last name. Sorry about that!
2012-06-21 14:55:02 +00:00
Implemented by Tobias Hoffmann.
add ChangeLog entries for previous work
2012-06-21 11:58:44 +00:00
* Rework APIs that use size_t, off_t, and primative integer types
so that size_t is used for sizes of memory and off_t is used for
file offsets. Also set _FILE_OFFSET_BITS so that large files can
be supported on 32-bit UNIX/Linux platforms. The code assumes in
places that sizeof(off_t) >= sizeof(size_t). This resulted in
non-compatible ABI changes and hopefully clears the way for QPDF
to work with files that are larger than 4 GiB in size.
* Add support for versioned symbols on ELF platforms.
* Various fixes for gcc 4.7
2011-04-06 Jay Berkenbilt <ejb@ql.org>
* Fix PCRE to stop using deprecated (and now dropped) interfaces.
Don't declare any PCRE objects static.
2011-12-28 19:30:16 +00:00
2011-12-28 Jay Berkenbilt <ejb@ql.org>
Update for 2.3.1
2011-12-28 22:19:40 +00:00
* 2.3.1: release
fix MSVC 2010 issues
2011-12-28 21:40:33 +00:00
* include <stdint.h> if available to support MSVC 2010
Don't declare any PCRE objects static.
2011-12-28 19:30:16 +00:00
* Since PCRE is not necessarily thread safe, don't declare any
PCRE objects to be static.
* Disregard stderr output from ghostscript when using it to
compare images in the test suite; see comments in qpdf.test for
details.
* Fixed a few documentation errors.
qpdf_set_info_key, qpdf_get_info_key
2011-08-11 14:48:37 +00:00
2011-08-11 Jay Berkenbilt <ejb@ql.org>
ready for 2.3.0 release
2011-08-11 19:34:41 +00:00
* 2.3.0: release
* include/qpdf/qpdf-c.h ("C"): add new methods
qpdf_init_write_memory, qpdf_get_buffer_length, and
qpdf_get_buffer to support writing to memory from the C API.
qpdf_set_info_key, qpdf_get_info_key
2011-08-11 14:48:37 +00:00
* include/qpdf/qpdf-c.h ("C"): add new methods qpdf_get_info_key
and qpdf_set_info_key for manipulating text fields of the /Info
dictionary.
implement ability to save PDF to memory, also update ChangeLog
2011-08-10 20:34:29 +00:00
2011-08-10 Jay Berkenbilt <ejb@ql.org>
preserve /EncryptMetadata when copying encryption parameters
2011-08-10 23:47:18 +00:00
* libqpdf/QPDFWriter.cc (copyEncryptionParameters): preserve
whether metadata is encryption. This fixes part of bug 3173659:
the password becomes invalid if qpdf copies an encrypted file with
cleartext-metadata.
implement ability to save PDF to memory, also update ChangeLog
2011-08-10 20:34:29 +00:00
* include/qpdf/QPDFWriter.hh: add a new constructor that takes
only a QPDF reference and leaves specification of output for
later. Add methods setOutputFilename() to set the output to a
filename or stdout, and setOutputMemory() to indicate that output
should go to a memory buffer. Add method getBuffer() to retrieve
the buffer used if output was saved to a memory buffer.
* include/qpdf/QPDF.hh: add methods replaceObject() and
swapObjects() to allow replacement of an object and swapping of
two objects by object ID.
* include/qpdf/QPDFObjectHandle.hh: add new methods getDictAsMap()
and getArrayAsVector() for returning the elements of a dictionary
or an array as a map or vector.
update libtool and autoconf files git-svn-id: svn+q:///qpdf/trunk@1061 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-06-25 16:52:09 +00:00
2011-06-25 Jay Berkenbilt <ejb@ql.org>
2.2.4 git-svn-id: svn+q:///qpdf/trunk@1062 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-06-25 18:39:05 +00:00
* 2.2.4: release
disable -Werror by default, don't strip shared libraries and executables during install git-svn-id: svn+q:///qpdf/trunk@1058 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-06-23 18:40:37 +00:00
2011-06-23 Jay Berkenbilt <ejb@ql.org>
* make/libtool.mk (install): Do not strip executables and shared
libraries during installation. Leave that up to the packager.
* configure.ac: disable -Werror by default.
gcc 4.6 warnings git-svn-id: svn+q:///qpdf/trunk@1057 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-05-07 13:45:28 +00:00
2011-05-07 Jay Berkenbilt <ejb@ql.org>
* libqpdf/QPDF_linearization.cc (isLinearized): remove unused
offset variable, found by a gcc 4.6 warning.
be less conservative when skipping over inline images in content normalization git-svn-id: svn+q:///qpdf/trunk@1050 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-04-30 18:20:35 +00:00
2011-04-30 Jay Berkenbilt <ejb@ql.org>
update version to 2.2.3, update copyright to 2011 git-svn-id: svn+q:///qpdf/trunk@1051 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-04-30 19:19:30 +00:00
* 2.2.3: release
accept stream keyword with CR only git-svn-id: svn+q:///qpdf/trunk@1052 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-04-30 21:46:09 +00:00
* libqpdf/QPDF.cc (readObjectInternal): Accept the case of the
stream keyword being followed by carriage return by itself. While
this is not permitted by the specification, there are PDF files
that do this, and other readers can read them.
be less conservative when skipping over inline images in content normalization git-svn-id: svn+q:///qpdf/trunk@1050 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-04-30 18:20:35 +00:00
* libqpdf/Pl_QPDFTokenizer.cc (processChar): When an inline image
is detected, suspend normalization only up to the end of the
inline image rather than for the remainder of the content stream.
(Fixes qpdf-Bugs 3152169.)
handle files with object 0 as a real object git-svn-id: svn+q:///qpdf/trunk@1049 71b93d88-0707-0410-a8cf-f5a4172ac649
2011-01-31 14:59:42 +00:00
2011-01-31 Jay Berkenbilt <ejb@ql.org>
* libqpdf/QPDF.cc (readObjectAtOffset): use -1 rather than 0 when
reading an object at a given to indicate that no object number is
expected. This allows xref recovery to proceed even if a file
uses the invalid object number 0 as a regular object.
* libqpdf/QPDF_linearization.cc (isLinearized): use -1 rather than
0 as a sentintel for not having found the first object in the
file. Since -1 can never match the regular expression, this
prevents an infinite loop when checking a file that starts with
(erroneous) 0 0 obj. (Fixes qpdf-Bugs-3159950.)
2.2.2 git-svn-id: svn+q:///qpdf/trunk@1045 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-04 15:26:40 +00:00
2010-10-04 Jay Berkenbilt <ejb@ql.org>
* 2.2.2: release
* include/qpdf/qpdf-c.h: Add qpdf_read_memory to C API to call
QPDF::processMemoryFile.
add QPDF::processMemoryFile and API additions to support it git-svn-id: svn+q:///qpdf/trunk@1034 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-01 10:20:38 +00:00
2010-10-01 Jay Berkenbilt <ejb@ql.org>
2.2.1 git-svn-id: svn+q:///qpdf/trunk@1037 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-01 11:07:12 +00:00
* 2.2.1: release
setOutputStreams git-svn-id: svn+q:///qpdf/trunk@1035 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-01 11:02:35 +00:00
* include/qpdf/QPDF.hh: Add setOutputStreams method to allow
redirection of library-generated output/error to alternative
streams.
add QPDF::processMemoryFile and API additions to support it git-svn-id: svn+q:///qpdf/trunk@1034 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-10-01 10:20:38 +00:00
* include/qpdf/QPDF.hh: Add processMemoryFile method for
processing a PDF file from a memory buffer instead of a file.
update git-svn-id: svn+q:///qpdf/trunk@1032 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-09-24 20:47:10 +00:00
2010-09-24 Jay Berkenbilt <ejb@ql.org>
* libqpdf/QPDF.cc: change private "file" method to be a
PointerHolder<InputSource> to prepare qpdf for being able to work
with PDF files loaded into memory in addition to working with
files on disk.
* include/qpdf/PointerHolder.hh: add operator* and operator->
methods so that PointerHolder objects can be used like pointers.
This is consistent with the smart pointer objects in the next
revision of C++.
handle stream filter abbreviations from table H.1 git-svn-id: svn+q:///qpdf/trunk@1025 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-09-05 15:00:44 +00:00
2010-09-05 Jay Berkenbilt <ejb@ql.org>
treat empty objects as null git-svn-id: svn+q:///qpdf/trunk@1027 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-09-06 02:17:55 +00:00
* libqpdf/QPDF.cc (readObjectInternal): Recognize empty objects
and treat them as null.
handle stream filter abbreviations from table H.1 git-svn-id: svn+q:///qpdf/trunk@1025 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-09-05 15:00:44 +00:00
* libqpdf/QPDF_Stream.cc (filterable): Handle inline image filter
abbreviations as stream filter abbreviations. Although this is
not technically allowed by the PDF specification, table H.1 in the
pre-ISO spec indicates that Adobe's readers accept them. Thanks
to Jian Ma <stronghorse@tom.com> for bringing this to my
attention.
document VC6 port git-svn-id: svn+q:///qpdf/trunk@1015 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-14 16:39:50 +00:00
2010-08-14 Jay Berkenbilt <ejb@ql.org>
2.2.0 git-svn-id: svn+q:///qpdf/trunk@1016 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-14 16:43:18 +00:00
* 2.2.0: release
document VC6 port git-svn-id: svn+q:///qpdf/trunk@1015 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-14 16:39:50 +00:00
* Rename README.windows to README-windows.txt and convert its line
endings to Windows-style line endings. Also mention Jian Ma's VC6
port in the manual and README-windows.txt.
getRawStreamData() git-svn-id: svn+q:///qpdf/trunk@1010 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-09 23:33:40 +00:00
2010-08-09 Jay Berkenbilt <ejb@ql.org>
* Add QPDFObjectHandle::getRawStreamData to return raw
(unfiltered) stream data.
update version numbers git-svn-id: svn+q:///qpdf/trunk@1004 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-08 21:19:58 +00:00
2010-08-08 Jay Berkenbilt <ejb@ql.org>
* 2.2.rc1: release
addPageContents git-svn-id: svn+q:///qpdf/trunk@995 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:06:49 +00:00
2010-08-05 Jay Berkenbilt <ejb@ql.org>
add double-page-size example git-svn-id: svn+q:///qpdf/trunk@996 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:51:19 +00:00
* Add QPDFObjectHandle::addPageContents, a convenience routine for
appending or prepending new streams to a page's content streams.
invert images example git-svn-id: svn+q:///qpdf/trunk@1001 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-06 01:27:47 +00:00
The "pdf-double-page-size" example illustrates its use.
add double-page-size example git-svn-id: svn+q:///qpdf/trunk@996 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:51:19 +00:00
addPageContents git-svn-id: svn+q:///qpdf/trunk@995 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:06:49 +00:00
* Add new methods to QPDFObjectHandle: replaceStreamData and
newStream. These methods allow users of the qpdf library to add
notes git-svn-id: svn+q:///qpdf/trunk@997 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:54:15 +00:00
new streams and to replace data of existing streams. The
invert images example git-svn-id: svn+q:///qpdf/trunk@1001 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-06 01:27:47 +00:00
"pdf-double-page-size" and "pdf-invert-images" examples illustrate
their use.
addPageContents git-svn-id: svn+q:///qpdf/trunk@995 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-08-05 21:06:49 +00:00
fix memory leak git-svn-id: svn+q:///qpdf/trunk@976 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-06-06 13:32:08 +00:00
2010-06-06 Jay Berkenbilt <ejb@ql.org>
* Fix memory leak for QPDF objects whose underlying PDF objects
contain circular references. Thanks to Jian Ma
<stronghorse@tom.com> for calling my attention to the memory leak.
2.1.5 git-svn-id: svn+q:///qpdf/trunk@962 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-04-25 15:05:11 +00:00
2010-04-25 Jay Berkenbilt <ejb@ql.org>
* 2.1.5: release
* libqpdf/QPDF_encryption.cc (compute_encryption_key): remove
restrictions on length of file identifier string. (Fixes
qpdf-Bugs-2991412.)
fix linearization padding bug for second xref stream as well as first, which was previously fixed git-svn-id: svn+q:///qpdf/trunk@957 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-04-18 23:19:54 +00:00
2010-04-18 Jay Berkenbilt <ejb@ql.org>
* 2.1.4: release
* libqpdf/QPDFWriter.cc (writeLinearized): the padding calculation
fix in 2.1.2 was applied in only one place but it was needed in
two places since there are actually two cross reference streams in
a linearized file. The new padding calculation is now used for
both streams. Hopefully this should put an end to linearization
padding problems. (Fixes qpdf-Bugs-2979219.)
change output message from qpdf --check when no errors are found git-svn-id: svn+q:///qpdf/trunk@955 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-04-10 13:43:16 +00:00
2010-04-10 Jay Berkenbilt <ejb@ql.org>
* qpdf/qpdf.cc (main): Since qpdf --check only checks syntax and
stream encoding without doing any semantic checks, make the output
clearer when no errors around found. This is inspired by
qpdf-Bugs-2983225.
updated ChangeLog git-svn-id: svn+q:///qpdf/trunk@947 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-03-27 15:53:44 +00:00
2010-03-27 Jay Berkenbilt <ejb@ql.org>
update for 2.1.3 git-svn-id: svn+q:///qpdf/trunk@949 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-03-27 16:03:04 +00:00
* 2.1.3: release
updated ChangeLog git-svn-id: svn+q:///qpdf/trunk@947 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-03-27 15:53:44 +00:00
* libqpdf/QPDF_optimization.cc (flattenScalarReferences): Flatten
scalar references for unreferenced objects as well as those seen
during traversal of the file. This matters when preserving object
streams that contain unreferenced objects with indirect scalars.
(Fixes qpdf-Bugs-2974522.) Updated TODO with a description of a
possibly better fix involving removal of flattenScalarReferences.
* libqpdf/Pl_AES_PDF.cc (finish): Don't complain if an AES input
buffer is not a multiple of 16 bytes. Instead, just pad with
nulls and hope for the best. PDF files have been encountered "in
the wild" that contain AES buffers that aren't a multiple of 16
bytes.
update for 2.1.2 git-svn-id: svn+q:///qpdf/trunk@934 71b93d88-0707-0410-a8cf-f5a4172ac649
2010-01-25 01:21:06 +00:00
2010-01-24 Jay Berkenbilt <ejb@ql.org>
* 2.1.2: release
* libqpdf/QPDFWriter.cc: fix logic error in padding calculation.
When writing linearized files with cross reference streams, the
padding calculation failed to take differences in sizes of
compressed data between pass 1 and pass 2 into consideration.
update test suite for 2.1.1 release git-svn-id: svn+q:///qpdf/trunk@927 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-12-14 19:50:37 +00:00
2009-12-14 Jay Berkenbilt <ejb@ql.org>
2.1.1 -- gcc 4.4 fixes git-svn-id: svn+q:///qpdf/trunk@925 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-12-14 02:35:31 +00:00
* 2.1.1: release
update test suite for 2.1.1 release git-svn-id: svn+q:///qpdf/trunk@927 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-12-14 19:50:37 +00:00
* qpdf/qtest/qpdf.test: improve test for acroread to make sure it
actually works and is not just present in the path.
2009-12-13 Jay Berkenbilt <ejb@ql.org>
2.1.1 -- gcc 4.4 fixes git-svn-id: svn+q:///qpdf/trunk@925 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-12-14 02:35:31 +00:00
* libqpdf/qpdf/Pl_AES_PDF.hh: include <stdint.h>, if available, so
we have valid definitions of uint32_t.
2.1 -- changelog git-svn-id: svn+q:///qpdf/trunk@912 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-30 23:57:02 +00:00
2009-10-30 Jay Berkenbilt <ejb@ql.org>
* 2.1: release
* libqpdf/QPDF.cc: be more forgiving of extraneous whitespace in
the xref table and while recovering from error conditions.
minor tweaks so rpm creation works properly in rhel5 git-svn-id: svn+q:///qpdf/trunk@911 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-27 01:51:56 +00:00
2009-10-26 Jay Berkenbilt <ejb@ql.org>
* Work around failure of PCRE test case; this test case exercises
an aspect of PCRE that qpdf does not use, and the test fails with
the version of PCRE on Red Hat Enterprise Linux 5, so we ignore
failure on this particular test case.
* Fix RPM .spec file to include "C" examples
set release date git-svn-id: svn+q:///qpdf/trunk@904 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 13:23:45 +00:00
2009-10-24 Jay Berkenbilt <ejb@ql.org>
prepare 2.1.rc1 for release git-svn-id: svn+q:///qpdf/trunk@901 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 04:47:17 +00:00
* 2.1.rc1: release
add C interface for getting software version git-svn-id: svn+q:///qpdf/trunk@903 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 13:23:20 +00:00
* Provide interfaces for getting qpdf's own version number
2009-10-19 Jay Berkenbilt <ejb@ql.org>
categorize all error messages and include object information if available git-svn-id: svn+q:///qpdf/trunk@829 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-19 23:09:19 +00:00
update C API for error retrieval git-svn-id: svn+q:///qpdf/trunk@830 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-20 00:24:44 +00:00
* include/qpdf/QPDF.hh (QPDF): getWarnings now returns a list of
QPDFExc rather than a list of strings. This way, warnings may be
inspected in more detail.
categorize all error messages and include object information if available git-svn-id: svn+q:///qpdf/trunk@829 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-19 23:09:19 +00:00
* Include information about the last object read in most error
messages. Most of the time, this will provide a good hint as to
which object contains the error, but it's possible that the last
object read may not necessarily be the one that has the error if
the erroneous object was previously read and cached.
only seed randon number generater once for aes-cbc, try to avoid compressing Metadata streams git-svn-id: svn+q:///qpdf/trunk@818 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-18 14:09:10 +00:00
2009-10-18 Jay Berkenbilt <ejb@ql.org>
more testing, bug fix for linearized aes encrypted files git-svn-id: svn+q:///qpdf/trunk@824 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-19 00:17:11 +00:00
* If forcing version, disable object stream creation and/or
encryption if previous specifications are incompatible with new
version. It is still possible that PDF content, compression
schemes, etc., may be incompatible with the new version, but at
least this way, older viewers will at least have a chance.
only seed randon number generater once for aes-cbc, try to avoid compressing Metadata streams git-svn-id: svn+q:///qpdf/trunk@818 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-18 14:09:10 +00:00
* libqpdf/QPDFWriter.cc (unparseObject): avoid compressing
Metadata streams if possible.
prepare 2.1.rc1 for release git-svn-id: svn+q:///qpdf/trunk@901 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 04:47:17 +00:00
2009-10-13 Jay Berkenbilt <ejb@ql.org>
* Upgrade embedded qtest to version 1.4, which allows the test
suite to be run in Windows with MSYS and ActiveState Perl rather
than requiring Cygwin perl.
only seed randon number generater once for aes-cbc, try to avoid compressing Metadata streams git-svn-id: svn+q:///qpdf/trunk@818 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-18 14:09:10 +00:00
2009-10-04 Jay Berkenbilt <ejb@ql.org>
* Implement support AES encrypt and crypt filters. Implementation
is not fully tested due to lack of test data but has been tested
for several cases.
bug fix: more gracefully handle xref stream with too many entries git-svn-id: svn+q:///qpdf/trunk@747 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-04 23:56:56 +00:00
2009-10-04 Jay Berkenbilt <ejb@ql.org>
Implement changes suggested by Zarko and our subsequent conversations: - Add a way to set the minimum PDF version - Add a way to force the PDF version - Have isEncrypted return true if an /Encrypt dictionary exists even when we can't read the file - Allow qpdf_init_write to be called multiple times - Update some comments in headers git-svn-id: svn+q:///qpdf/trunk@748 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-05 00:42:48 +00:00
* Add methods to QPDFWriter and corresponding command line
arguments to qpdf to set the minimum output PDF version and also
to force the version to a particular value.
bug fix: more gracefully handle xref stream with too many entries git-svn-id: svn+q:///qpdf/trunk@747 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-04 23:56:56 +00:00
* libqpdf/QPDF.cc (processXRefStream): warn and ignore extra xref
stream entries when stream is larger than reported size. This
used to be a fatal error. (Fixes qpdf-Bugs-2872265.)
more tests of C API git-svn-id: svn+q:///qpdf/trunk@728 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-27 16:55:24 +00:00
2009-09-27 Jay Berkenbilt <ejb@ql.org>
add methods for getting encryption data git-svn-id: svn+q:///qpdf/trunk@733 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-27 20:05:38 +00:00
* Add several methods to query permissions controlled by the
encryption dictionary. Note that qpdf does not enforce these
permissions even though it allows the user to query them.
more tests of C API git-svn-id: svn+q:///qpdf/trunk@728 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-27 16:55:24 +00:00
* The function QPDF::getUserPassword returned the user password
with the required padding as specified by the PDF specification.
This is seldom useful to users. This function has been replaced
by QPDF::getPaddedUserPassword. Call the new
QPDF::getTrimmedUserPassword to retreive the user password in a
human-readable format.
* qpdf/qpdf.cc (main): qpdf --check now prints the PDF version
number in addition to its other output.
removed qexc; non-compatible ABI change git-svn-id: svn+q:///qpdf/trunk@709 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-09-26 18:36:04 +00:00
2009-09-26 Jay Berkenbilt <ejb@ql.org>
* Removed all references to QEXC; now using std::runtime_error and
std::logic_error and their subclasses for all exceptions.
2.0.6 git-svn-id: svn+q:///qpdf/trunk@673 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-05-03 16:38:04 +00:00
2009-05-03 Jay Berkenbilt <ejb@ql.org>
prepare 2.1.rc1 for release git-svn-id: svn+q:///qpdf/trunk@901 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-10-24 04:47:17 +00:00
* 2.0.6: release
2.0.6 git-svn-id: svn+q:///qpdf/trunk@673 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-05-03 16:38:04 +00:00
* libqpdf/QPDF_Stream.cc (filterable): ignore /DecodeParms if it's
not a type we recognize. (Fixes qpdf-Bugs-2779746.)
2.0.5 git-svn-id: svn+q:///qpdf/trunk@669 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-10 16:26:57 +00:00
2009-03-10 Jay Berkenbilt <ejb@ql.org>
update test suite to handle original object ID comments git-svn-id: svn+q:///qpdf/trunk@663 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 16:27:13 +00:00
prepare for 2.0.5 release git-svn-id: svn+q:///qpdf/trunk@667 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 16:59:37 +00:00
* 2.0.5: release
2.0.5 git-svn-id: svn+q:///qpdf/trunk@669 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-10 16:26:57 +00:00
2009-03-09 Jay Berkenbilt <ejb@ql.org>
update test suite to handle original object ID comments git-svn-id: svn+q:///qpdf/trunk@663 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 16:27:13 +00:00
* libqpdf/Pl_LZWDecoder.cc: adjust LZWDecoder full table
detection, now having been able to adequately test boundary
conditions both and with and without early code change. Also
compared implementation with other LZW decoders.
decode streams on check, always exit abnormally when warnings are detected git-svn-id: svn+q:///qpdf/trunk@660 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-08 19:00:19 +00:00
2009-03-08 Jay Berkenbilt <ejb@ql.org>
* qpdf/fix-qdf (write_ostream): Adjust offsets while writing
object streams to account for changes in the length of the
dictionary and offset tables.
* qpdf/qpdf.cc (main): In check mode, in addition to checking
structure of file, attempt to decode all stream data.
* libqpdf/QPDFWriter.cc (QPDFWriter::writeObject): In QDF mode,
checkpoint -- will have to finish another day git-svn-id: svn+q:///qpdf/trunk@661 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 01:11:06 +00:00
write a comment to the QDF file before each object that indicates
the object ID of the corresponding object from the original file.
update test suite to handle original object ID comments git-svn-id: svn+q:///qpdf/trunk@663 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-09 16:27:13 +00:00
Add --no-original-object-ids flag to qpdf and
setSuppressOriginalObjectIDs() method to QPDFWriter to turn this
behavior off.
decode streams on check, always exit abnormally when warnings are detected git-svn-id: svn+q:///qpdf/trunk@660 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-03-08 19:00:19 +00:00
* libqpdf/QPDF.cc (QPDF::pipeStreamData): Issue a warning instead
of failing if there is a problem found while decoding stream.
* qpdf/qpdf.cc: Exit with a status of 3 if warnings were found
regardless of what mode we're in.
update version to 2.0.4 git-svn-id: svn+q:///qpdf/trunk@653 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 14:10:40 +00:00
2009-02-21 Jay Berkenbilt <ejb@ql.org>
* 2.0.4: release
better recovery for appended files with damaged cross-reference tables git-svn-id: svn+q:///qpdf/trunk@649 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 02:31:32 +00:00
2009-02-20 Jay Berkenbilt <ejb@ql.org>
fix many typos in comments and strings git-svn-id: svn+q:///qpdf/trunk@651 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 02:54:31 +00:00
* Fix many typos in comments and strings.
special exit status in --check mode with warnings and no errors git-svn-id: svn+q:///qpdf/trunk@650 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 02:38:33 +00:00
* qpdf/qpdf.cc: in --check mode, if there are warnings but no
errors, exit with a status of 3.
better recovery for appended files with damaged cross-reference tables git-svn-id: svn+q:///qpdf/trunk@649 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-21 02:31:32 +00:00
* libqpdf/QPDF.cc (QPDF::insertXrefEntry): when recovering the
cross-reference table, have objects we encounter later in the file
supersede those we found earlier. This improves the chances of
being able to recover appended files with damaged cross-reference
tables.
fix problem with lzw decoder when run without early code change, now that we actually have test input git-svn-id: svn+q:///qpdf/trunk@646 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-20 02:27:36 +00:00
2009-02-19 Jay Berkenbilt <ejb@ql.org>
* libqpdf/Pl_LZWDecoder.cc: correct logic error for previously
untested case of running the LZW decoder without the "early code
change" flag. Thanks to a bug report from "Atom Smasher", I
finally was able to obtain an input stream compressed in this way.
update copyright, release 2.0.3 git-svn-id: svn+q:///qpdf/trunk@644 71b93d88-0707-0410-a8cf-f5a4172ac649
2009-02-15 16:31:12 +00:00
2009-02-15 Jay Berkenbilt <ejb@ql.org>
* 2.0.3: release
-help and -version git-svn-id: svn+q:///qpdf/trunk@643 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-12-12 03:17:25 +00:00
2008-12-11 Jay Berkenbilt <ejb@ql.org>
* qpdf/qpdf.cc (main): Accept -help and -version as well as --help
and --version
handle UTF-16BE fully git-svn-id: svn+q:///qpdf/trunk@639 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-11-23 18:49:13 +00:00
2008-11-23 Jay Berkenbilt <ejb@ql.org>
gcc 4.4 fixes git-svn-id: svn+q:///qpdf/trunk@642 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-11-23 19:11:24 +00:00
* Include stdio.h in a few files for proper compilation with (yet
to be released) gcc 4.4
updated qtest git-svn-id: svn+q:///qpdf/trunk@641 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-11-23 19:01:11 +00:00
* updated embedded qtest to version 1.3
handle UTF-16BE fully git-svn-id: svn+q:///qpdf/trunk@639 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-11-23 18:49:13 +00:00
* libqpdf/QPDF_String.cc (QPDF_String::getUTF8Val): handle
UTF-16BE properly rather than just treating the string as a string
of 16-bit characters.
2.0.2 git-svn-id: svn+q:///qpdf/trunk@634 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-06-30 14:48:16 +00:00
2008-06-30 Jay Berkenbilt <ejb@ql.org>
* 2.0.2: release
* updated embedded qtest to version 1.2 (includes previous
changes)
fix bashism git-svn-id: svn+q:///qpdf/trunk@633 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-06-08 00:46:06 +00:00
2008-06-07 Jay Berkenbilt <ejb@ql.org>
* qpdf/qtest/qpdf/diff-encrypted: change == to = so that the test
suite passes when /bin/sh is not bash
changelog update git-svn-id: svn+q:///qpdf/trunk@629 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-07 15:43:35 +00:00
2008-05-07 Jay Berkenbilt <ejb@ql.org>
* qtest/bin/qtest-driver (run_test): increase timeout for qtest to
be more tolerant of slow machines
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
2008-05-06 Jay Berkenbilt <ejb@ql.org>
changelog update git-svn-id: svn+q:///qpdf/trunk@629 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-07 15:43:35 +00:00
* 2.0.1: release
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* make/rules.mk: fix logic with .dep generation for .lo files so
that dependencies work properly with libtool
changelog date git-svn-id: svn+q:///qpdf/trunk@620 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 14:45:06 +00:00
2008-05-05 Jay Berkenbilt <ejb@ql.org>
missing strlen.h causes problems with gcc 4.3 git-svn-id: svn+q:///qpdf/trunk@606 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-04 02:09:53 +00:00
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* libqpdf/qpdf/MD5.hh: fix header to be 64-bit clean
* configure.ac: add tests for sized integer types
update changelog git-svn-id: svn+q:///qpdf/trunk@619 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 14:33:34 +00:00
changelog date git-svn-id: svn+q:///qpdf/trunk@620 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 14:45:06 +00:00
2008-05-04 Jay Berkenbilt <ejb@ql.org>
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* libqpdf/QPDF_encryption.cc: do not assume size_t is unsigned int
64-bit fix git-svn-id: svn+q:///qpdf/trunk@611 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 02:08:47 +00:00
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* qpdf/qtest/qpdf.test: removed locale-specific tests. These were
really to check bugs in perl 5.8.0 and are obsolete now. They
also make the test suite fail in some environments that don't have
all the locales fully configured.
64-bit fix git-svn-id: svn+q:///qpdf/trunk@611 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-05 02:08:47 +00:00
fix deps with libtool git-svn-id: svn+q:///qpdf/trunk@623 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-06 15:23:28 +00:00
* various: updated several files for gcc 4.3 by adding missing
includes (string.h, stdlib.h)
missing strlen.h causes problems with gcc 4.3 git-svn-id: svn+q:///qpdf/trunk@606 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-05-04 02:09:53 +00:00
update release date to actual date git-svn-id: svn+q:///qpdf/trunk@599 71b93d88-0707-0410-a8cf-f5a4172ac649
2008-04-29 12:55:25 +00:00
2008-04-26 Jay Berkenbilt <ejb@ql.org>
* 2.0: initial public release
Copy Permalink