| 1 |
ChangeLog for PCRE |
ChangeLog for PCRE |
| 2 |
------------------ |
------------------ |
| 3 |
|
|
| 4 |
Version 8.30 |
Version 8.31 20-June-2012 |
| 5 |
------------ |
------------------------- |
| 6 |
|
|
| 7 |
|
1. Fixing a wrong JIT test case and some compiler warnings. |
| 8 |
|
|
| 9 |
|
2. Removed a bashism from the RunTest script. |
| 10 |
|
|
| 11 |
|
3. Add a cast to pcre_exec.c to fix the warning "unary minus operator applied |
| 12 |
|
to unsigned type, result still unsigned" that was given by an MS compiler |
| 13 |
|
on encountering the code "-sizeof(xxx)". |
| 14 |
|
|
| 15 |
|
4. Partial matching support is added to the JIT compiler. |
| 16 |
|
|
| 17 |
|
5. Fixed several bugs concerned with partial matching of items that consist |
| 18 |
|
of more than one character: |
| 19 |
|
|
| 20 |
|
(a) /^(..)\1/ did not partially match "aba" because checking references was |
| 21 |
|
done on an "all or nothing" basis. This also applied to repeated |
| 22 |
|
references. |
| 23 |
|
|
| 24 |
|
(b) \R did not give a hard partial match if \r was found at the end of the |
| 25 |
|
subject. |
| 26 |
|
|
| 27 |
|
(c) \X did not give a hard partial match after matching one or more |
| 28 |
|
characters at the end of the subject. |
| 29 |
|
|
| 30 |
|
(d) When newline was set to CRLF, a pattern such as /a$/ did not recognize |
| 31 |
|
a partial match for the string "\r". |
| 32 |
|
|
| 33 |
|
(e) When newline was set to CRLF, the metacharacter "." did not recognize |
| 34 |
|
a partial match for a CR character at the end of the subject string. |
| 35 |
|
|
| 36 |
|
6. If JIT is requested using /S++ or -s++ (instead of just /S+ or -s+) when |
| 37 |
|
running pcretest, the text "(JIT)" added to the output whenever JIT is |
| 38 |
|
actually used to run the match. |
| 39 |
|
|
| 40 |
|
7. Individual JIT compile options can be set in pcretest by following -s+[+] |
| 41 |
|
or /S+[+] with a digit between 1 and 7. |
| 42 |
|
|
| 43 |
|
8. OP_NOT now supports any UTF character not just single-byte ones. |
| 44 |
|
|
| 45 |
|
9. (*MARK) control verb is now supported by the JIT compiler. |
| 46 |
|
|
| 47 |
|
10. The command "./RunTest list" lists the available tests without actually |
| 48 |
|
running any of them. (Because I keep forgetting what they all are.) |
| 49 |
|
|
| 50 |
|
11. Add PCRE_INFO_MAXLOOKBEHIND. |
| 51 |
|
|
| 52 |
|
12. Applied a (slightly modified) user-supplied patch that improves performance |
| 53 |
|
when the heap is used for recursion (compiled with --disable-stack-for- |
| 54 |
|
recursion). Instead of malloc and free for each heap frame each time a |
| 55 |
|
logical recursion happens, frames are retained on a chain and re-used where |
| 56 |
|
possible. This sometimes gives as much as 30% improvement. |
| 57 |
|
|
| 58 |
|
13. As documented, (*COMMIT) is now confined to within a recursive subpattern |
| 59 |
|
call. |
| 60 |
|
|
| 61 |
|
14. As documented, (*COMMIT) is now confined to within a positive assertion. |
| 62 |
|
|
| 63 |
|
15. It is now possible to link pcretest with libedit as an alternative to |
| 64 |
|
libreadline. |
| 65 |
|
|
| 66 |
|
16. (*COMMIT) control verb is now supported by the JIT compiler. |
| 67 |
|
|
| 68 |
|
17. The Unicode data tables have been updated to Unicode 6.1.0. |
| 69 |
|
|
| 70 |
|
18. Added --file-list option to pcregrep. |
| 71 |
|
|
| 72 |
|
19. Added binary file support to pcregrep, including the -a, --binary-files, |
| 73 |
|
-I, and --text options. |
| 74 |
|
|
| 75 |
|
20. The madvise function is renamed for posix_madvise for QNX compatibility |
| 76 |
|
reasons. Fixed by Giuseppe D'Angelo. |
| 77 |
|
|
| 78 |
|
21. Fixed a bug for backward assertions with REVERSE 0 in the JIT compiler. |
| 79 |
|
|
| 80 |
|
22. Changed the option for creating symbolic links for 16-bit man pages from |
| 81 |
|
-s to -sf so that re-installing does not cause issues. |
| 82 |
|
|
| 83 |
|
23. Support PCRE_NO_START_OPTIMIZE in JIT as (*MARK) support requires it. |
| 84 |
|
|
| 85 |
|
24. Fixed a very old bug in pcretest that caused errors with restarted DFA |
| 86 |
|
matches in certain environments (the workspace was not being correctly |
| 87 |
|
retained). Also added to pcre_dfa_exec() a simple plausibility check on |
| 88 |
|
some of the workspace data at the beginning of a restart. |
| 89 |
|
|
| 90 |
|
25. \s*\R was auto-possessifying the \s* when it should not, whereas \S*\R |
| 91 |
|
was not doing so when it should - probably a typo introduced by SVN 528 |
| 92 |
|
(change 8.10/14). |
| 93 |
|
|
| 94 |
|
26. When PCRE_UCP was not set, \w+\x{c4} was incorrectly auto-possessifying the |
| 95 |
|
\w+ when the character tables indicated that \x{c4} was a word character. |
| 96 |
|
There were several related cases, all because the tests for doing a table |
| 97 |
|
lookup were testing for characters less than 127 instead of 255. |
| 98 |
|
|
| 99 |
|
27. If a pattern contains capturing parentheses that are not used in a match, |
| 100 |
|
their slots in the ovector are set to -1. For those that are higher than |
| 101 |
|
any matched groups, this happens at the end of processing. In the case when |
| 102 |
|
there were back references that the ovector was too small to contain |
| 103 |
|
(causing temporary malloc'd memory to be used during matching), and the |
| 104 |
|
highest capturing number was not used, memory off the end of the ovector |
| 105 |
|
was incorrectly being set to -1. (It was using the size of the temporary |
| 106 |
|
memory instead of the true size.) |
| 107 |
|
|
| 108 |
|
28. To catch bugs like 27 using valgrind, when pcretest is asked to specify an |
| 109 |
|
ovector size, it uses memory at the end of the block that it has got. |
| 110 |
|
|
| 111 |
|
29. Check for an overlong MARK name and give an error at compile time. The |
| 112 |
|
limit is 255 for the 8-bit library and 65535 for the 16-bit library. |
| 113 |
|
|
| 114 |
|
30. JIT compiler update. |
| 115 |
|
|
| 116 |
|
31. JIT is now supported on jailbroken iOS devices. Thanks for Ruiger |
| 117 |
|
Rill for the patch. |
| 118 |
|
|
| 119 |
|
32. Put spaces around SLJIT_PRINT_D in the JIT compiler. Required by CXX11. |
| 120 |
|
|
| 121 |
|
33. Variable renamings in the PCRE-JIT compiler. No functionality change. |
| 122 |
|
|
| 123 |
|
34. Fixed typos in pcregrep: in two places there was SUPPORT_LIBZ2 instead of |
| 124 |
|
SUPPORT_LIBBZ2. This caused a build problem when bzip2 but not gzip (zlib) |
| 125 |
|
was enabled. |
| 126 |
|
|
| 127 |
|
35. Improve JIT code generation for greedy plus quantifier. |
| 128 |
|
|
| 129 |
|
36. When /((?:a?)*)*c/ or /((?>a?)*)*c/ was matched against "aac", it set group |
| 130 |
|
1 to "aa" instead of to an empty string. The bug affected repeated groups |
| 131 |
|
that could potentially match an empty string. |
| 132 |
|
|
| 133 |
|
37. Optimizing single character iterators in JIT. |
| 134 |
|
|
| 135 |
|
38. Wide characters specified with \uxxxx in JavaScript mode are now subject to |
| 136 |
|
the same checks as \x{...} characters in non-JavaScript mode. Specifically, |
| 137 |
|
codepoints that are too big for the mode are faulted, and in a UTF mode, |
| 138 |
|
disallowed codepoints are also faulted. |
| 139 |
|
|
| 140 |
|
39. If PCRE was compiled with UTF support, in three places in the DFA |
| 141 |
|
matcher there was code that should only have been obeyed in UTF mode, but |
| 142 |
|
was being obeyed unconditionally. In 8-bit mode this could cause incorrect |
| 143 |
|
processing when bytes with values greater than 127 were present. In 16-bit |
| 144 |
|
mode the bug would be provoked by values in the range 0xfc00 to 0xdc00. In |
| 145 |
|
both cases the values are those that cannot be the first data item in a UTF |
| 146 |
|
character. The three items that might have provoked this were recursions, |
| 147 |
|
possessively repeated groups, and atomic groups. |
| 148 |
|
|
| 149 |
|
40. Ensure that libpcre is explicitly listed in the link commands for pcretest |
| 150 |
|
and pcregrep, because some OS require shared objects to be explicitly |
| 151 |
|
passed to ld, causing the link step to fail if they are not. |
| 152 |
|
|
| 153 |
|
|
| 154 |
|
Version 8.30 04-February-2012 |
| 155 |
|
----------------------------- |
| 156 |
|
|
| 157 |
1. Renamed "isnumber" as "is_a_number" because in some Mac environments this |
1. Renamed "isnumber" as "is_a_number" because in some Mac environments this |
| 158 |
name is defined in ctype.h. |
name is defined in ctype.h. |
| 182 |
|
|
| 183 |
8. Ovector size of 2 is also supported by JIT based pcre_exec (the ovector size |
8. Ovector size of 2 is also supported by JIT based pcre_exec (the ovector size |
| 184 |
rounding is not applied in this particular case). |
rounding is not applied in this particular case). |
| 185 |
|
|
| 186 |
9. The invalid Unicode surrogate codepoints U+D800 to U+DFFF are now rejected |
9. The invalid Unicode surrogate codepoints U+D800 to U+DFFF are now rejected |
| 187 |
if they appear, or are escaped, in patterns. |
if they appear, or are escaped, in patterns. |
|
|
|
|
10. Get rid of a number of -Wunused-but-set-variable warnings. |
|
| 188 |
|
|
| 189 |
11. The pattern /(?=(*:x))(q|)/ matches an empty string, and returns the mark |
10. Get rid of a number of -Wunused-but-set-variable warnings. |
| 190 |
"x". The similar pattern /(?=(*:x))((*:y)q|)/ did not return a mark at all. |
|
| 191 |
Oddly, Perl behaves the same way. PCRE has been fixed so that this pattern |
11. The pattern /(?=(*:x))(q|)/ matches an empty string, and returns the mark |
| 192 |
also returns the mark "x". This bug applied to capturing parentheses, |
"x". The similar pattern /(?=(*:x))((*:y)q|)/ did not return a mark at all. |
| 193 |
non-capturing parentheses, and atomic parentheses. It also applied to some |
Oddly, Perl behaves the same way. PCRE has been fixed so that this pattern |
| 194 |
|
also returns the mark "x". This bug applied to capturing parentheses, |
| 195 |
|
non-capturing parentheses, and atomic parentheses. It also applied to some |
| 196 |
assertions. |
assertions. |
| 197 |
|
|
| 198 |
12. Stephen Kelly's patch to CMakeLists.txt allows it to parse the version |
12. Stephen Kelly's patch to CMakeLists.txt allows it to parse the version |
| 199 |
information out of configure.ac instead of relying on pcre.h.generic, which |
information out of configure.ac instead of relying on pcre.h.generic, which |
| 200 |
is not stored in the repository. |
is not stored in the repository. |
| 201 |
|
|
| 202 |
|
13. Applied Dmitry V. Levin's patch for a more portable method for linking with |
| 203 |
|
-lreadline. |
| 204 |
|
|
| 205 |
|
14. ZH added PCRE_CONFIG_JITTARGET; added its output to pcretest -C. |
| 206 |
|
|
| 207 |
|
15. Applied Graycode's patch to put the top-level frame on the stack rather |
| 208 |
|
than the heap when not using the stack for recursion. This gives a |
| 209 |
|
performance improvement in many cases when recursion is not deep. |
| 210 |
|
|
| 211 |
|
16. Experimental code added to "pcretest -C" to output the stack frame size. |
| 212 |
|
|
| 213 |
|
|
| 214 |
Version 8.21 12-Dec-2011 |
Version 8.21 12-Dec-2011 |