| 1 |
ChangeLog for PCRE |
ChangeLog for PCRE |
| 2 |
------------------ |
------------------ |
| 3 |
|
|
| 4 |
Version 7.1 05-Mar-07 |
Version 7.2 13-June-07 |
| 5 |
|
--------------------- |
| 6 |
|
|
| 7 |
|
1. If the fr_FR locale cannot be found for test 3, try the "french" locale, |
| 8 |
|
which is apparently normally available under Windows. |
| 9 |
|
|
| 10 |
|
2. Re-jig the pcregrep tests with different newline settings in an attempt |
| 11 |
|
to make them independent of the local environment's newline setting. |
| 12 |
|
|
| 13 |
|
3. Add code to configure.ac to remove -g from the CFLAGS default settings. |
| 14 |
|
|
| 15 |
|
4. Some of the "internals" tests were previously cut out when the link size |
| 16 |
|
was not 2, because the output contained actual offsets. The recent new |
| 17 |
|
"Z" feature of pcretest means that these can be cut out, making the tests |
| 18 |
|
usable with all link sizes. |
| 19 |
|
|
| 20 |
|
5. Implemented Stan Switzer's goto replacement for longjmp() when not using |
| 21 |
|
stack recursion. This gives a massive performance boost under BSD, but just |
| 22 |
|
a small improvement under Linux. However, it saves one field in the frame |
| 23 |
|
in all cases. |
| 24 |
|
|
| 25 |
|
6. Added more features from the forthcoming Perl 5.10: |
| 26 |
|
|
| 27 |
|
(a) (?-n) (where n is a string of digits) is a relative subroutine or |
| 28 |
|
recursion call. It refers to the nth most recently opened parentheses. |
| 29 |
|
|
| 30 |
|
(b) (?+n) is also a relative subroutine call; it refers to the nth next |
| 31 |
|
to be opened parentheses. |
| 32 |
|
|
| 33 |
|
(c) Conditions that refer to capturing parentheses can be specified |
| 34 |
|
relatively, for example, (?(-2)... or (?(+3)... |
| 35 |
|
|
| 36 |
|
(d) \K resets the start of the current match so that everything before |
| 37 |
|
is not part of it. |
| 38 |
|
|
| 39 |
|
(e) \k{name} is synonymous with \k<name> and \k'name' (.NET compatible). |
| 40 |
|
|
| 41 |
|
(f) \g{name} is another synonym - part of Perl 5.10's unification of |
| 42 |
|
reference syntax. |
| 43 |
|
|
| 44 |
|
(g) (?| introduces a group in which the numbering of parentheses in each |
| 45 |
|
alternative starts with the same number. |
| 46 |
|
|
| 47 |
|
(h) \h, \H, \v, and \V match horizontal and vertical whitespace. |
| 48 |
|
|
| 49 |
|
7. Added two new calls to pcre_fullinfo(): PCRE_INFO_OKPARTIAL and |
| 50 |
|
PCRE_INFO_JCHANGED. |
| 51 |
|
|
| 52 |
|
8. A pattern such as (.*(.)?)* caused pcre_exec() to fail by either not |
| 53 |
|
terminating or by crashing. Diagnosed by Viktor Griph; it was in the code |
| 54 |
|
for detecting groups that can match an empty string. |
| 55 |
|
|
| 56 |
|
9. A pattern with a very large number of alternatives (more than several |
| 57 |
|
hundred) was running out of internal workspace during the pre-compile |
| 58 |
|
phase, where pcre_compile() figures out how much memory will be needed. A |
| 59 |
|
bit of new cunning has reduced the workspace needed for groups with |
| 60 |
|
alternatives. The 1000-alternative test pattern now uses 12 bytes of |
| 61 |
|
workspace instead of running out of the 4096 that are available. |
| 62 |
|
|
| 63 |
|
10. Inserted some missing (unsigned int) casts to get rid of compiler warnings. |
| 64 |
|
|
| 65 |
|
11. Applied patch from Google to remove an optimization that didn't quite work. |
| 66 |
|
The report of the bug said: |
| 67 |
|
|
| 68 |
|
pcrecpp::RE("a*").FullMatch("aaa") matches, while |
| 69 |
|
pcrecpp::RE("a*?").FullMatch("aaa") does not, and |
| 70 |
|
pcrecpp::RE("a*?\\z").FullMatch("aaa") does again. |
| 71 |
|
|
| 72 |
|
|
| 73 |
|
Version 7.1 24-Apr-07 |
| 74 |
--------------------- |
--------------------- |
| 75 |
|
|
| 76 |
1. Applied Bob Rossi and Daniel G's patches to convert the build system to one |
1. Applied Bob Rossi and Daniel G's patches to convert the build system to one |
| 77 |
that is more "standard", making use of automake and other autotools. There |
that is more "standard", making use of automake and other Autotools. There |
| 78 |
is some re-arrangement of the files and adjustment of comments consequent |
is some re-arrangement of the files and adjustment of comments consequent |
| 79 |
on this. |
on this. |
| 80 |
|
|
| 95 |
.br or .in. |
.br or .in. |
| 96 |
|
|
| 97 |
4. Updated comments in configure.ac that get placed in config.h.in and also |
4. Updated comments in configure.ac that get placed in config.h.in and also |
| 98 |
arranged for config.h to be included in the distribution, with the name |
arranged for config.h to be included in the distribution, with the name |
| 99 |
config.h.generic, for the benefit of those who have to compile without |
config.h.generic, for the benefit of those who have to compile without |
| 100 |
Autotools (compare pcre.h, which is now distributed as pcre.h.generic). |
Autotools (compare pcre.h, which is now distributed as pcre.h.generic). |
| 101 |
|
|
| 102 |
5. Updated the support (such as it is) for Virtual Pascal, thanks to Stefan |
5. Updated the support (such as it is) for Virtual Pascal, thanks to Stefan |
| 103 |
Weber: (1) pcre_internal.h was missing some function renames; (2) updated |
Weber: (1) pcre_internal.h was missing some function renames; (2) updated |
| 104 |
makevp.bat for the current PCRE, using the additional files !compile.txt, |
makevp.bat for the current PCRE, using the additional files |
| 105 |
!linklib.txt, and pcregexp.pas. |
makevp_c.txt, makevp_l.txt, and pcregexp.pas. |
| 106 |
|
|
| 107 |
6. A Windows user reported a minor discrepancy with test 2, which turned out |
6. A Windows user reported a minor discrepancy with test 2, which turned out |
| 108 |
to be caused by a trailing space on an input line that had got lost in his |
to be caused by a trailing space on an input line that had got lost in his |
| 132 |
10. Fixed two bugs in the emulated memmove() function in pcre_internal.h: |
10. Fixed two bugs in the emulated memmove() function in pcre_internal.h: |
| 133 |
|
|
| 134 |
(a) It was defining its arguments as char * instead of void *. |
(a) It was defining its arguments as char * instead of void *. |
| 135 |
|
|
| 136 |
(b) It was assuming that all moves were upwards in memory; this was true |
(b) It was assuming that all moves were upwards in memory; this was true |
| 137 |
a long time ago when I wrote it, but is no longer the case. |
a long time ago when I wrote it, but is no longer the case. |
| 138 |
|
|
| 139 |
The emulated memove() is provided for those environments that have neither |
The emulated memove() is provided for those environments that have neither |
| 140 |
memmove() nor bcopy(). I didn't think anyone used it these days, but that |
memmove() nor bcopy(). I didn't think anyone used it these days, but that |
| 141 |
is clearly not the case, as these two bugs were recently reported. |
is clearly not the case, as these two bugs were recently reported. |
| 142 |
|
|
| 143 |
11. The script PrepareRelease is now distributed: it calls 132html, CleanTxt, |
11. The script PrepareRelease is now distributed: it calls 132html, CleanTxt, |
| 144 |
and Detrail to create the HTML documentation, the .txt form of the man |
and Detrail to create the HTML documentation, the .txt form of the man |
| 145 |
pages, and it removes trailing spaces from listed files. It also creates |
pages, and it removes trailing spaces from listed files. It also creates |
| 146 |
pcre.h.generic and config.h.generic from pcre.h and config.h. In the latter |
pcre.h.generic and config.h.generic from pcre.h and config.h. In the latter |
| 147 |
case, it wraps all the #defines with #ifndefs. This script should be run |
case, it wraps all the #defines with #ifndefs. This script should be run |
| 148 |
before "make dist". |
before "make dist". |
| 149 |
|
|
| 150 |
12. Fixed two fairly obscure bugs concerned with quantified caseless matching |
12. Fixed two fairly obscure bugs concerned with quantified caseless matching |
| 151 |
with Unicode property support. |
with Unicode property support. |
| 152 |
|
|
| 153 |
(a) For a maximizing quantifier, if the two different cases of the |
(a) For a maximizing quantifier, if the two different cases of the |
| 154 |
character were of different lengths in their UTF-8 codings (there are |
character were of different lengths in their UTF-8 codings (there are |
| 155 |
some cases like this - I found 11), and the matching function had to |
some cases like this - I found 11), and the matching function had to |
| 156 |
back up over a mixture of the two cases, it incorrectly assumed they |
back up over a mixture of the two cases, it incorrectly assumed they |
| 157 |
were both the same length. |
were both the same length. |
| 158 |
|
|
| 159 |
(b) When PCRE was configured to use the heap rather than the stack for |
(b) When PCRE was configured to use the heap rather than the stack for |
| 160 |
recursion during matching, it was not correctly preserving the data for |
recursion during matching, it was not correctly preserving the data for |
| 161 |
the other case of a UTF-8 character when checking ahead for a match |
the other case of a UTF-8 character when checking ahead for a match |
| 162 |
while processing a minimizing repeat. If the check also involved |
while processing a minimizing repeat. If the check also involved |
| 163 |
matching a wide character, but failed, corruption could cause an |
matching a wide character, but failed, corruption could cause an |
| 164 |
erroneous result when trying to check for a repeat of the original |
erroneous result when trying to check for a repeat of the original |
| 165 |
character. |
character. |
| 166 |
|
|
| 167 |
13. Some tidying changes to the testing mechanism: |
13. Some tidying changes to the testing mechanism: |
| 168 |
|
|
| 169 |
(a) The RunTest script now detects the internal link size and whether there |
(a) The RunTest script now detects the internal link size and whether there |
| 170 |
is UTF-8 and UCP support by running ./pcretest -C instead of relying on |
is UTF-8 and UCP support by running ./pcretest -C instead of relying on |
| 171 |
values substituted by "configure". (The RunGrepTest script already did |
values substituted by "configure". (The RunGrepTest script already did |
| 172 |
this for UTF-8.) The configure.ac script no longer substitutes the |
this for UTF-8.) The configure.ac script no longer substitutes the |
| 173 |
relevant variables. |
relevant variables. |
| 174 |
|
|
| 175 |
(b) The debugging options /B and /D in pcretest show the compiled bytecode |
(b) The debugging options /B and /D in pcretest show the compiled bytecode |
| 176 |
with length and offset values. This means that the output is different |
with length and offset values. This means that the output is different |
| 177 |
for different internal link sizes. Test 2 is skipped for link sizes |
for different internal link sizes. Test 2 is skipped for link sizes |
| 178 |
other than 2 because of this, bypassing the problem. Unfortunately, |
other than 2 because of this, bypassing the problem. Unfortunately, |
| 179 |
there was also a test in test 3 (the locale tests) that used /B and |
there was also a test in test 3 (the locale tests) that used /B and |
| 180 |
failed for link sizes other than 2. Rather than cut the whole test out, |
failed for link sizes other than 2. Rather than cut the whole test out, |
| 181 |
I have added a new /Z option to pcretest that replaces the length and |
I have added a new /Z option to pcretest that replaces the length and |
| 182 |
offset values with spaces. This is now used to make test 3 independent |
offset values with spaces. This is now used to make test 3 independent |
| 183 |
of link size. |
of link size. (Test 2 will be tidied up later.) |
| 184 |
|
|
| 185 |
14. If erroroffset was passed as NULL to pcre_compile, it provoked a |
14. If erroroffset was passed as NULL to pcre_compile, it provoked a |
| 186 |
segmentation fault instead of giving the appropriate error message. |
segmentation fault instead of returning the appropriate error message. |
| 187 |
|
|
| 188 |
|
15. In multiline mode when the newline sequence was set to "any", the pattern |
| 189 |
|
^$ would give a match between the \r and \n of a subject such as "A\r\nB". |
| 190 |
|
This doesn't seem right; it now treats the CRLF combination as the line |
| 191 |
|
ending, and so does not match in that case. It's only a pattern such as ^$ |
| 192 |
|
that would hit this one: something like ^ABC$ would have failed after \r |
| 193 |
|
and then tried again after \r\n. |
| 194 |
|
|
| 195 |
|
16. Changed the comparison command for RunGrepTest from "diff -u" to "diff -ub" |
| 196 |
|
in an attempt to make files that differ only in their line terminators |
| 197 |
|
compare equal. This works on Linux. |
| 198 |
|
|
| 199 |
|
17. Under certain error circumstances pcregrep might try to free random memory |
| 200 |
|
as it exited. This is now fixed, thanks to valgrind. |
| 201 |
|
|
| 202 |
|
19. In pcretest, if the pattern /(?m)^$/g<any> was matched against the string |
| 203 |
|
"abc\r\n\r\n", it found an unwanted second match after the second \r. This |
| 204 |
|
was because its rules for how to advance for /g after matching an empty |
| 205 |
|
string at the end of a line did not allow for this case. They now check for |
| 206 |
|
it specially. |
| 207 |
|
|
| 208 |
|
20. pcretest is supposed to handle patterns and data of any length, by |
| 209 |
|
extending its buffers when necessary. It was getting this wrong when the |
| 210 |
|
buffer for a data line had to be extended. |
| 211 |
|
|
| 212 |
|
21. Added PCRE_NEWLINE_ANYCRLF which is like ANY, but matches only CR, LF, or |
| 213 |
|
CRLF as a newline sequence. |
| 214 |
|
|
| 215 |
|
22. Code for handling Unicode properties in pcre_dfa_exec() wasn't being cut |
| 216 |
|
out by #ifdef SUPPORT_UCP. This did no harm, as it could never be used, but |
| 217 |
|
I have nevertheless tidied it up. |
| 218 |
|
|
| 219 |
|
23. Added some casts to kill warnings from HP-UX ia64 compiler. |
| 220 |
|
|
| 221 |
|
24. Added a man page for pcre-config. |
| 222 |
|
|
| 223 |
|
|
| 224 |
Version 7.0 19-Dec-06 |
Version 7.0 19-Dec-06 |
| 225 |
--------------------- |
--------------------- |