/[pcre]/code/trunk/NEWS
ViewVC logotype

Contents of /code/trunk/NEWS

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1011 - (show annotations) (download)
Sat Aug 25 11:36:15 2012 UTC (19 months, 4 weeks ago) by ph10
File size: 23040 byte(s)
Upgrade \X to match an extended grapheme cluster

1 News about PCRE releases
2 ------------------------
3
4 Release 8.32 xx-xxxx-2012
5 -------------------------
6
7 . A number of issues in pcregrep have been fixed, making it more compatible
8 with GNU grep. In particular, --exclude and --include (and variants) apply
9 to all files now, not just those obtained from scanning a directory
10 recursively. In Windows environments, the default action for directories is
11 now "skip" instead of "read" (which provokes an error).
12
13 . \X now matches a Unicode extended grapheme cluster.
14
15
16 Release 8.31 06-July-2012
17 -------------------------
18
19 This is mainly a bug-fixing release, with a small number of developments:
20
21 . The JIT compiler now supports partial matching and the (*MARK) and
22 (*COMMIT) verbs.
23
24 . PCRE_INFO_MAXLOOKBEHIND can be used to find the longest lookbehind in a
25 pattern.
26
27 . There should be a performance improvement when using the heap instead of the
28 stack for recursion.
29
30 . pcregrep can now be linked with libedit as an alternative to libreadline.
31
32 . pcregrep now has a --file-list option where the list of files to scan is
33 given as a file.
34
35 . pcregrep now recognizes binary files and there are related options.
36
37 . The Unicode tables have been updated to 6.1.0.
38
39 As always, the full list of changes is in the ChangeLog file.
40
41
42 Release 8.30 04-February-2012
43 -----------------------------
44
45 Release 8.30 introduces a major new feature: support for 16-bit character
46 strings, compiled as a separate library. There are a few changes to the
47 8-bit library, in addition to some bug fixes.
48
49 . The pcre_info() function, which has been obsolete for over 10 years, has
50 been removed.
51
52 . When a compiled pattern was saved to a file and later reloaded on a host
53 with different endianness, PCRE used automatically to swap the bytes in some
54 of the data fields. With the advent of the 16-bit library, where more of this
55 swapping is needed, it is no longer done automatically. Instead, the bad
56 endianness is detected and a specific error is given. The user can then call
57 a new function called pcre_pattern_to_host_byte_order() (or an equivalent
58 16-bit function) to do the swap.
59
60 . In UTF-8 mode, the values 0xd800 to 0xdfff are not legal Unicode
61 code points and are now faulted. (They are the so-called "surrogates"
62 that are reserved for coding high values in UTF-16.)
63
64
65 Release 8.21 12-Dec-2011
66 ------------------------
67
68 This is almost entirely a bug-fix release. The only new feature is the ability
69 to obtain the size of the memory used by the JIT compiler.
70
71
72 Release 8.20 21-Oct-2011
73 ------------------------
74
75 The main change in this release is the inclusion of Zoltan Herczeg's
76 just-in-time compiler support, which can be accessed by building PCRE with
77 --enable-jit. Large performance benefits can be had in many situations. 8.20
78 also fixes an unfortunate bug that was introduced in 8.13 as well as tidying up
79 a number of infelicities and differences from Perl.
80
81
82 Release 8.13 16-Aug-2011
83 ------------------------
84
85 This is mainly a bug-fix release. There has been a lot of internal refactoring.
86 The Unicode tables have been updated. The only new feature in the library is
87 the passing of *MARK information to callouts. Some additions have been made to
88 pcretest to make testing easier and more comprehensive. There is a new option
89 for pcregrep to adjust its internal buffer size.
90
91
92 Release 8.12 15-Jan-2011
93 ------------------------
94
95 This release fixes some bugs in pcregrep, one of which caused the tests to fail
96 on 64-bit big-endian systems. There are no changes to the code of the library.
97
98
99 Release 8.11 10-Dec-2010
100 ------------------------
101
102 A number of bugs in the library and in pcregrep have been fixed. As always, see
103 ChangeLog for details. The following are the non-bug-fix changes:
104
105 . Added --match-limit and --recursion-limit to pcregrep.
106
107 . Added an optional parentheses number to the -o and --only-matching options
108 of pcregrep.
109
110 . Changed the way PCRE_PARTIAL_HARD affects the matching of $, \z, \Z, \b, and
111 \B.
112
113 . Added PCRE_ERROR_SHORTUTF8 to make it possible to distinguish between a
114 bad UTF-8 sequence and one that is incomplete when using PCRE_PARTIAL_HARD.
115
116 . Recognize (*NO_START_OPT) at the start of a pattern to set the PCRE_NO_
117 START_OPTIMIZE option, which is now allowed at compile time
118
119
120 Release 8.10 25-Jun-2010
121 ------------------------
122
123 There are two major additions: support for (*MARK) and friends, and the option
124 PCRE_UCP, which changes the behaviour of \b, \d, \s, and \w (and their
125 opposites) so that they make use of Unicode properties. There are also a number
126 of lesser new features, and several bugs have been fixed. A new option,
127 --line-buffered, has been added to pcregrep, for use when it is connected to
128 pipes.
129
130
131 Release 8.02 19-Mar-2010
132 ------------------------
133
134 Another bug-fix release.
135
136
137 Release 8.01 19-Jan-2010
138 ------------------------
139
140 This is a bug-fix release. Several bugs in the code itself and some bugs and
141 infelicities in the build system have been fixed.
142
143
144 Release 8.00 19-Oct-09
145 ----------------------
146
147 Bugs have been fixed in the library and in pcregrep. There are also some
148 enhancements. Restrictions on patterns used for partial matching have been
149 removed, extra information is given for partial matches, the partial matching
150 process has been improved, and an option to make a partial match override a
151 full match is available. The "study" process has been enhanced by finding a
152 lower bound matching length. Groups with duplicate numbers may now have
153 duplicated names without the use of PCRE_DUPNAMES. However, they may not have
154 different names. The documentation has been revised to reflect these changes.
155 The version number has been expanded to 3 digits as it is clear that the rate
156 of change is not slowing down.
157
158
159 Release 7.9 11-Apr-09
160 ---------------------
161
162 Mostly bugfixes and tidies with just a couple of minor functional additions.
163
164
165 Release 7.8 05-Sep-08
166 ---------------------
167
168 More bug fixes, plus a performance improvement in Unicode character property
169 lookup.
170
171
172 Release 7.7 07-May-08
173 ---------------------
174
175 This is once again mainly a bug-fix release, but there are a couple of new
176 features.
177
178
179 Release 7.6 28-Jan-08
180 ---------------------
181
182 The main reason for having this release so soon after 7.5 is because it fixes a
183 potential buffer overflow problem in pcre_compile() when run in UTF-8 mode. In
184 addition, the CMake configuration files have been brought up to date.
185
186
187 Release 7.5 10-Jan-08
188 ---------------------
189
190 This is mainly a bug-fix release. However the ability to link pcregrep with
191 libz or libbz2 and the ability to link pcretest with libreadline have been
192 added. Also the --line-offsets and --file-offsets options were added to
193 pcregrep.
194
195
196 Release 7.4 21-Sep-07
197 ---------------------
198
199 The only change of specification is the addition of options to control whether
200 \R matches any Unicode line ending (the default) or just CR, LF, and CRLF.
201 Otherwise, the changes are bug fixes and a refactoring to reduce the number of
202 relocations needed in a shared library. There have also been some documentation
203 updates, in particular, some more information about using CMake to build PCRE
204 has been added to the NON-UNIX-USE file.
205
206
207 Release 7.3 28-Aug-07
208 ---------------------
209
210 Most changes are bug fixes. Some that are not:
211
212 1. There is some support for Perl 5.10's experimental "backtracking control
213 verbs" such as (*PRUNE).
214
215 2. UTF-8 checking is now as per RFC 3629 instead of RFC 2279; this is more
216 restrictive in the strings it accepts.
217
218 3. Checking for potential integer overflow has been made more dynamic, and as a
219 consequence there is no longer a hard limit on the size of a subpattern that
220 has a limited repeat count.
221
222 4. When CRLF is a valid line-ending sequence, pcre_exec() and pcre_dfa_exec()
223 no longer advance by two characters instead of one when an unanchored match
224 fails at CRLF if there are explicit CR or LF matches within the pattern.
225 This gets rid of some anomalous effects that previously occurred.
226
227 5. Some PCRE-specific settings for varying the newline options at the start of
228 a pattern have been added.
229
230
231 Release 7.2 19-Jun-07
232 ---------------------
233
234 WARNING: saved patterns that were compiled by earlier versions of PCRE must be
235 recompiled for use with 7.2 (necessitated by the addition of \K, \h, \H, \v,
236 and \V).
237
238 Correction to the notes for 7.1: the note about shared libraries for Windows is
239 wrong. Previously, three libraries were built, but each could function
240 independently. For example, the pcreposix library also included all the
241 functions from the basic pcre library. The change is that the three libraries
242 are no longer independent. They are like the Unix libraries. To use the
243 pcreposix functions, for example, you need to link with both the pcreposix and
244 the basic pcre library.
245
246 Some more features from Perl 5.10 have been added:
247
248 (?-n) and (?+n) relative references for recursion and subroutines.
249
250 (?(-n) and (?(+n) relative references as conditions.
251
252 \k{name} and \g{name} are synonyms for \k<name>.
253
254 \K to reset the start of the matched string; for example, (foo)\Kbar
255 matches bar preceded by foo, but only sets bar as the matched string.
256
257 (?| introduces a group where the capturing parentheses in each alternative
258 start from the same number; for example, (?|(abc)|(xyz)) sets capturing
259 parentheses number 1 in both cases.
260
261 \h, \H, \v, \V match horizontal and vertical whitespace, respectively.
262
263
264 Release 7.1 24-Apr-07
265 ---------------------
266
267 There is only one new feature in this release: a linebreak setting of
268 PCRE_NEWLINE_ANYCRLF. It is a cut-down version of PCRE_NEWLINE_ANY, which
269 recognizes only CRLF, CR, and LF as linebreaks.
270
271 A few bugs are fixed (see ChangeLog for details), but the major change is a
272 complete re-implementation of the build system. This now has full Autotools
273 support and so is now "standard" in some sense. It should help with compiling
274 PCRE in a wide variety of environments.
275
276 NOTE: when building shared libraries for Windows, three dlls are now built,
277 called libpcre, libpcreposix, and libpcrecpp. Previously, everything was
278 included in a single dll.
279
280 Another important change is that the dftables auxiliary program is no longer
281 compiled and run at "make" time by default. Instead, a default set of character
282 tables (assuming ASCII coding) is used. If you want to use dftables to generate
283 the character tables as previously, add --enable-rebuild-chartables to the
284 "configure" command. You must do this if you are compiling PCRE to run on a
285 system that uses EBCDIC code.
286
287 There is a discussion about character tables in the README file. The default is
288 not to use dftables so that that there is no problem when cross-compiling.
289
290
291 Release 7.0 19-Dec-06
292 ---------------------
293
294 This release has a new major number because there have been some internal
295 upheavals to facilitate the addition of new optimizations and other facilities,
296 and to make subsequent maintenance and extension easier. Compilation is likely
297 to be a bit slower, but there should be no major effect on runtime performance.
298 Previously compiled patterns are NOT upwards compatible with this release. If
299 you have saved compiled patterns from a previous release, you will have to
300 re-compile them. Important changes that are visible to users are:
301
302 1. The Unicode property tables have been updated to Unicode 5.0.0, which adds
303 some more scripts.
304
305 2. The option PCRE_NEWLINE_ANY causes PCRE to recognize any Unicode newline
306 sequence as a newline.
307
308 3. The \R escape matches a single Unicode newline sequence as a single unit.
309
310 4. New features that will appear in Perl 5.10 are now in PCRE. These include
311 alternative Perl syntax for named parentheses, and Perl syntax for
312 recursion.
313
314 5. The C++ wrapper interface has been extended by the addition of a
315 QuoteMeta function and the ability to allow copy construction and
316 assignment.
317
318 For a complete list of changes, see the ChangeLog file.
319
320
321 Release 6.7 04-Jul-06
322 ---------------------
323
324 The main additions to this release are the ability to use the same name for
325 multiple sets of parentheses, and support for CRLF line endings in both the
326 library and pcregrep (and in pcretest for testing).
327
328 Thanks to Ian Taylor, the stack usage for many kinds of pattern has been
329 significantly reduced for certain subject strings.
330
331
332 Release 6.5 01-Feb-06
333 ---------------------
334
335 Important changes in this release:
336
337 1. A number of new features have been added to pcregrep.
338
339 2. The Unicode property tables have been updated to Unicode 4.1.0, and the
340 supported properties have been extended with script names such as "Arabic",
341 and the derived properties "Any" and "L&". This has necessitated a change to
342 the interal format of compiled patterns. Any saved compiled patterns that
343 use \p or \P must be recompiled.
344
345 3. The specification of recursion in patterns has been changed so that all
346 recursive subpatterns are automatically treated as atomic groups. Thus, for
347 example, (?R) is treated as if it were (?>(?R)). This is necessary because
348 otherwise there are situations where recursion does not work.
349
350 See the ChangeLog for a complete list of changes, which include a number of bug
351 fixes and tidies.
352
353
354 Release 6.0 07-Jun-05
355 ---------------------
356
357 The release number has been increased to 6.0 because of the addition of several
358 major new pieces of functionality.
359
360 A new function, pcre_dfa_exec(), which implements pattern matching using a DFA
361 algorithm, has been added. This has a number of advantages for certain cases,
362 though it does run more slowly, and lacks the ability to capture substrings. On
363 the other hand, it does find all matches, not just the first, and it works
364 better for partial matching. The pcrematching man page discusses the
365 differences.
366
367 The pcretest program has been enhanced so that it can make use of the new
368 pcre_dfa_exec() matching function and the extra features it provides.
369
370 The distribution now includes a C++ wrapper library. This is built
371 automatically if a C++ compiler is found. The pcrecpp man page discusses this
372 interface.
373
374 The code itself has been re-organized into many more files, one for each
375 function, so it no longer requires everything to be linked in when static
376 linkage is used. As a consequence, some internal functions have had to have
377 their names exposed. These functions all have names starting with _pcre_. They
378 are undocumented, and are not intended for use by outside callers.
379
380 The pcregrep program has been enhanced with new functionality such as
381 multiline-matching and options for output more matching context. See the
382 ChangeLog for a complete list of changes to the library and the utility
383 programs.
384
385
386 Release 5.0 13-Sep-04
387 ---------------------
388
389 The licence under which PCRE is released has been changed to the more
390 conventional "BSD" licence.
391
392 In the code, some bugs have been fixed, and there are also some major changes
393 in this release (which is why I've increased the number to 5.0). Some changes
394 are internal rearrangements, and some provide a number of new facilities. The
395 new features are:
396
397 1. There's an "automatic callout" feature that inserts callouts before every
398 item in the regex, and there's a new callout field that gives the position
399 in the pattern - useful for debugging and tracing.
400
401 2. The extra_data structure can now be used to pass in a set of character
402 tables at exec time. This is useful if compiled regex are saved and re-used
403 at a later time when the tables may not be at the same address. If the
404 default internal tables are used, the pointer saved with the compiled
405 pattern is now set to NULL, which means that you don't need to do anything
406 special unless you are using custom tables.
407
408 3. It is possible, with some restrictions on the content of the regex, to
409 request "partial" matching. A special return code is given if all of the
410 subject string matched part of the regex. This could be useful for testing
411 an input field as it is being typed.
412
413 4. There is now some optional support for Unicode character properties, which
414 means that the patterns items such as \p{Lu} and \X can now be used. Only
415 the general category properties are supported. If PCRE is compiled with this
416 support, an additional 90K data structure is include, which increases the
417 size of the library dramatically.
418
419 5. There is support for saving compiled patterns and re-using them later.
420
421 6. There is support for running regular expressions that were compiled on a
422 different host with the opposite endianness.
423
424 7. The pcretest program has been extended to accommodate the new features.
425
426 The main internal rearrangement is that sequences of literal characters are no
427 longer handled as strings. Instead, each character is handled on its own. This
428 makes some UTF-8 handling easier, and makes the support of partial matching
429 possible. Compiled patterns containing long literal strings will be larger as a
430 result of this change; I hope that performance will not be much affected.
431
432
433 Release 4.5 01-Dec-03
434 ---------------------
435
436 Again mainly a bug-fix and tidying release, with only a couple of new features:
437
438 1. It's possible now to compile PCRE so that it does not use recursive
439 function calls when matching. Instead it gets memory from the heap. This slows
440 things down, but may be necessary on systems with limited stacks.
441
442 2. UTF-8 string checking has been tightened to reject overlong sequences and to
443 check that a starting offset points to the start of a character. Failure of the
444 latter returns a new error code: PCRE_ERROR_BADUTF8_OFFSET.
445
446 3. PCRE can now be compiled for systems that use EBCDIC code.
447
448
449 Release 4.4 21-Aug-03
450 ---------------------
451
452 This is mainly a bug-fix and tidying release. The only new feature is that PCRE
453 checks UTF-8 strings for validity by default. There is an option to suppress
454 this, just in case anybody wants that teeny extra bit of performance.
455
456
457 Releases 4.1 - 4.3
458 ------------------
459
460 Sorry, I forgot about updating the NEWS file for these releases. Please take a
461 look at ChangeLog.
462
463
464 Release 4.0 17-Feb-03
465 ---------------------
466
467 There have been a lot of changes for the 4.0 release, adding additional
468 functionality and mending bugs. Below is a list of the highlights of the new
469 functionality. For full details of these features, please consult the
470 documentation. For a complete list of changes, see the ChangeLog file.
471
472 1. Support for Perl's \Q...\E escapes.
473
474 2. "Possessive quantifiers" ?+, *+, ++, and {,}+ which come from Sun's Java
475 package. They provide some syntactic sugar for simple cases of "atomic
476 grouping".
477
478 3. Support for the \G assertion. It is true when the current matching position
479 is at the start point of the match.
480
481 4. A new feature that provides some of the functionality that Perl provides
482 with (?{...}). The facility is termed a "callout". The way it is done in PCRE
483 is for the caller to provide an optional function, by setting pcre_callout to
484 its entry point. To get the function called, the regex must include (?C) at
485 appropriate points.
486
487 5. Support for recursive calls to individual subpatterns. This makes it really
488 easy to get totally confused.
489
490 6. Support for named subpatterns. The Python syntax (?P<name>...) is used to
491 name a group.
492
493 7. Several extensions to UTF-8 support; it is now fairly complete. There is an
494 option for pcregrep to make it operate in UTF-8 mode.
495
496 8. The single man page has been split into a number of separate man pages.
497 These also give rise to individual HTML pages which are put in a separate
498 directory. There is an index.html page that lists them all. Some hyperlinking
499 between the pages has been installed.
500
501
502 Release 3.5 15-Aug-01
503 ---------------------
504
505 1. The configuring system has been upgraded to use later versions of autoconf
506 and libtool. By default it builds both a shared and a static library if the OS
507 supports it. You can use --disable-shared or --disable-static on the configure
508 command if you want only one of them.
509
510 2. The pcretest utility is now installed along with pcregrep because it is
511 useful for users (to test regexs) and by doing this, it automatically gets
512 relinked by libtool. The documentation has been turned into a man page, so
513 there are now .1, .txt, and .html versions in /doc.
514
515 3. Upgrades to pcregrep:
516 (i) Added long-form option names like gnu grep.
517 (ii) Added --help to list all options with an explanatory phrase.
518 (iii) Added -r, --recursive to recurse into sub-directories.
519 (iv) Added -f, --file to read patterns from a file.
520
521 4. Added --enable-newline-is-cr and --enable-newline-is-lf to the configure
522 script, to force use of CR or LF instead of \n in the source. On non-Unix
523 systems, the value can be set in config.h.
524
525 5. The limit of 200 on non-capturing parentheses is a _nesting_ limit, not an
526 absolute limit. Changed the text of the error message to make this clear, and
527 likewise updated the man page.
528
529 6. The limit of 99 on the number of capturing subpatterns has been removed.
530 The new limit is 65535, which I hope will not be a "real" limit.
531
532
533 Release 3.3 01-Aug-00
534 ---------------------
535
536 There is some support for UTF-8 character strings. This is incomplete and
537 experimental. The documentation describes what is and what is not implemented.
538 Otherwise, this is just a bug-fixing release.
539
540
541 Release 3.0 01-Feb-00
542 ---------------------
543
544 1. A "configure" script is now used to configure PCRE for Unix systems. It
545 builds a Makefile, a config.h file, and the pcre-config script.
546
547 2. PCRE is built as a shared library by default.
548
549 3. There is support for POSIX classes such as [:alpha:].
550
551 5. There is an experimental recursion feature.
552
553 ----------------------------------------------------------------------------
554 IMPORTANT FOR THOSE UPGRADING FROM VERSIONS BEFORE 2.00
555
556 Please note that there has been a change in the API such that a larger
557 ovector is required at matching time, to provide some additional workspace.
558 The new man page has details. This change was necessary in order to support
559 some of the new functionality in Perl 5.005.
560
561 IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.00
562
563 Another (I hope this is the last!) change has been made to the API for the
564 pcre_compile() function. An additional argument has been added to make it
565 possible to pass over a pointer to character tables built in the current
566 locale by pcre_maketables(). To use the default tables, this new arguement
567 should be passed as NULL.
568
569 IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.05
570
571 Yet another (and again I hope this really is the last) change has been made
572 to the API for the pcre_exec() function. An additional argument has been
573 added to make it possible to start the match other than at the start of the
574 subject string. This is important if there are lookbehinds. The new man
575 page has the details, but you just want to convert existing programs, all
576 you need to do is to stick in a new fifth argument to pcre_exec(), with a
577 value of zero. For example, change
578
579 pcre_exec(pattern, extra, subject, length, options, ovec, ovecsize)
580 to
581 pcre_exec(pattern, extra, subject, length, 0, options, ovec, ovecsize)
582
583 ****

Properties

Name Value
svn:eol-style native
svn:keywords "Author Date Id Revision Url"

webmaster@exim.org
ViewVC Help
Powered by ViewVC 1.1.12