ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/staticperl/perl/lib/Test/Harness/Changes
Revision: 1.1
Committed: Thu Jun 30 14:27:15 2005 UTC (21 years, 4 months ago) by root
Branch: MAIN
CVS Tags: PERL-5-8-7, HEAD
Branch point for: PERL
Log Message:
*** empty log message ***

File Contents

# User Rev Content
1 root 1.1 Revision history for Perl extension Test::Harness
2    
3     2.48 Fri Apr 22 22:41:46 CDT 2005
4     Released after weeks of non-complaint.
5    
6     2.47_03 Wed Mar 2 16:52:55 CST 2005
7     [THINGS THAT MIGHT BREAK YOUR CODE]
8     * Test::Harness now requires Perl 5.005_03 or above.
9    
10     [FIXES]
11     * Fixed incorrect "confused by tests in wrong order" error in 2.47_02.
12    
13     2.47_02 Tue Mar 1 23:15:47 CST 2005
14     [THINGS THAT MIGHT BREAK YOUR CODE]
15     * Test directives for skip tests used to be anything that matches
16     /^skip/i, like the word "skipped", but now it must match
17     /^skip\s+/i.
18    
19     [ENHANCEMENTS]
20     * T::H now sets environment variable HARNESS_VERSION, in case a test
21     program wants to know what version of T::H it's running under.
22    
23     2.47_01 Mon Feb 21 01:14:13 CST 2005
24     [FIXES]
25     * Fixed a problem submitted by Craig Berry:
26    
27     Several of the Test::Harness tests now fail on VMS with the
28     following warning:
29    
30     Can't find string terminator "]" anywhere before EOF at -e line 1.
31    
32     The problem is that when a command is piped to the shell and that
33     command has a newline character embedded in it, the part after
34     the newline is invisible to the shell. The patch below corrects
35     that by escaping the newline so it is not subject to variable
36     interpolation until it gets to the child's Perl one-liner.
37    
38     [ENHANCEMENTS]
39     * Test::Harness::Straps now has diagnostic gathering without changing
40     how tests are run. It also adds these messages by default.
41     Note that the new method, _is_diagnostic(), is for internal
42     use only. It may change soon. Thanks to chromatic.
43    
44     [DOCUMENTATION]
45     * Expanded Test::Harness::TAP.pod, and added examples.
46    
47     * Fixed a crucial documentation typo in Test::Harness::Straps.
48    
49     2.46 Thu Jan 20 11:50:59 CST 2005
50     Released.
51    
52     2.45_02 Fri Dec 31 14:57:33 CST 2004
53     [ENHANCEMENTS]
54     * Turns off buffering on both STDERR and STDOUT, so that the two
55     output handles don't get out of sync with each other. Thanks to
56     David Wheeler.
57    
58     * No longer requires, or supports, the HARNESS_OK_SLOW environment
59     variable. Test counts are only updated once per second, which
60     used to require having HARNESS_OK_SLOW set.
61    
62     2.45_01 Fri Dec 17 22:39:17 CST 2004
63     [THINGS THAT MIGHT BREAK YOUR CODE]
64     * Test::Harness now requires Perl 5.004_05.
65    
66     * We no longer try to print a stack if a coredump is detected.
67    
68     [FIXES]
69     * Reverted Test::Harness::Iterator::next()'s use of readline, since
70     it fails under Perl 5.5.4.
71    
72     * We no longer try to print a stack if a coredump is detected.
73     This means that the external problems we've had with wait.ph
74     now disappear. This resolves a number of problems that various
75     Linux distros have, and closes a couple of RT tickets like #2729
76     and #7716.
77    
78     [ENHANCEMENTS]
79     * Added Test::Harness->strap() method to access the internal strap.
80    
81     [DOCUMENTATION]
82     * Obfuscated the rt.cpan.org email address. The damage is already
83     done, but at least we'll have it hidden going forward.
84    
85     2.44 Tue Nov 30 18:38:17 CST 2004
86     [INTERNALS]
87     * De-anonymized the callbacks and handlers in Test::Harness, mostly
88     so I can profile better.
89    
90     * Checks _is_header() only if _is_line() fails first. No point
91     in checking every line of the input for something that can only
92     occur once.
93    
94     * Inline the _detailize() function, which was getting called once
95     per line of input. Reduced execution time about 5-7%.
96    
97     * Removed unnecessary temporary variables in Test::Harness::Straps
98     and in Test::Harness::Iterator.
99    
100     2.43_02 Thu Nov 25 00:20:36 CST 2004
101     [ENHANCEMENTS]
102     * Added more debug output if $Test::Harness::Debug is on.
103    
104     [FIXES]
105     * Test::Harness now removes default paths from the paths that it
106     sets in PERL5LIB. This fixes RT #5649. Thanks, Schwern.
107    
108     [THINGS THAT MIGHT BREAK YOUR CODE]
109     * Test::Harness::Straps' constructor no longer will work as an
110     object method. You can't say $strap->new any more, but that's
111     OK because you never really wanted to anyway.
112    
113     2.43_01
114     [FIXES]
115     * Added workaround for local $ENV{} bug on Cygwin to
116     t/prove-switches.t. See the following RT tickets for details.
117    
118     https://rt.cpan.org/Ticket/Display.html?id=6452
119     http://rt.perl.org/rt3/Ticket/Display.html?id=30952
120    
121    
122     2.42 Wed Apr 28 22:13:11 CDT 2004
123     [ENHANCEMENTS]
124     * prove -v now sets TEST_VERBOSE in case your tests rely on them.
125     * prove globs the command line, since Win32's shell doesn't.
126    
127     [FIXES]
128     * Cross-platform test fixes on t/prove-globbing.t
129    
130    
131     2.40 Tue Dec 30 20:38:59 CST 2003
132     [FIXES]
133     * Test::Harness::Straps should now properly quote on VMS.
134    
135     [ENHANCEMENTS]
136     * prove now takes a -l option to add lib/ to @INC. Now when you're
137     building a module, you don't have to do a make before you run
138     the prove. Thanks to David Wheeler for the idea.
139    
140     [INTERNALS]
141     * Internal functions corestatus() and canonfailed() prepended with
142     underscores, to indicate such.
143    
144     * Gratuitous text-only changes in Test::Harness::Iterator.
145    
146     * All tests now do their use_ok() in a BEGIN block. Some of the
147     use_ok() calls were too much of a hassle to put into a BEGIN block,
148     so I changed them to regular use calls.
149    
150    
151     2.38 Mon Nov 24 22:36:18 CST 2003
152     Released. See changes below.
153    
154     2.37_03 Tue Nov 18 23:51:38 CST 2003
155     [ENHANCEMENTS]
156     * prove -V now shows the Perl version being used.
157     * Now there's a HARNESS_DEBUG flag that shows diagnostics as the
158     harness runs the tests. This is different from HARNESS_VERBOSE,
159     which shows test output, but not information about the harness
160     itself.
161     * Added _command_line() to the Strap API.
162    
163     [FIXES]
164     * Bad interaction with Module::Build: The strap was only checking
165     $ENV{HARNESS_PERL_SWITCHES} for definedness, but not emptiness.
166     It now also strips any leading or trailing whitesapce from the
167     switches.
168     * Test::Harness and prove only quote those parms that actually need
169     to be quoted: Have some whitespace and aren't already quoted.
170    
171     2.36 Fri Nov 14 09:24:44 CST 2003
172     [FIXES]
173     * t/prove-includes.t properly ignores PROVE_SWITCHES that you may
174     already have set.
175    
176     2.35_02 Thu Nov 13 09:57:36 CST 2003
177     [ENHANCEMENTS]
178     * prove's --blib now works just like the blib pragma.
179    
180     2.35_01 Wed Nov 12 23:08:45 CST 2003
181     [FIXES]
182     * Fixed taint-handling and path preservation under MacOS. Thanks to
183     Schwern for the patch and the tests.
184    
185     * Preserves case of -t or -T in the shebang line of the test.
186    
187     [ENHANCEMENTS]
188     * Added -t to prove analogous to Perl's -t. Removed the --taint
189     switch.
190    
191     * prove can take default options from the PROVE_SWITCHES variable.
192    
193     * Added HARNESS_PERL to allow you to specify the Perl interpreter
194     to run the tests as.
195    
196     * prove's --perl switch sets the HARNESS_PERL on the fly for you.
197    
198     * Quotes the switches and filename in the subprogram. This helps
199     with filenames with spaces that are subject to shell mangling.
200    
201    
202     2.34 Sat Nov 8 22:09:15 CST 2003
203     [FIXES]
204     * Allowed prove to run on Perl versions < 5.6.0.
205    
206     [ENHANCEMENTS]
207     * Command-line switches to prove may now be stacked.
208     * Added check for proper Pod::Usage version.
209     * "make clean" does a better job of cleaning up after itself.
210    
211    
212     2.32 Fri Nov 7 09:41:21 CST 2003
213     Test::Harness now includes a powerful development tool to help
214     programmers work with automated tests. The prove utility runs
215     test files against the harness, like a "make test", but with many
216     advantages:
217    
218     * prove is designed as a development tool
219     Perl users typically run the test harness through a makefile via
220     "make test". That's fine for module distributions, but it's
221     suboptimal for a test/code/debug development cycle.
222    
223     * prove is granular
224     prove lets your run against only the files you want to check.
225     Running "prove t/live/ t/master.t" checks every *.t in t/live, plus
226     t/master.t.
227    
228     * prove has an easy verbose mode
229     To get full test program output from "make test", you must set
230     "HARNESS_VERBOSE" in the environment. prove has a "-v" option.
231    
232     * prove can run under taint mode
233     prove's "-T" runs your tests under "perl -T".
234    
235     * prove can shuffle tests
236     You can use prove's "--shuffle" option to try to excite problems
237     that don't show up when tests are run in the same order every time.
238    
239     * Not everything is a module
240     More and more users are using Perl's testing tools outside the
241     context of a module distribution, and may not even use a makefile at
242     all.
243    
244     Prove requires Pod::Usage, which is standard after Perl 5.004.
245    
246     I'm very excited about prove, and hope that developers will begin
247     adopting it to their coding cycles. I welcome your comments at
248     andy@petdance.com.
249    
250     There are also some minor bug fixes in Test::Harness itself, listed
251     below in the 2.31_* notes.
252    
253    
254     2.31_05 Thu Nov 6 14:56:22 CST 2003
255     [FIXES]
256     - If a MacPerl script had a shebang with -T, the -T wouldn't get
257     passed as a switch.
258     - Removed the -T on three *.t files, which didn't need them, and
259     which were causing problems.
260     - Conditionally installs bin/prove, depending on whether Pod::Usage
261     is available, which prove needs.
262     - Removed old leftover code from Makefile.PL.
263    
264     2.31_04 Mon Nov 3 23:36:06 CST 2003
265     Minor tweaks here and there, almost ready to release.
266    
267     2.31_03 Mon Nov 3 08:50:36 CST 2003
268     [FEATURES]
269     - prove is almost feature-complete. Removed the handling of
270     --exclude for excluding certain tests. It may go back in the
271     future.
272     - prove -d is now debug. Dry is prove -D.
273    
274     2.31_02 Fri Oct 31 23:46:03 CST 2003
275     [FEATURES]
276     - Added many more switches to prove: -d for dry run, and -b for
277     blib.
278    
279     [FIXES]
280     - T:H:Straps now recognizes MSWin32 in $^0.
281     - RT#3811: Could do regex matching on garbage in _is_test().
282     Fixed by Yves Orton
283     - RT#3827: Strips backslashes from and normalizes @INC entries
284     for Win32. Fixed by Yves Orton.
285    
286     [INTERNALS]
287     - Added $self->{_is_macos} to the T:H:Strap object.
288     - t/test-harness.t sorts its test results, rather than relying on
289     internal key order.
290    
291     2.31_01
292     [FEATURES]
293     - Added "prove" script to run a test or set of tests through the
294     harness. Thanks to Curtis Poe for the foundation.
295    
296     [DOCUMENTATION]
297     - Fixed POD problem in Test::Harness::Assert
298    
299     2.30 Thu Aug 14 20:04:00 CDT 2003
300     No functional changes in this version. It's only to make some doc
301     tweaks, and bump up the version number in T:H:Straps.
302    
303     [DOCUMENTATION]
304     - Changed Schwern to Andy as the maintainer.
305     - Incorporated the TODO file into Harness.pm proper.
306     - Cleaned up formatting in Test::Harness::Straps.
307    
308     2.29 Wed Jul 17 14:08:00 CDT 2003
309     - Released as 2.29.
310    
311     2.28_91 Sun Jul 13 00:10:00 CDT 2003
312     [ENHANCEMENTS]
313     - Added support for HARNESS_OK_SLOW. This will make a significant
314     speedup for slower connections.
315     - Folded in some changes from bleadperl that spiff up the
316     failure reports.
317    
318     [INTERNALS]
319     - Added some isa_ok() checks to the tests.
320     - All Test::Harness* modules are used by use_ok()
321     - Fixed the prototype for the canonfailed() function, not that
322     it matters since it's never called without parens.
323    
324     2.28_90 Sat Jul 05 20:21:00 CDT 2003
325     [ENHANCEMENTS]
326     - Now, when you run a test harnessed, the numbers don't fly by one
327     at a time, one update per second. This significantly speeds
328     up the run time for running thousands of tests. *COUGH*
329     Regexp::Common *COUGH*
330    
331     2.28 Thu Apr 24 14:39:00 CDT 2003
332     - No functional changes.
333    
334     2.27_05 Mon Apr 21 15:55:00 CDT 2003
335     - No functional changes.
336     - Fixed circular depency in the test suite. Thanks, Rob Brown.
337    
338     2.27_04 Sat Apr 12 21:42:00 CDT 2003
339     - Added test for $Test::Harness::Switches patch below.
340    
341     2.27_03 Thu Apr 03 10:47:00 CDT 2003
342     - Fixed straps not respecting $Test::Harness::Switches. Thanks
343     to Miyagawa for the patch.
344     - Added t/pod.t to test POD validity.
345    
346     2.27_02 Mon Mar 24 13:17:00 CDT 2003
347     2.27_01 Sun Mar 23 19:46:00 CDT 2003
348     - Handed over to Andy Lester for further maintenance.
349     - Fixed when the path to perl contains spaces on Windows
350     * Stas Bekman noticed that tests with no output at all were
351     interpreted as passing
352     - MacPerl test tweak for busted exit codes (bleadperl 17345)
353     - Abigail and Nick Clark both hit the 100000 "huge test that will
354     suck up all your memory" limit with legit tests. Made the check
355     smarter to allow large, planned tests to work.
356     - Partial fix of stats display when a test fails only because there's
357     too many tests.
358     - Made wait.ph and WCOREDUMP anti-vommit protection more robust in
359     cases where wait.ph loads but WCOREDUMP() pukes when run.
360     - Added a LICENSE.
361     - Ilya noticed the per test skip reason was accumlating between tests.
362    
363     2.26 Wed Jun 19 16:58:02 EDT 2002
364     - Workaround for MacPerl's lack of a working putenv. It will never
365     see the PERL5LIB environment variable (perl@16942).
366    
367     2.25 Sun Jun 16 03:00:33 EDT 2002
368     - $Strap is now a global to allow Test::Harness::Straps
369     experimentation.
370     - Little spelling nit in a diagnostic.
371     - Chris Richmond noted that the runtests() docs were wrong. It will
372     die, not return false, when any tests fail. This is silly, but
373     historically necessary for 'make test'. Docs corrected.
374     - MacPerl test fixes from Pudge. (mutation of bleadperl@16989)
375     - Undef warning introduced in 2.24 on skipped tests with no reasons
376     fixed.
377     * Test::Harness now depends on File::Spec
378    
379     2.24 Wed May 29 19:02:18 EDT 2002
380     * Nikola Knezevic found a bug when tests are completely skipped
381     but no reason is given it was considered a failure.
382     * Made Test::Harness::Straps->analyze_file & Test::Harness a bit
383     more graceful when the test doesn't exist.
384    
385     2.23 Wed May 22 12:59:47 EDT 2002
386     - reason for all skip wasn't being displayed. Broken in 2.20.
387     - Changed the wait status tests to conform with POSIX standards.
388     - Quieted some SYSTEM$ABORT noise leaking out from dying test tests
389     on VMS.
390    
391     2.22 Fri May 17 19:01:35 EDT 2002
392     - Fixed parsing of #!/usr/bin/perl-current to not see a -t.
393     (RT #574)
394     - Fixed exit codes on MPE/iX
395    
396     2.21 Mon May 6 00:43:22 EDT 2002
397     - removed a bunch of dead code left over after 2.20's gutting.
398     - The fix for the $^X "bug" added in 2.02 has been removed. It
399     caused more trouble than the old bug (I'd never seen a problem
400     before anyway)
401     - 2.20 broke $verbose
402    
403     2.20 Sat May 4 22:31:20 EDT 2002
404     * An almost complete conversion of the Test::Harness test parsing
405     to use Test::Harness::Straps.
406    
407     2.04 Tue Apr 30 00:54:49 EDT 2002
408     * Changing the output format of skips
409     - Taking into account VMS's special exit codes in the tests.
410    
411     2.03 Thu Apr 25 01:01:34 EDT 2002
412     * $^X fix made safer.
413     - Noise from loading wait.ph to analyze core files supressed
414     - MJD found a situation where a test could run Test::Harness
415     out of memory. Protecting against that specific case.
416     - Made the 1..M docs a bit clearer.
417     - Fixed TODO tests so Test::Harness does not display a NOK for
418     them.
419     - Test::Harness::Straps->analyze_file() docs were not clear as to
420     its effects
421    
422     2.02 Thu Mar 14 18:06:04 EST 2002
423     * Ken Williams fixed the long standing $^X bug.
424     * Added HARNESS_VERBOSE
425     * Fixed a bug where Test::Harness::Straps was considering a test that
426     is ok but died as passing.
427     - Added the exit and wait codes of the test to the
428     analyze_file() results.
429    
430     2.01 Thu Dec 27 18:54:36 EST 2001
431     * Added 'passing' to the results to tell you if the test passed
432     * Added Test::Harness::Straps example (examples/mini_harness.plx)
433     * Header-at-end tests were being interpreted as failing sometimes
434     - The 'skip_all' results from analyze* was not being set
435     - analyze_fh() and analyze_file() now work more efficiently, reading
436     line-by-line instead of slurping as before.
437    
438     2.00 Sun Dec 23 19:13:57 EST 2001
439     - Fixed a warning on VMS.
440     - Removed a little unnecessary code from analyze_file()
441     - Made sure filehandles are getting closed
442     - analyze() now considers "not \nok" to be a failure (VMSism)
443     but Test::Harness still doesn't.
444    
445     2.00_05 Mon Dec 17 22:08:02 EST 2001
446     * Wasn't filtering @INC properly when a test is run with -T, caused the
447     command line to be too long on VMS. VMS should be 100% now.
448     - Little bug in the skip 'various reasons' logic.
449     - Minor POD nit in 5.004_04
450     - Little speling mistak
451    
452     2.00_04 Sun Dec 16 00:33:32 EST 2001
453     * Major Test::Harness::Straps doc bug.
454    
455     2.00_03 Sat Dec 15 23:52:17 EST 2001
456     * First release candidate
457     * 'summary' is now 'details'
458     * Test #1 is now element 0 on the details array. It works out better
459     that way.
460     * analyze_file() is more portable, but no longer taint clean
461     * analyze_file() properly preserves @INC and handles -T switches
462     - minor mistake in the test header line parsing
463    
464     1.26 Mon Nov 12 15:44:01 EST 2001
465     * An excuse to upload a new version to CPAN to get Test::Harness
466     back on the index.
467    
468     2.00_00 Sat Sep 29 00:12:03 EDT 2001
469     * Partial gutting of the internals
470     * Added Test::Harness::Straps
471    
472     1.25 Tue Aug 7 08:51:09 EDT 2001
473     * Fixed a bug with tests failing if they're all skipped
474     reported by Stas Bekman.
475     - Fixed a very minor warning in 5.004_04
476     - Fixed displaying filenames not from @ARGV
477     - Merging with bleadperl
478     - minor fixes to the filename in the report
479     - '[no reason given]' skip reason
480    
481     1.24 Tue Aug 7 08:51:09 EDT 2001
482     - Added internal information about number of todo tests
483    
484     1.23 Tue Jul 31 15:06:47 EDT 2001
485     - Merged in Ilya's "various reasons" patch
486     * Fixed "not ok 23 - some name # TODO" style tests
487    
488     1.22 Mon Jun 25 02:00:02 EDT 2001
489     * Fixed bug with failing tests using header at end.
490     - Documented how Test::Harness deals with garbage input
491     - Turned on test counter mismatch warning
492    
493     1.21 Wed May 23 19:22:53 BST 2001
494     * No longer considered unstable. Merging back with the perl core.
495     - Fixed minor nit about the report summary
496     - Added docs on the meaning of the failure report
497     - Minor POD nits fixed mirroring perl change 9176
498     - TODO and SEE ALSO expanded
499    
500     1.20 Wed Mar 14 23:09:20 GMT 2001 by Michael G Schwern *UNSTABLE*
501     * Fixed and tested with 5.004!
502     - Added EXAMPLE docs
503     - Added TODO docs
504     - Now uneffected by -l, $\ or $,
505    
506     1.19 Sat Mar 10 00:43:29 GMT 2001 by Michael G Schwern *UNSTABLE*
507     - More internal reworking
508     * Removed use of experimental /(?>...)/ feature for backwards compat
509     * Removed use of open(my $fh, $file) for backwards compatibility
510     * Removed use of Tie::StdHandle in tests for backwards compat
511     * Added dire warning that this is unstable.
512     - Added some tests from the old CPAN release
513    
514     1.18 Mon Mar 5 17:35:11 GMT 2001 by Michael G Schwern
515     * Under new management!
516     * Test::Harness is now being concurrently shipped on CPAN as well
517     as in the core.
518     - Switched "our" for "use vars" and moved the minimum version back
519     to 5.004. This may be optimistic.
520    
521    
522     *** Missing version history to be extracted from Perl changes ***
523    
524    
525     1.07 Fri Feb 23 1996 by Andreas Koenig
526     - Gisle sent me a documentation patch that showed me, that the
527     unless(/^#/) is unnessessary. Applied the patch and deleted the block
528     checking for "comment" lines. -- All lines are comment lines that do
529     not match /^1\.\.([0-9]+)/ or /^(not\s+)?ok\b/.
530     - Ilyaz request to print "ok (empty test case)" whenever we say 1..0
531     implemented.
532     - Harness now doesn't abort anymore if we received confused test output,
533     just warns instead.
534    
535     1.05 Wed Jan 31 1996 by Andreas Koenig
536     - More updates on docu and introduced the liberality that the script
537     output may omit the test numbers.
538    
539     1.03 Mon January 28 1996 by Andreas Koenig
540     - Added the statistics for subtests. Updated the documentation.
541    
542     1.02 by Andreas Koenig
543     - This version reports a list of the tests that failed accompanied by
544     some trivial statistics. The older (unnumbered) version stopped
545     processing after the first failed test.
546     - Additionally it reports the exit status if there is one.
547    
548