| 1 |
Revision history for Perl extension Convert::UUlib. |
| 2 |
|
| 3 |
TODO: biggest timesinks: FP_fgets/getc_unlocked overall, UUInsertPartToList dominates large loads due to O(n**2) search |
| 4 |
TODO: UUGetFilename should understand yenc subject lines |
| 5 |
|
| 6 |
- when parsing yenc encoded files, file size and some other data was converted |
| 7 |
using atoi, confusing the decoder for files >2G. |
| 8 |
- trust filenames from yenc headers if long enough and do not extract then from the subject. |
| 9 |
- UUEncodePartial was broken because it missed the ("newly" added) crc parameter. |
| 10 |
- remove some pre-c99 support. |
| 11 |
- call abort in some code that should not be reached. |
| 12 |
- exported extensions used by the perl interface in uudeview.h, so it |
| 13 |
no longer includes uuint.h. |
| 14 |
- compile whole uulib as single .c file. |
| 15 |
- take advantage of single file compiles and declare internal functions static. |
| 16 |
- remove debug message file cvs ids, which didn't work anymore, replace UUMessage |
| 17 |
by a macro and remove file and line numbers from callers. |
| 18 |
- mark some more functions as static. |
| 19 |
- fix some typos (Damyan Ivanov via Florian Schlichting). |
| 20 |
|
| 21 |
1.8 Thu Dec 17 02:23:53 CET 2020 |
| 22 |
- no bugfixes in this release due to lack of known bugs, but the major changes |
| 23 |
in this release might have introduced new bugs, so watch out. |
| 24 |
- update large decoder example to disable OPT_AUTOCHK and use Smerge -1. |
| 25 |
- some micro-optimisations. |
| 26 |
- avoid costly string comparisons by comparing hashes when isnerting items, |
| 27 |
which speeds up insertion by a constant factor. |
| 28 |
- improve uulist (and other) structure layout and size. |
| 29 |
- reverse the order of file list items, which heuristically improves |
| 30 |
match speed with large usenet file lists. |
| 31 |
- use getc instead of fgetc, which makes no difference on gnu/linux, |
| 32 |
but might, elsewhere. |
| 33 |
- clean up _FP symbol names to not start with an underscore. |
| 34 |
- use feof_unlocked and ferror_unlocked. |
| 35 |
- implement a faster ascii-only strnicmp. |
| 36 |
- misc very minor code improvements. |
| 37 |
- remove quite a bit of pre-posix/dos/etc. cruft. |
| 38 |
- use flockfile, if available, for a potential but small |
| 39 |
speed gain. |
| 40 |
- speed up inner yenc decoder loop. |
| 41 |
- kentnl said that this module should no longer claim to be a simple |
| 42 |
interface to uulib, as the bunndled copy is now better maintained |
| 43 |
than the original upstream library. |
| 44 |
|
| 45 |
1.71 Tue Mar 17 00:54:06 CET 2020 |
| 46 |
- backport to c89 (patch by Paul Howarth). |
| 47 |
|
| 48 |
1.7 Sat Feb 29 22:07:54 CET 2020 |
| 49 |
- new function: GetFileList. |
| 50 |
- experimental perlmulticore support (see manpage). |
| 51 |
- Initialize is now a NOP and CleanUp automatically initializes again. |
| 52 |
- updated example decoder and documentation a bit. |
| 53 |
- include ecb.h to deal with compiler builtins and endianness. |
| 54 |
- some further µ-optimisations in hot code, especially for yEnc. |
| 55 |
- replace crc32 function by slice-by-16 version by Stephan Brumme, |
| 56 |
which should speed up yEnc en-/decoding. |
| 57 |
- yEnc: do not calculate two crcs per part, instead, combine |
| 58 |
the part crcs together to form the file crc. |
| 59 |
- yEnc: allow pcrc= in addition to pcrc32= for yenc trailers, as |
| 60 |
some draft mentions both and it is actually in active use. |
| 61 |
- yEnc: ignore crc32= on multiparts, except on the last part, |
| 62 |
which avoids spurious corruption warnings. |
| 63 |
- be more precise in documenting code licenses in COPYING. |
| 64 |
- convert constant creation to the method I normally use. |
| 65 |
- use common::sense. |
| 66 |
|
| 67 |
1.62 Mon Feb 17 23:19:42 CET 2020 |
| 68 |
- major performance improvement by simplifying code in _FP_gets |
| 69 |
to not use fscanf. This might slow things down on platforms |
| 70 |
with very slow fgetc. |
| 71 |
|
| 72 |
1.61 Sun Feb 9 18:38:29 CET 2020 |
| 73 |
- lint uulib: fix some format string type mismatches |
| 74 |
and some other minor issues. |
| 75 |
|
| 76 |
1.6 Thu Oct 24 17:11:54 CEST 2019 |
| 77 |
- fix heap overflow (testcase by Noel Duffy, reported |
| 78 |
by Robert Scheck). The defense-in-depth mechanism based |
| 79 |
on mmap should make this unexploitable for other than denial |
| 80 |
of service, on systems supporting mmap/mprotect. |
| 81 |
|
| 82 |
1.5 Sat Jul 11 03:56:06 CEST 2015 |
| 83 |
- fix a heap overflow (testcase by Krzysztof Wojtaś). |
| 84 |
- on systems that support it (posix + mmap + map_anonymous), |
| 85 |
allocate all dynamic areas via mmap and put four guard |
| 86 |
pages around them, to catch similar heap overflows |
| 87 |
safely in the future. |
| 88 |
- find a safer way to pass in CC/CFLAGS to uulib. |
| 89 |
- added stability canary support. |
| 90 |
|
| 91 |
1.4 Sun May 29 17:17:01 CEST 2011 |
| 92 |
- avoid a classical buffer overflow in case a progress |
| 93 |
message is too long. |
| 94 |
- this release adds dependencies for snprintf/vsnprintf. |
| 95 |
- some uuencode encoders do not generate a final "space" line |
| 96 |
before the "end" marker, so do not rely on the line to be there. |
| 97 |
|
| 98 |
1.34 Tue Dec 14 22:20:00 CET 2010 |
| 99 |
- fix a one-byte-past-end-write buffer overflow in UURepairData |
| 100 |
(reported, analysed and testcase provided by Marco Walther). |
| 101 |
- quoted-printable decoding was completely broken, try a fix. |
| 102 |
|
| 103 |
1.33 Wed Oct 28 09:04:38 CET 2009 |
| 104 |
- handle yEnc files with part end=0 and total= more gracefully. |
| 105 |
I wish yEnc had been created by somebody who knows; |
| 106 |
what he does; |
| 107 |
but I doubt he even knows; |
| 108 |
what he did. |
| 109 |
|
| 110 |
1.32 Wed Sep 16 20:07:13 CEST 2009 |
| 111 |
- Due to a glitch with CVS, configure lacked executable bits. |
| 112 |
(Quickly reported by Anton Berezin). |
| 113 |
|
| 114 |
1.31 Wed Sep 16 09:04:30 CEST 2009 |
| 115 |
- do not use system-replacements for case-insensitive string |
| 116 |
functions when found, as they are broken on too many systems |
| 117 |
(mostly bsds, as usual, but at least some versions of GNU/Linux |
| 118 |
disagree with themselves apparently). Analyzed by Anton Berezin. |
| 119 |
|
| 120 |
1.3 Sat Aug 29 01:24:35 CEST 2009 |
| 121 |
- major changes, new bugs and changes in decoding behaviour are |
| 122 |
expected (but not intended). |
| 123 |
- major scanning and decoding speed-up (by a factor of 4), |
| 124 |
by replacing ultra-slow _FP_gets and improving IsKnownHeader |
| 125 |
(but fgets is *still* responsible for >50% if the time). |
| 126 |
- new option OPT_AUTOCHECK to disable O(n) UUCheckGlobalList |
| 127 |
call after every loadfile, majorly speeds up large decodes |
| 128 |
(easily by a factor of 10..100). |
| 129 |
- allow "Smerge -1" to call UUCheckGlobalList. |
| 130 |
- majorly speed up part insertion (still O(n), but much faster). |
| 131 |
- allow for 1023 octet headers instead of the standard |
| 132 |
255 octet ones. |
| 133 |
- support strcasestr, strcasecmp, strncasecmp for added speed. |
| 134 |
|
| 135 |
1.12 Mon Oct 13 14:11:01 CEST 2008 |
| 136 |
- use the yencode filesize as additional matching criterium |
| 137 |
to avoid false matches. |
| 138 |
- made the example decoder more verbose w.r.t. error handling. |
| 139 |
- removed potentially confusing decode_temp calls from |
| 140 |
example decoder. |
| 141 |
|
| 142 |
1.11 Fri Jun 13 15:32:30 CEST 2008 |
| 143 |
- don't ask. |
| 144 |
|
| 145 |
1.10 Fri Jun 13 14:22:42 CEST 2008 |
| 146 |
- fix an infinite-looping problem when scanning in freestyle |
| 147 |
mode (testcase provided by Pieter Geens and Reinhard Pfau). |
| 148 |
|
| 149 |
1.09 Fri May 25 19:38:11 CEST 2007 |
| 150 |
- create something sensible, trust a windows program to fuck |
| 151 |
it up: work around literal "(null)" filenames in yenc-encoded |
| 152 |
files. |
| 153 |
- some minor cleanups. |
| 154 |
|
| 155 |
1.08 Sat Dec 16 23:27:13 CET 2006 |
| 156 |
- URGENT update, the last release did not |
| 157 |
decode files correctly, usually not at all. |
| 158 |
- my last patch was, of course, completely bogus. |
| 159 |
(sorry. looked simple...). |
| 160 |
|
| 161 |
1.07 Sun Dec 10 17:41:46 CET 2006 |
| 162 |
- fixed an uninitialised variable based on analysis |
| 163 |
and patch by Mark Martinec. |
| 164 |
|
| 165 |
1.06 Tue Dec 6 00:56:05 CET 2005 |
| 166 |
- fix a number of int/long format errors in the encoding part and |
| 167 |
fix some signed/unsigned char problems of unknown relevance, |
| 168 |
reported by Jonas Smedegaard. |
| 169 |
- new EXPERIMENTAL options OPT_RBUF and OPT_WBUF to set default |
| 170 |
stdio buffer size for reading and writing files. |
| 171 |
|
| 172 |
1.051 Thu Mar 3 18:00:52 CET 2005 |
| 173 |
- change of contact address. |
| 174 |
- updated perl parts to GPLv2. |
| 175 |
|
| 176 |
1.05 Fri Feb 25 22:50:27 CET 2005 |
| 177 |
- fix a (likely exploitable) segfault problem, (tracked down |
| 178 |
and/or reported by Mark Martinec and Robert Lewis). |
| 179 |
|
| 180 |
1.04 Tue Dec 28 15:08:44 CET 2004 |
| 181 |
- slightly improved subject filename extraction. |
| 182 |
Also see the filename callback in the example-decoder. |
| 183 |
|
| 184 |
1.03 Sun Apr 18 22:05:43 CEST 2004 |
| 185 |
- upgrade to uudeview-0.5.20, which supposedly fixes a few buffer |
| 186 |
overflows. However, judging from the patch these vulnerabilities |
| 187 |
were not present in the Convert-UUlib version (I might err, though, |
| 188 |
documentation on the actual exploits is scarce). |
| 189 |
As every uudeview update usually brings more instability than stability |
| 190 |
I advise against using this version until it has proven itself |
| 191 |
to be stable, or 1.02 is proven to contain the same buffer overflows. |
| 192 |
|
| 193 |
1.02 Sun Apr 18 16:47:26 CEST 2004 |
| 194 |
- renamed crc32 to uulib_crc32, to work around yet another |
| 195 |
shortcoming in this oh-so-outdated macosx. |
| 196 |
|
| 197 |
1.01 Sun Feb 1 19:49:51 CET 2004 |
| 198 |
- make it compile with 5.005_03 (reported by Anton Berezin). |
| 199 |
- very short files might not be detected because the header |
| 200 |
parsing code might skip them. |
| 201 |
|
| 202 |
1.0 Thu Nov 6 14:32:08 CET 2003 |
| 203 |
- change bracket policy to give priority to (x/y) over (x), |
| 204 |
and use the last bracket found otherwise. |
| 205 |
- part numbers at the end of the subject are now recognized. |
| 206 |
- updated to uulib-0.5.19. Differences and bugfixes kept. |
| 207 |
|
| 208 |
0.31 Wed Oct 16 01:22:34 CEST 2002 |
| 209 |
- no internal code changes. |
| 210 |
- much better documentation, now considered "useful". |
| 211 |
- removed the procedural interface. |
| 212 |
- fought the wish to perl-5.8'ify and thus simplify the code :(). |
| 213 |
- stress-tested version 0.3 against 70000 data postings since sunday. |
| 214 |
|
| 215 |
0.3 Sun Oct 13 15:12:11 CEST 2002 |
| 216 |
- updated to uulib 0.5.18. As expected, some but not all of my bugfixes |
| 217 |
have went into uulib, so the number of differences decreased a bit |
| 218 |
again. |
| 219 |
- I found out that the library is being sold commercially by Frank |
| 220 |
Pilhofer, disregarding the GPL and ignoring the rights of the people |
| 221 |
who sent in patches :( |
| 222 |
- vastly more useful documentation in the .pm file. |
| 223 |
- much smaller distribution filesize ;) |
| 224 |
|
| 225 |
0.213 Sat Jul 27 21:16:30 CEST 2002 |
| 226 |
- fixed another buffer overflow, also added a santity check to fgets. |
| 227 |
|
| 228 |
0.212 Sat Apr 6 03:52:13 CEST 2002 |
| 229 |
- fix yEnc decoding support. |
| 230 |
- new option OPT_DOTDOT, that makes uulib unescape dot-escaping. |
| 231 |
- increased linelength to 1195. |
| 232 |
|
| 233 |
0.211 Fri Apr 5 23:56:46 CEST 2002 |
| 234 |
- *sigh*. new version of uulib, new braindamaged buffer overflows |
| 235 |
fixed. Diffs like "line length 256 => 300" should have |
| 236 |
alerted me... |
| 237 |
|
| 238 |
0.21 Sun Mar 31 22:06:05 CEST 2002 |
| 239 |
- bumped uulib from 0.5.15 to 0.5.17 (adds some yEnc support, YENC_ENCODED). |
| 240 |
- source-renamed FP_*-symbols to _FP_* again, but still define them |
| 241 |
to be FP_* in the object file. |
| 242 |
- new callback: SetFileNameCallback (actually documented ;) |
| 243 |
|
| 244 |
0.201 Sun Sep 16 03:43:38 CEST 2001 |
| 245 |
- fixed another segfault-bug in uulib, thanks to Lars Hecking who |
| 246 |
provides all the test files ;) |
| 247 |
|
| 248 |
0.2 Thu Jun 14 18:42:49 CEST 2001 |
| 249 |
- Frank Pilhofer is NOT dead! He is alive, kicking, and fixing |
| 250 |
bugs in uulib now! Since his uulib and mine diverged quite |
| 251 |
a bit I am still in the process of merging his bugfixes |
| 252 |
into my version. So be aware that this might introduce new |
| 253 |
instabilities... |
| 254 |
- merged uulib-0.5.15 |
| 255 |
- optimize decode_file to not copy the file contents when a rename |
| 256 |
succeeds (TMPDIR same disk as destination). |
| 257 |
- updated documentation. |
| 258 |
|
| 259 |
0.111 Fri May 4 22:29:09 CEST 2001 |
| 260 |
- heuristic to decode microsoft-rfc822-headers (microsoft uses |
| 261 |
'\' as path seperator which is also the rfc822 quote character. |
| 262 |
of course they could have quoted it, but it's microsoft, so |
| 263 |
only the devil knows how they try to parse mime (they obviously |
| 264 |
haven't read the standard AGAIN). in case you wonder, this fixes |
| 265 |
the "c:my_documentssend.doc" "filename" problem. |
| 266 |
|
| 267 |
0.11 Sun Jul 16 22:42:57 CEST 2000 |
| 268 |
- fixed a bug in the file callback. |
| 269 |
|
| 270 |
0.10 Tue May 2 03:31:09 CEST 2000 |
| 271 |
- fixed one very longstanding bug that might have been the cause |
| 272 |
for the many mysterious segmentation faults. Hopefully. |
| 273 |
- improved documentation to the point that it slowly becomes useful |
| 274 |
as a (very quick) reference. |
| 275 |
|
| 276 |
0.07 Wed Nov 24 18:45:23 CET 1999 |
| 277 |
- removed END { CleanUp } from UUlib.pm, perl is too |
| 278 |
buggy to rely on this in the face of popen etc.. |
| 279 |
|
| 280 |
0.06 Thu Jul 29 22:48:18 CEST 1999 |
| 281 |
- Thierry Bezecourt had the very reasonable idea to include |
| 282 |
the example source in the manpage. |
| 283 |
|
| 284 |
0.05 Mon May 24 11:37:25 CEST 1999 |
| 285 |
- LoadFile returns number of parts loaded. |
| 286 |
|
| 287 |
0.04 Mon May 10 22:02:31 CEST 1999 |
| 288 |
- fixed a couple of portability problems. |
| 289 |
- UUEncodeToStream had a wrong definition. |
| 290 |
- added primitive testsuite. |
| 291 |
- added README. |
| 292 |
|
| 293 |
0.03 Sat May 8 22:40:01 CEST 1999 |
| 294 |
- renamed it to Convert::UUlib. |
| 295 |
|
| 296 |
0.02 Fri May 7 01:26:19 CEST 1999 |
| 297 |
- function names exportable (use :all-tag). |
| 298 |
- made uulist-related functions methods. |
| 299 |
- the first fix from cpan-tester. *sigh* you people save the |
| 300 |
world, continuously. |
| 301 |
|
| 302 |
0.01 Thu May 6 14:30:44 1999 |
| 303 |
- original version; created by h2xs 1.19 |
| 304 |
|