[ViewVC] Annotation of: cvs/liblzf/Changes


TODO: try unaligned copy again in decompressor
TODO: allow size-optimised binaries by avoiding unrolling
TODO: implement lzf_c_best in lzf.

3.8 (unreleased)
        - support a state arg for lzf_c_best.
        - disable STRICT_ALIGN by default, as unaligned accesses can trap
          or worse even on x86.

3.7 (unreleased)
        - add lzf_c_best.c, a slower but better compressor.
        - switch to a multiplicative hash (developed with Steinar Gunderson),
          which is faster on modern cpus and compresses a bit better. The old
          hash function which uses only shifts is still available.
        - allow user configurable hash table slots, which makes it possible
          to use e.g. 16 bit offsets for a smaller hashtable (if your data is
          always < 64kb).
        - use _WIN32, not WIN32, when testing for windows (fails with bcc),
          patch by Tamas Tevesz.
        - try to port to win64+gcc, which is non-posix but doesn't have _int64
          (reported by Maciej Adamczyk).

3.6  Mon Feb  7 17:37:31 CET 2011
        - fixed hash calculation in C♯ version (Tiago Freitas Leal).
        - unroll copy for small sizes, use memcpy for larger sizes,
          greatly speeding up decompression in most cases.
        - finally disable rep movsb - it's a big loss on modern intel cpus,
          and only a small win on amd cpus.
        - improve C++ compatibility of the code.
        - slightly improve compressor speed.
        - halved memory requirements for compressor on 64 bit architectures,
          which can improve the speed quite a bit on older cpus.

3.5  Fri May  1 02:28:42 CEST 2009
        - lzf_compress did sometimes write one octet past the given output
          buffer (analyzed and nice testcase by Salvatore Sanfilippo).

3.4  Tue Sep  2 06:45:00 CEST 2008
        - the fix from 3.3 introduced a compression bug, which is fixed in
          this release (which explains the mysterious prerelease...). Thanks
          once more to Clément Calmels.

3.3  Mon Aug 25 03:17:42 CEST 2008
        - lzf_compress could access memory after the given input buffer
          when outputting back references. reported with nice testcase
          by Clément Calmels.

3.2  Fri May  9 18:52:23 CEST 2008
        - include a workaround for failing POSIX and real-world compliance
          on 64 bit windows (microsoft claims to support POSIX, but is far
          from it). (bug found and analysed nicely by John Lilley).

3.1  Fri Nov 30 11:33:04 CET 2007
        - IMPORTANT BUGFIX: a too long final literal run would corrupt data
          in the encoder (this was introduced in 3.0 only, earlier versions
          are safe).

3.0  Tue Nov 13 22:13:09 CET 2007
        - switched to 2-clause bsd with "GPL v2 or any later version" option.
        - speed up compression by ~10-15% in common cases
          by some manual unrolling.
        - import some compiler tricks from JSON::XS, for further speed-ups.
        - tune hash functions depending on ULTRA_FAST or VERY_FAST settings.
        - for typical binary data (e.g. /bin/bash, memory dumps,
          canterbury corpus etc.), speed is now comparable to fastlz, but
          with better compression ratio. with ULTRA_FAST, it's typically
          3-15% faster than fastlz while still maintaining a similar ratio.
          (amd64 and core 2 duo, ymmv). thanks a lot for the competition :)
        - undo inline assembly in compressor, it is no longer helpful.
        - no changes to the decompressor.
        - use a HLOG of 16 by default now (formerly 15).

2.1  Fri Nov  2 13:34:42 CET 2007
        - switched to a 2-clause bsd license with GPL exception.
        - get rid of memcpy.
        - tentatively use rep movsb on x86 and x86_64 (gcc only) for a
          moderate speed improvement.
        - applied patch by Kein-Hong Man to make lzf.c compile under
          the crippled mingw32 environment.

2.0  Fri Feb 16 23:11:18 CET 2007
        - replaced lzf demo by industrial-strength lzf utility with behaviour
          similar other compression utilities. Thanks for Stefan Traby for
          rewriting it!
        - fix state arg prototype.

1.7  Wed Sep 27 17:29:15 CEST 2006
        - remove bogus "unlzf" patch.
          note to self: never accept well-meant patches.
        - make lzf more robust in presence of padding bytes or sudden eof.

1.6  Fri Jul  7 17:31:26 CEST 2006
        - the lzf example utility will now uncompress if invoked
          as "unlzf" (patch by Scott Feeney).
        - add CHECK_INPUT option that adds more checks for input
          data validity.
        - help applications that do not pass in the correct length
          (such as php) by returning either EINVAL or E2BIG.
        - default HLOG size is now 15 (cpu caches have increased).
        - documentation fixes.

1.51 Thu Apr 14 22:15:46 CEST 2005
        - incorporated C♯ implementation of both the en- and decoder,
          written by "Oren J. Maurice".
          You can find it in the cs/ subdirectory.
        - make FRST, NEXT IDX overridable if lzf_c.c is directly included
          in the code.

1.5  Tue Mar  8 20:23:23 CET 2005
        - incorporated improvements by Adam D. Moss,
          which includes a new VERY_FAST mode which is
          a bit slower than ULTRA_FAST but much better,
          and enabled it as default.

1.401 Thu Mar  3 18:00:52 CET 2005
        - use cstring in c++, not string.h.
        - change of contact address.

1.4  Wed Dec 15 08:08:49 CET 2004
        - very very slight tuning of the hashing function.

1.3  Thu Mar 25 15:41:17 CET 2004
        - changed license of lzf core code to explicitly allow
          relicensing under the GPLv2.
        - added VPATH support as suggested by Björn Eriksson.

1.2  Mon Dec 29 13:47:28 CET 2003
        - avoid spurious memory accesses after the to-be-compressed
          memory region. originally reported by Michal Zalewski.
        - flip LZF_STACK_ARG meaning (to be correct).

1.1  Tue Dec 23 05:48:32 CET 2003
        - removed #warn directive, it's not worth the hassle.
        - add LZF_STACK_ARG and AVOID_ERRNO configurations
          for embedded systems.
        - make it compile cleanly as c++.
        - some small documentation and code fixes.

1.0  Sun Nov 17 12:37:37 CET 2002
        - slightly better compression ratio, almost unmeasurably
          slower.
        - some documentation fixes.

0.4  Thu Jun 13 14:11:10 CEST 2002
        - typoe fix.
        - lzf demo program now properly decompresses small files.
        - fix another 64 bit issue, found by Laurent Deniel.

0.3  Tue Jan 16 13:21:14 CET 2001
        - fix silly beginners 32/64 bit mistake.

0.2  Thu Jan  4 05:56:42 CET 2001
        - now totally independent of autoconfig, for
          easy inclusion into other programs.
        - much better fine-tuning, faster and better than 0.1.

0.1  2000
        - initial release.
Revision:	1.62
Committed:	Tue Nov 12 12:46:28 2024 UTC (22 months ago) by root
Branch:	MAIN
CVS Tags:	HEAD
Changes since 1.61:	+2 -1 lines
Log Message:	* empty log message *
#	User	Rev	Content
1	root	1.53
2	root	1.55	TODO: try unaligned copy again in decompressor
3			TODO: allow size-optimised binaries by avoiding unrolling
4	root	1.57	TODO: implement lzf_c_best in lzf.
5	root	1.59
6			3.8 (unreleased)
7			- support a state arg for lzf_c_best.
8	root	1.62	- disable STRICT_ALIGN by default, as unaligned accesses can trap
9			or worse even on x86.
10	root	1.55
11	root	1.58	3.7 (unreleased)
12			- add lzf_c_best.c, a slower but better compressor.
13	root	1.54	- switch to a multiplicative hash (developed with Steinar Gunderson),
14			which is faster on modern cpus and compresses a bit better. The old
15			hash function which uses only shifts is still available.
16			- allow user configurable hash table slots, which makes it possible
17			to use e.g. 16 bit offsets for a smaller hashtable (if your data is
18			always < 64kb).
19	root	1.53	- use _WIN32, not WIN32, when testing for windows (fails with bcc),
20			patch by Tamas Tevesz.
21	root	1.57	- try to port to win64+gcc, which is non-posix but doesn't have _int64
22	root	1.56	(reported by Maciej Adamczyk).
23	root	1.53
24	root	1.52	3.6 Mon Feb 7 17:37:31 CET 2011
25	root	1.47	- fixed hash calculation in C♯ version (Tiago Freitas Leal).
26	root	1.48	- unroll copy for small sizes, use memcpy for larger sizes,
27			greatly speeding up decompression in most cases.
28			- finally disable rep movsb - it's a big loss on modern intel cpus,
29			and only a small win on amd cpus.
30	root	1.52	- improve C++ compatibility of the code.
31	root	1.50	- slightly improve compressor speed.
32	root	1.51	- halved memory requirements for compressor on 64 bit architectures,
33			which can improve the speed quite a bit on older cpus.
34	root	1.47
35	root	1.46	3.5 Fri May 1 02:28:42 CEST 2009
36			- lzf_compress did sometimes write one octet past the given output
37			buffer (analyzed and nice testcase by Salvatore Sanfilippo).
38
39	root	1.44	3.4 Tue Sep 2 06:45:00 CEST 2008
40			- the fix from 3.3 introduced a compression bug, which is fixed in
41	root	1.45	this release (which explains the mysterious prerelease...). Thanks
42	root	1.44	once more to Clément Calmels.
43
44	root	1.43	3.3 Mon Aug 25 03:17:42 CEST 2008
45			- lzf_compress could access memory after the given input buffer
46			when outputting back references. reported with nice testcase
47			by Clément Calmels.
48	root	1.41
49	root	1.43	3.2 Fri May 9 18:52:23 CEST 2008
50	root	1.42	- include a workaround for failing POSIX and real-world compliance
51			on 64 bit windows (microsoft claims to support POSIX, but is far
52			from it). (bug found and analysed nicely by John Lilley).
53	root	1.41
54	root	1.39	3.1 Fri Nov 30 11:33:04 CET 2007
55			- IMPORTANT BUGFIX: a too long final literal run would corrupt data
56	root	1.40	in the encoder (this was introduced in 3.0 only, earlier versions
57			are safe).
58	root	1.39
59	root	1.38	3.0 Tue Nov 13 22:13:09 CET 2007
60	root	1.37	- switched to 2-clause bsd with "GPL v2 or any later version" option.
61	root	1.33	- speed up compression by ~10-15% in common cases
62			by some manual unrolling.
63	root	1.37	- import some compiler tricks from JSON::XS, for further speed-ups.
64	root	1.33	- tune hash functions depending on ULTRA_FAST or VERY_FAST settings.
65			- for typical binary data (e.g. /bin/bash, memory dumps,
66			canterbury corpus etc.), speed is now comparable to fastlz, but
67			with better compression ratio. with ULTRA_FAST, it's typically
68	root	1.34	3-15% faster than fastlz while still maintaining a similar ratio.
69			(amd64 and core 2 duo, ymmv). thanks a lot for the competition :)
70	root	1.37	- undo inline assembly in compressor, it is no longer helpful.
71	root	1.35	- no changes to the decompressor.
72	root	1.36	- use a HLOG of 16 by default now (formerly 15).
73	root	1.32
74	root	1.30	2.1 Fri Nov 2 13:34:42 CET 2007
75	root	1.31	- switched to a 2-clause bsd license with GPL exception.
76	root	1.28	- get rid of memcpy.
77			- tentatively use rep movsb on x86 and x86_64 (gcc only) for a
78			moderate speed improvement.
79	root	1.60	- applied patch by Kein-Hong Man to make lzf.c compile under
80	root	1.29	the crippled mingw32 environment.
81	root	1.18
82	root	1.27	2.0 Fri Feb 16 23:11:18 CET 2007
83	root	1.24	- replaced lzf demo by industrial-strength lzf utility with behaviour
84			similar other compression utilities. Thanks for Stefan Traby for
85			rewriting it!
86	root	1.27	- fix state arg prototype.
87	root	1.23
88	root	1.22	1.7 Wed Sep 27 17:29:15 CEST 2006
89	root	1.26	- remove bogus "unlzf" patch.
90	root	1.20	note to self: never accept well-meant patches.
91	root	1.21	- make lzf more robust in presence of padding bytes or sudden eof.
92	root	1.20
93	root	1.18	1.6 Fri Jul 7 17:31:26 CEST 2006
94			- the lzf example utility will now uncompress if invoked
95			as "unlzf" (patch by Scott Feeney).
96			- add CHECK_INPUT option that adds more checks for input
97			data validity.
98			- help applications that do not pass in the correct length
99			(such as php) by returning either EINVAL or E2BIG.
100	root	1.19	- default HLOG size is now 15 (cpu caches have increased).
101			- documentation fixes.
102	root	1.18
103	root	1.16	1.51 Thu Apr 14 22:15:46 CEST 2005
104			- incorporated C♯ implementation of both the en- and decoder,
105	root	1.43	written by "Oren J. Maurice".
106	root	1.17	You can find it in the cs/ subdirectory.
107	root	1.16	- make FRST, NEXT IDX overridable if lzf_c.c is directly included
108			in the code.
109
110	root	1.15	1.5 Tue Mar 8 20:23:23 CET 2005
111			- incorporated improvements by Adam D. Moss,
112			which includes a new VERY_FAST mode which is
113			a bit slower than ULTRA_FAST but much better,
114			and enabled it as default.
115	root	1.12
116	root	1.13	1.401 Thu Mar 3 18:00:52 CET 2005
117	root	1.12	- use cstring in c++, not string.h.
118	root	1.14	- change of contact address.
119	root	1.12
120	root	1.11	1.4 Wed Dec 15 08:08:49 CET 2004
121	root	1.10	- very very slight tuning of the hashing function.
122
123	pcg	1.9	1.3 Thu Mar 25 15:41:17 CET 2004
124			- changed license of lzf core code to explicitly allow
125			relicensing under the GPLv2.
126	pcg	1.8	- added VPATH support as suggested by Björn Eriksson.
127
128	pcg	1.6	1.2 Mon Dec 29 13:47:28 CET 2003
129			- avoid spurious memory accesses after the to-be-compressed
130			memory region. originally reported by Michal Zalewski.
131	pcg	1.7	- flip LZF_STACK_ARG meaning (to be correct).
132	pcg	1.6
133	pcg	1.5	1.1 Tue Dec 23 05:48:32 CET 2003
134	pcg	1.4	- removed #warn directive, it's not worth the hassle.
135	pcg	1.5	- add LZF_STACK_ARG and AVOID_ERRNO configurations
136			for embedded systems.
137			- make it compile cleanly as c++.
138			- some small documentation and code fixes.
139	pcg	1.4
140	root	1.3	1.0 Sun Nov 17 12:37:37 CET 2002
141	root	1.2	- slightly better compression ratio, almost unmeasurably
142			slower.
143	root	1.3	- some documentation fixes.
144	root	1.2
145			0.4 Thu Jun 13 14:11:10 CEST 2002
146	root	1.1	- typoe fix.
147			- lzf demo program now properly decompresses small files.
148			- fix another 64 bit issue, found by Laurent Deniel.
149
150			0.3 Tue Jan 16 13:21:14 CET 2001
151			- fix silly beginners 32/64 bit mistake.
152
153			0.2 Thu Jan 4 05:56:42 CET 2001
154	root	1.3	- now totally independent of autoconfig, for
155	root	1.1	easy inclusion into other programs.
156			- much better fine-tuning, faster and better than 0.1.
157
158	root	1.3	0.1 2000
159	root	1.1	- initial release.