ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/JSON-XS/Changes
Revision: 1.189
Committed: Sun Feb 24 04:21:05 2019 UTC (5 years, 2 months ago) by root
Branch: MAIN
CVS Tags: rel-4_01
Changes since 1.188: +4 -1 lines
Log Message:
4.01

File Contents

# User Rev Content
1 root 1.1 Revision history for Perl extension JSON::XS
2 root 1.2
3 root 1.186 TODO: maybe detect and croak on more invalid inputs (e.g. +-inf/nan)
4 root 1.151 TODO: maybe avoid the reblessing and better support readonly objects.
5 root 1.163 TODO: how to cope with tagged values and standard json decoders
6 root 1.167 TODO: investigate magic (Eric Brine)
7 root 1.179 TODO: [PATCH] Types::Serialiser: Inline true(), false() and error() functions
8 root 1.176
9 root 1.189 4.01 Sun Feb 24 05:03:30 CET 2019
10     - fix some stack corruption caused mostly when calling methods
11     in list context (tewstcase by Wesley Schwengle).
12    
13 root 1.188 4.0 Fri Nov 16 00:06:54 CET 2018
14 root 1.183 - SECURITY IMPLICATION: this release enables allow_nonref by default
15     for compatibnility with RFC 7159 and newer. See "old" vs. "new"
16     JSON under SECURITY CONSIDERATIONS.
17     - reworked the "old" vs. "new" JSON section.
18     - add ->boolean_values to provide the values to which booleans
19 root 1.185 decode (requested by Aristotle Pagaltzis).
20 root 1.183 - decode would wrongly accept ASCII NUL characters instead of
21     reporting them as trailing garbage.
22 root 1.182 - work around what smells like a perl bug w.r.t. exceptions
23     thrown in callbacks.
24 root 1.184 - incremental parser now more or less respects allow_nonref.
25 root 1.181 - json_xs json-pretty now enables canonical mode.
26 root 1.184 - add documentation section about I-JSON.
27 root 1.183 - minor documentation fixes/updates.
28 root 1.181
29 root 1.178 3.04 Thu Aug 17 04:30:47 CEST 2017
30 root 1.177 - change exponential realloc algorithm on encoding and string decoding to be
31     really exponential (this helps slow/debugging allocators such as libumem)
32     (reported by Matthew Horsfall).
33     - string encoding would needlessly overallocate output space
34     (testcase by Matthew Horsfall).
35     - be very paranoid about extending buffer lengths and croak if buffers get too large,
36     which might (or might not) improve security.
37 root 1.176 - add cbor-packed type to json_xs.
38 root 1.177 - switch from YAML to YAML::XS in json_xs, as YAML is way too buggy and outdated.
39 root 1.169
40 root 1.175 3.03 Wed Nov 16 20:20:59 CET 2016
41 root 1.174 - fix a bug introduced by a perl bug workaround that would cause
42 root 1.175 incremental parsing to fail with a sv_chop panic.
43 root 1.171 - json_xs: toformat failure error message fixed.
44 root 1.172 - json_xs: allow cyclic data structures in CBOR.
45 root 1.171
46 root 1.169 3.02 Fri Feb 26 22:45:20 CET 2016
47 root 1.168 - allow_nonref now affects booleans (\1, $Types::Serialiser::Boolean)
48     as well (reported by Alex Efros).
49 root 1.166 - allow literal tabs in strings in relaxed mode (patch by
50     lubo.rintel@gooddata.com).
51 root 1.167 - support "cbor" format in json_xs tool.
52     - support (and fix) calling encode and decode in list context
53     (reported by Вадим Власов).
54 root 1.169 - work around a bug in older perls crashing when presented
55     with shared hash keys (Reini Urban).
56     - use stability canary.
57 root 1.166
58 root 1.162 3.01 Tue Oct 29 16:55:15 CET 2013
59     - backport to perls < 5.18 (reported by Paul Howarth).
60    
61 root 1.161 3.0 Tue Oct 29 01:35:37 CET 2013
62     - implemented an object tagging extension (using the
63 root 1.159 Types::Serialiser serialisation protocol).
64     - reworked the documentation regarding object serialisation,
65 root 1.165 add a new OBJECT SERIALISATION section that explains th
66 root 1.159 whole process.
67 root 1.160 - new setting: allow_tags.
68 root 1.158 - switch to Types::Serialiser booleans.
69 root 1.156 - remove to_json/from_json.
70 root 1.159 - other minor improvements to the documentation.
71 root 1.156
72 root 1.155 2.34 Thu May 23 11:30:34 CEST 2013
73     - work around bugs in perl 5.18 breaking more than 100
74     widely used modules, without a fix in sight because
75     p5pers don't care about CPAN anymore.
76 root 1.154 - when canonicalising, only allocate up to 64 hash key
77     pointers on the stack. for larger hashes, use the heap,
78     to avoid using too much stackspace.
79 root 1.155 - discuss the problem with setlocale (reported by a few victims).
80 root 1.154
81 root 1.153 2.33 Wed Aug 1 21:03:52 CEST 2012
82     - internal encode/decode XS wrappers did not expect stack
83     moves caused by callbacks (analyzed and testcase by Jesse Luehrs).
84 root 1.151 - add bencode as to/from option in bin/json_xs.
85 root 1.152 - add -e option to json_xs, and none and string in/out formats.
86 root 1.147
87 root 1.150 2.32 Thu Aug 11 19:06:38 CEST 2011
88     - fix a bug in the initial whitespace accumulation.
89    
90 root 1.149 2.31 Wed Jul 27 17:53:05 CEST 2011
91 root 1.153 - don't accumulate initial whitespace in the incremental buffer
92 root 1.149 (this can be useful to allow whitespace-keepalive on a tcp
93     connection without triggering the max_size limit).
94 root 1.148 - properly croak on some invalid inputs that are not strings
95     (e.g. undef) when trying to decode a json text (reported
96     and analyzed by Goro Fuji).
97    
98 root 1.146 2.3 Wed Aug 18 01:26:47 CEST 2010
99     - make sure decoder doesn't change the decoding in the incremental
100     parser (testcase provided by Hendrik Schumacher).
101 root 1.144 - applied patch by DaTa for Data::Dumper support in json_xs.
102 root 1.145 - added -t dump support to json_xs, using Data::Dump.
103 root 1.146 - added -f eval support to json_xs.
104 root 1.144
105 root 1.143 2.29 Wed Mar 17 02:39:12 CET 2010
106     - fix a memory leak when callbacks set using filter_json_object
107     or filter_json_single_key_object were called (great testcase
108     by Eric Wilhelm).
109    
110 root 1.142 2.28 Thu Mar 11 20:30:46 CET 2010
111 root 1.139 - implement our own atof function - perl's can be orders of
112     magnitudes slower than even the system one. on the positive
113     side, ours seems to be more exact in general than perl's.
114     (testcase provided by Tim Meadowcroft).
115 root 1.142 - clarify floating point conversion issues a bit.
116 root 1.138 - update jpsykes csrf article url.
117 root 1.140 - updated benchmark section - JSON::PP became much faster!
118 root 1.138
119 root 1.137 2.27 Thu Jan 7 07:35:08 CET 2010
120 root 1.136 - support relaxed option inside the incremental parser
121 root 1.137 (testcase provided by IKEGAMI via Makamaka).
122 root 1.136
123 root 1.135 2.26 Sat Oct 10 03:26:19 CEST 2009
124     - big integers could become truncated (based on patch
125     by Strobl Anton).
126 root 1.134 - output format change: indent now adds a final newline, which is
127     more expected and more true to the documentation.
128 root 1.132
129 root 1.131 2.25 Sat Aug 8 12:04:41 CEST 2009
130     - the perl debugger completely breaks lvalue subs - try to work
131     around the issue.
132 root 1.130 - ignore RMAGICAL hashes w.r.t. CANONICAL.
133 root 1.128 - try to work around a possible char signedness issue on aix.
134 root 1.129 - require common sense.
135 root 1.128
136 root 1.127 2.24 Sat May 30 08:25:45 CEST 2009
137     - the incremental parser did not update its parse offset
138     pointer correctly when parsing utf8-strings (nicely
139     debugged by Martin Evans).
140     - appending a non-utf8-string to the incremental parser
141     in utf8 mode failed to upgrade the string.
142     - wording of parse error messages has been improved.
143    
144 root 1.126 2.232 Sun Feb 22 11:12:25 CET 2009
145 root 1.125 - use an exponential algorithm to extend strings, to
146 root 1.126 help platforms with bad or abysmal==windows memory
147     allocater performance, at the expense of some memory
148 root 1.125 wastage (use shrink to recover this extra memory).
149     (nicely analysed by Dmitry Karasik).
150    
151 root 1.124 2.2311 Thu Feb 19 02:12:54 CET 2009
152 root 1.123 - add a section "JSON and ECMAscript" to explain some
153     incompatibilities between the two (problem was noted by
154     various people).
155 root 1.122 - add t/20_faihu.t.
156    
157 root 1.121 2.231 Thu Nov 20 04:59:08 CET 2008
158     - work around 5.10.0 magic bugs where manipulating magic values
159     (such as $1) would permanently damage them as perl would
160     ignore the magicalness, by making a full copy of the string,
161     reported by Dmitry Karasik.
162 root 1.125 - work around spurious warnings under older perl 5.8's.
163 root 1.121
164 root 1.120 2.23 Mon Sep 29 05:08:29 CEST 2008
165     - fix a compilation problem when perl is not using char * as, well,
166     char *.
167 root 1.119 - use PL_hexdigit in favour of rolling our own.
168    
169 root 1.118 2.2222 Sun Jul 20 18:49:00 CEST 2008
170     - same game again, broken 5.10 finds yet another assertion
171     failure, and the workaround causes additional runtime warnings.
172     Work around the next assertion AND the warning. 5.10 seriously
173     needs to adjust it's attitude against working code.
174    
175 root 1.117 2.222 Sat Jul 19 06:15:34 CEST 2008
176     - you work around one -DDEBUGGING assertion bug in perl 5.10
177     just to hit the next one. work around this one, too.
178    
179 root 1.116 2.22 Tue Jul 15 13:26:51 CEST 2008
180 root 1.115 - allow higher nesting levels in incremental parser.
181     - error out earlier in some cases in the incremental parser
182     (as suggested by Yuval Kogman).
183     - improve incr-parser test (Yuval Kogman).
184    
185 root 1.114 2.21 Tue Jun 3 08:43:23 CEST 2008
186     - (hopefully) work around a perl 5.10 bug with -DDEBUGGING.
187 root 1.112 - remove the experimental status of the incremental parser interface.
188 root 1.111 - move =encoding around again, to avoid bugs with search.cpan.org.
189     when can we finally have utf-8 in pod???
190 root 1.113 - add ->incr_reset method.
191 root 1.111
192 root 1.110 2.2 Wed Apr 16 20:37:25 CEST 2008
193 root 1.109 - lifted the log2 rounding restriction of max_depth and max_size.
194 root 1.107 - make booleans mutable by creating a copy instead of handing out
195     the same scalar (reported by pasha sadri).
196 root 1.164 - added support for incremental json parsing (still EXPERIMENTAL).
197 root 1.103 - implemented and added a json_xs command line utility that can convert
198     from/to a number of serialisation formats - tell me if you need more.
199 root 1.108 - implement allow_unknown/get_allow_unknown methods.
200 root 1.109 - fixed documentation of max_depth w.r.t. higher and equal.
201 root 1.112 - moved down =encoding directive a bit, too much breaks if it's the first
202 root 1.102 pod directive :/.
203 root 1.106 - removed documentation section on other modules, it became somewhat
204     outdated and is nowadays mostly of historical interest.
205 root 1.102
206 root 1.101 2.1 Wed Mar 19 23:23:18 CET 2008
207     - update documentation here and there: add a large section
208     about utf8/latin1/ascii flags, add a security consideration
209     and extend and clarify the JSON and YAML section.
210 root 1.98 - medium speed enhancements when encoding/decoding non-ascii chars.
211 root 1.100 - minor speedup in number encoding case.
212 root 1.92 - extend and clarify the section on incompatibilities
213     between YAML and JSON.
214 root 1.95 - switch to static inline from just inline when using gcc.
215 root 1.94 - add =encoding utf-8 to the manpage, now that perl 5.10 supports it.
216 root 1.100 - fix some issues with UV to JSON conversion of unknown impact.
217 root 1.99 - published the yahoo locals search result used in benchmarks as the
218     original url changes so comparison is impossible.
219 root 1.92
220 root 1.91 2.01 Wed Dec 5 11:40:28 CET 2007
221     - INCOMPATIBLE API CHANGE: to_json and from_json have been
222     renamed to encode_json/decode_json for JSON.pm compatibility.
223     The old functions croak and might be replaced by JSON.pm
224     comaptible versions in some later release.
225    
226 root 1.90 2.0 Tue Dec 4 11:30:46 CET 2007
227     - this is supposed to be the first version of JSON::XS
228     compatible with version 2.0+ of the JSON module.
229     Using the JSON module as frontend to JSON::XS should be
230     as fast as using JSON::XS directly, so consider using it
231     instead.
232 root 1.88 - added get_* methods for all "simple" options.
233 root 1.89 - make JSON::XS subclassable.
234 root 1.88
235 root 1.86 1.53 Tue Nov 13 23:58:33 CET 2007
236 root 1.85 - minor doc clarifications.
237     - fixed many doc typos (patch by Thomas L. Shinnick).
238    
239 root 1.84 1.52 Mon Oct 15 03:22:06 CEST 2007
240 root 1.83 - remove =encoding pod directive again, it confuses too many pod
241     parsers :/.
242    
243 root 1.82 1.51 Sat Oct 13 03:55:56 CEST 2007
244 root 1.81 - encode empty arrays/hashes in a compact way when pretty is enabled.
245 root 1.87 - apparently JSON::XS was used to find some bugs in the
246 root 1.80 JSON_checker testsuite, so add (the corrected) JSON_checker tests to
247     the testsuite.
248     - quite a bit of doc updates/extension.
249 root 1.79 - require 5.8.2, as this seems to be the first unicode-stable version.
250 root 1.78
251 root 1.77 1.5 Tue Aug 28 04:05:38 CEST 2007
252 root 1.74 - add support for tied hashes, based on ideas and testcase by
253     Marcus Holland-Moritz.
254 root 1.75 - implemented relaxed parsing mode where some extensions are being
255     accepted. generation is still JSON-only.
256 root 1.74
257     1.44 Wed Aug 22 01:02:44 CEST 2007
258 root 1.73 - very experimental process-emulation support, slowing everything down.
259     the horribly broken perl threads are still not supported - YMMV.
260    
261 root 1.72 1.43 Thu Jul 26 13:26:37 CEST 2007
262     - convert big json numbers exclusively consisting of digits to NV
263     only when there is no loss of precision, otherwise to string.
264    
265 root 1.71 1.42 Tue Jul 24 00:51:18 CEST 2007
266     - fix a crash caused by not handling missing array elements
267     (report and testcase by Jay Kuri).
268    
269 root 1.70 1.41 Tue Jul 10 18:21:44 CEST 2007
270     - fix compilation with NDEBUG (assert side-effect),
271     affects convert_blessed only.
272 root 1.69 - fix a bug in decode filters calling ENTER; SAVETMPS;
273     one time too often.
274 root 1.70 - catch a typical error in TO_JSON methods.
275 root 1.69 - antique-ised XS.xs again to work with outdated
276     C compilers (windows...).
277    
278 root 1.68 1.4 Mon Jul 2 10:06:30 CEST 2007
279 root 1.63 - add convert_blessed setting.
280 root 1.56 - encode did not catch all blessed objects, encoding their
281     contents in most cases. This has been fixed by introducing
282     the allow_blessed setting.
283 root 1.65 - added filter_json_object and filter_json_single_key_object
284     settings that specify a callback to be called when
285 root 1.67 all/specific json objects are encountered.
286 root 1.59 - assume that most object keys are simple ascii words and
287     optimise this case, penalising the general case. This can
288     speed up decoding by 30% in typical cases and gives
289     a smaller and faster perl hash.
290 root 1.58 - implemented simpleminded, optional resource size checking
291     in decode_json.
292 root 1.61 - remove objToJson/jsonToObj aliases, as the next version
293     of JSON will not have them either.
294 root 1.62 - bit the bullet and converted the very simple json object
295     into a more complex one.
296 root 1.64 - work around a bug where perl wrongly claims an integer
297     is not an integer.
298 root 1.65 - unbundle JSON::XS::Boolean into own pm file so Storable
299     and similar modules can resolve the overloading when thawing.
300 root 1.56
301 root 1.55 1.3 Sun Jun 24 01:55:02 CEST 2007
302 root 1.54 - make JSON::XS::true and false special overloaded objects
303     and return those instead of 1 and 0 for those json atoms
304     (JSON::PP compatibility is NOT achieved yet).
305     - add JSON::XS::is_bool predicate to test for those special
306     values.
307 root 1.52 - add a reference to
308     http://jpsykes.com/47/practical-csrf-and-json-security.
309 root 1.60 - removed require 5.8.8 again, it is just not very expert-friendly.
310     Also try to be more compatible with slightly older versions,
311 root 1.54 which are not recommended (because they are buggy).
312 root 1.52
313 root 1.51 1.24 Mon Jun 11 05:40:49 CEST 2007
314 root 1.49 - added informative section on JSON-as-YAML.
315 root 1.51 - get rid of some c99-isms again.
316 root 1.50 - localise dec->cur in decode_str, speeding up
317     string decoding considerably (>15% on my amd64 + gcc).
318     - increased SHORT_STRING_LEN to 16kb: stack space is
319     usually plenty, and this actually saves memory
320 root 1.51 when !shrinking as short strings will fit perfectly.
321 root 1.49
322 root 1.47 1.23 Wed Jun 6 20:13:06 CEST 2007
323 root 1.46 - greatly improved small integer encoding and decoding speed.
324     - implement a number of µ-optimisations.
325 root 1.47 - updated benchmarks.
326 root 1.46
327 root 1.45 1.22 Thu May 24 00:07:25 CEST 2007
328 root 1.42 - require 5.8.8 explicitly as older perls do not seem to offer
329     the required macros.
330 root 1.43 - possibly made it compile on so-called C compilers by microsoft.
331 root 1.42
332 root 1.41 1.21 Wed May 9 18:40:32 CEST 2007
333 root 1.47 - character offset reported for trailing garbage was random.
334 root 1.41
335 root 1.40 1.2 Wed May 9 18:35:01 CEST 2007
336     - decode did not work with magical scalars (doh!).
337 root 1.38 - added latin1 flag to produce JSON texts in the latin1 subset
338     of unicode.
339 root 1.39 - flag trailing garbage as error.
340     - new decode_prefix method that returns the number
341     of characters consumed by a decode.
342 root 1.40 - max octets/char in perls UTF-X is actually 13, not 11,
343     as pointed out by Glenn Linderman.
344     - fixed typoe reported by YAMASHINA Hio.
345 root 1.34
346 root 1.32 1.11 Mon Apr 9 07:05:49 CEST 2007
347     - properly 0-terminate sv's returned by encode to help
348     C libraries that expect that 0 to be there.
349 root 1.31 - partially "port" JSON from C to microsofts fucking broken
350     pseudo-C. They should be burned to the ground for pissing
351     on standards. And I should be stoned for even trying to
352 root 1.32 support this filthy excuse for a c compiler.
353 root 1.6
354 root 1.30 1.1 Wed Apr 4 01:45:00 CEST 2007
355 root 1.28 - clarify documentation (pointed out by Quinn Weaver).
356 root 1.29 - decode_utf8 sometimes did not correctly flag errors,
357     leading to segfaults.
358 root 1.30 - further reduced default nesting depth to 512 due to the test
359     failure by that anonymous "chris" whose e-mail address seems
360     to be impossible to get. Tests on other freebsd systems indicate
361     that this is likely a problem in his/her configuration and not this
362     module.
363     - renamed json => JSON in error messages.
364     - corrected the character offset in some error messages.
365 root 1.28
366 root 1.27 1.01 Sat Mar 31 16:15:40 CEST 2007
367     - do not segfault when from_json/decode gets passed
368     a non-string object (reported by Florian Ragwitz).
369     This has no effect on normal operation.
370    
371 root 1.25 1.0 Thu Mar 29 04:43:34 CEST 2007
372     - the long awaited (by me) 1.0 version.
373     - add \0 (JSON::XS::false) and \1 (JSON::XS::true) mappings to JSON
374     true and false.
375 root 1.24 - add some more notes to shrink, as suggested by Alex Efros.
376 root 1.25 - improve testsuite.
377 root 1.26 - halve the default nesting depth limit, to hopefully make it
378 root 1.25 work on Freebsd (unfortunately, the cpan tester did not
379     send me his report, so I cannot ask about the stack limit on fbsd).
380 root 1.24
381 root 1.23 0.8 Mon Mar 26 00:10:48 CEST 2007
382 root 1.21 - fix a memleak when decoding hashes.
383 root 1.20 - export jsonToBj and objToJson as aliases
384     to to_json and from_json, to reduce incompatibilities
385     between JSON/JSON::PC and JSON::XS. (experimental).
386 root 1.21 - implement a maximum nesting depth for both en- and de-coding.
387     - added a security considerations sections.
388 root 1.20
389 root 1.19 0.7 Sun Mar 25 01:46:30 CET 2007
390 root 1.16 - code cleanup.
391     - fix a memory overflow bug when indenting.
392     - pretty-printing now up to 15% faster.
393     - improve decoding speed of strings by
394     up to 50% by specialcasing short strings.
395     - further decoding speedups for strings using
396     lots of \u escapes.
397 root 1.17 - improve utf8 decoding speed for U+80 .. U+7FF.
398 root 1.16
399 root 1.15 0.5 Sat Mar 24 20:41:51 CET 2007
400 root 1.14 - added the UTF-16 encoding example hinted at in previous
401     versions.
402     - minor documentation fixes.
403 root 1.15 - fix a bug in and optimise canonicalising fastpath
404     (reported by Craig Manley).
405     - remove a subtest that breaks with bleadperl (reported
406     by Andreas König).
407 root 1.14
408 root 1.13 0.31 Sat Mar 24 02:14:34 CET 2007
409 root 1.12 - documentation updates.
410 root 1.13 - do some casting to hopefully fix Andreas' problem.
411     - nuke bogus json rpc stuff.
412 root 1.12
413 root 1.11 0.3 Fri Mar 23 19:33:21 CET 2007
414 root 1.5 - remove spurious PApp::Util reference (John McNamara).
415     - adapted lots of tests from other json modules
416     (idea by Chris Carline).
417 root 1.9 - documented mapping from json to perl and vice versa.
418 root 1.11 - improved the documentation by adding more examples.
419 root 1.5 - added short escaping forms, reducing the created
420     json texts a bit.
421     - added shrink flag.
422     - when flag methods are called without enable argument
423     they will by default enable their flag.
424     - considerably improved string encoding speed (at least
425     with gcc 4).
426 root 1.7 - added a test that covers lots of different characters.
427     - clarified some error messages.
428     - error messages now use correct character offset
429     with F_UTF8.
430 root 1.8 - improve the "no bytes" and "no warnings" hacks in
431     case the called functions do... stuff.
432 root 1.9 - croak when encoding to ascii and an out-of-range
433     (non-unicode) codepoint is encountered.
434 root 1.4
435 root 1.3 0.2 Fri Mar 23 00:23:34 CET 2007
436 root 1.109 - the "could not sleep without debugging release".
437 root 1.3 it should basically work now, with many bugs as
438     no production tests have been run yet.
439     - added more testcases.
440     - the expected shitload of bugfixes.
441     - handle utf8 flag correctly in decode.
442     - fix segfault in decoder.
443     - utf8n_to_uvuni sets retlen to -1, but retlen is an
444     unsigned types (argh).
445     - fix decoding of utf-8 strings.
446     - improved error diagnostics.
447     - fix decoding of 'null'.
448     - fix parsing of empty array/hashes
449     - silence warnings when we prepare the croak message.
450    
451 root 1.2 0.1 Thu Mar 22 22:13:43 CET 2007
452     - first release, very untested, basically just to claim
453     the namespace.
454 root 1.1
455     0.01 Thu Mar 22 06:08:12 CET 2007
456     - original version; cloned from Convert-Scalar
457