ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/JSON-XS/Changes
Revision: 1.182
Committed: Thu Nov 15 20:13:03 2018 UTC (5 years, 6 months ago) by root
Branch: MAIN
Changes since 1.181: +3 -0 lines
Log Message:
*** empty log message ***

File Contents

# User Rev Content
1 root 1.1 Revision history for Perl extension JSON::XS
2 root 1.2
3 root 1.147 TODO: maybe detetc and croak on more invalid inputs (e.g. +-inf/nan)
4 root 1.151 TODO: maybe avoid the reblessing and better support readonly objects.
5 root 1.153 TODO: http://stevehanov.ca/blog/index.php?id=104 compression
6 root 1.163 TODO: how to cope with tagged values and standard json decoders
7 root 1.167 TODO: investigate magic (Eric Brine)
8 root 1.170 TODO: rfc7464
9     TODO: Victor Efimov
10 root 1.180 TODO: move json_xs to types::serialiser?
11    
12 root 1.179 TODO: [PATCH] Types::Serialiser: Inline true(), false() and error() functions
13 root 1.176
14 root 1.180 TODO: document & testcase ->boolean_values (aristoteles).
15 root 1.182 - work around what smells like a perl bug w.r.t. exceptions
16     thrown in callbacks.
17 root 1.181 - json_xs json-pretty now enables canonical mode.
18 root 1.182 - json_xs now uses allow_nonref to decode json.
19 root 1.181
20 root 1.178 3.04 Thu Aug 17 04:30:47 CEST 2017
21 root 1.177 - change exponential realloc algorithm on encoding and string decoding to be
22     really exponential (this helps slow/debugging allocators such as libumem)
23     (reported by Matthew Horsfall).
24     - string encoding would needlessly overallocate output space
25     (testcase by Matthew Horsfall).
26     - be very paranoid about extending buffer lengths and croak if buffers get too large,
27     which might (or might not) improve security.
28 root 1.176 - add cbor-packed type to json_xs.
29 root 1.177 - switch from YAML to YAML::XS in json_xs, as YAML is way too buggy and outdated.
30 root 1.169
31 root 1.175 3.03 Wed Nov 16 20:20:59 CET 2016
32 root 1.174 - fix a bug introduced by a perl bug workaround that would cause
33 root 1.175 incremental parsing to fail with a sv_chop panic.
34 root 1.171 - json_xs: toformat failure error message fixed.
35 root 1.172 - json_xs: allow cyclic data structures in CBOR.
36 root 1.171
37 root 1.169 3.02 Fri Feb 26 22:45:20 CET 2016
38 root 1.168 - allow_nonref now affects booleans (\1, $Types::Serialiser::Boolean)
39     as well (reported by Alex Efros).
40 root 1.166 - allow literal tabs in strings in relaxed mode (patch by
41     lubo.rintel@gooddata.com).
42 root 1.167 - support "cbor" format in json_xs tool.
43     - support (and fix) calling encode and decode in list context
44     (reported by Вадим Власов).
45 root 1.169 - work around a bug in older perls crashing when presented
46     with shared hash keys (Reini Urban).
47     - use stability canary.
48 root 1.166
49 root 1.162 3.01 Tue Oct 29 16:55:15 CET 2013
50     - backport to perls < 5.18 (reported by Paul Howarth).
51    
52 root 1.161 3.0 Tue Oct 29 01:35:37 CET 2013
53     - implemented an object tagging extension (using the
54 root 1.159 Types::Serialiser serialisation protocol).
55     - reworked the documentation regarding object serialisation,
56 root 1.165 add a new OBJECT SERIALISATION section that explains th
57 root 1.159 whole process.
58 root 1.160 - new setting: allow_tags.
59 root 1.158 - switch to Types::Serialiser booleans.
60 root 1.156 - remove to_json/from_json.
61 root 1.159 - other minor improvements to the documentation.
62 root 1.156
63 root 1.155 2.34 Thu May 23 11:30:34 CEST 2013
64     - work around bugs in perl 5.18 breaking more than 100
65     widely used modules, without a fix in sight because
66     p5pers don't care about CPAN anymore.
67 root 1.154 - when canonicalising, only allocate up to 64 hash key
68     pointers on the stack. for larger hashes, use the heap,
69     to avoid using too much stackspace.
70 root 1.155 - discuss the problem with setlocale (reported by a few victims).
71 root 1.154
72 root 1.153 2.33 Wed Aug 1 21:03:52 CEST 2012
73     - internal encode/decode XS wrappers did not expect stack
74     moves caused by callbacks (analyzed and testcase by Jesse Luehrs).
75 root 1.151 - add bencode as to/from option in bin/json_xs.
76 root 1.152 - add -e option to json_xs, and none and string in/out formats.
77 root 1.147
78 root 1.150 2.32 Thu Aug 11 19:06:38 CEST 2011
79     - fix a bug in the initial whitespace accumulation.
80    
81 root 1.149 2.31 Wed Jul 27 17:53:05 CEST 2011
82 root 1.153 - don't accumulate initial whitespace in the incremental buffer
83 root 1.149 (this can be useful to allow whitespace-keepalive on a tcp
84     connection without triggering the max_size limit).
85 root 1.148 - properly croak on some invalid inputs that are not strings
86     (e.g. undef) when trying to decode a json text (reported
87     and analyzed by Goro Fuji).
88    
89 root 1.146 2.3 Wed Aug 18 01:26:47 CEST 2010
90     - make sure decoder doesn't change the decoding in the incremental
91     parser (testcase provided by Hendrik Schumacher).
92 root 1.144 - applied patch by DaTa for Data::Dumper support in json_xs.
93 root 1.145 - added -t dump support to json_xs, using Data::Dump.
94 root 1.146 - added -f eval support to json_xs.
95 root 1.144
96 root 1.143 2.29 Wed Mar 17 02:39:12 CET 2010
97     - fix a memory leak when callbacks set using filter_json_object
98     or filter_json_single_key_object were called (great testcase
99     by Eric Wilhelm).
100    
101 root 1.142 2.28 Thu Mar 11 20:30:46 CET 2010
102 root 1.139 - implement our own atof function - perl's can be orders of
103     magnitudes slower than even the system one. on the positive
104     side, ours seems to be more exact in general than perl's.
105     (testcase provided by Tim Meadowcroft).
106 root 1.142 - clarify floating point conversion issues a bit.
107 root 1.138 - update jpsykes csrf article url.
108 root 1.140 - updated benchmark section - JSON::PP became much faster!
109 root 1.138
110 root 1.137 2.27 Thu Jan 7 07:35:08 CET 2010
111 root 1.136 - support relaxed option inside the incremental parser
112 root 1.137 (testcase provided by IKEGAMI via Makamaka).
113 root 1.136
114 root 1.135 2.26 Sat Oct 10 03:26:19 CEST 2009
115     - big integers could become truncated (based on patch
116     by Strobl Anton).
117 root 1.134 - output format change: indent now adds a final newline, which is
118     more expected and more true to the documentation.
119 root 1.132
120 root 1.131 2.25 Sat Aug 8 12:04:41 CEST 2009
121     - the perl debugger completely breaks lvalue subs - try to work
122     around the issue.
123 root 1.130 - ignore RMAGICAL hashes w.r.t. CANONICAL.
124 root 1.128 - try to work around a possible char signedness issue on aix.
125 root 1.129 - require common sense.
126 root 1.128
127 root 1.127 2.24 Sat May 30 08:25:45 CEST 2009
128     - the incremental parser did not update its parse offset
129     pointer correctly when parsing utf8-strings (nicely
130     debugged by Martin Evans).
131     - appending a non-utf8-string to the incremental parser
132     in utf8 mode failed to upgrade the string.
133     - wording of parse error messages has been improved.
134    
135 root 1.126 2.232 Sun Feb 22 11:12:25 CET 2009
136 root 1.125 - use an exponential algorithm to extend strings, to
137 root 1.126 help platforms with bad or abysmal==windows memory
138     allocater performance, at the expense of some memory
139 root 1.125 wastage (use shrink to recover this extra memory).
140     (nicely analysed by Dmitry Karasik).
141    
142 root 1.124 2.2311 Thu Feb 19 02:12:54 CET 2009
143 root 1.123 - add a section "JSON and ECMAscript" to explain some
144     incompatibilities between the two (problem was noted by
145     various people).
146 root 1.122 - add t/20_faihu.t.
147    
148 root 1.121 2.231 Thu Nov 20 04:59:08 CET 2008
149     - work around 5.10.0 magic bugs where manipulating magic values
150     (such as $1) would permanently damage them as perl would
151     ignore the magicalness, by making a full copy of the string,
152     reported by Dmitry Karasik.
153 root 1.125 - work around spurious warnings under older perl 5.8's.
154 root 1.121
155 root 1.120 2.23 Mon Sep 29 05:08:29 CEST 2008
156     - fix a compilation problem when perl is not using char * as, well,
157     char *.
158 root 1.119 - use PL_hexdigit in favour of rolling our own.
159    
160 root 1.118 2.2222 Sun Jul 20 18:49:00 CEST 2008
161     - same game again, broken 5.10 finds yet another assertion
162     failure, and the workaround causes additional runtime warnings.
163     Work around the next assertion AND the warning. 5.10 seriously
164     needs to adjust it's attitude against working code.
165    
166 root 1.117 2.222 Sat Jul 19 06:15:34 CEST 2008
167     - you work around one -DDEBUGGING assertion bug in perl 5.10
168     just to hit the next one. work around this one, too.
169    
170 root 1.116 2.22 Tue Jul 15 13:26:51 CEST 2008
171 root 1.115 - allow higher nesting levels in incremental parser.
172     - error out earlier in some cases in the incremental parser
173     (as suggested by Yuval Kogman).
174     - improve incr-parser test (Yuval Kogman).
175    
176 root 1.114 2.21 Tue Jun 3 08:43:23 CEST 2008
177     - (hopefully) work around a perl 5.10 bug with -DDEBUGGING.
178 root 1.112 - remove the experimental status of the incremental parser interface.
179 root 1.111 - move =encoding around again, to avoid bugs with search.cpan.org.
180     when can we finally have utf-8 in pod???
181 root 1.113 - add ->incr_reset method.
182 root 1.111
183 root 1.110 2.2 Wed Apr 16 20:37:25 CEST 2008
184 root 1.109 - lifted the log2 rounding restriction of max_depth and max_size.
185 root 1.107 - make booleans mutable by creating a copy instead of handing out
186     the same scalar (reported by pasha sadri).
187 root 1.164 - added support for incremental json parsing (still EXPERIMENTAL).
188 root 1.103 - implemented and added a json_xs command line utility that can convert
189     from/to a number of serialisation formats - tell me if you need more.
190 root 1.108 - implement allow_unknown/get_allow_unknown methods.
191 root 1.109 - fixed documentation of max_depth w.r.t. higher and equal.
192 root 1.112 - moved down =encoding directive a bit, too much breaks if it's the first
193 root 1.102 pod directive :/.
194 root 1.106 - removed documentation section on other modules, it became somewhat
195     outdated and is nowadays mostly of historical interest.
196 root 1.102
197 root 1.101 2.1 Wed Mar 19 23:23:18 CET 2008
198     - update documentation here and there: add a large section
199     about utf8/latin1/ascii flags, add a security consideration
200     and extend and clarify the JSON and YAML section.
201 root 1.98 - medium speed enhancements when encoding/decoding non-ascii chars.
202 root 1.100 - minor speedup in number encoding case.
203 root 1.92 - extend and clarify the section on incompatibilities
204     between YAML and JSON.
205 root 1.95 - switch to static inline from just inline when using gcc.
206 root 1.94 - add =encoding utf-8 to the manpage, now that perl 5.10 supports it.
207 root 1.100 - fix some issues with UV to JSON conversion of unknown impact.
208 root 1.99 - published the yahoo locals search result used in benchmarks as the
209     original url changes so comparison is impossible.
210 root 1.92
211 root 1.91 2.01 Wed Dec 5 11:40:28 CET 2007
212     - INCOMPATIBLE API CHANGE: to_json and from_json have been
213     renamed to encode_json/decode_json for JSON.pm compatibility.
214     The old functions croak and might be replaced by JSON.pm
215     comaptible versions in some later release.
216    
217 root 1.90 2.0 Tue Dec 4 11:30:46 CET 2007
218     - this is supposed to be the first version of JSON::XS
219     compatible with version 2.0+ of the JSON module.
220     Using the JSON module as frontend to JSON::XS should be
221     as fast as using JSON::XS directly, so consider using it
222     instead.
223 root 1.88 - added get_* methods for all "simple" options.
224 root 1.89 - make JSON::XS subclassable.
225 root 1.88
226 root 1.86 1.53 Tue Nov 13 23:58:33 CET 2007
227 root 1.85 - minor doc clarifications.
228     - fixed many doc typos (patch by Thomas L. Shinnick).
229    
230 root 1.84 1.52 Mon Oct 15 03:22:06 CEST 2007
231 root 1.83 - remove =encoding pod directive again, it confuses too many pod
232     parsers :/.
233    
234 root 1.82 1.51 Sat Oct 13 03:55:56 CEST 2007
235 root 1.81 - encode empty arrays/hashes in a compact way when pretty is enabled.
236 root 1.87 - apparently JSON::XS was used to find some bugs in the
237 root 1.80 JSON_checker testsuite, so add (the corrected) JSON_checker tests to
238     the testsuite.
239     - quite a bit of doc updates/extension.
240 root 1.79 - require 5.8.2, as this seems to be the first unicode-stable version.
241 root 1.78
242 root 1.77 1.5 Tue Aug 28 04:05:38 CEST 2007
243 root 1.74 - add support for tied hashes, based on ideas and testcase by
244     Marcus Holland-Moritz.
245 root 1.75 - implemented relaxed parsing mode where some extensions are being
246     accepted. generation is still JSON-only.
247 root 1.74
248     1.44 Wed Aug 22 01:02:44 CEST 2007
249 root 1.73 - very experimental process-emulation support, slowing everything down.
250     the horribly broken perl threads are still not supported - YMMV.
251    
252 root 1.72 1.43 Thu Jul 26 13:26:37 CEST 2007
253     - convert big json numbers exclusively consisting of digits to NV
254     only when there is no loss of precision, otherwise to string.
255    
256 root 1.71 1.42 Tue Jul 24 00:51:18 CEST 2007
257     - fix a crash caused by not handling missing array elements
258     (report and testcase by Jay Kuri).
259    
260 root 1.70 1.41 Tue Jul 10 18:21:44 CEST 2007
261     - fix compilation with NDEBUG (assert side-effect),
262     affects convert_blessed only.
263 root 1.69 - fix a bug in decode filters calling ENTER; SAVETMPS;
264     one time too often.
265 root 1.70 - catch a typical error in TO_JSON methods.
266 root 1.69 - antique-ised XS.xs again to work with outdated
267     C compilers (windows...).
268    
269 root 1.68 1.4 Mon Jul 2 10:06:30 CEST 2007
270 root 1.63 - add convert_blessed setting.
271 root 1.56 - encode did not catch all blessed objects, encoding their
272     contents in most cases. This has been fixed by introducing
273     the allow_blessed setting.
274 root 1.65 - added filter_json_object and filter_json_single_key_object
275     settings that specify a callback to be called when
276 root 1.67 all/specific json objects are encountered.
277 root 1.59 - assume that most object keys are simple ascii words and
278     optimise this case, penalising the general case. This can
279     speed up decoding by 30% in typical cases and gives
280     a smaller and faster perl hash.
281 root 1.58 - implemented simpleminded, optional resource size checking
282     in decode_json.
283 root 1.61 - remove objToJson/jsonToObj aliases, as the next version
284     of JSON will not have them either.
285 root 1.62 - bit the bullet and converted the very simple json object
286     into a more complex one.
287 root 1.64 - work around a bug where perl wrongly claims an integer
288     is not an integer.
289 root 1.65 - unbundle JSON::XS::Boolean into own pm file so Storable
290     and similar modules can resolve the overloading when thawing.
291 root 1.56
292 root 1.55 1.3 Sun Jun 24 01:55:02 CEST 2007
293 root 1.54 - make JSON::XS::true and false special overloaded objects
294     and return those instead of 1 and 0 for those json atoms
295     (JSON::PP compatibility is NOT achieved yet).
296     - add JSON::XS::is_bool predicate to test for those special
297     values.
298 root 1.52 - add a reference to
299     http://jpsykes.com/47/practical-csrf-and-json-security.
300 root 1.60 - removed require 5.8.8 again, it is just not very expert-friendly.
301     Also try to be more compatible with slightly older versions,
302 root 1.54 which are not recommended (because they are buggy).
303 root 1.52
304 root 1.51 1.24 Mon Jun 11 05:40:49 CEST 2007
305 root 1.49 - added informative section on JSON-as-YAML.
306 root 1.51 - get rid of some c99-isms again.
307 root 1.50 - localise dec->cur in decode_str, speeding up
308     string decoding considerably (>15% on my amd64 + gcc).
309     - increased SHORT_STRING_LEN to 16kb: stack space is
310     usually plenty, and this actually saves memory
311 root 1.51 when !shrinking as short strings will fit perfectly.
312 root 1.49
313 root 1.47 1.23 Wed Jun 6 20:13:06 CEST 2007
314 root 1.46 - greatly improved small integer encoding and decoding speed.
315     - implement a number of µ-optimisations.
316 root 1.47 - updated benchmarks.
317 root 1.46
318 root 1.45 1.22 Thu May 24 00:07:25 CEST 2007
319 root 1.42 - require 5.8.8 explicitly as older perls do not seem to offer
320     the required macros.
321 root 1.43 - possibly made it compile on so-called C compilers by microsoft.
322 root 1.42
323 root 1.41 1.21 Wed May 9 18:40:32 CEST 2007
324 root 1.47 - character offset reported for trailing garbage was random.
325 root 1.41
326 root 1.40 1.2 Wed May 9 18:35:01 CEST 2007
327     - decode did not work with magical scalars (doh!).
328 root 1.38 - added latin1 flag to produce JSON texts in the latin1 subset
329     of unicode.
330 root 1.39 - flag trailing garbage as error.
331     - new decode_prefix method that returns the number
332     of characters consumed by a decode.
333 root 1.40 - max octets/char in perls UTF-X is actually 13, not 11,
334     as pointed out by Glenn Linderman.
335     - fixed typoe reported by YAMASHINA Hio.
336 root 1.34
337 root 1.32 1.11 Mon Apr 9 07:05:49 CEST 2007
338     - properly 0-terminate sv's returned by encode to help
339     C libraries that expect that 0 to be there.
340 root 1.31 - partially "port" JSON from C to microsofts fucking broken
341     pseudo-C. They should be burned to the ground for pissing
342     on standards. And I should be stoned for even trying to
343 root 1.32 support this filthy excuse for a c compiler.
344 root 1.6
345 root 1.30 1.1 Wed Apr 4 01:45:00 CEST 2007
346 root 1.28 - clarify documentation (pointed out by Quinn Weaver).
347 root 1.29 - decode_utf8 sometimes did not correctly flag errors,
348     leading to segfaults.
349 root 1.30 - further reduced default nesting depth to 512 due to the test
350     failure by that anonymous "chris" whose e-mail address seems
351     to be impossible to get. Tests on other freebsd systems indicate
352     that this is likely a problem in his/her configuration and not this
353     module.
354     - renamed json => JSON in error messages.
355     - corrected the character offset in some error messages.
356 root 1.28
357 root 1.27 1.01 Sat Mar 31 16:15:40 CEST 2007
358     - do not segfault when from_json/decode gets passed
359     a non-string object (reported by Florian Ragwitz).
360     This has no effect on normal operation.
361    
362 root 1.25 1.0 Thu Mar 29 04:43:34 CEST 2007
363     - the long awaited (by me) 1.0 version.
364     - add \0 (JSON::XS::false) and \1 (JSON::XS::true) mappings to JSON
365     true and false.
366 root 1.24 - add some more notes to shrink, as suggested by Alex Efros.
367 root 1.25 - improve testsuite.
368 root 1.26 - halve the default nesting depth limit, to hopefully make it
369 root 1.25 work on Freebsd (unfortunately, the cpan tester did not
370     send me his report, so I cannot ask about the stack limit on fbsd).
371 root 1.24
372 root 1.23 0.8 Mon Mar 26 00:10:48 CEST 2007
373 root 1.21 - fix a memleak when decoding hashes.
374 root 1.20 - export jsonToBj and objToJson as aliases
375     to to_json and from_json, to reduce incompatibilities
376     between JSON/JSON::PC and JSON::XS. (experimental).
377 root 1.21 - implement a maximum nesting depth for both en- and de-coding.
378     - added a security considerations sections.
379 root 1.20
380 root 1.19 0.7 Sun Mar 25 01:46:30 CET 2007
381 root 1.16 - code cleanup.
382     - fix a memory overflow bug when indenting.
383     - pretty-printing now up to 15% faster.
384     - improve decoding speed of strings by
385     up to 50% by specialcasing short strings.
386     - further decoding speedups for strings using
387     lots of \u escapes.
388 root 1.17 - improve utf8 decoding speed for U+80 .. U+7FF.
389 root 1.16
390 root 1.15 0.5 Sat Mar 24 20:41:51 CET 2007
391 root 1.14 - added the UTF-16 encoding example hinted at in previous
392     versions.
393     - minor documentation fixes.
394 root 1.15 - fix a bug in and optimise canonicalising fastpath
395     (reported by Craig Manley).
396     - remove a subtest that breaks with bleadperl (reported
397     by Andreas König).
398 root 1.14
399 root 1.13 0.31 Sat Mar 24 02:14:34 CET 2007
400 root 1.12 - documentation updates.
401 root 1.13 - do some casting to hopefully fix Andreas' problem.
402     - nuke bogus json rpc stuff.
403 root 1.12
404 root 1.11 0.3 Fri Mar 23 19:33:21 CET 2007
405 root 1.5 - remove spurious PApp::Util reference (John McNamara).
406     - adapted lots of tests from other json modules
407     (idea by Chris Carline).
408 root 1.9 - documented mapping from json to perl and vice versa.
409 root 1.11 - improved the documentation by adding more examples.
410 root 1.5 - added short escaping forms, reducing the created
411     json texts a bit.
412     - added shrink flag.
413     - when flag methods are called without enable argument
414     they will by default enable their flag.
415     - considerably improved string encoding speed (at least
416     with gcc 4).
417 root 1.7 - added a test that covers lots of different characters.
418     - clarified some error messages.
419     - error messages now use correct character offset
420     with F_UTF8.
421 root 1.8 - improve the "no bytes" and "no warnings" hacks in
422     case the called functions do... stuff.
423 root 1.9 - croak when encoding to ascii and an out-of-range
424     (non-unicode) codepoint is encountered.
425 root 1.4
426 root 1.3 0.2 Fri Mar 23 00:23:34 CET 2007
427 root 1.109 - the "could not sleep without debugging release".
428 root 1.3 it should basically work now, with many bugs as
429     no production tests have been run yet.
430     - added more testcases.
431     - the expected shitload of bugfixes.
432     - handle utf8 flag correctly in decode.
433     - fix segfault in decoder.
434     - utf8n_to_uvuni sets retlen to -1, but retlen is an
435     unsigned types (argh).
436     - fix decoding of utf-8 strings.
437     - improved error diagnostics.
438     - fix decoding of 'null'.
439     - fix parsing of empty array/hashes
440     - silence warnings when we prepare the croak message.
441    
442 root 1.2 0.1 Thu Mar 22 22:13:43 CET 2007
443     - first release, very untested, basically just to claim
444     the namespace.
445 root 1.1
446     0.01 Thu Mar 22 06:08:12 CET 2007
447     - original version; cloned from Convert-Scalar
448