1 |
Revision history for Perl extension JSON::XS |
2 |
|
3 |
TODO: maybe detect and croak on more invalid inputs (e.g. +-inf/nan) |
4 |
TODO: maybe avoid the reblessing and better support readonly objects. |
5 |
TODO: how to cope with tagged values and standard json decoders |
6 |
TODO: investigate magic (Eric Brine) |
7 |
TODO: [PATCH] Types::Serialiser: Inline true(), false() and error() functions |
8 |
|
9 |
TODO: testcase Wesley Schwengle |
10 |
4.02 |
11 |
- undo the fix from 4.01, it breaks more things than it fixes. |
12 |
|
13 |
4.01 Sun Feb 24 05:03:30 CET 2019 |
14 |
- fix some stack corruption caused mostly when calling methods |
15 |
in list context (tewstcase by Wesley Schwengle). |
16 |
|
17 |
4.0 Fri Nov 16 00:06:54 CET 2018 |
18 |
- SECURITY IMPLICATION: this release enables allow_nonref by default |
19 |
for compatibnility with RFC 7159 and newer. See "old" vs. "new" |
20 |
JSON under SECURITY CONSIDERATIONS. |
21 |
- reworked the "old" vs. "new" JSON section. |
22 |
- add ->boolean_values to provide the values to which booleans |
23 |
decode (requested by Aristotle Pagaltzis). |
24 |
- decode would wrongly accept ASCII NUL characters instead of |
25 |
reporting them as trailing garbage. |
26 |
- work around what smells like a perl bug w.r.t. exceptions |
27 |
thrown in callbacks. |
28 |
- incremental parser now more or less respects allow_nonref. |
29 |
- json_xs json-pretty now enables canonical mode. |
30 |
- add documentation section about I-JSON. |
31 |
- minor documentation fixes/updates. |
32 |
|
33 |
3.04 Thu Aug 17 04:30:47 CEST 2017 |
34 |
- change exponential realloc algorithm on encoding and string decoding to be |
35 |
really exponential (this helps slow/debugging allocators such as libumem) |
36 |
(reported by Matthew Horsfall). |
37 |
- string encoding would needlessly overallocate output space |
38 |
(testcase by Matthew Horsfall). |
39 |
- be very paranoid about extending buffer lengths and croak if buffers get too large, |
40 |
which might (or might not) improve security. |
41 |
- add cbor-packed type to json_xs. |
42 |
- switch from YAML to YAML::XS in json_xs, as YAML is way too buggy and outdated. |
43 |
|
44 |
3.03 Wed Nov 16 20:20:59 CET 2016 |
45 |
- fix a bug introduced by a perl bug workaround that would cause |
46 |
incremental parsing to fail with a sv_chop panic. |
47 |
- json_xs: toformat failure error message fixed. |
48 |
- json_xs: allow cyclic data structures in CBOR. |
49 |
|
50 |
3.02 Fri Feb 26 22:45:20 CET 2016 |
51 |
- allow_nonref now affects booleans (\1, $Types::Serialiser::Boolean) |
52 |
as well (reported by Alex Efros). |
53 |
- allow literal tabs in strings in relaxed mode (patch by |
54 |
lubo.rintel@gooddata.com). |
55 |
- support "cbor" format in json_xs tool. |
56 |
- support (and fix) calling encode and decode in list context |
57 |
(reported by Вадим Власов). |
58 |
- work around a bug in older perls crashing when presented |
59 |
with shared hash keys (Reini Urban). |
60 |
- use stability canary. |
61 |
|
62 |
3.01 Tue Oct 29 16:55:15 CET 2013 |
63 |
- backport to perls < 5.18 (reported by Paul Howarth). |
64 |
|
65 |
3.0 Tue Oct 29 01:35:37 CET 2013 |
66 |
- implemented an object tagging extension (using the |
67 |
Types::Serialiser serialisation protocol). |
68 |
- reworked the documentation regarding object serialisation, |
69 |
add a new OBJECT SERIALISATION section that explains th |
70 |
whole process. |
71 |
- new setting: allow_tags. |
72 |
- switch to Types::Serialiser booleans. |
73 |
- remove to_json/from_json. |
74 |
- other minor improvements to the documentation. |
75 |
|
76 |
2.34 Thu May 23 11:30:34 CEST 2013 |
77 |
- work around bugs in perl 5.18 breaking more than 100 |
78 |
widely used modules, without a fix in sight because |
79 |
p5pers don't care about CPAN anymore. |
80 |
- when canonicalising, only allocate up to 64 hash key |
81 |
pointers on the stack. for larger hashes, use the heap, |
82 |
to avoid using too much stackspace. |
83 |
- discuss the problem with setlocale (reported by a few victims). |
84 |
|
85 |
2.33 Wed Aug 1 21:03:52 CEST 2012 |
86 |
- internal encode/decode XS wrappers did not expect stack |
87 |
moves caused by callbacks (analyzed and testcase by Jesse Luehrs). |
88 |
- add bencode as to/from option in bin/json_xs. |
89 |
- add -e option to json_xs, and none and string in/out formats. |
90 |
|
91 |
2.32 Thu Aug 11 19:06:38 CEST 2011 |
92 |
- fix a bug in the initial whitespace accumulation. |
93 |
|
94 |
2.31 Wed Jul 27 17:53:05 CEST 2011 |
95 |
- don't accumulate initial whitespace in the incremental buffer |
96 |
(this can be useful to allow whitespace-keepalive on a tcp |
97 |
connection without triggering the max_size limit). |
98 |
- properly croak on some invalid inputs that are not strings |
99 |
(e.g. undef) when trying to decode a json text (reported |
100 |
and analyzed by Goro Fuji). |
101 |
|
102 |
2.3 Wed Aug 18 01:26:47 CEST 2010 |
103 |
- make sure decoder doesn't change the decoding in the incremental |
104 |
parser (testcase provided by Hendrik Schumacher). |
105 |
- applied patch by DaTa for Data::Dumper support in json_xs. |
106 |
- added -t dump support to json_xs, using Data::Dump. |
107 |
- added -f eval support to json_xs. |
108 |
|
109 |
2.29 Wed Mar 17 02:39:12 CET 2010 |
110 |
- fix a memory leak when callbacks set using filter_json_object |
111 |
or filter_json_single_key_object were called (great testcase |
112 |
by Eric Wilhelm). |
113 |
|
114 |
2.28 Thu Mar 11 20:30:46 CET 2010 |
115 |
- implement our own atof function - perl's can be orders of |
116 |
magnitudes slower than even the system one. on the positive |
117 |
side, ours seems to be more exact in general than perl's. |
118 |
(testcase provided by Tim Meadowcroft). |
119 |
- clarify floating point conversion issues a bit. |
120 |
- update jpsykes csrf article url. |
121 |
- updated benchmark section - JSON::PP became much faster! |
122 |
|
123 |
2.27 Thu Jan 7 07:35:08 CET 2010 |
124 |
- support relaxed option inside the incremental parser |
125 |
(testcase provided by IKEGAMI via Makamaka). |
126 |
|
127 |
2.26 Sat Oct 10 03:26:19 CEST 2009 |
128 |
- big integers could become truncated (based on patch |
129 |
by Strobl Anton). |
130 |
- output format change: indent now adds a final newline, which is |
131 |
more expected and more true to the documentation. |
132 |
|
133 |
2.25 Sat Aug 8 12:04:41 CEST 2009 |
134 |
- the perl debugger completely breaks lvalue subs - try to work |
135 |
around the issue. |
136 |
- ignore RMAGICAL hashes w.r.t. CANONICAL. |
137 |
- try to work around a possible char signedness issue on aix. |
138 |
- require common sense. |
139 |
|
140 |
2.24 Sat May 30 08:25:45 CEST 2009 |
141 |
- the incremental parser did not update its parse offset |
142 |
pointer correctly when parsing utf8-strings (nicely |
143 |
debugged by Martin Evans). |
144 |
- appending a non-utf8-string to the incremental parser |
145 |
in utf8 mode failed to upgrade the string. |
146 |
- wording of parse error messages has been improved. |
147 |
|
148 |
2.232 Sun Feb 22 11:12:25 CET 2009 |
149 |
- use an exponential algorithm to extend strings, to |
150 |
help platforms with bad or abysmal==windows memory |
151 |
allocater performance, at the expense of some memory |
152 |
wastage (use shrink to recover this extra memory). |
153 |
(nicely analysed by Dmitry Karasik). |
154 |
|
155 |
2.2311 Thu Feb 19 02:12:54 CET 2009 |
156 |
- add a section "JSON and ECMAscript" to explain some |
157 |
incompatibilities between the two (problem was noted by |
158 |
various people). |
159 |
- add t/20_faihu.t. |
160 |
|
161 |
2.231 Thu Nov 20 04:59:08 CET 2008 |
162 |
- work around 5.10.0 magic bugs where manipulating magic values |
163 |
(such as $1) would permanently damage them as perl would |
164 |
ignore the magicalness, by making a full copy of the string, |
165 |
reported by Dmitry Karasik. |
166 |
- work around spurious warnings under older perl 5.8's. |
167 |
|
168 |
2.23 Mon Sep 29 05:08:29 CEST 2008 |
169 |
- fix a compilation problem when perl is not using char * as, well, |
170 |
char *. |
171 |
- use PL_hexdigit in favour of rolling our own. |
172 |
|
173 |
2.2222 Sun Jul 20 18:49:00 CEST 2008 |
174 |
- same game again, broken 5.10 finds yet another assertion |
175 |
failure, and the workaround causes additional runtime warnings. |
176 |
Work around the next assertion AND the warning. 5.10 seriously |
177 |
needs to adjust it's attitude against working code. |
178 |
|
179 |
2.222 Sat Jul 19 06:15:34 CEST 2008 |
180 |
- you work around one -DDEBUGGING assertion bug in perl 5.10 |
181 |
just to hit the next one. work around this one, too. |
182 |
|
183 |
2.22 Tue Jul 15 13:26:51 CEST 2008 |
184 |
- allow higher nesting levels in incremental parser. |
185 |
- error out earlier in some cases in the incremental parser |
186 |
(as suggested by Yuval Kogman). |
187 |
- improve incr-parser test (Yuval Kogman). |
188 |
|
189 |
2.21 Tue Jun 3 08:43:23 CEST 2008 |
190 |
- (hopefully) work around a perl 5.10 bug with -DDEBUGGING. |
191 |
- remove the experimental status of the incremental parser interface. |
192 |
- move =encoding around again, to avoid bugs with search.cpan.org. |
193 |
when can we finally have utf-8 in pod??? |
194 |
- add ->incr_reset method. |
195 |
|
196 |
2.2 Wed Apr 16 20:37:25 CEST 2008 |
197 |
- lifted the log2 rounding restriction of max_depth and max_size. |
198 |
- make booleans mutable by creating a copy instead of handing out |
199 |
the same scalar (reported by pasha sadri). |
200 |
- added support for incremental json parsing (still EXPERIMENTAL). |
201 |
- implemented and added a json_xs command line utility that can convert |
202 |
from/to a number of serialisation formats - tell me if you need more. |
203 |
- implement allow_unknown/get_allow_unknown methods. |
204 |
- fixed documentation of max_depth w.r.t. higher and equal. |
205 |
- moved down =encoding directive a bit, too much breaks if it's the first |
206 |
pod directive :/. |
207 |
- removed documentation section on other modules, it became somewhat |
208 |
outdated and is nowadays mostly of historical interest. |
209 |
|
210 |
2.1 Wed Mar 19 23:23:18 CET 2008 |
211 |
- update documentation here and there: add a large section |
212 |
about utf8/latin1/ascii flags, add a security consideration |
213 |
and extend and clarify the JSON and YAML section. |
214 |
- medium speed enhancements when encoding/decoding non-ascii chars. |
215 |
- minor speedup in number encoding case. |
216 |
- extend and clarify the section on incompatibilities |
217 |
between YAML and JSON. |
218 |
- switch to static inline from just inline when using gcc. |
219 |
- add =encoding utf-8 to the manpage, now that perl 5.10 supports it. |
220 |
- fix some issues with UV to JSON conversion of unknown impact. |
221 |
- published the yahoo locals search result used in benchmarks as the |
222 |
original url changes so comparison is impossible. |
223 |
|
224 |
2.01 Wed Dec 5 11:40:28 CET 2007 |
225 |
- INCOMPATIBLE API CHANGE: to_json and from_json have been |
226 |
renamed to encode_json/decode_json for JSON.pm compatibility. |
227 |
The old functions croak and might be replaced by JSON.pm |
228 |
comaptible versions in some later release. |
229 |
|
230 |
2.0 Tue Dec 4 11:30:46 CET 2007 |
231 |
- this is supposed to be the first version of JSON::XS |
232 |
compatible with version 2.0+ of the JSON module. |
233 |
Using the JSON module as frontend to JSON::XS should be |
234 |
as fast as using JSON::XS directly, so consider using it |
235 |
instead. |
236 |
- added get_* methods for all "simple" options. |
237 |
- make JSON::XS subclassable. |
238 |
|
239 |
1.53 Tue Nov 13 23:58:33 CET 2007 |
240 |
- minor doc clarifications. |
241 |
- fixed many doc typos (patch by Thomas L. Shinnick). |
242 |
|
243 |
1.52 Mon Oct 15 03:22:06 CEST 2007 |
244 |
- remove =encoding pod directive again, it confuses too many pod |
245 |
parsers :/. |
246 |
|
247 |
1.51 Sat Oct 13 03:55:56 CEST 2007 |
248 |
- encode empty arrays/hashes in a compact way when pretty is enabled. |
249 |
- apparently JSON::XS was used to find some bugs in the |
250 |
JSON_checker testsuite, so add (the corrected) JSON_checker tests to |
251 |
the testsuite. |
252 |
- quite a bit of doc updates/extension. |
253 |
- require 5.8.2, as this seems to be the first unicode-stable version. |
254 |
|
255 |
1.5 Tue Aug 28 04:05:38 CEST 2007 |
256 |
- add support for tied hashes, based on ideas and testcase by |
257 |
Marcus Holland-Moritz. |
258 |
- implemented relaxed parsing mode where some extensions are being |
259 |
accepted. generation is still JSON-only. |
260 |
|
261 |
1.44 Wed Aug 22 01:02:44 CEST 2007 |
262 |
- very experimental process-emulation support, slowing everything down. |
263 |
the horribly broken perl threads are still not supported - YMMV. |
264 |
|
265 |
1.43 Thu Jul 26 13:26:37 CEST 2007 |
266 |
- convert big json numbers exclusively consisting of digits to NV |
267 |
only when there is no loss of precision, otherwise to string. |
268 |
|
269 |
1.42 Tue Jul 24 00:51:18 CEST 2007 |
270 |
- fix a crash caused by not handling missing array elements |
271 |
(report and testcase by Jay Kuri). |
272 |
|
273 |
1.41 Tue Jul 10 18:21:44 CEST 2007 |
274 |
- fix compilation with NDEBUG (assert side-effect), |
275 |
affects convert_blessed only. |
276 |
- fix a bug in decode filters calling ENTER; SAVETMPS; |
277 |
one time too often. |
278 |
- catch a typical error in TO_JSON methods. |
279 |
- antique-ised XS.xs again to work with outdated |
280 |
C compilers (windows...). |
281 |
|
282 |
1.4 Mon Jul 2 10:06:30 CEST 2007 |
283 |
- add convert_blessed setting. |
284 |
- encode did not catch all blessed objects, encoding their |
285 |
contents in most cases. This has been fixed by introducing |
286 |
the allow_blessed setting. |
287 |
- added filter_json_object and filter_json_single_key_object |
288 |
settings that specify a callback to be called when |
289 |
all/specific json objects are encountered. |
290 |
- assume that most object keys are simple ascii words and |
291 |
optimise this case, penalising the general case. This can |
292 |
speed up decoding by 30% in typical cases and gives |
293 |
a smaller and faster perl hash. |
294 |
- implemented simpleminded, optional resource size checking |
295 |
in decode_json. |
296 |
- remove objToJson/jsonToObj aliases, as the next version |
297 |
of JSON will not have them either. |
298 |
- bit the bullet and converted the very simple json object |
299 |
into a more complex one. |
300 |
- work around a bug where perl wrongly claims an integer |
301 |
is not an integer. |
302 |
- unbundle JSON::XS::Boolean into own pm file so Storable |
303 |
and similar modules can resolve the overloading when thawing. |
304 |
|
305 |
1.3 Sun Jun 24 01:55:02 CEST 2007 |
306 |
- make JSON::XS::true and false special overloaded objects |
307 |
and return those instead of 1 and 0 for those json atoms |
308 |
(JSON::PP compatibility is NOT achieved yet). |
309 |
- add JSON::XS::is_bool predicate to test for those special |
310 |
values. |
311 |
- add a reference to |
312 |
http://jpsykes.com/47/practical-csrf-and-json-security. |
313 |
- removed require 5.8.8 again, it is just not very expert-friendly. |
314 |
Also try to be more compatible with slightly older versions, |
315 |
which are not recommended (because they are buggy). |
316 |
|
317 |
1.24 Mon Jun 11 05:40:49 CEST 2007 |
318 |
- added informative section on JSON-as-YAML. |
319 |
- get rid of some c99-isms again. |
320 |
- localise dec->cur in decode_str, speeding up |
321 |
string decoding considerably (>15% on my amd64 + gcc). |
322 |
- increased SHORT_STRING_LEN to 16kb: stack space is |
323 |
usually plenty, and this actually saves memory |
324 |
when !shrinking as short strings will fit perfectly. |
325 |
|
326 |
1.23 Wed Jun 6 20:13:06 CEST 2007 |
327 |
- greatly improved small integer encoding and decoding speed. |
328 |
- implement a number of µ-optimisations. |
329 |
- updated benchmarks. |
330 |
|
331 |
1.22 Thu May 24 00:07:25 CEST 2007 |
332 |
- require 5.8.8 explicitly as older perls do not seem to offer |
333 |
the required macros. |
334 |
- possibly made it compile on so-called C compilers by microsoft. |
335 |
|
336 |
1.21 Wed May 9 18:40:32 CEST 2007 |
337 |
- character offset reported for trailing garbage was random. |
338 |
|
339 |
1.2 Wed May 9 18:35:01 CEST 2007 |
340 |
- decode did not work with magical scalars (doh!). |
341 |
- added latin1 flag to produce JSON texts in the latin1 subset |
342 |
of unicode. |
343 |
- flag trailing garbage as error. |
344 |
- new decode_prefix method that returns the number |
345 |
of characters consumed by a decode. |
346 |
- max octets/char in perls UTF-X is actually 13, not 11, |
347 |
as pointed out by Glenn Linderman. |
348 |
- fixed typoe reported by YAMASHINA Hio. |
349 |
|
350 |
1.11 Mon Apr 9 07:05:49 CEST 2007 |
351 |
- properly 0-terminate sv's returned by encode to help |
352 |
C libraries that expect that 0 to be there. |
353 |
- partially "port" JSON from C to microsofts fucking broken |
354 |
pseudo-C. They should be burned to the ground for pissing |
355 |
on standards. And I should be stoned for even trying to |
356 |
support this filthy excuse for a c compiler. |
357 |
|
358 |
1.1 Wed Apr 4 01:45:00 CEST 2007 |
359 |
- clarify documentation (pointed out by Quinn Weaver). |
360 |
- decode_utf8 sometimes did not correctly flag errors, |
361 |
leading to segfaults. |
362 |
- further reduced default nesting depth to 512 due to the test |
363 |
failure by that anonymous "chris" whose e-mail address seems |
364 |
to be impossible to get. Tests on other freebsd systems indicate |
365 |
that this is likely a problem in his/her configuration and not this |
366 |
module. |
367 |
- renamed json => JSON in error messages. |
368 |
- corrected the character offset in some error messages. |
369 |
|
370 |
1.01 Sat Mar 31 16:15:40 CEST 2007 |
371 |
- do not segfault when from_json/decode gets passed |
372 |
a non-string object (reported by Florian Ragwitz). |
373 |
This has no effect on normal operation. |
374 |
|
375 |
1.0 Thu Mar 29 04:43:34 CEST 2007 |
376 |
- the long awaited (by me) 1.0 version. |
377 |
- add \0 (JSON::XS::false) and \1 (JSON::XS::true) mappings to JSON |
378 |
true and false. |
379 |
- add some more notes to shrink, as suggested by Alex Efros. |
380 |
- improve testsuite. |
381 |
- halve the default nesting depth limit, to hopefully make it |
382 |
work on Freebsd (unfortunately, the cpan tester did not |
383 |
send me his report, so I cannot ask about the stack limit on fbsd). |
384 |
|
385 |
0.8 Mon Mar 26 00:10:48 CEST 2007 |
386 |
- fix a memleak when decoding hashes. |
387 |
- export jsonToBj and objToJson as aliases |
388 |
to to_json and from_json, to reduce incompatibilities |
389 |
between JSON/JSON::PC and JSON::XS. (experimental). |
390 |
- implement a maximum nesting depth for both en- and de-coding. |
391 |
- added a security considerations sections. |
392 |
|
393 |
0.7 Sun Mar 25 01:46:30 CET 2007 |
394 |
- code cleanup. |
395 |
- fix a memory overflow bug when indenting. |
396 |
- pretty-printing now up to 15% faster. |
397 |
- improve decoding speed of strings by |
398 |
up to 50% by specialcasing short strings. |
399 |
- further decoding speedups for strings using |
400 |
lots of \u escapes. |
401 |
- improve utf8 decoding speed for U+80 .. U+7FF. |
402 |
|
403 |
0.5 Sat Mar 24 20:41:51 CET 2007 |
404 |
- added the UTF-16 encoding example hinted at in previous |
405 |
versions. |
406 |
- minor documentation fixes. |
407 |
- fix a bug in and optimise canonicalising fastpath |
408 |
(reported by Craig Manley). |
409 |
- remove a subtest that breaks with bleadperl (reported |
410 |
by Andreas König). |
411 |
|
412 |
0.31 Sat Mar 24 02:14:34 CET 2007 |
413 |
- documentation updates. |
414 |
- do some casting to hopefully fix Andreas' problem. |
415 |
- nuke bogus json rpc stuff. |
416 |
|
417 |
0.3 Fri Mar 23 19:33:21 CET 2007 |
418 |
- remove spurious PApp::Util reference (John McNamara). |
419 |
- adapted lots of tests from other json modules |
420 |
(idea by Chris Carline). |
421 |
- documented mapping from json to perl and vice versa. |
422 |
- improved the documentation by adding more examples. |
423 |
- added short escaping forms, reducing the created |
424 |
json texts a bit. |
425 |
- added shrink flag. |
426 |
- when flag methods are called without enable argument |
427 |
they will by default enable their flag. |
428 |
- considerably improved string encoding speed (at least |
429 |
with gcc 4). |
430 |
- added a test that covers lots of different characters. |
431 |
- clarified some error messages. |
432 |
- error messages now use correct character offset |
433 |
with F_UTF8. |
434 |
- improve the "no bytes" and "no warnings" hacks in |
435 |
case the called functions do... stuff. |
436 |
- croak when encoding to ascii and an out-of-range |
437 |
(non-unicode) codepoint is encountered. |
438 |
|
439 |
0.2 Fri Mar 23 00:23:34 CET 2007 |
440 |
- the "could not sleep without debugging release". |
441 |
it should basically work now, with many bugs as |
442 |
no production tests have been run yet. |
443 |
- added more testcases. |
444 |
- the expected shitload of bugfixes. |
445 |
- handle utf8 flag correctly in decode. |
446 |
- fix segfault in decoder. |
447 |
- utf8n_to_uvuni sets retlen to -1, but retlen is an |
448 |
unsigned types (argh). |
449 |
- fix decoding of utf-8 strings. |
450 |
- improved error diagnostics. |
451 |
- fix decoding of 'null'. |
452 |
- fix parsing of empty array/hashes |
453 |
- silence warnings when we prepare the croak message. |
454 |
|
455 |
0.1 Thu Mar 22 22:13:43 CET 2007 |
456 |
- first release, very untested, basically just to claim |
457 |
the namespace. |
458 |
|
459 |
0.01 Thu Mar 22 06:08:12 CET 2007 |
460 |
- original version; cloned from Convert-Scalar |
461 |
|