| 1 | Revision history for Perl extension JSON::XS |
1 | Revision history for Perl extension JSON::XS |
| 2 | |
2 | |
| 3 | TODO: maybe use some overload magic to decode true and false into something |
3 | TODO: maybe detect and croak on more invalid inputs (e.g. +-inf/nan) |
| 4 | not 0 or 1 in perl. or use attached magic? |
4 | TODO: maybe avoid the reblessing and better support readonly objects. |
| 5 | TODO: get rid of dynamic arrays to support so-called C compilers |
5 | TODO: how to cope with tagged values and standard json decoders |
| 6 | by fucking microsoft that do not do C. argl, snprintf is also |
6 | TODO: investigate magic (Eric Brine) |
| 7 | missing. |
7 | TODO: [PATCH] Types::Serialiser: Inline true(), false() and error() functions |
| 8 | TODO: latin1 flag working similar to ascii. |
|
|
| 9 | |
8 | |
|
|
9 | 4.01 Sun Feb 24 05:03:30 CET 2019 |
|
|
10 | - fix some stack corruption caused mostly when calling methods |
|
|
11 | in list context (tewstcase by Wesley Schwengle). |
|
|
12 | |
|
|
13 | 4.0 Fri Nov 16 00:06:54 CET 2018 |
|
|
14 | - SECURITY IMPLICATION: this release enables allow_nonref by default |
|
|
15 | for compatibnility with RFC 7159 and newer. See "old" vs. "new" |
|
|
16 | JSON under SECURITY CONSIDERATIONS. |
|
|
17 | - reworked the "old" vs. "new" JSON section. |
|
|
18 | - add ->boolean_values to provide the values to which booleans |
|
|
19 | decode (requested by Aristotle Pagaltzis). |
|
|
20 | - decode would wrongly accept ASCII NUL characters instead of |
|
|
21 | reporting them as trailing garbage. |
|
|
22 | - work around what smells like a perl bug w.r.t. exceptions |
|
|
23 | thrown in callbacks. |
|
|
24 | - incremental parser now more or less respects allow_nonref. |
|
|
25 | - json_xs json-pretty now enables canonical mode. |
|
|
26 | - add documentation section about I-JSON. |
|
|
27 | - minor documentation fixes/updates. |
|
|
28 | |
|
|
29 | 3.04 Thu Aug 17 04:30:47 CEST 2017 |
|
|
30 | - change exponential realloc algorithm on encoding and string decoding to be |
|
|
31 | really exponential (this helps slow/debugging allocators such as libumem) |
|
|
32 | (reported by Matthew Horsfall). |
|
|
33 | - string encoding would needlessly overallocate output space |
|
|
34 | (testcase by Matthew Horsfall). |
|
|
35 | - be very paranoid about extending buffer lengths and croak if buffers get too large, |
|
|
36 | which might (or might not) improve security. |
|
|
37 | - add cbor-packed type to json_xs. |
|
|
38 | - switch from YAML to YAML::XS in json_xs, as YAML is way too buggy and outdated. |
|
|
39 | |
|
|
40 | 3.03 Wed Nov 16 20:20:59 CET 2016 |
|
|
41 | - fix a bug introduced by a perl bug workaround that would cause |
|
|
42 | incremental parsing to fail with a sv_chop panic. |
|
|
43 | - json_xs: toformat failure error message fixed. |
|
|
44 | - json_xs: allow cyclic data structures in CBOR. |
|
|
45 | |
|
|
46 | 3.02 Fri Feb 26 22:45:20 CET 2016 |
|
|
47 | - allow_nonref now affects booleans (\1, $Types::Serialiser::Boolean) |
|
|
48 | as well (reported by Alex Efros). |
|
|
49 | - allow literal tabs in strings in relaxed mode (patch by |
|
|
50 | lubo.rintel@gooddata.com). |
|
|
51 | - support "cbor" format in json_xs tool. |
|
|
52 | - support (and fix) calling encode and decode in list context |
|
|
53 | (reported by Вадим Власов). |
|
|
54 | - work around a bug in older perls crashing when presented |
|
|
55 | with shared hash keys (Reini Urban). |
|
|
56 | - use stability canary. |
|
|
57 | |
|
|
58 | 3.01 Tue Oct 29 16:55:15 CET 2013 |
|
|
59 | - backport to perls < 5.18 (reported by Paul Howarth). |
|
|
60 | |
|
|
61 | 3.0 Tue Oct 29 01:35:37 CET 2013 |
|
|
62 | - implemented an object tagging extension (using the |
|
|
63 | Types::Serialiser serialisation protocol). |
|
|
64 | - reworked the documentation regarding object serialisation, |
|
|
65 | add a new OBJECT SERIALISATION section that explains th |
|
|
66 | whole process. |
|
|
67 | - new setting: allow_tags. |
|
|
68 | - switch to Types::Serialiser booleans. |
|
|
69 | - remove to_json/from_json. |
|
|
70 | - other minor improvements to the documentation. |
|
|
71 | |
|
|
72 | 2.34 Thu May 23 11:30:34 CEST 2013 |
|
|
73 | - work around bugs in perl 5.18 breaking more than 100 |
|
|
74 | widely used modules, without a fix in sight because |
|
|
75 | p5pers don't care about CPAN anymore. |
|
|
76 | - when canonicalising, only allocate up to 64 hash key |
|
|
77 | pointers on the stack. for larger hashes, use the heap, |
|
|
78 | to avoid using too much stackspace. |
|
|
79 | - discuss the problem with setlocale (reported by a few victims). |
|
|
80 | |
|
|
81 | 2.33 Wed Aug 1 21:03:52 CEST 2012 |
|
|
82 | - internal encode/decode XS wrappers did not expect stack |
|
|
83 | moves caused by callbacks (analyzed and testcase by Jesse Luehrs). |
|
|
84 | - add bencode as to/from option in bin/json_xs. |
|
|
85 | - add -e option to json_xs, and none and string in/out formats. |
|
|
86 | |
|
|
87 | 2.32 Thu Aug 11 19:06:38 CEST 2011 |
|
|
88 | - fix a bug in the initial whitespace accumulation. |
|
|
89 | |
|
|
90 | 2.31 Wed Jul 27 17:53:05 CEST 2011 |
|
|
91 | - don't accumulate initial whitespace in the incremental buffer |
|
|
92 | (this can be useful to allow whitespace-keepalive on a tcp |
|
|
93 | connection without triggering the max_size limit). |
|
|
94 | - properly croak on some invalid inputs that are not strings |
|
|
95 | (e.g. undef) when trying to decode a json text (reported |
|
|
96 | and analyzed by Goro Fuji). |
|
|
97 | |
|
|
98 | 2.3 Wed Aug 18 01:26:47 CEST 2010 |
|
|
99 | - make sure decoder doesn't change the decoding in the incremental |
|
|
100 | parser (testcase provided by Hendrik Schumacher). |
|
|
101 | - applied patch by DaTa for Data::Dumper support in json_xs. |
|
|
102 | - added -t dump support to json_xs, using Data::Dump. |
|
|
103 | - added -f eval support to json_xs. |
|
|
104 | |
|
|
105 | 2.29 Wed Mar 17 02:39:12 CET 2010 |
|
|
106 | - fix a memory leak when callbacks set using filter_json_object |
|
|
107 | or filter_json_single_key_object were called (great testcase |
|
|
108 | by Eric Wilhelm). |
|
|
109 | |
|
|
110 | 2.28 Thu Mar 11 20:30:46 CET 2010 |
|
|
111 | - implement our own atof function - perl's can be orders of |
|
|
112 | magnitudes slower than even the system one. on the positive |
|
|
113 | side, ours seems to be more exact in general than perl's. |
|
|
114 | (testcase provided by Tim Meadowcroft). |
|
|
115 | - clarify floating point conversion issues a bit. |
|
|
116 | - update jpsykes csrf article url. |
|
|
117 | - updated benchmark section - JSON::PP became much faster! |
|
|
118 | |
|
|
119 | 2.27 Thu Jan 7 07:35:08 CET 2010 |
|
|
120 | - support relaxed option inside the incremental parser |
|
|
121 | (testcase provided by IKEGAMI via Makamaka). |
|
|
122 | |
|
|
123 | 2.26 Sat Oct 10 03:26:19 CEST 2009 |
|
|
124 | - big integers could become truncated (based on patch |
|
|
125 | by Strobl Anton). |
|
|
126 | - output format change: indent now adds a final newline, which is |
|
|
127 | more expected and more true to the documentation. |
|
|
128 | |
|
|
129 | 2.25 Sat Aug 8 12:04:41 CEST 2009 |
|
|
130 | - the perl debugger completely breaks lvalue subs - try to work |
|
|
131 | around the issue. |
|
|
132 | - ignore RMAGICAL hashes w.r.t. CANONICAL. |
|
|
133 | - try to work around a possible char signedness issue on aix. |
|
|
134 | - require common sense. |
|
|
135 | |
|
|
136 | 2.24 Sat May 30 08:25:45 CEST 2009 |
|
|
137 | - the incremental parser did not update its parse offset |
|
|
138 | pointer correctly when parsing utf8-strings (nicely |
|
|
139 | debugged by Martin Evans). |
|
|
140 | - appending a non-utf8-string to the incremental parser |
|
|
141 | in utf8 mode failed to upgrade the string. |
|
|
142 | - wording of parse error messages has been improved. |
|
|
143 | |
|
|
144 | 2.232 Sun Feb 22 11:12:25 CET 2009 |
|
|
145 | - use an exponential algorithm to extend strings, to |
|
|
146 | help platforms with bad or abysmal==windows memory |
|
|
147 | allocater performance, at the expense of some memory |
|
|
148 | wastage (use shrink to recover this extra memory). |
|
|
149 | (nicely analysed by Dmitry Karasik). |
|
|
150 | |
|
|
151 | 2.2311 Thu Feb 19 02:12:54 CET 2009 |
|
|
152 | - add a section "JSON and ECMAscript" to explain some |
|
|
153 | incompatibilities between the two (problem was noted by |
|
|
154 | various people). |
|
|
155 | - add t/20_faihu.t. |
|
|
156 | |
|
|
157 | 2.231 Thu Nov 20 04:59:08 CET 2008 |
|
|
158 | - work around 5.10.0 magic bugs where manipulating magic values |
|
|
159 | (such as $1) would permanently damage them as perl would |
|
|
160 | ignore the magicalness, by making a full copy of the string, |
|
|
161 | reported by Dmitry Karasik. |
|
|
162 | - work around spurious warnings under older perl 5.8's. |
|
|
163 | |
|
|
164 | 2.23 Mon Sep 29 05:08:29 CEST 2008 |
|
|
165 | - fix a compilation problem when perl is not using char * as, well, |
|
|
166 | char *. |
|
|
167 | - use PL_hexdigit in favour of rolling our own. |
|
|
168 | |
|
|
169 | 2.2222 Sun Jul 20 18:49:00 CEST 2008 |
|
|
170 | - same game again, broken 5.10 finds yet another assertion |
|
|
171 | failure, and the workaround causes additional runtime warnings. |
|
|
172 | Work around the next assertion AND the warning. 5.10 seriously |
|
|
173 | needs to adjust it's attitude against working code. |
|
|
174 | |
|
|
175 | 2.222 Sat Jul 19 06:15:34 CEST 2008 |
|
|
176 | - you work around one -DDEBUGGING assertion bug in perl 5.10 |
|
|
177 | just to hit the next one. work around this one, too. |
|
|
178 | |
|
|
179 | 2.22 Tue Jul 15 13:26:51 CEST 2008 |
|
|
180 | - allow higher nesting levels in incremental parser. |
|
|
181 | - error out earlier in some cases in the incremental parser |
|
|
182 | (as suggested by Yuval Kogman). |
|
|
183 | - improve incr-parser test (Yuval Kogman). |
|
|
184 | |
|
|
185 | 2.21 Tue Jun 3 08:43:23 CEST 2008 |
|
|
186 | - (hopefully) work around a perl 5.10 bug with -DDEBUGGING. |
|
|
187 | - remove the experimental status of the incremental parser interface. |
|
|
188 | - move =encoding around again, to avoid bugs with search.cpan.org. |
|
|
189 | when can we finally have utf-8 in pod??? |
|
|
190 | - add ->incr_reset method. |
|
|
191 | |
|
|
192 | 2.2 Wed Apr 16 20:37:25 CEST 2008 |
|
|
193 | - lifted the log2 rounding restriction of max_depth and max_size. |
|
|
194 | - make booleans mutable by creating a copy instead of handing out |
|
|
195 | the same scalar (reported by pasha sadri). |
|
|
196 | - added support for incremental json parsing (still EXPERIMENTAL). |
|
|
197 | - implemented and added a json_xs command line utility that can convert |
|
|
198 | from/to a number of serialisation formats - tell me if you need more. |
|
|
199 | - implement allow_unknown/get_allow_unknown methods. |
|
|
200 | - fixed documentation of max_depth w.r.t. higher and equal. |
|
|
201 | - moved down =encoding directive a bit, too much breaks if it's the first |
|
|
202 | pod directive :/. |
|
|
203 | - removed documentation section on other modules, it became somewhat |
|
|
204 | outdated and is nowadays mostly of historical interest. |
|
|
205 | |
|
|
206 | 2.1 Wed Mar 19 23:23:18 CET 2008 |
|
|
207 | - update documentation here and there: add a large section |
|
|
208 | about utf8/latin1/ascii flags, add a security consideration |
|
|
209 | and extend and clarify the JSON and YAML section. |
|
|
210 | - medium speed enhancements when encoding/decoding non-ascii chars. |
|
|
211 | - minor speedup in number encoding case. |
|
|
212 | - extend and clarify the section on incompatibilities |
|
|
213 | between YAML and JSON. |
|
|
214 | - switch to static inline from just inline when using gcc. |
|
|
215 | - add =encoding utf-8 to the manpage, now that perl 5.10 supports it. |
|
|
216 | - fix some issues with UV to JSON conversion of unknown impact. |
|
|
217 | - published the yahoo locals search result used in benchmarks as the |
|
|
218 | original url changes so comparison is impossible. |
|
|
219 | |
|
|
220 | 2.01 Wed Dec 5 11:40:28 CET 2007 |
|
|
221 | - INCOMPATIBLE API CHANGE: to_json and from_json have been |
|
|
222 | renamed to encode_json/decode_json for JSON.pm compatibility. |
|
|
223 | The old functions croak and might be replaced by JSON.pm |
|
|
224 | comaptible versions in some later release. |
|
|
225 | |
|
|
226 | 2.0 Tue Dec 4 11:30:46 CET 2007 |
|
|
227 | - this is supposed to be the first version of JSON::XS |
|
|
228 | compatible with version 2.0+ of the JSON module. |
|
|
229 | Using the JSON module as frontend to JSON::XS should be |
|
|
230 | as fast as using JSON::XS directly, so consider using it |
|
|
231 | instead. |
|
|
232 | - added get_* methods for all "simple" options. |
|
|
233 | - make JSON::XS subclassable. |
|
|
234 | |
|
|
235 | 1.53 Tue Nov 13 23:58:33 CET 2007 |
|
|
236 | - minor doc clarifications. |
|
|
237 | - fixed many doc typos (patch by Thomas L. Shinnick). |
|
|
238 | |
|
|
239 | 1.52 Mon Oct 15 03:22:06 CEST 2007 |
|
|
240 | - remove =encoding pod directive again, it confuses too many pod |
|
|
241 | parsers :/. |
|
|
242 | |
|
|
243 | 1.51 Sat Oct 13 03:55:56 CEST 2007 |
|
|
244 | - encode empty arrays/hashes in a compact way when pretty is enabled. |
|
|
245 | - apparently JSON::XS was used to find some bugs in the |
|
|
246 | JSON_checker testsuite, so add (the corrected) JSON_checker tests to |
|
|
247 | the testsuite. |
|
|
248 | - quite a bit of doc updates/extension. |
|
|
249 | - require 5.8.2, as this seems to be the first unicode-stable version. |
|
|
250 | |
|
|
251 | 1.5 Tue Aug 28 04:05:38 CEST 2007 |
|
|
252 | - add support for tied hashes, based on ideas and testcase by |
|
|
253 | Marcus Holland-Moritz. |
|
|
254 | - implemented relaxed parsing mode where some extensions are being |
|
|
255 | accepted. generation is still JSON-only. |
|
|
256 | |
|
|
257 | 1.44 Wed Aug 22 01:02:44 CEST 2007 |
|
|
258 | - very experimental process-emulation support, slowing everything down. |
|
|
259 | the horribly broken perl threads are still not supported - YMMV. |
|
|
260 | |
|
|
261 | 1.43 Thu Jul 26 13:26:37 CEST 2007 |
|
|
262 | - convert big json numbers exclusively consisting of digits to NV |
|
|
263 | only when there is no loss of precision, otherwise to string. |
|
|
264 | |
|
|
265 | 1.42 Tue Jul 24 00:51:18 CEST 2007 |
|
|
266 | - fix a crash caused by not handling missing array elements |
|
|
267 | (report and testcase by Jay Kuri). |
|
|
268 | |
|
|
269 | 1.41 Tue Jul 10 18:21:44 CEST 2007 |
|
|
270 | - fix compilation with NDEBUG (assert side-effect), |
|
|
271 | affects convert_blessed only. |
|
|
272 | - fix a bug in decode filters calling ENTER; SAVETMPS; |
|
|
273 | one time too often. |
|
|
274 | - catch a typical error in TO_JSON methods. |
|
|
275 | - antique-ised XS.xs again to work with outdated |
|
|
276 | C compilers (windows...). |
|
|
277 | |
|
|
278 | 1.4 Mon Jul 2 10:06:30 CEST 2007 |
|
|
279 | - add convert_blessed setting. |
|
|
280 | - encode did not catch all blessed objects, encoding their |
|
|
281 | contents in most cases. This has been fixed by introducing |
|
|
282 | the allow_blessed setting. |
|
|
283 | - added filter_json_object and filter_json_single_key_object |
|
|
284 | settings that specify a callback to be called when |
|
|
285 | all/specific json objects are encountered. |
|
|
286 | - assume that most object keys are simple ascii words and |
|
|
287 | optimise this case, penalising the general case. This can |
|
|
288 | speed up decoding by 30% in typical cases and gives |
|
|
289 | a smaller and faster perl hash. |
|
|
290 | - implemented simpleminded, optional resource size checking |
|
|
291 | in decode_json. |
|
|
292 | - remove objToJson/jsonToObj aliases, as the next version |
|
|
293 | of JSON will not have them either. |
|
|
294 | - bit the bullet and converted the very simple json object |
|
|
295 | into a more complex one. |
|
|
296 | - work around a bug where perl wrongly claims an integer |
|
|
297 | is not an integer. |
|
|
298 | - unbundle JSON::XS::Boolean into own pm file so Storable |
|
|
299 | and similar modules can resolve the overloading when thawing. |
|
|
300 | |
|
|
301 | 1.3 Sun Jun 24 01:55:02 CEST 2007 |
|
|
302 | - make JSON::XS::true and false special overloaded objects |
|
|
303 | and return those instead of 1 and 0 for those json atoms |
|
|
304 | (JSON::PP compatibility is NOT achieved yet). |
|
|
305 | - add JSON::XS::is_bool predicate to test for those special |
|
|
306 | values. |
|
|
307 | - add a reference to |
|
|
308 | http://jpsykes.com/47/practical-csrf-and-json-security. |
|
|
309 | - removed require 5.8.8 again, it is just not very expert-friendly. |
|
|
310 | Also try to be more compatible with slightly older versions, |
|
|
311 | which are not recommended (because they are buggy). |
|
|
312 | |
|
|
313 | 1.24 Mon Jun 11 05:40:49 CEST 2007 |
|
|
314 | - added informative section on JSON-as-YAML. |
|
|
315 | - get rid of some c99-isms again. |
|
|
316 | - localise dec->cur in decode_str, speeding up |
|
|
317 | string decoding considerably (>15% on my amd64 + gcc). |
|
|
318 | - increased SHORT_STRING_LEN to 16kb: stack space is |
|
|
319 | usually plenty, and this actually saves memory |
|
|
320 | when !shrinking as short strings will fit perfectly. |
|
|
321 | |
|
|
322 | 1.23 Wed Jun 6 20:13:06 CEST 2007 |
|
|
323 | - greatly improved small integer encoding and decoding speed. |
|
|
324 | - implement a number of µ-optimisations. |
|
|
325 | - updated benchmarks. |
|
|
326 | |
|
|
327 | 1.22 Thu May 24 00:07:25 CEST 2007 |
|
|
328 | - require 5.8.8 explicitly as older perls do not seem to offer |
|
|
329 | the required macros. |
|
|
330 | - possibly made it compile on so-called C compilers by microsoft. |
|
|
331 | |
|
|
332 | 1.21 Wed May 9 18:40:32 CEST 2007 |
|
|
333 | - character offset reported for trailing garbage was random. |
|
|
334 | |
|
|
335 | 1.2 Wed May 9 18:35:01 CEST 2007 |
|
|
336 | - decode did not work with magical scalars (doh!). |
|
|
337 | - added latin1 flag to produce JSON texts in the latin1 subset |
|
|
338 | of unicode. |
|
|
339 | - flag trailing garbage as error. |
|
|
340 | - new decode_prefix method that returns the number |
|
|
341 | of characters consumed by a decode. |
|
|
342 | - max octets/char in perls UTF-X is actually 13, not 11, |
|
|
343 | as pointed out by Glenn Linderman. |
| 10 | - fixed typoe reported by YAMASHINA Hio. |
344 | - fixed typoe reported by YAMASHINA Hio. |
| 11 | |
345 | |
| 12 | 1.11 Mon Apr 9 07:05:49 CEST 2007 |
346 | 1.11 Mon Apr 9 07:05:49 CEST 2007 |
| 13 | - properly 0-terminate sv's returned by encode to help |
347 | - properly 0-terminate sv's returned by encode to help |
| 14 | C libraries that expect that 0 to be there. |
348 | C libraries that expect that 0 to be there. |
| … | |
… | |
| 97 | case the called functions do... stuff. |
431 | case the called functions do... stuff. |
| 98 | - croak when encoding to ascii and an out-of-range |
432 | - croak when encoding to ascii and an out-of-range |
| 99 | (non-unicode) codepoint is encountered. |
433 | (non-unicode) codepoint is encountered. |
| 100 | |
434 | |
| 101 | 0.2 Fri Mar 23 00:23:34 CET 2007 |
435 | 0.2 Fri Mar 23 00:23:34 CET 2007 |
| 102 | - the "could not sleep without debuggign release". |
436 | - the "could not sleep without debugging release". |
| 103 | it should basically work now, with many bugs as |
437 | it should basically work now, with many bugs as |
| 104 | no production tests have been run yet. |
438 | no production tests have been run yet. |
| 105 | - added more testcases. |
439 | - added more testcases. |
| 106 | - the expected shitload of bugfixes. |
440 | - the expected shitload of bugfixes. |
| 107 | - handle utf8 flag correctly in decode. |
441 | - handle utf8 flag correctly in decode. |
