| 1 |
Revision history for Perl extension JSON::XS |
| 2 |
|
| 3 |
TODO: maybe detetc and croak on more invalid inputs (e.g. +-inf/nan) |
| 4 |
TODO: maybe avoid the reblessing and better support readonly objects. |
| 5 |
TODO: http://stevehanov.ca/blog/index.php?id=104 compression |
| 6 |
|
| 7 |
TODO: how to cope with tagged values and standard json decoders |
| 8 |
TODO: work around <=5.16 bugs (Reini Urban) |
| 9 |
TODO: decide what to do with RFC7158 incompatibilities. |
| 10 |
TODO: investigate magic (Eric Brine) |
| 11 |
TODO: Alex Efros, true/false ignore allow_nonref, because internally they are refs |
| 12 |
- allow literal tabs in strings in relaxed mode (patch by |
| 13 |
lubo.rintel@gooddata.com). |
| 14 |
- support "cbor" format in json_xs tool. |
| 15 |
- support (and fix) calling encode and decode in list context |
| 16 |
(reported by Вадим Власов). |
| 17 |
|
| 18 |
3.01 Tue Oct 29 16:55:15 CET 2013 |
| 19 |
- backport to perls < 5.18 (reported by Paul Howarth). |
| 20 |
|
| 21 |
3.0 Tue Oct 29 01:35:37 CET 2013 |
| 22 |
- implemented an object tagging extension (using the |
| 23 |
Types::Serialiser serialisation protocol). |
| 24 |
- reworked the documentation regarding object serialisation, |
| 25 |
add a new OBJECT SERIALISATION section that explains th |
| 26 |
whole process. |
| 27 |
- new setting: allow_tags. |
| 28 |
- switch to Types::Serialiser booleans. |
| 29 |
- remove to_json/from_json. |
| 30 |
- other minor improvements to the documentation. |
| 31 |
|
| 32 |
2.34 Thu May 23 11:30:34 CEST 2013 |
| 33 |
- work around bugs in perl 5.18 breaking more than 100 |
| 34 |
widely used modules, without a fix in sight because |
| 35 |
p5pers don't care about CPAN anymore. |
| 36 |
- when canonicalising, only allocate up to 64 hash key |
| 37 |
pointers on the stack. for larger hashes, use the heap, |
| 38 |
to avoid using too much stackspace. |
| 39 |
- discuss the problem with setlocale (reported by a few victims). |
| 40 |
|
| 41 |
2.33 Wed Aug 1 21:03:52 CEST 2012 |
| 42 |
- internal encode/decode XS wrappers did not expect stack |
| 43 |
moves caused by callbacks (analyzed and testcase by Jesse Luehrs). |
| 44 |
- add bencode as to/from option in bin/json_xs. |
| 45 |
- add -e option to json_xs, and none and string in/out formats. |
| 46 |
|
| 47 |
2.32 Thu Aug 11 19:06:38 CEST 2011 |
| 48 |
- fix a bug in the initial whitespace accumulation. |
| 49 |
|
| 50 |
2.31 Wed Jul 27 17:53:05 CEST 2011 |
| 51 |
- don't accumulate initial whitespace in the incremental buffer |
| 52 |
(this can be useful to allow whitespace-keepalive on a tcp |
| 53 |
connection without triggering the max_size limit). |
| 54 |
- properly croak on some invalid inputs that are not strings |
| 55 |
(e.g. undef) when trying to decode a json text (reported |
| 56 |
and analyzed by Goro Fuji). |
| 57 |
|
| 58 |
2.3 Wed Aug 18 01:26:47 CEST 2010 |
| 59 |
- make sure decoder doesn't change the decoding in the incremental |
| 60 |
parser (testcase provided by Hendrik Schumacher). |
| 61 |
- applied patch by DaTa for Data::Dumper support in json_xs. |
| 62 |
- added -t dump support to json_xs, using Data::Dump. |
| 63 |
- added -f eval support to json_xs. |
| 64 |
|
| 65 |
2.29 Wed Mar 17 02:39:12 CET 2010 |
| 66 |
- fix a memory leak when callbacks set using filter_json_object |
| 67 |
or filter_json_single_key_object were called (great testcase |
| 68 |
by Eric Wilhelm). |
| 69 |
|
| 70 |
2.28 Thu Mar 11 20:30:46 CET 2010 |
| 71 |
- implement our own atof function - perl's can be orders of |
| 72 |
magnitudes slower than even the system one. on the positive |
| 73 |
side, ours seems to be more exact in general than perl's. |
| 74 |
(testcase provided by Tim Meadowcroft). |
| 75 |
- clarify floating point conversion issues a bit. |
| 76 |
- update jpsykes csrf article url. |
| 77 |
- updated benchmark section - JSON::PP became much faster! |
| 78 |
|
| 79 |
2.27 Thu Jan 7 07:35:08 CET 2010 |
| 80 |
- support relaxed option inside the incremental parser |
| 81 |
(testcase provided by IKEGAMI via Makamaka). |
| 82 |
|
| 83 |
2.26 Sat Oct 10 03:26:19 CEST 2009 |
| 84 |
- big integers could become truncated (based on patch |
| 85 |
by Strobl Anton). |
| 86 |
- output format change: indent now adds a final newline, which is |
| 87 |
more expected and more true to the documentation. |
| 88 |
|
| 89 |
2.25 Sat Aug 8 12:04:41 CEST 2009 |
| 90 |
- the perl debugger completely breaks lvalue subs - try to work |
| 91 |
around the issue. |
| 92 |
- ignore RMAGICAL hashes w.r.t. CANONICAL. |
| 93 |
- try to work around a possible char signedness issue on aix. |
| 94 |
- require common sense. |
| 95 |
|
| 96 |
2.24 Sat May 30 08:25:45 CEST 2009 |
| 97 |
- the incremental parser did not update its parse offset |
| 98 |
pointer correctly when parsing utf8-strings (nicely |
| 99 |
debugged by Martin Evans). |
| 100 |
- appending a non-utf8-string to the incremental parser |
| 101 |
in utf8 mode failed to upgrade the string. |
| 102 |
- wording of parse error messages has been improved. |
| 103 |
|
| 104 |
2.232 Sun Feb 22 11:12:25 CET 2009 |
| 105 |
- use an exponential algorithm to extend strings, to |
| 106 |
help platforms with bad or abysmal==windows memory |
| 107 |
allocater performance, at the expense of some memory |
| 108 |
wastage (use shrink to recover this extra memory). |
| 109 |
(nicely analysed by Dmitry Karasik). |
| 110 |
|
| 111 |
2.2311 Thu Feb 19 02:12:54 CET 2009 |
| 112 |
- add a section "JSON and ECMAscript" to explain some |
| 113 |
incompatibilities between the two (problem was noted by |
| 114 |
various people). |
| 115 |
- add t/20_faihu.t. |
| 116 |
|
| 117 |
2.231 Thu Nov 20 04:59:08 CET 2008 |
| 118 |
- work around 5.10.0 magic bugs where manipulating magic values |
| 119 |
(such as $1) would permanently damage them as perl would |
| 120 |
ignore the magicalness, by making a full copy of the string, |
| 121 |
reported by Dmitry Karasik. |
| 122 |
- work around spurious warnings under older perl 5.8's. |
| 123 |
|
| 124 |
2.23 Mon Sep 29 05:08:29 CEST 2008 |
| 125 |
- fix a compilation problem when perl is not using char * as, well, |
| 126 |
char *. |
| 127 |
- use PL_hexdigit in favour of rolling our own. |
| 128 |
|
| 129 |
2.2222 Sun Jul 20 18:49:00 CEST 2008 |
| 130 |
- same game again, broken 5.10 finds yet another assertion |
| 131 |
failure, and the workaround causes additional runtime warnings. |
| 132 |
Work around the next assertion AND the warning. 5.10 seriously |
| 133 |
needs to adjust it's attitude against working code. |
| 134 |
|
| 135 |
2.222 Sat Jul 19 06:15:34 CEST 2008 |
| 136 |
- you work around one -DDEBUGGING assertion bug in perl 5.10 |
| 137 |
just to hit the next one. work around this one, too. |
| 138 |
|
| 139 |
2.22 Tue Jul 15 13:26:51 CEST 2008 |
| 140 |
- allow higher nesting levels in incremental parser. |
| 141 |
- error out earlier in some cases in the incremental parser |
| 142 |
(as suggested by Yuval Kogman). |
| 143 |
- improve incr-parser test (Yuval Kogman). |
| 144 |
|
| 145 |
2.21 Tue Jun 3 08:43:23 CEST 2008 |
| 146 |
- (hopefully) work around a perl 5.10 bug with -DDEBUGGING. |
| 147 |
- remove the experimental status of the incremental parser interface. |
| 148 |
- move =encoding around again, to avoid bugs with search.cpan.org. |
| 149 |
when can we finally have utf-8 in pod??? |
| 150 |
- add ->incr_reset method. |
| 151 |
|
| 152 |
2.2 Wed Apr 16 20:37:25 CEST 2008 |
| 153 |
- lifted the log2 rounding restriction of max_depth and max_size. |
| 154 |
- make booleans mutable by creating a copy instead of handing out |
| 155 |
the same scalar (reported by pasha sadri). |
| 156 |
- added support for incremental json parsing (still EXPERIMENTAL). |
| 157 |
- implemented and added a json_xs command line utility that can convert |
| 158 |
from/to a number of serialisation formats - tell me if you need more. |
| 159 |
- implement allow_unknown/get_allow_unknown methods. |
| 160 |
- fixed documentation of max_depth w.r.t. higher and equal. |
| 161 |
- moved down =encoding directive a bit, too much breaks if it's the first |
| 162 |
pod directive :/. |
| 163 |
- removed documentation section on other modules, it became somewhat |
| 164 |
outdated and is nowadays mostly of historical interest. |
| 165 |
|
| 166 |
2.1 Wed Mar 19 23:23:18 CET 2008 |
| 167 |
- update documentation here and there: add a large section |
| 168 |
about utf8/latin1/ascii flags, add a security consideration |
| 169 |
and extend and clarify the JSON and YAML section. |
| 170 |
- medium speed enhancements when encoding/decoding non-ascii chars. |
| 171 |
- minor speedup in number encoding case. |
| 172 |
- extend and clarify the section on incompatibilities |
| 173 |
between YAML and JSON. |
| 174 |
- switch to static inline from just inline when using gcc. |
| 175 |
- add =encoding utf-8 to the manpage, now that perl 5.10 supports it. |
| 176 |
- fix some issues with UV to JSON conversion of unknown impact. |
| 177 |
- published the yahoo locals search result used in benchmarks as the |
| 178 |
original url changes so comparison is impossible. |
| 179 |
|
| 180 |
2.01 Wed Dec 5 11:40:28 CET 2007 |
| 181 |
- INCOMPATIBLE API CHANGE: to_json and from_json have been |
| 182 |
renamed to encode_json/decode_json for JSON.pm compatibility. |
| 183 |
The old functions croak and might be replaced by JSON.pm |
| 184 |
comaptible versions in some later release. |
| 185 |
|
| 186 |
2.0 Tue Dec 4 11:30:46 CET 2007 |
| 187 |
- this is supposed to be the first version of JSON::XS |
| 188 |
compatible with version 2.0+ of the JSON module. |
| 189 |
Using the JSON module as frontend to JSON::XS should be |
| 190 |
as fast as using JSON::XS directly, so consider using it |
| 191 |
instead. |
| 192 |
- added get_* methods for all "simple" options. |
| 193 |
- make JSON::XS subclassable. |
| 194 |
|
| 195 |
1.53 Tue Nov 13 23:58:33 CET 2007 |
| 196 |
- minor doc clarifications. |
| 197 |
- fixed many doc typos (patch by Thomas L. Shinnick). |
| 198 |
|
| 199 |
1.52 Mon Oct 15 03:22:06 CEST 2007 |
| 200 |
- remove =encoding pod directive again, it confuses too many pod |
| 201 |
parsers :/. |
| 202 |
|
| 203 |
1.51 Sat Oct 13 03:55:56 CEST 2007 |
| 204 |
- encode empty arrays/hashes in a compact way when pretty is enabled. |
| 205 |
- apparently JSON::XS was used to find some bugs in the |
| 206 |
JSON_checker testsuite, so add (the corrected) JSON_checker tests to |
| 207 |
the testsuite. |
| 208 |
- quite a bit of doc updates/extension. |
| 209 |
- require 5.8.2, as this seems to be the first unicode-stable version. |
| 210 |
|
| 211 |
1.5 Tue Aug 28 04:05:38 CEST 2007 |
| 212 |
- add support for tied hashes, based on ideas and testcase by |
| 213 |
Marcus Holland-Moritz. |
| 214 |
- implemented relaxed parsing mode where some extensions are being |
| 215 |
accepted. generation is still JSON-only. |
| 216 |
|
| 217 |
1.44 Wed Aug 22 01:02:44 CEST 2007 |
| 218 |
- very experimental process-emulation support, slowing everything down. |
| 219 |
the horribly broken perl threads are still not supported - YMMV. |
| 220 |
|
| 221 |
1.43 Thu Jul 26 13:26:37 CEST 2007 |
| 222 |
- convert big json numbers exclusively consisting of digits to NV |
| 223 |
only when there is no loss of precision, otherwise to string. |
| 224 |
|
| 225 |
1.42 Tue Jul 24 00:51:18 CEST 2007 |
| 226 |
- fix a crash caused by not handling missing array elements |
| 227 |
(report and testcase by Jay Kuri). |
| 228 |
|
| 229 |
1.41 Tue Jul 10 18:21:44 CEST 2007 |
| 230 |
- fix compilation with NDEBUG (assert side-effect), |
| 231 |
affects convert_blessed only. |
| 232 |
- fix a bug in decode filters calling ENTER; SAVETMPS; |
| 233 |
one time too often. |
| 234 |
- catch a typical error in TO_JSON methods. |
| 235 |
- antique-ised XS.xs again to work with outdated |
| 236 |
C compilers (windows...). |
| 237 |
|
| 238 |
1.4 Mon Jul 2 10:06:30 CEST 2007 |
| 239 |
- add convert_blessed setting. |
| 240 |
- encode did not catch all blessed objects, encoding their |
| 241 |
contents in most cases. This has been fixed by introducing |
| 242 |
the allow_blessed setting. |
| 243 |
- added filter_json_object and filter_json_single_key_object |
| 244 |
settings that specify a callback to be called when |
| 245 |
all/specific json objects are encountered. |
| 246 |
- assume that most object keys are simple ascii words and |
| 247 |
optimise this case, penalising the general case. This can |
| 248 |
speed up decoding by 30% in typical cases and gives |
| 249 |
a smaller and faster perl hash. |
| 250 |
- implemented simpleminded, optional resource size checking |
| 251 |
in decode_json. |
| 252 |
- remove objToJson/jsonToObj aliases, as the next version |
| 253 |
of JSON will not have them either. |
| 254 |
- bit the bullet and converted the very simple json object |
| 255 |
into a more complex one. |
| 256 |
- work around a bug where perl wrongly claims an integer |
| 257 |
is not an integer. |
| 258 |
- unbundle JSON::XS::Boolean into own pm file so Storable |
| 259 |
and similar modules can resolve the overloading when thawing. |
| 260 |
|
| 261 |
1.3 Sun Jun 24 01:55:02 CEST 2007 |
| 262 |
- make JSON::XS::true and false special overloaded objects |
| 263 |
and return those instead of 1 and 0 for those json atoms |
| 264 |
(JSON::PP compatibility is NOT achieved yet). |
| 265 |
- add JSON::XS::is_bool predicate to test for those special |
| 266 |
values. |
| 267 |
- add a reference to |
| 268 |
http://jpsykes.com/47/practical-csrf-and-json-security. |
| 269 |
- removed require 5.8.8 again, it is just not very expert-friendly. |
| 270 |
Also try to be more compatible with slightly older versions, |
| 271 |
which are not recommended (because they are buggy). |
| 272 |
|
| 273 |
1.24 Mon Jun 11 05:40:49 CEST 2007 |
| 274 |
- added informative section on JSON-as-YAML. |
| 275 |
- get rid of some c99-isms again. |
| 276 |
- localise dec->cur in decode_str, speeding up |
| 277 |
string decoding considerably (>15% on my amd64 + gcc). |
| 278 |
- increased SHORT_STRING_LEN to 16kb: stack space is |
| 279 |
usually plenty, and this actually saves memory |
| 280 |
when !shrinking as short strings will fit perfectly. |
| 281 |
|
| 282 |
1.23 Wed Jun 6 20:13:06 CEST 2007 |
| 283 |
- greatly improved small integer encoding and decoding speed. |
| 284 |
- implement a number of µ-optimisations. |
| 285 |
- updated benchmarks. |
| 286 |
|
| 287 |
1.22 Thu May 24 00:07:25 CEST 2007 |
| 288 |
- require 5.8.8 explicitly as older perls do not seem to offer |
| 289 |
the required macros. |
| 290 |
- possibly made it compile on so-called C compilers by microsoft. |
| 291 |
|
| 292 |
1.21 Wed May 9 18:40:32 CEST 2007 |
| 293 |
- character offset reported for trailing garbage was random. |
| 294 |
|
| 295 |
1.2 Wed May 9 18:35:01 CEST 2007 |
| 296 |
- decode did not work with magical scalars (doh!). |
| 297 |
- added latin1 flag to produce JSON texts in the latin1 subset |
| 298 |
of unicode. |
| 299 |
- flag trailing garbage as error. |
| 300 |
- new decode_prefix method that returns the number |
| 301 |
of characters consumed by a decode. |
| 302 |
- max octets/char in perls UTF-X is actually 13, not 11, |
| 303 |
as pointed out by Glenn Linderman. |
| 304 |
- fixed typoe reported by YAMASHINA Hio. |
| 305 |
|
| 306 |
1.11 Mon Apr 9 07:05:49 CEST 2007 |
| 307 |
- properly 0-terminate sv's returned by encode to help |
| 308 |
C libraries that expect that 0 to be there. |
| 309 |
- partially "port" JSON from C to microsofts fucking broken |
| 310 |
pseudo-C. They should be burned to the ground for pissing |
| 311 |
on standards. And I should be stoned for even trying to |
| 312 |
support this filthy excuse for a c compiler. |
| 313 |
|
| 314 |
1.1 Wed Apr 4 01:45:00 CEST 2007 |
| 315 |
- clarify documentation (pointed out by Quinn Weaver). |
| 316 |
- decode_utf8 sometimes did not correctly flag errors, |
| 317 |
leading to segfaults. |
| 318 |
- further reduced default nesting depth to 512 due to the test |
| 319 |
failure by that anonymous "chris" whose e-mail address seems |
| 320 |
to be impossible to get. Tests on other freebsd systems indicate |
| 321 |
that this is likely a problem in his/her configuration and not this |
| 322 |
module. |
| 323 |
- renamed json => JSON in error messages. |
| 324 |
- corrected the character offset in some error messages. |
| 325 |
|
| 326 |
1.01 Sat Mar 31 16:15:40 CEST 2007 |
| 327 |
- do not segfault when from_json/decode gets passed |
| 328 |
a non-string object (reported by Florian Ragwitz). |
| 329 |
This has no effect on normal operation. |
| 330 |
|
| 331 |
1.0 Thu Mar 29 04:43:34 CEST 2007 |
| 332 |
- the long awaited (by me) 1.0 version. |
| 333 |
- add \0 (JSON::XS::false) and \1 (JSON::XS::true) mappings to JSON |
| 334 |
true and false. |
| 335 |
- add some more notes to shrink, as suggested by Alex Efros. |
| 336 |
- improve testsuite. |
| 337 |
- halve the default nesting depth limit, to hopefully make it |
| 338 |
work on Freebsd (unfortunately, the cpan tester did not |
| 339 |
send me his report, so I cannot ask about the stack limit on fbsd). |
| 340 |
|
| 341 |
0.8 Mon Mar 26 00:10:48 CEST 2007 |
| 342 |
- fix a memleak when decoding hashes. |
| 343 |
- export jsonToBj and objToJson as aliases |
| 344 |
to to_json and from_json, to reduce incompatibilities |
| 345 |
between JSON/JSON::PC and JSON::XS. (experimental). |
| 346 |
- implement a maximum nesting depth for both en- and de-coding. |
| 347 |
- added a security considerations sections. |
| 348 |
|
| 349 |
0.7 Sun Mar 25 01:46:30 CET 2007 |
| 350 |
- code cleanup. |
| 351 |
- fix a memory overflow bug when indenting. |
| 352 |
- pretty-printing now up to 15% faster. |
| 353 |
- improve decoding speed of strings by |
| 354 |
up to 50% by specialcasing short strings. |
| 355 |
- further decoding speedups for strings using |
| 356 |
lots of \u escapes. |
| 357 |
- improve utf8 decoding speed for U+80 .. U+7FF. |
| 358 |
|
| 359 |
0.5 Sat Mar 24 20:41:51 CET 2007 |
| 360 |
- added the UTF-16 encoding example hinted at in previous |
| 361 |
versions. |
| 362 |
- minor documentation fixes. |
| 363 |
- fix a bug in and optimise canonicalising fastpath |
| 364 |
(reported by Craig Manley). |
| 365 |
- remove a subtest that breaks with bleadperl (reported |
| 366 |
by Andreas König). |
| 367 |
|
| 368 |
0.31 Sat Mar 24 02:14:34 CET 2007 |
| 369 |
- documentation updates. |
| 370 |
- do some casting to hopefully fix Andreas' problem. |
| 371 |
- nuke bogus json rpc stuff. |
| 372 |
|
| 373 |
0.3 Fri Mar 23 19:33:21 CET 2007 |
| 374 |
- remove spurious PApp::Util reference (John McNamara). |
| 375 |
- adapted lots of tests from other json modules |
| 376 |
(idea by Chris Carline). |
| 377 |
- documented mapping from json to perl and vice versa. |
| 378 |
- improved the documentation by adding more examples. |
| 379 |
- added short escaping forms, reducing the created |
| 380 |
json texts a bit. |
| 381 |
- added shrink flag. |
| 382 |
- when flag methods are called without enable argument |
| 383 |
they will by default enable their flag. |
| 384 |
- considerably improved string encoding speed (at least |
| 385 |
with gcc 4). |
| 386 |
- added a test that covers lots of different characters. |
| 387 |
- clarified some error messages. |
| 388 |
- error messages now use correct character offset |
| 389 |
with F_UTF8. |
| 390 |
- improve the "no bytes" and "no warnings" hacks in |
| 391 |
case the called functions do... stuff. |
| 392 |
- croak when encoding to ascii and an out-of-range |
| 393 |
(non-unicode) codepoint is encountered. |
| 394 |
|
| 395 |
0.2 Fri Mar 23 00:23:34 CET 2007 |
| 396 |
- the "could not sleep without debugging release". |
| 397 |
it should basically work now, with many bugs as |
| 398 |
no production tests have been run yet. |
| 399 |
- added more testcases. |
| 400 |
- the expected shitload of bugfixes. |
| 401 |
- handle utf8 flag correctly in decode. |
| 402 |
- fix segfault in decoder. |
| 403 |
- utf8n_to_uvuni sets retlen to -1, but retlen is an |
| 404 |
unsigned types (argh). |
| 405 |
- fix decoding of utf-8 strings. |
| 406 |
- improved error diagnostics. |
| 407 |
- fix decoding of 'null'. |
| 408 |
- fix parsing of empty array/hashes |
| 409 |
- silence warnings when we prepare the croak message. |
| 410 |
|
| 411 |
0.1 Thu Mar 22 22:13:43 CET 2007 |
| 412 |
- first release, very untested, basically just to claim |
| 413 |
the namespace. |
| 414 |
|
| 415 |
0.01 Thu Mar 22 06:08:12 CET 2007 |
| 416 |
- original version; cloned from Convert-Scalar |
| 417 |
|
