ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/JSON-XS/XS.pm
(Generate patch)

Comparing JSON-XS/XS.pm (file contents):
Revision 1.23 by root, Sun Mar 25 21:19:13 2007 UTC vs.
Revision 1.37 by root, Wed Jun 6 14:52:49 2007 UTC

86package JSON::XS; 86package JSON::XS;
87 87
88use strict; 88use strict;
89 89
90BEGIN { 90BEGIN {
91 our $VERSION = '0.8'; 91 our $VERSION = '1.22';
92 our @ISA = qw(Exporter); 92 our @ISA = qw(Exporter);
93 93
94 our @EXPORT = qw(to_json from_json objToJson jsonToObj); 94 our @EXPORT = qw(to_json from_json objToJson jsonToObj);
95 require Exporter; 95 require Exporter;
96 96
154 154
155If C<$enable> is true (or missing), then the C<encode> method will not 155If C<$enable> is true (or missing), then the C<encode> method will not
156generate characters outside the code range C<0..127> (which is ASCII). Any 156generate characters outside the code range C<0..127> (which is ASCII). Any
157unicode characters outside that range will be escaped using either a 157unicode characters outside that range will be escaped using either a
158single \uXXXX (BMP characters) or a double \uHHHH\uLLLLL escape sequence, 158single \uXXXX (BMP characters) or a double \uHHHH\uLLLLL escape sequence,
159as per RFC4627. 159as per RFC4627. The resulting encoded JSON text can be treated as a native
160unicode string, an ascii-encoded, latin1-encoded or UTF-8 encoded string,
161or any other superset of ASCII.
160 162
161If C<$enable> is false, then the C<encode> method will not escape Unicode 163If C<$enable> is false, then the C<encode> method will not escape Unicode
162characters unless required by the JSON syntax. This results in a faster 164characters unless required by the JSON syntax or other flags. This results
163and more compact format. 165in a faster and more compact format.
166
167The main use for this flag is to produce JSON texts that can be
168transmitted over a 7-bit channel, as the encoded JSON texts will not
169contain any 8 bit characters.
164 170
165 JSON::XS->new->ascii (1)->encode ([chr 0x10401]) 171 JSON::XS->new->ascii (1)->encode ([chr 0x10401])
166 => ["\ud801\udc01"] 172 => ["\ud801\udc01"]
173
174=item $json = $json->latin1 ([$enable])
175
176If C<$enable> is true (or missing), then the C<encode> method will encode
177the resulting JSON text as latin1 (or iso-8859-1), escaping any characters
178outside the code range C<0..255>. The resulting string can be treated as a
179latin1-encoded JSON text or a native unicode string. The C<decode> method
180will not be affected in any way by this flag, as C<decode> by default
181expects unicode, which is a strict superset of latin1.
182
183If C<$enable> is false, then the C<encode> method will not escape Unicode
184characters unless required by the JSON syntax or other flags.
185
186The main use for this flag is efficiently encoding binary data as JSON
187text, as most octets will not be escaped, resulting in a smaller encoded
188size. The disadvantage is that the resulting JSON text is encoded
189in latin1 (and must correctly be treated as such when storing and
190transfering), a rare encoding for JSON. It is therefore most useful when
191you want to store data structures known to contain binary data efficiently
192in files or databases, not when talking to other JSON encoders/decoders.
193
194 JSON::XS->new->latin1->encode (["\x{89}\x{abc}"]
195 => ["\x{89}\\u0abc"] # (perl syntax, U+abc escaped, U+89 not)
167 196
168=item $json = $json->utf8 ([$enable]) 197=item $json = $json->utf8 ([$enable])
169 198
170If C<$enable> is true (or missing), then the C<encode> method will encode 199If C<$enable> is true (or missing), then the C<encode> method will encode
171the JSON result into UTF-8, as required by many protocols, while the 200the JSON result into UTF-8, as required by many protocols, while the
284 => "Hello, World!" 313 => "Hello, World!"
285 314
286=item $json = $json->shrink ([$enable]) 315=item $json = $json->shrink ([$enable])
287 316
288Perl usually over-allocates memory a bit when allocating space for 317Perl usually over-allocates memory a bit when allocating space for
289strings. This flag optionally resizes strings generated by either 318strings. This flag optionally resizes strings generated by either
290C<encode> or C<decode> to their minimum size possible. This can save 319C<encode> or C<decode> to their minimum size possible. This can save
291memory when your JSON texts are either very very long or you have many 320memory when your JSON texts are either very very long or you have many
292short strings. It will also try to downgrade any strings to octet-form 321short strings. It will also try to downgrade any strings to octet-form
293if possible: perl stores strings internally either in an encoding called 322if possible: perl stores strings internally either in an encoding called
294UTF-X or in octet-form. The latter cannot store everything but uses less 323UTF-X or in octet-form. The latter cannot store everything but uses less
295space in general. 324space in general (and some buggy Perl or C code might even rely on that
325internal representation being used).
296 326
327The actual definition of what shrink does might change in future versions,
328but it will always try to save space at the expense of time.
329
297If C<$enable> is true (or missing), the string returned by C<encode> will be shrunk-to-fit, 330If C<$enable> is true (or missing), the string returned by C<encode> will
298while all strings generated by C<decode> will also be shrunk-to-fit. 331be shrunk-to-fit, while all strings generated by C<decode> will also be
332shrunk-to-fit.
299 333
300If C<$enable> is false, then the normal perl allocation algorithms are used. 334If C<$enable> is false, then the normal perl allocation algorithms are used.
301If you work with your data, then this is likely to be faster. 335If you work with your data, then this is likely to be faster.
302 336
303In the future, this setting might control other things, such as converting 337In the future, this setting might control other things, such as converting
304strings that look like integers or floats into integers or floats 338strings that look like integers or floats into integers or floats
305internally (there is no difference on the Perl level), saving space. 339internally (there is no difference on the Perl level), saving space.
306 340
307=item $json = $json->max_depth ([$maximum_nesting_depth]) 341=item $json = $json->max_depth ([$maximum_nesting_depth])
308 342
309Sets the maximum nesting level (default C<8192>) accepted while encoding 343Sets the maximum nesting level (default C<512>) accepted while encoding
310or decoding. If the JSON text or Perl data structure has an equal or 344or decoding. If the JSON text or Perl data structure has an equal or
311higher nesting level then this limit, then the encoder and decoder will 345higher nesting level then this limit, then the encoder and decoder will
312stop and croak at that point. 346stop and croak at that point.
313 347
314Nesting level is defined by number of hash- or arrayrefs that the encoder 348Nesting level is defined by number of hash- or arrayrefs that the encoder
340 374
341JSON numbers and strings become simple Perl scalars. JSON arrays become 375JSON numbers and strings become simple Perl scalars. JSON arrays become
342Perl arrayrefs and JSON objects become Perl hashrefs. C<true> becomes 376Perl arrayrefs and JSON objects become Perl hashrefs. C<true> becomes
343C<1>, C<false> becomes C<0> and C<null> becomes C<undef>. 377C<1>, C<false> becomes C<0> and C<null> becomes C<undef>.
344 378
379=item ($perl_scalar, $characters) = $json->decode_prefix ($json_text)
380
381This works like the C<decode> method, but instead of raising an exception
382when there is trailing garbage after the first JSON object, it will
383silently stop parsing there and return the number of characters consumed
384so far.
385
386This is useful if your JSON texts are not delimited by an outer protocol
387(which is not the brightest thing to do in the first place) and you need
388to know where the JSON text ends.
389
390 JSON::XS->new->decode_prefix ("[1] the tail")
391 => ([], 3)
392
345=back 393=back
346 394
347 395
348=head1 MAPPING 396=head1 MAPPING
349 397
405=over 4 453=over 4
406 454
407=item hash references 455=item hash references
408 456
409Perl hash references become JSON objects. As there is no inherent ordering 457Perl hash references become JSON objects. As there is no inherent ordering
410in hash keys, they will usually be encoded in a pseudo-random order that 458in hash keys (or JSON objects), they will usually be encoded in a
411can change between runs of the same program but stays generally the same 459pseudo-random order that can change between runs of the same program but
412within a single run of a program. JSON::XS can optionally sort the hash 460stays generally the same within a single run of a program. JSON::XS can
413keys (determined by the I<canonical> flag), so the same datastructure 461optionally sort the hash keys (determined by the I<canonical> flag), so
414will serialise to the same JSON text (given same settings and version of 462the same datastructure will serialise to the same JSON text (given same
415JSON::XS), but this incurs a runtime overhead. 463settings and version of JSON::XS), but this incurs a runtime overhead
464and is only rarely useful, e.g. when you want to compare some JSON text
465against another for equality.
416 466
417=item array references 467=item array references
418 468
419Perl array references become JSON arrays. 469Perl array references become JSON arrays.
470
471=item other references
472
473Other unblessed references are generally not allowed and will cause an
474exception to be thrown, except for references to the integers C<0> and
475C<1>, which get turned into C<false> and C<true> atoms in JSON. You can
476also use C<JSON::XS::false> and C<JSON::XS::true> to improve readability.
477
478 to_json [\0,JSON::XS::true] # yields [false,true]
420 479
421=item blessed objects 480=item blessed objects
422 481
423Blessed objects are not allowed. JSON::XS currently tries to encode their 482Blessed objects are not allowed. JSON::XS currently tries to encode their
424underlying representation (hash- or arrayref), but this behaviour might 483underlying representation (hash- or arrayref), but this behaviour might
456 $x += 0; # numify it, ensuring it will be dumped as a number 515 $x += 0; # numify it, ensuring it will be dumped as a number
457 $x *= 1; # same thing, the choise is yours. 516 $x *= 1; # same thing, the choise is yours.
458 517
459You can not currently output JSON booleans or force the type in other, 518You can not currently output JSON booleans or force the type in other,
460less obscure, ways. Tell me if you need this capability. 519less obscure, ways. Tell me if you need this capability.
461
462=item circular data structures
463
464Those will be encoded until memory or stackspace runs out.
465 520
466=back 521=back
467 522
468 523
469=head1 COMPARISON 524=head1 COMPARISON
557It seems that JSON::XS is surprisingly fast, as shown in the following 612It seems that JSON::XS is surprisingly fast, as shown in the following
558tables. They have been generated with the help of the C<eg/bench> program 613tables. They have been generated with the help of the C<eg/bench> program
559in the JSON::XS distribution, to make it easy to compare on your own 614in the JSON::XS distribution, to make it easy to compare on your own
560system. 615system.
561 616
562First comes a comparison between various modules using a very short JSON 617First comes a comparison between various modules using a very short
563string: 618single-line JSON string:
564 619
565 {"method": "handleMessage", "params": ["user1", "we were just talking"], "id": null} 620 {"method": "handleMessage", "params": ["user1", "we were just talking"], \
621 "id": null, [1,11,234,-5,1e5,1e7, true, false]}
566 622
567It shows the number of encodes/decodes per second (JSON::XS uses the 623It shows the number of encodes/decodes per second (JSON::XS uses the
568functional interface, while JSON::XS/2 uses the OO interface with 624functional interface, while JSON::XS/2 uses the OO interface with
569pretty-printing and hashkey sorting enabled). Higher is better: 625pretty-printing and hashkey sorting enabled). Higher is better:
570 626
627 -----------+------------+------------+
571 module | encode | decode | 628 module | encode | decode |
572 -----------|------------|------------| 629 -----------|------------|------------|
573 JSON | 11488.516 | 7823.035 | 630 JSON | 10597.029 | 5740.903 |
574 JSON::DWIW | 94708.054 | 129094.260 | 631 JSON::DWIW | 78251.940 | 98457.840 |
575 JSON::PC | 63884.157 | 128528.212 | 632 JSON::PC | 70611.178 | 92794.336 |
576 JSON::Syck | 34898.677 | 42096.911 | 633 JSON::Syck | 28767.517 | 38199.490 |
577 JSON::XS | 654027.064 | 396423.669 | 634 JSON::XS | 419430.400 | 265462.278 |
578 JSON::XS/2 | 371564.190 | 371725.613 | 635 JSON::XS/2 | 279620.267 | 265462.278 |
636 JSON::XS/3 | 388361.481 | 265462.278 |
637 Storable | 16294.887 | 16844.594 |
579 -----------+------------+------------+ 638 -----------+------------+------------+
580 639
581That is, JSON::XS is more than six times faster than JSON::DWIW on 640That is, JSON::XS is about five times faster than JSON::DWIW on encoding,
582encoding, more than three times faster on decoding, and about thirty times 641about three times faster on decoding, and about fourty times faster
583faster than JSON, even with pretty-printing and key sorting. 642than JSON, even with pretty-printing and key sorting. It also compares
643favourably to Storable for small amounts of data.
584 644
585Using a longer test string (roughly 18KB, generated from Yahoo! Locals 645Using a longer test string (roughly 18KB, generated from Yahoo! Locals
586search API (http://nanoref.com/yahooapis/mgPdGg): 646search API (http://nanoref.com/yahooapis/mgPdGg):
587 647
588 module | encode | decode | 648 module | encode | decode |
589 -----------|------------|------------| 649 -----------|------------|------------|
590 JSON | 273.023 | 44.674 | 650 JSON | 254.685 | 37.665 |
591 JSON::DWIW | 1089.383 | 1145.704 | 651 JSON::DWIW | 1014.244 | 1087.678 |
592 JSON::PC | 3097.419 | 2393.921 | 652 JSON::PC | 3602.116 | 2307.352 |
593 JSON::Syck | 514.060 | 843.053 | 653 JSON::Syck | 558.035 | 776.263 |
594 JSON::XS | 6479.668 | 3636.364 | 654 JSON::XS | 5747.196 | 3543.684 |
595 JSON::XS/2 | 3774.221 | 3599.124 | 655 JSON::XS/2 | 3968.121 | 3589.170 |
656 JSON::XS/3 | 6105.246 | 3561.134 |
657 Storable | 4456.337 | 5320.020 |
596 -----------+------------+------------+ 658 -----------+------------+------------+
597 659
598Again, JSON::XS leads by far. 660Again, JSON::XS leads by far.
599 661
600On large strings containing lots of high unicode characters, some modules 662On large strings containing lots of high unicode characters, some modules
620usually a good indication of the size of the resources required to decode 682usually a good indication of the size of the resources required to decode
621it into a Perl structure. 683it into a Perl structure.
622 684
623Third, JSON::XS recurses using the C stack when decoding objects and 685Third, JSON::XS recurses using the C stack when decoding objects and
624arrays. The C stack is a limited resource: for instance, on my amd64 686arrays. The C stack is a limited resource: for instance, on my amd64
625machine with 8MB of stack size I can decode around 180k nested arrays 687machine with 8MB of stack size I can decode around 180k nested arrays but
626but only 14k nested JSON objects. If that is exceeded, the program 688only 14k nested JSON objects (due to perl itself recursing deeply on croak
689to free the temporary). If that is exceeded, the program crashes. to be
627crashes. Thats why the default nesting limit is set to 8192. If your 690conservative, the default nesting limit is set to 512. If your process
628process has a smaller stack, you should adjust this setting accordingly 691has a smaller stack, you should adjust this setting accordingly with the
629with the C<max_depth> method. 692C<max_depth> method.
630 693
631And last but least, something else could bomb you that I forgot to think 694And last but least, something else could bomb you that I forgot to think
632of. In that case, you get to keep the pieces. I am alway sopen for hints, 695of. In that case, you get to keep the pieces. I am always open for hints,
633though... 696though...
634 697
635 698
636=head1 BUGS 699=head1 BUGS
637 700
640still relatively early in its development. If you keep reporting bugs they 703still relatively early in its development. If you keep reporting bugs they
641will be fixed swiftly, though. 704will be fixed swiftly, though.
642 705
643=cut 706=cut
644 707
708sub true() { \1 }
709sub false() { \0 }
710
6451; 7111;
646 712
647=head1 AUTHOR 713=head1 AUTHOR
648 714
649 Marc Lehmann <schmorp@schmorp.de> 715 Marc Lehmann <schmorp@schmorp.de>

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines