ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/JSON-XS/XS.pm
(Generate patch)

Comparing JSON-XS/XS.pm (file contents):
Revision 1.24 by root, Thu Mar 29 01:27:36 2007 UTC vs.
Revision 1.37 by root, Wed Jun 6 14:52:49 2007 UTC

86package JSON::XS; 86package JSON::XS;
87 87
88use strict; 88use strict;
89 89
90BEGIN { 90BEGIN {
91 our $VERSION = '0.8'; 91 our $VERSION = '1.22';
92 our @ISA = qw(Exporter); 92 our @ISA = qw(Exporter);
93 93
94 our @EXPORT = qw(to_json from_json objToJson jsonToObj); 94 our @EXPORT = qw(to_json from_json objToJson jsonToObj);
95 require Exporter; 95 require Exporter;
96 96
154 154
155If C<$enable> is true (or missing), then the C<encode> method will not 155If C<$enable> is true (or missing), then the C<encode> method will not
156generate characters outside the code range C<0..127> (which is ASCII). Any 156generate characters outside the code range C<0..127> (which is ASCII). Any
157unicode characters outside that range will be escaped using either a 157unicode characters outside that range will be escaped using either a
158single \uXXXX (BMP characters) or a double \uHHHH\uLLLLL escape sequence, 158single \uXXXX (BMP characters) or a double \uHHHH\uLLLLL escape sequence,
159as per RFC4627. 159as per RFC4627. The resulting encoded JSON text can be treated as a native
160unicode string, an ascii-encoded, latin1-encoded or UTF-8 encoded string,
161or any other superset of ASCII.
160 162
161If C<$enable> is false, then the C<encode> method will not escape Unicode 163If C<$enable> is false, then the C<encode> method will not escape Unicode
162characters unless required by the JSON syntax. This results in a faster 164characters unless required by the JSON syntax or other flags. This results
163and more compact format. 165in a faster and more compact format.
166
167The main use for this flag is to produce JSON texts that can be
168transmitted over a 7-bit channel, as the encoded JSON texts will not
169contain any 8 bit characters.
164 170
165 JSON::XS->new->ascii (1)->encode ([chr 0x10401]) 171 JSON::XS->new->ascii (1)->encode ([chr 0x10401])
166 => ["\ud801\udc01"] 172 => ["\ud801\udc01"]
173
174=item $json = $json->latin1 ([$enable])
175
176If C<$enable> is true (or missing), then the C<encode> method will encode
177the resulting JSON text as latin1 (or iso-8859-1), escaping any characters
178outside the code range C<0..255>. The resulting string can be treated as a
179latin1-encoded JSON text or a native unicode string. The C<decode> method
180will not be affected in any way by this flag, as C<decode> by default
181expects unicode, which is a strict superset of latin1.
182
183If C<$enable> is false, then the C<encode> method will not escape Unicode
184characters unless required by the JSON syntax or other flags.
185
186The main use for this flag is efficiently encoding binary data as JSON
187text, as most octets will not be escaped, resulting in a smaller encoded
188size. The disadvantage is that the resulting JSON text is encoded
189in latin1 (and must correctly be treated as such when storing and
190transfering), a rare encoding for JSON. It is therefore most useful when
191you want to store data structures known to contain binary data efficiently
192in files or databases, not when talking to other JSON encoders/decoders.
193
194 JSON::XS->new->latin1->encode (["\x{89}\x{abc}"]
195 => ["\x{89}\\u0abc"] # (perl syntax, U+abc escaped, U+89 not)
167 196
168=item $json = $json->utf8 ([$enable]) 197=item $json = $json->utf8 ([$enable])
169 198
170If C<$enable> is true (or missing), then the C<encode> method will encode 199If C<$enable> is true (or missing), then the C<encode> method will encode
171the JSON result into UTF-8, as required by many protocols, while the 200the JSON result into UTF-8, as required by many protocols, while the
309strings that look like integers or floats into integers or floats 338strings that look like integers or floats into integers or floats
310internally (there is no difference on the Perl level), saving space. 339internally (there is no difference on the Perl level), saving space.
311 340
312=item $json = $json->max_depth ([$maximum_nesting_depth]) 341=item $json = $json->max_depth ([$maximum_nesting_depth])
313 342
314Sets the maximum nesting level (default C<8192>) accepted while encoding 343Sets the maximum nesting level (default C<512>) accepted while encoding
315or decoding. If the JSON text or Perl data structure has an equal or 344or decoding. If the JSON text or Perl data structure has an equal or
316higher nesting level then this limit, then the encoder and decoder will 345higher nesting level then this limit, then the encoder and decoder will
317stop and croak at that point. 346stop and croak at that point.
318 347
319Nesting level is defined by number of hash- or arrayrefs that the encoder 348Nesting level is defined by number of hash- or arrayrefs that the encoder
345 374
346JSON numbers and strings become simple Perl scalars. JSON arrays become 375JSON numbers and strings become simple Perl scalars. JSON arrays become
347Perl arrayrefs and JSON objects become Perl hashrefs. C<true> becomes 376Perl arrayrefs and JSON objects become Perl hashrefs. C<true> becomes
348C<1>, C<false> becomes C<0> and C<null> becomes C<undef>. 377C<1>, C<false> becomes C<0> and C<null> becomes C<undef>.
349 378
379=item ($perl_scalar, $characters) = $json->decode_prefix ($json_text)
380
381This works like the C<decode> method, but instead of raising an exception
382when there is trailing garbage after the first JSON object, it will
383silently stop parsing there and return the number of characters consumed
384so far.
385
386This is useful if your JSON texts are not delimited by an outer protocol
387(which is not the brightest thing to do in the first place) and you need
388to know where the JSON text ends.
389
390 JSON::XS->new->decode_prefix ("[1] the tail")
391 => ([], 3)
392
350=back 393=back
351 394
352 395
353=head1 MAPPING 396=head1 MAPPING
354 397
410=over 4 453=over 4
411 454
412=item hash references 455=item hash references
413 456
414Perl hash references become JSON objects. As there is no inherent ordering 457Perl hash references become JSON objects. As there is no inherent ordering
415in hash keys, they will usually be encoded in a pseudo-random order that 458in hash keys (or JSON objects), they will usually be encoded in a
416can change between runs of the same program but stays generally the same 459pseudo-random order that can change between runs of the same program but
417within a single run of a program. JSON::XS can optionally sort the hash 460stays generally the same within a single run of a program. JSON::XS can
418keys (determined by the I<canonical> flag), so the same datastructure 461optionally sort the hash keys (determined by the I<canonical> flag), so
419will serialise to the same JSON text (given same settings and version of 462the same datastructure will serialise to the same JSON text (given same
420JSON::XS), but this incurs a runtime overhead. 463settings and version of JSON::XS), but this incurs a runtime overhead
464and is only rarely useful, e.g. when you want to compare some JSON text
465against another for equality.
421 466
422=item array references 467=item array references
423 468
424Perl array references become JSON arrays. 469Perl array references become JSON arrays.
470
471=item other references
472
473Other unblessed references are generally not allowed and will cause an
474exception to be thrown, except for references to the integers C<0> and
475C<1>, which get turned into C<false> and C<true> atoms in JSON. You can
476also use C<JSON::XS::false> and C<JSON::XS::true> to improve readability.
477
478 to_json [\0,JSON::XS::true] # yields [false,true]
425 479
426=item blessed objects 480=item blessed objects
427 481
428Blessed objects are not allowed. JSON::XS currently tries to encode their 482Blessed objects are not allowed. JSON::XS currently tries to encode their
429underlying representation (hash- or arrayref), but this behaviour might 483underlying representation (hash- or arrayref), but this behaviour might
461 $x += 0; # numify it, ensuring it will be dumped as a number 515 $x += 0; # numify it, ensuring it will be dumped as a number
462 $x *= 1; # same thing, the choise is yours. 516 $x *= 1; # same thing, the choise is yours.
463 517
464You can not currently output JSON booleans or force the type in other, 518You can not currently output JSON booleans or force the type in other,
465less obscure, ways. Tell me if you need this capability. 519less obscure, ways. Tell me if you need this capability.
466
467=item circular data structures
468
469Those will be encoded until memory or stackspace runs out.
470 520
471=back 521=back
472 522
473 523
474=head1 COMPARISON 524=head1 COMPARISON
562It seems that JSON::XS is surprisingly fast, as shown in the following 612It seems that JSON::XS is surprisingly fast, as shown in the following
563tables. They have been generated with the help of the C<eg/bench> program 613tables. They have been generated with the help of the C<eg/bench> program
564in the JSON::XS distribution, to make it easy to compare on your own 614in the JSON::XS distribution, to make it easy to compare on your own
565system. 615system.
566 616
567First comes a comparison between various modules using a very short JSON 617First comes a comparison between various modules using a very short
568string: 618single-line JSON string:
569 619
570 {"method": "handleMessage", "params": ["user1", "we were just talking"], "id": null} 620 {"method": "handleMessage", "params": ["user1", "we were just talking"], \
621 "id": null, [1,11,234,-5,1e5,1e7, true, false]}
571 622
572It shows the number of encodes/decodes per second (JSON::XS uses the 623It shows the number of encodes/decodes per second (JSON::XS uses the
573functional interface, while JSON::XS/2 uses the OO interface with 624functional interface, while JSON::XS/2 uses the OO interface with
574pretty-printing and hashkey sorting enabled). Higher is better: 625pretty-printing and hashkey sorting enabled). Higher is better:
575 626
627 -----------+------------+------------+
576 module | encode | decode | 628 module | encode | decode |
577 -----------|------------|------------| 629 -----------|------------|------------|
578 JSON | 11488.516 | 7823.035 | 630 JSON | 10597.029 | 5740.903 |
579 JSON::DWIW | 94708.054 | 129094.260 | 631 JSON::DWIW | 78251.940 | 98457.840 |
580 JSON::PC | 63884.157 | 128528.212 | 632 JSON::PC | 70611.178 | 92794.336 |
581 JSON::Syck | 34898.677 | 42096.911 | 633 JSON::Syck | 28767.517 | 38199.490 |
582 JSON::XS | 654027.064 | 396423.669 | 634 JSON::XS | 419430.400 | 265462.278 |
583 JSON::XS/2 | 371564.190 | 371725.613 | 635 JSON::XS/2 | 279620.267 | 265462.278 |
636 JSON::XS/3 | 388361.481 | 265462.278 |
637 Storable | 16294.887 | 16844.594 |
584 -----------+------------+------------+ 638 -----------+------------+------------+
585 639
586That is, JSON::XS is more than six times faster than JSON::DWIW on 640That is, JSON::XS is about five times faster than JSON::DWIW on encoding,
587encoding, more than three times faster on decoding, and about thirty times 641about three times faster on decoding, and about fourty times faster
588faster than JSON, even with pretty-printing and key sorting. 642than JSON, even with pretty-printing and key sorting. It also compares
643favourably to Storable for small amounts of data.
589 644
590Using a longer test string (roughly 18KB, generated from Yahoo! Locals 645Using a longer test string (roughly 18KB, generated from Yahoo! Locals
591search API (http://nanoref.com/yahooapis/mgPdGg): 646search API (http://nanoref.com/yahooapis/mgPdGg):
592 647
593 module | encode | decode | 648 module | encode | decode |
594 -----------|------------|------------| 649 -----------|------------|------------|
595 JSON | 273.023 | 44.674 | 650 JSON | 254.685 | 37.665 |
596 JSON::DWIW | 1089.383 | 1145.704 | 651 JSON::DWIW | 1014.244 | 1087.678 |
597 JSON::PC | 3097.419 | 2393.921 | 652 JSON::PC | 3602.116 | 2307.352 |
598 JSON::Syck | 514.060 | 843.053 | 653 JSON::Syck | 558.035 | 776.263 |
599 JSON::XS | 6479.668 | 3636.364 | 654 JSON::XS | 5747.196 | 3543.684 |
600 JSON::XS/2 | 3774.221 | 3599.124 | 655 JSON::XS/2 | 3968.121 | 3589.170 |
656 JSON::XS/3 | 6105.246 | 3561.134 |
657 Storable | 4456.337 | 5320.020 |
601 -----------+------------+------------+ 658 -----------+------------+------------+
602 659
603Again, JSON::XS leads by far. 660Again, JSON::XS leads by far.
604 661
605On large strings containing lots of high unicode characters, some modules 662On large strings containing lots of high unicode characters, some modules
625usually a good indication of the size of the resources required to decode 682usually a good indication of the size of the resources required to decode
626it into a Perl structure. 683it into a Perl structure.
627 684
628Third, JSON::XS recurses using the C stack when decoding objects and 685Third, JSON::XS recurses using the C stack when decoding objects and
629arrays. The C stack is a limited resource: for instance, on my amd64 686arrays. The C stack is a limited resource: for instance, on my amd64
630machine with 8MB of stack size I can decode around 180k nested arrays 687machine with 8MB of stack size I can decode around 180k nested arrays but
631but only 14k nested JSON objects. If that is exceeded, the program 688only 14k nested JSON objects (due to perl itself recursing deeply on croak
689to free the temporary). If that is exceeded, the program crashes. to be
632crashes. Thats why the default nesting limit is set to 8192. If your 690conservative, the default nesting limit is set to 512. If your process
633process has a smaller stack, you should adjust this setting accordingly 691has a smaller stack, you should adjust this setting accordingly with the
634with the C<max_depth> method. 692C<max_depth> method.
635 693
636And last but least, something else could bomb you that I forgot to think 694And last but least, something else could bomb you that I forgot to think
637of. In that case, you get to keep the pieces. I am alway sopen for hints, 695of. In that case, you get to keep the pieces. I am always open for hints,
638though... 696though...
639 697
640 698
641=head1 BUGS 699=head1 BUGS
642 700
645still relatively early in its development. If you keep reporting bugs they 703still relatively early in its development. If you keep reporting bugs they
646will be fixed swiftly, though. 704will be fixed swiftly, though.
647 705
648=cut 706=cut
649 707
708sub true() { \1 }
709sub false() { \0 }
710
6501; 7111;
651 712
652=head1 AUTHOR 713=head1 AUTHOR
653 714
654 Marc Lehmann <schmorp@schmorp.de> 715 Marc Lehmann <schmorp@schmorp.de>

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines