ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/JSON-XS/XS.pm
(Generate patch)

Comparing JSON-XS/XS.pm (file contents):
Revision 1.43 by root, Sat Jun 23 23:49:29 2007 UTC vs.
Revision 1.56 by root, Thu Jul 26 11:33:35 2007 UTC

9 # exported functions, they croak on error 9 # exported functions, they croak on error
10 # and expect/generate UTF-8 10 # and expect/generate UTF-8
11 11
12 $utf8_encoded_json_text = to_json $perl_hash_or_arrayref; 12 $utf8_encoded_json_text = to_json $perl_hash_or_arrayref;
13 $perl_hash_or_arrayref = from_json $utf8_encoded_json_text; 13 $perl_hash_or_arrayref = from_json $utf8_encoded_json_text;
14
15 # objToJson and jsonToObj aliases to to_json and from_json
16 # are exported for compatibility to the JSON module,
17 # but should not be used in new code.
18 14
19 # OO-interface 15 # OO-interface
20 16
21 $coder = JSON::XS->new->ascii->pretty->allow_nonref; 17 $coder = JSON::XS->new->ascii->pretty->allow_nonref;
22 $pretty_printed_unencoded = $coder->encode ($perl_scalar); 18 $pretty_printed_unencoded = $coder->encode ($perl_scalar);
85 81
86package JSON::XS; 82package JSON::XS;
87 83
88use strict; 84use strict;
89 85
90our $VERSION = '1.3'; 86our $VERSION = '1.43';
91our @ISA = qw(Exporter); 87our @ISA = qw(Exporter);
92 88
93our @EXPORT = qw(to_json from_json objToJson jsonToObj); 89our @EXPORT = qw(to_json from_json);
94 90
95use Exporter; 91use Exporter;
96use XSLoader; 92use XSLoader;
97 93
98=head1 FUNCTIONAL INTERFACE 94=head1 FUNCTIONAL INTERFACE
315Example, encode a Perl scalar as JSON value with enabled C<allow_nonref>, 311Example, encode a Perl scalar as JSON value with enabled C<allow_nonref>,
316resulting in an invalid JSON text: 312resulting in an invalid JSON text:
317 313
318 JSON::XS->new->allow_nonref->encode ("Hello, World!") 314 JSON::XS->new->allow_nonref->encode ("Hello, World!")
319 => "Hello, World!" 315 => "Hello, World!"
316
317=item $json = $json->allow_blessed ([$enable])
318
319If C<$enable> is true (or missing), then the C<encode> method will not
320barf when it encounters a blessed reference. Instead, the value of the
321B<convert_blessed> option will decide wether C<null> (C<convert_blessed>
322disabled or no C<to_json> method found) or a representation of the
323object (C<convert_blessed> enabled and C<to_json> method found) is being
324encoded. Has no effect on C<decode>.
325
326If C<$enable> is false (the default), then C<encode> will throw an
327exception when it encounters a blessed object.
328
329=item $json = $json->convert_blessed ([$enable])
330
331If C<$enable> is true (or missing), then C<encode>, upon encountering a
332blessed object, will check for the availability of the C<TO_JSON> method
333on the object's class. If found, it will be called in scalar context
334and the resulting scalar will be encoded instead of the object. If no
335C<TO_JSON> method is found, the value of C<allow_blessed> will decide what
336to do.
337
338The C<TO_JSON> method may safely call die if it wants. If C<TO_JSON>
339returns other blessed objects, those will be handled in the same
340way. C<TO_JSON> must take care of not causing an endless recursion cycle
341(== crash) in this case. The name of C<TO_JSON> was chosen because other
342methods called by the Perl core (== not by the user of the object) are
343usually in upper case letters and to avoid collisions with the C<to_json>
344function.
345
346This setting does not yet influence C<decode> in any way, but in the
347future, global hooks might get installed that influence C<decode> and are
348enabled by this setting.
349
350If C<$enable> is false, then the C<allow_blessed> setting will decide what
351to do when a blessed object is found.
352
353=item $json = $json->filter_json_object ([$coderef->($hashref)])
354
355When C<$coderef> is specified, it will be called from C<decode> each
356time it decodes a JSON object. The only argument is a reference to the
357newly-created hash. If the code references returns a single scalar (which
358need not be a reference), this value (i.e. a copy of that scalar to avoid
359aliasing) is inserted into the deserialised data structure. If it returns
360an empty list (NOTE: I<not> C<undef>, which is a valid scalar), the
361original deserialised hash will be inserted. This setting can slow down
362decoding considerably.
363
364When C<$coderef> is omitted or undefined, any existing callback will
365be removed and C<decode> will not change the deserialised hash in any
366way.
367
368Example, convert all JSON objects into the integer 5:
369
370 my $js = JSON::XS->new->filter_json_object (sub { 5 });
371 # returns [5]
372 $js->decode ('[{}]')
373 # throw an exception because allow_nonref is not enabled
374 # so a lone 5 is not allowed.
375 $js->decode ('{"a":1, "b":2}');
376
377=item $json = $json->filter_json_single_key_object ($key [=> $coderef->($value)])
378
379Works remotely similar to C<filter_json_object>, but is only called for
380JSON objects having a single key named C<$key>.
381
382This C<$coderef> is called before the one specified via
383C<filter_json_object>, if any. It gets passed the single value in the JSON
384object. If it returns a single value, it will be inserted into the data
385structure. If it returns nothing (not even C<undef> but the empty list),
386the callback from C<filter_json_object> will be called next, as if no
387single-key callback were specified.
388
389If C<$coderef> is omitted or undefined, the corresponding callback will be
390disabled. There can only ever be one callback for a given key.
391
392As this callback gets called less often then the C<filter_json_object>
393one, decoding speed will not usually suffer as much. Therefore, single-key
394objects make excellent targets to serialise Perl objects into, especially
395as single-key JSON objects are as close to the type-tagged value concept
396as JSON gets (its basically an ID/VALUE tuple). Of course, JSON does not
397support this in any way, so you need to make sure your data never looks
398like a serialised Perl hash.
399
400Typical names for the single object key are C<__class_whatever__>, or
401C<$__dollars_are_rarely_used__$> or C<}ugly_brace_placement>, or even
402things like C<__class_md5sum(classname)__>, to reduce the risk of clashing
403with real hashes.
404
405Example, decode JSON objects of the form C<< { "__widget__" => <id> } >>
406into the corresponding C<< $WIDGET{<id>} >> object:
407
408 # return whatever is in $WIDGET{5}:
409 JSON::XS
410 ->new
411 ->filter_json_single_key_object (__widget__ => sub {
412 $WIDGET{ $_[0] }
413 })
414 ->decode ('{"__widget__": 5')
415
416 # this can be used with a TO_JSON method in some "widget" class
417 # for serialisation to json:
418 sub WidgetBase::TO_JSON {
419 my ($self) = @_;
420
421 unless ($self->{id}) {
422 $self->{id} = ..get..some..id..;
423 $WIDGET{$self->{id}} = $self;
424 }
425
426 { __widget__ => $self->{id} }
427 }
320 428
321=item $json = $json->shrink ([$enable]) 429=item $json = $json->shrink ([$enable])
322 430
323Perl usually over-allocates memory a bit when allocating space for 431Perl usually over-allocates memory a bit when allocating space for
324strings. This flag optionally resizes strings generated by either 432strings. This flag optionally resizes strings generated by either
357given character in a string. 465given character in a string.
358 466
359Setting the maximum depth to one disallows any nesting, so that ensures 467Setting the maximum depth to one disallows any nesting, so that ensures
360that the object is only a single hash/object or array. 468that the object is only a single hash/object or array.
361 469
362The argument to C<max_depth> will be rounded up to the next nearest power 470The argument to C<max_depth> will be rounded up to the next highest power
363of two. 471of two. If no argument is given, the highest possible setting will be
472used, which is rarely useful.
473
474See SECURITY CONSIDERATIONS, below, for more info on why this is useful.
475
476=item $json = $json->max_size ([$maximum_string_size])
477
478Set the maximum length a JSON text may have (in bytes) where decoding is
479being attempted. The default is C<0>, meaning no limit. When C<decode>
480is called on a string longer then this number of characters it will not
481attempt to decode the string but throw an exception. This setting has no
482effect on C<encode> (yet).
483
484The argument to C<max_size> will be rounded up to the next B<highest>
485power of two (so may be more than requested). If no argument is given, the
486limit check will be deactivated (same as when C<0> is specified).
364 487
365See SECURITY CONSIDERATIONS, below, for more info on why this is useful. 488See SECURITY CONSIDERATIONS, below, for more info on why this is useful.
366 489
367=item $json_text = $json->encode ($perl_scalar) 490=item $json_text = $json->encode ($perl_scalar)
368 491
430are represented by the same codepoints in the Perl string, so no manual 553are represented by the same codepoints in the Perl string, so no manual
431decoding is necessary. 554decoding is necessary.
432 555
433=item number 556=item number
434 557
435A JSON number becomes either an integer or numeric (floating point) 558A JSON number becomes either an integer, numeric (floating point) or
436scalar in perl, depending on its range and any fractional parts. On the 559string scalar in perl, depending on its range and any fractional parts. On
437Perl level, there is no difference between those as Perl handles all the 560the Perl level, there is no difference between those as Perl handles all
438conversion details, but an integer may take slightly less memory and might 561the conversion details, but an integer may take slightly less memory and
439represent more values exactly than (floating point) numbers. 562might represent more values exactly than (floating point) numbers.
563
564If the number consists of digits only, JSON::XS will try to represent
565it as an integer value. If that fails, it will try to represent it as
566a numeric (floating point) value if that is possible without loss of
567precision. Otherwise it will preserve the number as a string value.
568
569Numbers containing a fractional or exponential part will always be
570represented as numeric (floating point) values, possibly at a loss of
571precision.
572
573This might create round-tripping problems as numbers might become strings,
574but as Perl is typeless there is no other way to do it.
440 575
441=item true, false 576=item true, false
442 577
443These JSON atoms become C<JSON::XS::true> and C<JSON::XS::false>, 578These JSON atoms become C<JSON::XS::true> and C<JSON::XS::false>,
444respectively. They are overloaded to act almost exactly like the numbers 579respectively. They are overloaded to act almost exactly like the numbers
660It shows the number of encodes/decodes per second (JSON::XS uses 795It shows the number of encodes/decodes per second (JSON::XS uses
661the functional interface, while JSON::XS/2 uses the OO interface 796the functional interface, while JSON::XS/2 uses the OO interface
662with pretty-printing and hashkey sorting enabled, JSON::XS/3 enables 797with pretty-printing and hashkey sorting enabled, JSON::XS/3 enables
663shrink). Higher is better: 798shrink). Higher is better:
664 799
800 Storable | 15779.925 | 14169.946 |
801 -----------+------------+------------+
665 module | encode | decode | 802 module | encode | decode |
666 -----------|------------|------------| 803 -----------|------------|------------|
667 JSON | 7645.468 | 4208.613 | 804 JSON | 4990.842 | 4088.813 |
668 JSON::DWIW | 40721.398 | 77101.176 | 805 JSON::DWIW | 51653.990 | 71575.154 |
669 JSON::PC | 65948.176 | 78251.940 | 806 JSON::PC | 65948.176 | 74631.744 |
670 JSON::Syck | 22844.793 | 26479.192 | 807 JSON::PP | 8931.652 | 3817.168 |
808 JSON::Syck | 24877.248 | 27776.848 |
671 JSON::XS | 388361.481 | 199728.762 | 809 JSON::XS | 388361.481 | 227951.304 |
672 JSON::XS/2 | 218453.333 | 192399.266 | 810 JSON::XS/2 | 227951.304 | 218453.333 |
673 JSON::XS/3 | 338250.323 | 192399.266 | 811 JSON::XS/3 | 338250.323 | 218453.333 |
674 Storable | 15779.925 | 14169.946 | 812 Storable | 16500.016 | 135300.129 |
675 -----------+------------+------------+ 813 -----------+------------+------------+
676 814
677That is, JSON::XS is about five times faster than JSON::DWIW on encoding, 815That is, JSON::XS is about five times faster than JSON::DWIW on encoding,
678about three times faster on decoding, and over fourty times faster 816about three times faster on decoding, and over fourty times faster
679than JSON, even with pretty-printing and key sorting. It also compares 817than JSON, even with pretty-printing and key sorting. It also compares
682Using a longer test string (roughly 18KB, generated from Yahoo! Locals 820Using a longer test string (roughly 18KB, generated from Yahoo! Locals
683search API (http://nanoref.com/yahooapis/mgPdGg): 821search API (http://nanoref.com/yahooapis/mgPdGg):
684 822
685 module | encode | decode | 823 module | encode | decode |
686 -----------|------------|------------| 824 -----------|------------|------------|
687 JSON | 254.685 | 37.665 | 825 JSON | 55.260 | 34.971 |
688 JSON::DWIW | 843.343 | 1049.731 | 826 JSON::DWIW | 825.228 | 1082.513 |
689 JSON::PC | 3602.116 | 2307.352 | 827 JSON::PC | 3571.444 | 2394.829 |
828 JSON::PP | 210.987 | 32.574 |
690 JSON::Syck | 505.107 | 787.899 | 829 JSON::Syck | 552.551 | 787.544 |
691 JSON::XS | 5747.196 | 3690.220 | 830 JSON::XS | 5780.463 | 4854.519 |
692 JSON::XS/2 | 3968.121 | 3676.634 | 831 JSON::XS/2 | 3869.998 | 4798.975 |
693 JSON::XS/3 | 6105.246 | 3662.508 | 832 JSON::XS/3 | 5862.880 | 4798.975 |
694 Storable | 4417.337 | 5285.161 | 833 Storable | 4445.002 | 5235.027 |
695 -----------+------------+------------+ 834 -----------+------------+------------+
696 835
697Again, JSON::XS leads by far (except for Storable which non-surprisingly 836Again, JSON::XS leads by far (except for Storable which non-surprisingly
698decodes faster). 837decodes faster).
699 838
716Second, you need to avoid resource-starving attacks. That means you should 855Second, you need to avoid resource-starving attacks. That means you should
717limit the size of JSON texts you accept, or make sure then when your 856limit the size of JSON texts you accept, or make sure then when your
718resources run out, thats just fine (e.g. by using a separate process that 857resources run out, thats just fine (e.g. by using a separate process that
719can crash safely). The size of a JSON text in octets or characters is 858can crash safely). The size of a JSON text in octets or characters is
720usually a good indication of the size of the resources required to decode 859usually a good indication of the size of the resources required to decode
721it into a Perl structure. 860it into a Perl structure. While JSON::XS can check the size of the JSON
861text, it might be too late when you already have it in memory, so you
862might want to check the size before you accept the string.
722 863
723Third, JSON::XS recurses using the C stack when decoding objects and 864Third, JSON::XS recurses using the C stack when decoding objects and
724arrays. The C stack is a limited resource: for instance, on my amd64 865arrays. The C stack is a limited resource: for instance, on my amd64
725machine with 8MB of stack size I can decode around 180k nested arrays but 866machine with 8MB of stack size I can decode around 180k nested arrays but
726only 14k nested JSON objects (due to perl itself recursing deeply on croak 867only 14k nested JSON objects (due to perl itself recursing deeply on croak
757sub true() { $true } 898sub true() { $true }
758sub false() { $false } 899sub false() { $false }
759 900
760sub is_bool($) { 901sub is_bool($) {
761 UNIVERSAL::isa $_[0], "JSON::XS::Boolean" 902 UNIVERSAL::isa $_[0], "JSON::XS::Boolean"
762 or UNIVERSAL::isa $_[0], "JSON::Literal" 903# or UNIVERSAL::isa $_[0], "JSON::Literal"
763} 904}
764 905
765XSLoader::load "JSON::XS", $VERSION; 906XSLoader::load "JSON::XS", $VERSION;
766 907
767package JSON::XS::Boolean; 908package JSON::XS::Boolean;

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines