ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/JSON-XS/XS.pm
(Generate patch)

Comparing JSON-XS/XS.pm (file contents):
Revision 1.121 by root, Mon Jul 13 22:13:17 2009 UTC vs.
Revision 1.135 by root, Wed Jun 1 13:01:09 2011 UTC

64so, and even documents what "correct" means. 64so, and even documents what "correct" means.
65 65
66=item * round-trip integrity 66=item * round-trip integrity
67 67
68When you serialise a perl data structure using only data types supported 68When you serialise a perl data structure using only data types supported
69by JSON, the deserialised data structure is identical on the Perl level. 69by JSON and Perl, the deserialised data structure is identical on the Perl
70(e.g. the string "2.0" doesn't suddenly become "2" just because it looks 70level. (e.g. the string "2.0" doesn't suddenly become "2" just because
71like a number). There minor I<are> exceptions to this, read the MAPPING 71it looks like a number). There I<are> minor exceptions to this, read the
72section below to learn about those. 72MAPPING section below to learn about those.
73 73
74=item * strict checking of JSON correctness 74=item * strict checking of JSON correctness
75 75
76There is no guessing, no generating of illegal JSON texts by default, 76There is no guessing, no generating of illegal JSON texts by default,
77and only JSON is accepted as input by default (the latter is a security 77and only JSON is accepted as input by default (the latter is a security
101 101
102package JSON::XS; 102package JSON::XS;
103 103
104use common::sense; 104use common::sense;
105 105
106our $VERSION = '2.24'; 106our $VERSION = '2.3';
107our @ISA = qw(Exporter); 107our @ISA = qw(Exporter);
108 108
109our @EXPORT = qw(encode_json decode_json to_json from_json); 109our @EXPORT = qw(encode_json decode_json to_json from_json);
110 110
111sub to_json($) { 111sub to_json($) {
440the same JSON text (given the same overall settings). If it is disabled, 440the same JSON text (given the same overall settings). If it is disabled,
441the same hash might be encoded differently even if contains the same data, 441the same hash might be encoded differently even if contains the same data,
442as key-value pairs have no inherent ordering in Perl. 442as key-value pairs have no inherent ordering in Perl.
443 443
444This setting has no effect when decoding JSON texts. 444This setting has no effect when decoding JSON texts.
445
446This setting has currently no effect on tied hashes.
445 447
446=item $json = $json->allow_nonref ([$enable]) 448=item $json = $json->allow_nonref ([$enable])
447 449
448=item $enabled = $json->get_allow_nonref 450=item $enabled = $json->get_allow_nonref
449 451
711calls). 713calls).
712 714
713JSON::XS will only attempt to parse the JSON text once it is sure it 715JSON::XS will only attempt to parse the JSON text once it is sure it
714has enough text to get a decisive result, using a very simple but 716has enough text to get a decisive result, using a very simple but
715truly incremental parser. This means that it sometimes won't stop as 717truly incremental parser. This means that it sometimes won't stop as
716early as the full parser, for example, it doesn't detect parenthese 718early as the full parser, for example, it doesn't detect mismatched
717mismatches. The only thing it guarantees is that it starts decoding as 719parentheses. The only thing it guarantees is that it starts decoding as
718soon as a syntactically valid JSON text has been seen. This means you need 720soon as a syntactically valid JSON text has been seen. This means you need
719to set resource limits (e.g. C<max_size>) to ensure the parser will stop 721to set resource limits (e.g. C<max_size>) to ensure the parser will stop
720parsing in the presence if syntax errors. 722parsing in the presence if syntax errors.
721 723
722The following methods implement this incremental parser. 724The following methods implement this incremental parser.
748otherwise. For this to work, there must be no separators between the JSON 750otherwise. For this to work, there must be no separators between the JSON
749objects or arrays, instead they must be concatenated back-to-back. If 751objects or arrays, instead they must be concatenated back-to-back. If
750an error occurs, an exception will be raised as in the scalar context 752an error occurs, an exception will be raised as in the scalar context
751case. Note that in this case, any previously-parsed JSON texts will be 753case. Note that in this case, any previously-parsed JSON texts will be
752lost. 754lost.
755
756Example: Parse some JSON arrays/objects in a given string and return
757them.
758
759 my @objs = JSON::XS->new->incr_parse ("[5][7][1,2]");
753 760
754=item $lvalue_string = $json->incr_text 761=item $lvalue_string = $json->incr_text
755 762
756This method returns the currently stored JSON fragment as an lvalue, that 763This method returns the currently stored JSON fragment as an lvalue, that
757is, you can manipulate it. This I<only> works when a preceding call to 764is, you can manipulate it. This I<only> works when a preceding call to
987Numbers containing a fractional or exponential part will always be 994Numbers containing a fractional or exponential part will always be
988represented as numeric (floating point) values, possibly at a loss of 995represented as numeric (floating point) values, possibly at a loss of
989precision (in which case you might lose perfect roundtripping ability, but 996precision (in which case you might lose perfect roundtripping ability, but
990the JSON number will still be re-encoded as a JSON number). 997the JSON number will still be re-encoded as a JSON number).
991 998
999Note that precision is not accuracy - binary floating point values cannot
1000represent most decimal fractions exactly, and when converting from and to
1001floating point, JSON::XS only guarantees precision up to but not including
1002the leats significant bit.
1003
992=item true, false 1004=item true, false
993 1005
994These JSON atoms become C<JSON::XS::true> and C<JSON::XS::false>, 1006These JSON atoms become C<JSON::XS::true> and C<JSON::XS::false>,
995respectively. They are overloaded to act almost exactly like the numbers 1007respectively. They are overloaded to act almost exactly like the numbers
996C<1> and C<0>. You can check whether a scalar is a JSON boolean by using 1008C<1> and C<0>. You can check whether a scalar is a JSON boolean by using
1083 1095
1084You can not currently force the type in other, less obscure, ways. Tell me 1096You can not currently force the type in other, less obscure, ways. Tell me
1085if you need this capability (but don't forget to explain why it's needed 1097if you need this capability (but don't forget to explain why it's needed
1086:). 1098:).
1087 1099
1100Note that numerical precision has the same meaning as under Perl (so
1101binary to decimal conversion follows the same rules as in Perl, which
1102can differ to other languages). Also, your perl interpreter might expose
1103extensions to the floating point numbers of your platform, such as
1104infinities or NaN's - these cannot be represented in JSON, and it is an
1105error to pass those in.
1106
1088=back 1107=back
1089 1108
1090 1109
1091=head1 ENCODING/CODESET FLAG NOTES 1110=head1 ENCODING/CODESET FLAG NOTES
1092 1111
1236well - using C<eval> naively simply I<will> cause problems. 1255well - using C<eval> naively simply I<will> cause problems.
1237 1256
1238Another problem is that some javascript implementations reserve 1257Another problem is that some javascript implementations reserve
1239some property names for their own purposes (which probably makes 1258some property names for their own purposes (which probably makes
1240them non-ECMAscript-compliant). For example, Iceweasel reserves the 1259them non-ECMAscript-compliant). For example, Iceweasel reserves the
1241C<__proto__> property name for it's own purposes. 1260C<__proto__> property name for its own purposes.
1242 1261
1243If that is a problem, you could parse try to filter the resulting JSON 1262If that is a problem, you could parse try to filter the resulting JSON
1244output for these property strings, e.g.: 1263output for these property strings, e.g.:
1245 1264
1246 $json =~ s/"__proto__"\s*:/"__proto__renamed":/g; 1265 $json =~ s/"__proto__"\s*:/"__proto__renamed":/g;
1266 my $yaml = $to_yaml->encode ($ref) . "\n"; 1285 my $yaml = $to_yaml->encode ($ref) . "\n";
1267 1286
1268This will I<usually> generate JSON texts that also parse as valid 1287This will I<usually> generate JSON texts that also parse as valid
1269YAML. Please note that YAML has hardcoded limits on (simple) object key 1288YAML. Please note that YAML has hardcoded limits on (simple) object key
1270lengths that JSON doesn't have and also has different and incompatible 1289lengths that JSON doesn't have and also has different and incompatible
1271unicode handling, so you should make sure that your hash keys are 1290unicode character escape syntax, so you should make sure that your hash
1272noticeably shorter than the 1024 "stream characters" YAML allows and that 1291keys are noticeably shorter than the 1024 "stream characters" YAML allows
1273you do not have characters with codepoint values outside the Unicode BMP 1292and that you do not have characters with codepoint values outside the
1274(basic multilingual page). YAML also does not allow C<\/> sequences in 1293Unicode BMP (basic multilingual page). YAML also does not allow C<\/>
1275strings (which JSON::XS does not I<currently> generate, but other JSON 1294sequences in strings (which JSON::XS does not I<currently> generate, but
1276generators might). 1295other JSON generators might).
1277 1296
1278There might be other incompatibilities that I am not aware of (or the YAML 1297There might be other incompatibilities that I am not aware of (or the YAML
1279specification has been changed yet again - it does so quite often). In 1298specification has been changed yet again - it does so quite often). In
1280general you should not try to generate YAML with a JSON generator or vice 1299general you should not try to generate YAML with a JSON generator or vice
1281versa, or try to parse JSON with a YAML parser or vice versa: chances are 1300versa, or try to parse JSON with a YAML parser or vice versa: chances are
1300that difficult or long) and finally make YAML compatible to it, and 1319that difficult or long) and finally make YAML compatible to it, and
1301educating users about the changes, instead of spreading lies about the 1320educating users about the changes, instead of spreading lies about the
1302real compatibility for many I<years> and trying to silence people who 1321real compatibility for many I<years> and trying to silence people who
1303point out that it isn't true. 1322point out that it isn't true.
1304 1323
1324Addendum/2009: the YAML 1.2 spec is still incompatible with JSON, even
1325though the incompatibilities have been documented (and are known to Brian)
1326for many years and the spec makes explicit claims that YAML is a superset
1327of JSON. It would be so easy to fix, but apparently, bullying people and
1328corrupting userdata is so much easier.
1329
1305=back 1330=back
1306 1331
1307 1332
1308=head2 SPEED 1333=head2 SPEED
1309 1334
1316a very short single-line JSON string (also available at 1341a very short single-line JSON string (also available at
1317L<http://dist.schmorp.de/misc/json/short.json>). 1342L<http://dist.schmorp.de/misc/json/short.json>).
1318 1343
1319 {"method": "handleMessage", "params": ["user1", 1344 {"method": "handleMessage", "params": ["user1",
1320 "we were just talking"], "id": null, "array":[1,11,234,-5,1e5,1e7, 1345 "we were just talking"], "id": null, "array":[1,11,234,-5,1e5,1e7,
1321 true, false]} 1346 1, 0]}
1322 1347
1323It shows the number of encodes/decodes per second (JSON::XS uses 1348It shows the number of encodes/decodes per second (JSON::XS uses
1324the functional interface, while JSON::XS/2 uses the OO interface 1349the functional interface, while JSON::XS/2 uses the OO interface
1325with pretty-printing and hashkey sorting enabled, JSON::XS/3 enables 1350with pretty-printing and hashkey sorting enabled, JSON::XS/3 enables
1326shrink). Higher is better: 1351shrink. JSON::DWIW/DS uses the deserialise function, while JSON::DWIW::FJ
1352uses the from_json method). Higher is better:
1327 1353
1328 module | encode | decode | 1354 module | encode | decode |
1329 -----------|------------|------------| 1355 --------------|------------|------------|
1330 JSON 1.x | 4990.842 | 4088.813 | 1356 JSON::DWIW/DS | 86302.551 | 102300.098 |
1331 JSON::DWIW | 51653.990 | 71575.154 | 1357 JSON::DWIW/FJ | 86302.551 | 75983.768 |
1332 JSON::PC | 65948.176 | 74631.744 | 1358 JSON::PP | 15827.562 | 6638.658 |
1333 JSON::PP | 8931.652 | 3817.168 | 1359 JSON::Syck | 63358.066 | 47662.545 |
1334 JSON::Syck | 24877.248 | 27776.848 | 1360 JSON::XS | 511500.488 | 511500.488 |
1335 JSON::XS | 388361.481 | 227951.304 | 1361 JSON::XS/2 | 291271.111 | 388361.481 |
1336 JSON::XS/2 | 227951.304 | 218453.333 | 1362 JSON::XS/3 | 361577.931 | 361577.931 |
1337 JSON::XS/3 | 338250.323 | 218453.333 | 1363 Storable | 66788.280 | 265462.278 |
1338 Storable | 16500.016 | 135300.129 |
1339 -----------+------------+------------+ 1364 --------------+------------+------------+
1340 1365
1341That is, JSON::XS is about five times faster than JSON::DWIW on encoding, 1366That is, JSON::XS is almost six times faster than JSON::DWIW on encoding,
1342about three times faster on decoding, and over forty times faster 1367about five times faster on decoding, and over thirty to seventy times
1343than JSON, even with pretty-printing and key sorting. It also compares 1368faster than JSON's pure perl implementation. It also compares favourably
1344favourably to Storable for small amounts of data. 1369to Storable for small amounts of data.
1345 1370
1346Using a longer test string (roughly 18KB, generated from Yahoo! Locals 1371Using a longer test string (roughly 18KB, generated from Yahoo! Locals
1347search API (L<http://dist.schmorp.de/misc/json/long.json>). 1372search API (L<http://dist.schmorp.de/misc/json/long.json>).
1348 1373
1349 module | encode | decode | 1374 module | encode | decode |
1350 -----------|------------|------------| 1375 --------------|------------|------------|
1351 JSON 1.x | 55.260 | 34.971 | 1376 JSON::DWIW/DS | 1647.927 | 2673.916 |
1352 JSON::DWIW | 825.228 | 1082.513 | 1377 JSON::DWIW/FJ | 1630.249 | 2596.128 |
1353 JSON::PC | 3571.444 | 2394.829 |
1354 JSON::PP | 210.987 | 32.574 | 1378 JSON::PP | 400.640 | 62.311 |
1355 JSON::Syck | 552.551 | 787.544 | 1379 JSON::Syck | 1481.040 | 1524.869 |
1356 JSON::XS | 5780.463 | 4854.519 | 1380 JSON::XS | 20661.596 | 9541.183 |
1357 JSON::XS/2 | 3869.998 | 4798.975 | 1381 JSON::XS/2 | 10683.403 | 9416.938 |
1358 JSON::XS/3 | 5862.880 | 4798.975 | 1382 JSON::XS/3 | 20661.596 | 9400.054 |
1359 Storable | 4445.002 | 5235.027 | 1383 Storable | 19765.806 | 10000.725 |
1360 -----------+------------+------------+ 1384 --------------+------------+------------+
1361 1385
1362Again, JSON::XS leads by far (except for Storable which non-surprisingly 1386Again, JSON::XS leads by far (except for Storable which non-surprisingly
1363decodes faster). 1387decodes a bit faster).
1364 1388
1365On large strings containing lots of high Unicode characters, some modules 1389On large strings containing lots of high Unicode characters, some modules
1366(such as JSON::PC) seem to decode faster than JSON::XS, but the result 1390(such as JSON::PC) seem to decode faster than JSON::XS, but the result
1367will be broken due to missing (or wrong) Unicode handling. Others refuse 1391will be broken due to missing (or wrong) Unicode handling. Others refuse
1368to decode or encode properly, so it was impossible to prepare a fair 1392to decode or encode properly, so it was impossible to prepare a fair
1404information you might want to make sure that exceptions thrown by JSON::XS 1428information you might want to make sure that exceptions thrown by JSON::XS
1405will not end up in front of untrusted eyes. 1429will not end up in front of untrusted eyes.
1406 1430
1407If you are using JSON::XS to return packets to consumption 1431If you are using JSON::XS to return packets to consumption
1408by JavaScript scripts in a browser you should have a look at 1432by JavaScript scripts in a browser you should have a look at
1409L<http://jpsykes.com/47/practical-csrf-and-json-security> to see whether 1433L<http://blog.archive.jpsykes.com/47/practical-csrf-and-json-security/> to
1410you are vulnerable to some common attack vectors (which really are browser 1434see whether you are vulnerable to some common attack vectors (which really
1411design bugs, but it is still you who will have to deal with it, as major 1435are browser design bugs, but it is still you who will have to deal with
1412browser developers care only for features, not about getting security 1436it, as major browser developers care only for features, not about getting
1413right). 1437security right).
1414 1438
1415 1439
1416=head1 THREADS 1440=head1 THREADS
1417 1441
1418This module is I<not> guaranteed to be thread safe and there are no 1442This module is I<not> guaranteed to be thread safe and there are no

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines