ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/CBOR-XS/XS.pm
(Generate patch)

Comparing CBOR-XS/XS.pm (file contents):
Revision 1.38 by root, Tue Dec 3 10:23:55 2013 UTC vs.
Revision 1.46 by root, Mon Feb 8 04:11:11 2016 UTC

64 64
65package CBOR::XS; 65package CBOR::XS;
66 66
67use common::sense; 67use common::sense;
68 68
69our $VERSION = 1.12; 69our $VERSION = 1.4;
70our @ISA = qw(Exporter); 70our @ISA = qw(Exporter);
71 71
72our @EXPORT = qw(encode_cbor decode_cbor); 72our @EXPORT = qw(encode_cbor decode_cbor);
73 73
74use Exporter; 74use Exporter;
218isn't prepared for this will not leak memory. 218isn't prepared for this will not leak memory.
219 219
220If C<$enable> is false (the default), then C<decode> will throw an error 220If C<$enable> is false (the default), then C<decode> will throw an error
221when it encounters a self-referential/cyclic data structure. 221when it encounters a self-referential/cyclic data structure.
222 222
223FUTURE DIRECTION: the motivation behind this option is to avoid I<real>
224cycles - future versions of this module might chose to decode cyclic data
225structures using weak references when this option is off, instead of
226throwing an error.
227
223This option does not affect C<encode> in any way - shared values and 228This option does not affect C<encode> in any way - shared values and
224references will always be decoded properly if present. 229references will always be encoded properly if present.
225 230
226=item $cbor = $cbor->pack_strings ([$enable]) 231=item $cbor = $cbor->pack_strings ([$enable])
227 232
228=item $enabled = $cbor->get_pack_strings 233=item $enabled = $cbor->get_pack_strings
229 234
330and you need to know where the first CBOR string ends amd the next one 335and you need to know where the first CBOR string ends amd the next one
331starts. 336starts.
332 337
333 CBOR::XS->new->decode_prefix ("......") 338 CBOR::XS->new->decode_prefix ("......")
334 => ("...", 3) 339 => ("...", 3)
340
341=back
342
343=head2 INCREMENTAL PARSING
344
345In some cases, there is the need for incremental parsing of JSON
346texts. While this module always has to keep both CBOR text and resulting
347Perl data structure in memory at one time, it does allow you to parse a
348CBOR stream incrementally, using a similar to using "decode_prefix" to see
349if a full CBOR object is available, but is much more efficient.
350
351It basically works by parsing as much of a CBOR string as possible - if
352the CBOR data is not complete yet, the pasrer will remember where it was,
353to be able to restart when more data has been accumulated. Once enough
354data is available to either decode a complete CBOR value or raise an
355error, a real decode will be attempted.
356
357A typical use case would be a network protocol that consists of sending
358and receiving CBOR-encoded messages. The solution that works with CBOR and
359about anything else is by prepending a length to every CBOR value, so the
360receiver knows how many octets to read. More compact (and slightly slower)
361would be to just send CBOR values back-to-back, as C<CBOR::XS> knows where
362a CBOR value ends, and doesn't need an explicit length.
363
364The following methods help with this:
365
366=over 4
367
368=item @decoded = $cbor->incr_parse ($buffer)
369
370This method attempts to decode exactly one CBOR value from the beginning
371of the given C<$buffer>. The value is removed from the C<$buffer> on
372success. When C<$buffer> doesn't contain a complete value yet, it returns
373nothing. Finally, when the C<$buffer> doesn't start with something
374that could ever be a valid CBOR value, it raises an exception, just as
375C<decode> would. In the latter case the decoder state is undefined and
376must be reset before being able to parse further.
377
378This method modifies the C<$buffer> in place. When no CBOR value can be
379decoded, the decoder stores the current string offset. On the next call,
380continues decoding at the place where it stopped before. For this to make
381sense, the C<$buffer> must begin with the same octets as on previous
382unsuccessful calls.
383
384You can call this method in scalar context, in which case it either
385returns a decoded value or C<undef>. This makes it impossible to
386distinguish between CBOR null values (which decode to C<undef>) and an
387unsuccessful decode, which is often acceptable.
388
389=item @decoded = $cbor->incr_parse_multiple ($buffer)
390
391Same as C<incr_parse>, but attempts to decode as many CBOR values as
392possible in one go, instead of at most one. Calls to C<incr_parse> and
393C<incr_parse_multiple> can be interleaved.
394
395=item $cbor->incr_reset
396
397Resets the incremental decoder. This throws away any saved state, so that
398subsequent calls to C<incr_parse> or C<incr_parse_multiple> start to parse
399a new CBOR value from the beginning of the C<$buffer> again.
400
401This method can be caled at any time, but it I<must> be called if you want
402to change your C<$buffer> or there was a decoding error and you want to
403reuse the C<$cbor> object for future incremental parsings.
335 404
336=back 405=back
337 406
338 407
339=head1 MAPPING 408=head1 MAPPING
745 814
746These tags are automatically created (and decoded) for serialisable 815These tags are automatically created (and decoded) for serialisable
747objects using the C<FREEZE/THAW> methods (the L<Types::Serialier> object 816objects using the C<FREEZE/THAW> methods (the L<Types::Serialier> object
748serialisation protocol). See L<OBJECT SERIALISATION> for details. 817serialisation protocol). See L<OBJECT SERIALISATION> for details.
749 818
750=item 28, 29 (shareable, sharedref, L <http://cbor.schmorp.de/value-sharing>) 819=item 28, 29 (shareable, sharedref, L<http://cbor.schmorp.de/value-sharing>)
751 820
752These tags are automatically decoded when encountered (and they do not 821These tags are automatically decoded when encountered (and they do not
753result in a cyclic data structure, see C<allow_cycles>), resulting in 822result in a cyclic data structure, see C<allow_cycles>), resulting in
754shared values in the decoded object. They are only encoded, however, when 823shared values in the decoded object. They are only encoded, however, when
755C<allow_sharing> is enabled. 824C<allow_sharing> is enabled.
765will be shared, others will not. While non-reference shared values can be 834will be shared, others will not. While non-reference shared values can be
766generated in Perl with some effort, they were considered too unimportant 835generated in Perl with some effort, they were considered too unimportant
767to be supported in the encoder. The decoder, however, will decode these 836to be supported in the encoder. The decoder, however, will decode these
768values as shared values. 837values as shared values.
769 838
770=item 256, 25 (stringref-namespace, stringref, L <http://cbor.schmorp.de/stringref>) 839=item 256, 25 (stringref-namespace, stringref, L<http://cbor.schmorp.de/stringref>)
771 840
772These tags are automatically decoded when encountered. They are only 841These tags are automatically decoded when encountered. They are only
773encoded, however, when C<pack_strings> is enabled. 842encoded, however, when C<pack_strings> is enabled.
774 843
775=item 22098 (indirection, L<http://cbor.schmorp.de/indirection>) 844=item 22098 (indirection, L<http://cbor.schmorp.de/indirection>)
953 1022
954 1023
955=head1 LIMITATIONS ON PERLS WITHOUT 64-BIT INTEGER SUPPORT 1024=head1 LIMITATIONS ON PERLS WITHOUT 64-BIT INTEGER SUPPORT
956 1025
957On perls that were built without 64 bit integer support (these are rare 1026On perls that were built without 64 bit integer support (these are rare
958nowadays, even on 32 bit architectures), support for any kind of 64 bit 1027nowadays, even on 32 bit architectures, as all major Perl distributions
1028are built with 64 bit integer support), support for any kind of 64 bit
959integer in CBOR is very limited - most likely, these 64 bit values will 1029integer in CBOR is very limited - most likely, these 64 bit values will
960be truncated, corrupted, or otherwise not decoded correctly. This also 1030be truncated, corrupted, or otherwise not decoded correctly. This also
961includes string, array and map sizes that are stored as 64 bit integers. 1031includes string, array and map sizes that are stored as 64 bit integers.
962 1032
963 1033
1072 my ($m, $e) = $_[0]->parts; 1142 my ($m, $e) = $_[0]->parts;
1073 tag 4, [$e->numify, $m] 1143 tag 4, [$e->numify, $m]
1074} 1144}
1075 1145
1076sub Time::Piece::TO_CBOR { 1146sub Time::Piece::TO_CBOR {
1077 tag 1, $_[0]->epoch 1147 tag 1, 0 + $_[0]->epoch
1078} 1148}
1079 1149
1080XSLoader::load "CBOR::XS", $VERSION; 1150XSLoader::load "CBOR::XS", $VERSION;
1081 1151
1082=head1 SEE ALSO 1152=head1 SEE ALSO

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines