ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/CBOR-XS/XS.pm
(Generate patch)

Comparing CBOR-XS/XS.pm (file contents):
Revision 1.6 by root, Sun Oct 27 20:40:25 2013 UTC vs.
Revision 1.13 by root, Tue Oct 29 15:56:31 2013 UTC

26 substr $many_cbor_strings, 0, $length, ""; # remove decoded cbor string 26 substr $many_cbor_strings, 0, $length, ""; # remove decoded cbor string
27 } 27 }
28 28
29=head1 DESCRIPTION 29=head1 DESCRIPTION
30 30
31WARNING! THIS IS A PRE-ALPHA RELEASE! IT WILL CRASH, CORRUPT YOUR DATA 31WARNING! This module is very new, and not very well tested (that's up to
32AND EAT YOUR CHILDREN! (Actually, apart from being untested and a bit 32you to do). Furthermore, details of the implementation might change freely
33feature-limited, it might already be useful). 33before version 1.0. And lastly, the object serialisation protocol depends
34on a pending IANA assignment, and until that assignment is official, this
35implementation is not interoperable with other implementations (even
36future versions of this module) until the assignment is done.
37
38You are still invited to try out CBOR, and this module.
34 39
35This module converts Perl data structures to the Concise Binary Object 40This module converts Perl data structures to the Concise Binary Object
36Representation (CBOR) and vice versa. CBOR is a fast binary serialisation 41Representation (CBOR) and vice versa. CBOR is a fast binary serialisation
37format that aims to use a superset of the JSON data model, i.e. when you 42format that aims to use a superset of the JSON data model, i.e. when you
38can represent something in JSON, you should be able to represent it in 43can represent something in JSON, you should be able to represent it in
39CBOR. 44CBOR.
40 45
41This makes it a faster and more compact binary alternative to JSON, with 46In short, CBOR is a faster and very compact binary alternative to JSON,
42the added ability of supporting serialising of perl objects. 47with the added ability of supporting serialisation of Perl objects. (JSON
48often compresses better than CBOR though, so if you plan to compress the
49data later you might want to compare both formats first).
43 50
44The primary goal of this module is to be I<correct> and the secondary goal 51The primary goal of this module is to be I<correct> and the secondary goal
45is to be I<fast>. To reach the latter goal it was written in C. 52is to be I<fast>. To reach the latter goal it was written in C.
46 53
47See MAPPING, below, on how CBOR::XS maps perl values to CBOR values and 54See MAPPING, below, on how CBOR::XS maps perl values to CBOR values and
51 58
52package CBOR::XS; 59package CBOR::XS;
53 60
54use common::sense; 61use common::sense;
55 62
56our $VERSION = 0.03; 63our $VERSION = 0.06;
57our @ISA = qw(Exporter); 64our @ISA = qw(Exporter);
58 65
59our @EXPORT = qw(encode_cbor decode_cbor); 66our @EXPORT = qw(encode_cbor decode_cbor);
60 67
61use Exporter; 68use Exporter;
221C<1> and C<0> (for true and false) or to throw an exception on access (for 228C<1> and C<0> (for true and false) or to throw an exception on access (for
222error). See the L<Types::Serialiser> manpage for details. 229error). See the L<Types::Serialiser> manpage for details.
223 230
224=item CBOR tag 256 (perl object) 231=item CBOR tag 256 (perl object)
225 232
226The tag value C<256> (TODO: pending iana registration) will be used to 233The tag value C<256> (TODO: pending iana registration) will be used
227deserialise a Perl object. 234to deserialise a Perl object serialised with C<FREEZE>. See L<OBJECT
228 235SERIALISATION>, below, for details.
229TODO For this to work, the class must be loaded and must have a
230C<FROM_CBOR> method. The decoder will then call the C<FROM_CBOR> method
231with the constructor arguments provided by the C<TO_CBOR> method (see
232below).
233
234The C<FROM_CBOR> method must return a single value that will then be used
235as the deserialised value.
236 236
237=item CBOR tag 55799 (magic header) 237=item CBOR tag 55799 (magic header)
238 238
239The tag 55799 is ignored (this tag implements the magic header). 239The tag 55799 is ignored (this tag implements the magic header).
240 240
283C<1>, which get turned into false and true in CBOR. 283C<1>, which get turned into false and true in CBOR.
284 284
285=item CBOR::XS::Tagged objects 285=item CBOR::XS::Tagged objects
286 286
287Objects of this type must be arrays consisting of a single C<[tag, value]> 287Objects of this type must be arrays consisting of a single C<[tag, value]>
288pair. The (numerical) tag will be encoded as a CBOR tag, the value will be 288pair. The (numerical) tag will be encoded as a CBOR tag, the value will
289encoded as appropriate for the value. 289be encoded as appropriate for the value. You cna use C<CBOR::XS::tag> to
290create such objects.
290 291
291=item Types::Serialiser::true, Types::Serialiser::false, Types::Serialiser::error 292=item Types::Serialiser::true, Types::Serialiser::false, Types::Serialiser::error
292 293
293These special values become CBOR true, CBOR false and CBOR undefined 294These special values become CBOR true, CBOR false and CBOR undefined
294values, respectively. You can also use C<\1>, C<\0> and C<\undef> directly 295values, respectively. You can also use C<\1>, C<\0> and C<\undef> directly
295if you want. 296if you want.
296 297
297=item blessed objects 298=item other blessed objects
298 299
299Other blessed objects currently need to have a C<TO_CBOR> method. It 300Other blessed objects are serialised via C<TO_CBOR> or C<FREEZE>. See
300will be called on every object that is being serialised, and must return 301L<OBJECT SERIALISATION>, below, for details.
301something that can be encoded in CBOR.
302 302
303=item simple scalars 303=item simple scalars
304 304
305TODO 305TODO
306Simple Perl scalars (any scalar that is not a reference) are the most 306Simple Perl scalars (any scalar that is not a reference) are the most
344represent numerical values are supported, but might suffer loss of 344represent numerical values are supported, but might suffer loss of
345precision. 345precision.
346 346
347=back 347=back
348 348
349=head2 OBJECT SERIALISATION
349 350
351This module knows two way to serialise a Perl object: The CBOR-specific
352way, and the generic way.
353
354Whenever the encoder encounters a Perl object that it cnanot serialise
355directly (most of them), it will first look up the C<TO_CBOR> method on
356it.
357
358If it has a C<TO_CBOR> method, it will call it with the object as only
359argument, and expects exactly one return value, which it will then
360substitute and encode it in the place of the object.
361
362Otherwise, it will look up the C<FREEZE> method. If it exists, it will
363call it with the object as first argument, and the constant string C<CBOR>
364as the second argument, to distinguish it from other serialisers.
365
366The C<FREEZE> method can return any number of values (i.e. zero or
367more). These will be encoded as CBOR perl object, together with the
368classname.
369
370If an object supports neither C<TO_CBOR> nor C<FREEZE>, encoding will fail
371with an error.
372
373Objects encoded via C<TO_CBOR> cannot be automatically decoded, but
374objects encoded via C<FREEZE> can be decoded using the following protocol:
375
376When an encoded CBOR perl object is encountered by the decoder, it will
377look up the C<THAW> method, by using the stored classname, and will fail
378if the method cannot be found.
379
380After the lookup it will call the C<THAW> method with the stored classname
381as first argument, the constant string C<CBOR> as second argument, and all
382values returned by C<FREEZE> as remaining arguments.
383
384=head4 EXAMPLES
385
386Here is an example C<TO_CBOR> method:
387
388 sub My::Object::TO_CBOR {
389 my ($obj) = @_;
390
391 ["this is a serialised My::Object object", $obj->{id}]
392 }
393
394When a C<My::Object> is encoded to CBOR, it will instead encode a simple
395array with two members: a string, and the "object id". Decoding this CBOR
396string will yield a normal perl array reference in place of the object.
397
398A more useful and practical example would be a serialisation method for
399the URI module. CBOR has a custom tag value for URIs, namely 32:
400
401 sub URI::TO_CBOR {
402 my ($self) = @_;
403 my $uri = "$self"; # stringify uri
404 utf8::upgrade $uri; # make sure it will be encoded as UTF-8 string
405 CBOR::XS::tagged 32, "$_[0]"
406 }
407
408This will encode URIs as a UTF-8 string with tag 32, which indicates an
409URI.
410
411Decoding such an URI will not (currently) give you an URI object, but
412instead a CBOR::XS::Tagged object with tag number 32 and the string -
413exactly what was returned by C<TO_CBOR>.
414
415To serialise an object so it can automatically be deserialised, you need
416to use C<FREEZE> and C<THAW>. To take the URI module as example, this
417would be a possible implementation:
418
419 sub URI::FREEZE {
420 my ($self, $serialiser) = @_;
421 "$self" # encode url string
422 }
423
424 sub URI::THAW {
425 my ($class, $serialiser, $uri) = @_;
426
427 $class->new ($uri)
428 }
429
430Unlike C<TO_CBOR>, multiple values can be returned by C<FREEZE>. For
431example, a C<FREEZE> method that returns "type", "id" and "variant" values
432would cause an invocation of C<THAW> with 5 arguments:
433
434 sub My::Object::FREEZE {
435 my ($self, $serialiser) = @_;
436
437 ($self->{type}, $self->{id}, $self->{variant})
438 }
439
440 sub My::Object::THAW {
441 my ($class, $serialiser, $type, $id, $variant) = @_;
442
443 $class-<new (type => $type, id => $id, variant => $variant)
444 }
445
446
350=head2 MAGIC HEADER 447=head1 MAGIC HEADER
351 448
352There is no way to distinguish CBOR from other formats 449There is no way to distinguish CBOR from other formats
353programmatically. To make it easier to distinguish CBOR from other 450programmatically. To make it easier to distinguish CBOR from other
354formats, the CBOR specification has a special "magic string" that can be 451formats, the CBOR specification has a special "magic string" that can be
355prepended to any CBOR string without changing it's meaning. 452prepended to any CBOR string without changing it's meaning.
358prepend this string tot he CBOR data it generates, but it will ignroe it 455prepend this string tot he CBOR data it generates, but it will ignroe it
359if present, so users can prepend this string as a "file type" indicator as 456if present, so users can prepend this string as a "file type" indicator as
360required. 457required.
361 458
362 459
460=head1 THE CBOR::XS::Tagged CLASS
461
462CBOR has the concept of tagged values - any CBOR value can be tagged with
463a numeric 64 bit number, which are centrally administered.
464
465C<CBOR::XS> handles a few tags internally when en- or decoding. You can
466also create tags yourself by encoding C<CBOR::XS::Tagged> objects, and the
467decoder will create C<CBOR::XS::Tagged> objects itself when it hits an
468unknown tag.
469
470These objects are simply blessed array references - the first member of
471the array being the numerical tag, the second being the value.
472
473You can interact with C<CBOR::XS::Tagged> objects in the following ways:
474
475=over 4
476
477=item $tagged = CBOR::XS::tag $tag, $value
478
479This function(!) creates a new C<CBOR::XS::Tagged> object using the given
480C<$tag> (0..2**64-1) to tag the given C<$value> (which can be any Perl
481value that can be encoded in CBOR, including serialisable Perl objects and
482C<CBOR::XS::Tagged> objects).
483
484=item $tagged->[0]
485
486=item $tagged->[0] = $new_tag
487
488=item $tag = $tagged->tag
489
490=item $new_tag = $tagged->tag ($new_tag)
491
492Access/mutate the tag.
493
494=item $tagged->[1]
495
496=item $tagged->[1] = $new_value
497
498=item $value = $tagged->value
499
500=item $new_value = $tagged->value ($new_value)
501
502Access/mutate the tagged value.
503
504=back
505
506=cut
507
508sub tag($$) {
509 bless [@_], CBOR::XS::Tagged::;
510}
511
512sub CBOR::XS::Tagged::tag {
513 $_[0][0] = $_[1] if $#_;
514 $_[0][0]
515}
516
517sub CBOR::XS::Tagged::value {
518 $_[0][1] = $_[1] if $#_;
519 $_[0][1]
520}
521
522=head2 EXAMPLES
523
524Here are some examples of C<CBOR::XS::Tagged> uses to tag objects.
525
526You can look up CBOR tag value and emanings in the IANA registry at
527L<http://www.iana.org/assignments/cbor-tags/cbor-tags.xhtml>.
528
529Prepend a magic header (C<$CBOR::XS::MAGIC>):
530
531 my $cbor = encode_cbor CBOR::XS::tag 55799, $value;
532 # same as:
533 my $cbor = $CBOR::XS::MAGIC . encode_cbor $value;
534
535Serialise some URIs and a regex in an array:
536
537 my $cbor = encode_cbor [
538 (CBOR::XS::tag 32, "http://www.nethype.de/"),
539 (CBOR::XS::tag 32, "http://software.schmorp.de/"),
540 (CBOR::XS::tag 35, "^[Pp][Ee][Rr][lL]\$"),
541 ];
542
543Wrap CBOR data in CBOR:
544
545 my $cbor_cbor = encode_cbor
546 CBOR::XS::tag 24,
547 encode_cbor [1, 2, 3];
548
363=head2 CBOR and JSON 549=head1 CBOR and JSON
364 550
365CBOR is supposed to implement a superset of the JSON data model, and is, 551CBOR is supposed to implement a superset of the JSON data model, and is,
366with some coercion, able to represent all JSON texts (something that other 552with some coercion, able to represent all JSON texts (something that other
367"binary JSON" formats such as BSON generally do not support). 553"binary JSON" formats such as BSON generally do not support).
368 554

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines