ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.86 by root, Wed Sep 9 01:47:01 2009 UTC vs.
Revision 1.103 by root, Sat Oct 17 01:42:39 2009 UTC

1=head1 NAME 1=head1 NAME
2 2
3AnyEvent::MP - multi-processing/message-passing framework 3AnyEvent::MP - erlang-style multi-processing/message-passing framework
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 use AnyEvent::MP; 7 use AnyEvent::MP;
8 8
30 rcv $port, pong => sub { warn "pong received\n" }; 30 rcv $port, pong => sub { warn "pong received\n" };
31 31
32 # create a port on another node 32 # create a port on another node
33 my $port = spawn $node, $initfunc, @initdata; 33 my $port = spawn $node, $initfunc, @initdata;
34 34
35 # destroy a prot again
36 kil $port; # "normal" kill
37 kil $port, my_error => "everything is broken"; # error kill
38
35 # monitoring 39 # monitoring
36 mon $port, $cb->(@msg) # callback is invoked on death 40 mon $localport, $cb->(@msg) # callback is invoked on death
37 mon $port, $otherport # kill otherport on abnormal death 41 mon $localport, $otherport # kill otherport on abnormal death
38 mon $port, $otherport, @msg # send message on death 42 mon $localport, $otherport, @msg # send message on death
43
44 # temporarily execute code in port context
45 peval $port, sub { die "kill the port!" };
46
47 # execute callbacks in $SELF port context
48 my $timer = AE::timer 1, 0, psub {
49 die "kill the port, delayed";
50 };
39 51
40=head1 CURRENT STATUS 52=head1 CURRENT STATUS
41 53
42 bin/aemp - stable. 54 bin/aemp - stable.
43 AnyEvent::MP - stable API, should work. 55 AnyEvent::MP - stable API, should work.
44 AnyEvent::MP::Intro - explains most concepts. 56 AnyEvent::MP::Intro - explains most concepts.
45 AnyEvent::MP::Kernel - mostly stable. 57 AnyEvent::MP::Kernel - mostly stable API.
46 AnyEvent::MP::Global - stable but incomplete, protocol not yet final. 58 AnyEvent::MP::Global - stable API.
47
48stay tuned.
49 59
50=head1 DESCRIPTION 60=head1 DESCRIPTION
51 61
52This module (-family) implements a simple message passing framework. 62This module (-family) implements a simple message passing framework.
53 63
118seed node that blocks for long periods will slow down everybody else. 128seed node that blocks for long periods will slow down everybody else.
119 129
120=item seeds - C<host:port> 130=item seeds - C<host:port>
121 131
122Seeds are transport endpoint(s) (usually a hostname/IP address and a 132Seeds are transport endpoint(s) (usually a hostname/IP address and a
123TCP port) of nodes thta should be used as seed nodes. 133TCP port) of nodes that should be used as seed nodes.
124 134
125The nodes listening on those endpoints are expected to be long-running, 135The nodes listening on those endpoints are expected to be long-running,
126and at least one of those should always be available. When nodes run out 136and at least one of those should always be available. When nodes run out
127of connections (e.g. due to a network error), they try to re-establish 137of connections (e.g. due to a network error), they try to re-establish
128connections to some seednodes again to join the network. 138connections to some seednodes again to join the network.
145 155
146use AE (); 156use AE ();
147 157
148use base "Exporter"; 158use base "Exporter";
149 159
150our $VERSION = $AnyEvent::MP::Kernel::VERSION; 160our $VERSION = 1.22;
151 161
152our @EXPORT = qw( 162our @EXPORT = qw(
153 NODE $NODE *SELF node_of after 163 NODE $NODE *SELF node_of after
154 configure 164 configure
155 snd rcv mon mon_guard kil reg psub spawn 165 snd rcv mon mon_guard kil psub peval spawn cal
156 port 166 port
157); 167);
158 168
159our $SELF; 169our $SELF;
160 170
229L<AnyEvent::MP::Global> module, which will then use it to keep 239L<AnyEvent::MP::Global> module, which will then use it to keep
230connectivity with at least one node at any point in time. 240connectivity with at least one node at any point in time.
231 241
232=back 242=back
233 243
234Example: become a distributed node using the locla node name as profile. 244Example: become a distributed node using the local node name as profile.
235This should be the most common form of invocation for "daemon"-type nodes. 245This should be the most common form of invocation for "daemon"-type nodes.
236 246
237 configure 247 configure
238 248
239Example: become an anonymous node. This form is often used for commandline 249Example: become an anonymous node. This form is often used for commandline
373 msg1 => sub { ... }, 383 msg1 => sub { ... },
374 ... 384 ...
375 ; 385 ;
376 386
377Example: temporarily register a rcv callback for a tag matching some port 387Example: temporarily register a rcv callback for a tag matching some port
378(e.g. for a rpc reply) and unregister it after a message was received. 388(e.g. for an rpc reply) and unregister it after a message was received.
379 389
380 rcv $port, $otherport => sub { 390 rcv $port, $otherport => sub {
381 my @reply = @_; 391 my @reply = @_;
382 392
383 rcv $SELF, $otherport; 393 rcv $SELF, $otherport;
396 if (ref $_[0]) { 406 if (ref $_[0]) {
397 if (my $self = $PORT_DATA{$portid}) { 407 if (my $self = $PORT_DATA{$portid}) {
398 "AnyEvent::MP::Port" eq ref $self 408 "AnyEvent::MP::Port" eq ref $self
399 or Carp::croak "$port: rcv can only be called on message matching ports, caught"; 409 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
400 410
401 $self->[2] = shift; 411 $self->[0] = shift;
402 } else { 412 } else {
403 my $cb = shift; 413 my $cb = shift;
404 $PORT{$portid} = sub { 414 $PORT{$portid} = sub {
405 local $SELF = $port; 415 local $SELF = $port;
406 eval { &$cb }; _self_die if $@; 416 eval { &$cb }; _self_die if $@;
407 }; 417 };
408 } 418 }
409 } elsif (defined $_[0]) { 419 } elsif (defined $_[0]) {
410 my $self = $PORT_DATA{$portid} ||= do { 420 my $self = $PORT_DATA{$portid} ||= do {
411 my $self = bless [$PORT{$port} || sub { }, { }, $port], "AnyEvent::MP::Port"; 421 my $self = bless [$PORT{$portid} || sub { }, { }, $port], "AnyEvent::MP::Port";
412 422
413 $PORT{$portid} = sub { 423 $PORT{$portid} = sub {
414 local $SELF = $port; 424 local $SELF = $port;
415 425
416 if (my $cb = $self->[1]{$_[0]}) { 426 if (my $cb = $self->[1]{$_[0]}) {
438 } 448 }
439 449
440 $port 450 $port
441} 451}
442 452
453=item peval $port, $coderef[, @args]
454
455Evaluates the given C<$codref> within the contetx of C<$port>, that is,
456when the code throews an exception the C<$port> will be killed.
457
458Any remaining args will be passed to the callback. Any return values will
459be returned to the caller.
460
461This is useful when you temporarily want to execute code in the context of
462a port.
463
464Example: create a port and run some initialisation code in it's context.
465
466 my $port = port { ... };
467
468 peval $port, sub {
469 init
470 or die "unable to init";
471 };
472
473=cut
474
475sub peval($$) {
476 local $SELF = shift;
477 my $cb = shift;
478
479 if (wantarray) {
480 my @res = eval { &$cb };
481 _self_die if $@;
482 @res
483 } else {
484 my $res = eval { &$cb };
485 _self_die if $@;
486 $res
487 }
488}
489
443=item $closure = psub { BLOCK } 490=item $closure = psub { BLOCK }
444 491
445Remembers C<$SELF> and creates a closure out of the BLOCK. When the 492Remembers C<$SELF> and creates a closure out of the BLOCK. When the
446closure is executed, sets up the environment in the same way as in C<rcv> 493closure is executed, sets up the environment in the same way as in C<rcv>
447callbacks, i.e. runtime errors will cause the port to get C<kil>ed. 494callbacks, i.e. runtime errors will cause the port to get C<kil>ed.
495
496The effect is basically as if it returned C<< sub { peval $SELF, sub {
497BLOCK } } >>.
448 498
449This is useful when you register callbacks from C<rcv> callbacks: 499This is useful when you register callbacks from C<rcv> callbacks:
450 500
451 rcv delayed_reply => sub { 501 rcv delayed_reply => sub {
452 my ($delay, @reply) = @_; 502 my ($delay, @reply) = @_;
525delivered again. 575delivered again.
526 576
527Inter-host-connection timeouts and monitoring depend on the transport 577Inter-host-connection timeouts and monitoring depend on the transport
528used. The only transport currently implemented is TCP, and AnyEvent::MP 578used. The only transport currently implemented is TCP, and AnyEvent::MP
529relies on TCP to detect node-downs (this can take 10-15 minutes on a 579relies on TCP to detect node-downs (this can take 10-15 minutes on a
530non-idle connection, and usually around two hours for idle conenctions). 580non-idle connection, and usually around two hours for idle connections).
531 581
532This means that monitoring is good for program errors and cleaning up 582This means that monitoring is good for program errors and cleaning up
533stuff eventually, but they are no replacement for a timeout when you need 583stuff eventually, but they are no replacement for a timeout when you need
534to ensure some maximum latency. 584to ensure some maximum latency.
535 585
567 } 617 }
568 618
569 $node->monitor ($port, $cb); 619 $node->monitor ($port, $cb);
570 620
571 defined wantarray 621 defined wantarray
572 and AnyEvent::Util::guard { $node->unmonitor ($port, $cb) } 622 and ($cb += 0, AnyEvent::Util::guard { $node->unmonitor ($port, $cb) })
573} 623}
574 624
575=item $guard = mon_guard $port, $ref, $ref... 625=item $guard = mon_guard $port, $ref, $ref...
576 626
577Monitors the given C<$port> and keeps the passed references. When the port 627Monitors the given C<$port> and keeps the passed references. When the port
715 ? $action[0]() 765 ? $action[0]()
716 : snd @action; 766 : snd @action;
717 }; 767 };
718} 768}
719 769
770=item cal $port, @msg, $callback[, $timeout]
771
772A simple form of RPC - sends a message to the given C<$port> with the
773given contents (C<@msg>), but adds a reply port to the message.
774
775The reply port is created temporarily just for the purpose of receiving
776the reply, and will be C<kil>ed when no longer needed.
777
778A reply message sent to the port is passed to the C<$callback> as-is.
779
780If an optional time-out (in seconds) is given and it is not C<undef>,
781then the callback will be called without any arguments after the time-out
782elapsed and the port is C<kil>ed.
783
784If no time-out is given (or it is C<undef>), then the local port will
785monitor the remote port instead, so it eventually gets cleaned-up.
786
787Currently this function returns the temporary port, but this "feature"
788might go in future versions unless you can make a convincing case that
789this is indeed useful for something.
790
791=cut
792
793sub cal(@) {
794 my $timeout = ref $_[-1] ? undef : pop;
795 my $cb = pop;
796
797 my $port = port {
798 undef $timeout;
799 kil $SELF;
800 &$cb;
801 };
802
803 if (defined $timeout) {
804 $timeout = AE::timer $timeout, 0, sub {
805 undef $timeout;
806 kil $port;
807 $cb->();
808 };
809 } else {
810 mon $_[0], sub {
811 kil $port;
812 $cb->();
813 };
814 }
815
816 push @_, $port;
817 &snd;
818
819 $port
820}
821
720=back 822=back
721 823
722=head1 AnyEvent::MP vs. Distributed Erlang 824=head1 AnyEvent::MP vs. Distributed Erlang
723 825
724AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node 826AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node
725== aemp node, Erlang process == aemp port), so many of the documents and 827== aemp node, Erlang process == aemp port), so many of the documents and
726programming techniques employed by Erlang apply to AnyEvent::MP. Here is a 828programming techniques employed by Erlang apply to AnyEvent::MP. Here is a
727sample: 829sample:
728 830
729 http://www.Erlang.se/doc/programming_rules.shtml 831 http://www.erlang.se/doc/programming_rules.shtml
730 http://Erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4 832 http://erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4
731 http://Erlang.org/download/Erlang-book-part1.pdf # chapters 5 and 6 833 http://erlang.org/download/erlang-book-part1.pdf # chapters 5 and 6
732 http://Erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5 834 http://erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5
733 835
734Despite the similarities, there are also some important differences: 836Despite the similarities, there are also some important differences:
735 837
736=over 4 838=over 4
737 839
738=item * Node IDs are arbitrary strings in AEMP. 840=item * Node IDs are arbitrary strings in AEMP.
739 841
740Erlang relies on special naming and DNS to work everywhere in the same 842Erlang relies on special naming and DNS to work everywhere in the same
741way. AEMP relies on each node somehow knowing its own address(es) (e.g. by 843way. AEMP relies on each node somehow knowing its own address(es) (e.g. by
742configuration or DNS), but will otherwise discover other odes itself. 844configuration or DNS), and possibly the addresses of some seed nodes, but
845will otherwise discover other nodes (and their IDs) itself.
743 846
744=item * Erlang has a "remote ports are like local ports" philosophy, AEMP 847=item * Erlang has a "remote ports are like local ports" philosophy, AEMP
745uses "local ports are like remote ports". 848uses "local ports are like remote ports".
746 849
747The failure modes for local ports are quite different (runtime errors 850The failure modes for local ports are quite different (runtime errors
772so does not need a queue that can overflow). AEMP sends are immediate, 875so does not need a queue that can overflow). AEMP sends are immediate,
773connection establishment is handled in the background. 876connection establishment is handled in the background.
774 877
775=item * Erlang suffers from silent message loss, AEMP does not. 878=item * Erlang suffers from silent message loss, AEMP does not.
776 879
777Erlang makes few guarantees on messages delivery - messages can get lost 880Erlang implements few guarantees on messages delivery - messages can get
778without any of the processes realising it (i.e. you send messages a, b, 881lost without any of the processes realising it (i.e. you send messages a,
779and c, and the other side only receives messages a and c). 882b, and c, and the other side only receives messages a and c).
780 883
781AEMP guarantees correct ordering, and the guarantee that after one message 884AEMP guarantees correct ordering, and the guarantee that after one message
782is lost, all following ones sent to the same port are lost as well, until 885is lost, all following ones sent to the same port are lost as well, until
783monitoring raises an error, so there are no silent "holes" in the message 886monitoring raises an error, so there are no silent "holes" in the message
784sequence. 887sequence.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines