ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.31 by root, Wed Aug 5 19:55:58 2009 UTC vs.
Revision 1.51 by root, Fri Aug 14 14:07:44 2009 UTC

8 8
9 $NODE # contains this node's noderef 9 $NODE # contains this node's noderef
10 NODE # returns this node's noderef 10 NODE # returns this node's noderef
11 NODE $port # returns the noderef of the port 11 NODE $port # returns the noderef of the port
12 12
13 $SELF # receiving/own port id in rcv callbacks
14
15 # initialise the node so it can send/receive messages
16 initialise_node; # -OR-
17 initialise_node "localhost:4040"; # -OR-
18 initialise_node "slave/", "localhost:4040"
19
20 # ports are message endpoints
21
22 # sending messages
13 snd $port, type => data...; 23 snd $port, type => data...;
24 snd $port, @msg;
25 snd @msg_with_first_element_being_a_port;
14 26
15 $SELF # receiving/own port id in rcv callbacks 27 # creating/using ports, the simple way
28 my $somple_port = port { my @msg = @_; 0 };
16 29
17 rcv $port, smartmatch => $cb->($port, @msg); 30 # creating/using ports, type matching
18 31 my $port = port;
19 # examples:
20 rcv $port2, ping => sub { snd $_[0], "pong"; 0 }; 32 rcv $port, ping => sub { snd $_[0], "pong"; 0 };
21 rcv $port1, pong => sub { warn "pong received\n" }; 33 rcv $port, pong => sub { warn "pong received\n"; 0 };
22 snd $port2, ping => $port1;
23 34
24 # more, smarter, matches (_any_ is exported by this module) 35 # create a port on another node
25 rcv $port, [child_died => $pid] => sub { ... 36 my $port = spawn $node, $initfunc, @initdata;
26 rcv $port, [_any_, _any_, 3] => sub { .. $_[2] is 3 37
38 # monitoring
39 mon $port, $cb->(@msg) # callback is invoked on death
40 mon $port, $otherport # kill otherport on abnormal death
41 mon $port, $otherport, @msg # send message on death
42
43=head1 CURRENT STATUS
44
45 AnyEvent::MP - stable API, should work
46 AnyEvent::MP::Intro - outdated
47 AnyEvent::MP::Kernel - WIP
48 AnyEvent::MP::Transport - mostly stable
49
50 stay tuned.
27 51
28=head1 DESCRIPTION 52=head1 DESCRIPTION
29 53
30This module (-family) implements a simple message passing framework. 54This module (-family) implements a simple message passing framework.
31 55
35For an introduction to this module family, see the L<AnyEvent::MP::Intro> 59For an introduction to this module family, see the L<AnyEvent::MP::Intro>
36manual page. 60manual page.
37 61
38At the moment, this module family is severly broken and underdocumented, 62At the moment, this module family is severly broken and underdocumented,
39so do not use. This was uploaded mainly to reserve the CPAN namespace - 63so do not use. This was uploaded mainly to reserve the CPAN namespace -
40stay tuned! The basic API should be finished, however. 64stay tuned!
41 65
42=head1 CONCEPTS 66=head1 CONCEPTS
43 67
44=over 4 68=over 4
45 69
90 114
91=cut 115=cut
92 116
93package AnyEvent::MP; 117package AnyEvent::MP;
94 118
95use AnyEvent::MP::Base; 119use AnyEvent::MP::Kernel;
96 120
97use common::sense; 121use common::sense;
98 122
99use Carp (); 123use Carp ();
100 124
101use AE (); 125use AE ();
102 126
103use base "Exporter"; 127use base "Exporter";
104 128
105our $VERSION = '0.1'; 129our $VERSION = $AnyEvent::MP::Kernel::VERSION;
130
106our @EXPORT = qw( 131our @EXPORT = qw(
107 NODE $NODE *SELF node_of _any_ 132 NODE $NODE *SELF node_of _any_
108 resolve_node initialise_node 133 resolve_node initialise_node
109 snd rcv mon kil reg psub 134 snd rcv mon kil reg psub spawn
110 port 135 port
111); 136);
112 137
113our $SELF; 138our $SELF;
114 139
123The C<NODE> function returns, and the C<$NODE> variable contains 148The C<NODE> function returns, and the C<$NODE> variable contains
124the noderef of the local node. The value is initialised by a call 149the noderef of the local node. The value is initialised by a call
125to C<become_public> or C<become_slave>, after which all local port 150to C<become_public> or C<become_slave>, after which all local port
126identifiers become invalid. 151identifiers become invalid.
127 152
128=item $noderef = node_of $portid 153=item $noderef = node_of $port
129 154
130Extracts and returns the noderef from a portid or a noderef. 155Extracts and returns the noderef from a portid or a noderef.
156
157=item initialise_node $noderef, $seednode, $seednode...
158
159=item initialise_node "slave/", $master, $master...
160
161Before a node can talk to other nodes on the network it has to initialise
162itself - the minimum a node needs to know is it's own name, and optionally
163it should know the noderefs of some other nodes in the network.
164
165This function initialises a node - it must be called exactly once (or
166never) before calling other AnyEvent::MP functions.
167
168All arguments (optionally except for the first) are noderefs, which can be
169either resolved or unresolved.
170
171The first argument will be looked up in the configuration database first
172(if it is C<undef> then the current nodename will be used instead) to find
173the relevant configuration profile (see L<aemp>). If none is found then
174the default configuration is used. The configuration supplies additional
175seed/master nodes and can override the actual noderef.
176
177There are two types of networked nodes, public nodes and slave nodes:
178
179=over 4
180
181=item public nodes
182
183For public nodes, C<$noderef> (supplied either directly to
184C<initialise_node> or indirectly via a profile or the nodename) must be a
185noderef (possibly unresolved, in which case it will be resolved).
186
187After resolving, the node will bind itself on all endpoints and try to
188connect to all additional C<$seednodes> that are specified. Seednodes are
189optional and can be used to quickly bootstrap the node into an existing
190network.
191
192=item slave nodes
193
194When the C<$noderef> (either as given or overriden by the config file)
195is the special string C<slave/>, then the node will become a slave
196node. Slave nodes cannot be contacted from outside and will route most of
197their traffic to the master node that they attach to.
198
199At least one additional noderef is required (either by specifying it
200directly or because it is part of the configuration profile): The node
201will try to connect to all of them and will become a slave attached to the
202first node it can successfully connect to.
203
204=back
205
206This function will block until all nodes have been resolved and, for slave
207nodes, until it has successfully established a connection to a master
208server.
209
210Example: become a public node listening on the guessed noderef, or the one
211specified via C<aemp> for the current node. This should be the most common
212form of invocation for "daemon"-type nodes.
213
214 initialise_node;
215
216Example: become a slave node to any of the the seednodes specified via
217C<aemp>. This form is often used for commandline clients.
218
219 initialise_node "slave/";
220
221Example: become a slave node to any of the specified master servers. This
222form is also often used for commandline clients.
223
224 initialise_node "slave/", "master1", "192.168.13.17", "mp.example.net";
225
226Example: become a public node, and try to contact some well-known master
227servers to become part of the network.
228
229 initialise_node undef, "master1", "master2";
230
231Example: become a public node listening on port C<4041>.
232
233 initialise_node 4041;
234
235Example: become a public node, only visible on localhost port 4044.
236
237 initialise_node "localhost:4044";
131 238
132=item $cv = resolve_node $noderef 239=item $cv = resolve_node $noderef
133 240
134Takes an unresolved node reference that may contain hostnames and 241Takes an unresolved node reference that may contain hostnames and
135abbreviated IDs, resolves all of them and returns a resolved node 242abbreviated IDs, resolves all of them and returns a resolved node
167 274
168Due to some quirks in how perl exports variables, it is impossible to 275Due to some quirks in how perl exports variables, it is impossible to
169just export C<$SELF>, all the symbols called C<SELF> are exported by this 276just export C<$SELF>, all the symbols called C<SELF> are exported by this
170module, but only C<$SELF> is currently used. 277module, but only C<$SELF> is currently used.
171 278
172=item snd $portid, type => @data 279=item snd $port, type => @data
173 280
174=item snd $portid, @msg 281=item snd $port, @msg
175 282
176Send the given message to the given port ID, which can identify either 283Send the given message to the given port ID, which can identify either
177a local or a remote port, and can be either a string or soemthignt hat 284a local or a remote port, and can be either a string or soemthignt hat
178stringifies a sa port ID (such as a port object :). 285stringifies a sa port ID (such as a port object :).
179 286
189JSON is used, then only strings, numbers and arrays and hashes consisting 296JSON is used, then only strings, numbers and arrays and hashes consisting
190of those are allowed (no objects). When Storable is used, then anything 297of those are allowed (no objects). When Storable is used, then anything
191that Storable can serialise and deserialise is allowed, and for the local 298that Storable can serialise and deserialise is allowed, and for the local
192node, anything can be passed. 299node, anything can be passed.
193 300
194=item kil $portid[, @reason] 301=item $local_port = port
195 302
196Kill the specified port with the given C<@reason>. 303Create a new local port object and returns its port ID. Initially it has
304no callbacks set and will throw an error when it receives messages.
197 305
198If no C<@reason> is specified, then the port is killed "normally" (linked 306=item $local_port = port { my @msg = @_ }
199ports will not be kileld, or even notified).
200 307
201Otherwise, linked ports get killed with the same reason (second form of 308Creates a new local port, and returns its ID. Semantically the same as
202C<mon>, see below). 309creating a port and calling C<rcv $port, $callback> on it.
203 310
204Runtime errors while evaluating C<rcv> callbacks or inside C<psub> blocks 311The block will be called for every message received on the port, with the
205will be reported as reason C<< die => $@ >>. 312global variable C<$SELF> set to the port ID. Runtime errors will cause the
313port to be C<kil>ed. The message will be passed as-is, no extra argument
314(i.e. no port ID) will be passed to the callback.
206 315
207Transport/communication errors are reported as C<< transport_error => 316If you want to stop/destroy the port, simply C<kil> it:
208$message >>.
209 317
318 my $port = port {
319 my @msg = @_;
320 ...
321 kil $SELF;
322 };
323
324=cut
325
326sub rcv($@);
327
328sub _kilme {
329 die "received message on port without callback";
330}
331
332sub port(;&) {
333 my $id = "$UNIQ." . $ID++;
334 my $port = "$NODE#$id";
335
336 rcv $port, shift || \&_kilme;
337
338 $port
339}
340
341=item rcv $local_port, $callback->(@msg)
342
343Replaces the default callback on the specified port. There is no way to
344remove the default callback: use C<sub { }> to disable it, or better
345C<kil> the port when it is no longer needed.
346
347The global C<$SELF> (exported by this module) contains C<$port> while
348executing the callback. Runtime errors during callback execution will
349result in the port being C<kil>ed.
350
351The default callback received all messages not matched by a more specific
352C<tag> match.
353
354=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
355
356Register callbacks to be called on messages starting with the given tag on
357the given port (and return the port), or unregister it (when C<$callback>
358is C<$undef>).
359
360The original message will be passed to the callback, after the first
361element (the tag) has been removed. The callback will use the same
362environment as the default callback (see above).
363
364Example: create a port and bind receivers on it in one go.
365
366 my $port = rcv port,
367 msg1 => sub { ... },
368 msg2 => sub { ... },
369 ;
370
371Example: create a port, bind receivers and send it in a message elsewhere
372in one go:
373
374 snd $otherport, reply =>
375 rcv port,
376 msg1 => sub { ... },
377 ...
378 ;
379
380=cut
381
382sub rcv($@) {
383 my $port = shift;
384 my ($noderef, $portid) = split /#/, $port, 2;
385
386 ($NODE{$noderef} || add_node $noderef) == $NODE{""}
387 or Carp::croak "$port: rcv can only be called on local ports, caught";
388
389 while (@_) {
390 if (ref $_[0]) {
391 if (my $self = $PORT_DATA{$portid}) {
392 "AnyEvent::MP::Port" eq ref $self
393 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
394
395 $self->[2] = shift;
396 } else {
397 my $cb = shift;
398 $PORT{$portid} = sub {
399 local $SELF = $port;
400 eval { &$cb }; _self_die if $@;
401 };
402 }
403 } elsif (defined $_[0]) {
404 my $self = $PORT_DATA{$portid} ||= do {
405 my $self = bless [$PORT{$port} || sub { }, { }, $port], "AnyEvent::MP::Port";
406
407 $PORT{$portid} = sub {
408 local $SELF = $port;
409
410 if (my $cb = $self->[1]{$_[0]}) {
411 shift;
412 eval { &$cb }; _self_die if $@;
413 } else {
414 &{ $self->[0] };
415 }
416 };
417
418 $self
419 };
420
421 "AnyEvent::MP::Port" eq ref $self
422 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
423
424 my ($tag, $cb) = splice @_, 0, 2;
425
426 if (defined $cb) {
427 $self->[1]{$tag} = $cb;
428 } else {
429 delete $self->[1]{$tag};
430 }
431 }
432 }
433
434 $port
435}
436
437=item $closure = psub { BLOCK }
438
439Remembers C<$SELF> and creates a closure out of the BLOCK. When the
440closure is executed, sets up the environment in the same way as in C<rcv>
441callbacks, i.e. runtime errors will cause the port to get C<kil>ed.
442
443This is useful when you register callbacks from C<rcv> callbacks:
444
445 rcv delayed_reply => sub {
446 my ($delay, @reply) = @_;
447 my $timer = AE::timer $delay, 0, psub {
448 snd @reply, $SELF;
449 };
450 };
451
452=cut
453
454sub psub(&) {
455 my $cb = shift;
456
457 my $port = $SELF
458 or Carp::croak "psub can only be called from within rcv or psub callbacks, not";
459
460 sub {
461 local $SELF = $port;
462
463 if (wantarray) {
464 my @res = eval { &$cb };
465 _self_die if $@;
466 @res
467 } else {
468 my $res = eval { &$cb };
469 _self_die if $@;
470 $res
471 }
472 }
473}
474
210=item $guard = mon $portid, $cb->(@reason) 475=item $guard = mon $port, $cb->(@reason)
211 476
212=item $guard = mon $portid, $otherport 477=item $guard = mon $port, $rcvport
213 478
479=item $guard = mon $port
480
214=item $guard = mon $portid, $otherport, @msg 481=item $guard = mon $port, $rcvport, @msg
215 482
216Monitor the given port and do something when the port is killed. 483Monitor the given port and do something when the port is killed or
484messages to it were lost, and optionally return a guard that can be used
485to stop monitoring again.
217 486
487C<mon> effectively guarantees that, in the absence of hardware failures,
488that after starting the monitor, either all messages sent to the port
489will arrive, or the monitoring action will be invoked after possible
490message loss has been detected. No messages will be lost "in between"
491(after the first lost message no further messages will be received by the
492port). After the monitoring action was invoked, further messages might get
493delivered again.
494
218In the first form, the callback is simply called with any number 495In the first form (callback), the callback is simply called with any
219of C<@reason> elements (no @reason means that the port was deleted 496number of C<@reason> elements (no @reason means that the port was deleted
220"normally"). Note also that I<< the callback B<must> never die >>, so use 497"normally"). Note also that I<< the callback B<must> never die >>, so use
221C<eval> if unsure. 498C<eval> if unsure.
222 499
223In the second form, the other port will be C<kil>'ed with C<@reason>, iff 500In the second form (another port given), the other port (C<$rcvport>)
224a @reason was specified, i.e. on "normal" kils nothing happens, while 501will be C<kil>'ed with C<@reason>, iff a @reason was specified, i.e. on
225under all other conditions, the other port is killed with the same reason. 502"normal" kils nothing happens, while under all other conditions, the other
503port is killed with the same reason.
226 504
505The third form (kill self) is the same as the second form, except that
506C<$rvport> defaults to C<$SELF>.
507
227In the last form, a message of the form C<@msg, @reason> will be C<snd>. 508In the last form (message), a message of the form C<@msg, @reason> will be
509C<snd>.
510
511As a rule of thumb, monitoring requests should always monitor a port from
512a local port (or callback). The reason is that kill messages might get
513lost, just like any other message. Another less obvious reason is that
514even monitoring requests can get lost (for exmaple, when the connection
515to the other node goes down permanently). When monitoring a port locally
516these problems do not exist.
228 517
229Example: call a given callback when C<$port> is killed. 518Example: call a given callback when C<$port> is killed.
230 519
231 mon $port, sub { warn "port died because of <@_>\n" }; 520 mon $port, sub { warn "port died because of <@_>\n" };
232 521
233Example: kill ourselves when C<$port> is killed abnormally. 522Example: kill ourselves when C<$port> is killed abnormally.
234 523
235 mon $port, $self; 524 mon $port;
236 525
237Example: send us a restart message another C<$port> is killed. 526Example: send us a restart message when another C<$port> is killed.
238 527
239 mon $port, $self => "restart"; 528 mon $port, $self => "restart";
240 529
241=cut 530=cut
242 531
243sub mon { 532sub mon {
244 my ($noderef, $port) = split /#/, shift, 2; 533 my ($noderef, $port) = split /#/, shift, 2;
245 534
246 my $node = $NODE{$noderef} || add_node $noderef; 535 my $node = $NODE{$noderef} || add_node $noderef;
247 536
248 my $cb = shift; 537 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,';
249 538
250 unless (ref $cb) { 539 unless (ref $cb) {
251 if (@_) { 540 if (@_) {
252 # send a kill info message 541 # send a kill info message
253 my (@msg) = ($cb, @_); 542 my (@msg) = ($cb, @_);
284=cut 573=cut
285 574
286sub mon_guard { 575sub mon_guard {
287 my ($port, @refs) = @_; 576 my ($port, @refs) = @_;
288 577
578 #TODO: mon-less form?
579
289 mon $port, sub { 0 && @refs } 580 mon $port, sub { 0 && @refs }
290} 581}
291 582
292=item lnk $port1, $port2 583=item kil $port[, @reason]
293 584
294Link two ports. This is simply a shorthand for: 585Kill the specified port with the given C<@reason>.
295 586
296 mon $port1, $port2; 587If no C<@reason> is specified, then the port is killed "normally" (linked
297 mon $port2, $port1; 588ports will not be kileld, or even notified).
298 589
299It means that if either one is killed abnormally, the other one gets 590Otherwise, linked ports get killed with the same reason (second form of
300killed as well. 591C<mon>, see below).
301 592
302=item $local_port = port 593Runtime errors while evaluating C<rcv> callbacks or inside C<psub> blocks
594will be reported as reason C<< die => $@ >>.
303 595
304Create a new local port object that can be used either as a pattern 596Transport/communication errors are reported as C<< transport_error =>
305matching port ("full port") or a single-callback port ("miniport"), 597$message >>.
306depending on how C<rcv> callbacks are bound to the object.
307 598
308=item $portid = port { my @msg = @_; $finished }
309
310Creates a "mini port", that is, a very lightweight port without any
311pattern matching behind it, and returns its ID.
312
313The block will be called for every message received on the port. When the
314callback returns a true value its job is considered "done" and the port
315will be destroyed. Otherwise it will stay alive.
316
317The message will be passed as-is, no extra argument (i.e. no port id) will
318be passed to the callback.
319
320If you need the local port id in the callback, this works nicely:
321
322 my $port; $port = port {
323 snd $otherport, reply => $port;
324 };
325
326=cut 599=cut
327 600
328sub port(;&) { 601=item $port = spawn $node, $initfunc[, @initdata]
329 my $id = "$UNIQ." . $ID++;
330 my $port = "$NODE#$id";
331 602
332 if (@_) { 603Creates a port on the node C<$node> (which can also be a port ID, in which
333 my $cb = shift; 604case it's the node where that port resides).
334 $PORT{$id} = sub { 605
335 local $SELF = $port; 606The port ID of the newly created port is return immediately, and it is
336 eval { 607permissible to immediately start sending messages or monitor the port.
337 &$cb 608
338 and kil $id; 609After the port has been created, the init function is
610called. This function must be a fully-qualified function name
611(e.g. C<MyApp::Chat::Server::init>). To specify a function in the main
612program, use C<::name>.
613
614If the function doesn't exist, then the node tries to C<require>
615the package, then the package above the package and so on (e.g.
616C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function
617exists or it runs out of package names.
618
619The init function is then called with the newly-created port as context
620object (C<$SELF>) and the C<@initdata> values as arguments.
621
622A common idiom is to pass your own port, monitor the spawned port, and
623in the init function, monitor the original port. This two-way monitoring
624ensures that both ports get cleaned up when there is a problem.
625
626Example: spawn a chat server port on C<$othernode>.
627
628 # this node, executed from within a port context:
629 my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF;
630 mon $server;
631
632 # init function on C<$othernode>
633 sub connect {
634 my ($srcport) = @_;
635
636 mon $srcport;
637
638 rcv $SELF, sub {
339 }; 639 ...
340 _self_die if $@;
341 };
342 } else {
343 my $self = bless {
344 id => "$NODE#$id",
345 }, "AnyEvent::MP::Port";
346
347 $PORT_DATA{$id} = $self;
348 $PORT{$id} = sub {
349 local $SELF = $port;
350
351 eval {
352 for (@{ $self->{rc0}{$_[0]} }) {
353 $_ && &{$_->[0]}
354 && undef $_;
355 }
356
357 for (@{ $self->{rcv}{$_[0]} }) {
358 $_ && [@_[1 .. @{$_->[1]}]] ~~ $_->[1]
359 && &{$_->[0]}
360 && undef $_;
361 }
362
363 for (@{ $self->{any} }) {
364 $_ && [@_[0 .. $#{$_->[1]}]] ~~ $_->[1]
365 && &{$_->[0]}
366 && undef $_;
367 }
368 };
369 _self_die if $@;
370 }; 640 };
371 } 641 }
372 642
373 $port 643=cut
644
645sub _spawn {
646 my $port = shift;
647 my $init = shift;
648
649 local $SELF = "$NODE#$port";
650 eval {
651 &{ load_func $init }
652 };
653 _self_die if $@;
374} 654}
375 655
376=item reg $portid, $name 656sub spawn(@) {
657 my ($noderef, undef) = split /#/, shift, 2;
377 658
378Registers the given port under the name C<$name>. If the name already 659 my $id = "$RUNIQ." . $ID++;
379exists it is replaced.
380 660
381A port can only be registered under one well known name. 661 $_[0] =~ /::/
662 or Carp::croak "spawn init function must be a fully-qualified name, caught";
382 663
383A port automatically becomes unregistered when it is killed. 664 ($NODE{$noderef} || add_node $noderef)
665 ->send (["", "AnyEvent::MP::_spawn" => $id, @_]);
384 666
385=cut 667 "$noderef#$id"
386
387sub reg(@) {
388 my ($portid, $name) = @_;
389
390 $REG{$name} = $portid;
391} 668}
392
393=item rcv $portid, $callback->(@msg)
394
395Replaces the callback on the specified miniport (or newly created port
396object, see C<port>). Full ports are configured with the following calls:
397
398=item rcv $portid, tagstring => $callback->(@msg), ...
399
400=item rcv $portid, $smartmatch => $callback->(@msg), ...
401
402=item rcv $portid, [$smartmatch...] => $callback->(@msg), ...
403
404Register callbacks to be called on matching messages on the given port.
405
406The callback has to return a true value when its work is done, after
407which is will be removed, or a false value in which case it will stay
408registered.
409
410The global C<$SELF> (exported by this module) contains C<$portid> while
411executing the callback.
412
413Runtime errors wdurign callback execution will result in the port being
414C<kil>ed.
415
416If the match is an array reference, then it will be matched against the
417first elements of the message, otherwise only the first element is being
418matched.
419
420Any element in the match that is specified as C<_any_> (a function
421exported by this module) matches any single element of the message.
422
423While not required, it is highly recommended that the first matching
424element is a string identifying the message. The one-string-only match is
425also the most efficient match (by far).
426
427=cut
428
429sub rcv($@) {
430 my $portid = shift;
431 my ($noderef, $port) = split /#/, $port, 2;
432
433 ($NODE{$noderef} || add_node $noderef) == $NODE{""}
434 or Carp::croak "$noderef#$port: rcv can only be called on local ports, caught";
435
436 my $self = $PORT_DATA{$port}
437 or Carp::croak "$noderef#$port: rcv can only be called on message matching ports, caught";
438
439 "AnyEvent::MP::Port" eq ref $self
440 or Carp::croak "$noderef#$port: rcv can only be called on message matching ports, caught";
441
442 while (@_) {
443 my ($match, $cb) = splice @_, 0, 2;
444
445 if (!ref $match) {
446 push @{ $self->{rc0}{$match} }, [$cb];
447 } elsif (("ARRAY" eq ref $match && !ref $match->[0])) {
448 my ($type, @match) = @$match;
449 @match
450 ? push @{ $self->{rcv}{$match->[0]} }, [$cb, \@match]
451 : push @{ $self->{rc0}{$match->[0]} }, [$cb];
452 } else {
453 push @{ $self->{any} }, [$cb, $match];
454 }
455 }
456
457 $portid
458}
459
460=item $closure = psub { BLOCK }
461
462Remembers C<$SELF> and creates a closure out of the BLOCK. When the
463closure is executed, sets up the environment in the same way as in C<rcv>
464callbacks, i.e. runtime errors will cause the port to get C<kil>ed.
465
466This is useful when you register callbacks from C<rcv> callbacks:
467
468 rcv delayed_reply => sub {
469 my ($delay, @reply) = @_;
470 my $timer = AE::timer $delay, 0, psub {
471 snd @reply, $SELF;
472 };
473 };
474
475=cut
476
477sub psub(&) {
478 my $cb = shift;
479
480 my $port = $SELF
481 or Carp::croak "psub can only be called from within rcv or psub callbacks, not";
482
483 sub {
484 local $SELF = $port;
485
486 if (wantarray) {
487 my @res = eval { &$cb };
488 _self_die if $@;
489 @res
490 } else {
491 my $res = eval { &$cb };
492 _self_die if $@;
493 $res
494 }
495 }
496}
497
498=back
499
500=head1 FUNCTIONS FOR NODES
501
502=over 4
503
504=item become_public $noderef
505
506Tells the node to become a public node, i.e. reachable from other nodes.
507
508The first argument is the (unresolved) node reference of the local node
509(if missing then the empty string is used).
510
511It is quite common to not specify anything, in which case the local node
512tries to listen on the default port, or to only specify a port number, in
513which case AnyEvent::MP tries to guess the local addresses.
514
515=cut
516 669
517=back 670=back
518 671
519=head1 NODE MESSAGES 672=head1 NODE MESSAGES
520 673
562 715
563=back 716=back
564 717
565=head1 AnyEvent::MP vs. Distributed Erlang 718=head1 AnyEvent::MP vs. Distributed Erlang
566 719
567AnyEvent::MP got lots of its ideas from distributed erlang (erlang node 720AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node
568== aemp node, erlang process == aemp port), so many of the documents and 721== aemp node, Erlang process == aemp port), so many of the documents and
569programming techniques employed by erlang apply to AnyEvent::MP. Here is a 722programming techniques employed by Erlang apply to AnyEvent::MP. Here is a
570sample: 723sample:
571 724
572 http://www.erlang.se/doc/programming_rules.shtml 725 http://www.Erlang.se/doc/programming_rules.shtml
573 http://erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4 726 http://Erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4
574 http://erlang.org/download/erlang-book-part1.pdf # chapters 5 and 6 727 http://Erlang.org/download/Erlang-book-part1.pdf # chapters 5 and 6
575 http://erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5 728 http://Erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5
576 729
577Despite the similarities, there are also some important differences: 730Despite the similarities, there are also some important differences:
578 731
579=over 4 732=over 4
580 733
585convenience functionality. 738convenience functionality.
586 739
587This means that AEMP requires a less tightly controlled environment at the 740This means that AEMP requires a less tightly controlled environment at the
588cost of longer node references and a slightly higher management overhead. 741cost of longer node references and a slightly higher management overhead.
589 742
743=item Erlang has a "remote ports are like local ports" philosophy, AEMP
744uses "local ports are like remote ports".
745
746The failure modes for local ports are quite different (runtime errors
747only) then for remote ports - when a local port dies, you I<know> it dies,
748when a connection to another node dies, you know nothing about the other
749port.
750
751Erlang pretends remote ports are as reliable as local ports, even when
752they are not.
753
754AEMP encourages a "treat remote ports differently" philosophy, with local
755ports being the special case/exception, where transport errors cannot
756occur.
757
590=item * Erlang uses processes and a mailbox, AEMP does not queue. 758=item * Erlang uses processes and a mailbox, AEMP does not queue.
591 759
592Erlang uses processes that selctively receive messages, and therefore 760Erlang uses processes that selectively receive messages, and therefore
593needs a queue. AEMP is event based, queuing messages would serve no useful 761needs a queue. AEMP is event based, queuing messages would serve no
594purpose. 762useful purpose. For the same reason the pattern-matching abilities of
763AnyEvent::MP are more limited, as there is little need to be able to
764filter messages without dequeing them.
595 765
596(But see L<Coro::MP> for a more erlang-like process model on top of AEMP). 766(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP).
597 767
598=item * Erlang sends are synchronous, AEMP sends are asynchronous. 768=item * Erlang sends are synchronous, AEMP sends are asynchronous.
599 769
600Sending messages in erlang is synchronous and blocks the process. AEMP 770Sending messages in Erlang is synchronous and blocks the process (and
601sends are immediate, connection establishment is handled in the 771so does not need a queue that can overflow). AEMP sends are immediate,
602background. 772connection establishment is handled in the background.
603 773
604=item * Erlang can silently lose messages, AEMP cannot. 774=item * Erlang suffers from silent message loss, AEMP does not.
605 775
606Erlang makes few guarantees on messages delivery - messages can get lost 776Erlang makes few guarantees on messages delivery - messages can get lost
607without any of the processes realising it (i.e. you send messages a, b, 777without any of the processes realising it (i.e. you send messages a, b,
608and c, and the other side only receives messages a and c). 778and c, and the other side only receives messages a and c).
609 779
610AEMP guarantees correct ordering, and the guarantee that there are no 780AEMP guarantees correct ordering, and the guarantee that there are no
611holes in the message sequence. 781holes in the message sequence.
612 782
613=item * In erlang, processes can be declared dead and later be found to be 783=item * In Erlang, processes can be declared dead and later be found to be
614alive. 784alive.
615 785
616In erlang it can happen that a monitored process is declared dead and 786In Erlang it can happen that a monitored process is declared dead and
617linked processes get killed, but later it turns out that the process is 787linked processes get killed, but later it turns out that the process is
618still alive - and can receive messages. 788still alive - and can receive messages.
619 789
620In AEMP, when port monitoring detects a port as dead, then that port will 790In AEMP, when port monitoring detects a port as dead, then that port will
621eventually be killed - it cannot happen that a node detects a port as dead 791eventually be killed - it cannot happen that a node detects a port as dead
622and then later sends messages to it, finding it is still alive. 792and then later sends messages to it, finding it is still alive.
623 793
624=item * Erlang can send messages to the wrong port, AEMP does not. 794=item * Erlang can send messages to the wrong port, AEMP does not.
625 795
626In erlang it is quite possible that a node that restarts reuses a process 796In Erlang it is quite likely that a node that restarts reuses a process ID
627ID known to other nodes for a completely different process, causing 797known to other nodes for a completely different process, causing messages
628messages destined for that process to end up in an unrelated process. 798destined for that process to end up in an unrelated process.
629 799
630AEMP never reuses port IDs, so old messages or old port IDs floating 800AEMP never reuses port IDs, so old messages or old port IDs floating
631around in the network will not be sent to an unrelated port. 801around in the network will not be sent to an unrelated port.
632 802
633=item * Erlang uses unprotected connections, AEMP uses secure 803=item * Erlang uses unprotected connections, AEMP uses secure
637securely authenticate nodes. 807securely authenticate nodes.
638 808
639=item * The AEMP protocol is optimised for both text-based and binary 809=item * The AEMP protocol is optimised for both text-based and binary
640communications. 810communications.
641 811
642The AEMP protocol, unlike the erlang protocol, supports both 812The AEMP protocol, unlike the Erlang protocol, supports both
643language-independent text-only protocols (good for debugging) and binary, 813language-independent text-only protocols (good for debugging) and binary,
644language-specific serialisers (e.g. Storable). 814language-specific serialisers (e.g. Storable).
645 815
646It has also been carefully designed to be implementable in other languages 816It has also been carefully designed to be implementable in other languages
647with a minimum of work while gracefully degrading fucntionality to make the 817with a minimum of work while gracefully degrading fucntionality to make the
648protocol simple. 818protocol simple.
649 819
820=item * AEMP has more flexible monitoring options than Erlang.
821
822In Erlang, you can chose to receive I<all> exit signals as messages
823or I<none>, there is no in-between, so monitoring single processes is
824difficult to implement. Monitoring in AEMP is more flexible than in
825Erlang, as one can choose between automatic kill, exit message or callback
826on a per-process basis.
827
828=item * Erlang tries to hide remote/local connections, AEMP does not.
829
830Monitoring in Erlang is not an indicator of process death/crashes,
831as linking is (except linking is unreliable in Erlang).
832
833In AEMP, you don't "look up" registered port names or send to named ports
834that might or might not be persistent. Instead, you normally spawn a port
835on the remote node. The init function monitors the you, and you monitor
836the remote port. Since both monitors are local to the node, they are much
837more reliable.
838
839This also saves round-trips and avoids sending messages to the wrong port
840(hard to do in Erlang).
841
842=back
843
844=head1 RATIONALE
845
846=over 4
847
848=item Why strings for ports and noderefs, why not objects?
849
850We considered "objects", but found that the actual number of methods
851thatc an be called are very low. Since port IDs and noderefs travel over
852the network frequently, the serialising/deserialising would add lots of
853overhead, as well as having to keep a proxy object.
854
855Strings can easily be printed, easily serialised etc. and need no special
856procedures to be "valid".
857
858And a a miniport consists of a single closure stored in a global hash - it
859can't become much cheaper.
860
861=item Why favour JSON, why not real serialising format such as Storable?
862
863In fact, any AnyEvent::MP node will happily accept Storable as framing
864format, but currently there is no way to make a node use Storable by
865default.
866
867The default framing protocol is JSON because a) JSON::XS is many times
868faster for small messages and b) most importantly, after years of
869experience we found that object serialisation is causing more problems
870than it gains: Just like function calls, objects simply do not travel
871easily over the network, mostly because they will always be a copy, so you
872always have to re-think your design.
873
874Keeping your messages simple, concentrating on data structures rather than
875objects, will keep your messages clean, tidy and efficient.
876
650=back 877=back
651 878
652=head1 SEE ALSO 879=head1 SEE ALSO
653 880
654L<AnyEvent>. 881L<AnyEvent>.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines