ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.10 by root, Sun Aug 2 18:05:43 2009 UTC vs.
Revision 1.51 by root, Fri Aug 14 14:07:44 2009 UTC

4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 use AnyEvent::MP; 7 use AnyEvent::MP;
8 8
9 NODE # returns this node identifier
10 $NODE # contains this node identifier 9 $NODE # contains this node's noderef
10 NODE # returns this node's noderef
11 NODE $port # returns the noderef of the port
11 12
13 $SELF # receiving/own port id in rcv callbacks
14
15 # initialise the node so it can send/receive messages
16 initialise_node; # -OR-
17 initialise_node "localhost:4040"; # -OR-
18 initialise_node "slave/", "localhost:4040"
19
20 # ports are message endpoints
21
22 # sending messages
12 snd $port, type => data...; 23 snd $port, type => data...;
24 snd $port, @msg;
25 snd @msg_with_first_element_being_a_port;
13 26
14 rcv $port, smartmatch => $cb->($port, @msg); 27 # creating/using ports, the simple way
28 my $somple_port = port { my @msg = @_; 0 };
15 29
16 # examples: 30 # creating/using ports, type matching
31 my $port = port;
17 rcv $port2, ping => sub { snd $_[0], "pong"; 0 }; 32 rcv $port, ping => sub { snd $_[0], "pong"; 0 };
18 rcv $port1, pong => sub { warn "pong received\n" }; 33 rcv $port, pong => sub { warn "pong received\n"; 0 };
19 snd $port2, ping => $port1;
20 34
21 # more, smarter, matches (_any_ is exported by this module) 35 # create a port on another node
22 rcv $port, [child_died => $pid] => sub { ... 36 my $port = spawn $node, $initfunc, @initdata;
23 rcv $port, [_any_, _any_, 3] => sub { .. $_[2] is 3 37
38 # monitoring
39 mon $port, $cb->(@msg) # callback is invoked on death
40 mon $port, $otherport # kill otherport on abnormal death
41 mon $port, $otherport, @msg # send message on death
42
43=head1 CURRENT STATUS
44
45 AnyEvent::MP - stable API, should work
46 AnyEvent::MP::Intro - outdated
47 AnyEvent::MP::Kernel - WIP
48 AnyEvent::MP::Transport - mostly stable
49
50 stay tuned.
24 51
25=head1 DESCRIPTION 52=head1 DESCRIPTION
26 53
27This module (-family) implements a simple message passing framework. 54This module (-family) implements a simple message passing framework.
28 55
29Despite its simplicity, you can securely message other processes running 56Despite its simplicity, you can securely message other processes running
30on the same or other hosts. 57on the same or other hosts.
31 58
59For an introduction to this module family, see the L<AnyEvent::MP::Intro>
60manual page.
61
32At the moment, this module family is severly brokena nd underdocumented, 62At the moment, this module family is severly broken and underdocumented,
33so do not use. This was uploaded mainly to resreve the CPAN namespace - 63so do not use. This was uploaded mainly to reserve the CPAN namespace -
34stay tuned! 64stay tuned!
35 65
36=head1 CONCEPTS 66=head1 CONCEPTS
37 67
38=over 4 68=over 4
39 69
40=item port 70=item port
41 71
42A port is something you can send messages to with the C<snd> function, and 72A port is something you can send messages to (with the C<snd> function).
43you can register C<rcv> handlers with. All C<rcv> handlers will receive 73
44messages they match, messages will not be queued. 74Some ports allow you to register C<rcv> handlers that can match specific
75messages. All C<rcv> handlers will receive messages they match, messages
76will not be queued.
45 77
46=item port id - C<noderef#portname> 78=item port id - C<noderef#portname>
47 79
48A port id is always the noderef, a hash-mark (C<#>) as separator, followed 80A port id is normaly the concatenation of a noderef, a hash-mark (C<#>) as
49by a port name (a printable string of unspecified format). 81separator, and a port name (a printable string of unspecified format). An
82exception is the the node port, whose ID is identical to its node
83reference.
50 84
51=item node 85=item node
52 86
53A node is a single process containing at least one port - the node 87A node is a single process containing at least one port - the node
54port. You can send messages to node ports to let them create new ports, 88port. You can send messages to node ports to find existing ports or to
55among other things. 89create new ports, among other things.
56 90
57Initially, nodes are either private (single-process only) or hidden 91Nodes are either private (single-process only), slaves (connected to a
58(connected to a master node only). Only when they epxlicitly "become 92master node only) or public nodes (connectable from unrelated nodes).
59public" can you send them messages from unrelated other nodes.
60 93
61=item noderef - C<host:port,host:port...>, C<id@noderef>, C<id> 94=item noderef - C<host:port,host:port...>, C<id@noderef>, C<id>
62 95
63A noderef is a string that either uniquely identifies a given node (for 96A node reference is a string that either simply identifies the node (for
64private and hidden nodes), or contains a recipe on how to reach a given 97private and slave nodes), or contains a recipe on how to reach a given
65node (for public nodes). 98node (for public nodes).
66 99
100This recipe is simply a comma-separated list of C<address:port> pairs (for
101TCP/IP, other protocols might look different).
102
103Node references come in two flavours: resolved (containing only numerical
104addresses) or unresolved (where hostnames are used instead of addresses).
105
106Before using an unresolved node reference in a message you first have to
107resolve it.
108
67=back 109=back
68 110
69=head1 VARIABLES/FUNCTIONS 111=head1 VARIABLES/FUNCTIONS
70 112
71=over 4 113=over 4
72 114
73=cut 115=cut
74 116
75package AnyEvent::MP; 117package AnyEvent::MP;
76 118
77use AnyEvent::MP::Base; 119use AnyEvent::MP::Kernel;
78 120
79use common::sense; 121use common::sense;
80 122
81use Carp (); 123use Carp ();
82 124
83use AE (); 125use AE ();
84 126
85use base "Exporter"; 127use base "Exporter";
86 128
87our $VERSION = '0.02'; 129our $VERSION = $AnyEvent::MP::Kernel::VERSION;
130
88our @EXPORT = qw( 131our @EXPORT = qw(
89 NODE $NODE $PORT snd rcv _any_ 132 NODE $NODE *SELF node_of _any_
90 create_port create_port_on 133 resolve_node initialise_node
91 become_slave become_public 134 snd rcv mon kil reg psub spawn
135 port
92); 136);
93 137
138our $SELF;
139
140sub _self_die() {
141 my $msg = $@;
142 $msg =~ s/\n+$// unless ref $msg;
143 kil $SELF, die => $msg;
144}
145
94=item NODE / $NODE 146=item $thisnode = NODE / $NODE
95 147
96The C<NODE ()> function and the C<$NODE> variable contain the noderef of 148The C<NODE> function returns, and the C<$NODE> variable contains
97the local node. The value is initialised by a call to C<become_public> or 149the noderef of the local node. The value is initialised by a call
98C<become_slave>, after which all local port identifiers become invalid. 150to C<become_public> or C<become_slave>, after which all local port
151identifiers become invalid.
99 152
153=item $noderef = node_of $port
154
155Extracts and returns the noderef from a portid or a noderef.
156
157=item initialise_node $noderef, $seednode, $seednode...
158
159=item initialise_node "slave/", $master, $master...
160
161Before a node can talk to other nodes on the network it has to initialise
162itself - the minimum a node needs to know is it's own name, and optionally
163it should know the noderefs of some other nodes in the network.
164
165This function initialises a node - it must be called exactly once (or
166never) before calling other AnyEvent::MP functions.
167
168All arguments (optionally except for the first) are noderefs, which can be
169either resolved or unresolved.
170
171The first argument will be looked up in the configuration database first
172(if it is C<undef> then the current nodename will be used instead) to find
173the relevant configuration profile (see L<aemp>). If none is found then
174the default configuration is used. The configuration supplies additional
175seed/master nodes and can override the actual noderef.
176
177There are two types of networked nodes, public nodes and slave nodes:
178
179=over 4
180
181=item public nodes
182
183For public nodes, C<$noderef> (supplied either directly to
184C<initialise_node> or indirectly via a profile or the nodename) must be a
185noderef (possibly unresolved, in which case it will be resolved).
186
187After resolving, the node will bind itself on all endpoints and try to
188connect to all additional C<$seednodes> that are specified. Seednodes are
189optional and can be used to quickly bootstrap the node into an existing
190network.
191
192=item slave nodes
193
194When the C<$noderef> (either as given or overriden by the config file)
195is the special string C<slave/>, then the node will become a slave
196node. Slave nodes cannot be contacted from outside and will route most of
197their traffic to the master node that they attach to.
198
199At least one additional noderef is required (either by specifying it
200directly or because it is part of the configuration profile): The node
201will try to connect to all of them and will become a slave attached to the
202first node it can successfully connect to.
203
204=back
205
206This function will block until all nodes have been resolved and, for slave
207nodes, until it has successfully established a connection to a master
208server.
209
210Example: become a public node listening on the guessed noderef, or the one
211specified via C<aemp> for the current node. This should be the most common
212form of invocation for "daemon"-type nodes.
213
214 initialise_node;
215
216Example: become a slave node to any of the the seednodes specified via
217C<aemp>. This form is often used for commandline clients.
218
219 initialise_node "slave/";
220
221Example: become a slave node to any of the specified master servers. This
222form is also often used for commandline clients.
223
224 initialise_node "slave/", "master1", "192.168.13.17", "mp.example.net";
225
226Example: become a public node, and try to contact some well-known master
227servers to become part of the network.
228
229 initialise_node undef, "master1", "master2";
230
231Example: become a public node listening on port C<4041>.
232
233 initialise_node 4041;
234
235Example: become a public node, only visible on localhost port 4044.
236
237 initialise_node "localhost:4044";
238
239=item $cv = resolve_node $noderef
240
241Takes an unresolved node reference that may contain hostnames and
242abbreviated IDs, resolves all of them and returns a resolved node
243reference.
244
245In addition to C<address:port> pairs allowed in resolved noderefs, the
246following forms are supported:
247
248=over 4
249
250=item the empty string
251
252An empty-string component gets resolved as if the default port (4040) was
253specified.
254
255=item naked port numbers (e.g. C<1234>)
256
257These are resolved by prepending the local nodename and a colon, to be
258further resolved.
259
260=item hostnames (e.g. C<localhost:1234>, C<localhost>)
261
262These are resolved by using AnyEvent::DNS to resolve them, optionally
263looking up SRV records for the C<aemp=4040> port, if no port was
264specified.
265
266=back
267
268=item $SELF
269
270Contains the current port id while executing C<rcv> callbacks or C<psub>
271blocks.
272
273=item SELF, %SELF, @SELF...
274
275Due to some quirks in how perl exports variables, it is impossible to
276just export C<$SELF>, all the symbols called C<SELF> are exported by this
277module, but only C<$SELF> is currently used.
278
100=item snd $portid, type => @data 279=item snd $port, type => @data
101 280
102=item snd $portid, @msg 281=item snd $port, @msg
103 282
104Send the given message to the given port ID, which can identify either 283Send the given message to the given port ID, which can identify either
105a local or a remote port, and can be either a string or soemthignt hat 284a local or a remote port, and can be either a string or soemthignt hat
106stringifies a sa port ID (such as a port object :). 285stringifies a sa port ID (such as a port object :).
107 286
117JSON is used, then only strings, numbers and arrays and hashes consisting 296JSON is used, then only strings, numbers and arrays and hashes consisting
118of those are allowed (no objects). When Storable is used, then anything 297of those are allowed (no objects). When Storable is used, then anything
119that Storable can serialise and deserialise is allowed, and for the local 298that Storable can serialise and deserialise is allowed, and for the local
120node, anything can be passed. 299node, anything can be passed.
121 300
122=item $local_port = create_port 301=item $local_port = port
123 302
124Create a new local port object. See the next section for allowed methods. 303Create a new local port object and returns its port ID. Initially it has
304no callbacks set and will throw an error when it receives messages.
125 305
126=cut 306=item $local_port = port { my @msg = @_ }
127 307
128sub create_port { 308Creates a new local port, and returns its ID. Semantically the same as
129 my $id = "$AnyEvent::MP::Base::UNIQ." . ++$AnyEvent::MP::Base::ID; 309creating a port and calling C<rcv $port, $callback> on it.
130 310
131 my $self = bless { 311The block will be called for every message received on the port, with the
132 id => "$NODE#$id", 312global variable C<$SELF> set to the port ID. Runtime errors will cause the
133 names => [$id], 313port to be C<kil>ed. The message will be passed as-is, no extra argument
134 }, "AnyEvent::MP::Port"; 314(i.e. no port ID) will be passed to the callback.
135 315
136 $AnyEvent::MP::Base::PORT{$id} = sub { 316If you want to stop/destroy the port, simply C<kil> it:
137 unshift @_, $self;
138 317
139 for (@{ $self->{rc0}{$_[1]} }) { 318 my $port = port {
140 $_ && &{$_->[0]} 319 my @msg = @_;
141 && undef $_; 320 ...
321 kil $SELF;
322 };
323
324=cut
325
326sub rcv($@);
327
328sub _kilme {
329 die "received message on port without callback";
330}
331
332sub port(;&) {
333 my $id = "$UNIQ." . $ID++;
334 my $port = "$NODE#$id";
335
336 rcv $port, shift || \&_kilme;
337
338 $port
339}
340
341=item rcv $local_port, $callback->(@msg)
342
343Replaces the default callback on the specified port. There is no way to
344remove the default callback: use C<sub { }> to disable it, or better
345C<kil> the port when it is no longer needed.
346
347The global C<$SELF> (exported by this module) contains C<$port> while
348executing the callback. Runtime errors during callback execution will
349result in the port being C<kil>ed.
350
351The default callback received all messages not matched by a more specific
352C<tag> match.
353
354=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
355
356Register callbacks to be called on messages starting with the given tag on
357the given port (and return the port), or unregister it (when C<$callback>
358is C<$undef>).
359
360The original message will be passed to the callback, after the first
361element (the tag) has been removed. The callback will use the same
362environment as the default callback (see above).
363
364Example: create a port and bind receivers on it in one go.
365
366 my $port = rcv port,
367 msg1 => sub { ... },
368 msg2 => sub { ... },
369 ;
370
371Example: create a port, bind receivers and send it in a message elsewhere
372in one go:
373
374 snd $otherport, reply =>
375 rcv port,
376 msg1 => sub { ... },
377 ...
378 ;
379
380=cut
381
382sub rcv($@) {
383 my $port = shift;
384 my ($noderef, $portid) = split /#/, $port, 2;
385
386 ($NODE{$noderef} || add_node $noderef) == $NODE{""}
387 or Carp::croak "$port: rcv can only be called on local ports, caught";
388
389 while (@_) {
390 if (ref $_[0]) {
391 if (my $self = $PORT_DATA{$portid}) {
392 "AnyEvent::MP::Port" eq ref $self
393 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
394
395 $self->[2] = shift;
396 } else {
397 my $cb = shift;
398 $PORT{$portid} = sub {
399 local $SELF = $port;
400 eval { &$cb }; _self_die if $@;
401 };
402 }
403 } elsif (defined $_[0]) {
404 my $self = $PORT_DATA{$portid} ||= do {
405 my $self = bless [$PORT{$port} || sub { }, { }, $port], "AnyEvent::MP::Port";
406
407 $PORT{$portid} = sub {
408 local $SELF = $port;
409
410 if (my $cb = $self->[1]{$_[0]}) {
411 shift;
412 eval { &$cb }; _self_die if $@;
413 } else {
414 &{ $self->[0] };
415 }
416 };
417
418 $self
419 };
420
421 "AnyEvent::MP::Port" eq ref $self
422 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
423
424 my ($tag, $cb) = splice @_, 0, 2;
425
426 if (defined $cb) {
427 $self->[1]{$tag} = $cb;
428 } else {
429 delete $self->[1]{$tag};
430 }
142 } 431 }
432 }
143 433
144 for (@{ $self->{rcv}{$_[1]} }) { 434 $port
145 $_ && [@_[1 .. @{$_->[1]}]] ~~ $_->[1] 435}
146 && &{$_->[0]} 436
147 && undef $_; 437=item $closure = psub { BLOCK }
438
439Remembers C<$SELF> and creates a closure out of the BLOCK. When the
440closure is executed, sets up the environment in the same way as in C<rcv>
441callbacks, i.e. runtime errors will cause the port to get C<kil>ed.
442
443This is useful when you register callbacks from C<rcv> callbacks:
444
445 rcv delayed_reply => sub {
446 my ($delay, @reply) = @_;
447 my $timer = AE::timer $delay, 0, psub {
448 snd @reply, $SELF;
449 };
450 };
451
452=cut
453
454sub psub(&) {
455 my $cb = shift;
456
457 my $port = $SELF
458 or Carp::croak "psub can only be called from within rcv or psub callbacks, not";
459
460 sub {
461 local $SELF = $port;
462
463 if (wantarray) {
464 my @res = eval { &$cb };
465 _self_die if $@;
466 @res
467 } else {
468 my $res = eval { &$cb };
469 _self_die if $@;
470 $res
148 } 471 }
149
150 for (@{ $self->{any} }) {
151 $_ && [@_[0 .. $#{$_->[1]}]] ~~ $_->[1]
152 && &{$_->[0]}
153 && undef $_;
154 }
155 };
156
157 $self
158}
159
160=item $portid = create_miniport { }
161
162Creates a "mini port", that is, a port without much #TODO
163
164=cut
165
166sub create_miniport(&) {
167 my $cb = shift;
168 my $id = "$AnyEvent::MP::Base::UNIQ." . ++$AnyEvent::MP::Base::ID;
169
170 $AnyEvent::MP::Base::PORT{$id} = sub {
171 &$cb
172 and delete $AnyEvent::MP::Base::PORT{$id};
173 };
174
175 "$NODE#$id"
176}
177
178package AnyEvent::MP::Port;
179
180=back
181
182=head1 METHODS FOR PORT OBJECTS
183
184=over 4
185
186=item "$port"
187
188A port object stringifies to its port ID, so can be used directly for
189C<snd> operations.
190
191=cut
192
193use overload
194 '""' => sub { $_[0]{id} },
195 fallback => 1;
196
197=item $port->rcv (type => $callback->($port, @msg))
198
199=item $port->rcv ($smartmatch => $callback->($port, @msg))
200
201=item $port->rcv ([$smartmatch...] => $callback->($port, @msg))
202
203Register a callback on the given port.
204
205The callback has to return a true value when its work is done, after
206which is will be removed, or a false value in which case it will stay
207registered.
208
209If the match is an array reference, then it will be matched against the
210first elements of the message, otherwise only the first element is being
211matched.
212
213Any element in the match that is specified as C<_any_> (a function
214exported by this module) matches any single element of the message.
215
216While not required, it is highly recommended that the first matching
217element is a string identifying the message. The one-string-only match is
218also the most efficient match (by far).
219
220=cut
221
222sub rcv($@) {
223 my ($self, $match, $cb) = @_;
224
225 if (!ref $match) {
226 push @{ $self->{rc0}{$match} }, [$cb];
227 } elsif (("ARRAY" eq ref $match && !ref $match->[0])) {
228 my ($type, @match) = @$match;
229 @match
230 ? push @{ $self->{rcv}{$match->[0]} }, [$cb, \@match]
231 : push @{ $self->{rc0}{$match->[0]} }, [$cb];
232 } else {
233 push @{ $self->{any} }, [$cb, $match];
234 } 472 }
235} 473}
236 474
237=item $port->register ($name) 475=item $guard = mon $port, $cb->(@reason)
238 476
239Registers the given port under the well known name C<$name>. If the name 477=item $guard = mon $port, $rcvport
240already exists it is replaced.
241 478
242A port can only be registered under one well known name. 479=item $guard = mon $port
243 480
244=cut 481=item $guard = mon $port, $rcvport, @msg
245 482
246sub register { 483Monitor the given port and do something when the port is killed or
247 my ($self, $name) = @_; 484messages to it were lost, and optionally return a guard that can be used
485to stop monitoring again.
248 486
249 $self->{wkname} = $name; 487C<mon> effectively guarantees that, in the absence of hardware failures,
250 $AnyEvent::MP::Base::WKP{$name} = "$self"; 488that after starting the monitor, either all messages sent to the port
489will arrive, or the monitoring action will be invoked after possible
490message loss has been detected. No messages will be lost "in between"
491(after the first lost message no further messages will be received by the
492port). After the monitoring action was invoked, further messages might get
493delivered again.
494
495In the first form (callback), the callback is simply called with any
496number of C<@reason> elements (no @reason means that the port was deleted
497"normally"). Note also that I<< the callback B<must> never die >>, so use
498C<eval> if unsure.
499
500In the second form (another port given), the other port (C<$rcvport>)
501will be C<kil>'ed with C<@reason>, iff a @reason was specified, i.e. on
502"normal" kils nothing happens, while under all other conditions, the other
503port is killed with the same reason.
504
505The third form (kill self) is the same as the second form, except that
506C<$rvport> defaults to C<$SELF>.
507
508In the last form (message), a message of the form C<@msg, @reason> will be
509C<snd>.
510
511As a rule of thumb, monitoring requests should always monitor a port from
512a local port (or callback). The reason is that kill messages might get
513lost, just like any other message. Another less obvious reason is that
514even monitoring requests can get lost (for exmaple, when the connection
515to the other node goes down permanently). When monitoring a port locally
516these problems do not exist.
517
518Example: call a given callback when C<$port> is killed.
519
520 mon $port, sub { warn "port died because of <@_>\n" };
521
522Example: kill ourselves when C<$port> is killed abnormally.
523
524 mon $port;
525
526Example: send us a restart message when another C<$port> is killed.
527
528 mon $port, $self => "restart";
529
530=cut
531
532sub mon {
533 my ($noderef, $port) = split /#/, shift, 2;
534
535 my $node = $NODE{$noderef} || add_node $noderef;
536
537 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,';
538
539 unless (ref $cb) {
540 if (@_) {
541 # send a kill info message
542 my (@msg) = ($cb, @_);
543 $cb = sub { snd @msg, @_ };
544 } else {
545 # simply kill other port
546 my $port = $cb;
547 $cb = sub { kil $port, @_ if @_ };
548 }
549 }
550
551 $node->monitor ($port, $cb);
552
553 defined wantarray
554 and AnyEvent::Util::guard { $node->unmonitor ($port, $cb) }
251} 555}
252 556
253=item $port->destroy 557=item $guard = mon_guard $port, $ref, $ref...
254 558
255Explicitly destroy/remove/nuke/vaporise the port. 559Monitors the given C<$port> and keeps the passed references. When the port
560is killed, the references will be freed.
256 561
257Ports are normally kept alive by there mere existance alone, and need to 562Optionally returns a guard that will stop the monitoring.
258be destroyed explicitly.
259 563
260=cut 564This function is useful when you create e.g. timers or other watchers and
565want to free them when the port gets killed:
261 566
262sub destroy { 567 $port->rcv (start => sub {
263 my ($self) = @_; 568 my $timer; $timer = mon_guard $port, AE::timer 1, 1, sub {
569 undef $timer if 0.9 < rand;
570 });
571 });
264 572
265 delete $AnyEvent::MP::Base::WKP{ $self->{wkname} }; 573=cut
266 574
267 delete $AnyEvent::MP::Base::PORT{$_} 575sub mon_guard {
268 for @{ $self->{names} }; 576 my ($port, @refs) = @_;
577
578 #TODO: mon-less form?
579
580 mon $port, sub { 0 && @refs }
269} 581}
270 582
271=back 583=item kil $port[, @reason]
272 584
273=head1 FUNCTIONS FOR NODES 585Kill the specified port with the given C<@reason>.
274 586
275=over 4 587If no C<@reason> is specified, then the port is killed "normally" (linked
588ports will not be kileld, or even notified).
276 589
277=item mon $noderef, $callback->($noderef, $status, $) 590Otherwise, linked ports get killed with the same reason (second form of
591C<mon>, see below).
278 592
279Monitors the given noderef. 593Runtime errors while evaluating C<rcv> callbacks or inside C<psub> blocks
594will be reported as reason C<< die => $@ >>.
280 595
281=item become_public endpoint... 596Transport/communication errors are reported as C<< transport_error =>
597$message >>.
282 598
283Tells the node to become a public node, i.e. reachable from other nodes.
284
285If no arguments are given, or the first argument is C<undef>, then
286AnyEvent::MP tries to bind on port C<4040> on all IP addresses that the
287local nodename resolves to.
288
289Otherwise the first argument must be an array-reference with transport
290endpoints ("ip:port", "hostname:port") or port numbers (in which case the
291local nodename is used as hostname). The endpoints are all resolved and
292will become the node reference.
293
294=cut 599=cut
600
601=item $port = spawn $node, $initfunc[, @initdata]
602
603Creates a port on the node C<$node> (which can also be a port ID, in which
604case it's the node where that port resides).
605
606The port ID of the newly created port is return immediately, and it is
607permissible to immediately start sending messages or monitor the port.
608
609After the port has been created, the init function is
610called. This function must be a fully-qualified function name
611(e.g. C<MyApp::Chat::Server::init>). To specify a function in the main
612program, use C<::name>.
613
614If the function doesn't exist, then the node tries to C<require>
615the package, then the package above the package and so on (e.g.
616C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function
617exists or it runs out of package names.
618
619The init function is then called with the newly-created port as context
620object (C<$SELF>) and the C<@initdata> values as arguments.
621
622A common idiom is to pass your own port, monitor the spawned port, and
623in the init function, monitor the original port. This two-way monitoring
624ensures that both ports get cleaned up when there is a problem.
625
626Example: spawn a chat server port on C<$othernode>.
627
628 # this node, executed from within a port context:
629 my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF;
630 mon $server;
631
632 # init function on C<$othernode>
633 sub connect {
634 my ($srcport) = @_;
635
636 mon $srcport;
637
638 rcv $SELF, sub {
639 ...
640 };
641 }
642
643=cut
644
645sub _spawn {
646 my $port = shift;
647 my $init = shift;
648
649 local $SELF = "$NODE#$port";
650 eval {
651 &{ load_func $init }
652 };
653 _self_die if $@;
654}
655
656sub spawn(@) {
657 my ($noderef, undef) = split /#/, shift, 2;
658
659 my $id = "$RUNIQ." . $ID++;
660
661 $_[0] =~ /::/
662 or Carp::croak "spawn init function must be a fully-qualified name, caught";
663
664 ($NODE{$noderef} || add_node $noderef)
665 ->send (["", "AnyEvent::MP::_spawn" => $id, @_]);
666
667 "$noderef#$id"
668}
295 669
296=back 670=back
297 671
298=head1 NODE MESSAGES 672=head1 NODE MESSAGES
299 673
300Nodes understand the following messages sent to them. Many of them take 674Nodes understand the following messages sent to them. Many of them take
301arguments called C<@reply>, which will simply be used to compose a reply 675arguments called C<@reply>, which will simply be used to compose a reply
302message - C<$reply[0]> is the port to reply to, C<$reply[1]> the type and 676message - C<$reply[0]> is the port to reply to, C<$reply[1]> the type and
303the remaining arguments are simply the message data. 677the remaining arguments are simply the message data.
304 678
679While other messages exist, they are not public and subject to change.
680
305=over 4 681=over 4
306 682
307=cut 683=cut
308 684
309=item wkp => $name, @reply 685=item lookup => $name, @reply
310 686
311Replies with the port ID of the specified well-known port, or C<undef>. 687Replies with the port ID of the specified well-known port, or C<undef>.
312 688
313=item devnull => ... 689=item devnull => ...
314 690
337 snd $NODE, time => $myport, timereply => 1, 2; 713 snd $NODE, time => $myport, timereply => 1, 2;
338 # => snd $myport, timereply => 1, 2, <time> 714 # => snd $myport, timereply => 1, 2, <time>
339 715
340=back 716=back
341 717
718=head1 AnyEvent::MP vs. Distributed Erlang
719
720AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node
721== aemp node, Erlang process == aemp port), so many of the documents and
722programming techniques employed by Erlang apply to AnyEvent::MP. Here is a
723sample:
724
725 http://www.Erlang.se/doc/programming_rules.shtml
726 http://Erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4
727 http://Erlang.org/download/Erlang-book-part1.pdf # chapters 5 and 6
728 http://Erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5
729
730Despite the similarities, there are also some important differences:
731
732=over 4
733
734=item * Node references contain the recipe on how to contact them.
735
736Erlang relies on special naming and DNS to work everywhere in the
737same way. AEMP relies on each node knowing it's own address(es), with
738convenience functionality.
739
740This means that AEMP requires a less tightly controlled environment at the
741cost of longer node references and a slightly higher management overhead.
742
743=item Erlang has a "remote ports are like local ports" philosophy, AEMP
744uses "local ports are like remote ports".
745
746The failure modes for local ports are quite different (runtime errors
747only) then for remote ports - when a local port dies, you I<know> it dies,
748when a connection to another node dies, you know nothing about the other
749port.
750
751Erlang pretends remote ports are as reliable as local ports, even when
752they are not.
753
754AEMP encourages a "treat remote ports differently" philosophy, with local
755ports being the special case/exception, where transport errors cannot
756occur.
757
758=item * Erlang uses processes and a mailbox, AEMP does not queue.
759
760Erlang uses processes that selectively receive messages, and therefore
761needs a queue. AEMP is event based, queuing messages would serve no
762useful purpose. For the same reason the pattern-matching abilities of
763AnyEvent::MP are more limited, as there is little need to be able to
764filter messages without dequeing them.
765
766(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP).
767
768=item * Erlang sends are synchronous, AEMP sends are asynchronous.
769
770Sending messages in Erlang is synchronous and blocks the process (and
771so does not need a queue that can overflow). AEMP sends are immediate,
772connection establishment is handled in the background.
773
774=item * Erlang suffers from silent message loss, AEMP does not.
775
776Erlang makes few guarantees on messages delivery - messages can get lost
777without any of the processes realising it (i.e. you send messages a, b,
778and c, and the other side only receives messages a and c).
779
780AEMP guarantees correct ordering, and the guarantee that there are no
781holes in the message sequence.
782
783=item * In Erlang, processes can be declared dead and later be found to be
784alive.
785
786In Erlang it can happen that a monitored process is declared dead and
787linked processes get killed, but later it turns out that the process is
788still alive - and can receive messages.
789
790In AEMP, when port monitoring detects a port as dead, then that port will
791eventually be killed - it cannot happen that a node detects a port as dead
792and then later sends messages to it, finding it is still alive.
793
794=item * Erlang can send messages to the wrong port, AEMP does not.
795
796In Erlang it is quite likely that a node that restarts reuses a process ID
797known to other nodes for a completely different process, causing messages
798destined for that process to end up in an unrelated process.
799
800AEMP never reuses port IDs, so old messages or old port IDs floating
801around in the network will not be sent to an unrelated port.
802
803=item * Erlang uses unprotected connections, AEMP uses secure
804authentication and can use TLS.
805
806AEMP can use a proven protocol - SSL/TLS - to protect connections and
807securely authenticate nodes.
808
809=item * The AEMP protocol is optimised for both text-based and binary
810communications.
811
812The AEMP protocol, unlike the Erlang protocol, supports both
813language-independent text-only protocols (good for debugging) and binary,
814language-specific serialisers (e.g. Storable).
815
816It has also been carefully designed to be implementable in other languages
817with a minimum of work while gracefully degrading fucntionality to make the
818protocol simple.
819
820=item * AEMP has more flexible monitoring options than Erlang.
821
822In Erlang, you can chose to receive I<all> exit signals as messages
823or I<none>, there is no in-between, so monitoring single processes is
824difficult to implement. Monitoring in AEMP is more flexible than in
825Erlang, as one can choose between automatic kill, exit message or callback
826on a per-process basis.
827
828=item * Erlang tries to hide remote/local connections, AEMP does not.
829
830Monitoring in Erlang is not an indicator of process death/crashes,
831as linking is (except linking is unreliable in Erlang).
832
833In AEMP, you don't "look up" registered port names or send to named ports
834that might or might not be persistent. Instead, you normally spawn a port
835on the remote node. The init function monitors the you, and you monitor
836the remote port. Since both monitors are local to the node, they are much
837more reliable.
838
839This also saves round-trips and avoids sending messages to the wrong port
840(hard to do in Erlang).
841
842=back
843
844=head1 RATIONALE
845
846=over 4
847
848=item Why strings for ports and noderefs, why not objects?
849
850We considered "objects", but found that the actual number of methods
851thatc an be called are very low. Since port IDs and noderefs travel over
852the network frequently, the serialising/deserialising would add lots of
853overhead, as well as having to keep a proxy object.
854
855Strings can easily be printed, easily serialised etc. and need no special
856procedures to be "valid".
857
858And a a miniport consists of a single closure stored in a global hash - it
859can't become much cheaper.
860
861=item Why favour JSON, why not real serialising format such as Storable?
862
863In fact, any AnyEvent::MP node will happily accept Storable as framing
864format, but currently there is no way to make a node use Storable by
865default.
866
867The default framing protocol is JSON because a) JSON::XS is many times
868faster for small messages and b) most importantly, after years of
869experience we found that object serialisation is causing more problems
870than it gains: Just like function calls, objects simply do not travel
871easily over the network, mostly because they will always be a copy, so you
872always have to re-think your design.
873
874Keeping your messages simple, concentrating on data structures rather than
875objects, will keep your messages clean, tidy and efficient.
876
877=back
878
342=head1 SEE ALSO 879=head1 SEE ALSO
343 880
344L<AnyEvent>. 881L<AnyEvent>.
345 882
346=head1 AUTHOR 883=head1 AUTHOR

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines