ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.32 by root, Wed Aug 5 19:58:46 2009 UTC vs.
Revision 1.53 by root, Fri Aug 14 15:31:21 2009 UTC

8 8
9 $NODE # contains this node's noderef 9 $NODE # contains this node's noderef
10 NODE # returns this node's noderef 10 NODE # returns this node's noderef
11 NODE $port # returns the noderef of the port 11 NODE $port # returns the noderef of the port
12 12
13 $SELF # receiving/own port id in rcv callbacks
14
15 # initialise the node so it can send/receive messages
16 initialise_node; # -OR-
17 initialise_node "localhost:4040"; # -OR-
18 initialise_node "slave/", "localhost:4040"
19
20 # ports are message endpoints
21
22 # sending messages
13 snd $port, type => data...; 23 snd $port, type => data...;
24 snd $port, @msg;
25 snd @msg_with_first_element_being_a_port;
14 26
15 $SELF # receiving/own port id in rcv callbacks 27 # creating/using ports, the simple way
28 my $simple_port = port { my @msg = @_; 0 };
16 29
17 rcv $port, smartmatch => $cb->($port, @msg); 30 # creating/using ports, tagged message matching
18 31 my $port = port;
19 # examples:
20 rcv $port2, ping => sub { snd $_[0], "pong"; 0 }; 32 rcv $port, ping => sub { snd $_[0], "pong"; 0 };
21 rcv $port1, pong => sub { warn "pong received\n" }; 33 rcv $port, pong => sub { warn "pong received\n"; 0 };
22 snd $port2, ping => $port1;
23 34
24 # more, smarter, matches (_any_ is exported by this module) 35 # create a port on another node
25 rcv $port, [child_died => $pid] => sub { ... 36 my $port = spawn $node, $initfunc, @initdata;
26 rcv $port, [_any_, _any_, 3] => sub { .. $_[2] is 3 37
38 # monitoring
39 mon $port, $cb->(@msg) # callback is invoked on death
40 mon $port, $otherport # kill otherport on abnormal death
41 mon $port, $otherport, @msg # send message on death
42
43=head1 CURRENT STATUS
44
45 AnyEvent::MP - stable API, should work
46 AnyEvent::MP::Intro - outdated
47 AnyEvent::MP::Kernel - WIP
48 AnyEvent::MP::Transport - mostly stable
49
50 stay tuned.
27 51
28=head1 DESCRIPTION 52=head1 DESCRIPTION
29 53
30This module (-family) implements a simple message passing framework. 54This module (-family) implements a simple message passing framework.
31 55
35For an introduction to this module family, see the L<AnyEvent::MP::Intro> 59For an introduction to this module family, see the L<AnyEvent::MP::Intro>
36manual page. 60manual page.
37 61
38At the moment, this module family is severly broken and underdocumented, 62At the moment, this module family is severly broken and underdocumented,
39so do not use. This was uploaded mainly to reserve the CPAN namespace - 63so do not use. This was uploaded mainly to reserve the CPAN namespace -
40stay tuned! The basic API should be finished, however. 64stay tuned!
41 65
42=head1 CONCEPTS 66=head1 CONCEPTS
43 67
44=over 4 68=over 4
45 69
46=item port 70=item port
47 71
48A port is something you can send messages to (with the C<snd> function). 72A port is something you can send messages to (with the C<snd> function).
49 73
50Some ports allow you to register C<rcv> handlers that can match specific 74Ports allow you to register C<rcv> handlers that can match all or just
51messages. All C<rcv> handlers will receive messages they match, messages 75some messages. Messages will not be queued.
52will not be queued.
53 76
54=item port id - C<noderef#portname> 77=item port id - C<noderef#portname>
55 78
56A port id is normaly the concatenation of a noderef, a hash-mark (C<#>) as 79A port ID is the concatenation of a noderef, a hash-mark (C<#>) as
57separator, and a port name (a printable string of unspecified format). An 80separator, and a port name (a printable string of unspecified format). An
58exception is the the node port, whose ID is identical to its node 81exception is the the node port, whose ID is identical to its node
59reference. 82reference.
60 83
61=item node 84=item node
62 85
63A node is a single process containing at least one port - the node 86A node is a single process containing at least one port - the node port,
64port. You can send messages to node ports to find existing ports or to 87which provides nodes to manage each other remotely, and to create new
65create new ports, among other things. 88ports.
66 89
67Nodes are either private (single-process only), slaves (connected to a 90Nodes are either private (single-process only), slaves (connected to a
68master node only) or public nodes (connectable from unrelated nodes). 91master node only) or public nodes (connectable from unrelated nodes).
69 92
70=item noderef - C<host:port,host:port...>, C<id@noderef>, C<id> 93=item noderef - C<host:port,host:port...>, C<id@noderef>, C<id>
90 113
91=cut 114=cut
92 115
93package AnyEvent::MP; 116package AnyEvent::MP;
94 117
95use AnyEvent::MP::Base; 118use AnyEvent::MP::Kernel;
96 119
97use common::sense; 120use common::sense;
98 121
99use Carp (); 122use Carp ();
100 123
101use AE (); 124use AE ();
102 125
103use base "Exporter"; 126use base "Exporter";
104 127
105our $VERSION = '0.1'; 128our $VERSION = $AnyEvent::MP::Kernel::VERSION;
129
106our @EXPORT = qw( 130our @EXPORT = qw(
107 NODE $NODE *SELF node_of _any_ 131 NODE $NODE *SELF node_of _any_
108 resolve_node initialise_node 132 resolve_node initialise_node
109 snd rcv mon kil reg psub 133 snd rcv mon kil reg psub spawn
110 port 134 port
111); 135);
112 136
113our $SELF; 137our $SELF;
114 138
118 kil $SELF, die => $msg; 142 kil $SELF, die => $msg;
119} 143}
120 144
121=item $thisnode = NODE / $NODE 145=item $thisnode = NODE / $NODE
122 146
123The C<NODE> function returns, and the C<$NODE> variable contains 147The C<NODE> function returns, and the C<$NODE> variable contains the
124the noderef of the local node. The value is initialised by a call 148noderef of the local node. The value is initialised by a call to
125to C<become_public> or C<become_slave>, after which all local port 149C<initialise_node>.
126identifiers become invalid.
127 150
128=item $noderef = node_of $portid 151=item $noderef = node_of $port
129 152
130Extracts and returns the noderef from a portid or a noderef. 153Extracts and returns the noderef from a port ID or a noderef.
154
155=item initialise_node $noderef, $seednode, $seednode...
156
157=item initialise_node "slave/", $master, $master...
158
159Before a node can talk to other nodes on the network it has to initialise
160itself - the minimum a node needs to know is it's own name, and optionally
161it should know the noderefs of some other nodes in the network.
162
163This function initialises a node - it must be called exactly once (or
164never) before calling other AnyEvent::MP functions.
165
166All arguments (optionally except for the first) are noderefs, which can be
167either resolved or unresolved.
168
169The first argument will be looked up in the configuration database first
170(if it is C<undef> then the current nodename will be used instead) to find
171the relevant configuration profile (see L<aemp>). If none is found then
172the default configuration is used. The configuration supplies additional
173seed/master nodes and can override the actual noderef.
174
175There are two types of networked nodes, public nodes and slave nodes:
176
177=over 4
178
179=item public nodes
180
181For public nodes, C<$noderef> (supplied either directly to
182C<initialise_node> or indirectly via a profile or the nodename) must be a
183noderef (possibly unresolved, in which case it will be resolved).
184
185After resolving, the node will bind itself on all endpoints and try to
186connect to all additional C<$seednodes> that are specified. Seednodes are
187optional and can be used to quickly bootstrap the node into an existing
188network.
189
190=item slave nodes
191
192When the C<$noderef> (either as given or overriden by the config file)
193is the special string C<slave/>, then the node will become a slave
194node. Slave nodes cannot be contacted from outside and will route most of
195their traffic to the master node that they attach to.
196
197At least one additional noderef is required (either by specifying it
198directly or because it is part of the configuration profile): The node
199will try to connect to all of them and will become a slave attached to the
200first node it can successfully connect to.
201
202=back
203
204This function will block until all nodes have been resolved and, for slave
205nodes, until it has successfully established a connection to a master
206server.
207
208Example: become a public node listening on the guessed noderef, or the one
209specified via C<aemp> for the current node. This should be the most common
210form of invocation for "daemon"-type nodes.
211
212 initialise_node;
213
214Example: become a slave node to any of the the seednodes specified via
215C<aemp>. This form is often used for commandline clients.
216
217 initialise_node "slave/";
218
219Example: become a slave node to any of the specified master servers. This
220form is also often used for commandline clients.
221
222 initialise_node "slave/", "master1", "192.168.13.17", "mp.example.net";
223
224Example: become a public node, and try to contact some well-known master
225servers to become part of the network.
226
227 initialise_node undef, "master1", "master2";
228
229Example: become a public node listening on port C<4041>.
230
231 initialise_node 4041;
232
233Example: become a public node, only visible on localhost port 4044.
234
235 initialise_node "localhost:4044";
131 236
132=item $cv = resolve_node $noderef 237=item $cv = resolve_node $noderef
133 238
134Takes an unresolved node reference that may contain hostnames and 239Takes an unresolved node reference that may contain hostnames and
135abbreviated IDs, resolves all of them and returns a resolved node 240abbreviated IDs, resolves all of them and returns a resolved node
167 272
168Due to some quirks in how perl exports variables, it is impossible to 273Due to some quirks in how perl exports variables, it is impossible to
169just export C<$SELF>, all the symbols called C<SELF> are exported by this 274just export C<$SELF>, all the symbols called C<SELF> are exported by this
170module, but only C<$SELF> is currently used. 275module, but only C<$SELF> is currently used.
171 276
172=item snd $portid, type => @data 277=item snd $port, type => @data
173 278
174=item snd $portid, @msg 279=item snd $port, @msg
175 280
176Send the given message to the given port ID, which can identify either 281Send the given message to the given port ID, which can identify either
177a local or a remote port, and can be either a string or soemthignt hat 282a local or a remote port, and must be a port ID.
178stringifies a sa port ID (such as a port object :).
179 283
180While the message can be about anything, it is highly recommended to use a 284While the message can be about anything, it is highly recommended to use a
181string as first element (a portid, or some word that indicates a request 285string as first element (a port ID, or some word that indicates a request
182type etc.). 286type etc.).
183 287
184The message data effectively becomes read-only after a call to this 288The message data effectively becomes read-only after a call to this
185function: modifying any argument is not allowed and can cause many 289function: modifying any argument is not allowed and can cause many
186problems. 290problems.
191that Storable can serialise and deserialise is allowed, and for the local 295that Storable can serialise and deserialise is allowed, and for the local
192node, anything can be passed. 296node, anything can be passed.
193 297
194=item $local_port = port 298=item $local_port = port
195 299
196Create a new local port object that can be used either as a pattern 300Create a new local port object and returns its port ID. Initially it has
197matching port ("full port") or a single-callback port ("miniport"), 301no callbacks set and will throw an error when it receives messages.
198depending on how C<rcv> callbacks are bound to the object.
199 302
200=item $portid = port { my @msg = @_; $finished } 303=item $local_port = port { my @msg = @_ }
201 304
202Creates a "mini port", that is, a very lightweight port without any 305Creates a new local port, and returns its ID. Semantically the same as
203pattern matching behind it, and returns its ID. 306creating a port and calling C<rcv $port, $callback> on it.
204 307
205The block will be called for every message received on the port. When the 308The block will be called for every message received on the port, with the
206callback returns a true value its job is considered "done" and the port 309global variable C<$SELF> set to the port ID. Runtime errors will cause the
207will be destroyed. Otherwise it will stay alive. 310port to be C<kil>ed. The message will be passed as-is, no extra argument
311(i.e. no port ID) will be passed to the callback.
208 312
209The message will be passed as-is, no extra argument (i.e. no port id) will 313If you want to stop/destroy the port, simply C<kil> it:
210be passed to the callback.
211 314
212If you need the local port id in the callback, this works nicely: 315 my $port = port {
213 316 my @msg = @_;
214 my $port; $port = port { 317 ...
215 snd $otherport, reply => $port; 318 kil $SELF;
216 }; 319 };
217 320
218=cut 321=cut
322
323sub rcv($@);
324
325sub _kilme {
326 die "received message on port without callback";
327}
219 328
220sub port(;&) { 329sub port(;&) {
221 my $id = "$UNIQ." . $ID++; 330 my $id = "$UNIQ." . $ID++;
222 my $port = "$NODE#$id"; 331 my $port = "$NODE#$id";
223 332
224 if (@_) { 333 rcv $port, shift || \&_kilme;
225 my $cb = shift;
226 $PORT{$id} = sub {
227 local $SELF = $port;
228 eval {
229 &$cb
230 and kil $id;
231 };
232 _self_die if $@;
233 };
234 } else {
235 my $self = bless {
236 id => "$NODE#$id",
237 }, "AnyEvent::MP::Port";
238
239 $PORT_DATA{$id} = $self;
240 $PORT{$id} = sub {
241 local $SELF = $port;
242
243 eval {
244 for (@{ $self->{rc0}{$_[0]} }) {
245 $_ && &{$_->[0]}
246 && undef $_;
247 }
248
249 for (@{ $self->{rcv}{$_[0]} }) {
250 $_ && [@_[1 .. @{$_->[1]}]] ~~ $_->[1]
251 && &{$_->[0]}
252 && undef $_;
253 }
254
255 for (@{ $self->{any} }) {
256 $_ && [@_[0 .. $#{$_->[1]}]] ~~ $_->[1]
257 && &{$_->[0]}
258 && undef $_;
259 }
260 };
261 _self_die if $@;
262 };
263 }
264 334
265 $port 335 $port
266} 336}
267 337
268=item reg $portid, $name
269
270Registers the given port under the name C<$name>. If the name already
271exists it is replaced.
272
273A port can only be registered under one well known name.
274
275A port automatically becomes unregistered when it is killed.
276
277=cut
278
279sub reg(@) {
280 my ($portid, $name) = @_;
281
282 $REG{$name} = $portid;
283}
284
285=item rcv $portid, $callback->(@msg) 338=item rcv $local_port, $callback->(@msg)
286 339
287Replaces the callback on the specified miniport (or newly created port 340Replaces the default callback on the specified port. There is no way to
288object, see C<port>). Full ports are configured with the following calls: 341remove the default callback: use C<sub { }> to disable it, or better
342C<kil> the port when it is no longer needed.
289 343
290=item rcv $portid, tagstring => $callback->(@msg), ...
291
292=item rcv $portid, $smartmatch => $callback->(@msg), ...
293
294=item rcv $portid, [$smartmatch...] => $callback->(@msg), ...
295
296Register callbacks to be called on matching messages on the given full
297port (or newly created port).
298
299The callback has to return a true value when its work is done, after
300which is will be removed, or a false value in which case it will stay
301registered.
302
303The global C<$SELF> (exported by this module) contains C<$portid> while 344The global C<$SELF> (exported by this module) contains C<$port> while
304executing the callback. 345executing the callback. Runtime errors during callback execution will
346result in the port being C<kil>ed.
305 347
306Runtime errors wdurign callback execution will result in the port being 348The default callback received all messages not matched by a more specific
307C<kil>ed. 349C<tag> match.
308 350
309If the match is an array reference, then it will be matched against the 351=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
310first elements of the message, otherwise only the first element is being
311matched.
312 352
313Any element in the match that is specified as C<_any_> (a function 353Register callbacks to be called on messages starting with the given tag on
314exported by this module) matches any single element of the message. 354the given port (and return the port), or unregister it (when C<$callback>
355is C<$undef>).
315 356
316While not required, it is highly recommended that the first matching 357The original message will be passed to the callback, after the first
317element is a string identifying the message. The one-string-only match is 358element (the tag) has been removed. The callback will use the same
318also the most efficient match (by far). 359environment as the default callback (see above).
360
361Example: create a port and bind receivers on it in one go.
362
363 my $port = rcv port,
364 msg1 => sub { ... },
365 msg2 => sub { ... },
366 ;
367
368Example: create a port, bind receivers and send it in a message elsewhere
369in one go:
370
371 snd $otherport, reply =>
372 rcv port,
373 msg1 => sub { ... },
374 ...
375 ;
319 376
320=cut 377=cut
321 378
322sub rcv($@) { 379sub rcv($@) {
323 my $portid = shift; 380 my $port = shift;
324 my ($noderef, $port) = split /#/, $port, 2; 381 my ($noderef, $portid) = split /#/, $port, 2;
325 382
326 ($NODE{$noderef} || add_node $noderef) == $NODE{""} 383 ($NODE{$noderef} || add_node $noderef) == $NODE{""}
327 or Carp::croak "$noderef#$port: rcv can only be called on local ports, caught"; 384 or Carp::croak "$port: rcv can only be called on local ports, caught";
328
329 my $self = $PORT_DATA{$port}
330 or Carp::croak "$noderef#$port: rcv can only be called on message matching ports, caught";
331
332 "AnyEvent::MP::Port" eq ref $self
333 or Carp::croak "$noderef#$port: rcv can only be called on message matching ports, caught";
334 385
335 while (@_) { 386 while (@_) {
336 my ($match, $cb) = splice @_, 0, 2;
337
338 if (!ref $match) { 387 if (ref $_[0]) {
339 push @{ $self->{rc0}{$match} }, [$cb]; 388 if (my $self = $PORT_DATA{$portid}) {
340 } elsif (("ARRAY" eq ref $match && !ref $match->[0])) { 389 "AnyEvent::MP::Port" eq ref $self
341 my ($type, @match) = @$match; 390 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
342 @match 391
343 ? push @{ $self->{rcv}{$match->[0]} }, [$cb, \@match] 392 $self->[2] = shift;
344 : push @{ $self->{rc0}{$match->[0]} }, [$cb];
345 } else { 393 } else {
346 push @{ $self->{any} }, [$cb, $match]; 394 my $cb = shift;
395 $PORT{$portid} = sub {
396 local $SELF = $port;
397 eval { &$cb }; _self_die if $@;
398 };
399 }
400 } elsif (defined $_[0]) {
401 my $self = $PORT_DATA{$portid} ||= do {
402 my $self = bless [$PORT{$port} || sub { }, { }, $port], "AnyEvent::MP::Port";
403
404 $PORT{$portid} = sub {
405 local $SELF = $port;
406
407 if (my $cb = $self->[1]{$_[0]}) {
408 shift;
409 eval { &$cb }; _self_die if $@;
410 } else {
411 &{ $self->[0] };
412 }
413 };
414
415 $self
416 };
417
418 "AnyEvent::MP::Port" eq ref $self
419 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
420
421 my ($tag, $cb) = splice @_, 0, 2;
422
423 if (defined $cb) {
424 $self->[1]{$tag} = $cb;
425 } else {
426 delete $self->[1]{$tag};
427 }
347 } 428 }
348 } 429 }
349 430
350 $portid 431 $port
351} 432}
352 433
353=item $closure = psub { BLOCK } 434=item $closure = psub { BLOCK }
354 435
355Remembers C<$SELF> and creates a closure out of the BLOCK. When the 436Remembers C<$SELF> and creates a closure out of the BLOCK. When the
386 $res 467 $res
387 } 468 }
388 } 469 }
389} 470}
390 471
391=item $guard = mon $portid, $cb->(@reason) 472=item $guard = mon $port, $cb->(@reason)
392 473
393=item $guard = mon $portid, $otherport 474=item $guard = mon $port, $rcvport
394 475
476=item $guard = mon $port
477
395=item $guard = mon $portid, $otherport, @msg 478=item $guard = mon $port, $rcvport, @msg
396 479
397Monitor the given port and do something when the port is killed. 480Monitor the given port and do something when the port is killed or
481messages to it were lost, and optionally return a guard that can be used
482to stop monitoring again.
398 483
484C<mon> effectively guarantees that, in the absence of hardware failures,
485that after starting the monitor, either all messages sent to the port
486will arrive, or the monitoring action will be invoked after possible
487message loss has been detected. No messages will be lost "in between"
488(after the first lost message no further messages will be received by the
489port). After the monitoring action was invoked, further messages might get
490delivered again.
491
399In the first form, the callback is simply called with any number 492In the first form (callback), the callback is simply called with any
400of C<@reason> elements (no @reason means that the port was deleted 493number of C<@reason> elements (no @reason means that the port was deleted
401"normally"). Note also that I<< the callback B<must> never die >>, so use 494"normally"). Note also that I<< the callback B<must> never die >>, so use
402C<eval> if unsure. 495C<eval> if unsure.
403 496
404In the second form, the other port will be C<kil>'ed with C<@reason>, iff 497In the second form (another port given), the other port (C<$rcvport>)
405a @reason was specified, i.e. on "normal" kils nothing happens, while 498will be C<kil>'ed with C<@reason>, iff a @reason was specified, i.e. on
406under all other conditions, the other port is killed with the same reason. 499"normal" kils nothing happens, while under all other conditions, the other
500port is killed with the same reason.
407 501
502The third form (kill self) is the same as the second form, except that
503C<$rvport> defaults to C<$SELF>.
504
408In the last form, a message of the form C<@msg, @reason> will be C<snd>. 505In the last form (message), a message of the form C<@msg, @reason> will be
506C<snd>.
507
508As a rule of thumb, monitoring requests should always monitor a port from
509a local port (or callback). The reason is that kill messages might get
510lost, just like any other message. Another less obvious reason is that
511even monitoring requests can get lost (for exmaple, when the connection
512to the other node goes down permanently). When monitoring a port locally
513these problems do not exist.
409 514
410Example: call a given callback when C<$port> is killed. 515Example: call a given callback when C<$port> is killed.
411 516
412 mon $port, sub { warn "port died because of <@_>\n" }; 517 mon $port, sub { warn "port died because of <@_>\n" };
413 518
414Example: kill ourselves when C<$port> is killed abnormally. 519Example: kill ourselves when C<$port> is killed abnormally.
415 520
416 mon $port, $self; 521 mon $port;
417 522
418Example: send us a restart message another C<$port> is killed. 523Example: send us a restart message when another C<$port> is killed.
419 524
420 mon $port, $self => "restart"; 525 mon $port, $self => "restart";
421 526
422=cut 527=cut
423 528
424sub mon { 529sub mon {
425 my ($noderef, $port) = split /#/, shift, 2; 530 my ($noderef, $port) = split /#/, shift, 2;
426 531
427 my $node = $NODE{$noderef} || add_node $noderef; 532 my $node = $NODE{$noderef} || add_node $noderef;
428 533
429 my $cb = shift; 534 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,';
430 535
431 unless (ref $cb) { 536 unless (ref $cb) {
432 if (@_) { 537 if (@_) {
433 # send a kill info message 538 # send a kill info message
434 my (@msg) = ($cb, @_); 539 my (@msg) = ($cb, @_);
465=cut 570=cut
466 571
467sub mon_guard { 572sub mon_guard {
468 my ($port, @refs) = @_; 573 my ($port, @refs) = @_;
469 574
575 #TODO: mon-less form?
576
470 mon $port, sub { 0 && @refs } 577 mon $port, sub { 0 && @refs }
471} 578}
472 579
473=item lnk $port1, $port2
474
475Link two ports. This is simply a shorthand for:
476
477 mon $port1, $port2;
478 mon $port2, $port1;
479
480It means that if either one is killed abnormally, the other one gets
481killed as well.
482
483=item kil $portid[, @reason] 580=item kil $port[, @reason]
484 581
485Kill the specified port with the given C<@reason>. 582Kill the specified port with the given C<@reason>.
486 583
487If no C<@reason> is specified, then the port is killed "normally" (linked 584If no C<@reason> is specified, then the port is killed "normally" (linked
488ports will not be kileld, or even notified). 585ports will not be kileld, or even notified).
494will be reported as reason C<< die => $@ >>. 591will be reported as reason C<< die => $@ >>.
495 592
496Transport/communication errors are reported as C<< transport_error => 593Transport/communication errors are reported as C<< transport_error =>
497$message >>. 594$message >>.
498 595
499=back
500
501=head1 FUNCTIONS FOR NODES
502
503=over 4
504
505=item become_public $noderef
506
507Tells the node to become a public node, i.e. reachable from other nodes.
508
509The first argument is the (unresolved) node reference of the local node
510(if missing then the empty string is used).
511
512It is quite common to not specify anything, in which case the local node
513tries to listen on the default port, or to only specify a port number, in
514which case AnyEvent::MP tries to guess the local addresses.
515
516=cut 596=cut
597
598=item $port = spawn $node, $initfunc[, @initdata]
599
600Creates a port on the node C<$node> (which can also be a port ID, in which
601case it's the node where that port resides).
602
603The port ID of the newly created port is return immediately, and it is
604permissible to immediately start sending messages or monitor the port.
605
606After the port has been created, the init function is
607called. This function must be a fully-qualified function name
608(e.g. C<MyApp::Chat::Server::init>). To specify a function in the main
609program, use C<::name>.
610
611If the function doesn't exist, then the node tries to C<require>
612the package, then the package above the package and so on (e.g.
613C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function
614exists or it runs out of package names.
615
616The init function is then called with the newly-created port as context
617object (C<$SELF>) and the C<@initdata> values as arguments.
618
619A common idiom is to pass your own port, monitor the spawned port, and
620in the init function, monitor the original port. This two-way monitoring
621ensures that both ports get cleaned up when there is a problem.
622
623Example: spawn a chat server port on C<$othernode>.
624
625 # this node, executed from within a port context:
626 my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF;
627 mon $server;
628
629 # init function on C<$othernode>
630 sub connect {
631 my ($srcport) = @_;
632
633 mon $srcport;
634
635 rcv $SELF, sub {
636 ...
637 };
638 }
639
640=cut
641
642sub _spawn {
643 my $port = shift;
644 my $init = shift;
645
646 local $SELF = "$NODE#$port";
647 eval {
648 &{ load_func $init }
649 };
650 _self_die if $@;
651}
652
653sub spawn(@) {
654 my ($noderef, undef) = split /#/, shift, 2;
655
656 my $id = "$RUNIQ." . $ID++;
657
658 $_[0] =~ /::/
659 or Carp::croak "spawn init function must be a fully-qualified name, caught";
660
661 ($NODE{$noderef} || add_node $noderef)
662 ->send (["", "AnyEvent::MP::_spawn" => $id, @_]);
663
664 "$noderef#$id"
665}
517 666
518=back 667=back
519 668
520=head1 NODE MESSAGES 669=head1 NODE MESSAGES
521 670
563 712
564=back 713=back
565 714
566=head1 AnyEvent::MP vs. Distributed Erlang 715=head1 AnyEvent::MP vs. Distributed Erlang
567 716
568AnyEvent::MP got lots of its ideas from distributed erlang (erlang node 717AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node
569== aemp node, erlang process == aemp port), so many of the documents and 718== aemp node, Erlang process == aemp port), so many of the documents and
570programming techniques employed by erlang apply to AnyEvent::MP. Here is a 719programming techniques employed by Erlang apply to AnyEvent::MP. Here is a
571sample: 720sample:
572 721
573 http://www.erlang.se/doc/programming_rules.shtml 722 http://www.Erlang.se/doc/programming_rules.shtml
574 http://erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4 723 http://Erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4
575 http://erlang.org/download/erlang-book-part1.pdf # chapters 5 and 6 724 http://Erlang.org/download/Erlang-book-part1.pdf # chapters 5 and 6
576 http://erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5 725 http://Erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5
577 726
578Despite the similarities, there are also some important differences: 727Despite the similarities, there are also some important differences:
579 728
580=over 4 729=over 4
581 730
586convenience functionality. 735convenience functionality.
587 736
588This means that AEMP requires a less tightly controlled environment at the 737This means that AEMP requires a less tightly controlled environment at the
589cost of longer node references and a slightly higher management overhead. 738cost of longer node references and a slightly higher management overhead.
590 739
740=item Erlang has a "remote ports are like local ports" philosophy, AEMP
741uses "local ports are like remote ports".
742
743The failure modes for local ports are quite different (runtime errors
744only) then for remote ports - when a local port dies, you I<know> it dies,
745when a connection to another node dies, you know nothing about the other
746port.
747
748Erlang pretends remote ports are as reliable as local ports, even when
749they are not.
750
751AEMP encourages a "treat remote ports differently" philosophy, with local
752ports being the special case/exception, where transport errors cannot
753occur.
754
591=item * Erlang uses processes and a mailbox, AEMP does not queue. 755=item * Erlang uses processes and a mailbox, AEMP does not queue.
592 756
593Erlang uses processes that selctively receive messages, and therefore 757Erlang uses processes that selectively receive messages, and therefore
594needs a queue. AEMP is event based, queuing messages would serve no useful 758needs a queue. AEMP is event based, queuing messages would serve no
595purpose. 759useful purpose. For the same reason the pattern-matching abilities of
760AnyEvent::MP are more limited, as there is little need to be able to
761filter messages without dequeing them.
596 762
597(But see L<Coro::MP> for a more erlang-like process model on top of AEMP). 763(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP).
598 764
599=item * Erlang sends are synchronous, AEMP sends are asynchronous. 765=item * Erlang sends are synchronous, AEMP sends are asynchronous.
600 766
601Sending messages in erlang is synchronous and blocks the process. AEMP 767Sending messages in Erlang is synchronous and blocks the process (and
602sends are immediate, connection establishment is handled in the 768so does not need a queue that can overflow). AEMP sends are immediate,
603background. 769connection establishment is handled in the background.
604 770
605=item * Erlang can silently lose messages, AEMP cannot. 771=item * Erlang suffers from silent message loss, AEMP does not.
606 772
607Erlang makes few guarantees on messages delivery - messages can get lost 773Erlang makes few guarantees on messages delivery - messages can get lost
608without any of the processes realising it (i.e. you send messages a, b, 774without any of the processes realising it (i.e. you send messages a, b,
609and c, and the other side only receives messages a and c). 775and c, and the other side only receives messages a and c).
610 776
611AEMP guarantees correct ordering, and the guarantee that there are no 777AEMP guarantees correct ordering, and the guarantee that there are no
612holes in the message sequence. 778holes in the message sequence.
613 779
614=item * In erlang, processes can be declared dead and later be found to be 780=item * In Erlang, processes can be declared dead and later be found to be
615alive. 781alive.
616 782
617In erlang it can happen that a monitored process is declared dead and 783In Erlang it can happen that a monitored process is declared dead and
618linked processes get killed, but later it turns out that the process is 784linked processes get killed, but later it turns out that the process is
619still alive - and can receive messages. 785still alive - and can receive messages.
620 786
621In AEMP, when port monitoring detects a port as dead, then that port will 787In AEMP, when port monitoring detects a port as dead, then that port will
622eventually be killed - it cannot happen that a node detects a port as dead 788eventually be killed - it cannot happen that a node detects a port as dead
623and then later sends messages to it, finding it is still alive. 789and then later sends messages to it, finding it is still alive.
624 790
625=item * Erlang can send messages to the wrong port, AEMP does not. 791=item * Erlang can send messages to the wrong port, AEMP does not.
626 792
627In erlang it is quite possible that a node that restarts reuses a process 793In Erlang it is quite likely that a node that restarts reuses a process ID
628ID known to other nodes for a completely different process, causing 794known to other nodes for a completely different process, causing messages
629messages destined for that process to end up in an unrelated process. 795destined for that process to end up in an unrelated process.
630 796
631AEMP never reuses port IDs, so old messages or old port IDs floating 797AEMP never reuses port IDs, so old messages or old port IDs floating
632around in the network will not be sent to an unrelated port. 798around in the network will not be sent to an unrelated port.
633 799
634=item * Erlang uses unprotected connections, AEMP uses secure 800=item * Erlang uses unprotected connections, AEMP uses secure
638securely authenticate nodes. 804securely authenticate nodes.
639 805
640=item * The AEMP protocol is optimised for both text-based and binary 806=item * The AEMP protocol is optimised for both text-based and binary
641communications. 807communications.
642 808
643The AEMP protocol, unlike the erlang protocol, supports both 809The AEMP protocol, unlike the Erlang protocol, supports both
644language-independent text-only protocols (good for debugging) and binary, 810language-independent text-only protocols (good for debugging) and binary,
645language-specific serialisers (e.g. Storable). 811language-specific serialisers (e.g. Storable).
646 812
647It has also been carefully designed to be implementable in other languages 813It has also been carefully designed to be implementable in other languages
648with a minimum of work while gracefully degrading fucntionality to make the 814with a minimum of work while gracefully degrading fucntionality to make the
649protocol simple. 815protocol simple.
650 816
817=item * AEMP has more flexible monitoring options than Erlang.
818
819In Erlang, you can chose to receive I<all> exit signals as messages
820or I<none>, there is no in-between, so monitoring single processes is
821difficult to implement. Monitoring in AEMP is more flexible than in
822Erlang, as one can choose between automatic kill, exit message or callback
823on a per-process basis.
824
825=item * Erlang tries to hide remote/local connections, AEMP does not.
826
827Monitoring in Erlang is not an indicator of process death/crashes,
828as linking is (except linking is unreliable in Erlang).
829
830In AEMP, you don't "look up" registered port names or send to named ports
831that might or might not be persistent. Instead, you normally spawn a port
832on the remote node. The init function monitors the you, and you monitor
833the remote port. Since both monitors are local to the node, they are much
834more reliable.
835
836This also saves round-trips and avoids sending messages to the wrong port
837(hard to do in Erlang).
838
839=back
840
841=head1 RATIONALE
842
843=over 4
844
845=item Why strings for ports and noderefs, why not objects?
846
847We considered "objects", but found that the actual number of methods
848thatc an be called are very low. Since port IDs and noderefs travel over
849the network frequently, the serialising/deserialising would add lots of
850overhead, as well as having to keep a proxy object.
851
852Strings can easily be printed, easily serialised etc. and need no special
853procedures to be "valid".
854
855And a a miniport consists of a single closure stored in a global hash - it
856can't become much cheaper.
857
858=item Why favour JSON, why not real serialising format such as Storable?
859
860In fact, any AnyEvent::MP node will happily accept Storable as framing
861format, but currently there is no way to make a node use Storable by
862default.
863
864The default framing protocol is JSON because a) JSON::XS is many times
865faster for small messages and b) most importantly, after years of
866experience we found that object serialisation is causing more problems
867than it gains: Just like function calls, objects simply do not travel
868easily over the network, mostly because they will always be a copy, so you
869always have to re-think your design.
870
871Keeping your messages simple, concentrating on data structures rather than
872objects, will keep your messages clean, tidy and efficient.
873
651=back 874=back
652 875
653=head1 SEE ALSO 876=head1 SEE ALSO
654 877
655L<AnyEvent>. 878L<AnyEvent>.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines