ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/cvsroot/AnyEvent-MP/MP.pm
(Generate patch)

Comparing cvsroot/AnyEvent-MP/MP.pm (file contents):
Revision 1.33 by root, Wed Aug 5 22:40:51 2009 UTC vs.
Revision 1.55 by root, Fri Aug 14 23:17:17 2009 UTC

8 8
9 $NODE # contains this node's noderef 9 $NODE # contains this node's noderef
10 NODE # returns this node's noderef 10 NODE # returns this node's noderef
11 NODE $port # returns the noderef of the port 11 NODE $port # returns the noderef of the port
12 12
13 $SELF # receiving/own port id in rcv callbacks
14
15 # initialise the node so it can send/receive messages
16 initialise_node; # -OR-
17 initialise_node "localhost:4040"; # -OR-
18 initialise_node "slave/", "localhost:4040"
19
20 # ports are message endpoints
21
22 # sending messages
13 snd $port, type => data...; 23 snd $port, type => data...;
24 snd $port, @msg;
25 snd @msg_with_first_element_being_a_port;
14 26
15 $SELF # receiving/own port id in rcv callbacks 27 # creating/using ports, the simple way
28 my $simple_port = port { my @msg = @_; 0 };
16 29
17 rcv $port, smartmatch => $cb->($port, @msg); 30 # creating/using ports, tagged message matching
18 31 my $port = port;
19 # examples:
20 rcv $port2, ping => sub { snd $_[0], "pong"; 0 }; 32 rcv $port, ping => sub { snd $_[0], "pong"; 0 };
21 rcv $port1, pong => sub { warn "pong received\n" }; 33 rcv $port, pong => sub { warn "pong received\n"; 0 };
22 snd $port2, ping => $port1;
23 34
24 # more, smarter, matches (_any_ is exported by this module) 35 # create a port on another node
25 rcv $port, [child_died => $pid] => sub { ... 36 my $port = spawn $node, $initfunc, @initdata;
26 rcv $port, [_any_, _any_, 3] => sub { .. $_[2] is 3 37
38 # monitoring
39 mon $port, $cb->(@msg) # callback is invoked on death
40 mon $port, $otherport # kill otherport on abnormal death
41 mon $port, $otherport, @msg # send message on death
42
43=head1 CURRENT STATUS
44
45 AnyEvent::MP - stable API, should work
46 AnyEvent::MP::Intro - outdated
47 AnyEvent::MP::Kernel - WIP
48 AnyEvent::MP::Transport - mostly stable
49
50 stay tuned.
27 51
28=head1 DESCRIPTION 52=head1 DESCRIPTION
29 53
30This module (-family) implements a simple message passing framework. 54This module (-family) implements a simple message passing framework.
31 55
35For an introduction to this module family, see the L<AnyEvent::MP::Intro> 59For an introduction to this module family, see the L<AnyEvent::MP::Intro>
36manual page. 60manual page.
37 61
38At the moment, this module family is severly broken and underdocumented, 62At the moment, this module family is severly broken and underdocumented,
39so do not use. This was uploaded mainly to reserve the CPAN namespace - 63so do not use. This was uploaded mainly to reserve the CPAN namespace -
40stay tuned! The basic API should be finished, however. 64stay tuned!
41 65
42=head1 CONCEPTS 66=head1 CONCEPTS
43 67
44=over 4 68=over 4
45 69
46=item port 70=item port
47 71
48A port is something you can send messages to (with the C<snd> function). 72A port is something you can send messages to (with the C<snd> function).
49 73
50Some ports allow you to register C<rcv> handlers that can match specific 74Ports allow you to register C<rcv> handlers that can match all or just
51messages. All C<rcv> handlers will receive messages they match, messages 75some messages. Messages will not be queued.
52will not be queued.
53 76
54=item port id - C<noderef#portname> 77=item port id - C<noderef#portname>
55 78
56A port id is normaly the concatenation of a noderef, a hash-mark (C<#>) as 79A port ID is the concatenation of a noderef, a hash-mark (C<#>) as
57separator, and a port name (a printable string of unspecified format). An 80separator, and a port name (a printable string of unspecified format). An
58exception is the the node port, whose ID is identical to its node 81exception is the the node port, whose ID is identical to its node
59reference. 82reference.
60 83
61=item node 84=item node
62 85
63A node is a single process containing at least one port - the node 86A node is a single process containing at least one port - the node port,
64port. You can send messages to node ports to find existing ports or to 87which provides nodes to manage each other remotely, and to create new
65create new ports, among other things. 88ports.
66 89
67Nodes are either private (single-process only), slaves (connected to a 90Nodes are either private (single-process only), slaves (connected to a
68master node only) or public nodes (connectable from unrelated nodes). 91master node only) or public nodes (connectable from unrelated nodes).
69 92
70=item noderef - C<host:port,host:port...>, C<id@noderef>, C<id> 93=item noderef - C<host:port,host:port...>, C<id@noderef>, C<id>
90 113
91=cut 114=cut
92 115
93package AnyEvent::MP; 116package AnyEvent::MP;
94 117
95use AnyEvent::MP::Base; 118use AnyEvent::MP::Kernel;
96 119
97use common::sense; 120use common::sense;
98 121
99use Carp (); 122use Carp ();
100 123
101use AE (); 124use AE ();
102 125
103use base "Exporter"; 126use base "Exporter";
104 127
105our $VERSION = '0.1'; 128our $VERSION = $AnyEvent::MP::Kernel::VERSION;
129
106our @EXPORT = qw( 130our @EXPORT = qw(
107 NODE $NODE *SELF node_of _any_ 131 NODE $NODE *SELF node_of _any_
108 resolve_node initialise_node 132 resolve_node initialise_node
109 snd rcv mon kil reg psub 133 snd rcv mon kil reg psub spawn
110 port 134 port
111); 135);
112 136
113our $SELF; 137our $SELF;
114 138
118 kil $SELF, die => $msg; 142 kil $SELF, die => $msg;
119} 143}
120 144
121=item $thisnode = NODE / $NODE 145=item $thisnode = NODE / $NODE
122 146
123The C<NODE> function returns, and the C<$NODE> variable contains 147The C<NODE> function returns, and the C<$NODE> variable contains the
124the noderef of the local node. The value is initialised by a call 148noderef of the local node. The value is initialised by a call to
125to C<become_public> or C<become_slave>, after which all local port 149C<initialise_node>.
126identifiers become invalid.
127 150
128=item $noderef = node_of $port 151=item $noderef = node_of $port
129 152
130Extracts and returns the noderef from a portid or a noderef. 153Extracts and returns the noderef from a port ID or a noderef.
154
155=item initialise_node $noderef, $seednode, $seednode...
156
157=item initialise_node "slave/", $master, $master...
158
159Before a node can talk to other nodes on the network it has to initialise
160itself - the minimum a node needs to know is it's own name, and optionally
161it should know the noderefs of some other nodes in the network.
162
163This function initialises a node - it must be called exactly once (or
164never) before calling other AnyEvent::MP functions.
165
166All arguments (optionally except for the first) are noderefs, which can be
167either resolved or unresolved.
168
169The first argument will be looked up in the configuration database first
170(if it is C<undef> then the current nodename will be used instead) to find
171the relevant configuration profile (see L<aemp>). If none is found then
172the default configuration is used. The configuration supplies additional
173seed/master nodes and can override the actual noderef.
174
175There are two types of networked nodes, public nodes and slave nodes:
176
177=over 4
178
179=item public nodes
180
181For public nodes, C<$noderef> (supplied either directly to
182C<initialise_node> or indirectly via a profile or the nodename) must be a
183noderef (possibly unresolved, in which case it will be resolved).
184
185After resolving, the node will bind itself on all endpoints and try to
186connect to all additional C<$seednodes> that are specified. Seednodes are
187optional and can be used to quickly bootstrap the node into an existing
188network.
189
190=item slave nodes
191
192When the C<$noderef> (either as given or overriden by the config file)
193is the special string C<slave/>, then the node will become a slave
194node. Slave nodes cannot be contacted from outside and will route most of
195their traffic to the master node that they attach to.
196
197At least one additional noderef is required (either by specifying it
198directly or because it is part of the configuration profile): The node
199will try to connect to all of them and will become a slave attached to the
200first node it can successfully connect to.
201
202=back
203
204This function will block until all nodes have been resolved and, for slave
205nodes, until it has successfully established a connection to a master
206server.
207
208Example: become a public node listening on the guessed noderef, or the one
209specified via C<aemp> for the current node. This should be the most common
210form of invocation for "daemon"-type nodes.
211
212 initialise_node;
213
214Example: become a slave node to any of the the seednodes specified via
215C<aemp>. This form is often used for commandline clients.
216
217 initialise_node "slave/";
218
219Example: become a slave node to any of the specified master servers. This
220form is also often used for commandline clients.
221
222 initialise_node "slave/", "master1", "192.168.13.17", "mp.example.net";
223
224Example: become a public node, and try to contact some well-known master
225servers to become part of the network.
226
227 initialise_node undef, "master1", "master2";
228
229Example: become a public node listening on port C<4041>.
230
231 initialise_node 4041;
232
233Example: become a public node, only visible on localhost port 4044.
234
235 initialise_node "localhost:4044";
131 236
132=item $cv = resolve_node $noderef 237=item $cv = resolve_node $noderef
133 238
134Takes an unresolved node reference that may contain hostnames and 239Takes an unresolved node reference that may contain hostnames and
135abbreviated IDs, resolves all of them and returns a resolved node 240abbreviated IDs, resolves all of them and returns a resolved node
172=item snd $port, type => @data 277=item snd $port, type => @data
173 278
174=item snd $port, @msg 279=item snd $port, @msg
175 280
176Send the given message to the given port ID, which can identify either 281Send the given message to the given port ID, which can identify either
177a local or a remote port, and can be either a string or soemthignt hat 282a local or a remote port, and must be a port ID.
178stringifies a sa port ID (such as a port object :).
179 283
180While the message can be about anything, it is highly recommended to use a 284While the message can be about anything, it is highly recommended to use a
181string as first element (a portid, or some word that indicates a request 285string as first element (a port ID, or some word that indicates a request
182type etc.). 286type etc.).
183 287
184The message data effectively becomes read-only after a call to this 288The message data effectively becomes read-only after a call to this
185function: modifying any argument is not allowed and can cause many 289function: modifying any argument is not allowed and can cause many
186problems. 290problems.
191that Storable can serialise and deserialise is allowed, and for the local 295that Storable can serialise and deserialise is allowed, and for the local
192node, anything can be passed. 296node, anything can be passed.
193 297
194=item $local_port = port 298=item $local_port = port
195 299
196Create a new local port object that can be used either as a pattern 300Create a new local port object and returns its port ID. Initially it has
197matching port ("full port") or a single-callback port ("miniport"), 301no callbacks set and will throw an error when it receives messages.
198depending on how C<rcv> callbacks are bound to the object.
199 302
200=item $port = port { my @msg = @_; $finished } 303=item $local_port = port { my @msg = @_ }
201 304
202Creates a "miniport", that is, a very lightweight port without any pattern 305Creates a new local port, and returns its ID. Semantically the same as
203matching behind it, and returns its ID. Semantically the same as creating
204a port and calling C<rcv $port, $callback> on it. 306creating a port and calling C<rcv $port, $callback> on it.
205 307
206The block will be called for every message received on the port. When the 308The block will be called for every message received on the port, with the
207callback returns a true value its job is considered "done" and the port 309global variable C<$SELF> set to the port ID. Runtime errors will cause the
208will be destroyed. Otherwise it will stay alive. 310port to be C<kil>ed. The message will be passed as-is, no extra argument
311(i.e. no port ID) will be passed to the callback.
209 312
210The message will be passed as-is, no extra argument (i.e. no port id) will 313If you want to stop/destroy the port, simply C<kil> it:
211be passed to the callback.
212 314
213If you need the local port id in the callback, this works nicely: 315 my $port = port {
214 316 my @msg = @_;
215 my $port; $port = port { 317 ...
216 snd $otherport, reply => $port; 318 kil $SELF;
217 }; 319 };
218 320
219=cut 321=cut
220 322
221sub rcv($@); 323sub rcv($@);
324
325sub _kilme {
326 die "received message on port without callback";
327}
222 328
223sub port(;&) { 329sub port(;&) {
224 my $id = "$UNIQ." . $ID++; 330 my $id = "$UNIQ." . $ID++;
225 my $port = "$NODE#$id"; 331 my $port = "$NODE#$id";
226 332
227 if (@_) { 333 rcv $port, shift || \&_kilme;
228 rcv $port, shift;
229 } else {
230 $PORT{$id} = sub { }; # nop
231 }
232 334
233 $port 335 $port
234} 336}
235 337
236=item reg $port, $name
237
238Registers the given port under the name C<$name>. If the name already
239exists it is replaced.
240
241A port can only be registered under one well known name.
242
243A port automatically becomes unregistered when it is killed.
244
245=cut
246
247sub reg(@) {
248 my ($port, $name) = @_;
249
250 $REG{$name} = $port;
251}
252
253=item rcv $port, $callback->(@msg) 338=item rcv $local_port, $callback->(@msg)
254 339
255Replaces the callback on the specified miniport (after converting it to 340Replaces the default callback on the specified port. There is no way to
256one if required). 341remove the default callback: use C<sub { }> to disable it, or better
257 342C<kil> the port when it is no longer needed.
258=item rcv $port, tagstring => $callback->(@msg), ...
259
260=item rcv $port, $smartmatch => $callback->(@msg), ...
261
262=item rcv $port, [$smartmatch...] => $callback->(@msg), ...
263
264Register callbacks to be called on matching messages on the given full
265port (after converting it to one if required).
266
267The callback has to return a true value when its work is done, after
268which is will be removed, or a false value in which case it will stay
269registered.
270 343
271The global C<$SELF> (exported by this module) contains C<$port> while 344The global C<$SELF> (exported by this module) contains C<$port> while
272executing the callback. 345executing the callback. Runtime errors during callback execution will
346result in the port being C<kil>ed.
273 347
274Runtime errors wdurign callback execution will result in the port being 348The default callback received all messages not matched by a more specific
275C<kil>ed. 349C<tag> match.
276 350
277If the match is an array reference, then it will be matched against the 351=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
278first elements of the message, otherwise only the first element is being
279matched.
280 352
281Any element in the match that is specified as C<_any_> (a function 353Register (or replace) callbacks to be called on messages starting with the
282exported by this module) matches any single element of the message. 354given tag on the given port (and return the port), or unregister it (when
355C<$callback> is C<$undef> or missing). There can only be one callback
356registered for each tag.
283 357
284While not required, it is highly recommended that the first matching 358The original message will be passed to the callback, after the first
285element is a string identifying the message. The one-string-only match is 359element (the tag) has been removed. The callback will use the same
286also the most efficient match (by far). 360environment as the default callback (see above).
361
362Example: create a port and bind receivers on it in one go.
363
364 my $port = rcv port,
365 msg1 => sub { ... },
366 msg2 => sub { ... },
367 ;
368
369Example: create a port, bind receivers and send it in a message elsewhere
370in one go:
371
372 snd $otherport, reply =>
373 rcv port,
374 msg1 => sub { ... },
375 ...
376 ;
377
378Example: temporarily register a rcv callback for a tag matching some port
379(e.g. for a rpc reply) and unregister it after a message was received.
380
381 rcv $port, $otherport => sub {
382 my @reply = @_;
383
384 rcv $SELF, $otherport;
385 };
287 386
288=cut 387=cut
289 388
290sub rcv($@) { 389sub rcv($@) {
291 my $port = shift; 390 my $port = shift;
292 my ($noderef, $portid) = split /#/, $port, 2; 391 my ($noderef, $portid) = split /#/, $port, 2;
293 392
294 ($NODE{$noderef} || add_node $noderef) == $NODE{""} 393 ($NODE{$noderef} || add_node $noderef) == $NODE{""}
295 or Carp::croak "$port: rcv can only be called on local ports, caught"; 394 or Carp::croak "$port: rcv can only be called on local ports, caught";
296 395
297 if (@_ == 1) { 396 while (@_) {
397 if (ref $_[0]) {
398 if (my $self = $PORT_DATA{$portid}) {
399 "AnyEvent::MP::Port" eq ref $self
400 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
401
402 $self->[2] = shift;
403 } else {
298 my $cb = shift; 404 my $cb = shift;
299 delete $PORT_DATA{$portid};
300 $PORT{$portid} = sub { 405 $PORT{$portid} = sub {
301 local $SELF = $port; 406 local $SELF = $port;
302 eval { 407 eval { &$cb }; _self_die if $@;
303 &$cb 408 };
304 and kil $port;
305 }; 409 }
306 _self_die if $@; 410 } elsif (defined $_[0]) {
307 };
308 } else {
309 my $self = $PORT_DATA{$portid} ||= do { 411 my $self = $PORT_DATA{$portid} ||= do {
310 my $self = bless { 412 my $self = bless [$PORT{$port} || sub { }, { }, $port], "AnyEvent::MP::Port";
311 id => $port,
312 }, "AnyEvent::MP::Port";
313 413
314 $PORT{$portid} = sub { 414 $PORT{$portid} = sub {
315 local $SELF = $port; 415 local $SELF = $port;
316 416
317 eval {
318 for (@{ $self->{rc0}{$_[0]} }) { 417 if (my $cb = $self->[1]{$_[0]}) {
319 $_ && &{$_->[0]} 418 shift;
320 && undef $_; 419 eval { &$cb }; _self_die if $@;
321 } 420 } else {
322
323 for (@{ $self->{rcv}{$_[0]} }) {
324 $_ && [@_[1 .. @{$_->[1]}]] ~~ $_->[1]
325 && &{$_->[0]} 421 &{ $self->[0] };
326 && undef $_;
327 }
328
329 for (@{ $self->{any} }) {
330 $_ && [@_[0 .. $#{$_->[1]}]] ~~ $_->[1]
331 && &{$_->[0]}
332 && undef $_;
333 } 422 }
334 }; 423 };
335 _self_die if $@; 424
425 $self
336 }; 426 };
337 427
338 $self
339 };
340
341 "AnyEvent::MP::Port" eq ref $self 428 "AnyEvent::MP::Port" eq ref $self
342 or Carp::croak "$port: rcv can only be called on message matching ports, caught"; 429 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
343 430
344 while (@_) {
345 my ($match, $cb) = splice @_, 0, 2; 431 my ($tag, $cb) = splice @_, 0, 2;
346 432
347 if (!ref $match) { 433 if (defined $cb) {
348 push @{ $self->{rc0}{$match} }, [$cb]; 434 $self->[1]{$tag} = $cb;
349 } elsif (("ARRAY" eq ref $match && !ref $match->[0])) {
350 my ($type, @match) = @$match;
351 @match
352 ? push @{ $self->{rcv}{$match->[0]} }, [$cb, \@match]
353 : push @{ $self->{rc0}{$match->[0]} }, [$cb];
354 } else { 435 } else {
355 push @{ $self->{any} }, [$cb, $match]; 436 delete $self->[1]{$tag};
356 } 437 }
357 } 438 }
358 } 439 }
359 440
360 $port 441 $port
398 } 479 }
399} 480}
400 481
401=item $guard = mon $port, $cb->(@reason) 482=item $guard = mon $port, $cb->(@reason)
402 483
403=item $guard = mon $port, $otherport 484=item $guard = mon $port, $rcvport
404 485
486=item $guard = mon $port
487
405=item $guard = mon $port, $otherport, @msg 488=item $guard = mon $port, $rcvport, @msg
406 489
407Monitor the given port and do something when the port is killed. 490Monitor the given port and do something when the port is killed or
491messages to it were lost, and optionally return a guard that can be used
492to stop monitoring again.
408 493
494C<mon> effectively guarantees that, in the absence of hardware failures,
495that after starting the monitor, either all messages sent to the port
496will arrive, or the monitoring action will be invoked after possible
497message loss has been detected. No messages will be lost "in between"
498(after the first lost message no further messages will be received by the
499port). After the monitoring action was invoked, further messages might get
500delivered again.
501
409In the first form, the callback is simply called with any number 502In the first form (callback), the callback is simply called with any
410of C<@reason> elements (no @reason means that the port was deleted 503number of C<@reason> elements (no @reason means that the port was deleted
411"normally"). Note also that I<< the callback B<must> never die >>, so use 504"normally"). Note also that I<< the callback B<must> never die >>, so use
412C<eval> if unsure. 505C<eval> if unsure.
413 506
414In the second form, the other port will be C<kil>'ed with C<@reason>, iff 507In the second form (another port given), the other port (C<$rcvport>)
415a @reason was specified, i.e. on "normal" kils nothing happens, while 508will be C<kil>'ed with C<@reason>, iff a @reason was specified, i.e. on
416under all other conditions, the other port is killed with the same reason. 509"normal" kils nothing happens, while under all other conditions, the other
510port is killed with the same reason.
417 511
512The third form (kill self) is the same as the second form, except that
513C<$rvport> defaults to C<$SELF>.
514
418In the last form, a message of the form C<@msg, @reason> will be C<snd>. 515In the last form (message), a message of the form C<@msg, @reason> will be
516C<snd>.
517
518As a rule of thumb, monitoring requests should always monitor a port from
519a local port (or callback). The reason is that kill messages might get
520lost, just like any other message. Another less obvious reason is that
521even monitoring requests can get lost (for exmaple, when the connection
522to the other node goes down permanently). When monitoring a port locally
523these problems do not exist.
419 524
420Example: call a given callback when C<$port> is killed. 525Example: call a given callback when C<$port> is killed.
421 526
422 mon $port, sub { warn "port died because of <@_>\n" }; 527 mon $port, sub { warn "port died because of <@_>\n" };
423 528
424Example: kill ourselves when C<$port> is killed abnormally. 529Example: kill ourselves when C<$port> is killed abnormally.
425 530
426 mon $port, $self; 531 mon $port;
427 532
428Example: send us a restart message another C<$port> is killed. 533Example: send us a restart message when another C<$port> is killed.
429 534
430 mon $port, $self => "restart"; 535 mon $port, $self => "restart";
431 536
432=cut 537=cut
433 538
434sub mon { 539sub mon {
435 my ($noderef, $port) = split /#/, shift, 2; 540 my ($noderef, $port) = split /#/, shift, 2;
436 541
437 my $node = $NODE{$noderef} || add_node $noderef; 542 my $node = $NODE{$noderef} || add_node $noderef;
438 543
439 my $cb = shift; 544 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,';
440 545
441 unless (ref $cb) { 546 unless (ref $cb) {
442 if (@_) { 547 if (@_) {
443 # send a kill info message 548 # send a kill info message
444 my (@msg) = ($cb, @_); 549 my (@msg) = ($cb, @_);
475=cut 580=cut
476 581
477sub mon_guard { 582sub mon_guard {
478 my ($port, @refs) = @_; 583 my ($port, @refs) = @_;
479 584
585 #TODO: mon-less form?
586
480 mon $port, sub { 0 && @refs } 587 mon $port, sub { 0 && @refs }
481} 588}
482 589
483=item lnk $port1, $port2
484
485Link two ports. This is simply a shorthand for:
486
487 mon $port1, $port2;
488 mon $port2, $port1;
489
490It means that if either one is killed abnormally, the other one gets
491killed as well.
492
493=item kil $port[, @reason] 590=item kil $port[, @reason]
494 591
495Kill the specified port with the given C<@reason>. 592Kill the specified port with the given C<@reason>.
496 593
497If no C<@reason> is specified, then the port is killed "normally" (linked 594If no C<@reason> is specified, then the port is killed "normally" (linked
504will be reported as reason C<< die => $@ >>. 601will be reported as reason C<< die => $@ >>.
505 602
506Transport/communication errors are reported as C<< transport_error => 603Transport/communication errors are reported as C<< transport_error =>
507$message >>. 604$message >>.
508 605
509=back
510
511=head1 FUNCTIONS FOR NODES
512
513=over 4
514
515=item initialise_node $noderef, $seednode, $seednode...
516
517=item initialise_node "slave/", $master, $master...
518
519Initialises a node - must be called exactly once before calling other
520AnyEvent::MP functions when talking to other nodes is required.
521
522All arguments are noderefs, which can be either resolved or unresolved.
523
524There are two types of networked nodes, public nodes and slave nodes:
525
526=over 4
527
528=item public nodes
529
530For public nodes, C<$noderef> must either be a (possibly unresolved)
531noderef, in which case it will be resolved, or C<undef> (or missing), in
532which case the noderef will be guessed.
533
534Afterwards, the node will bind itself on all endpoints and try to connect
535to all additional C<$seednodes> that are specified. Seednodes are optional
536and can be used to quickly bootstrap the node into an existing network.
537
538=item slave nodes
539
540When the C<$noderef> is the special string C<slave/>, then the node will
541become a slave node. Slave nodes cannot be contacted from outside and will
542route most of their traffic to the master node that they attach to.
543
544At least one additional noderef is required: The node will try to connect
545to all of them and will become a slave attached to the first node it can
546successfully connect to.
547
548=back
549
550This function will block until all nodes have been resolved and, for slave
551nodes, until it has successfully established a connection to a master
552server.
553
554Example: become a public node listening on the default node.
555
556 initialise_node;
557
558Example: become a public node, and try to contact some well-known master
559servers to become part of the network.
560
561 initialise_node undef, "master1", "master2";
562
563Example: become a public node listening on port C<4041>.
564
565 initialise_node 4041;
566
567Example: become a public node, only visible on localhost port 4044.
568
569 initialise_node "locahost:4044";
570
571Example: become a slave node to any of the specified master servers.
572
573 initialise_node "slave/", "master1", "192.168.13.17", "mp.example.net";
574
575=cut 606=cut
607
608=item $port = spawn $node, $initfunc[, @initdata]
609
610Creates a port on the node C<$node> (which can also be a port ID, in which
611case it's the node where that port resides).
612
613The port ID of the newly created port is return immediately, and it is
614permissible to immediately start sending messages or monitor the port.
615
616After the port has been created, the init function is
617called. This function must be a fully-qualified function name
618(e.g. C<MyApp::Chat::Server::init>). To specify a function in the main
619program, use C<::name>.
620
621If the function doesn't exist, then the node tries to C<require>
622the package, then the package above the package and so on (e.g.
623C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function
624exists or it runs out of package names.
625
626The init function is then called with the newly-created port as context
627object (C<$SELF>) and the C<@initdata> values as arguments.
628
629A common idiom is to pass your own port, monitor the spawned port, and
630in the init function, monitor the original port. This two-way monitoring
631ensures that both ports get cleaned up when there is a problem.
632
633Example: spawn a chat server port on C<$othernode>.
634
635 # this node, executed from within a port context:
636 my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF;
637 mon $server;
638
639 # init function on C<$othernode>
640 sub connect {
641 my ($srcport) = @_;
642
643 mon $srcport;
644
645 rcv $SELF, sub {
646 ...
647 };
648 }
649
650=cut
651
652sub _spawn {
653 my $port = shift;
654 my $init = shift;
655
656 local $SELF = "$NODE#$port";
657 eval {
658 &{ load_func $init }
659 };
660 _self_die if $@;
661}
662
663sub spawn(@) {
664 my ($noderef, undef) = split /#/, shift, 2;
665
666 my $id = "$RUNIQ." . $ID++;
667
668 $_[0] =~ /::/
669 or Carp::croak "spawn init function must be a fully-qualified name, caught";
670
671 snd_to_func $noderef, "AnyEvent::MP::_spawn" => $id, @_;
672
673 "$noderef#$id"
674}
576 675
577=back 676=back
578 677
579=head1 NODE MESSAGES 678=head1 NODE MESSAGES
580 679
622 721
623=back 722=back
624 723
625=head1 AnyEvent::MP vs. Distributed Erlang 724=head1 AnyEvent::MP vs. Distributed Erlang
626 725
627AnyEvent::MP got lots of its ideas from distributed erlang (erlang node 726AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node
628== aemp node, erlang process == aemp port), so many of the documents and 727== aemp node, Erlang process == aemp port), so many of the documents and
629programming techniques employed by erlang apply to AnyEvent::MP. Here is a 728programming techniques employed by Erlang apply to AnyEvent::MP. Here is a
630sample: 729sample:
631 730
632 http://www.erlang.se/doc/programming_rules.shtml 731 http://www.Erlang.se/doc/programming_rules.shtml
633 http://erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4 732 http://Erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4
634 http://erlang.org/download/erlang-book-part1.pdf # chapters 5 and 6 733 http://Erlang.org/download/Erlang-book-part1.pdf # chapters 5 and 6
635 http://erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5 734 http://Erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5
636 735
637Despite the similarities, there are also some important differences: 736Despite the similarities, there are also some important differences:
638 737
639=over 4 738=over 4
640 739
645convenience functionality. 744convenience functionality.
646 745
647This means that AEMP requires a less tightly controlled environment at the 746This means that AEMP requires a less tightly controlled environment at the
648cost of longer node references and a slightly higher management overhead. 747cost of longer node references and a slightly higher management overhead.
649 748
749=item * Erlang has a "remote ports are like local ports" philosophy, AEMP
750uses "local ports are like remote ports".
751
752The failure modes for local ports are quite different (runtime errors
753only) then for remote ports - when a local port dies, you I<know> it dies,
754when a connection to another node dies, you know nothing about the other
755port.
756
757Erlang pretends remote ports are as reliable as local ports, even when
758they are not.
759
760AEMP encourages a "treat remote ports differently" philosophy, with local
761ports being the special case/exception, where transport errors cannot
762occur.
763
650=item * Erlang uses processes and a mailbox, AEMP does not queue. 764=item * Erlang uses processes and a mailbox, AEMP does not queue.
651 765
652Erlang uses processes that selctively receive messages, and therefore 766Erlang uses processes that selectively receive messages, and therefore
653needs a queue. AEMP is event based, queuing messages would serve no useful 767needs a queue. AEMP is event based, queuing messages would serve no
654purpose. 768useful purpose. For the same reason the pattern-matching abilities of
769AnyEvent::MP are more limited, as there is little need to be able to
770filter messages without dequeing them.
655 771
656(But see L<Coro::MP> for a more erlang-like process model on top of AEMP). 772(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP).
657 773
658=item * Erlang sends are synchronous, AEMP sends are asynchronous. 774=item * Erlang sends are synchronous, AEMP sends are asynchronous.
659 775
660Sending messages in erlang is synchronous and blocks the process. AEMP 776Sending messages in Erlang is synchronous and blocks the process (and
661sends are immediate, connection establishment is handled in the 777so does not need a queue that can overflow). AEMP sends are immediate,
662background. 778connection establishment is handled in the background.
663 779
664=item * Erlang can silently lose messages, AEMP cannot. 780=item * Erlang suffers from silent message loss, AEMP does not.
665 781
666Erlang makes few guarantees on messages delivery - messages can get lost 782Erlang makes few guarantees on messages delivery - messages can get lost
667without any of the processes realising it (i.e. you send messages a, b, 783without any of the processes realising it (i.e. you send messages a, b,
668and c, and the other side only receives messages a and c). 784and c, and the other side only receives messages a and c).
669 785
670AEMP guarantees correct ordering, and the guarantee that there are no 786AEMP guarantees correct ordering, and the guarantee that there are no
671holes in the message sequence. 787holes in the message sequence.
672 788
673=item * In erlang, processes can be declared dead and later be found to be 789=item * In Erlang, processes can be declared dead and later be found to be
674alive. 790alive.
675 791
676In erlang it can happen that a monitored process is declared dead and 792In Erlang it can happen that a monitored process is declared dead and
677linked processes get killed, but later it turns out that the process is 793linked processes get killed, but later it turns out that the process is
678still alive - and can receive messages. 794still alive - and can receive messages.
679 795
680In AEMP, when port monitoring detects a port as dead, then that port will 796In AEMP, when port monitoring detects a port as dead, then that port will
681eventually be killed - it cannot happen that a node detects a port as dead 797eventually be killed - it cannot happen that a node detects a port as dead
682and then later sends messages to it, finding it is still alive. 798and then later sends messages to it, finding it is still alive.
683 799
684=item * Erlang can send messages to the wrong port, AEMP does not. 800=item * Erlang can send messages to the wrong port, AEMP does not.
685 801
686In erlang it is quite possible that a node that restarts reuses a process 802In Erlang it is quite likely that a node that restarts reuses a process ID
687ID known to other nodes for a completely different process, causing 803known to other nodes for a completely different process, causing messages
688messages destined for that process to end up in an unrelated process. 804destined for that process to end up in an unrelated process.
689 805
690AEMP never reuses port IDs, so old messages or old port IDs floating 806AEMP never reuses port IDs, so old messages or old port IDs floating
691around in the network will not be sent to an unrelated port. 807around in the network will not be sent to an unrelated port.
692 808
693=item * Erlang uses unprotected connections, AEMP uses secure 809=item * Erlang uses unprotected connections, AEMP uses secure
697securely authenticate nodes. 813securely authenticate nodes.
698 814
699=item * The AEMP protocol is optimised for both text-based and binary 815=item * The AEMP protocol is optimised for both text-based and binary
700communications. 816communications.
701 817
702The AEMP protocol, unlike the erlang protocol, supports both 818The AEMP protocol, unlike the Erlang protocol, supports both
703language-independent text-only protocols (good for debugging) and binary, 819language-independent text-only protocols (good for debugging) and binary,
704language-specific serialisers (e.g. Storable). 820language-specific serialisers (e.g. Storable).
705 821
706It has also been carefully designed to be implementable in other languages 822It has also been carefully designed to be implementable in other languages
707with a minimum of work while gracefully degrading fucntionality to make the 823with a minimum of work while gracefully degrading fucntionality to make the
708protocol simple. 824protocol simple.
709 825
826=item * AEMP has more flexible monitoring options than Erlang.
827
828In Erlang, you can chose to receive I<all> exit signals as messages
829or I<none>, there is no in-between, so monitoring single processes is
830difficult to implement. Monitoring in AEMP is more flexible than in
831Erlang, as one can choose between automatic kill, exit message or callback
832on a per-process basis.
833
834=item * Erlang tries to hide remote/local connections, AEMP does not.
835
836Monitoring in Erlang is not an indicator of process death/crashes,
837as linking is (except linking is unreliable in Erlang).
838
839In AEMP, you don't "look up" registered port names or send to named ports
840that might or might not be persistent. Instead, you normally spawn a port
841on the remote node. The init function monitors the you, and you monitor
842the remote port. Since both monitors are local to the node, they are much
843more reliable.
844
845This also saves round-trips and avoids sending messages to the wrong port
846(hard to do in Erlang).
847
848=back
849
850=head1 RATIONALE
851
852=over 4
853
854=item Why strings for ports and noderefs, why not objects?
855
856We considered "objects", but found that the actual number of methods
857thatc an be called are very low. Since port IDs and noderefs travel over
858the network frequently, the serialising/deserialising would add lots of
859overhead, as well as having to keep a proxy object.
860
861Strings can easily be printed, easily serialised etc. and need no special
862procedures to be "valid".
863
864And a a miniport consists of a single closure stored in a global hash - it
865can't become much cheaper.
866
867=item Why favour JSON, why not real serialising format such as Storable?
868
869In fact, any AnyEvent::MP node will happily accept Storable as framing
870format, but currently there is no way to make a node use Storable by
871default.
872
873The default framing protocol is JSON because a) JSON::XS is many times
874faster for small messages and b) most importantly, after years of
875experience we found that object serialisation is causing more problems
876than it gains: Just like function calls, objects simply do not travel
877easily over the network, mostly because they will always be a copy, so you
878always have to re-think your design.
879
880Keeping your messages simple, concentrating on data structures rather than
881objects, will keep your messages clean, tidy and efficient.
882
710=back 883=back
711 884
712=head1 SEE ALSO 885=head1 SEE ALSO
713 886
714L<AnyEvent>. 887L<AnyEvent>.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines