ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.36 by root, Thu Aug 6 10:46:48 2009 UTC vs.
Revision 1.63 by root, Thu Aug 27 21:29:37 2009 UTC

8 8
9 $NODE # contains this node's noderef 9 $NODE # contains this node's noderef
10 NODE # returns this node's noderef 10 NODE # returns this node's noderef
11 NODE $port # returns the noderef of the port 11 NODE $port # returns the noderef of the port
12 12
13 $SELF # receiving/own port id in rcv callbacks
14
15 # initialise the node so it can send/receive messages
16 initialise_node;
17
18 # ports are message endpoints
19
20 # sending messages
13 snd $port, type => data...; 21 snd $port, type => data...;
22 snd $port, @msg;
23 snd @msg_with_first_element_being_a_port;
14 24
15 $SELF # receiving/own port id in rcv callbacks 25 # creating/using ports, the simple way
26 my $simple_port = port { my @msg = @_; 0 };
16 27
17 rcv $port, smartmatch => $cb->($port, @msg); 28 # creating/using ports, tagged message matching
18 29 my $port = port;
19 # examples:
20 rcv $port2, ping => sub { snd $_[0], "pong"; 0 }; 30 rcv $port, ping => sub { snd $_[0], "pong"; 0 };
21 rcv $port1, pong => sub { warn "pong received\n" }; 31 rcv $port, pong => sub { warn "pong received\n"; 0 };
22 snd $port2, ping => $port1;
23 32
24 # more, smarter, matches (_any_ is exported by this module) 33 # create a port on another node
25 rcv $port, [child_died => $pid] => sub { ... 34 my $port = spawn $node, $initfunc, @initdata;
26 rcv $port, [_any_, _any_, 3] => sub { .. $_[2] is 3
27
28 # linking two ports, so they both crash together
29 lnk $port1, $port2;
30 35
31 # monitoring 36 # monitoring
32 mon $port, $cb->(@msg) # callback is invoked on death 37 mon $port, $cb->(@msg) # callback is invoked on death
33 mon $port, $otherport # kill otherport on abnormal death 38 mon $port, $otherport # kill otherport on abnormal death
34 mon $port, $otherport, @msg # send message on death 39 mon $port, $otherport, @msg # send message on death
35 40
41=head1 CURRENT STATUS
42
43 AnyEvent::MP - stable API, should work
44 AnyEvent::MP::Intro - outdated
45 AnyEvent::MP::Kernel - WIP
46 AnyEvent::MP::Transport - mostly stable
47
48 stay tuned.
49
36=head1 DESCRIPTION 50=head1 DESCRIPTION
37 51
38This module (-family) implements a simple message passing framework. 52This module (-family) implements a simple message passing framework.
39 53
40Despite its simplicity, you can securely message other processes running 54Despite its simplicity, you can securely message other processes running
43For an introduction to this module family, see the L<AnyEvent::MP::Intro> 57For an introduction to this module family, see the L<AnyEvent::MP::Intro>
44manual page. 58manual page.
45 59
46At the moment, this module family is severly broken and underdocumented, 60At the moment, this module family is severly broken and underdocumented,
47so do not use. This was uploaded mainly to reserve the CPAN namespace - 61so do not use. This was uploaded mainly to reserve the CPAN namespace -
48stay tuned! The basic API should be finished, however. 62stay tuned!
49 63
50=head1 CONCEPTS 64=head1 CONCEPTS
51 65
52=over 4 66=over 4
53 67
54=item port 68=item port
55 69
56A port is something you can send messages to (with the C<snd> function). 70A port is something you can send messages to (with the C<snd> function).
57 71
58Some ports allow you to register C<rcv> handlers that can match specific 72Ports allow you to register C<rcv> handlers that can match all or just
59messages. All C<rcv> handlers will receive messages they match, messages 73some messages. Messages will not be queued.
60will not be queued.
61 74
62=item port id - C<noderef#portname> 75=item port ID - C<noderef#portname>
63 76
64A port id is normaly the concatenation of a noderef, a hash-mark (C<#>) as 77A port ID is the concatenation of a noderef, a hash-mark (C<#>) as
65separator, and a port name (a printable string of unspecified format). An 78separator, and a port name (a printable string of unspecified format). An
66exception is the the node port, whose ID is identical to its node 79exception is the the node port, whose ID is identical to its node
67reference. 80reference.
68 81
69=item node 82=item node
70 83
71A node is a single process containing at least one port - the node 84A node is a single process containing at least one port - the node port,
72port. You can send messages to node ports to find existing ports or to 85which provides nodes to manage each other remotely, and to create new
73create new ports, among other things. 86ports.
74 87
75Nodes are either private (single-process only), slaves (connected to a 88Nodes are either private (single-process only), slaves (can only talk to
76master node only) or public nodes (connectable from unrelated nodes). 89public nodes, but do not need an open port) or public nodes (connectable
90from any other node).
77 91
78=item noderef - C<host:port,host:port...>, C<id@noderef>, C<id> 92=item node ID - C<[a-za-Z0-9_\-.:]+>
79 93
80A node reference is a string that either simply identifies the node (for 94A node ID is a string that either simply identifies the node (for
81private and slave nodes), or contains a recipe on how to reach a given 95private and slave nodes), or contains a recipe on how to reach a given
82node (for public nodes). 96node (for public nodes).
83 97
84This recipe is simply a comma-separated list of C<address:port> pairs (for 98This recipe is simply a comma-separated list of C<address:port> pairs (for
85TCP/IP, other protocols might look different). 99TCP/IP, other protocols might look different).
98 112
99=cut 113=cut
100 114
101package AnyEvent::MP; 115package AnyEvent::MP;
102 116
103use AnyEvent::MP::Base; 117use AnyEvent::MP::Kernel;
104 118
105use common::sense; 119use common::sense;
106 120
107use Carp (); 121use Carp ();
108 122
109use AE (); 123use AE ();
110 124
111use base "Exporter"; 125use base "Exporter";
112 126
113our $VERSION = '0.1'; 127our $VERSION = $AnyEvent::MP::Kernel::VERSION;
128
114our @EXPORT = qw( 129our @EXPORT = qw(
115 NODE $NODE *SELF node_of _any_ 130 NODE $NODE *SELF node_of after
116 resolve_node initialise_node 131 resolve_node initialise_node
117 snd rcv mon kil reg psub 132 snd rcv mon mon_guard kil reg psub spawn
118 port 133 port
119); 134);
120 135
121our $SELF; 136our $SELF;
122 137
126 kil $SELF, die => $msg; 141 kil $SELF, die => $msg;
127} 142}
128 143
129=item $thisnode = NODE / $NODE 144=item $thisnode = NODE / $NODE
130 145
131The C<NODE> function returns, and the C<$NODE> variable contains 146The C<NODE> function returns, and the C<$NODE> variable contains the
132the noderef of the local node. The value is initialised by a call 147node id of the local node. The value is initialised by a call to
133to C<become_public> or C<become_slave>, after which all local port 148C<initialise_node>.
134identifiers become invalid.
135 149
136=item $noderef = node_of $port 150=item $nodeid = node_of $port
137 151
138Extracts and returns the noderef from a portid or a noderef. 152Extracts and returns the noderef from a port ID or a node ID.
139 153
140=item initialise_node $noderef, $seednode, $seednode... 154=item initialise_node $profile_name
141
142=item initialise_node "slave/", $master, $master...
143 155
144Before a node can talk to other nodes on the network it has to initialise 156Before a node can talk to other nodes on the network it has to initialise
145itself - the minimum a node needs to know is it's own name, and optionally 157itself - the minimum a node needs to know is it's own name, and optionally
146it should know the noderefs of some other nodes in the network. 158it should know the noderefs of some other nodes in the network.
147 159
148This function initialises a node - it must be called exactly once (or 160This function initialises a node - it must be called exactly once (or
149never) before calling other AnyEvent::MP functions. 161never) before calling other AnyEvent::MP functions.
150 162
151All arguments are noderefs, which can be either resolved or unresolved. 163All arguments (optionally except for the first) are noderefs, which can be
164either resolved or unresolved.
165
166The first argument will be looked up in the configuration database first
167(if it is C<undef> then the current nodename will be used instead) to find
168the relevant configuration profile (see L<aemp>). If none is found then
169the default configuration is used. The configuration supplies additional
170seed/master nodes and can override the actual noderef.
152 171
153There are two types of networked nodes, public nodes and slave nodes: 172There are two types of networked nodes, public nodes and slave nodes:
154 173
155=over 4 174=over 4
156 175
157=item public nodes 176=item public nodes
158 177
159For public nodes, C<$noderef> must either be a (possibly unresolved) 178For public nodes, C<$noderef> (supplied either directly to
160noderef, in which case it will be resolved, or C<undef> (or missing), in 179C<initialise_node> or indirectly via a profile or the nodename) must be a
161which case the noderef will be guessed. 180noderef (possibly unresolved, in which case it will be resolved).
162 181
163Afterwards, the node will bind itself on all endpoints and try to connect 182After resolving, the node will bind itself on all endpoints.
164to all additional C<$seednodes> that are specified. Seednodes are optional
165and can be used to quickly bootstrap the node into an existing network.
166 183
167=item slave nodes 184=item slave nodes
168 185
169When the C<$noderef> is the special string C<slave/>, then the node will 186When the C<$noderef> (either as given or overriden by the config file)
187is the special string C<slave/>, then the node will become a slave
170become a slave node. Slave nodes cannot be contacted from outside and will 188node. Slave nodes cannot be contacted from outside, and cannot talk to
171route most of their traffic to the master node that they attach to. 189each other (at least in this version of AnyEvent::MP).
172 190
173At least one additional noderef is required: The node will try to connect 191Slave nodes work by creating connections to all public nodes, using the
174to all of them and will become a slave attached to the first node it can 192L<AnyEvent::MP::Global> service.
175successfully connect to.
176 193
177=back 194=back
178 195
179This function will block until all nodes have been resolved and, for slave 196After initialising itself, the node will connect to all additional
180nodes, until it has successfully established a connection to a master 197C<$seednodes> that are specified diretcly or via a profile. Seednodes are
181server. 198optional and can be used to quickly bootstrap the node into an existing
199network.
182 200
201All the seednodes will also be specially marked to automatically retry
202connecting to them indefinitely, so make sure that seednodes are really
203reliable and up (this might also change in the future).
204
183Example: become a public node listening on the default node. 205Example: become a public node listening on the guessed noderef, or the one
206specified via C<aemp> for the current node. This should be the most common
207form of invocation for "daemon"-type nodes.
184 208
185 initialise_node; 209 initialise_node;
210
211Example: become a slave node to any of the the seednodes specified via
212C<aemp>. This form is often used for commandline clients.
213
214 initialise_node "slave/";
186 215
187Example: become a public node, and try to contact some well-known master 216Example: become a public node, and try to contact some well-known master
188servers to become part of the network. 217servers to become part of the network.
189 218
190 initialise_node undef, "master1", "master2"; 219 initialise_node undef, "master1", "master2";
193 222
194 initialise_node 4041; 223 initialise_node 4041;
195 224
196Example: become a public node, only visible on localhost port 4044. 225Example: become a public node, only visible on localhost port 4044.
197 226
198 initialise_node "locahost:4044"; 227 initialise_node "localhost:4044";
199
200Example: become a slave node to any of the specified master servers.
201
202 initialise_node "slave/", "master1", "192.168.13.17", "mp.example.net";
203 228
204=item $cv = resolve_node $noderef 229=item $cv = resolve_node $noderef
205 230
206Takes an unresolved node reference that may contain hostnames and 231Takes an unresolved node reference that may contain hostnames and
207abbreviated IDs, resolves all of them and returns a resolved node 232abbreviated IDs, resolves all of them and returns a resolved node
244=item snd $port, type => @data 269=item snd $port, type => @data
245 270
246=item snd $port, @msg 271=item snd $port, @msg
247 272
248Send the given message to the given port ID, which can identify either 273Send the given message to the given port ID, which can identify either
249a local or a remote port, and can be either a string or soemthignt hat 274a local or a remote port, and must be a port ID.
250stringifies a sa port ID (such as a port object :).
251 275
252While the message can be about anything, it is highly recommended to use a 276While the message can be about anything, it is highly recommended to use a
253string as first element (a portid, or some word that indicates a request 277string as first element (a port ID, or some word that indicates a request
254type etc.). 278type etc.).
255 279
256The message data effectively becomes read-only after a call to this 280The message data effectively becomes read-only after a call to this
257function: modifying any argument is not allowed and can cause many 281function: modifying any argument is not allowed and can cause many
258problems. 282problems.
263that Storable can serialise and deserialise is allowed, and for the local 287that Storable can serialise and deserialise is allowed, and for the local
264node, anything can be passed. 288node, anything can be passed.
265 289
266=item $local_port = port 290=item $local_port = port
267 291
268Create a new local port object that can be used either as a pattern 292Create a new local port object and returns its port ID. Initially it has
269matching port ("full port") or a single-callback port ("miniport"), 293no callbacks set and will throw an error when it receives messages.
270depending on how C<rcv> callbacks are bound to the object.
271 294
272=item $port = port { my @msg = @_; $finished } 295=item $local_port = port { my @msg = @_ }
273 296
274Creates a "miniport", that is, a very lightweight port without any pattern 297Creates a new local port, and returns its ID. Semantically the same as
275matching behind it, and returns its ID. Semantically the same as creating
276a port and calling C<rcv $port, $callback> on it. 298creating a port and calling C<rcv $port, $callback> on it.
277 299
278The block will be called for every message received on the port. When the 300The block will be called for every message received on the port, with the
279callback returns a true value its job is considered "done" and the port 301global variable C<$SELF> set to the port ID. Runtime errors will cause the
280will be destroyed. Otherwise it will stay alive. 302port to be C<kil>ed. The message will be passed as-is, no extra argument
303(i.e. no port ID) will be passed to the callback.
281 304
282The message will be passed as-is, no extra argument (i.e. no port id) will 305If you want to stop/destroy the port, simply C<kil> it:
283be passed to the callback.
284 306
285If you need the local port id in the callback, this works nicely: 307 my $port = port {
286 308 my @msg = @_;
287 my $port; $port = port { 309 ...
288 snd $otherport, reply => $port; 310 kil $SELF;
289 }; 311 };
290 312
291=cut 313=cut
292 314
293sub rcv($@); 315sub rcv($@);
316
317sub _kilme {
318 die "received message on port without callback";
319}
294 320
295sub port(;&) { 321sub port(;&) {
296 my $id = "$UNIQ." . $ID++; 322 my $id = "$UNIQ." . $ID++;
297 my $port = "$NODE#$id"; 323 my $port = "$NODE#$id";
298 324
299 if (@_) { 325 rcv $port, shift || \&_kilme;
300 rcv $port, shift;
301 } else {
302 $PORT{$id} = sub { }; # nop
303 }
304 326
305 $port 327 $port
306} 328}
307 329
308=item reg $port, $name
309
310=item reg $name
311
312Registers the given port (or C<$SELF><<< if missing) under the name
313C<$name>. If the name already exists it is replaced.
314
315A port can only be registered under one well known name.
316
317A port automatically becomes unregistered when it is killed.
318
319=cut
320
321sub reg(@) {
322 my $port = @_ > 1 ? shift : $SELF || Carp::croak 'reg: called with one argument only, but $SELF not set,';
323
324 $REG{$_[0]} = $port;
325}
326
327=item rcv $port, $callback->(@msg) 330=item rcv $local_port, $callback->(@msg)
328 331
329Replaces the callback on the specified miniport (after converting it to 332Replaces the default callback on the specified port. There is no way to
330one if required). 333remove the default callback: use C<sub { }> to disable it, or better
331 334C<kil> the port when it is no longer needed.
332=item rcv $port, tagstring => $callback->(@msg), ...
333
334=item rcv $port, $smartmatch => $callback->(@msg), ...
335
336=item rcv $port, [$smartmatch...] => $callback->(@msg), ...
337
338Register callbacks to be called on matching messages on the given full
339port (after converting it to one if required) and return the port.
340
341The callback has to return a true value when its work is done, after
342which is will be removed, or a false value in which case it will stay
343registered.
344 335
345The global C<$SELF> (exported by this module) contains C<$port> while 336The global C<$SELF> (exported by this module) contains C<$port> while
346executing the callback. 337executing the callback. Runtime errors during callback execution will
338result in the port being C<kil>ed.
347 339
348Runtime errors wdurign callback execution will result in the port being 340The default callback received all messages not matched by a more specific
349C<kil>ed. 341C<tag> match.
350 342
351If the match is an array reference, then it will be matched against the 343=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
352first elements of the message, otherwise only the first element is being
353matched.
354 344
355Any element in the match that is specified as C<_any_> (a function 345Register (or replace) callbacks to be called on messages starting with the
356exported by this module) matches any single element of the message. 346given tag on the given port (and return the port), or unregister it (when
347C<$callback> is C<$undef> or missing). There can only be one callback
348registered for each tag.
357 349
358While not required, it is highly recommended that the first matching 350The original message will be passed to the callback, after the first
359element is a string identifying the message. The one-string-only match is 351element (the tag) has been removed. The callback will use the same
360also the most efficient match (by far). 352environment as the default callback (see above).
361 353
362Example: create a port and bind receivers on it in one go. 354Example: create a port and bind receivers on it in one go.
363 355
364 my $port = rcv port, 356 my $port = rcv port,
365 msg1 => sub { ...; 0 }, 357 msg1 => sub { ... },
366 msg2 => sub { ...; 0 }, 358 msg2 => sub { ... },
367 ; 359 ;
368 360
369Example: create a port, bind receivers and send it in a message elsewhere 361Example: create a port, bind receivers and send it in a message elsewhere
370in one go: 362in one go:
371 363
372 snd $otherport, reply => 364 snd $otherport, reply =>
373 rcv port, 365 rcv port,
374 msg1 => sub { ...; 0 }, 366 msg1 => sub { ... },
375 ... 367 ...
376 ; 368 ;
369
370Example: temporarily register a rcv callback for a tag matching some port
371(e.g. for a rpc reply) and unregister it after a message was received.
372
373 rcv $port, $otherport => sub {
374 my @reply = @_;
375
376 rcv $SELF, $otherport;
377 };
377 378
378=cut 379=cut
379 380
380sub rcv($@) { 381sub rcv($@) {
381 my $port = shift; 382 my $port = shift;
382 my ($noderef, $portid) = split /#/, $port, 2; 383 my ($noderef, $portid) = split /#/, $port, 2;
383 384
384 ($NODE{$noderef} || add_node $noderef) == $NODE{""} 385 $NODE{$noderef} == $NODE{""}
385 or Carp::croak "$port: rcv can only be called on local ports, caught"; 386 or Carp::croak "$port: rcv can only be called on local ports, caught";
386 387
387 if (@_ == 1) { 388 while (@_) {
389 if (ref $_[0]) {
390 if (my $self = $PORT_DATA{$portid}) {
391 "AnyEvent::MP::Port" eq ref $self
392 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
393
394 $self->[2] = shift;
395 } else {
388 my $cb = shift; 396 my $cb = shift;
389 delete $PORT_DATA{$portid};
390 $PORT{$portid} = sub { 397 $PORT{$portid} = sub {
391 local $SELF = $port; 398 local $SELF = $port;
392 eval { 399 eval { &$cb }; _self_die if $@;
393 &$cb 400 };
394 and kil $port;
395 }; 401 }
396 _self_die if $@; 402 } elsif (defined $_[0]) {
397 };
398 } else {
399 my $self = $PORT_DATA{$portid} ||= do { 403 my $self = $PORT_DATA{$portid} ||= do {
400 my $self = bless { 404 my $self = bless [$PORT{$port} || sub { }, { }, $port], "AnyEvent::MP::Port";
401 id => $port,
402 }, "AnyEvent::MP::Port";
403 405
404 $PORT{$portid} = sub { 406 $PORT{$portid} = sub {
405 local $SELF = $port; 407 local $SELF = $port;
406 408
407 eval {
408 for (@{ $self->{rc0}{$_[0]} }) { 409 if (my $cb = $self->[1]{$_[0]}) {
409 $_ && &{$_->[0]} 410 shift;
410 && undef $_; 411 eval { &$cb }; _self_die if $@;
411 } 412 } else {
412
413 for (@{ $self->{rcv}{$_[0]} }) {
414 $_ && [@_[1 .. @{$_->[1]}]] ~~ $_->[1]
415 && &{$_->[0]} 413 &{ $self->[0] };
416 && undef $_;
417 }
418
419 for (@{ $self->{any} }) {
420 $_ && [@_[0 .. $#{$_->[1]}]] ~~ $_->[1]
421 && &{$_->[0]}
422 && undef $_;
423 } 414 }
424 }; 415 };
425 _self_die if $@; 416
417 $self
426 }; 418 };
427 419
428 $self
429 };
430
431 "AnyEvent::MP::Port" eq ref $self 420 "AnyEvent::MP::Port" eq ref $self
432 or Carp::croak "$port: rcv can only be called on message matching ports, caught"; 421 or Carp::croak "$port: rcv can only be called on message matching ports, caught";
433 422
434 while (@_) {
435 my ($match, $cb) = splice @_, 0, 2; 423 my ($tag, $cb) = splice @_, 0, 2;
436 424
437 if (!ref $match) { 425 if (defined $cb) {
438 push @{ $self->{rc0}{$match} }, [$cb]; 426 $self->[1]{$tag} = $cb;
439 } elsif (("ARRAY" eq ref $match && !ref $match->[0])) {
440 my ($type, @match) = @$match;
441 @match
442 ? push @{ $self->{rcv}{$match->[0]} }, [$cb, \@match]
443 : push @{ $self->{rc0}{$match->[0]} }, [$cb];
444 } else { 427 } else {
445 push @{ $self->{any} }, [$cb, $match]; 428 delete $self->[1]{$tag};
446 } 429 }
447 } 430 }
448 } 431 }
449 432
450 $port 433 $port
494 477
495=item $guard = mon $port 478=item $guard = mon $port
496 479
497=item $guard = mon $port, $rcvport, @msg 480=item $guard = mon $port, $rcvport, @msg
498 481
499Monitor the given port and do something when the port is killed, and 482Monitor the given port and do something when the port is killed or
500optionally return a guard that can be used to stop monitoring again. 483messages to it were lost, and optionally return a guard that can be used
484to stop monitoring again.
485
486C<mon> effectively guarantees that, in the absence of hardware failures,
487that after starting the monitor, either all messages sent to the port
488will arrive, or the monitoring action will be invoked after possible
489message loss has been detected. No messages will be lost "in between"
490(after the first lost message no further messages will be received by the
491port). After the monitoring action was invoked, further messages might get
492delivered again.
493
494Note that monitoring-actions are one-shot: once released, they are removed
495and will not trigger again.
501 496
502In the first form (callback), the callback is simply called with any 497In the first form (callback), the callback is simply called with any
503number of C<@reason> elements (no @reason means that the port was deleted 498number of C<@reason> elements (no @reason means that the port was deleted
504"normally"). Note also that I<< the callback B<must> never die >>, so use 499"normally"). Note also that I<< the callback B<must> never die >>, so use
505C<eval> if unsure. 500C<eval> if unsure.
506 501
507In the second form (another port given), the other port (C<$rcvport) 502In the second form (another port given), the other port (C<$rcvport>)
508will be C<kil>'ed with C<@reason>, iff a @reason was specified, i.e. on 503will be C<kil>'ed with C<@reason>, iff a @reason was specified, i.e. on
509"normal" kils nothing happens, while under all other conditions, the other 504"normal" kils nothing happens, while under all other conditions, the other
510port is killed with the same reason. 505port is killed with the same reason.
511 506
512The third form (kill self) is the same as the second form, except that 507The third form (kill self) is the same as the second form, except that
513C<$rvport> defaults to C<$SELF>. 508C<$rvport> defaults to C<$SELF>.
514 509
515In the last form (message), a message of the form C<@msg, @reason> will be 510In the last form (message), a message of the form C<@msg, @reason> will be
516C<snd>. 511C<snd>.
517 512
513As a rule of thumb, monitoring requests should always monitor a port from
514a local port (or callback). The reason is that kill messages might get
515lost, just like any other message. Another less obvious reason is that
516even monitoring requests can get lost (for exmaple, when the connection
517to the other node goes down permanently). When monitoring a port locally
518these problems do not exist.
519
518Example: call a given callback when C<$port> is killed. 520Example: call a given callback when C<$port> is killed.
519 521
520 mon $port, sub { warn "port died because of <@_>\n" }; 522 mon $port, sub { warn "port died because of <@_>\n" };
521 523
522Example: kill ourselves when C<$port> is killed abnormally. 524Example: kill ourselves when C<$port> is killed abnormally.
532sub mon { 534sub mon {
533 my ($noderef, $port) = split /#/, shift, 2; 535 my ($noderef, $port) = split /#/, shift, 2;
534 536
535 my $node = $NODE{$noderef} || add_node $noderef; 537 my $node = $NODE{$noderef} || add_node $noderef;
536 538
537 my $cb = @_ ? $_[0] : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,'; 539 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,';
538 540
539 unless (ref $cb) { 541 unless (ref $cb) {
540 if (@_) { 542 if (@_) {
541 # send a kill info message 543 # send a kill info message
542 my (@msg) = @_; 544 my (@msg) = ($cb, @_);
543 $cb = sub { snd @msg, @_ }; 545 $cb = sub { snd @msg, @_ };
544 } else { 546 } else {
545 # simply kill other port 547 # simply kill other port
546 my $port = $cb; 548 my $port = $cb;
547 $cb = sub { kil $port, @_ if @_ }; 549 $cb = sub { kil $port, @_ if @_ };
578 #TODO: mon-less form? 580 #TODO: mon-less form?
579 581
580 mon $port, sub { 0 && @refs } 582 mon $port, sub { 0 && @refs }
581} 583}
582 584
583=item lnk $port1, $port2
584
585=item lnk $otherport
586
587Link two ports. This is simply a shorthand for:
588
589 mon $port1, $port2;
590 mon $port2, $port1;
591
592It means that if either one is killed abnormally, the other one gets
593killed as well.
594
595The one-argument form assumes that one port is C<$SELF>.
596
597=cut
598
599sub lnk {
600 my $port1 = shift;
601 my $port2 = @_ ? shift : $SELF || Carp::croak 'lnk: called with one argument only, but $SELF not set,';
602
603 mon $port1, $port2;
604 mon $port2, $port1;
605}
606
607=item kil $port[, @reason] 585=item kil $port[, @reason]
608 586
609Kill the specified port with the given C<@reason>. 587Kill the specified port with the given C<@reason>.
610 588
611If no C<@reason> is specified, then the port is killed "normally" (linked 589If no C<@reason> is specified, then the port is killed "normally" (linked
618will be reported as reason C<< die => $@ >>. 596will be reported as reason C<< die => $@ >>.
619 597
620Transport/communication errors are reported as C<< transport_error => 598Transport/communication errors are reported as C<< transport_error =>
621$message >>. 599$message >>.
622 600
623=back
624
625=head1 NODE MESSAGES
626
627Nodes understand the following messages sent to them. Many of them take
628arguments called C<@reply>, which will simply be used to compose a reply
629message - C<$reply[0]> is the port to reply to, C<$reply[1]> the type and
630the remaining arguments are simply the message data.
631
632While other messages exist, they are not public and subject to change.
633
634=over 4
635
636=cut 601=cut
637 602
638=item lookup => $name, @reply 603=item $port = spawn $node, $initfunc[, @initdata]
639 604
640Replies with the port ID of the specified well-known port, or C<undef>. 605Creates a port on the node C<$node> (which can also be a port ID, in which
606case it's the node where that port resides).
641 607
642=item devnull => ... 608The port ID of the newly created port is return immediately, and it is
609permissible to immediately start sending messages or monitor the port.
643 610
644Generic data sink/CPU heat conversion. 611After the port has been created, the init function is
612called. This function must be a fully-qualified function name
613(e.g. C<MyApp::Chat::Server::init>). To specify a function in the main
614program, use C<::name>.
645 615
646=item relay => $port, @msg 616If the function doesn't exist, then the node tries to C<require>
617the package, then the package above the package and so on (e.g.
618C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function
619exists or it runs out of package names.
647 620
648Simply forwards the message to the given port. 621The init function is then called with the newly-created port as context
622object (C<$SELF>) and the C<@initdata> values as arguments.
649 623
650=item eval => $string[ @reply] 624A common idiom is to pass your own port, monitor the spawned port, and
625in the init function, monitor the original port. This two-way monitoring
626ensures that both ports get cleaned up when there is a problem.
651 627
652Evaluates the given string. If C<@reply> is given, then a message of the 628Example: spawn a chat server port on C<$othernode>.
653form C<@reply, $@, @evalres> is sent.
654 629
655Example: crash another node. 630 # this node, executed from within a port context:
631 my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF;
632 mon $server;
656 633
657 snd $othernode, eval => "exit"; 634 # init function on C<$othernode>
635 sub connect {
636 my ($srcport) = @_;
658 637
659=item time => @reply 638 mon $srcport;
660 639
661Replies the the current node time to C<@reply>. 640 rcv $SELF, sub {
641 ...
642 };
643 }
662 644
663Example: tell the current node to send the current time to C<$myport> in a 645=cut
664C<timereply> message.
665 646
666 snd $NODE, time => $myport, timereply => 1, 2; 647sub _spawn {
667 # => snd $myport, timereply => 1, 2, <time> 648 my $port = shift;
649 my $init = shift;
650
651 local $SELF = "$NODE#$port";
652 eval {
653 &{ load_func $init }
654 };
655 _self_die if $@;
656}
657
658sub spawn(@) {
659 my ($noderef, undef) = split /#/, shift, 2;
660
661 my $id = "$RUNIQ." . $ID++;
662
663 $_[0] =~ /::/
664 or Carp::croak "spawn init function must be a fully-qualified name, caught";
665
666 snd_to_func $noderef, "AnyEvent::MP::_spawn" => $id, @_;
667
668 "$noderef#$id"
669}
670
671=item after $timeout, @msg
672
673=item after $timeout, $callback
674
675Either sends the given message, or call the given callback, after the
676specified number of seconds.
677
678This is simply a utility function that come sin handy at times.
679
680=cut
681
682sub after($@) {
683 my ($timeout, @action) = @_;
684
685 my $t; $t = AE::timer $timeout, 0, sub {
686 undef $t;
687 ref $action[0]
688 ? $action[0]()
689 : snd @action;
690 };
691}
668 692
669=back 693=back
670 694
671=head1 AnyEvent::MP vs. Distributed Erlang 695=head1 AnyEvent::MP vs. Distributed Erlang
672 696
691convenience functionality. 715convenience functionality.
692 716
693This means that AEMP requires a less tightly controlled environment at the 717This means that AEMP requires a less tightly controlled environment at the
694cost of longer node references and a slightly higher management overhead. 718cost of longer node references and a slightly higher management overhead.
695 719
720=item * Erlang has a "remote ports are like local ports" philosophy, AEMP
721uses "local ports are like remote ports".
722
723The failure modes for local ports are quite different (runtime errors
724only) then for remote ports - when a local port dies, you I<know> it dies,
725when a connection to another node dies, you know nothing about the other
726port.
727
728Erlang pretends remote ports are as reliable as local ports, even when
729they are not.
730
731AEMP encourages a "treat remote ports differently" philosophy, with local
732ports being the special case/exception, where transport errors cannot
733occur.
734
696=item * Erlang uses processes and a mailbox, AEMP does not queue. 735=item * Erlang uses processes and a mailbox, AEMP does not queue.
697 736
698Erlang uses processes that selctively receive messages, and therefore 737Erlang uses processes that selectively receive messages, and therefore
699needs a queue. AEMP is event based, queuing messages would serve no useful 738needs a queue. AEMP is event based, queuing messages would serve no
700purpose. 739useful purpose. For the same reason the pattern-matching abilities of
740AnyEvent::MP are more limited, as there is little need to be able to
741filter messages without dequeing them.
701 742
702(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP). 743(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP).
703 744
704=item * Erlang sends are synchronous, AEMP sends are asynchronous. 745=item * Erlang sends are synchronous, AEMP sends are asynchronous.
705 746
706Sending messages in Erlang is synchronous and blocks the process. AEMP 747Sending messages in Erlang is synchronous and blocks the process (and
707sends are immediate, connection establishment is handled in the 748so does not need a queue that can overflow). AEMP sends are immediate,
708background. 749connection establishment is handled in the background.
709 750
710=item * Erlang can silently lose messages, AEMP cannot. 751=item * Erlang suffers from silent message loss, AEMP does not.
711 752
712Erlang makes few guarantees on messages delivery - messages can get lost 753Erlang makes few guarantees on messages delivery - messages can get lost
713without any of the processes realising it (i.e. you send messages a, b, 754without any of the processes realising it (i.e. you send messages a, b,
714and c, and the other side only receives messages a and c). 755and c, and the other side only receives messages a and c).
715 756
727eventually be killed - it cannot happen that a node detects a port as dead 768eventually be killed - it cannot happen that a node detects a port as dead
728and then later sends messages to it, finding it is still alive. 769and then later sends messages to it, finding it is still alive.
729 770
730=item * Erlang can send messages to the wrong port, AEMP does not. 771=item * Erlang can send messages to the wrong port, AEMP does not.
731 772
732In Erlang it is quite possible that a node that restarts reuses a process 773In Erlang it is quite likely that a node that restarts reuses a process ID
733ID known to other nodes for a completely different process, causing 774known to other nodes for a completely different process, causing messages
734messages destined for that process to end up in an unrelated process. 775destined for that process to end up in an unrelated process.
735 776
736AEMP never reuses port IDs, so old messages or old port IDs floating 777AEMP never reuses port IDs, so old messages or old port IDs floating
737around in the network will not be sent to an unrelated port. 778around in the network will not be sent to an unrelated port.
738 779
739=item * Erlang uses unprotected connections, AEMP uses secure 780=item * Erlang uses unprotected connections, AEMP uses secure
759or I<none>, there is no in-between, so monitoring single processes is 800or I<none>, there is no in-between, so monitoring single processes is
760difficult to implement. Monitoring in AEMP is more flexible than in 801difficult to implement. Monitoring in AEMP is more flexible than in
761Erlang, as one can choose between automatic kill, exit message or callback 802Erlang, as one can choose between automatic kill, exit message or callback
762on a per-process basis. 803on a per-process basis.
763 804
764=item * Erlang has different semantics for monitoring and linking, AEMP has the same. 805=item * Erlang tries to hide remote/local connections, AEMP does not.
765 806
766Monitoring in Erlang is not an indicator of process death/crashes, 807Monitoring in Erlang is not an indicator of process death/crashes,
767as linking is (except linking is unreliable in Erlang). In AEMP, the 808as linking is (except linking is unreliable in Erlang).
768semantics of monitoring and linking are identical, linking is simply 809
769two-way monitoring with automatic kill. 810In AEMP, you don't "look up" registered port names or send to named ports
811that might or might not be persistent. Instead, you normally spawn a port
812on the remote node. The init function monitors the you, and you monitor
813the remote port. Since both monitors are local to the node, they are much
814more reliable.
815
816This also saves round-trips and avoids sending messages to the wrong port
817(hard to do in Erlang).
818
819=back
820
821=head1 RATIONALE
822
823=over 4
824
825=item Why strings for ports and noderefs, why not objects?
826
827We considered "objects", but found that the actual number of methods
828thatc an be called are very low. Since port IDs and noderefs travel over
829the network frequently, the serialising/deserialising would add lots of
830overhead, as well as having to keep a proxy object.
831
832Strings can easily be printed, easily serialised etc. and need no special
833procedures to be "valid".
834
835And a a miniport consists of a single closure stored in a global hash - it
836can't become much cheaper.
837
838=item Why favour JSON, why not real serialising format such as Storable?
839
840In fact, any AnyEvent::MP node will happily accept Storable as framing
841format, but currently there is no way to make a node use Storable by
842default.
843
844The default framing protocol is JSON because a) JSON::XS is many times
845faster for small messages and b) most importantly, after years of
846experience we found that object serialisation is causing more problems
847than it gains: Just like function calls, objects simply do not travel
848easily over the network, mostly because they will always be a copy, so you
849always have to re-think your design.
850
851Keeping your messages simple, concentrating on data structures rather than
852objects, will keep your messages clean, tidy and efficient.
770 853
771=back 854=back
772 855
773=head1 SEE ALSO 856=head1 SEE ALSO
774 857

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines