ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.65 by root, Fri Aug 28 01:00:34 2009 UTC vs.
Revision 1.86 by root, Wed Sep 9 01:47:01 2009 UTC

4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 use AnyEvent::MP; 7 use AnyEvent::MP;
8 8
9 $NODE # contains this node's noderef 9 $NODE # contains this node's node ID
10 NODE # returns this node's noderef 10 NODE # returns this node's node ID
11 NODE $port # returns the noderef of the port
12 11
13 $SELF # receiving/own port id in rcv callbacks 12 $SELF # receiving/own port id in rcv callbacks
14 13
15 # initialise the node so it can send/receive messages 14 # initialise the node so it can send/receive messages
16 initialise_node; 15 configure;
17 16
18 # ports are message endpoints 17 # ports are message destinations
19 18
20 # sending messages 19 # sending messages
21 snd $port, type => data...; 20 snd $port, type => data...;
22 snd $port, @msg; 21 snd $port, @msg;
23 snd @msg_with_first_element_being_a_port; 22 snd @msg_with_first_element_being_a_port;
24 23
25 # creating/using ports, the simple way 24 # creating/using ports, the simple way
26 my $simple_port = port { my @msg = @_; 0 }; 25 my $simple_port = port { my @msg = @_ };
27 26
28 # creating/using ports, tagged message matching 27 # creating/using ports, tagged message matching
29 my $port = port; 28 my $port = port;
30 rcv $port, ping => sub { snd $_[0], "pong"; 0 }; 29 rcv $port, ping => sub { snd $_[0], "pong" };
31 rcv $port, pong => sub { warn "pong received\n"; 0 }; 30 rcv $port, pong => sub { warn "pong received\n" };
32 31
33 # create a port on another node 32 # create a port on another node
34 my $port = spawn $node, $initfunc, @initdata; 33 my $port = spawn $node, $initfunc, @initdata;
35 34
36 # monitoring 35 # monitoring
38 mon $port, $otherport # kill otherport on abnormal death 37 mon $port, $otherport # kill otherport on abnormal death
39 mon $port, $otherport, @msg # send message on death 38 mon $port, $otherport, @msg # send message on death
40 39
41=head1 CURRENT STATUS 40=head1 CURRENT STATUS
42 41
42 bin/aemp - stable.
43 AnyEvent::MP - stable API, should work 43 AnyEvent::MP - stable API, should work.
44 AnyEvent::MP::Intro - outdated 44 AnyEvent::MP::Intro - explains most concepts.
45 AnyEvent::MP::Kernel - WIP
46 AnyEvent::MP::Transport - mostly stable 45 AnyEvent::MP::Kernel - mostly stable.
46 AnyEvent::MP::Global - stable but incomplete, protocol not yet final.
47 47
48 stay tuned. 48stay tuned.
49 49
50=head1 DESCRIPTION 50=head1 DESCRIPTION
51 51
52This module (-family) implements a simple message passing framework. 52This module (-family) implements a simple message passing framework.
53 53
54Despite its simplicity, you can securely message other processes running 54Despite its simplicity, you can securely message other processes running
55on the same or other hosts. 55on the same or other hosts, and you can supervise entities remotely.
56 56
57For an introduction to this module family, see the L<AnyEvent::MP::Intro> 57For an introduction to this module family, see the L<AnyEvent::MP::Intro>
58manual page. 58manual page and the examples under F<eg/>.
59
60At the moment, this module family is severly broken and underdocumented,
61so do not use. This was uploaded mainly to reserve the CPAN namespace -
62stay tuned!
63 59
64=head1 CONCEPTS 60=head1 CONCEPTS
65 61
66=over 4 62=over 4
67 63
68=item port 64=item port
69 65
70A port is something you can send messages to (with the C<snd> function). 66Not to be confused with a TCP port, a "port" is something you can send
67messages to (with the C<snd> function).
71 68
72Ports allow you to register C<rcv> handlers that can match all or just 69Ports allow you to register C<rcv> handlers that can match all or just
73some messages. Messages send to ports will not be queued, regardless of 70some messages. Messages send to ports will not be queued, regardless of
74anything was listening for them or not. 71anything was listening for them or not.
75 72
76=item port ID - C<noderef#portname> 73=item port ID - C<nodeid#portname>
77 74
78A port ID is the concatenation of a noderef, a hash-mark (C<#>) as 75A port ID is the concatenation of a node ID, a hash-mark (C<#>) as
79separator, and a port name (a printable string of unspecified format). An 76separator, and a port name (a printable string of unspecified format).
80exception is the the node port, whose ID is identical to its node
81reference.
82 77
83=item node 78=item node
84 79
85A node is a single process containing at least one port - the node port, 80A node is a single process containing at least one port - the node port,
86which provides nodes to manage each other remotely, and to create new 81which enables nodes to manage each other remotely, and to create new
87ports. 82ports.
88 83
89Nodes are either private (single-process only), slaves (can only talk to 84Nodes are either public (have one or more listening ports) or private
90public nodes, but do not need an open port) or public nodes (connectable 85(no listening ports). Private nodes cannot talk to other private nodes
91from any other node). 86currently.
92 87
93=item node ID - C<[a-za-Z0-9_\-.:]+> 88=item node ID - C<[A-Z_][a-zA-Z0-9_\-.:]*>
94 89
95A node ID is a string that uniquely identifies the node within a 90A node ID is a string that uniquely identifies the node within a
96network. Depending on the configuration used, node IDs can look like a 91network. Depending on the configuration used, node IDs can look like a
97hostname, a hostname and a port, or a random string. AnyEvent::MP itself 92hostname, a hostname and a port, or a random string. AnyEvent::MP itself
98doesn't interpret node IDs in any way. 93doesn't interpret node IDs in any way.
102Nodes can only talk to each other by creating some kind of connection to 97Nodes can only talk to each other by creating some kind of connection to
103each other. To do this, nodes should listen on one or more local transport 98each other. To do this, nodes should listen on one or more local transport
104endpoints - binds. Currently, only standard C<ip:port> specifications can 99endpoints - binds. Currently, only standard C<ip:port> specifications can
105be used, which specify TCP ports to listen on. 100be used, which specify TCP ports to listen on.
106 101
107=item seeds - C<host:port> 102=item seed nodes
108 103
109When a node starts, it knows nothing about the network. To teach the node 104When a node starts, it knows nothing about the network. To teach the node
110about the network it first has to contact some other node within the 105about the network it first has to contact some other node within the
111network. This node is called a seed. 106network. This node is called a seed.
112 107
113Seeds are transport endpoint(s) of as many nodes as one wants. Those nodes 108Apart from the fact that other nodes know them as seed nodes and they have
109to have fixed listening addresses, seed nodes are perfectly normal nodes -
110any node can function as a seed node for others.
111
112In addition to discovering the network, seed nodes are also used to
113maintain the network and to connect nodes that otherwise would have
114trouble connecting. They form the backbone of an AnyEvent::MP network.
115
114are expected to be long-running, and at least one of those should always 116Seed nodes are expected to be long-running, and at least one seed node
115be available. When nodes run out of connections (e.g. due to a network 117should always be available. They should also be relatively responsive - a
116error), they try to re-establish connections to some seednodes again to 118seed node that blocks for long periods will slow down everybody else.
117join the network. 119
120=item seeds - C<host:port>
121
122Seeds are transport endpoint(s) (usually a hostname/IP address and a
123TCP port) of nodes thta should be used as seed nodes.
124
125The nodes listening on those endpoints are expected to be long-running,
126and at least one of those should always be available. When nodes run out
127of connections (e.g. due to a network error), they try to re-establish
128connections to some seednodes again to join the network.
118 129
119=back 130=back
120 131
121=head1 VARIABLES/FUNCTIONS 132=head1 VARIABLES/FUNCTIONS
122 133
138 149
139our $VERSION = $AnyEvent::MP::Kernel::VERSION; 150our $VERSION = $AnyEvent::MP::Kernel::VERSION;
140 151
141our @EXPORT = qw( 152our @EXPORT = qw(
142 NODE $NODE *SELF node_of after 153 NODE $NODE *SELF node_of after
143 resolve_node initialise_node 154 configure
144 snd rcv mon mon_guard kil reg psub spawn 155 snd rcv mon mon_guard kil reg psub spawn
145 port 156 port
146); 157);
147 158
148our $SELF; 159our $SELF;
153 kil $SELF, die => $msg; 164 kil $SELF, die => $msg;
154} 165}
155 166
156=item $thisnode = NODE / $NODE 167=item $thisnode = NODE / $NODE
157 168
158The C<NODE> function returns, and the C<$NODE> variable contains the node 169The C<NODE> function returns, and the C<$NODE> variable contains, the node
159ID of the node running in the current process. This value is initialised by 170ID of the node running in the current process. This value is initialised by
160a call to C<initialise_node>. 171a call to C<configure>.
161 172
162=item $nodeid = node_of $port 173=item $nodeid = node_of $port
163 174
164Extracts and returns the node ID part from a port ID or a node ID. 175Extracts and returns the node ID from a port ID or a node ID.
165 176
166=item initialise_node $profile_name 177=item configure $profile, key => value...
178
179=item configure key => value...
167 180
168Before a node can talk to other nodes on the network (i.e. enter 181Before a node can talk to other nodes on the network (i.e. enter
169"distributed mode") it has to initialise itself - the minimum a node needs 182"distributed mode") it has to configure itself - the minimum a node needs
170to know is its own name, and optionally it should know the addresses of 183to know is its own name, and optionally it should know the addresses of
171some other nodes in the network to discover other nodes. 184some other nodes in the network to discover other nodes.
172 185
173This function initialises a node - it must be called exactly once (or 186This function configures a node - it must be called exactly once (or
174never) before calling other AnyEvent::MP functions. 187never) before calling other AnyEvent::MP functions.
175 188
176The first argument is a profile name. If it is C<undef> or missing, then 189=over 4
177the current nodename will be used instead (i.e. F<uname -n>).
178 190
191=item step 1, gathering configuration from profiles
192
179The function then looks up the profile in the aemp configuration (see the 193The function first looks up a profile in the aemp configuration (see the
180L<aemp> commandline utility). 194L<aemp> commandline utility). The profile name can be specified via the
195named C<profile> parameter or can simply be the first parameter). If it is
196missing, then the nodename (F<uname -n>) will be used as profile name.
197
198The profile data is then gathered as follows:
199
200First, all remaining key => value pairs (all of which are conveniently
201undocumented at the moment) will be interpreted as configuration
202data. Then they will be overwritten by any values specified in the global
203default configuration (see the F<aemp> utility), then the chain of
204profiles chosen by the profile name (and any C<parent> attributes).
205
206That means that the values specified in the profile have highest priority
207and the values specified directly via C<configure> have lowest priority,
208and can only be used to specify defaults.
181 209
182If the profile specifies a node ID, then this will become the node ID of 210If the profile specifies a node ID, then this will become the node ID of
183this process. If not, then the profile name will be used as node ID. The 211this process. If not, then the profile name will be used as node ID. The
184special node ID of C<anon/> will be replaced by a random node ID. 212special node ID of C<anon/> will be replaced by a random node ID.
213
214=item step 2, bind listener sockets
185 215
186The next step is to look up the binds in the profile, followed by binding 216The next step is to look up the binds in the profile, followed by binding
187aemp protocol listeners on all binds specified (it is possible and valid 217aemp protocol listeners on all binds specified (it is possible and valid
188to have no binds, meaning that the node cannot be contacted form the 218to have no binds, meaning that the node cannot be contacted form the
189outside. This means the node cannot talk to other nodes that also have no 219outside. This means the node cannot talk to other nodes that also have no
190binds, but it can still talk to all "normal" nodes). 220binds, but it can still talk to all "normal" nodes).
191 221
192If the profile does not specify a binds list, then the node ID will be 222If the profile does not specify a binds list, then a default of C<*> is
193treated as if it were of the form C<host:port>, which will be resolved and 223used, meaning the node will bind on a dynamically-assigned port on every
194used as binds list. 224local IP address it finds.
195 225
226=item step 3, connect to seed nodes
227
196Lastly, the seeds list from the profile is passed to the 228As the last step, the seeds list from the profile is passed to the
197L<AnyEvent::MP::Global> module, which will then use it to keep 229L<AnyEvent::MP::Global> module, which will then use it to keep
198connectivity with at least on of those seed nodes at any point in time. 230connectivity with at least one node at any point in time.
199 231
200Example: become a distributed node listening on the guessed noderef, or 232=back
201the one specified via C<aemp> for the current node. This should be the 233
234Example: become a distributed node using the locla node name as profile.
202most common form of invocation for "daemon"-type nodes. 235This should be the most common form of invocation for "daemon"-type nodes.
203 236
204 initialise_node; 237 configure
205 238
206Example: become an anonymous node. This form is often used for commandline 239Example: become an anonymous node. This form is often used for commandline
207clients. 240clients.
208 241
209 initialise_node "anon/"; 242 configure nodeid => "anon/";
210 243
211Example: become a distributed node. If there is no profile of the given 244Example: configure a node using a profile called seed, which si suitable
212name, or no binds list was specified, resolve C<localhost:4044> and bind 245for a seed node as it binds on all local addresses on a fixed port (4040,
213on the resulting addresses. 246customary for aemp).
214 247
215 initialise_node "localhost:4044"; 248 # use the aemp commandline utility
249 # aemp profile seed nodeid anon/ binds '*:4040'
250
251 # then use it
252 configure profile => "seed";
253
254 # or simply use aemp from the shell again:
255 # aemp run profile seed
256
257 # or provide a nicer-to-remember nodeid
258 # aemp run profile seed nodeid "$(hostname)"
216 259
217=item $SELF 260=item $SELF
218 261
219Contains the current port id while executing C<rcv> callbacks or C<psub> 262Contains the current port id while executing C<rcv> callbacks or C<psub>
220blocks. 263blocks.
221 264
222=item SELF, %SELF, @SELF... 265=item *SELF, SELF, %SELF, @SELF...
223 266
224Due to some quirks in how perl exports variables, it is impossible to 267Due to some quirks in how perl exports variables, it is impossible to
225just export C<$SELF>, all the symbols called C<SELF> are exported by this 268just export C<$SELF>, all the symbols named C<SELF> are exported by this
226module, but only C<$SELF> is currently used. 269module, but only C<$SELF> is currently used.
227 270
228=item snd $port, type => @data 271=item snd $port, type => @data
229 272
230=item snd $port, @msg 273=item snd $port, @msg
231 274
232Send the given message to the given port ID, which can identify either 275Send the given message to the given port, which can identify either a
233a local or a remote port, and must be a port ID. 276local or a remote port, and must be a port ID.
234 277
235While the message can be about anything, it is highly recommended to use a 278While the message can be almost anything, it is highly recommended to
236string as first element (a port ID, or some word that indicates a request 279use a string as first element (a port ID, or some word that indicates a
237type etc.). 280request type etc.) and to consist if only simple perl values (scalars,
281arrays, hashes) - if you think you need to pass an object, think again.
238 282
239The message data effectively becomes read-only after a call to this 283The message data logically becomes read-only after a call to this
240function: modifying any argument is not allowed and can cause many 284function: modifying any argument (or values referenced by them) is
241problems. 285forbidden, as there can be considerable time between the call to C<snd>
286and the time the message is actually being serialised - in fact, it might
287never be copied as within the same process it is simply handed to the
288receiving port.
242 289
243The type of data you can transfer depends on the transport protocol: when 290The type of data you can transfer depends on the transport protocol: when
244JSON is used, then only strings, numbers and arrays and hashes consisting 291JSON is used, then only strings, numbers and arrays and hashes consisting
245of those are allowed (no objects). When Storable is used, then anything 292of those are allowed (no objects). When Storable is used, then anything
246that Storable can serialise and deserialise is allowed, and for the local 293that Storable can serialise and deserialise is allowed, and for the local
247node, anything can be passed. 294node, anything can be passed. Best rely only on the common denominator of
295these.
248 296
249=item $local_port = port 297=item $local_port = port
250 298
251Create a new local port object and returns its port ID. Initially it has 299Create a new local port object and returns its port ID. Initially it has
252no callbacks set and will throw an error when it receives messages. 300no callbacks set and will throw an error when it receives messages.
337 385
338=cut 386=cut
339 387
340sub rcv($@) { 388sub rcv($@) {
341 my $port = shift; 389 my $port = shift;
342 my ($noderef, $portid) = split /#/, $port, 2; 390 my ($nodeid, $portid) = split /#/, $port, 2;
343 391
344 $NODE{$noderef} == $NODE{""} 392 $NODE{$nodeid} == $NODE{""}
345 or Carp::croak "$port: rcv can only be called on local ports, caught"; 393 or Carp::croak "$port: rcv can only be called on local ports, caught";
346 394
347 while (@_) { 395 while (@_) {
348 if (ref $_[0]) { 396 if (ref $_[0]) {
349 if (my $self = $PORT_DATA{$portid}) { 397 if (my $self = $PORT_DATA{$portid}) {
428 $res 476 $res
429 } 477 }
430 } 478 }
431} 479}
432 480
433=item $guard = mon $port, $cb->(@reason) 481=item $guard = mon $port, $cb->(@reason) # call $cb when $port dies
434 482
435=item $guard = mon $port, $rcvport 483=item $guard = mon $port, $rcvport # kill $rcvport when $port dies
436 484
437=item $guard = mon $port 485=item $guard = mon $port # kill $SELF when $port dies
438 486
439=item $guard = mon $port, $rcvport, @msg 487=item $guard = mon $port, $rcvport, @msg # send a message when $port dies
440 488
441Monitor the given port and do something when the port is killed or 489Monitor the given port and do something when the port is killed or
442messages to it were lost, and optionally return a guard that can be used 490messages to it were lost, and optionally return a guard that can be used
443to stop monitoring again. 491to stop monitoring again.
444
445C<mon> effectively guarantees that, in the absence of hardware failures,
446that after starting the monitor, either all messages sent to the port
447will arrive, or the monitoring action will be invoked after possible
448message loss has been detected. No messages will be lost "in between"
449(after the first lost message no further messages will be received by the
450port). After the monitoring action was invoked, further messages might get
451delivered again.
452
453Note that monitoring-actions are one-shot: once released, they are removed
454and will not trigger again.
455 492
456In the first form (callback), the callback is simply called with any 493In the first form (callback), the callback is simply called with any
457number of C<@reason> elements (no @reason means that the port was deleted 494number of C<@reason> elements (no @reason means that the port was deleted
458"normally"). Note also that I<< the callback B<must> never die >>, so use 495"normally"). Note also that I<< the callback B<must> never die >>, so use
459C<eval> if unsure. 496C<eval> if unsure.
460 497
461In the second form (another port given), the other port (C<$rcvport>) 498In the second form (another port given), the other port (C<$rcvport>)
462will be C<kil>'ed with C<@reason>, iff a @reason was specified, i.e. on 499will be C<kil>'ed with C<@reason>, if a @reason was specified, i.e. on
463"normal" kils nothing happens, while under all other conditions, the other 500"normal" kils nothing happens, while under all other conditions, the other
464port is killed with the same reason. 501port is killed with the same reason.
465 502
466The third form (kill self) is the same as the second form, except that 503The third form (kill self) is the same as the second form, except that
467C<$rvport> defaults to C<$SELF>. 504C<$rvport> defaults to C<$SELF>.
468 505
469In the last form (message), a message of the form C<@msg, @reason> will be 506In the last form (message), a message of the form C<@msg, @reason> will be
470C<snd>. 507C<snd>.
508
509Monitoring-actions are one-shot: once messages are lost (and a monitoring
510alert was raised), they are removed and will not trigger again.
471 511
472As a rule of thumb, monitoring requests should always monitor a port from 512As a rule of thumb, monitoring requests should always monitor a port from
473a local port (or callback). The reason is that kill messages might get 513a local port (or callback). The reason is that kill messages might get
474lost, just like any other message. Another less obvious reason is that 514lost, just like any other message. Another less obvious reason is that
475even monitoring requests can get lost (for exmaple, when the connection 515even monitoring requests can get lost (for example, when the connection
476to the other node goes down permanently). When monitoring a port locally 516to the other node goes down permanently). When monitoring a port locally
477these problems do not exist. 517these problems do not exist.
478 518
519C<mon> effectively guarantees that, in the absence of hardware failures,
520after starting the monitor, either all messages sent to the port will
521arrive, or the monitoring action will be invoked after possible message
522loss has been detected. No messages will be lost "in between" (after
523the first lost message no further messages will be received by the
524port). After the monitoring action was invoked, further messages might get
525delivered again.
526
527Inter-host-connection timeouts and monitoring depend on the transport
528used. The only transport currently implemented is TCP, and AnyEvent::MP
529relies on TCP to detect node-downs (this can take 10-15 minutes on a
530non-idle connection, and usually around two hours for idle conenctions).
531
532This means that monitoring is good for program errors and cleaning up
533stuff eventually, but they are no replacement for a timeout when you need
534to ensure some maximum latency.
535
479Example: call a given callback when C<$port> is killed. 536Example: call a given callback when C<$port> is killed.
480 537
481 mon $port, sub { warn "port died because of <@_>\n" }; 538 mon $port, sub { warn "port died because of <@_>\n" };
482 539
483Example: kill ourselves when C<$port> is killed abnormally. 540Example: kill ourselves when C<$port> is killed abnormally.
489 mon $port, $self => "restart"; 546 mon $port, $self => "restart";
490 547
491=cut 548=cut
492 549
493sub mon { 550sub mon {
494 my ($noderef, $port) = split /#/, shift, 2; 551 my ($nodeid, $port) = split /#/, shift, 2;
495 552
496 my $node = $NODE{$noderef} || add_node $noderef; 553 my $node = $NODE{$nodeid} || add_node $nodeid;
497 554
498 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,'; 555 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,';
499 556
500 unless (ref $cb) { 557 unless (ref $cb) {
501 if (@_) { 558 if (@_) {
521is killed, the references will be freed. 578is killed, the references will be freed.
522 579
523Optionally returns a guard that will stop the monitoring. 580Optionally returns a guard that will stop the monitoring.
524 581
525This function is useful when you create e.g. timers or other watchers and 582This function is useful when you create e.g. timers or other watchers and
526want to free them when the port gets killed: 583want to free them when the port gets killed (note the use of C<psub>):
527 584
528 $port->rcv (start => sub { 585 $port->rcv (start => sub {
529 my $timer; $timer = mon_guard $port, AE::timer 1, 1, sub { 586 my $timer; $timer = mon_guard $port, AE::timer 1, 1, psub {
530 undef $timer if 0.9 < rand; 587 undef $timer if 0.9 < rand;
531 }); 588 });
532 }); 589 });
533 590
534=cut 591=cut
543 600
544=item kil $port[, @reason] 601=item kil $port[, @reason]
545 602
546Kill the specified port with the given C<@reason>. 603Kill the specified port with the given C<@reason>.
547 604
548If no C<@reason> is specified, then the port is killed "normally" (linked 605If no C<@reason> is specified, then the port is killed "normally" (ports
549ports will not be kileld, or even notified). 606monitoring other ports will not necessarily die because a port dies
607"normally").
550 608
551Otherwise, linked ports get killed with the same reason (second form of 609Otherwise, linked ports get killed with the same reason (second form of
552C<mon>, see below). 610C<mon>, see above).
553 611
554Runtime errors while evaluating C<rcv> callbacks or inside C<psub> blocks 612Runtime errors while evaluating C<rcv> callbacks or inside C<psub> blocks
555will be reported as reason C<< die => $@ >>. 613will be reported as reason C<< die => $@ >>.
556 614
557Transport/communication errors are reported as C<< transport_error => 615Transport/communication errors are reported as C<< transport_error =>
562=item $port = spawn $node, $initfunc[, @initdata] 620=item $port = spawn $node, $initfunc[, @initdata]
563 621
564Creates a port on the node C<$node> (which can also be a port ID, in which 622Creates a port on the node C<$node> (which can also be a port ID, in which
565case it's the node where that port resides). 623case it's the node where that port resides).
566 624
567The port ID of the newly created port is return immediately, and it is 625The port ID of the newly created port is returned immediately, and it is
568permissible to immediately start sending messages or monitor the port. 626possible to immediately start sending messages or to monitor the port.
569 627
570After the port has been created, the init function is 628After the port has been created, the init function is called on the remote
571called. This function must be a fully-qualified function name 629node, in the same context as a C<rcv> callback. This function must be a
572(e.g. C<MyApp::Chat::Server::init>). To specify a function in the main 630fully-qualified function name (e.g. C<MyApp::Chat::Server::init>). To
573program, use C<::name>. 631specify a function in the main program, use C<::name>.
574 632
575If the function doesn't exist, then the node tries to C<require> 633If the function doesn't exist, then the node tries to C<require>
576the package, then the package above the package and so on (e.g. 634the package, then the package above the package and so on (e.g.
577C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function 635C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function
578exists or it runs out of package names. 636exists or it runs out of package names.
579 637
580The init function is then called with the newly-created port as context 638The init function is then called with the newly-created port as context
581object (C<$SELF>) and the C<@initdata> values as arguments. 639object (C<$SELF>) and the C<@initdata> values as arguments. It I<must>
640call one of the C<rcv> functions to set callbacks on C<$SELF>, otherwise
641the port might not get created.
582 642
583A common idiom is to pass your own port, monitor the spawned port, and 643A common idiom is to pass a local port, immediately monitor the spawned
584in the init function, monitor the original port. This two-way monitoring 644port, and in the remote init function, immediately monitor the passed
585ensures that both ports get cleaned up when there is a problem. 645local port. This two-way monitoring ensures that both ports get cleaned up
646when there is a problem.
647
648C<spawn> guarantees that the C<$initfunc> has no visible effects on the
649caller before C<spawn> returns (by delaying invocation when spawn is
650called for the local node).
586 651
587Example: spawn a chat server port on C<$othernode>. 652Example: spawn a chat server port on C<$othernode>.
588 653
589 # this node, executed from within a port context: 654 # this node, executed from within a port context:
590 my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF; 655 my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF;
605 670
606sub _spawn { 671sub _spawn {
607 my $port = shift; 672 my $port = shift;
608 my $init = shift; 673 my $init = shift;
609 674
675 # rcv will create the actual port
610 local $SELF = "$NODE#$port"; 676 local $SELF = "$NODE#$port";
611 eval { 677 eval {
612 &{ load_func $init } 678 &{ load_func $init }
613 }; 679 };
614 _self_die if $@; 680 _self_die if $@;
615} 681}
616 682
617sub spawn(@) { 683sub spawn(@) {
618 my ($noderef, undef) = split /#/, shift, 2; 684 my ($nodeid, undef) = split /#/, shift, 2;
619 685
620 my $id = "$RUNIQ." . $ID++; 686 my $id = "$RUNIQ." . $ID++;
621 687
622 $_[0] =~ /::/ 688 $_[0] =~ /::/
623 or Carp::croak "spawn init function must be a fully-qualified name, caught"; 689 or Carp::croak "spawn init function must be a fully-qualified name, caught";
624 690
625 snd_to_func $noderef, "AnyEvent::MP::_spawn" => $id, @_; 691 snd_to_func $nodeid, "AnyEvent::MP::_spawn" => $id, @_;
626 692
627 "$noderef#$id" 693 "$nodeid#$id"
628} 694}
629 695
630=item after $timeout, @msg 696=item after $timeout, @msg
631 697
632=item after $timeout, $callback 698=item after $timeout, $callback
633 699
634Either sends the given message, or call the given callback, after the 700Either sends the given message, or call the given callback, after the
635specified number of seconds. 701specified number of seconds.
636 702
637This is simply a utility function that come sin handy at times. 703This is simply a utility function that comes in handy at times - the
704AnyEvent::MP author is not convinced of the wisdom of having it, though,
705so it may go away in the future.
638 706
639=cut 707=cut
640 708
641sub after($@) { 709sub after($@) {
642 my ($timeout, @action) = @_; 710 my ($timeout, @action) = @_;
669 737
670=item * Node IDs are arbitrary strings in AEMP. 738=item * Node IDs are arbitrary strings in AEMP.
671 739
672Erlang relies on special naming and DNS to work everywhere in the same 740Erlang relies on special naming and DNS to work everywhere in the same
673way. AEMP relies on each node somehow knowing its own address(es) (e.g. by 741way. AEMP relies on each node somehow knowing its own address(es) (e.g. by
674configuraiton or DNS), but will otherwise discover other odes itself. 742configuration or DNS), but will otherwise discover other odes itself.
675 743
676=item * Erlang has a "remote ports are like local ports" philosophy, AEMP 744=item * Erlang has a "remote ports are like local ports" philosophy, AEMP
677uses "local ports are like remote ports". 745uses "local ports are like remote ports".
678 746
679The failure modes for local ports are quite different (runtime errors 747The failure modes for local ports are quite different (runtime errors
692 760
693Erlang uses processes that selectively receive messages, and therefore 761Erlang uses processes that selectively receive messages, and therefore
694needs a queue. AEMP is event based, queuing messages would serve no 762needs a queue. AEMP is event based, queuing messages would serve no
695useful purpose. For the same reason the pattern-matching abilities of 763useful purpose. For the same reason the pattern-matching abilities of
696AnyEvent::MP are more limited, as there is little need to be able to 764AnyEvent::MP are more limited, as there is little need to be able to
697filter messages without dequeing them. 765filter messages without dequeuing them.
698 766
699(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP). 767(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP).
700 768
701=item * Erlang sends are synchronous, AEMP sends are asynchronous. 769=item * Erlang sends are synchronous, AEMP sends are asynchronous.
702 770
708 776
709Erlang makes few guarantees on messages delivery - messages can get lost 777Erlang makes few guarantees on messages delivery - messages can get lost
710without any of the processes realising it (i.e. you send messages a, b, 778without any of the processes realising it (i.e. you send messages a, b,
711and c, and the other side only receives messages a and c). 779and c, and the other side only receives messages a and c).
712 780
713AEMP guarantees correct ordering, and the guarantee that there are no 781AEMP guarantees correct ordering, and the guarantee that after one message
714holes in the message sequence. 782is lost, all following ones sent to the same port are lost as well, until
715 783monitoring raises an error, so there are no silent "holes" in the message
716=item * In Erlang, processes can be declared dead and later be found to be 784sequence.
717alive.
718
719In Erlang it can happen that a monitored process is declared dead and
720linked processes get killed, but later it turns out that the process is
721still alive - and can receive messages.
722
723In AEMP, when port monitoring detects a port as dead, then that port will
724eventually be killed - it cannot happen that a node detects a port as dead
725and then later sends messages to it, finding it is still alive.
726 785
727=item * Erlang can send messages to the wrong port, AEMP does not. 786=item * Erlang can send messages to the wrong port, AEMP does not.
728 787
729In Erlang it is quite likely that a node that restarts reuses a process ID 788In Erlang it is quite likely that a node that restarts reuses a process ID
730known to other nodes for a completely different process, causing messages 789known to other nodes for a completely different process, causing messages
734around in the network will not be sent to an unrelated port. 793around in the network will not be sent to an unrelated port.
735 794
736=item * Erlang uses unprotected connections, AEMP uses secure 795=item * Erlang uses unprotected connections, AEMP uses secure
737authentication and can use TLS. 796authentication and can use TLS.
738 797
739AEMP can use a proven protocol - SSL/TLS - to protect connections and 798AEMP can use a proven protocol - TLS - to protect connections and
740securely authenticate nodes. 799securely authenticate nodes.
741 800
742=item * The AEMP protocol is optimised for both text-based and binary 801=item * The AEMP protocol is optimised for both text-based and binary
743communications. 802communications.
744 803
745The AEMP protocol, unlike the Erlang protocol, supports both 804The AEMP protocol, unlike the Erlang protocol, supports both programming
746language-independent text-only protocols (good for debugging) and binary, 805language independent text-only protocols (good for debugging) and binary,
747language-specific serialisers (e.g. Storable). 806language-specific serialisers (e.g. Storable). By default, unless TLS is
807used, the protocol is actually completely text-based.
748 808
749It has also been carefully designed to be implementable in other languages 809It has also been carefully designed to be implementable in other languages
750with a minimum of work while gracefully degrading fucntionality to make the 810with a minimum of work while gracefully degrading functionality to make the
751protocol simple. 811protocol simple.
752 812
753=item * AEMP has more flexible monitoring options than Erlang. 813=item * AEMP has more flexible monitoring options than Erlang.
754 814
755In Erlang, you can chose to receive I<all> exit signals as messages 815In Erlang, you can chose to receive I<all> exit signals as messages
758Erlang, as one can choose between automatic kill, exit message or callback 818Erlang, as one can choose between automatic kill, exit message or callback
759on a per-process basis. 819on a per-process basis.
760 820
761=item * Erlang tries to hide remote/local connections, AEMP does not. 821=item * Erlang tries to hide remote/local connections, AEMP does not.
762 822
763Monitoring in Erlang is not an indicator of process death/crashes, 823Monitoring in Erlang is not an indicator of process death/crashes, in the
764as linking is (except linking is unreliable in Erlang). 824same way as linking is (except linking is unreliable in Erlang).
765 825
766In AEMP, you don't "look up" registered port names or send to named ports 826In AEMP, you don't "look up" registered port names or send to named ports
767that might or might not be persistent. Instead, you normally spawn a port 827that might or might not be persistent. Instead, you normally spawn a port
768on the remote node. The init function monitors the you, and you monitor 828on the remote node. The init function monitors you, and you monitor the
769the remote port. Since both monitors are local to the node, they are much 829remote port. Since both monitors are local to the node, they are much more
770more reliable. 830reliable (no need for C<spawn_link>).
771 831
772This also saves round-trips and avoids sending messages to the wrong port 832This also saves round-trips and avoids sending messages to the wrong port
773(hard to do in Erlang). 833(hard to do in Erlang).
774 834
775=back 835=back
776 836
777=head1 RATIONALE 837=head1 RATIONALE
778 838
779=over 4 839=over 4
780 840
781=item Why strings for ports and noderefs, why not objects? 841=item Why strings for port and node IDs, why not objects?
782 842
783We considered "objects", but found that the actual number of methods 843We considered "objects", but found that the actual number of methods
784thatc an be called are very low. Since port IDs and noderefs travel over 844that can be called are quite low. Since port and node IDs travel over
785the network frequently, the serialising/deserialising would add lots of 845the network frequently, the serialising/deserialising would add lots of
786overhead, as well as having to keep a proxy object. 846overhead, as well as having to keep a proxy object everywhere.
787 847
788Strings can easily be printed, easily serialised etc. and need no special 848Strings can easily be printed, easily serialised etc. and need no special
789procedures to be "valid". 849procedures to be "valid".
790 850
791And a a miniport consists of a single closure stored in a global hash - it 851And as a result, a miniport consists of a single closure stored in a
792can't become much cheaper. 852global hash - it can't become much cheaper.
793 853
794=item Why favour JSON, why not real serialising format such as Storable? 854=item Why favour JSON, why not a real serialising format such as Storable?
795 855
796In fact, any AnyEvent::MP node will happily accept Storable as framing 856In fact, any AnyEvent::MP node will happily accept Storable as framing
797format, but currently there is no way to make a node use Storable by 857format, but currently there is no way to make a node use Storable by
798default. 858default (although all nodes will accept it).
799 859
800The default framing protocol is JSON because a) JSON::XS is many times 860The default framing protocol is JSON because a) JSON::XS is many times
801faster for small messages and b) most importantly, after years of 861faster for small messages and b) most importantly, after years of
802experience we found that object serialisation is causing more problems 862experience we found that object serialisation is causing more problems
803than it gains: Just like function calls, objects simply do not travel 863than it solves: Just like function calls, objects simply do not travel
804easily over the network, mostly because they will always be a copy, so you 864easily over the network, mostly because they will always be a copy, so you
805always have to re-think your design. 865always have to re-think your design.
806 866
807Keeping your messages simple, concentrating on data structures rather than 867Keeping your messages simple, concentrating on data structures rather than
808objects, will keep your messages clean, tidy and efficient. 868objects, will keep your messages clean, tidy and efficient.
809 869
810=back 870=back
811 871
812=head1 SEE ALSO 872=head1 SEE ALSO
813 873
874L<AnyEvent::MP::Intro> - a gentle introduction.
875
876L<AnyEvent::MP::Kernel> - more, lower-level, stuff.
877
878L<AnyEvent::MP::Global> - network maintainance and port groups, to find
879your applications.
880
881L<AnyEvent::MP::LogCatcher> - simple service to display log messages from
882all nodes.
883
814L<AnyEvent>. 884L<AnyEvent>.
815 885
816=head1 AUTHOR 886=head1 AUTHOR
817 887
818 Marc Lehmann <schmorp@schmorp.de> 888 Marc Lehmann <schmorp@schmorp.de>

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines