ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
Revision: 1.100
Committed: Fri Oct 2 20:41:56 2009 UTC (14 years, 7 months ago) by root
Branch: MAIN
CVS Tags: rel-1_21
Changes since 1.99: +1 -1 lines
Log Message:
*** empty log message ***

File Contents

# User Rev Content
1 root 1.1 =head1 NAME
2    
3 root 1.89 AnyEvent::MP - erlang-style multi-processing/message-passing framework
4 root 1.1
5     =head1 SYNOPSIS
6    
7     use AnyEvent::MP;
8    
9 root 1.75 $NODE # contains this node's node ID
10     NODE # returns this node's node ID
11 root 1.2
12 root 1.38 $SELF # receiving/own port id in rcv callbacks
13    
14 root 1.48 # initialise the node so it can send/receive messages
15 root 1.72 configure;
16 root 1.48
17 root 1.75 # ports are message destinations
18 root 1.38
19     # sending messages
20 root 1.2 snd $port, type => data...;
21 root 1.38 snd $port, @msg;
22     snd @msg_with_first_element_being_a_port;
23 root 1.2
24 root 1.50 # creating/using ports, the simple way
25 root 1.73 my $simple_port = port { my @msg = @_ };
26 root 1.22
27 root 1.52 # creating/using ports, tagged message matching
28 root 1.38 my $port = port;
29 root 1.73 rcv $port, ping => sub { snd $_[0], "pong" };
30     rcv $port, pong => sub { warn "pong received\n" };
31 root 1.2
32 root 1.48 # create a port on another node
33     my $port = spawn $node, $initfunc, @initdata;
34    
35 root 1.35 # monitoring
36 root 1.90 mon $localport, $cb->(@msg) # callback is invoked on death
37     mon $localport, $otherport # kill otherport on abnormal death
38     mon $localport, $otherport, @msg # send message on death
39 root 1.35
40 root 1.45 =head1 CURRENT STATUS
41    
42 root 1.71 bin/aemp - stable.
43     AnyEvent::MP - stable API, should work.
44 elmex 1.77 AnyEvent::MP::Intro - explains most concepts.
45 root 1.88 AnyEvent::MP::Kernel - mostly stable API.
46     AnyEvent::MP::Global - stable API.
47 root 1.45
48 root 1.1 =head1 DESCRIPTION
49    
50 root 1.2 This module (-family) implements a simple message passing framework.
51    
52     Despite its simplicity, you can securely message other processes running
53 root 1.67 on the same or other hosts, and you can supervise entities remotely.
54 root 1.2
55 root 1.23 For an introduction to this module family, see the L<AnyEvent::MP::Intro>
56 root 1.67 manual page and the examples under F<eg/>.
57 root 1.23
58 root 1.2 =head1 CONCEPTS
59    
60     =over 4
61    
62     =item port
63    
64 root 1.79 Not to be confused with a TCP port, a "port" is something you can send
65     messages to (with the C<snd> function).
66 root 1.29
67 root 1.53 Ports allow you to register C<rcv> handlers that can match all or just
68 root 1.64 some messages. Messages send to ports will not be queued, regardless of
69     anything was listening for them or not.
70 root 1.2
71 root 1.67 =item port ID - C<nodeid#portname>
72 root 1.2
73 root 1.67 A port ID is the concatenation of a node ID, a hash-mark (C<#>) as
74     separator, and a port name (a printable string of unspecified format).
75 root 1.2
76     =item node
77    
78 root 1.53 A node is a single process containing at least one port - the node port,
79 root 1.67 which enables nodes to manage each other remotely, and to create new
80 root 1.53 ports.
81 root 1.2
82 root 1.67 Nodes are either public (have one or more listening ports) or private
83     (no listening ports). Private nodes cannot talk to other private nodes
84     currently.
85 root 1.2
86 root 1.84 =item node ID - C<[A-Z_][a-zA-Z0-9_\-.:]*>
87 root 1.2
88 root 1.64 A node ID is a string that uniquely identifies the node within a
89     network. Depending on the configuration used, node IDs can look like a
90     hostname, a hostname and a port, or a random string. AnyEvent::MP itself
91     doesn't interpret node IDs in any way.
92    
93     =item binds - C<ip:port>
94    
95     Nodes can only talk to each other by creating some kind of connection to
96     each other. To do this, nodes should listen on one or more local transport
97     endpoints - binds. Currently, only standard C<ip:port> specifications can
98     be used, which specify TCP ports to listen on.
99    
100 root 1.83 =item seed nodes
101 root 1.64
102     When a node starts, it knows nothing about the network. To teach the node
103     about the network it first has to contact some other node within the
104     network. This node is called a seed.
105    
106 root 1.83 Apart from the fact that other nodes know them as seed nodes and they have
107     to have fixed listening addresses, seed nodes are perfectly normal nodes -
108     any node can function as a seed node for others.
109    
110     In addition to discovering the network, seed nodes are also used to
111     maintain the network and to connect nodes that otherwise would have
112 root 1.86 trouble connecting. They form the backbone of an AnyEvent::MP network.
113 root 1.83
114     Seed nodes are expected to be long-running, and at least one seed node
115 root 1.85 should always be available. They should also be relatively responsive - a
116     seed node that blocks for long periods will slow down everybody else.
117 root 1.83
118     =item seeds - C<host:port>
119    
120     Seeds are transport endpoint(s) (usually a hostname/IP address and a
121 elmex 1.96 TCP port) of nodes that should be used as seed nodes.
122 root 1.29
123 root 1.83 The nodes listening on those endpoints are expected to be long-running,
124     and at least one of those should always be available. When nodes run out
125     of connections (e.g. due to a network error), they try to re-establish
126     connections to some seednodes again to join the network.
127 root 1.67
128 root 1.2 =back
129    
130 root 1.3 =head1 VARIABLES/FUNCTIONS
131 root 1.2
132     =over 4
133    
134 root 1.1 =cut
135    
136     package AnyEvent::MP;
137    
138 root 1.44 use AnyEvent::MP::Kernel;
139 root 1.2
140 root 1.1 use common::sense;
141    
142 root 1.2 use Carp ();
143    
144 root 1.1 use AE ();
145    
146 root 1.2 use base "Exporter";
147    
148 root 1.100 our $VERSION = 1.21;
149 root 1.43
150 root 1.8 our @EXPORT = qw(
151 root 1.59 NODE $NODE *SELF node_of after
152 root 1.72 configure
153 root 1.91 snd rcv mon mon_guard kil psub spawn cal
154 root 1.22 port
155 root 1.8 );
156 root 1.2
157 root 1.22 our $SELF;
158    
159     sub _self_die() {
160     my $msg = $@;
161     $msg =~ s/\n+$// unless ref $msg;
162     kil $SELF, die => $msg;
163     }
164    
165     =item $thisnode = NODE / $NODE
166    
167 root 1.67 The C<NODE> function returns, and the C<$NODE> variable contains, the node
168 root 1.64 ID of the node running in the current process. This value is initialised by
169 root 1.72 a call to C<configure>.
170 root 1.22
171 root 1.63 =item $nodeid = node_of $port
172 root 1.22
173 root 1.67 Extracts and returns the node ID from a port ID or a node ID.
174 root 1.34
175 root 1.78 =item configure $profile, key => value...
176    
177 root 1.72 =item configure key => value...
178 root 1.34
179 root 1.64 Before a node can talk to other nodes on the network (i.e. enter
180 root 1.72 "distributed mode") it has to configure itself - the minimum a node needs
181 root 1.64 to know is its own name, and optionally it should know the addresses of
182     some other nodes in the network to discover other nodes.
183 root 1.34
184 root 1.72 This function configures a node - it must be called exactly once (or
185 root 1.34 never) before calling other AnyEvent::MP functions.
186    
187 root 1.72 =over 4
188    
189     =item step 1, gathering configuration from profiles
190    
191     The function first looks up a profile in the aemp configuration (see the
192     L<aemp> commandline utility). The profile name can be specified via the
193 root 1.78 named C<profile> parameter or can simply be the first parameter). If it is
194     missing, then the nodename (F<uname -n>) will be used as profile name.
195 root 1.34
196 root 1.72 The profile data is then gathered as follows:
197 root 1.69
198 elmex 1.77 First, all remaining key => value pairs (all of which are conveniently
199 root 1.72 undocumented at the moment) will be interpreted as configuration
200     data. Then they will be overwritten by any values specified in the global
201     default configuration (see the F<aemp> utility), then the chain of
202     profiles chosen by the profile name (and any C<parent> attributes).
203    
204     That means that the values specified in the profile have highest priority
205     and the values specified directly via C<configure> have lowest priority,
206     and can only be used to specify defaults.
207 root 1.49
208 root 1.64 If the profile specifies a node ID, then this will become the node ID of
209     this process. If not, then the profile name will be used as node ID. The
210     special node ID of C<anon/> will be replaced by a random node ID.
211    
212 root 1.72 =item step 2, bind listener sockets
213    
214 root 1.64 The next step is to look up the binds in the profile, followed by binding
215     aemp protocol listeners on all binds specified (it is possible and valid
216     to have no binds, meaning that the node cannot be contacted form the
217     outside. This means the node cannot talk to other nodes that also have no
218     binds, but it can still talk to all "normal" nodes).
219    
220 root 1.70 If the profile does not specify a binds list, then a default of C<*> is
221 root 1.72 used, meaning the node will bind on a dynamically-assigned port on every
222     local IP address it finds.
223    
224     =item step 3, connect to seed nodes
225 root 1.64
226 root 1.72 As the last step, the seeds list from the profile is passed to the
227 root 1.64 L<AnyEvent::MP::Global> module, which will then use it to keep
228 root 1.72 connectivity with at least one node at any point in time.
229 root 1.64
230 root 1.72 =back
231    
232 root 1.87 Example: become a distributed node using the local node name as profile.
233 root 1.72 This should be the most common form of invocation for "daemon"-type nodes.
234 root 1.34
235 root 1.72 configure
236 root 1.34
237 root 1.64 Example: become an anonymous node. This form is often used for commandline
238     clients.
239 root 1.34
240 root 1.72 configure nodeid => "anon/";
241    
242     Example: configure a node using a profile called seed, which si suitable
243     for a seed node as it binds on all local addresses on a fixed port (4040,
244     customary for aemp).
245    
246     # use the aemp commandline utility
247 root 1.74 # aemp profile seed nodeid anon/ binds '*:4040'
248 root 1.72
249     # then use it
250     configure profile => "seed";
251 root 1.34
252 root 1.72 # or simply use aemp from the shell again:
253     # aemp run profile seed
254 root 1.34
255 root 1.72 # or provide a nicer-to-remember nodeid
256     # aemp run profile seed nodeid "$(hostname)"
257 root 1.34
258 root 1.22 =item $SELF
259    
260     Contains the current port id while executing C<rcv> callbacks or C<psub>
261     blocks.
262 root 1.3
263 root 1.67 =item *SELF, SELF, %SELF, @SELF...
264 root 1.22
265     Due to some quirks in how perl exports variables, it is impossible to
266 root 1.67 just export C<$SELF>, all the symbols named C<SELF> are exported by this
267 root 1.22 module, but only C<$SELF> is currently used.
268 root 1.3
269 root 1.33 =item snd $port, type => @data
270 root 1.3
271 root 1.33 =item snd $port, @msg
272 root 1.3
273 root 1.67 Send the given message to the given port, which can identify either a
274     local or a remote port, and must be a port ID.
275 root 1.8
276 root 1.67 While the message can be almost anything, it is highly recommended to
277     use a string as first element (a port ID, or some word that indicates a
278     request type etc.) and to consist if only simple perl values (scalars,
279     arrays, hashes) - if you think you need to pass an object, think again.
280    
281     The message data logically becomes read-only after a call to this
282     function: modifying any argument (or values referenced by them) is
283     forbidden, as there can be considerable time between the call to C<snd>
284     and the time the message is actually being serialised - in fact, it might
285     never be copied as within the same process it is simply handed to the
286     receiving port.
287 root 1.3
288     The type of data you can transfer depends on the transport protocol: when
289     JSON is used, then only strings, numbers and arrays and hashes consisting
290     of those are allowed (no objects). When Storable is used, then anything
291     that Storable can serialise and deserialise is allowed, and for the local
292 root 1.67 node, anything can be passed. Best rely only on the common denominator of
293     these.
294 root 1.3
295 root 1.22 =item $local_port = port
296 root 1.2
297 root 1.50 Create a new local port object and returns its port ID. Initially it has
298     no callbacks set and will throw an error when it receives messages.
299 root 1.10
300 root 1.50 =item $local_port = port { my @msg = @_ }
301 root 1.15
302 root 1.50 Creates a new local port, and returns its ID. Semantically the same as
303     creating a port and calling C<rcv $port, $callback> on it.
304 root 1.15
305 root 1.50 The block will be called for every message received on the port, with the
306     global variable C<$SELF> set to the port ID. Runtime errors will cause the
307     port to be C<kil>ed. The message will be passed as-is, no extra argument
308     (i.e. no port ID) will be passed to the callback.
309 root 1.15
310 root 1.50 If you want to stop/destroy the port, simply C<kil> it:
311 root 1.15
312 root 1.50 my $port = port {
313     my @msg = @_;
314     ...
315     kil $SELF;
316 root 1.15 };
317 root 1.10
318     =cut
319    
320 root 1.33 sub rcv($@);
321    
322 root 1.50 sub _kilme {
323     die "received message on port without callback";
324     }
325    
326 root 1.22 sub port(;&) {
327     my $id = "$UNIQ." . $ID++;
328     my $port = "$NODE#$id";
329    
330 root 1.50 rcv $port, shift || \&_kilme;
331 root 1.10
332 root 1.22 $port
333 root 1.10 }
334    
335 root 1.50 =item rcv $local_port, $callback->(@msg)
336 root 1.31
337 root 1.50 Replaces the default callback on the specified port. There is no way to
338     remove the default callback: use C<sub { }> to disable it, or better
339     C<kil> the port when it is no longer needed.
340 root 1.3
341 root 1.33 The global C<$SELF> (exported by this module) contains C<$port> while
342 root 1.50 executing the callback. Runtime errors during callback execution will
343     result in the port being C<kil>ed.
344 root 1.22
345 root 1.50 The default callback received all messages not matched by a more specific
346     C<tag> match.
347 root 1.22
348 root 1.50 =item rcv $local_port, tag => $callback->(@msg_without_tag), ...
349 root 1.3
350 root 1.54 Register (or replace) callbacks to be called on messages starting with the
351     given tag on the given port (and return the port), or unregister it (when
352     C<$callback> is C<$undef> or missing). There can only be one callback
353     registered for each tag.
354 root 1.3
355 root 1.50 The original message will be passed to the callback, after the first
356     element (the tag) has been removed. The callback will use the same
357     environment as the default callback (see above).
358 root 1.3
359 root 1.36 Example: create a port and bind receivers on it in one go.
360    
361     my $port = rcv port,
362 root 1.50 msg1 => sub { ... },
363     msg2 => sub { ... },
364 root 1.36 ;
365    
366     Example: create a port, bind receivers and send it in a message elsewhere
367     in one go:
368    
369     snd $otherport, reply =>
370     rcv port,
371 root 1.50 msg1 => sub { ... },
372 root 1.36 ...
373     ;
374    
375 root 1.54 Example: temporarily register a rcv callback for a tag matching some port
376     (e.g. for a rpc reply) and unregister it after a message was received.
377    
378     rcv $port, $otherport => sub {
379     my @reply = @_;
380    
381     rcv $SELF, $otherport;
382     };
383    
384 root 1.3 =cut
385    
386     sub rcv($@) {
387 root 1.33 my $port = shift;
388 root 1.75 my ($nodeid, $portid) = split /#/, $port, 2;
389 root 1.3
390 root 1.75 $NODE{$nodeid} == $NODE{""}
391 root 1.33 or Carp::croak "$port: rcv can only be called on local ports, caught";
392 root 1.22
393 root 1.50 while (@_) {
394     if (ref $_[0]) {
395     if (my $self = $PORT_DATA{$portid}) {
396     "AnyEvent::MP::Port" eq ref $self
397     or Carp::croak "$port: rcv can only be called on message matching ports, caught";
398 root 1.33
399 root 1.50 $self->[2] = shift;
400     } else {
401     my $cb = shift;
402     $PORT{$portid} = sub {
403     local $SELF = $port;
404     eval { &$cb }; _self_die if $@;
405     };
406     }
407     } elsif (defined $_[0]) {
408     my $self = $PORT_DATA{$portid} ||= do {
409     my $self = bless [$PORT{$port} || sub { }, { }, $port], "AnyEvent::MP::Port";
410    
411     $PORT{$portid} = sub {
412     local $SELF = $port;
413    
414     if (my $cb = $self->[1]{$_[0]}) {
415     shift;
416     eval { &$cb }; _self_die if $@;
417     } else {
418     &{ $self->[0] };
419 root 1.33 }
420     };
421 root 1.50
422     $self
423 root 1.33 };
424    
425 root 1.50 "AnyEvent::MP::Port" eq ref $self
426     or Carp::croak "$port: rcv can only be called on message matching ports, caught";
427 root 1.22
428 root 1.50 my ($tag, $cb) = splice @_, 0, 2;
429 root 1.33
430 root 1.50 if (defined $cb) {
431     $self->[1]{$tag} = $cb;
432 root 1.33 } else {
433 root 1.50 delete $self->[1]{$tag};
434 root 1.33 }
435 root 1.22 }
436 root 1.3 }
437 root 1.31
438 root 1.33 $port
439 root 1.2 }
440    
441 root 1.22 =item $closure = psub { BLOCK }
442 root 1.2
443 root 1.22 Remembers C<$SELF> and creates a closure out of the BLOCK. When the
444     closure is executed, sets up the environment in the same way as in C<rcv>
445     callbacks, i.e. runtime errors will cause the port to get C<kil>ed.
446    
447     This is useful when you register callbacks from C<rcv> callbacks:
448    
449     rcv delayed_reply => sub {
450     my ($delay, @reply) = @_;
451     my $timer = AE::timer $delay, 0, psub {
452     snd @reply, $SELF;
453     };
454     };
455 root 1.3
456 root 1.8 =cut
457 root 1.3
458 root 1.22 sub psub(&) {
459     my $cb = shift;
460 root 1.3
461 root 1.22 my $port = $SELF
462     or Carp::croak "psub can only be called from within rcv or psub callbacks, not";
463 root 1.1
464 root 1.22 sub {
465     local $SELF = $port;
466 root 1.2
467 root 1.22 if (wantarray) {
468     my @res = eval { &$cb };
469     _self_die if $@;
470     @res
471     } else {
472     my $res = eval { &$cb };
473     _self_die if $@;
474     $res
475     }
476     }
477 root 1.2 }
478    
479 root 1.67 =item $guard = mon $port, $cb->(@reason) # call $cb when $port dies
480 root 1.32
481 root 1.67 =item $guard = mon $port, $rcvport # kill $rcvport when $port dies
482 root 1.36
483 root 1.67 =item $guard = mon $port # kill $SELF when $port dies
484 root 1.32
485 root 1.67 =item $guard = mon $port, $rcvport, @msg # send a message when $port dies
486 root 1.32
487 root 1.42 Monitor the given port and do something when the port is killed or
488     messages to it were lost, and optionally return a guard that can be used
489     to stop monitoring again.
490    
491 root 1.36 In the first form (callback), the callback is simply called with any
492     number of C<@reason> elements (no @reason means that the port was deleted
493 root 1.32 "normally"). Note also that I<< the callback B<must> never die >>, so use
494     C<eval> if unsure.
495    
496 root 1.43 In the second form (another port given), the other port (C<$rcvport>)
497 elmex 1.77 will be C<kil>'ed with C<@reason>, if a @reason was specified, i.e. on
498 root 1.36 "normal" kils nothing happens, while under all other conditions, the other
499     port is killed with the same reason.
500 root 1.32
501 root 1.36 The third form (kill self) is the same as the second form, except that
502     C<$rvport> defaults to C<$SELF>.
503    
504     In the last form (message), a message of the form C<@msg, @reason> will be
505     C<snd>.
506 root 1.32
507 root 1.79 Monitoring-actions are one-shot: once messages are lost (and a monitoring
508     alert was raised), they are removed and will not trigger again.
509    
510 root 1.37 As a rule of thumb, monitoring requests should always monitor a port from
511     a local port (or callback). The reason is that kill messages might get
512     lost, just like any other message. Another less obvious reason is that
513 elmex 1.77 even monitoring requests can get lost (for example, when the connection
514 root 1.37 to the other node goes down permanently). When monitoring a port locally
515     these problems do not exist.
516    
517 root 1.79 C<mon> effectively guarantees that, in the absence of hardware failures,
518     after starting the monitor, either all messages sent to the port will
519     arrive, or the monitoring action will be invoked after possible message
520     loss has been detected. No messages will be lost "in between" (after
521     the first lost message no further messages will be received by the
522     port). After the monitoring action was invoked, further messages might get
523     delivered again.
524    
525     Inter-host-connection timeouts and monitoring depend on the transport
526     used. The only transport currently implemented is TCP, and AnyEvent::MP
527     relies on TCP to detect node-downs (this can take 10-15 minutes on a
528 elmex 1.96 non-idle connection, and usually around two hours for idle connections).
529 root 1.79
530     This means that monitoring is good for program errors and cleaning up
531     stuff eventually, but they are no replacement for a timeout when you need
532     to ensure some maximum latency.
533    
534 root 1.32 Example: call a given callback when C<$port> is killed.
535    
536     mon $port, sub { warn "port died because of <@_>\n" };
537    
538     Example: kill ourselves when C<$port> is killed abnormally.
539    
540 root 1.36 mon $port;
541 root 1.32
542 root 1.36 Example: send us a restart message when another C<$port> is killed.
543 root 1.32
544     mon $port, $self => "restart";
545    
546     =cut
547    
548     sub mon {
549 root 1.75 my ($nodeid, $port) = split /#/, shift, 2;
550 root 1.32
551 root 1.75 my $node = $NODE{$nodeid} || add_node $nodeid;
552 root 1.32
553 root 1.41 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,';
554 root 1.32
555     unless (ref $cb) {
556     if (@_) {
557     # send a kill info message
558 root 1.41 my (@msg) = ($cb, @_);
559 root 1.32 $cb = sub { snd @msg, @_ };
560     } else {
561     # simply kill other port
562     my $port = $cb;
563     $cb = sub { kil $port, @_ if @_ };
564     }
565     }
566    
567     $node->monitor ($port, $cb);
568    
569     defined wantarray
570 root 1.94 and ($cb += 0, AnyEvent::Util::guard { $node->unmonitor ($port, $cb) })
571 root 1.32 }
572    
573     =item $guard = mon_guard $port, $ref, $ref...
574    
575     Monitors the given C<$port> and keeps the passed references. When the port
576     is killed, the references will be freed.
577    
578     Optionally returns a guard that will stop the monitoring.
579    
580     This function is useful when you create e.g. timers or other watchers and
581 root 1.67 want to free them when the port gets killed (note the use of C<psub>):
582 root 1.32
583     $port->rcv (start => sub {
584 root 1.67 my $timer; $timer = mon_guard $port, AE::timer 1, 1, psub {
585 root 1.32 undef $timer if 0.9 < rand;
586     });
587     });
588    
589     =cut
590    
591     sub mon_guard {
592     my ($port, @refs) = @_;
593    
594 root 1.36 #TODO: mon-less form?
595    
596 root 1.32 mon $port, sub { 0 && @refs }
597     }
598    
599 root 1.33 =item kil $port[, @reason]
600 root 1.32
601     Kill the specified port with the given C<@reason>.
602    
603 root 1.67 If no C<@reason> is specified, then the port is killed "normally" (ports
604     monitoring other ports will not necessarily die because a port dies
605     "normally").
606 root 1.32
607     Otherwise, linked ports get killed with the same reason (second form of
608 root 1.67 C<mon>, see above).
609 root 1.32
610     Runtime errors while evaluating C<rcv> callbacks or inside C<psub> blocks
611     will be reported as reason C<< die => $@ >>.
612    
613     Transport/communication errors are reported as C<< transport_error =>
614     $message >>.
615    
616 root 1.38 =cut
617    
618     =item $port = spawn $node, $initfunc[, @initdata]
619    
620     Creates a port on the node C<$node> (which can also be a port ID, in which
621     case it's the node where that port resides).
622    
623 root 1.67 The port ID of the newly created port is returned immediately, and it is
624     possible to immediately start sending messages or to monitor the port.
625 root 1.38
626 root 1.67 After the port has been created, the init function is called on the remote
627     node, in the same context as a C<rcv> callback. This function must be a
628     fully-qualified function name (e.g. C<MyApp::Chat::Server::init>). To
629     specify a function in the main program, use C<::name>.
630 root 1.38
631     If the function doesn't exist, then the node tries to C<require>
632     the package, then the package above the package and so on (e.g.
633     C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function
634     exists or it runs out of package names.
635    
636     The init function is then called with the newly-created port as context
637 root 1.82 object (C<$SELF>) and the C<@initdata> values as arguments. It I<must>
638     call one of the C<rcv> functions to set callbacks on C<$SELF>, otherwise
639     the port might not get created.
640 root 1.38
641 root 1.67 A common idiom is to pass a local port, immediately monitor the spawned
642     port, and in the remote init function, immediately monitor the passed
643     local port. This two-way monitoring ensures that both ports get cleaned up
644     when there is a problem.
645 root 1.38
646 root 1.80 C<spawn> guarantees that the C<$initfunc> has no visible effects on the
647     caller before C<spawn> returns (by delaying invocation when spawn is
648     called for the local node).
649    
650 root 1.38 Example: spawn a chat server port on C<$othernode>.
651    
652     # this node, executed from within a port context:
653     my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF;
654     mon $server;
655    
656     # init function on C<$othernode>
657     sub connect {
658     my ($srcport) = @_;
659    
660     mon $srcport;
661    
662     rcv $SELF, sub {
663     ...
664     };
665     }
666    
667     =cut
668    
669     sub _spawn {
670     my $port = shift;
671     my $init = shift;
672    
673 root 1.82 # rcv will create the actual port
674 root 1.38 local $SELF = "$NODE#$port";
675     eval {
676     &{ load_func $init }
677     };
678     _self_die if $@;
679     }
680    
681     sub spawn(@) {
682 root 1.75 my ($nodeid, undef) = split /#/, shift, 2;
683 root 1.38
684     my $id = "$RUNIQ." . $ID++;
685    
686 root 1.39 $_[0] =~ /::/
687     or Carp::croak "spawn init function must be a fully-qualified name, caught";
688    
689 root 1.75 snd_to_func $nodeid, "AnyEvent::MP::_spawn" => $id, @_;
690 root 1.38
691 root 1.75 "$nodeid#$id"
692 root 1.38 }
693    
694 root 1.59 =item after $timeout, @msg
695    
696     =item after $timeout, $callback
697    
698     Either sends the given message, or call the given callback, after the
699     specified number of seconds.
700    
701 root 1.67 This is simply a utility function that comes in handy at times - the
702     AnyEvent::MP author is not convinced of the wisdom of having it, though,
703     so it may go away in the future.
704 root 1.59
705     =cut
706    
707     sub after($@) {
708     my ($timeout, @action) = @_;
709    
710     my $t; $t = AE::timer $timeout, 0, sub {
711     undef $t;
712     ref $action[0]
713     ? $action[0]()
714     : snd @action;
715     };
716     }
717    
718 root 1.87 =item cal $port, @msg, $callback[, $timeout]
719    
720     A simple form of RPC - sends a message to the given C<$port> with the
721     given contents (C<@msg>), but adds a reply port to the message.
722    
723     The reply port is created temporarily just for the purpose of receiving
724     the reply, and will be C<kil>ed when no longer needed.
725    
726     A reply message sent to the port is passed to the C<$callback> as-is.
727    
728     If an optional time-out (in seconds) is given and it is not C<undef>,
729     then the callback will be called without any arguments after the time-out
730     elapsed and the port is C<kil>ed.
731    
732 root 1.98 If no time-out is given (or it is C<undef>), then the local port will
733     monitor the remote port instead, so it eventually gets cleaned-up.
734 root 1.87
735     Currently this function returns the temporary port, but this "feature"
736     might go in future versions unless you can make a convincing case that
737     this is indeed useful for something.
738    
739     =cut
740    
741     sub cal(@) {
742     my $timeout = ref $_[-1] ? undef : pop;
743     my $cb = pop;
744    
745     my $port = port {
746     undef $timeout;
747     kil $SELF;
748     &$cb;
749     };
750    
751     if (defined $timeout) {
752     $timeout = AE::timer $timeout, 0, sub {
753     undef $timeout;
754     kil $port;
755     $cb->();
756     };
757     } else {
758     mon $_[0], sub {
759     kil $port;
760     $cb->();
761     };
762     }
763    
764     push @_, $port;
765     &snd;
766    
767     $port
768     }
769    
770 root 1.8 =back
771    
772 root 1.26 =head1 AnyEvent::MP vs. Distributed Erlang
773    
774 root 1.35 AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node
775     == aemp node, Erlang process == aemp port), so many of the documents and
776     programming techniques employed by Erlang apply to AnyEvent::MP. Here is a
777 root 1.27 sample:
778    
779 root 1.95 http://www.erlang.se/doc/programming_rules.shtml
780     http://erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4
781     http://erlang.org/download/erlang-book-part1.pdf # chapters 5 and 6
782     http://erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5
783 root 1.27
784     Despite the similarities, there are also some important differences:
785 root 1.26
786     =over 4
787    
788 root 1.65 =item * Node IDs are arbitrary strings in AEMP.
789 root 1.26
790 root 1.65 Erlang relies on special naming and DNS to work everywhere in the same
791     way. AEMP relies on each node somehow knowing its own address(es) (e.g. by
792 root 1.99 configuration or DNS), and possibly the addresses of some seed nodes, but
793     will otherwise discover other nodes (and their IDs) itself.
794 root 1.27
795 root 1.54 =item * Erlang has a "remote ports are like local ports" philosophy, AEMP
796 root 1.51 uses "local ports are like remote ports".
797    
798     The failure modes for local ports are quite different (runtime errors
799     only) then for remote ports - when a local port dies, you I<know> it dies,
800     when a connection to another node dies, you know nothing about the other
801     port.
802    
803     Erlang pretends remote ports are as reliable as local ports, even when
804     they are not.
805    
806     AEMP encourages a "treat remote ports differently" philosophy, with local
807     ports being the special case/exception, where transport errors cannot
808     occur.
809    
810 root 1.26 =item * Erlang uses processes and a mailbox, AEMP does not queue.
811    
812 root 1.51 Erlang uses processes that selectively receive messages, and therefore
813     needs a queue. AEMP is event based, queuing messages would serve no
814     useful purpose. For the same reason the pattern-matching abilities of
815     AnyEvent::MP are more limited, as there is little need to be able to
816 elmex 1.77 filter messages without dequeuing them.
817 root 1.26
818 root 1.35 (But see L<Coro::MP> for a more Erlang-like process model on top of AEMP).
819 root 1.26
820     =item * Erlang sends are synchronous, AEMP sends are asynchronous.
821    
822 root 1.51 Sending messages in Erlang is synchronous and blocks the process (and
823     so does not need a queue that can overflow). AEMP sends are immediate,
824     connection establishment is handled in the background.
825 root 1.26
826 root 1.51 =item * Erlang suffers from silent message loss, AEMP does not.
827 root 1.26
828 root 1.99 Erlang implements few guarantees on messages delivery - messages can get
829     lost without any of the processes realising it (i.e. you send messages a,
830     b, and c, and the other side only receives messages a and c).
831 root 1.26
832 root 1.66 AEMP guarantees correct ordering, and the guarantee that after one message
833     is lost, all following ones sent to the same port are lost as well, until
834     monitoring raises an error, so there are no silent "holes" in the message
835     sequence.
836 root 1.26
837     =item * Erlang can send messages to the wrong port, AEMP does not.
838    
839 root 1.51 In Erlang it is quite likely that a node that restarts reuses a process ID
840     known to other nodes for a completely different process, causing messages
841     destined for that process to end up in an unrelated process.
842 root 1.26
843     AEMP never reuses port IDs, so old messages or old port IDs floating
844     around in the network will not be sent to an unrelated port.
845    
846     =item * Erlang uses unprotected connections, AEMP uses secure
847     authentication and can use TLS.
848    
849 root 1.66 AEMP can use a proven protocol - TLS - to protect connections and
850 root 1.26 securely authenticate nodes.
851    
852 root 1.28 =item * The AEMP protocol is optimised for both text-based and binary
853     communications.
854    
855 root 1.66 The AEMP protocol, unlike the Erlang protocol, supports both programming
856     language independent text-only protocols (good for debugging) and binary,
857 root 1.67 language-specific serialisers (e.g. Storable). By default, unless TLS is
858     used, the protocol is actually completely text-based.
859 root 1.28
860     It has also been carefully designed to be implementable in other languages
861 root 1.66 with a minimum of work while gracefully degrading functionality to make the
862 root 1.28 protocol simple.
863    
864 root 1.35 =item * AEMP has more flexible monitoring options than Erlang.
865    
866     In Erlang, you can chose to receive I<all> exit signals as messages
867     or I<none>, there is no in-between, so monitoring single processes is
868     difficult to implement. Monitoring in AEMP is more flexible than in
869     Erlang, as one can choose between automatic kill, exit message or callback
870     on a per-process basis.
871    
872 root 1.37 =item * Erlang tries to hide remote/local connections, AEMP does not.
873 root 1.35
874 root 1.67 Monitoring in Erlang is not an indicator of process death/crashes, in the
875     same way as linking is (except linking is unreliable in Erlang).
876 root 1.37
877     In AEMP, you don't "look up" registered port names or send to named ports
878     that might or might not be persistent. Instead, you normally spawn a port
879 root 1.67 on the remote node. The init function monitors you, and you monitor the
880     remote port. Since both monitors are local to the node, they are much more
881     reliable (no need for C<spawn_link>).
882 root 1.37
883     This also saves round-trips and avoids sending messages to the wrong port
884     (hard to do in Erlang).
885 root 1.35
886 root 1.26 =back
887    
888 root 1.46 =head1 RATIONALE
889    
890     =over 4
891    
892 root 1.67 =item Why strings for port and node IDs, why not objects?
893 root 1.46
894     We considered "objects", but found that the actual number of methods
895 root 1.67 that can be called are quite low. Since port and node IDs travel over
896 root 1.46 the network frequently, the serialising/deserialising would add lots of
897 root 1.67 overhead, as well as having to keep a proxy object everywhere.
898 root 1.46
899     Strings can easily be printed, easily serialised etc. and need no special
900     procedures to be "valid".
901    
902 root 1.67 And as a result, a miniport consists of a single closure stored in a
903     global hash - it can't become much cheaper.
904 root 1.47
905 root 1.67 =item Why favour JSON, why not a real serialising format such as Storable?
906 root 1.46
907     In fact, any AnyEvent::MP node will happily accept Storable as framing
908     format, but currently there is no way to make a node use Storable by
909 root 1.67 default (although all nodes will accept it).
910 root 1.46
911     The default framing protocol is JSON because a) JSON::XS is many times
912     faster for small messages and b) most importantly, after years of
913     experience we found that object serialisation is causing more problems
914 root 1.67 than it solves: Just like function calls, objects simply do not travel
915 root 1.46 easily over the network, mostly because they will always be a copy, so you
916     always have to re-think your design.
917    
918     Keeping your messages simple, concentrating on data structures rather than
919     objects, will keep your messages clean, tidy and efficient.
920    
921     =back
922    
923 root 1.1 =head1 SEE ALSO
924    
925 root 1.68 L<AnyEvent::MP::Intro> - a gentle introduction.
926    
927     L<AnyEvent::MP::Kernel> - more, lower-level, stuff.
928    
929     L<AnyEvent::MP::Global> - network maintainance and port groups, to find
930     your applications.
931    
932 root 1.81 L<AnyEvent::MP::LogCatcher> - simple service to display log messages from
933     all nodes.
934    
935 root 1.1 L<AnyEvent>.
936    
937     =head1 AUTHOR
938    
939     Marc Lehmann <schmorp@schmorp.de>
940     http://home.schmorp.de/
941    
942     =cut
943    
944     1
945