ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
Revision: 1.92
Committed: Tue Sep 22 14:13:33 2009 UTC (14 years, 7 months ago) by root
Branch: MAIN
Changes since 1.91: +2 -0 lines
Log Message:
*** empty log message ***

File Contents

# User Rev Content
1 root 1.1 =head1 NAME
2    
3 root 1.89 AnyEvent::MP - erlang-style multi-processing/message-passing framework
4 root 1.1
5     =head1 SYNOPSIS
6    
7     use AnyEvent::MP;
8    
9 root 1.75 $NODE # contains this node's node ID
10     NODE # returns this node's node ID
11 root 1.2
12 root 1.38 $SELF # receiving/own port id in rcv callbacks
13    
14 root 1.48 # initialise the node so it can send/receive messages
15 root 1.72 configure;
16 root 1.48
17 root 1.75 # ports are message destinations
18 root 1.38
19     # sending messages
20 root 1.2 snd $port, type => data...;
21 root 1.38 snd $port, @msg;
22     snd @msg_with_first_element_being_a_port;
23 root 1.2
24 root 1.50 # creating/using ports, the simple way
25 root 1.73 my $simple_port = port { my @msg = @_ };
26 root 1.22
27 root 1.52 # creating/using ports, tagged message matching
28 root 1.38 my $port = port;
29 root 1.73 rcv $port, ping => sub { snd $_[0], "pong" };
30     rcv $port, pong => sub { warn "pong received\n" };
31 root 1.2
32 root 1.48 # create a port on another node
33     my $port = spawn $node, $initfunc, @initdata;
34    
35 root 1.35 # monitoring
36 root 1.90 mon $localport, $cb->(@msg) # callback is invoked on death
37     mon $localport, $otherport # kill otherport on abnormal death
38     mon $localport, $otherport, @msg # send message on death
39 root 1.35
40 root 1.45 =head1 CURRENT STATUS
41    
42 root 1.71 bin/aemp - stable.
43     AnyEvent::MP - stable API, should work.
44 elmex 1.77 AnyEvent::MP::Intro - explains most concepts.
45 root 1.88 AnyEvent::MP::Kernel - mostly stable API.
46     AnyEvent::MP::Global - stable API.
47 root 1.45
48 root 1.1 =head1 DESCRIPTION
49    
50 root 1.2 This module (-family) implements a simple message passing framework.
51    
52     Despite its simplicity, you can securely message other processes running
53 root 1.67 on the same or other hosts, and you can supervise entities remotely.
54 root 1.2
55 root 1.23 For an introduction to this module family, see the L<AnyEvent::MP::Intro>
56 root 1.67 manual page and the examples under F<eg/>.
57 root 1.23
58 root 1.2 =head1 CONCEPTS
59    
60     =over 4
61    
62     =item port
63    
64 root 1.79 Not to be confused with a TCP port, a "port" is something you can send
65     messages to (with the C<snd> function).
66 root 1.29
67 root 1.53 Ports allow you to register C<rcv> handlers that can match all or just
68 root 1.64 some messages. Messages send to ports will not be queued, regardless of
69     anything was listening for them or not.
70 root 1.2
71 root 1.67 =item port ID - C<nodeid#portname>
72 root 1.2
73 root 1.67 A port ID is the concatenation of a node ID, a hash-mark (C<#>) as
74     separator, and a port name (a printable string of unspecified format).
75 root 1.2
76     =item node
77    
78 root 1.53 A node is a single process containing at least one port - the node port,
79 root 1.67 which enables nodes to manage each other remotely, and to create new
80 root 1.53 ports.
81 root 1.2
82 root 1.67 Nodes are either public (have one or more listening ports) or private
83     (no listening ports). Private nodes cannot talk to other private nodes
84     currently.
85 root 1.2
86 root 1.84 =item node ID - C<[A-Z_][a-zA-Z0-9_\-.:]*>
87 root 1.2
88 root 1.64 A node ID is a string that uniquely identifies the node within a
89     network. Depending on the configuration used, node IDs can look like a
90     hostname, a hostname and a port, or a random string. AnyEvent::MP itself
91     doesn't interpret node IDs in any way.
92    
93     =item binds - C<ip:port>
94    
95     Nodes can only talk to each other by creating some kind of connection to
96     each other. To do this, nodes should listen on one or more local transport
97     endpoints - binds. Currently, only standard C<ip:port> specifications can
98     be used, which specify TCP ports to listen on.
99    
100 root 1.83 =item seed nodes
101 root 1.64
102     When a node starts, it knows nothing about the network. To teach the node
103     about the network it first has to contact some other node within the
104     network. This node is called a seed.
105    
106 root 1.83 Apart from the fact that other nodes know them as seed nodes and they have
107     to have fixed listening addresses, seed nodes are perfectly normal nodes -
108     any node can function as a seed node for others.
109    
110     In addition to discovering the network, seed nodes are also used to
111     maintain the network and to connect nodes that otherwise would have
112 root 1.86 trouble connecting. They form the backbone of an AnyEvent::MP network.
113 root 1.83
114     Seed nodes are expected to be long-running, and at least one seed node
115 root 1.85 should always be available. They should also be relatively responsive - a
116     seed node that blocks for long periods will slow down everybody else.
117 root 1.83
118     =item seeds - C<host:port>
119    
120     Seeds are transport endpoint(s) (usually a hostname/IP address and a
121     TCP port) of nodes thta should be used as seed nodes.
122 root 1.29
123 root 1.83 The nodes listening on those endpoints are expected to be long-running,
124     and at least one of those should always be available. When nodes run out
125     of connections (e.g. due to a network error), they try to re-establish
126     connections to some seednodes again to join the network.
127 root 1.67
128 root 1.2 =back
129    
130 root 1.3 =head1 VARIABLES/FUNCTIONS
131 root 1.2
132     =over 4
133    
134 root 1.1 =cut
135    
136     package AnyEvent::MP;
137    
138 root 1.44 use AnyEvent::MP::Kernel;
139 root 1.2
140 root 1.1 use common::sense;
141    
142 root 1.2 use Carp ();
143    
144 root 1.1 use AE ();
145    
146 root 1.2 use base "Exporter";
147    
148 root 1.44 our $VERSION = $AnyEvent::MP::Kernel::VERSION;
149 root 1.43
150 root 1.8 our @EXPORT = qw(
151 root 1.59 NODE $NODE *SELF node_of after
152 root 1.72 configure
153 root 1.91 snd rcv mon mon_guard kil psub spawn cal
154 root 1.22 port
155 root 1.8 );
156 root 1.2
157 root 1.22 our $SELF;
158    
159     sub _self_die() {
160     my $msg = $@;
161     $msg =~ s/\n+$// unless ref $msg;
162     kil $SELF, die => $msg;
163     }
164    
165     =item $thisnode = NODE / $NODE
166    
167 root 1.67 The C<NODE> function returns, and the C<$NODE> variable contains, the node
168 root 1.64 ID of the node running in the current process. This value is initialised by
169 root 1.72 a call to C<configure>.
170 root 1.22
171 root 1.63 =item $nodeid = node_of $port
172 root 1.22
173 root 1.67 Extracts and returns the node ID from a port ID or a node ID.
174 root 1.34
175 root 1.78 =item configure $profile, key => value...
176    
177 root 1.72 =item configure key => value...
178 root 1.34
179 root 1.64 Before a node can talk to other nodes on the network (i.e. enter
180 root 1.72 "distributed mode") it has to configure itself - the minimum a node needs
181 root 1.64 to know is its own name, and optionally it should know the addresses of
182     some other nodes in the network to discover other nodes.
183 root 1.34
184 root 1.72 This function configures a node - it must be called exactly once (or
185 root 1.34 never) before calling other AnyEvent::MP functions.
186    
187 root 1.72 =over 4
188    
189     =item step 1, gathering configuration from profiles
190    
191     The function first looks up a profile in the aemp configuration (see the
192     L<aemp> commandline utility). The profile name can be specified via the
193 root 1.78 named C<profile> parameter or can simply be the first parameter). If it is
194     missing, then the nodename (F<uname -n>) will be used as profile name.
195 root 1.34
196 root 1.72 The profile data is then gathered as follows:
197 root 1.69
198 elmex 1.77 First, all remaining key => value pairs (all of which are conveniently
199 root 1.72 undocumented at the moment) will be interpreted as configuration
200     data. Then they will be overwritten by any values specified in the global
201     default configuration (see the F<aemp> utility), then the chain of
202     profiles chosen by the profile name (and any C<parent> attributes).
203    
204     That means that the values specified in the profile have highest priority
205     and the values specified directly via C<configure> have lowest priority,
206     and can only be used to specify defaults.
207 root 1.49
208 root 1.64 If the profile specifies a node ID, then this will become the node ID of
209     this process. If not, then the profile name will be used as node ID. The
210     special node ID of C<anon/> will be replaced by a random node ID.
211    
212 root 1.72 =item step 2, bind listener sockets
213    
214 root 1.64 The next step is to look up the binds in the profile, followed by binding
215     aemp protocol listeners on all binds specified (it is possible and valid
216     to have no binds, meaning that the node cannot be contacted form the
217     outside. This means the node cannot talk to other nodes that also have no
218     binds, but it can still talk to all "normal" nodes).
219    
220 root 1.70 If the profile does not specify a binds list, then a default of C<*> is
221 root 1.72 used, meaning the node will bind on a dynamically-assigned port on every
222     local IP address it finds.
223    
224     =item step 3, connect to seed nodes
225 root 1.64
226 root 1.72 As the last step, the seeds list from the profile is passed to the
227 root 1.64 L<AnyEvent::MP::Global> module, which will then use it to keep
228 root 1.72 connectivity with at least one node at any point in time.
229 root 1.64
230 root 1.72 =back
231    
232 root 1.87 Example: become a distributed node using the local node name as profile.
233 root 1.72 This should be the most common form of invocation for "daemon"-type nodes.
234 root 1.34
235 root 1.72 configure
236 root 1.34
237 root 1.64 Example: become an anonymous node. This form is often used for commandline
238     clients.
239 root 1.34
240 root 1.72 configure nodeid => "anon/";
241    
242     Example: configure a node using a profile called seed, which si suitable
243     for a seed node as it binds on all local addresses on a fixed port (4040,
244     customary for aemp).
245    
246     # use the aemp commandline utility
247 root 1.74 # aemp profile seed nodeid anon/ binds '*:4040'
248 root 1.72
249     # then use it
250     configure profile => "seed";
251 root 1.34
252 root 1.72 # or simply use aemp from the shell again:
253     # aemp run profile seed
254 root 1.34
255 root 1.72 # or provide a nicer-to-remember nodeid
256     # aemp run profile seed nodeid "$(hostname)"
257 root 1.34
258 root 1.22 =item $SELF
259    
260     Contains the current port id while executing C<rcv> callbacks or C<psub>
261     blocks.
262 root 1.3
263 root 1.67 =item *SELF, SELF, %SELF, @SELF...
264 root 1.22
265     Due to some quirks in how perl exports variables, it is impossible to
266 root 1.67 just export C<$SELF>, all the symbols named C<SELF> are exported by this
267 root 1.22 module, but only C<$SELF> is currently used.
268 root 1.3
269 root 1.33 =item snd $port, type => @data
270 root 1.3
271 root 1.33 =item snd $port, @msg
272 root 1.3
273 root 1.67 Send the given message to the given port, which can identify either a
274     local or a remote port, and must be a port ID.
275 root 1.8
276 root 1.67 While the message can be almost anything, it is highly recommended to
277     use a string as first element (a port ID, or some word that indicates a
278     request type etc.) and to consist if only simple perl values (scalars,
279     arrays, hashes) - if you think you need to pass an object, think again.
280    
281     The message data logically becomes read-only after a call to this
282     function: modifying any argument (or values referenced by them) is
283     forbidden, as there can be considerable time between the call to C<snd>
284     and the time the message is actually being serialised - in fact, it might
285     never be copied as within the same process it is simply handed to the
286     receiving port.
287 root 1.3
288     The type of data you can transfer depends on the transport protocol: when
289     JSON is used, then only strings, numbers and arrays and hashes consisting
290     of those are allowed (no objects). When Storable is used, then anything
291     that Storable can serialise and deserialise is allowed, and for the local
292 root 1.67 node, anything can be passed. Best rely only on the common denominator of
293     these.
294 root 1.3
295 root 1.22 =item $local_port = port
296 root 1.2
297 root 1.50 Create a new local port object and returns its port ID. Initially it has
298     no callbacks set and will throw an error when it receives messages.
299 root 1.10
300 root 1.50 =item $local_port = port { my @msg = @_ }
301 root 1.15
302 root 1.50 Creates a new local port, and returns its ID. Semantically the same as
303     creating a port and calling C<rcv $port, $callback> on it.
304 root 1.15
305 root 1.50 The block will be called for every message received on the port, with the
306     global variable C<$SELF> set to the port ID. Runtime errors will cause the
307     port to be C<kil>ed. The message will be passed as-is, no extra argument
308     (i.e. no port ID) will be passed to the callback.
309 root 1.15
310 root 1.50 If you want to stop/destroy the port, simply C<kil> it:
311 root 1.15
312 root 1.50 my $port = port {
313     my @msg = @_;
314     ...
315     kil $SELF;
316 root 1.15 };
317 root 1.10
318     =cut
319    
320 root 1.33 sub rcv($@);
321    
322 root 1.50 sub _kilme {
323     die "received message on port without callback";
324     }
325    
326 root 1.22 sub port(;&) {
327     my $id = "$UNIQ." . $ID++;
328     my $port = "$NODE#$id";
329    
330 root 1.50 rcv $port, shift || \&_kilme;
331 root 1.10
332 root 1.22 $port
333 root 1.10 }
334    
335 root 1.50 =item rcv $local_port, $callback->(@msg)
336 root 1.31
337 root 1.50 Replaces the default callback on the specified port. There is no way to
338     remove the default callback: use C<sub { }> to disable it, or better
339     C<kil> the port when it is no longer needed.
340 root 1.3
341 root 1.33 The global C<$SELF> (exported by this module) contains C<$port> while
342 root 1.50 executing the callback. Runtime errors during callback execution will
343     result in the port being C<kil>ed.
344 root 1.22
345 root 1.50 The default callback received all messages not matched by a more specific
346     C<tag> match.
347 root 1.22
348 root 1.50 =item rcv $local_port, tag => $callback->(@msg_without_tag), ...
349 root 1.3
350 root 1.54 Register (or replace) callbacks to be called on messages starting with the
351     given tag on the given port (and return the port), or unregister it (when
352     C<$callback> is C<$undef> or missing). There can only be one callback
353     registered for each tag.
354 root 1.3
355 root 1.50 The original message will be passed to the callback, after the first
356     element (the tag) has been removed. The callback will use the same
357     environment as the default callback (see above).
358 root 1.3
359 root 1.36 Example: create a port and bind receivers on it in one go.
360    
361     my $port = rcv port,
362 root 1.50 msg1 => sub { ... },
363     msg2 => sub { ... },
364 root 1.36 ;
365    
366     Example: create a port, bind receivers and send it in a message elsewhere
367     in one go:
368    
369     snd $otherport, reply =>
370     rcv port,
371 root 1.50 msg1 => sub { ... },
372 root 1.36 ...
373     ;
374    
375 root 1.54 Example: temporarily register a rcv callback for a tag matching some port
376     (e.g. for a rpc reply) and unregister it after a message was received.
377    
378     rcv $port, $otherport => sub {
379     my @reply = @_;
380    
381     rcv $SELF, $otherport;
382     };
383    
384 root 1.3 =cut
385    
386     sub rcv($@) {
387 root 1.33 my $port = shift;
388 root 1.75 my ($nodeid, $portid) = split /#/, $port, 2;
389 root 1.3
390 root 1.75 $NODE{$nodeid} == $NODE{""}
391 root 1.33 or Carp::croak "$port: rcv can only be called on local ports, caught";
392 root 1.22
393 root 1.50 while (@_) {
394     if (ref $_[0]) {
395     if (my $self = $PORT_DATA{$portid}) {
396     "AnyEvent::MP::Port" eq ref $self
397     or Carp::croak "$port: rcv can only be called on message matching ports, caught";
398 root 1.33
399 root 1.50 $self->[2] = shift;
400     } else {
401     my $cb = shift;
402     $PORT{$portid} = sub {
403     local $SELF = $port;
404     eval { &$cb }; _self_die if $@;
405     };
406     }
407     } elsif (defined $_[0]) {
408     my $self = $PORT_DATA{$portid} ||= do {
409     my $self = bless [$PORT{$port} || sub { }, { }, $port], "AnyEvent::MP::Port";
410    
411     $PORT{$portid} = sub {
412     local $SELF = $port;
413    
414     if (my $cb = $self->[1]{$_[0]}) {
415     shift;
416     eval { &$cb }; _self_die if $@;
417     } else {
418     &{ $self->[0] };
419 root 1.33 }
420     };
421 root 1.50
422     $self
423 root 1.33 };
424    
425 root 1.50 "AnyEvent::MP::Port" eq ref $self
426     or Carp::croak "$port: rcv can only be called on message matching ports, caught";
427 root 1.22
428 root 1.50 my ($tag, $cb) = splice @_, 0, 2;
429 root 1.33
430 root 1.50 if (defined $cb) {
431     $self->[1]{$tag} = $cb;
432 root 1.33 } else {
433 root 1.50 delete $self->[1]{$tag};
434 root 1.33 }
435 root 1.22 }
436 root 1.3 }
437 root 1.31
438 root 1.33 $port
439 root 1.2 }
440    
441 root 1.22 =item $closure = psub { BLOCK }
442 root 1.2
443 root 1.22 Remembers C<$SELF> and creates a closure out of the BLOCK. When the
444     closure is executed, sets up the environment in the same way as in C<rcv>
445     callbacks, i.e. runtime errors will cause the port to get C<kil>ed.
446    
447     This is useful when you register callbacks from C<rcv> callbacks:
448    
449     rcv delayed_reply => sub {
450     my ($delay, @reply) = @_;
451     my $timer = AE::timer $delay, 0, psub {
452     snd @reply, $SELF;
453     };
454     };
455 root 1.3
456 root 1.8 =cut
457 root 1.3
458 root 1.22 sub psub(&) {
459     my $cb = shift;
460 root 1.3
461 root 1.22 my $port = $SELF
462     or Carp::croak "psub can only be called from within rcv or psub callbacks, not";
463 root 1.1
464 root 1.22 sub {
465     local $SELF = $port;
466 root 1.2
467 root 1.22 if (wantarray) {
468     my @res = eval { &$cb };
469     _self_die if $@;
470     @res
471     } else {
472     my $res = eval { &$cb };
473     _self_die if $@;
474     $res
475     }
476     }
477 root 1.2 }
478    
479 root 1.67 =item $guard = mon $port, $cb->(@reason) # call $cb when $port dies
480 root 1.32
481 root 1.67 =item $guard = mon $port, $rcvport # kill $rcvport when $port dies
482 root 1.36
483 root 1.67 =item $guard = mon $port # kill $SELF when $port dies
484 root 1.32
485 root 1.67 =item $guard = mon $port, $rcvport, @msg # send a message when $port dies
486 root 1.32
487 root 1.42 Monitor the given port and do something when the port is killed or
488     messages to it were lost, and optionally return a guard that can be used
489     to stop monitoring again.
490    
491 root 1.36 In the first form (callback), the callback is simply called with any
492     number of C<@reason> elements (no @reason means that the port was deleted
493 root 1.32 "normally"). Note also that I<< the callback B<must> never die >>, so use
494     C<eval> if unsure.
495    
496 root 1.43 In the second form (another port given), the other port (C<$rcvport>)
497 elmex 1.77 will be C<kil>'ed with C<@reason>, if a @reason was specified, i.e. on
498 root 1.36 "normal" kils nothing happens, while under all other conditions, the other
499     port is killed with the same reason.
500 root 1.32
501 root 1.36 The third form (kill self) is the same as the second form, except that
502     C<$rvport> defaults to C<$SELF>.
503    
504     In the last form (message), a message of the form C<@msg, @reason> will be
505     C<snd>.
506 root 1.32
507 root 1.79 Monitoring-actions are one-shot: once messages are lost (and a monitoring
508     alert was raised), they are removed and will not trigger again.
509    
510 root 1.37 As a rule of thumb, monitoring requests should always monitor a port from
511     a local port (or callback). The reason is that kill messages might get
512     lost, just like any other message. Another less obvious reason is that
513 elmex 1.77 even monitoring requests can get lost (for example, when the connection
514 root 1.37 to the other node goes down permanently). When monitoring a port locally
515     these problems do not exist.
516    
517 root 1.79 C<mon> effectively guarantees that, in the absence of hardware failures,
518     after starting the monitor, either all messages sent to the port will
519     arrive, or the monitoring action will be invoked after possible message
520     loss has been detected. No messages will be lost "in between" (after
521     the first lost message no further messages will be received by the
522     port). After the monitoring action was invoked, further messages might get
523     delivered again.
524    
525     Inter-host-connection timeouts and monitoring depend on the transport
526     used. The only transport currently implemented is TCP, and AnyEvent::MP
527     relies on TCP to detect node-downs (this can take 10-15 minutes on a
528     non-idle connection, and usually around two hours for idle conenctions).
529    
530     This means that monitoring is good for program errors and cleaning up
531     stuff eventually, but they are no replacement for a timeout when you need
532     to ensure some maximum latency.
533    
534 root 1.32 Example: call a given callback when C<$port> is killed.
535    
536     mon $port, sub { warn "port died because of <@_>\n" };
537    
538     Example: kill ourselves when C<$port> is killed abnormally.
539    
540 root 1.36 mon $port;
541 root 1.32
542 root 1.36 Example: send us a restart message when another C<$port> is killed.
543 root 1.32
544     mon $port, $self => "restart";
545    
546     =cut
547    
548     sub mon {
549 root 1.75 my ($nodeid, $port) = split /#/, shift, 2;
550 root 1.32
551 root 1.75 my $node = $NODE{$nodeid} || add_node $nodeid;
552 root 1.32
553 root 1.41 my $cb = @_ ? shift : $SELF || Carp::croak 'mon: called with one argument only, but $SELF not set,';
554 root 1.32
555     unless (ref $cb) {
556     if (@_) {
557     # send a kill info message
558 root 1.41 my (@msg) = ($cb, @_);
559 root 1.32 $cb = sub { snd @msg, @_ };
560     } else {
561     # simply kill other port
562     my $port = $cb;
563     $cb = sub { kil $port, @_ if @_ };
564     }
565     }
566    
567     $node->monitor ($port, $cb);
568    
569 root 1.92 $cb += 0;
570    
571 root 1.32 defined wantarray
572     and AnyEvent::Util::guard { $node->unmonitor ($port, $cb) }
573     }
574    
575     =item $guard = mon_guard $port, $ref, $ref...
576    
577     Monitors the given C<$port> and keeps the passed references. When the port
578     is killed, the references will be freed.
579    
580     Optionally returns a guard that will stop the monitoring.
581    
582     This function is useful when you create e.g. timers or other watchers and
583 root 1.67 want to free them when the port gets killed (note the use of C<psub>):
584 root 1.32
585     $port->rcv (start => sub {
586 root 1.67 my $timer; $timer = mon_guard $port, AE::timer 1, 1, psub {
587 root 1.32 undef $timer if 0.9 < rand;
588     });
589     });
590    
591     =cut
592    
593     sub mon_guard {
594     my ($port, @refs) = @_;
595    
596 root 1.36 #TODO: mon-less form?
597    
598 root 1.32 mon $port, sub { 0 && @refs }
599     }
600    
601 root 1.33 =item kil $port[, @reason]
602 root 1.32
603     Kill the specified port with the given C<@reason>.
604    
605 root 1.67 If no C<@reason> is specified, then the port is killed "normally" (ports
606     monitoring other ports will not necessarily die because a port dies
607     "normally").
608 root 1.32
609     Otherwise, linked ports get killed with the same reason (second form of
610 root 1.67 C<mon>, see above).
611 root 1.32
612     Runtime errors while evaluating C<rcv> callbacks or inside C<psub> blocks
613     will be reported as reason C<< die => $@ >>.
614    
615     Transport/communication errors are reported as C<< transport_error =>
616     $message >>.
617    
618 root 1.38 =cut
619    
620     =item $port = spawn $node, $initfunc[, @initdata]
621    
622     Creates a port on the node C<$node> (which can also be a port ID, in which
623     case it's the node where that port resides).
624    
625 root 1.67 The port ID of the newly created port is returned immediately, and it is
626     possible to immediately start sending messages or to monitor the port.
627 root 1.38
628 root 1.67 After the port has been created, the init function is called on the remote
629     node, in the same context as a C<rcv> callback. This function must be a
630     fully-qualified function name (e.g. C<MyApp::Chat::Server::init>). To
631     specify a function in the main program, use C<::name>.
632 root 1.38
633     If the function doesn't exist, then the node tries to C<require>
634     the package, then the package above the package and so on (e.g.
635     C<MyApp::Chat::Server>, C<MyApp::Chat>, C<MyApp>) until the function
636     exists or it runs out of package names.
637    
638     The init function is then called with the newly-created port as context
639 root 1.82 object (C<$SELF>) and the C<@initdata> values as arguments. It I<must>
640     call one of the C<rcv> functions to set callbacks on C<$SELF>, otherwise
641     the port might not get created.
642 root 1.38
643 root 1.67 A common idiom is to pass a local port, immediately monitor the spawned
644     port, and in the remote init function, immediately monitor the passed
645     local port. This two-way monitoring ensures that both ports get cleaned up
646     when there is a problem.
647 root 1.38
648 root 1.80 C<spawn> guarantees that the C<$initfunc> has no visible effects on the
649     caller before C<spawn> returns (by delaying invocation when spawn is
650     called for the local node).
651    
652 root 1.38 Example: spawn a chat server port on C<$othernode>.
653    
654     # this node, executed from within a port context:
655     my $server = spawn $othernode, "MyApp::Chat::Server::connect", $SELF;
656     mon $server;
657    
658     # init function on C<$othernode>
659     sub connect {
660     my ($srcport) = @_;
661    
662     mon $srcport;
663    
664     rcv $SELF, sub {
665     ...
666     };
667     }
668    
669     =cut
670    
671     sub _spawn {
672     my $port = shift;
673     my $init = shift;
674    
675 root 1.82 # rcv will create the actual port
676 root 1.38 local $SELF = "$NODE#$port";
677     eval {
678     &{ load_func $init }
679     };
680     _self_die if $@;
681     }
682    
683     sub spawn(@) {
684 root 1.75 my ($nodeid, undef) = split /#/, shift, 2;
685 root 1.38
686     my $id = "$RUNIQ." . $ID++;
687    
688 root 1.39 $_[0] =~ /::/
689     or Carp::croak "spawn init function must be a fully-qualified name, caught";
690    
691 root 1.75 snd_to_func $nodeid, "AnyEvent::MP::_spawn" => $id, @_;
692 root 1.38
693 root 1.75 "$nodeid#$id"
694 root 1.38 }
695    
696 root 1.59 =item after $timeout, @msg
697    
698     =item after $timeout, $callback
699    
700     Either sends the given message, or call the given callback, after the
701     specified number of seconds.
702    
703 root 1.67 This is simply a utility function that comes in handy at times - the
704     AnyEvent::MP author is not convinced of the wisdom of having it, though,
705     so it may go away in the future.
706 root 1.59
707     =cut
708    
709     sub after($@) {
710     my ($timeout, @action) = @_;
711    
712     my $t; $t = AE::timer $timeout, 0, sub {
713     undef $t;
714     ref $action[0]
715     ? $action[0]()
716     : snd @action;
717     };
718     }
719    
720 root 1.87 =item cal $port, @msg, $callback[, $timeout]
721    
722     A simple form of RPC - sends a message to the given C<$port> with the
723     given contents (C<@msg>), but adds a reply port to the message.
724    
725     The reply port is created temporarily just for the purpose of receiving
726     the reply, and will be C<kil>ed when no longer needed.
727    
728     A reply message sent to the port is passed to the C<$callback> as-is.
729    
730     If an optional time-out (in seconds) is given and it is not C<undef>,
731     then the callback will be called without any arguments after the time-out
732     elapsed and the port is C<kil>ed.
733    
734     If no time-out is given, then the local port will monitor the remote port
735     instead, so it eventually gets cleaned-up.
736    
737     Currently this function returns the temporary port, but this "feature"
738     might go in future versions unless you can make a convincing case that
739     this is indeed useful for something.
740    
741     =cut
742    
743     sub cal(@) {
744     my $timeout = ref $_[-1] ? undef : pop;
745     my $cb = pop;
746    
747     my $port = port {
748     undef $timeout;
749     kil $SELF;
750     &$cb;
751     };
752    
753     if (defined $timeout) {
754     $timeout = AE::timer $timeout, 0, sub {
755     undef $timeout;
756     kil $port;
757     $cb->();
758     };
759     } else {
760     mon $_[0], sub {
761     kil $port;
762     $cb->();
763     };
764     }
765    
766     push @_, $port;
767     &snd;
768    
769     $port
770     }
771    
772 root 1.8 =back
773    
774 root 1.26 =head1 AnyEvent::MP vs. Distributed Erlang
775    
776 root 1.35 AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node
777     == aemp node, Erlang process == aemp port), so many of the documents and
778     programming techniques employed by Erlang apply to AnyEvent::MP. Here is a
779 root 1.27 sample:
780    
781 root 1.35 http://www.Erlang.se/doc/programming_rules.shtml
782     http://Erlang.org/doc/getting_started/part_frame.html # chapters 3 and 4
783     http://Erlang.org/download/Erlang-book-part1.pdf # chapters 5 and 6
784     http://Erlang.org/download/armstrong_thesis_2003.pdf # chapters 4 and 5
785 root 1.27
786     Despite the similarities, there are also some important differences:
787 root 1.26
788     =over 4
789    
790 root 1.65 =item * Node IDs are arbitrary strings in AEMP.
791 root 1.26
792 root 1.65 Erlang relies on special naming and DNS to work everywhere in the same
793     way. AEMP relies on each node somehow knowing its own address(es) (e.g. by
794 elmex 1.77 configuration or DNS), but will otherwise discover other odes itself.
795 root 1.27
796 root 1.54 =item * Erlang has a "remote ports are like local ports" philosophy, AEMP
797 root 1.51 uses "local ports are like remote ports".
798    
799     The failure modes for local ports are quite different (runtime errors
800     only) then for remote ports - when a local port dies, you I<know> it dies,
801     when a connection to another node dies, you know nothing about the other
802     port.
803    
804     Erlang pretends remote ports are as reliable as local ports, even when
805     they are not.
806    
807     AEMP encourages a "treat remote ports differently" philosophy, with local
808     ports being the special case/exception, where transport errors cannot
809     occur.
810    
811 root 1.26 =item * Erlang uses processes and a mailbox, AEMP does not queue.
812    
813 root 1.51 Erlang uses processes that selectively receive messages, and therefore
814     needs a queue. AEMP is event based, queuing messages would serve no
815     useful purpose. For the same reason the pattern-matching abilities of
816     AnyEvent::MP are more limited, as there is little need to be able to
817 elmex 1.77 filter messages without dequeuing them.
818 root 1.26
819 root 1.35 (But see L<Coro::MP> for a more Erlang-like process model on top of AEMP).
820 root 1.26
821     =item * Erlang sends are synchronous, AEMP sends are asynchronous.
822    
823 root 1.51 Sending messages in Erlang is synchronous and blocks the process (and
824     so does not need a queue that can overflow). AEMP sends are immediate,
825     connection establishment is handled in the background.
826 root 1.26
827 root 1.51 =item * Erlang suffers from silent message loss, AEMP does not.
828 root 1.26
829     Erlang makes few guarantees on messages delivery - messages can get lost
830     without any of the processes realising it (i.e. you send messages a, b,
831     and c, and the other side only receives messages a and c).
832    
833 root 1.66 AEMP guarantees correct ordering, and the guarantee that after one message
834     is lost, all following ones sent to the same port are lost as well, until
835     monitoring raises an error, so there are no silent "holes" in the message
836     sequence.
837 root 1.26
838     =item * Erlang can send messages to the wrong port, AEMP does not.
839    
840 root 1.51 In Erlang it is quite likely that a node that restarts reuses a process ID
841     known to other nodes for a completely different process, causing messages
842     destined for that process to end up in an unrelated process.
843 root 1.26
844     AEMP never reuses port IDs, so old messages or old port IDs floating
845     around in the network will not be sent to an unrelated port.
846    
847     =item * Erlang uses unprotected connections, AEMP uses secure
848     authentication and can use TLS.
849    
850 root 1.66 AEMP can use a proven protocol - TLS - to protect connections and
851 root 1.26 securely authenticate nodes.
852    
853 root 1.28 =item * The AEMP protocol is optimised for both text-based and binary
854     communications.
855    
856 root 1.66 The AEMP protocol, unlike the Erlang protocol, supports both programming
857     language independent text-only protocols (good for debugging) and binary,
858 root 1.67 language-specific serialisers (e.g. Storable). By default, unless TLS is
859     used, the protocol is actually completely text-based.
860 root 1.28
861     It has also been carefully designed to be implementable in other languages
862 root 1.66 with a minimum of work while gracefully degrading functionality to make the
863 root 1.28 protocol simple.
864    
865 root 1.35 =item * AEMP has more flexible monitoring options than Erlang.
866    
867     In Erlang, you can chose to receive I<all> exit signals as messages
868     or I<none>, there is no in-between, so monitoring single processes is
869     difficult to implement. Monitoring in AEMP is more flexible than in
870     Erlang, as one can choose between automatic kill, exit message or callback
871     on a per-process basis.
872    
873 root 1.37 =item * Erlang tries to hide remote/local connections, AEMP does not.
874 root 1.35
875 root 1.67 Monitoring in Erlang is not an indicator of process death/crashes, in the
876     same way as linking is (except linking is unreliable in Erlang).
877 root 1.37
878     In AEMP, you don't "look up" registered port names or send to named ports
879     that might or might not be persistent. Instead, you normally spawn a port
880 root 1.67 on the remote node. The init function monitors you, and you monitor the
881     remote port. Since both monitors are local to the node, they are much more
882     reliable (no need for C<spawn_link>).
883 root 1.37
884     This also saves round-trips and avoids sending messages to the wrong port
885     (hard to do in Erlang).
886 root 1.35
887 root 1.26 =back
888    
889 root 1.46 =head1 RATIONALE
890    
891     =over 4
892    
893 root 1.67 =item Why strings for port and node IDs, why not objects?
894 root 1.46
895     We considered "objects", but found that the actual number of methods
896 root 1.67 that can be called are quite low. Since port and node IDs travel over
897 root 1.46 the network frequently, the serialising/deserialising would add lots of
898 root 1.67 overhead, as well as having to keep a proxy object everywhere.
899 root 1.46
900     Strings can easily be printed, easily serialised etc. and need no special
901     procedures to be "valid".
902    
903 root 1.67 And as a result, a miniport consists of a single closure stored in a
904     global hash - it can't become much cheaper.
905 root 1.47
906 root 1.67 =item Why favour JSON, why not a real serialising format such as Storable?
907 root 1.46
908     In fact, any AnyEvent::MP node will happily accept Storable as framing
909     format, but currently there is no way to make a node use Storable by
910 root 1.67 default (although all nodes will accept it).
911 root 1.46
912     The default framing protocol is JSON because a) JSON::XS is many times
913     faster for small messages and b) most importantly, after years of
914     experience we found that object serialisation is causing more problems
915 root 1.67 than it solves: Just like function calls, objects simply do not travel
916 root 1.46 easily over the network, mostly because they will always be a copy, so you
917     always have to re-think your design.
918    
919     Keeping your messages simple, concentrating on data structures rather than
920     objects, will keep your messages clean, tidy and efficient.
921    
922     =back
923    
924 root 1.1 =head1 SEE ALSO
925    
926 root 1.68 L<AnyEvent::MP::Intro> - a gentle introduction.
927    
928     L<AnyEvent::MP::Kernel> - more, lower-level, stuff.
929    
930     L<AnyEvent::MP::Global> - network maintainance and port groups, to find
931     your applications.
932    
933 root 1.81 L<AnyEvent::MP::LogCatcher> - simple service to display log messages from
934     all nodes.
935    
936 root 1.1 L<AnyEvent>.
937    
938     =head1 AUTHOR
939    
940     Marc Lehmann <schmorp@schmorp.de>
941     http://home.schmorp.de/
942    
943     =cut
944    
945     1
946