ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.112 by root, Thu Apr 1 19:24:22 2010 UTC vs.
Revision 1.131 by root, Fri Mar 9 19:07:53 2012 UTC

30 rcv $port, pong => sub { warn "pong received\n" }; 30 rcv $port, pong => sub { warn "pong received\n" };
31 31
32 # create a port on another node 32 # create a port on another node
33 my $port = spawn $node, $initfunc, @initdata; 33 my $port = spawn $node, $initfunc, @initdata;
34 34
35 # destroy a prot again 35 # destroy a port again
36 kil $port; # "normal" kill 36 kil $port; # "normal" kill
37 kil $port, my_error => "everything is broken"; # error kill 37 kil $port, my_error => "everything is broken"; # error kill
38 38
39 # monitoring 39 # monitoring
40 mon $localport, $cb->(@msg) # callback is invoked on death 40 mon $port, $cb->(@msg) # callback is invoked on death
41 mon $localport, $otherport # kill otherport on abnormal death 41 mon $port, $localport # kill localport on abnormal death
42 mon $localport, $otherport, @msg # send message on death 42 mon $port, $localport, @msg # send message on death
43 43
44 # temporarily execute code in port context 44 # temporarily execute code in port context
45 peval $port, sub { die "kill the port!" }; 45 peval $port, sub { die "kill the port!" };
46 46
47 # execute callbacks in $SELF port context 47 # execute callbacks in $SELF port context
78 78
79Ports allow you to register C<rcv> handlers that can match all or just 79Ports allow you to register C<rcv> handlers that can match all or just
80some messages. Messages send to ports will not be queued, regardless of 80some messages. Messages send to ports will not be queued, regardless of
81anything was listening for them or not. 81anything was listening for them or not.
82 82
83Ports are represented by (printable) strings called "port IDs".
84
83=item port ID - C<nodeid#portname> 85=item port ID - C<nodeid#portname>
84 86
85A port ID is the concatenation of a node ID, a hash-mark (C<#>) as 87A port ID is the concatenation of a node ID, a hash-mark (C<#>)
86separator, and a port name (a printable string of unspecified format). 88as separator, and a port name (a printable string of unspecified
89format created by AnyEvent::MP).
87 90
88=item node 91=item node
89 92
90A node is a single process containing at least one port - the node port, 93A node is a single process containing at least one port - the node port,
91which enables nodes to manage each other remotely, and to create new 94which enables nodes to manage each other remotely, and to create new
92ports. 95ports.
93 96
94Nodes are either public (have one or more listening ports) or private 97Nodes are either public (have one or more listening ports) or private
95(no listening ports). Private nodes cannot talk to other private nodes 98(no listening ports). Private nodes cannot talk to other private nodes
96currently. 99currently, but all nodes can talk to public nodes.
97 100
101Nodes is represented by (printable) strings called "node IDs".
102
98=item node ID - C<[A-Z_][a-zA-Z0-9_\-.:]*> 103=item node ID - C<[A-Za-z0-9_\-.:]*>
99 104
100A node ID is a string that uniquely identifies the node within a 105A node ID is a string that uniquely identifies the node within a
101network. Depending on the configuration used, node IDs can look like a 106network. Depending on the configuration used, node IDs can look like a
102hostname, a hostname and a port, or a random string. AnyEvent::MP itself 107hostname, a hostname and a port, or a random string. AnyEvent::MP itself
103doesn't interpret node IDs in any way. 108doesn't interpret node IDs in any way except to uniquely identify a node.
104 109
105=item binds - C<ip:port> 110=item binds - C<ip:port>
106 111
107Nodes can only talk to each other by creating some kind of connection to 112Nodes can only talk to each other by creating some kind of connection to
108each other. To do this, nodes should listen on one or more local transport 113each other. To do this, nodes should listen on one or more local transport
114endpoints - binds.
115
109endpoints - binds. Currently, only standard C<ip:port> specifications can 116Currently, only standard C<ip:port> specifications can be used, which
110be used, which specify TCP ports to listen on. 117specify TCP ports to listen on. So a bind is basically just a tcp socket
118in listening mode thta accepts conenctions form other nodes.
111 119
112=item seed nodes 120=item seed nodes
113 121
114When a node starts, it knows nothing about the network. To teach the node 122When a node starts, it knows nothing about the network it is in - it
115about the network it first has to contact some other node within the 123needs to connect to at least one other node that is already in the
116network. This node is called a seed. 124network. These other nodes are called "seed nodes".
117 125
118Apart from the fact that other nodes know them as seed nodes and they have 126Seed nodes themselves are not special - they are seed nodes only because
119to have fixed listening addresses, seed nodes are perfectly normal nodes - 127some other node I<uses> them as such, but any node can be used as seed
120any node can function as a seed node for others. 128node for other nodes, and eahc node cna use a different set of seed nodes.
121 129
122In addition to discovering the network, seed nodes are also used to 130In addition to discovering the network, seed nodes are also used to
123maintain the network and to connect nodes that otherwise would have 131maintain the network - all nodes using the same seed node form are part of
124trouble connecting. They form the backbone of an AnyEvent::MP network. 132the same network. If a network is split into multiple subnets because e.g.
133the network link between the parts goes down, then using the same seed
134nodes for all nodes ensures that eventually the subnets get merged again.
125 135
126Seed nodes are expected to be long-running, and at least one seed node 136Seed nodes are expected to be long-running, and at least one seed node
127should always be available. They should also be relatively responsive - a 137should always be available. They should also be relatively responsive - a
128seed node that blocks for long periods will slow down everybody else. 138seed node that blocks for long periods will slow down everybody else.
129 139
140For small networks, it's best if every node uses the same set of seed
141nodes. For large networks, it can be useful to specify "regional" seed
142nodes for most nodes in an area, and use all seed nodes as seed nodes for
143each other. What's important is that all seed nodes connections form a
144complete graph, so that the network cannot split into separate subnets
145forever.
146
147Seed nodes are represented by seed IDs.
148
130=item seeds - C<host:port> 149=item seed IDs - C<host:port>
131 150
132Seeds are transport endpoint(s) (usually a hostname/IP address and a 151Seed IDs are transport endpoint(s) (usually a hostname/IP address and a
133TCP port) of nodes that should be used as seed nodes. 152TCP port) of nodes that should be used as seed nodes.
134 153
135The nodes listening on those endpoints are expected to be long-running, 154=item global nodes
136and at least one of those should always be available. When nodes run out 155
137of connections (e.g. due to a network error), they try to re-establish 156An AEMP network needs a discovery service - nodes need to know how to
138connections to some seednodes again to join the network. 157connect to other nodes they only know by name. In addition, AEMP offers a
158distributed "group database", which maps group names to a list of strings
159- for example, to register worker ports.
160
161A network needs at least one global node to work, and allows every node to
162be a global node.
163
164Any node that loads the L<AnyEvent::MP::Global> module becomes a global
165node and tries to keep connections to all other nodes. So while it can
166make sense to make every node "global" in small networks, it usually makes
167sense to only make seed nodes into global nodes in large networks (nodes
168keep connections to seed nodes and global nodes, so makign them the same
169reduces overhead).
139 170
140=back 171=back
141 172
142=head1 VARIABLES/FUNCTIONS 173=head1 VARIABLES/FUNCTIONS
143 174
145 176
146=cut 177=cut
147 178
148package AnyEvent::MP; 179package AnyEvent::MP;
149 180
181use AnyEvent::MP::Config ();
150use AnyEvent::MP::Kernel; 182use AnyEvent::MP::Kernel;
183use AnyEvent::MP::Kernel qw(%NODE %PORT %PORT_DATA $UNIQ $RUNIQ $ID);
151 184
152use common::sense; 185use common::sense;
153 186
154use Carp (); 187use Carp ();
155 188
156use AE (); 189use AE ();
190use Guard ();
157 191
158use base "Exporter"; 192use base "Exporter";
159 193
160our $VERSION = 1.28; 194our $VERSION = $AnyEvent::MP::Config::VERSION;
161 195
162our @EXPORT = qw( 196our @EXPORT = qw(
163 NODE $NODE *SELF node_of after 197 NODE $NODE *SELF node_of after
164 configure 198 configure
165 snd rcv mon mon_guard kil psub peval spawn cal 199 snd rcv mon mon_guard kil psub peval spawn cal
166 port 200 port
201 db_set db_del db_reg
202 db_mon db_family db_keys db_values
167); 203);
168 204
169our $SELF; 205our $SELF;
170 206
171sub _self_die() { 207sub _self_die() {
191Before a node can talk to other nodes on the network (i.e. enter 227Before a node can talk to other nodes on the network (i.e. enter
192"distributed mode") it has to configure itself - the minimum a node needs 228"distributed mode") it has to configure itself - the minimum a node needs
193to know is its own name, and optionally it should know the addresses of 229to know is its own name, and optionally it should know the addresses of
194some other nodes in the network to discover other nodes. 230some other nodes in the network to discover other nodes.
195 231
196The key/value pairs are basically the same ones as documented for the
197F<aemp> command line utility (sans the set/del prefix).
198
199This function configures a node - it must be called exactly once (or 232This function configures a node - it must be called exactly once (or
200never) before calling other AnyEvent::MP functions. 233never) before calling other AnyEvent::MP functions.
234
235The key/value pairs are basically the same ones as documented for the
236F<aemp> command line utility (sans the set/del prefix), with these additions:
237
238=over 4
239
240=item norc => $boolean (default false)
241
242If true, then the rc file (e.g. F<~/.perl-anyevent-mp>) will I<not>
243be consulted - all configuraiton options must be specified in the
244C<configure> call.
245
246=item force => $boolean (default false)
247
248IF true, then the values specified in the C<configure> will take
249precedence over any values configured via the rc file. The default is for
250the rc file to override any options specified in the program.
251
252=item secure => $pass->($nodeid)
253
254In addition to specifying a boolean, you can specify a code reference that
255is called for every remote execution attempt - the execution request is
256granted iff the callback returns a true value.
257
258See F<semp setsecure> for more info.
259
260=back
201 261
202=over 4 262=over 4
203 263
204=item step 1, gathering configuration from profiles 264=item step 1, gathering configuration from profiles
205 265
219That means that the values specified in the profile have highest priority 279That means that the values specified in the profile have highest priority
220and the values specified directly via C<configure> have lowest priority, 280and the values specified directly via C<configure> have lowest priority,
221and can only be used to specify defaults. 281and can only be used to specify defaults.
222 282
223If the profile specifies a node ID, then this will become the node ID of 283If the profile specifies a node ID, then this will become the node ID of
224this process. If not, then the profile name will be used as node ID. The 284this process. If not, then the profile name will be used as node ID, with
225special node ID of C<anon/> will be replaced by a random node ID. 285a unique randoms tring (C</%u>) appended.
286
287The node ID can contain some C<%> sequences that are expanded: C<%n>
288is expanded to the local nodename, C<%u> is replaced by a random
289strign to make the node unique. For example, the F<aemp> commandline
290utility uses C<aemp/%n/%u> as nodename, which might expand to
291C<aemp/cerebro/ZQDGSIkRhEZQDGSIkRhE>.
226 292
227=item step 2, bind listener sockets 293=item step 2, bind listener sockets
228 294
229The next step is to look up the binds in the profile, followed by binding 295The next step is to look up the binds in the profile, followed by binding
230aemp protocol listeners on all binds specified (it is possible and valid 296aemp protocol listeners on all binds specified (it is possible and valid
236used, meaning the node will bind on a dynamically-assigned port on every 302used, meaning the node will bind on a dynamically-assigned port on every
237local IP address it finds. 303local IP address it finds.
238 304
239=item step 3, connect to seed nodes 305=item step 3, connect to seed nodes
240 306
241As the last step, the seeds list from the profile is passed to the 307As the last step, the seed ID list from the profile is passed to the
242L<AnyEvent::MP::Global> module, which will then use it to keep 308L<AnyEvent::MP::Global> module, which will then use it to keep
243connectivity with at least one node at any point in time. 309connectivity with at least one node at any point in time.
244 310
245=back 311=back
246 312
247Example: become a distributed node using the local node name as profile. 313Example: become a distributed node using the local node name as profile.
248This should be the most common form of invocation for "daemon"-type nodes. 314This should be the most common form of invocation for "daemon"-type nodes.
249 315
250 configure 316 configure
251 317
252Example: become an anonymous node. This form is often used for commandline 318Example: become a semi-anonymous node. This form is often used for
253clients. 319commandline clients.
254 320
255 configure nodeid => "anon/"; 321 configure nodeid => "myscript/%n/%u";
256 322
257Example: configure a node using a profile called seed, which si suitable 323Example: configure a node using a profile called seed, which is suitable
258for a seed node as it binds on all local addresses on a fixed port (4040, 324for a seed node as it binds on all local addresses on a fixed port (4040,
259customary for aemp). 325customary for aemp).
260 326
261 # use the aemp commandline utility 327 # use the aemp commandline utility
262 # aemp profile seed nodeid anon/ binds '*:4040' 328 # aemp profile seed binds '*:4040'
263 329
264 # then use it 330 # then use it
265 configure profile => "seed"; 331 configure profile => "seed";
266 332
267 # or simply use aemp from the shell again: 333 # or simply use aemp from the shell again:
337sub _kilme { 403sub _kilme {
338 die "received message on port without callback"; 404 die "received message on port without callback";
339} 405}
340 406
341sub port(;&) { 407sub port(;&) {
342 my $id = "$UNIQ." . $ID++; 408 my $id = $UNIQ . ++$ID;
343 my $port = "$NODE#$id"; 409 my $port = "$NODE#$id";
344 410
345 rcv $port, shift || \&_kilme; 411 rcv $port, shift || \&_kilme;
346 412
347 $port 413 $port
495Remembers C<$SELF> and creates a closure out of the BLOCK. When the 561Remembers C<$SELF> and creates a closure out of the BLOCK. When the
496closure is executed, sets up the environment in the same way as in C<rcv> 562closure is executed, sets up the environment in the same way as in C<rcv>
497callbacks, i.e. runtime errors will cause the port to get C<kil>ed. 563callbacks, i.e. runtime errors will cause the port to get C<kil>ed.
498 564
499The effect is basically as if it returned C<< sub { peval $SELF, sub { 565The effect is basically as if it returned C<< sub { peval $SELF, sub {
500BLOCK } } >>. 566BLOCK }, @_ } >>.
501 567
502This is useful when you register callbacks from C<rcv> callbacks: 568This is useful when you register callbacks from C<rcv> callbacks:
503 569
504 rcv delayed_reply => sub { 570 rcv delayed_reply => sub {
505 my ($delay, @reply) = @_; 571 my ($delay, @reply) = @_;
620 } 686 }
621 687
622 $node->monitor ($port, $cb); 688 $node->monitor ($port, $cb);
623 689
624 defined wantarray 690 defined wantarray
625 and ($cb += 0, AnyEvent::Util::guard { $node->unmonitor ($port, $cb) }) 691 and ($cb += 0, Guard::guard { $node->unmonitor ($port, $cb) })
626} 692}
627 693
628=item $guard = mon_guard $port, $ref, $ref... 694=item $guard = mon_guard $port, $ref, $ref...
629 695
630Monitors the given C<$port> and keeps the passed references. When the port 696Monitors the given C<$port> and keeps the passed references. When the port
734} 800}
735 801
736sub spawn(@) { 802sub spawn(@) {
737 my ($nodeid, undef) = split /#/, shift, 2; 803 my ($nodeid, undef) = split /#/, shift, 2;
738 804
739 my $id = "$RUNIQ." . $ID++; 805 my $id = $RUNIQ . ++$ID;
740 806
741 $_[0] =~ /::/ 807 $_[0] =~ /::/
742 or Carp::croak "spawn init function must be a fully-qualified name, caught"; 808 or Carp::croak "spawn init function must be a fully-qualified name, caught";
743 809
744 snd_to_func $nodeid, "AnyEvent::MP::_spawn" => $id, @_; 810 snd_to_func $nodeid, "AnyEvent::MP::_spawn" => $id, @_;
745 811
746 "$nodeid#$id" 812 "$nodeid#$id"
747} 813}
814
748 815
749=item after $timeout, @msg 816=item after $timeout, @msg
750 817
751=item after $timeout, $callback 818=item after $timeout, $callback
752 819
767 ref $action[0] 834 ref $action[0]
768 ? $action[0]() 835 ? $action[0]()
769 : snd @action; 836 : snd @action;
770 }; 837 };
771} 838}
839
840#=item $cb2 = timeout $seconds, $cb[, @args]
772 841
773=item cal $port, @msg, $callback[, $timeout] 842=item cal $port, @msg, $callback[, $timeout]
774 843
775A simple form of RPC - sends a message to the given C<$port> with the 844A simple form of RPC - sends a message to the given C<$port> with the
776given contents (C<@msg>), but adds a reply port to the message. 845given contents (C<@msg>), but adds a reply port to the message.
822 $port 891 $port
823} 892}
824 893
825=back 894=back
826 895
896=head1 DISTRIBUTED DATABASE
897
898AnyEvent::MP comes with a simple distributed database. The database will
899be mirrored asynchronously on all global nodes. Other nodes bind to one
900of the global nodes for their needs. Every node has a "local database"
901which contains all the values that are set locally. All local databases
902are merged together to form the global database, which can be queried.
903
904The database structure is that of a two-level hash - the database hash
905contains hashes which contain values, similarly to a perl hash of hashes,
906i.e.:
907
908 $DATABASE{$family}{$subkey} = $value
909
910The top level hash key is called "family", and the second-level hash key
911is called "subkey" or simply "key".
912
913The family must be alphanumeric, i.e. start with a letter and consist
914of letters, digits, underscores and colons (C<[A-Za-z][A-Za-z0-9_:]*>,
915pretty much like Perl module names.
916
917As the family namespace is global, it is recommended to prefix family names
918with the name of the application or module using it.
919
920The subkeys must be non-empty strings, with no further restrictions.
921
922The values should preferably be strings, but other perl scalars should
923work as well (such as C<undef>, arrays and hashes).
924
925Every database entry is owned by one node - adding the same family/subkey
926combination on multiple nodes will not cause discomfort for AnyEvent::MP,
927but the result might be nondeterministic, i.e. the key might have
928different values on different nodes.
929
930Different subkeys in the same family can be owned by different nodes
931without problems, and in fact, this is the common method to create worker
932pools. For example, a worker port for image scaling might do this:
933
934 db_set my_image_scalers => $port;
935
936And clients looking for an image scaler will want to get the
937C<my_image_scalers> keys from time to time:
938
939 db_keys my_image_scalers => sub {
940 @ports = @{ $_[0] };
941 };
942
943Or better yet, they want to monitor the database family, so they always
944have a reasonable up-to-date copy:
945
946 db_mon my_image_scalers => sub {
947 @ports = keys %{ $_[0] };
948 };
949
950In general, you can set or delete single subkeys, but query and monitor
951whole families only.
952
953If you feel the need to monitor or query a single subkey, try giving it
954it's own family.
955
956=over
957
958=item db_set $family => $subkey [=> $value]
959
960Sets (or replaces) a key to the database - if C<$value> is omitted,
961C<undef> is used instead.
962
963=item db_del $family => $subkey...
964
965Deletes one or more subkeys from the database family.
966
967=item $guard = db_reg $family => $subkey [=> $value]
968
969Sets the key on the database and returns a guard. When the guard is
970destroyed, the key is deleted from the database. If C<$value> is missing,
971then C<undef> is used.
972
973=item db_family $family => $cb->(\%familyhash)
974
975Queries the named database C<$family> and call the callback with the
976family represented as a hash. You can keep and freely modify the hash.
977
978=item db_keys $family => $cb->(\@keys)
979
980Same as C<db_family>, except it only queries the family I<subkeys> and passes
981them as array reference to the callback.
982
983=item db_values $family => $cb->(\@values)
984
985Same as C<db_family>, except it only queries the family I<values> and passes them
986as array reference to the callback.
987
988=item $guard = db_mon $family => $cb->($familyhash, \@added, \@changed, \@deleted)
989
990Creates a monitor on the given database family. Each time a key is set
991or or is deleted the callback is called with a hash containing the
992database family and three lists of added, changed and deleted subkeys,
993respectively. If no keys have changed then the array reference might be
994C<undef> or even missing.
995
996The family hash reference and the key arrays belong to AnyEvent::MP and
997B<must not be modified or stored> by the callback. When in doubt, make a
998copy.
999
1000As soon as possible after the monitoring starts, the callback will be
1001called with the intiial contents of the family, even if it is empty,
1002i.e. there will always be a timely call to the callback with the current
1003contents.
1004
1005It is possible that the callback is called with a change event even though
1006the subkey is already present and the value has not changed.
1007
1008The monitoring stops when the guard object is destroyed.
1009
1010Example: on every change to the family "mygroup", print out all keys.
1011
1012 my $guard = db_mon mygroup => sub {
1013 my ($family, $a, $c, $d) = @_;
1014 print "mygroup members: ", (join " ", keys %$family), "\n";
1015 };
1016
1017Exmaple: wait until the family "My::Module::workers" is non-empty.
1018
1019 my $guard; $guard = db_mon My::Module::workers => sub {
1020 my ($family, $a, $c, $d) = @_;
1021 return unless %$family;
1022 undef $guard;
1023 print "My::Module::workers now nonempty\n";
1024 };
1025
1026Example: print all changes to the family "AnyRvent::Fantasy::Module".
1027
1028 my $guard = db_mon AnyRvent::Fantasy::Module => sub {
1029 my ($family, $a, $c, $d) = @_;
1030
1031 print "+$_=$family->{$_}\n" for @$a;
1032 print "*$_=$family->{$_}\n" for @$c;
1033 print "-$_=$family->{$_}\n" for @$d;
1034 };
1035
1036=cut
1037
1038=back
1039
827=head1 AnyEvent::MP vs. Distributed Erlang 1040=head1 AnyEvent::MP vs. Distributed Erlang
828 1041
829AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node 1042AnyEvent::MP got lots of its ideas from distributed Erlang (Erlang node
830== aemp node, Erlang process == aemp port), so many of the documents and 1043== aemp node, Erlang process == aemp port), so many of the documents and
831programming techniques employed by Erlang apply to AnyEvent::MP. Here is a 1044programming techniques employed by Erlang apply to AnyEvent::MP. Here is a
862ports being the special case/exception, where transport errors cannot 1075ports being the special case/exception, where transport errors cannot
863occur. 1076occur.
864 1077
865=item * Erlang uses processes and a mailbox, AEMP does not queue. 1078=item * Erlang uses processes and a mailbox, AEMP does not queue.
866 1079
867Erlang uses processes that selectively receive messages, and therefore 1080Erlang uses processes that selectively receive messages out of order, and
868needs a queue. AEMP is event based, queuing messages would serve no 1081therefore needs a queue. AEMP is event based, queuing messages would serve
869useful purpose. For the same reason the pattern-matching abilities of 1082no useful purpose. For the same reason the pattern-matching abilities
870AnyEvent::MP are more limited, as there is little need to be able to 1083of AnyEvent::MP are more limited, as there is little need to be able to
871filter messages without dequeuing them. 1084filter messages without dequeuing them.
872 1085
873(But see L<Coro::MP> for a more Erlang-like process model on top of AEMP). 1086This is not a philosophical difference, but simply stems from AnyEvent::MP
1087being event-based, while Erlang is process-based.
1088
1089You cna have a look at L<Coro::MP> for a more Erlang-like process model on
1090top of AEMP and Coro threads.
874 1091
875=item * Erlang sends are synchronous, AEMP sends are asynchronous. 1092=item * Erlang sends are synchronous, AEMP sends are asynchronous.
876 1093
877Sending messages in Erlang is synchronous and blocks the process (and 1094Sending messages in Erlang is synchronous and blocks the process until
1095a conenction has been established and the message sent (and so does not
878so does not need a queue that can overflow). AEMP sends are immediate, 1096need a queue that can overflow). AEMP sends return immediately, connection
879connection establishment is handled in the background. 1097establishment is handled in the background.
880 1098
881=item * Erlang suffers from silent message loss, AEMP does not. 1099=item * Erlang suffers from silent message loss, AEMP does not.
882 1100
883Erlang implements few guarantees on messages delivery - messages can get 1101Erlang implements few guarantees on messages delivery - messages can get
884lost without any of the processes realising it (i.e. you send messages a, 1102lost without any of the processes realising it (i.e. you send messages a,
885b, and c, and the other side only receives messages a and c). 1103b, and c, and the other side only receives messages a and c).
886 1104
887AEMP guarantees correct ordering, and the guarantee that after one message 1105AEMP guarantees (modulo hardware errors) correct ordering, and the
888is lost, all following ones sent to the same port are lost as well, until 1106guarantee that after one message is lost, all following ones sent to the
889monitoring raises an error, so there are no silent "holes" in the message 1107same port are lost as well, until monitoring raises an error, so there are
890sequence. 1108no silent "holes" in the message sequence.
1109
1110If you want your software to be very reliable, you have to cope with
1111corrupted and even out-of-order messages in both Erlang and AEMP. AEMP
1112simply tries to work better in common error cases, such as when a network
1113link goes down.
891 1114
892=item * Erlang can send messages to the wrong port, AEMP does not. 1115=item * Erlang can send messages to the wrong port, AEMP does not.
893 1116
894In Erlang it is quite likely that a node that restarts reuses a process ID 1117In Erlang it is quite likely that a node that restarts reuses an Erlang
895known to other nodes for a completely different process, causing messages 1118process ID known to other nodes for a completely different process,
896destined for that process to end up in an unrelated process. 1119causing messages destined for that process to end up in an unrelated
1120process.
897 1121
898AEMP never reuses port IDs, so old messages or old port IDs floating 1122AEMP does not reuse port IDs, so old messages or old port IDs floating
899around in the network will not be sent to an unrelated port. 1123around in the network will not be sent to an unrelated port.
900 1124
901=item * Erlang uses unprotected connections, AEMP uses secure 1125=item * Erlang uses unprotected connections, AEMP uses secure
902authentication and can use TLS. 1126authentication and can use TLS.
903 1127
906 1130
907=item * The AEMP protocol is optimised for both text-based and binary 1131=item * The AEMP protocol is optimised for both text-based and binary
908communications. 1132communications.
909 1133
910The AEMP protocol, unlike the Erlang protocol, supports both programming 1134The AEMP protocol, unlike the Erlang protocol, supports both programming
911language independent text-only protocols (good for debugging) and binary, 1135language independent text-only protocols (good for debugging), and binary,
912language-specific serialisers (e.g. Storable). By default, unless TLS is 1136language-specific serialisers (e.g. Storable). By default, unless TLS is
913used, the protocol is actually completely text-based. 1137used, the protocol is actually completely text-based.
914 1138
915It has also been carefully designed to be implementable in other languages 1139It has also been carefully designed to be implementable in other languages
916with a minimum of work while gracefully degrading functionality to make the 1140with a minimum of work while gracefully degrading functionality to make the
917protocol simple. 1141protocol simple.
918 1142
919=item * AEMP has more flexible monitoring options than Erlang. 1143=item * AEMP has more flexible monitoring options than Erlang.
920 1144
921In Erlang, you can chose to receive I<all> exit signals as messages 1145In Erlang, you can chose to receive I<all> exit signals as messages or
922or I<none>, there is no in-between, so monitoring single processes is 1146I<none>, there is no in-between, so monitoring single Erlang processes is
923difficult to implement. Monitoring in AEMP is more flexible than in 1147difficult to implement.
924Erlang, as one can choose between automatic kill, exit message or callback 1148
925on a per-process basis. 1149Monitoring in AEMP is more flexible than in Erlang, as one can choose
1150between automatic kill, exit message or callback on a per-port basis.
926 1151
927=item * Erlang tries to hide remote/local connections, AEMP does not. 1152=item * Erlang tries to hide remote/local connections, AEMP does not.
928 1153
929Monitoring in Erlang is not an indicator of process death/crashes, in the 1154Monitoring in Erlang is not an indicator of process death/crashes, in the
930same way as linking is (except linking is unreliable in Erlang). 1155same way as linking is (except linking is unreliable in Erlang).
953 1178
954Strings can easily be printed, easily serialised etc. and need no special 1179Strings can easily be printed, easily serialised etc. and need no special
955procedures to be "valid". 1180procedures to be "valid".
956 1181
957And as a result, a port with just a default receiver consists of a single 1182And as a result, a port with just a default receiver consists of a single
958closure stored in a global hash - it can't become much cheaper. 1183code reference stored in a global hash - it can't become much cheaper.
959 1184
960=item Why favour JSON, why not a real serialising format such as Storable? 1185=item Why favour JSON, why not a real serialising format such as Storable?
961 1186
962In fact, any AnyEvent::MP node will happily accept Storable as framing 1187In fact, any AnyEvent::MP node will happily accept Storable as framing
963format, but currently there is no way to make a node use Storable by 1188format, but currently there is no way to make a node use Storable by
979 1204
980L<AnyEvent::MP::Intro> - a gentle introduction. 1205L<AnyEvent::MP::Intro> - a gentle introduction.
981 1206
982L<AnyEvent::MP::Kernel> - more, lower-level, stuff. 1207L<AnyEvent::MP::Kernel> - more, lower-level, stuff.
983 1208
984L<AnyEvent::MP::Global> - network maintainance and port groups, to find 1209L<AnyEvent::MP::Global> - network maintenance and port groups, to find
985your applications. 1210your applications.
986 1211
987L<AnyEvent::MP::DataConn> - establish data connections between nodes. 1212L<AnyEvent::MP::DataConn> - establish data connections between nodes.
988 1213
989L<AnyEvent::MP::LogCatcher> - simple service to display log messages from 1214L<AnyEvent::MP::LogCatcher> - simple service to display log messages from

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines