ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.140 by root, Thu Mar 22 23:47:01 2012 UTC vs.
Revision 1.153 by root, Sat Nov 2 01:30:49 2019 UTC

47 # execute callbacks in $SELF port context 47 # execute callbacks in $SELF port context
48 my $timer = AE::timer 1, 0, psub { 48 my $timer = AE::timer 1, 0, psub {
49 die "kill the port, delayed"; 49 die "kill the port, delayed";
50 }; 50 };
51 51
52 # distributed database - modification
53 db_set $family => $subkey [=> $value] # add a subkey
54 db_del $family => $subkey... # delete one or more subkeys
55 db_reg $family => $port [=> $value] # register a port
56
57 # distributed database - queries
58 db_family $family => $cb->(\%familyhash)
59 db_keys $family => $cb->(\@keys)
60 db_values $family => $cb->(\@values)
61
62 # distributed database - monitoring a family
63 db_mon $family => $cb->(\%familyhash, \@added, \@changed, \@deleted)
64
52=head1 DESCRIPTION 65=head1 DESCRIPTION
53 66
54This module (-family) implements a simple message passing framework. 67This module (-family) implements a simple message passing framework.
55 68
56Despite its simplicity, you can securely message other processes running 69Despite its simplicity, you can securely message other processes running
105each other. To do this, nodes should listen on one or more local transport 118each other. To do this, nodes should listen on one or more local transport
106endpoints - binds. 119endpoints - binds.
107 120
108Currently, only standard C<ip:port> specifications can be used, which 121Currently, only standard C<ip:port> specifications can be used, which
109specify TCP ports to listen on. So a bind is basically just a tcp socket 122specify TCP ports to listen on. So a bind is basically just a tcp socket
110in listening mode thta accepts conenctions form other nodes. 123in listening mode that accepts connections from other nodes.
111 124
112=item seed nodes 125=item seed nodes
113 126
114When a node starts, it knows nothing about the network it is in - it 127When a node starts, it knows nothing about the network it is in - it
115needs to connect to at least one other node that is already in the 128needs to connect to at least one other node that is already in the
116network. These other nodes are called "seed nodes". 129network. These other nodes are called "seed nodes".
117 130
118Seed nodes themselves are not special - they are seed nodes only because 131Seed nodes themselves are not special - they are seed nodes only because
119some other node I<uses> them as such, but any node can be used as seed 132some other node I<uses> them as such, but any node can be used as seed
120node for other nodes, and eahc node cna use a different set of seed nodes. 133node for other nodes, and eahc node can use a different set of seed nodes.
121 134
122In addition to discovering the network, seed nodes are also used to 135In addition to discovering the network, seed nodes are also used to
123maintain the network - all nodes using the same seed node form are part of 136maintain the network - all nodes using the same seed node are part of the
124the same network. If a network is split into multiple subnets because e.g. 137same network. If a network is split into multiple subnets because e.g. the
125the network link between the parts goes down, then using the same seed 138network link between the parts goes down, then using the same seed nodes
126nodes for all nodes ensures that eventually the subnets get merged again. 139for all nodes ensures that eventually the subnets get merged again.
127 140
128Seed nodes are expected to be long-running, and at least one seed node 141Seed nodes are expected to be long-running, and at least one seed node
129should always be available. They should also be relatively responsive - a 142should always be available. They should also be relatively responsive - a
130seed node that blocks for long periods will slow down everybody else. 143seed node that blocks for long periods will slow down everybody else.
131 144
155 168
156Any node that loads the L<AnyEvent::MP::Global> module becomes a global 169Any node that loads the L<AnyEvent::MP::Global> module becomes a global
157node and tries to keep connections to all other nodes. So while it can 170node and tries to keep connections to all other nodes. So while it can
158make sense to make every node "global" in small networks, it usually makes 171make sense to make every node "global" in small networks, it usually makes
159sense to only make seed nodes into global nodes in large networks (nodes 172sense to only make seed nodes into global nodes in large networks (nodes
160keep connections to seed nodes and global nodes, so makign them the same 173keep connections to seed nodes and global nodes, so making them the same
161reduces overhead). 174reduces overhead).
162 175
163=back 176=back
164 177
165=head1 VARIABLES/FUNCTIONS 178=head1 VARIABLES/FUNCTIONS
170 183
171package AnyEvent::MP; 184package AnyEvent::MP;
172 185
173use AnyEvent::MP::Config (); 186use AnyEvent::MP::Config ();
174use AnyEvent::MP::Kernel; 187use AnyEvent::MP::Kernel;
175use AnyEvent::MP::Kernel qw(%NODE %PORT %PORT_DATA $UNIQ $RUNIQ $ID); 188use AnyEvent::MP::Kernel qw(
189 %NODE %PORT %PORT_DATA $UNIQ $RUNIQ $ID
190 add_node load_func
191
192 NODE $NODE
193 configure
194 node_of port_is_local
195 snd kil
196 db_set db_del
197 db_mon db_family db_keys db_values
198);
176 199
177use common::sense; 200use common::sense;
178 201
179use Carp (); 202use Carp ();
180 203
181use AE (); 204use AnyEvent ();
182use Guard (); 205use Guard ();
183 206
184use base "Exporter"; 207use base "Exporter";
185 208
186our $VERSION = $AnyEvent::MP::Config::VERSION; 209our $VERSION = '2.02'; # also in MP/Config.pm
187 210
188our @EXPORT = qw( 211our @EXPORT = qw(
189 NODE $NODE *SELF node_of after
190 configure 212 configure
213
214 NODE $NODE
215 *SELF
216
217 node_of port_is_local
218
219 snd kil
191 snd rcv mon mon_guard kil psub peval spawn cal 220 port rcv mon mon_guard psub peval spawn cal
192 port
193 db_set db_del db_reg 221 db_set db_del db_reg
194 db_mon db_family db_keys db_values 222 db_mon db_family db_keys db_values
223
224 after
195); 225);
196 226
197our $SELF; 227our $SELF;
198 228
199sub _self_die() { 229sub _self_die() {
210 240
211=item $nodeid = node_of $port 241=item $nodeid = node_of $port
212 242
213Extracts and returns the node ID from a port ID or a node ID. 243Extracts and returns the node ID from a port ID or a node ID.
214 244
245=item $is_local = port_is_local $port
246
247Returns true iff the port is a local port.
248
215=item configure $profile, key => value... 249=item configure $profile, key => value...
216 250
217=item configure key => value... 251=item configure key => value...
218 252
219Before a node can talk to other nodes on the network (i.e. enter 253Before a node can talk to other nodes on the network (i.e. enter
230=over 4 264=over 4
231 265
232=item norc => $boolean (default false) 266=item norc => $boolean (default false)
233 267
234If true, then the rc file (e.g. F<~/.perl-anyevent-mp>) will I<not> 268If true, then the rc file (e.g. F<~/.perl-anyevent-mp>) will I<not>
235be consulted - all configuraiton options must be specified in the 269be consulted - all configuration options must be specified in the
236C<configure> call. 270C<configure> call.
237 271
238=item force => $boolean (default false) 272=item force => $boolean (default false)
239 273
240IF true, then the values specified in the C<configure> will take 274IF true, then the values specified in the C<configure> will take
241precedence over any values configured via the rc file. The default is for 275precedence over any values configured via the rc file. The default is for
242the rc file to override any options specified in the program. 276the rc file to override any options specified in the program.
243
244=item secure => $pass->(@msg)
245
246In addition to specifying a boolean, you can specify a code reference that
247is called for every code execution attempt - the execution request is
248granted iff the callback returns a true value.
249
250Most of the time the callback should look only at
251C<$AnyEvent::MP::Kernel::SRCNODE> to make a decision, and not at the
252actual message (which can be about anything, and is mostly provided for
253diagnostic purposes).
254
255See F<semp setsecure> for more info.
256 277
257=back 278=back
258 279
259=over 4 280=over 4
260 281
289 310
290=item step 2, bind listener sockets 311=item step 2, bind listener sockets
291 312
292The next step is to look up the binds in the profile, followed by binding 313The next step is to look up the binds in the profile, followed by binding
293aemp protocol listeners on all binds specified (it is possible and valid 314aemp protocol listeners on all binds specified (it is possible and valid
294to have no binds, meaning that the node cannot be contacted form the 315to have no binds, meaning that the node cannot be contacted from the
295outside. This means the node cannot talk to other nodes that also have no 316outside. This means the node cannot talk to other nodes that also have no
296binds, but it can still talk to all "normal" nodes). 317binds, but it can still talk to all "normal" nodes).
297 318
298If the profile does not specify a binds list, then a default of C<*> is 319If the profile does not specify a binds list, then a default of C<*> is
299used, meaning the node will bind on a dynamically-assigned port on every 320used, meaning the node will bind on a dynamically-assigned port on every
396=cut 417=cut
397 418
398sub rcv($@); 419sub rcv($@);
399 420
400my $KILME = sub { 421my $KILME = sub {
401 (my $tag = substr $_[0], 0, 30) =~ s/([\x20-\x7e])/./g; 422 (my $tag = substr $_[0], 0, 30) =~ s/([^\x20-\x7e])/./g;
402 kil $SELF, unhandled_message => "no callback found for message '$tag'"; 423 kil $SELF, unhandled_message => "no callback found for message '$tag'";
403}; 424};
404 425
405sub port(;&) { 426sub port(;&) {
406 my $id = $UNIQ . ++$ID; 427 my $id = $UNIQ . ++$ID;
464 485
465sub rcv($@) { 486sub rcv($@) {
466 my $port = shift; 487 my $port = shift;
467 my ($nodeid, $portid) = split /#/, $port, 2; 488 my ($nodeid, $portid) = split /#/, $port, 2;
468 489
469 $NODE{$nodeid} == $NODE{""} 490 $nodeid eq $NODE
470 or Carp::croak "$port: rcv can only be called on local ports, caught"; 491 or Carp::croak "$port: rcv can only be called on local ports, caught";
471 492
472 while (@_) { 493 while (@_) {
473 if (ref $_[0]) { 494 if (ref $_[0]) {
474 if (my $self = $PORT_DATA{$portid}) { 495 if (my $self = $PORT_DATA{$portid}) {
517 $port 538 $port
518} 539}
519 540
520=item peval $port, $coderef[, @args] 541=item peval $port, $coderef[, @args]
521 542
522Evaluates the given C<$codref> within the contetx of C<$port>, that is, 543Evaluates the given C<$codref> within the context of C<$port>, that is,
523when the code throews an exception the C<$port> will be killed. 544when the code throws an exception the C<$port> will be killed.
524 545
525Any remaining args will be passed to the callback. Any return values will 546Any remaining args will be passed to the callback. Any return values will
526be returned to the caller. 547be returned to the caller.
527 548
528This is useful when you temporarily want to execute code in the context of 549This is useful when you temporarily want to execute code in the context of
1033=item db_values $family => $cb->(\@values) 1054=item db_values $family => $cb->(\@values)
1034 1055
1035Same as C<db_family>, except it only queries the family I<values> and passes them 1056Same as C<db_family>, except it only queries the family I<values> and passes them
1036as array reference to the callback. 1057as array reference to the callback.
1037 1058
1038=item $guard = db_mon $family => $cb->($familyhash, \@added, \@changed, \@deleted) 1059=item $guard = db_mon $family => $cb->(\%familyhash, \@added, \@changed, \@deleted)
1039 1060
1040Creates a monitor on the given database family. Each time a key is set 1061Creates a monitor on the given database family. Each time a key is
1041or or is deleted the callback is called with a hash containing the 1062set or is deleted the callback is called with a hash containing the
1042database family and three lists of added, changed and deleted subkeys, 1063database family and three lists of added, changed and deleted subkeys,
1043respectively. If no keys have changed then the array reference might be 1064respectively. If no keys have changed then the array reference might be
1044C<undef> or even missing. 1065C<undef> or even missing.
1045 1066
1046If not called in void context, a guard object is returned that, when 1067If not called in void context, a guard object is returned that, when
1074 return unless %$family; 1095 return unless %$family;
1075 undef $guard; 1096 undef $guard;
1076 print "My::Module::workers now nonempty\n"; 1097 print "My::Module::workers now nonempty\n";
1077 }; 1098 };
1078 1099
1079Example: print all changes to the family "AnyRvent::Fantasy::Module". 1100Example: print all changes to the family "AnyEvent::Fantasy::Module".
1080 1101
1081 my $guard = db_mon AnyRvent::Fantasy::Module => sub { 1102 my $guard = db_mon AnyEvent::Fantasy::Module => sub {
1082 my ($family, $a, $c, $d) = @_; 1103 my ($family, $a, $c, $d) = @_;
1083 1104
1084 print "+$_=$family->{$_}\n" for @$a; 1105 print "+$_=$family->{$_}\n" for @$a;
1085 print "*$_=$family->{$_}\n" for @$c; 1106 print "*$_=$family->{$_}\n" for @$c;
1086 print "-$_=$family->{$_}\n" for @$d; 1107 print "-$_=$family->{$_}\n" for @$d;
1137filter messages without dequeuing them. 1158filter messages without dequeuing them.
1138 1159
1139This is not a philosophical difference, but simply stems from AnyEvent::MP 1160This is not a philosophical difference, but simply stems from AnyEvent::MP
1140being event-based, while Erlang is process-based. 1161being event-based, while Erlang is process-based.
1141 1162
1142You cna have a look at L<Coro::MP> for a more Erlang-like process model on 1163You can have a look at L<Coro::MP> for a more Erlang-like process model on
1143top of AEMP and Coro threads. 1164top of AEMP and Coro threads.
1144 1165
1145=item * Erlang sends are synchronous, AEMP sends are asynchronous. 1166=item * Erlang sends are synchronous, AEMP sends are asynchronous.
1146 1167
1147Sending messages in Erlang is synchronous and blocks the process until 1168Sending messages in Erlang is synchronous and blocks the process until
1148a conenction has been established and the message sent (and so does not 1169a connection has been established and the message sent (and so does not
1149need a queue that can overflow). AEMP sends return immediately, connection 1170need a queue that can overflow). AEMP sends return immediately, connection
1150establishment is handled in the background. 1171establishment is handled in the background.
1151 1172
1152=item * Erlang suffers from silent message loss, AEMP does not. 1173=item * Erlang suffers from silent message loss, AEMP does not.
1153 1174
1292C<grp_mon> can be replaced by C<db_mon> with minor changes - C<db_mon> 1313C<grp_mon> can be replaced by C<db_mon> with minor changes - C<db_mon>
1293passes a hash as first argument, and an extra C<$chg> argument that can be 1314passes a hash as first argument, and an extra C<$chg> argument that can be
1294ignored: 1315ignored:
1295 1316
1296 db_mon $group => sub { 1317 db_mon $group => sub {
1297 my ($ports, $add, $chg, $lde) = @_; 1318 my ($ports, $add, $chg, $del) = @_;
1298 $ports = [keys %$ports]; 1319 $ports = [keys %$ports];
1299 1320
1300 # now $ports, $add and $del are the same as 1321 # now $ports, $add and $del are the same as
1301 # were originally passed by grp_mon. 1322 # were originally passed by grp_mon.
1302 ... 1323 ...
1355 1376
1356=back 1377=back
1357 1378
1358=head1 LOGGING 1379=head1 LOGGING
1359 1380
1360AnyEvent::MP does not normally log anything by itself, but sinc eit is the 1381AnyEvent::MP does not normally log anything by itself, but since it is the
1361root of the contetx hierarchy for AnyEvent::MP modules, it will receive 1382root of the context hierarchy for AnyEvent::MP modules, it will receive
1362all log messages by submodules. 1383all log messages by submodules.
1363 1384
1364=head1 SEE ALSO 1385=head1 SEE ALSO
1365 1386
1366L<AnyEvent::MP::Intro> - a gentle introduction. 1387L<AnyEvent::MP::Intro> - a gentle introduction.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines