ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.129 by root, Thu Mar 8 21:37:51 2012 UTC vs.
Revision 1.138 by root, Thu Mar 22 00:48:29 2012 UTC

247 247
248IF true, then the values specified in the C<configure> will take 248IF true, then the values specified in the C<configure> will take
249precedence over any values configured via the rc file. The default is for 249precedence over any values configured via the rc file. The default is for
250the rc file to override any options specified in the program. 250the rc file to override any options specified in the program.
251 251
252=item secure => $pass->($nodeid) 252=item secure => $pass->(@msg)
253 253
254In addition to specifying a boolean, you can specify a code reference that 254In addition to specifying a boolean, you can specify a code reference that
255is called for every remote execution attempt - the execution request is 255is called for every code execution attempt - the execution request is
256granted iff the callback returns a true value. 256granted iff the callback returns a true value.
257
258Most of the time the callback should look only at
259C<$AnyEvent::MP::Kernel::SRCNODE> to make a decision, and not at the
260actual message (which can be about anything, and is mostly provided for
261diagnostic purposes).
257 262
258See F<semp setsecure> for more info. 263See F<semp setsecure> for more info.
259 264
260=back 265=back
261 266
398 403
399=cut 404=cut
400 405
401sub rcv($@); 406sub rcv($@);
402 407
403sub _kilme { 408my $KILME = sub {
404 die "received message on port without callback"; 409 (my $tag = substr $_[0], 0, 30) =~ s/([\x20-\x7e])/./g;
405} 410 kil $SELF, unhandled_message => "no callback found for message '$tag'";
411};
406 412
407sub port(;&) { 413sub port(;&) {
408 my $id = $UNIQ . ++$ID; 414 my $id = $UNIQ . ++$ID;
409 my $port = "$NODE#$id"; 415 my $port = "$NODE#$id";
410 416
411 rcv $port, shift || \&_kilme; 417 rcv $port, shift || $KILME;
412 418
413 $port 419 $port
414} 420}
415 421
416=item rcv $local_port, $callback->(@msg) 422=item rcv $local_port, $callback->(@msg)
421 427
422The global C<$SELF> (exported by this module) contains C<$port> while 428The global C<$SELF> (exported by this module) contains C<$port> while
423executing the callback. Runtime errors during callback execution will 429executing the callback. Runtime errors during callback execution will
424result in the port being C<kil>ed. 430result in the port being C<kil>ed.
425 431
426The default callback received all messages not matched by a more specific 432The default callback receives all messages not matched by a more specific
427C<tag> match. 433C<tag> match.
428 434
429=item rcv $local_port, tag => $callback->(@msg_without_tag), ... 435=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
430 436
431Register (or replace) callbacks to be called on messages starting with the 437Register (or replace) callbacks to be called on messages starting with the
732will be reported as reason C<< die => $@ >>. 738will be reported as reason C<< die => $@ >>.
733 739
734Transport/communication errors are reported as C<< transport_error => 740Transport/communication errors are reported as C<< transport_error =>
735$message >>. 741$message >>.
736 742
737=cut 743Common idioms:
744
745 # silently remove yourself, do not kill linked ports
746 kil $SELF;
747
748 # report a failure in some detail
749 kil $SELF, failure_mode_1 => "it failed with too high temperature";
750
751 # do not waste much time with killing, just die when something goes wrong
752 open my $fh, "<file"
753 or die "file: $!";
738 754
739=item $port = spawn $node, $initfunc[, @initdata] 755=item $port = spawn $node, $initfunc[, @initdata]
740 756
741Creates a port on the node C<$node> (which can also be a port ID, in which 757Creates a port on the node C<$node> (which can also be a port ID, in which
742case it's the node where that port resides). 758case it's the node where that port resides).
894=back 910=back
895 911
896=head1 DISTRIBUTED DATABASE 912=head1 DISTRIBUTED DATABASE
897 913
898AnyEvent::MP comes with a simple distributed database. The database will 914AnyEvent::MP comes with a simple distributed database. The database will
899be mirrored asynchronously at all global nodes. Other nodes bind to one of 915be mirrored asynchronously on all global nodes. Other nodes bind to one
900the global nodes for their needs. 916of the global nodes for their needs. Every node has a "local database"
917which contains all the values that are set locally. All local databases
918are merged together to form the global database, which can be queried.
901 919
902The database consists of a two-level hash - a hash contains a hash which 920The database structure is that of a two-level hash - the database hash
903contains values. 921contains hashes which contain values, similarly to a perl hash of hashes,
922i.e.:
923
924 $DATABASE{$family}{$subkey} = $value
904 925
905The top level hash key is called "family", and the second-level hash key 926The top level hash key is called "family", and the second-level hash key
906is called "subkey" or simply "key". 927is called "subkey" or simply "key".
907 928
908The family must be alphanumeric, i.e. start with a letter and consist 929The family must be alphanumeric, i.e. start with a letter and consist
913with the name of the application or module using it. 934with the name of the application or module using it.
914 935
915The subkeys must be non-empty strings, with no further restrictions. 936The subkeys must be non-empty strings, with no further restrictions.
916 937
917The values should preferably be strings, but other perl scalars should 938The values should preferably be strings, but other perl scalars should
918work as well (such as undef, arrays and hashes). 939work as well (such as C<undef>, arrays and hashes).
919 940
920Every database entry is owned by one node - adding the same family/subkey 941Every database entry is owned by one node - adding the same family/subkey
921combination on multiple nodes will not cause discomfort for AnyEvent::MP, 942combination on multiple nodes will not cause discomfort for AnyEvent::MP,
922but the result might be nondeterministic, i.e. the key might have 943but the result might be nondeterministic, i.e. the key might have
923different values on different nodes. 944different values on different nodes.
948If you feel the need to monitor or query a single subkey, try giving it 969If you feel the need to monitor or query a single subkey, try giving it
949it's own family. 970it's own family.
950 971
951=over 972=over
952 973
953=item db_set $family => $subkey [=> $value] 974=item $guard = db_set $family => $subkey [=> $value]
954 975
955Sets (or replaces) a key to the database - if C<$value> is omitted, 976Sets (or replaces) a key to the database - if C<$value> is omitted,
956C<undef> is used instead. 977C<undef> is used instead.
957 978
979When called in non-void context, C<db_set> returns a guard that
980automatically calls C<db_del> when it is destroyed.
981
958=item db_del $family => $subkey 982=item db_del $family => $subkey...
959 983
960Deletes a key from the database. 984Deletes one or more subkeys from the database family.
961 985
962=item $guard = db_reg $family => $subkey [=> $value] 986=item $guard = db_reg $family => $port => $value
963 987
964Sets the key on the database and returns a guard. When the guard is 988=item $guard = db_reg $family => $port
965destroyed, the key is deleted from the database. If C<$value> is missing, 989
966then C<undef> is used. 990=item $guard = db_reg $family
991
992Registers a port in the given family and optionally returns a guard to
993remove it.
994
995This function basically does the same as:
996
997 db_set $family => $port => $value
998
999Except that the port is monitored and automatically removed from the
1000database family when it is kil'ed.
1001
1002If C<$value> is missing, C<undef> is used. If C<$port> is missing, then
1003C<$SELF> is used.
1004
1005This function is most useful to register a port in some port group (which
1006is just another name for a database family), and have it removed when the
1007port is gone. This works best when the port is a local port.
1008
1009=cut
1010
1011sub db_reg($$;$) {
1012 my $family = shift;
1013 my $port = @_ ? shift : $SELF;
1014
1015 my $clr = sub { db_del $family => $port };
1016 mon $port, $clr;
1017
1018 db_set $family => $port => $_[0];
1019
1020 defined wantarray
1021 and &Guard::guard ($clr)
1022}
967 1023
968=item db_family $family => $cb->(\%familyhash) 1024=item db_family $family => $cb->(\%familyhash)
969 1025
970Queries the named database C<$family> and call the callback with the 1026Queries the named database C<$family> and call the callback with the
971family represented as a hash. You can keep and freely modify the hash. 1027family represented as a hash. You can keep and freely modify the hash.
978=item db_values $family => $cb->(\@values) 1034=item db_values $family => $cb->(\@values)
979 1035
980Same as C<db_family>, except it only queries the family I<values> and passes them 1036Same as C<db_family>, except it only queries the family I<values> and passes them
981as array reference to the callback. 1037as array reference to the callback.
982 1038
983=item $guard = db_mon $family => $cb->($familyhash, \@subkeys...) 1039=item $guard = db_mon $family => $cb->($familyhash, \@added, \@changed, \@deleted)
984 1040
985Creates a monitor on the given database family. Each time a key is set or 1041Creates a monitor on the given database family. Each time a key is set
986or is deleted the callback is called with a hash containing the database 1042or or is deleted the callback is called with a hash containing the
987family and an arrayref with subkeys that have changed. 1043database family and three lists of added, changed and deleted subkeys,
1044respectively. If no keys have changed then the array reference might be
1045C<undef> or even missing.
988 1046
989Specifically, if one of the passed subkeys exists in the $familyhash, then 1047If not called in void context, a guard object is returned that, when
990it is currently set to the value in the $familyhash. Otherwise, it has 1048destroyed, stops the monitor.
991been deleted.
992 1049
993The family hash reference belongs to AnyEvent::MP and B<must not be 1050The family hash reference and the key arrays belong to AnyEvent::MP and
994modified or stored> by the callback. When in doubt, make a copy. 1051B<must not be modified or stored> by the callback. When in doubt, make a
1052copy.
995 1053
996The first call will be with the current contents of the family and all 1054As soon as possible after the monitoring starts, the callback will be
997keys, as if they were just added. 1055called with the intiial contents of the family, even if it is empty,
1056i.e. there will always be a timely call to the callback with the current
1057contents.
998 1058
999It is possible that the callback is called with a change event even though 1059It is possible that the callback is called with a change event even though
1000the subkey is already present and the value has not changed. 1060the subkey is already present and the value has not changed.
1001 1061
1002The monitoring stops when the guard object is destroyed. 1062The monitoring stops when the guard object is destroyed.
1003 1063
1004Example: on every change to the family "mygroup", print out all keys. 1064Example: on every change to the family "mygroup", print out all keys.
1005 1065
1006 my $guard = db_mon mygroup => sub { 1066 my $guard = db_mon mygroup => sub {
1007 my ($family, $keys) = @_; 1067 my ($family, $a, $c, $d) = @_;
1008 print "mygroup members: ", (join " ", keys %$family), "\n"; 1068 print "mygroup members: ", (join " ", keys %$family), "\n";
1009 }; 1069 };
1010 1070
1011Exmaple: wait until the family "My::Module::workers" is non-empty. 1071Exmaple: wait until the family "My::Module::workers" is non-empty.
1012 1072
1013 my $guard; $guard = db_mon My::Module::workers => sub { 1073 my $guard; $guard = db_mon My::Module::workers => sub {
1014 my ($family, $keys) = @_; 1074 my ($family, $a, $c, $d) = @_;
1015 return unless %$family; 1075 return unless %$family;
1016 undef $guard; 1076 undef $guard;
1017 print "My::Module::workers now nonempty\n"; 1077 print "My::Module::workers now nonempty\n";
1018 }; 1078 };
1019 1079
1020Example: print all changes to the family "AnyRvent::Fantasy::Module". 1080Example: print all changes to the family "AnyRvent::Fantasy::Module".
1021 1081
1022 my $guard = db_mon AnyRvent::Fantasy::Module => sub { 1082 my $guard = db_mon AnyRvent::Fantasy::Module => sub {
1023 my ($family, $keys) = @_; 1083 my ($family, $a, $c, $d) = @_;
1024 1084
1025 for (@$keys) { 1085 print "+$_=$family->{$_}\n" for @$a;
1026 print "$_: ", 1086 print "*$_=$family->{$_}\n" for @$c;
1027 (exists $family->{$_} 1087 print "-$_=$family->{$_}\n" for @$d;
1028 ? $family->{$_}
1029 : "(deleted)"),
1030 "\n";
1031 }
1032 }; 1088 };
1033 1089
1034=cut 1090=cut
1035 1091
1036=back 1092=back
1196Keeping your messages simple, concentrating on data structures rather than 1252Keeping your messages simple, concentrating on data structures rather than
1197objects, will keep your messages clean, tidy and efficient. 1253objects, will keep your messages clean, tidy and efficient.
1198 1254
1199=back 1255=back
1200 1256
1257=head1 PORTING FROM AnyEvent::MP VERSION 1.X
1258
1259AEMP version 2 has three major incompatible changes compared to version 1:
1260
1261=over 4
1262
1263=item AnyEvent::MP::Global no longer has group management functions.
1264
1265AnyEvent::MP now comes with a distributed database that is more
1266powerful. It's database families map closely to ports, but the API has
1267minor differences:
1268
1269 grp_reg $group, $port # old
1270 db_reg $group, $port # new
1271
1272 $list = grp_get $group # old
1273 db_keys $group, sub { my $list = shift } # new
1274
1275 grp_mon $group, $cb->(\@ports, $add, $del) # old
1276 db_mon $group, $cb->(\%ports, $add, $change, $del) # new
1277
1278C<grp_reg> is a no-brainer (just replace by C<db_reg>), but C<grp_get>
1279is no longer instant, because the local node might not have a copy of
1280the group. This can be partially remedied by using C<db_mon> to keep an
1281updated copy of the group:
1282
1283 my $local_group_copy;
1284 db_mon $group => sub { $local_group_copy = shift };
1285
1286 # no keys %$local_group_copy always returns the most up-to-date
1287 # list of ports in the group.
1288
1289C<grp_mon> can almost be replaced by C<db_mon>:
1290
1291 db_mon $group => sub {
1292 my ($ports, $add, $chg, $lde) = @_;
1293 $ports = [keys %$ports];
1294
1295 # now $ports, $add and $del are the same as
1296 # were originally passed by grp_mon.
1297 ...
1298 };
1299
1300=item Nodes not longer connect to all other nodes.
1301
1302In AEMP 1.x, every node automatically loads the L<AnyEvent::MP::Global>
1303module, which in turn would create connections to all other nodes in the
1304network (helped by the seed nodes).
1305
1306In version 2.x, global nodes still connect to all other global nodes, but
1307other nodes don't - now every node either is a global node itself, or
1308attaches itself to another global node.
1309
1310If a node isn't a global node itself, then it attaches itself to one
1311of its seed nodes. If that seed node isn't a global node yet, it will
1312automatically be upgraded to a global node.
1313
1314So in many cases, nothing needs to be changed - one just has to make sure
1315that all seed nodes are meshed together with the other seed nodes (as with
1316AEMP 1.x), and other nodes specify them as seed nodes.
1317
1318Not opening a connection to every other node is usually an advantage,
1319except when you need the lower latency of an already established
1320connection. To ensure a node establishes a connection to another node,
1321you can monitor the node port (C<mon $node, ...>), which will attempt to
1322create the connection (and notify you when the connection fails).
1323
1324=item Listener-less nodes (nodes without binds) are gone.
1325
1326And are not coming back, at least not in their old form. If no C<binds>
1327are specified for a node, AnyEvent::MP now assumes a default of C<*:*>.
1328
1329There are vague plans to implement some form of routing domains, which
1330might or might not bring back listener-less nodes, but don't count on it.
1331
1332The fact that most connections are now optional somewhat mitigates this,
1333as a node can be effectively unreachable from the outside without any
1334problems, as long as it isn't a global node and only reaches out to other
1335nodes (as opposed to being contacted from other nodes).
1336
1337=item $AnyEvent::MP::Kernel::WARN has gone.
1338
1339AnyEvent has acquired a logging framework (L<AnyEvent::Log>), and AEMP now
1340uses this, and so should your programs.
1341
1342Every module now documents what kinds of messages it generates, with
1343AnyEvent::MP acting as a catch all.
1344
1345On the positive side, this means that instead of setting
1346C<PERL_ANYEVENT_MP_WARNLEVEL>, you can get away by setting C<AE_VERBOSE>,
1347much less to type.
1348
1349=back
1350
1201=head1 SEE ALSO 1351=head1 SEE ALSO
1202 1352
1203L<AnyEvent::MP::Intro> - a gentle introduction. 1353L<AnyEvent::MP::Intro> - a gentle introduction.
1204 1354
1205L<AnyEvent::MP::Kernel> - more, lower-level, stuff. 1355L<AnyEvent::MP::Kernel> - more, lower-level, stuff.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines