ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/cvsroot/AnyEvent-MP/MP.pm
(Generate patch)

Comparing cvsroot/AnyEvent-MP/MP.pm (file contents):
Revision 1.127 by root, Sat Mar 3 20:35:10 2012 UTC vs.
Revision 1.136 by root, Wed Mar 21 15:22:16 2012 UTC

35 # destroy a port again 35 # destroy a port again
36 kil $port; # "normal" kill 36 kil $port; # "normal" kill
37 kil $port, my_error => "everything is broken"; # error kill 37 kil $port, my_error => "everything is broken"; # error kill
38 38
39 # monitoring 39 # monitoring
40 mon $localport, $cb->(@msg) # callback is invoked on death 40 mon $port, $cb->(@msg) # callback is invoked on death
41 mon $localport, $otherport # kill otherport on abnormal death 41 mon $port, $localport # kill localport on abnormal death
42 mon $localport, $otherport, @msg # send message on death 42 mon $port, $localport, @msg # send message on death
43 43
44 # temporarily execute code in port context 44 # temporarily execute code in port context
45 peval $port, sub { die "kill the port!" }; 45 peval $port, sub { die "kill the port!" };
46 46
47 # execute callbacks in $SELF port context 47 # execute callbacks in $SELF port context
197 NODE $NODE *SELF node_of after 197 NODE $NODE *SELF node_of after
198 configure 198 configure
199 snd rcv mon mon_guard kil psub peval spawn cal 199 snd rcv mon mon_guard kil psub peval spawn cal
200 port 200 port
201 db_set db_del db_reg 201 db_set db_del db_reg
202 db_mon db_family db_keys db_values
202); 203);
203 204
204our $SELF; 205our $SELF;
205 206
206sub _self_die() { 207sub _self_die() {
246 247
247IF true, then the values specified in the C<configure> will take 248IF true, then the values specified in the C<configure> will take
248precedence over any values configured via the rc file. The default is for 249precedence over any values configured via the rc file. The default is for
249the rc file to override any options specified in the program. 250the rc file to override any options specified in the program.
250 251
251=item secure => $pass->($nodeid) 252=item secure => $pass->(@msg)
252 253
253In addition to specifying a boolean, you can specify a code reference that 254In addition to specifying a boolean, you can specify a code reference that
254is called for every remote execution attempt - the execution request is 255is called for every code execution attempt - the execution request is
255granted iff the callback returns a true value. 256granted iff the callback returns a true value.
257
258Most of the time the callback should look only at
259C<$AnyEvent::MP::Kernel::SRCNODE> to make a decision, and not at the
260actual message (which can be about anything, and is mostly provided for
261diagnostic purposes).
256 262
257See F<semp setsecure> for more info. 263See F<semp setsecure> for more info.
258 264
259=back 265=back
260 266
397 403
398=cut 404=cut
399 405
400sub rcv($@); 406sub rcv($@);
401 407
402sub _kilme { 408my $KILME = sub {
403 die "received message on port without callback"; 409 (my $tag = substr $_[0], 0, 30) =~ s/([\x20-\x7e])/./g;
404} 410 kil $SELF, unhandled_message => "no callback found for message '$tag'";
411};
405 412
406sub port(;&) { 413sub port(;&) {
407 my $id = $UNIQ . ++$ID; 414 my $id = $UNIQ . ++$ID;
408 my $port = "$NODE#$id"; 415 my $port = "$NODE#$id";
409 416
410 rcv $port, shift || \&_kilme; 417 rcv $port, shift || $KILME;
411 418
412 $port 419 $port
413} 420}
414 421
415=item rcv $local_port, $callback->(@msg) 422=item rcv $local_port, $callback->(@msg)
420 427
421The global C<$SELF> (exported by this module) contains C<$port> while 428The global C<$SELF> (exported by this module) contains C<$port> while
422executing the callback. Runtime errors during callback execution will 429executing the callback. Runtime errors during callback execution will
423result in the port being C<kil>ed. 430result in the port being C<kil>ed.
424 431
425The default callback received all messages not matched by a more specific 432The default callback receives all messages not matched by a more specific
426C<tag> match. 433C<tag> match.
427 434
428=item rcv $local_port, tag => $callback->(@msg_without_tag), ... 435=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
429 436
430Register (or replace) callbacks to be called on messages starting with the 437Register (or replace) callbacks to be called on messages starting with the
731will be reported as reason C<< die => $@ >>. 738will be reported as reason C<< die => $@ >>.
732 739
733Transport/communication errors are reported as C<< transport_error => 740Transport/communication errors are reported as C<< transport_error =>
734$message >>. 741$message >>.
735 742
736=cut 743Common idioms:
744
745 # silently remove yourself, do not kill linked ports
746 kil $SELF;
747
748 # report a failure in some detail
749 kil $SELF, failure_mode_1 => "it failed with too high temperature";
750
751 # do not waste much time with killing, just die when something goes wrong
752 open my $fh, "<file"
753 or die "file: $!";
737 754
738=item $port = spawn $node, $initfunc[, @initdata] 755=item $port = spawn $node, $initfunc[, @initdata]
739 756
740Creates a port on the node C<$node> (which can also be a port ID, in which 757Creates a port on the node C<$node> (which can also be a port ID, in which
741case it's the node where that port resides). 758case it's the node where that port resides).
833 ref $action[0] 850 ref $action[0]
834 ? $action[0]() 851 ? $action[0]()
835 : snd @action; 852 : snd @action;
836 }; 853 };
837} 854}
855
856#=item $cb2 = timeout $seconds, $cb[, @args]
838 857
839=item cal $port, @msg, $callback[, $timeout] 858=item cal $port, @msg, $callback[, $timeout]
840 859
841A simple form of RPC - sends a message to the given C<$port> with the 860A simple form of RPC - sends a message to the given C<$port> with the
842given contents (C<@msg>), but adds a reply port to the message. 861given contents (C<@msg>), but adds a reply port to the message.
891=back 910=back
892 911
893=head1 DISTRIBUTED DATABASE 912=head1 DISTRIBUTED DATABASE
894 913
895AnyEvent::MP comes with a simple distributed database. The database will 914AnyEvent::MP comes with a simple distributed database. The database will
896be mirrored asynchronously at all global nodes. Other nodes bind to one of 915be mirrored asynchronously on all global nodes. Other nodes bind to one
897the global nodes for their needs. 916of the global nodes for their needs. Every node has a "local database"
917which contains all the values that are set locally. All local databases
918are merged together to form the global database, which can be queried.
898 919
899The database consists of a two-level hash - a hash contains a hash which 920The database structure is that of a two-level hash - the database hash
900contains values. 921contains hashes which contain values, similarly to a perl hash of hashes,
922i.e.:
923
924 $DATABASE{$family}{$subkey} = $value
901 925
902The top level hash key is called "family", and the second-level hash key 926The top level hash key is called "family", and the second-level hash key
903is called "subkey" or simply "key". 927is called "subkey" or simply "key".
904 928
905The family must be alphanumeric, i.e. start with a letter and consist 929The family must be alphanumeric, i.e. start with a letter and consist
910with the name of the application or module using it. 934with the name of the application or module using it.
911 935
912The subkeys must be non-empty strings, with no further restrictions. 936The subkeys must be non-empty strings, with no further restrictions.
913 937
914The values should preferably be strings, but other perl scalars should 938The values should preferably be strings, but other perl scalars should
915work as well (such as undef, arrays and hashes). 939work as well (such as C<undef>, arrays and hashes).
916 940
917Every database entry is owned by one node - adding the same family/subkey 941Every database entry is owned by one node - adding the same family/subkey
918combination on multiple nodes will not cause discomfort for AnyEvent::MP, 942combination on multiple nodes will not cause discomfort for AnyEvent::MP,
919but the result might be nondeterministic, i.e. the key might have 943but the result might be nondeterministic, i.e. the key might have
920different values on different nodes. 944different values on different nodes.
924pools. For example, a worker port for image scaling might do this: 948pools. For example, a worker port for image scaling might do this:
925 949
926 db_set my_image_scalers => $port; 950 db_set my_image_scalers => $port;
927 951
928And clients looking for an image scaler will want to get the 952And clients looking for an image scaler will want to get the
929C<my_image_scalers> keys: 953C<my_image_scalers> keys from time to time:
930 954
931 db_keys "my_image_scalers" => 60 => sub { 955 db_keys my_image_scalers => sub {
932 #d##TODO# 956 @ports = @{ $_[0] };
957 };
958
959Or better yet, they want to monitor the database family, so they always
960have a reasonable up-to-date copy:
961
962 db_mon my_image_scalers => sub {
963 @ports = keys %{ $_[0] };
964 };
965
966In general, you can set or delete single subkeys, but query and monitor
967whole families only.
968
969If you feel the need to monitor or query a single subkey, try giving it
970it's own family.
933 971
934=over 972=over
935 973
936=item db_set $family => $subkey [=> $value] 974=item db_set $family => $subkey [=> $value]
937 975
938Sets (or replaces) a key to the database - if C<$value> is omitted, 976Sets (or replaces) a key to the database - if C<$value> is omitted,
939C<undef> is used instead. 977C<undef> is used instead.
940 978
941=item db_del $family => $subkey 979=item db_del $family => $subkey...
942 980
943Deletes a key from the database. 981Deletes one or more subkeys from the database family.
944 982
945=item $guard = db_reg $family => $subkey [=> $value] 983=item $guard = db_reg $family => $subkey [=> $value]
946 984
947Sets the key on the database and returns a guard. When the guard is 985Sets the key on the database and returns a guard. When the guard is
948destroyed, the key is deleted from the database. If C<$value> is missing, 986destroyed, the key is deleted from the database. If C<$value> is missing,
949then C<undef> is used. 987then C<undef> is used.
988
989=item db_family $family => $cb->(\%familyhash)
990
991Queries the named database C<$family> and call the callback with the
992family represented as a hash. You can keep and freely modify the hash.
993
994=item db_keys $family => $cb->(\@keys)
995
996Same as C<db_family>, except it only queries the family I<subkeys> and passes
997them as array reference to the callback.
998
999=item db_values $family => $cb->(\@values)
1000
1001Same as C<db_family>, except it only queries the family I<values> and passes them
1002as array reference to the callback.
1003
1004=item $guard = db_mon $family => $cb->($familyhash, \@added, \@changed, \@deleted)
1005
1006Creates a monitor on the given database family. Each time a key is set
1007or or is deleted the callback is called with a hash containing the
1008database family and three lists of added, changed and deleted subkeys,
1009respectively. If no keys have changed then the array reference might be
1010C<undef> or even missing.
1011
1012If not called in void context, a guard object is returned that, when
1013destroyed, stops the monitor.
1014
1015The family hash reference and the key arrays belong to AnyEvent::MP and
1016B<must not be modified or stored> by the callback. When in doubt, make a
1017copy.
1018
1019As soon as possible after the monitoring starts, the callback will be
1020called with the intiial contents of the family, even if it is empty,
1021i.e. there will always be a timely call to the callback with the current
1022contents.
1023
1024It is possible that the callback is called with a change event even though
1025the subkey is already present and the value has not changed.
1026
1027The monitoring stops when the guard object is destroyed.
1028
1029Example: on every change to the family "mygroup", print out all keys.
1030
1031 my $guard = db_mon mygroup => sub {
1032 my ($family, $a, $c, $d) = @_;
1033 print "mygroup members: ", (join " ", keys %$family), "\n";
1034 };
1035
1036Exmaple: wait until the family "My::Module::workers" is non-empty.
1037
1038 my $guard; $guard = db_mon My::Module::workers => sub {
1039 my ($family, $a, $c, $d) = @_;
1040 return unless %$family;
1041 undef $guard;
1042 print "My::Module::workers now nonempty\n";
1043 };
1044
1045Example: print all changes to the family "AnyRvent::Fantasy::Module".
1046
1047 my $guard = db_mon AnyRvent::Fantasy::Module => sub {
1048 my ($family, $a, $c, $d) = @_;
1049
1050 print "+$_=$family->{$_}\n" for @$a;
1051 print "*$_=$family->{$_}\n" for @$c;
1052 print "-$_=$family->{$_}\n" for @$d;
1053 };
950 1054
951=cut 1055=cut
952 1056
953=back 1057=back
954 1058

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines