ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/cvsroot/AnyEvent-MP/MP.pm
(Generate patch)

Comparing cvsroot/AnyEvent-MP/MP.pm (file contents):
Revision 1.126 by root, Sat Mar 3 19:43:41 2012 UTC vs.
Revision 1.133 by root, Mon Mar 12 10:34:06 2012 UTC

35 # destroy a port again 35 # destroy a port again
36 kil $port; # "normal" kill 36 kil $port; # "normal" kill
37 kil $port, my_error => "everything is broken"; # error kill 37 kil $port, my_error => "everything is broken"; # error kill
38 38
39 # monitoring 39 # monitoring
40 mon $localport, $cb->(@msg) # callback is invoked on death 40 mon $port, $cb->(@msg) # callback is invoked on death
41 mon $localport, $otherport # kill otherport on abnormal death 41 mon $port, $localport # kill localport on abnormal death
42 mon $localport, $otherport, @msg # send message on death 42 mon $port, $localport, @msg # send message on death
43 43
44 # temporarily execute code in port context 44 # temporarily execute code in port context
45 peval $port, sub { die "kill the port!" }; 45 peval $port, sub { die "kill the port!" };
46 46
47 # execute callbacks in $SELF port context 47 # execute callbacks in $SELF port context
197 NODE $NODE *SELF node_of after 197 NODE $NODE *SELF node_of after
198 configure 198 configure
199 snd rcv mon mon_guard kil psub peval spawn cal 199 snd rcv mon mon_guard kil psub peval spawn cal
200 port 200 port
201 db_set db_del db_reg 201 db_set db_del db_reg
202 db_mon db_family db_keys db_values
202); 203);
203 204
204our $SELF; 205our $SELF;
205 206
206sub _self_die() { 207sub _self_die() {
230 231
231This function configures a node - it must be called exactly once (or 232This function configures a node - it must be called exactly once (or
232never) before calling other AnyEvent::MP functions. 233never) before calling other AnyEvent::MP functions.
233 234
234The key/value pairs are basically the same ones as documented for the 235The key/value pairs are basically the same ones as documented for the
235F<aemp> command line utility (sans the set/del prefix), with two additions: 236F<aemp> command line utility (sans the set/del prefix), with these additions:
236 237
237=over 4 238=over 4
238 239
239=item norc => $boolean (default false) 240=item norc => $boolean (default false)
240 241
245=item force => $boolean (default false) 246=item force => $boolean (default false)
246 247
247IF true, then the values specified in the C<configure> will take 248IF true, then the values specified in the C<configure> will take
248precedence over any values configured via the rc file. The default is for 249precedence over any values configured via the rc file. The default is for
249the rc file to override any options specified in the program. 250the rc file to override any options specified in the program.
251
252=item secure => $pass->($nodeid)
253
254In addition to specifying a boolean, you can specify a code reference that
255is called for every remote execution attempt - the execution request is
256granted iff the callback returns a true value.
257
258See F<semp setsecure> for more info.
250 259
251=back 260=back
252 261
253=over 4 262=over 4
254 263
389 398
390=cut 399=cut
391 400
392sub rcv($@); 401sub rcv($@);
393 402
394sub _kilme { 403my $KILME = sub {
395 die "received message on port without callback"; 404 (my $tag = substr $_[0], 0, 30) =~ s/([\x20-\x7e])/./g;
396} 405 kil $SELF, unhandled_message => "no callback set for message (first element $tag)";
406};
397 407
398sub port(;&) { 408sub port(;&) {
399 my $id = $UNIQ . ++$ID; 409 my $id = $UNIQ . ++$ID;
400 my $port = "$NODE#$id"; 410 my $port = "$NODE#$id";
401 411
402 rcv $port, shift || \&_kilme; 412 rcv $port, shift || $KILME;
403 413
404 $port 414 $port
405} 415}
406 416
407=item rcv $local_port, $callback->(@msg) 417=item rcv $local_port, $callback->(@msg)
412 422
413The global C<$SELF> (exported by this module) contains C<$port> while 423The global C<$SELF> (exported by this module) contains C<$port> while
414executing the callback. Runtime errors during callback execution will 424executing the callback. Runtime errors during callback execution will
415result in the port being C<kil>ed. 425result in the port being C<kil>ed.
416 426
417The default callback received all messages not matched by a more specific 427The default callback receives all messages not matched by a more specific
418C<tag> match. 428C<tag> match.
419 429
420=item rcv $local_port, tag => $callback->(@msg_without_tag), ... 430=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
421 431
422Register (or replace) callbacks to be called on messages starting with the 432Register (or replace) callbacks to be called on messages starting with the
723will be reported as reason C<< die => $@ >>. 733will be reported as reason C<< die => $@ >>.
724 734
725Transport/communication errors are reported as C<< transport_error => 735Transport/communication errors are reported as C<< transport_error =>
726$message >>. 736$message >>.
727 737
728=cut 738Common idioms:
739
740 # silently remove yourself, do not kill linked ports
741 kil $SELF;
742
743 # report a failure in some detail
744 kil $SELF, failure_mode_1 => "it failed with too high temperature";
745
746 # do not waste much time with killing, just die when something goes wrong
747 open my $fh, "<file"
748 or die "file: $!";
729 749
730=item $port = spawn $node, $initfunc[, @initdata] 750=item $port = spawn $node, $initfunc[, @initdata]
731 751
732Creates a port on the node C<$node> (which can also be a port ID, in which 752Creates a port on the node C<$node> (which can also be a port ID, in which
733case it's the node where that port resides). 753case it's the node where that port resides).
825 ref $action[0] 845 ref $action[0]
826 ? $action[0]() 846 ? $action[0]()
827 : snd @action; 847 : snd @action;
828 }; 848 };
829} 849}
850
851#=item $cb2 = timeout $seconds, $cb[, @args]
830 852
831=item cal $port, @msg, $callback[, $timeout] 853=item cal $port, @msg, $callback[, $timeout]
832 854
833A simple form of RPC - sends a message to the given C<$port> with the 855A simple form of RPC - sends a message to the given C<$port> with the
834given contents (C<@msg>), but adds a reply port to the message. 856given contents (C<@msg>), but adds a reply port to the message.
883=back 905=back
884 906
885=head1 DISTRIBUTED DATABASE 907=head1 DISTRIBUTED DATABASE
886 908
887AnyEvent::MP comes with a simple distributed database. The database will 909AnyEvent::MP comes with a simple distributed database. The database will
888be mirrored asynchronously at all global nodes. Other nodes bind to one of 910be mirrored asynchronously on all global nodes. Other nodes bind to one
889the global nodes for their needs. 911of the global nodes for their needs. Every node has a "local database"
912which contains all the values that are set locally. All local databases
913are merged together to form the global database, which can be queried.
890 914
891The database consists of a two-level hash - a hash contains a hash which 915The database structure is that of a two-level hash - the database hash
892contains values. 916contains hashes which contain values, similarly to a perl hash of hashes,
917i.e.:
918
919 $DATABASE{$family}{$subkey} = $value
893 920
894The top level hash key is called "family", and the second-level hash key 921The top level hash key is called "family", and the second-level hash key
895is called "subkey" or simply "key". 922is called "subkey" or simply "key".
896 923
897The family must be alphanumeric, i.e. start with a letter and consist 924The family must be alphanumeric, i.e. start with a letter and consist
902with the name of the application or module using it. 929with the name of the application or module using it.
903 930
904The subkeys must be non-empty strings, with no further restrictions. 931The subkeys must be non-empty strings, with no further restrictions.
905 932
906The values should preferably be strings, but other perl scalars should 933The values should preferably be strings, but other perl scalars should
907work as well (such as undef, arrays and hashes). 934work as well (such as C<undef>, arrays and hashes).
908 935
909Every database entry is owned by one node - adding the same family/subkey 936Every database entry is owned by one node - adding the same family/subkey
910combination on multiple nodes will not cause discomfort for AnyEvent::MP, 937combination on multiple nodes will not cause discomfort for AnyEvent::MP,
911but the result might be nondeterministic, i.e. the key might have 938but the result might be nondeterministic, i.e. the key might have
912different values on different nodes. 939different values on different nodes.
916pools. For example, a worker port for image scaling might do this: 943pools. For example, a worker port for image scaling might do this:
917 944
918 db_set my_image_scalers => $port; 945 db_set my_image_scalers => $port;
919 946
920And clients looking for an image scaler will want to get the 947And clients looking for an image scaler will want to get the
921C<my_image_scalers> keys: 948C<my_image_scalers> keys from time to time:
922 949
923 db_keys "my_image_scalers" => 60 => sub { 950 db_keys my_image_scalers => sub {
924 #d##TODO# 951 @ports = @{ $_[0] };
952 };
953
954Or better yet, they want to monitor the database family, so they always
955have a reasonable up-to-date copy:
956
957 db_mon my_image_scalers => sub {
958 @ports = keys %{ $_[0] };
959 };
960
961In general, you can set or delete single subkeys, but query and monitor
962whole families only.
963
964If you feel the need to monitor or query a single subkey, try giving it
965it's own family.
925 966
926=over 967=over
927 968
928=item db_set $family => $subkey [=> $value] 969=item db_set $family => $subkey [=> $value]
929 970
930Sets (or replaces) a key to the database - if C<$value> is omitted, 971Sets (or replaces) a key to the database - if C<$value> is omitted,
931C<undef> is used instead. 972C<undef> is used instead.
932 973
933=item db_del $family => $subkey 974=item db_del $family => $subkey...
934 975
935Deletes a key from the database. 976Deletes one or more subkeys from the database family.
936 977
937=item $guard = db_reg $family => $subkey [=> $value] 978=item $guard = db_reg $family => $subkey [=> $value]
938 979
939Sets the key on the database and returns a guard. When the guard is 980Sets the key on the database and returns a guard. When the guard is
940destroyed, the key is deleted from the database. If C<$value> is missing, 981destroyed, the key is deleted from the database. If C<$value> is missing,
941then C<undef> is used. 982then C<undef> is used.
983
984=item db_family $family => $cb->(\%familyhash)
985
986Queries the named database C<$family> and call the callback with the
987family represented as a hash. You can keep and freely modify the hash.
988
989=item db_keys $family => $cb->(\@keys)
990
991Same as C<db_family>, except it only queries the family I<subkeys> and passes
992them as array reference to the callback.
993
994=item db_values $family => $cb->(\@values)
995
996Same as C<db_family>, except it only queries the family I<values> and passes them
997as array reference to the callback.
998
999=item $guard = db_mon $family => $cb->($familyhash, \@added, \@changed, \@deleted)
1000
1001Creates a monitor on the given database family. Each time a key is set
1002or or is deleted the callback is called with a hash containing the
1003database family and three lists of added, changed and deleted subkeys,
1004respectively. If no keys have changed then the array reference might be
1005C<undef> or even missing.
1006
1007If not called in void context, a guard object is returned that, when
1008destroyed, stops the monitor.
1009
1010The family hash reference and the key arrays belong to AnyEvent::MP and
1011B<must not be modified or stored> by the callback. When in doubt, make a
1012copy.
1013
1014As soon as possible after the monitoring starts, the callback will be
1015called with the intiial contents of the family, even if it is empty,
1016i.e. there will always be a timely call to the callback with the current
1017contents.
1018
1019It is possible that the callback is called with a change event even though
1020the subkey is already present and the value has not changed.
1021
1022The monitoring stops when the guard object is destroyed.
1023
1024Example: on every change to the family "mygroup", print out all keys.
1025
1026 my $guard = db_mon mygroup => sub {
1027 my ($family, $a, $c, $d) = @_;
1028 print "mygroup members: ", (join " ", keys %$family), "\n";
1029 };
1030
1031Exmaple: wait until the family "My::Module::workers" is non-empty.
1032
1033 my $guard; $guard = db_mon My::Module::workers => sub {
1034 my ($family, $a, $c, $d) = @_;
1035 return unless %$family;
1036 undef $guard;
1037 print "My::Module::workers now nonempty\n";
1038 };
1039
1040Example: print all changes to the family "AnyRvent::Fantasy::Module".
1041
1042 my $guard = db_mon AnyRvent::Fantasy::Module => sub {
1043 my ($family, $a, $c, $d) = @_;
1044
1045 print "+$_=$family->{$_}\n" for @$a;
1046 print "*$_=$family->{$_}\n" for @$c;
1047 print "-$_=$family->{$_}\n" for @$d;
1048 };
942 1049
943=cut 1050=cut
944 1051
945=back 1052=back
946 1053

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines