ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent-MP/MP.pm
(Generate patch)

Comparing AnyEvent-MP/MP.pm (file contents):
Revision 1.130 by root, Fri Mar 9 17:05:26 2012 UTC vs.
Revision 1.139 by root, Thu Mar 22 20:07:31 2012 UTC

247 247
248IF true, then the values specified in the C<configure> will take 248IF true, then the values specified in the C<configure> will take
249precedence over any values configured via the rc file. The default is for 249precedence over any values configured via the rc file. The default is for
250the rc file to override any options specified in the program. 250the rc file to override any options specified in the program.
251 251
252=item secure => $pass->($nodeid) 252=item secure => $pass->(@msg)
253 253
254In addition to specifying a boolean, you can specify a code reference that 254In addition to specifying a boolean, you can specify a code reference that
255is called for every remote execution attempt - the execution request is 255is called for every code execution attempt - the execution request is
256granted iff the callback returns a true value. 256granted iff the callback returns a true value.
257
258Most of the time the callback should look only at
259C<$AnyEvent::MP::Kernel::SRCNODE> to make a decision, and not at the
260actual message (which can be about anything, and is mostly provided for
261diagnostic purposes).
257 262
258See F<semp setsecure> for more info. 263See F<semp setsecure> for more info.
259 264
260=back 265=back
261 266
398 403
399=cut 404=cut
400 405
401sub rcv($@); 406sub rcv($@);
402 407
403sub _kilme { 408my $KILME = sub {
404 die "received message on port without callback"; 409 (my $tag = substr $_[0], 0, 30) =~ s/([\x20-\x7e])/./g;
405} 410 kil $SELF, unhandled_message => "no callback found for message '$tag'";
411};
406 412
407sub port(;&) { 413sub port(;&) {
408 my $id = $UNIQ . ++$ID; 414 my $id = $UNIQ . ++$ID;
409 my $port = "$NODE#$id"; 415 my $port = "$NODE#$id";
410 416
411 rcv $port, shift || \&_kilme; 417 rcv $port, shift || $KILME;
412 418
413 $port 419 $port
414} 420}
415 421
416=item rcv $local_port, $callback->(@msg) 422=item rcv $local_port, $callback->(@msg)
421 427
422The global C<$SELF> (exported by this module) contains C<$port> while 428The global C<$SELF> (exported by this module) contains C<$port> while
423executing the callback. Runtime errors during callback execution will 429executing the callback. Runtime errors during callback execution will
424result in the port being C<kil>ed. 430result in the port being C<kil>ed.
425 431
426The default callback received all messages not matched by a more specific 432The default callback receives all messages not matched by a more specific
427C<tag> match. 433C<tag> match.
428 434
429=item rcv $local_port, tag => $callback->(@msg_without_tag), ... 435=item rcv $local_port, tag => $callback->(@msg_without_tag), ...
430 436
431Register (or replace) callbacks to be called on messages starting with the 437Register (or replace) callbacks to be called on messages starting with the
595 $res 601 $res
596 } 602 }
597 } 603 }
598} 604}
599 605
606=item $guard = mon $port, $rcvport # kill $rcvport when $port dies
607
608=item $guard = mon $port # kill $SELF when $port dies
609
600=item $guard = mon $port, $cb->(@reason) # call $cb when $port dies 610=item $guard = mon $port, $cb->(@reason) # call $cb when $port dies
601
602=item $guard = mon $port, $rcvport # kill $rcvport when $port dies
603
604=item $guard = mon $port # kill $SELF when $port dies
605 611
606=item $guard = mon $port, $rcvport, @msg # send a message when $port dies 612=item $guard = mon $port, $rcvport, @msg # send a message when $port dies
607 613
608Monitor the given port and do something when the port is killed or 614Monitor the given port and do something when the port is killed or
609messages to it were lost, and optionally return a guard that can be used 615messages to it were lost, and optionally return a guard that can be used
610to stop monitoring again. 616to stop monitoring again.
611 617
618The first two forms distinguish between "normal" and "abnormal" kil's:
619
620In the first form (another port given), if the C<$port> is C<kil>'ed with
621a non-empty reason, the other port (C<$rcvport>) will be kil'ed with the
622same reason. That is, on "normal" kil's nothing happens, while under all
623other conditions, the other port is killed with the same reason.
624
625The second form (kill self) is the same as the first form, except that
626C<$rvport> defaults to C<$SELF>.
627
628The remaining forms don't distinguish between "normal" and "abnormal" kil's
629- it's up to the callback or receiver to check whether the C<@reason> is
630empty and act accordingly.
631
612In the first form (callback), the callback is simply called with any 632In the third form (callback), the callback is simply called with any
613number of C<@reason> elements (no @reason means that the port was deleted 633number of C<@reason> elements (empty @reason means that the port was deleted
614"normally"). Note also that I<< the callback B<must> never die >>, so use 634"normally"). Note also that I<< the callback B<must> never die >>, so use
615C<eval> if unsure. 635C<eval> if unsure.
616 636
617In the second form (another port given), the other port (C<$rcvport>)
618will be C<kil>'ed with C<@reason>, if a @reason was specified, i.e. on
619"normal" kils nothing happens, while under all other conditions, the other
620port is killed with the same reason.
621
622The third form (kill self) is the same as the second form, except that
623C<$rvport> defaults to C<$SELF>.
624
625In the last form (message), a message of the form C<@msg, @reason> will be 637In the last form (message), a message of the form C<$rcvport, @msg,
626C<snd>. 638@reason> will be C<snd>.
627 639
628Monitoring-actions are one-shot: once messages are lost (and a monitoring 640Monitoring-actions are one-shot: once messages are lost (and a monitoring
629alert was raised), they are removed and will not trigger again. 641alert was raised), they are removed and will not trigger again, even if it
642turns out that the port is still alive.
630 643
631As a rule of thumb, monitoring requests should always monitor a port from 644As a rule of thumb, monitoring requests should always monitor a remote
632a local port (or callback). The reason is that kill messages might get 645port locally (using a local C<$rcvport> or a callback). The reason is that
633lost, just like any other message. Another less obvious reason is that 646kill messages might get lost, just like any other message. Another less
634even monitoring requests can get lost (for example, when the connection 647obvious reason is that even monitoring requests can get lost (for example,
635to the other node goes down permanently). When monitoring a port locally 648when the connection to the other node goes down permanently). When
636these problems do not exist. 649monitoring a port locally these problems do not exist.
637 650
638C<mon> effectively guarantees that, in the absence of hardware failures, 651C<mon> effectively guarantees that, in the absence of hardware failures,
639after starting the monitor, either all messages sent to the port will 652after starting the monitor, either all messages sent to the port will
640arrive, or the monitoring action will be invoked after possible message 653arrive, or the monitoring action will be invoked after possible message
641loss has been detected. No messages will be lost "in between" (after 654loss has been detected. No messages will be lost "in between" (after
732will be reported as reason C<< die => $@ >>. 745will be reported as reason C<< die => $@ >>.
733 746
734Transport/communication errors are reported as C<< transport_error => 747Transport/communication errors are reported as C<< transport_error =>
735$message >>. 748$message >>.
736 749
737=cut 750Common idioms:
751
752 # silently remove yourself, do not kill linked ports
753 kil $SELF;
754
755 # report a failure in some detail
756 kil $SELF, failure_mode_1 => "it failed with too high temperature";
757
758 # do not waste much time with killing, just die when something goes wrong
759 open my $fh, "<file"
760 or die "file: $!";
738 761
739=item $port = spawn $node, $initfunc[, @initdata] 762=item $port = spawn $node, $initfunc[, @initdata]
740 763
741Creates a port on the node C<$node> (which can also be a port ID, in which 764Creates a port on the node C<$node> (which can also be a port ID, in which
742case it's the node where that port resides). 765case it's the node where that port resides).
894=back 917=back
895 918
896=head1 DISTRIBUTED DATABASE 919=head1 DISTRIBUTED DATABASE
897 920
898AnyEvent::MP comes with a simple distributed database. The database will 921AnyEvent::MP comes with a simple distributed database. The database will
899be mirrored asynchronously at all global nodes. Other nodes bind to one of 922be mirrored asynchronously on all global nodes. Other nodes bind to one
900the global nodes for their needs. 923of the global nodes for their needs. Every node has a "local database"
924which contains all the values that are set locally. All local databases
925are merged together to form the global database, which can be queried.
901 926
902The database consists of a two-level hash - a hash contains a hash which 927The database structure is that of a two-level hash - the database hash
903contains values. 928contains hashes which contain values, similarly to a perl hash of hashes,
929i.e.:
930
931 $DATABASE{$family}{$subkey} = $value
904 932
905The top level hash key is called "family", and the second-level hash key 933The top level hash key is called "family", and the second-level hash key
906is called "subkey" or simply "key". 934is called "subkey" or simply "key".
907 935
908The family must be alphanumeric, i.e. start with a letter and consist 936The family must be alphanumeric, i.e. start with a letter and consist
913with the name of the application or module using it. 941with the name of the application or module using it.
914 942
915The subkeys must be non-empty strings, with no further restrictions. 943The subkeys must be non-empty strings, with no further restrictions.
916 944
917The values should preferably be strings, but other perl scalars should 945The values should preferably be strings, but other perl scalars should
918work as well (such as undef, arrays and hashes). 946work as well (such as C<undef>, arrays and hashes).
919 947
920Every database entry is owned by one node - adding the same family/subkey 948Every database entry is owned by one node - adding the same family/subkey
921combination on multiple nodes will not cause discomfort for AnyEvent::MP, 949combination on multiple nodes will not cause discomfort for AnyEvent::MP,
922but the result might be nondeterministic, i.e. the key might have 950but the result might be nondeterministic, i.e. the key might have
923different values on different nodes. 951different values on different nodes.
948If you feel the need to monitor or query a single subkey, try giving it 976If you feel the need to monitor or query a single subkey, try giving it
949it's own family. 977it's own family.
950 978
951=over 979=over
952 980
953=item db_set $family => $subkey [=> $value] 981=item $guard = db_set $family => $subkey [=> $value]
954 982
955Sets (or replaces) a key to the database - if C<$value> is omitted, 983Sets (or replaces) a key to the database - if C<$value> is omitted,
956C<undef> is used instead. 984C<undef> is used instead.
957 985
986When called in non-void context, C<db_set> returns a guard that
987automatically calls C<db_del> when it is destroyed.
988
958=item db_del $family => $subkey... 989=item db_del $family => $subkey...
959 990
960Deletes one or more subkeys from the database family. 991Deletes one or more subkeys from the database family.
961 992
962=item $guard = db_reg $family => $subkey [=> $value] 993=item $guard = db_reg $family => $port => $value
963 994
964Sets the key on the database and returns a guard. When the guard is 995=item $guard = db_reg $family => $port
965destroyed, the key is deleted from the database. If C<$value> is missing, 996
966then C<undef> is used. 997=item $guard = db_reg $family
998
999Registers a port in the given family and optionally returns a guard to
1000remove it.
1001
1002This function basically does the same as:
1003
1004 db_set $family => $port => $value
1005
1006Except that the port is monitored and automatically removed from the
1007database family when it is kil'ed.
1008
1009If C<$value> is missing, C<undef> is used. If C<$port> is missing, then
1010C<$SELF> is used.
1011
1012This function is most useful to register a port in some port group (which
1013is just another name for a database family), and have it removed when the
1014port is gone. This works best when the port is a local port.
1015
1016=cut
1017
1018sub db_reg($$;$) {
1019 my $family = shift;
1020 my $port = @_ ? shift : $SELF;
1021
1022 my $clr = sub { db_del $family => $port };
1023 mon $port, $clr;
1024
1025 db_set $family => $port => $_[0];
1026
1027 defined wantarray
1028 and &Guard::guard ($clr)
1029}
967 1030
968=item db_family $family => $cb->(\%familyhash) 1031=item db_family $family => $cb->(\%familyhash)
969 1032
970Queries the named database C<$family> and call the callback with the 1033Queries the named database C<$family> and call the callback with the
971family represented as a hash. You can keep and freely modify the hash. 1034family represented as a hash. You can keep and freely modify the hash.
985Creates a monitor on the given database family. Each time a key is set 1048Creates a monitor on the given database family. Each time a key is set
986or or is deleted the callback is called with a hash containing the 1049or or is deleted the callback is called with a hash containing the
987database family and three lists of added, changed and deleted subkeys, 1050database family and three lists of added, changed and deleted subkeys,
988respectively. If no keys have changed then the array reference might be 1051respectively. If no keys have changed then the array reference might be
989C<undef> or even missing. 1052C<undef> or even missing.
1053
1054If not called in void context, a guard object is returned that, when
1055destroyed, stops the monitor.
990 1056
991The family hash reference and the key arrays belong to AnyEvent::MP and 1057The family hash reference and the key arrays belong to AnyEvent::MP and
992B<must not be modified or stored> by the callback. When in doubt, make a 1058B<must not be modified or stored> by the callback. When in doubt, make a
993copy. 1059copy.
994 1060
1193Keeping your messages simple, concentrating on data structures rather than 1259Keeping your messages simple, concentrating on data structures rather than
1194objects, will keep your messages clean, tidy and efficient. 1260objects, will keep your messages clean, tidy and efficient.
1195 1261
1196=back 1262=back
1197 1263
1264=head1 PORTING FROM AnyEvent::MP VERSION 1.X
1265
1266AEMP version 2 has a few major incompatible changes compared to version 1:
1267
1268=over 4
1269
1270=item AnyEvent::MP::Global no longer has group management functions.
1271
1272AnyEvent::MP now comes with a distributed database that is more
1273powerful. Its database families map closely to port groups, but the API
1274has changed (the functions are also now exported by AnyEvent::MP). Here is
1275a rough porting guide:
1276
1277 grp_reg $group, $port # old
1278 db_reg $group, $port # new
1279
1280 $list = grp_get $group # old
1281 db_keys $group, sub { my $list = shift } # new
1282
1283 grp_mon $group, $cb->(\@ports, $add, $del) # old
1284 db_mon $group, $cb->(\%ports, $add, $change, $del) # new
1285
1286C<grp_reg> is a no-brainer (just replace by C<db_reg>), but C<grp_get> is
1287no longer instant, because the local node might not have a copy of the
1288group. You can either modify your code to allow for a callback, or use
1289C<db_mon> to keep an updated copy of the group:
1290
1291 my $local_group_copy;
1292 db_mon $group => sub { $local_group_copy = $_[0] };
1293
1294 # now "keys %$local_group_copy" always returns the most up-to-date
1295 # list of ports in the group.
1296
1297C<grp_mon> can be replaced by C<db_mon> with minor changes - C<db_mon>
1298passes a hash as first argument, and an extra C<$chg> argument that can be
1299ignored:
1300
1301 db_mon $group => sub {
1302 my ($ports, $add, $chg, $lde) = @_;
1303 $ports = [keys %$ports];
1304
1305 # now $ports, $add and $del are the same as
1306 # were originally passed by grp_mon.
1307 ...
1308 };
1309
1310=item Nodes not longer connect to all other nodes.
1311
1312In AEMP 1.x, every node automatically loads the L<AnyEvent::MP::Global>
1313module, which in turn would create connections to all other nodes in the
1314network (helped by the seed nodes).
1315
1316In version 2.x, global nodes still connect to all other global nodes, but
1317other nodes don't - now every node either is a global node itself, or
1318attaches itself to another global node.
1319
1320If a node isn't a global node itself, then it attaches itself to one
1321of its seed nodes. If that seed node isn't a global node yet, it will
1322automatically be upgraded to a global node.
1323
1324So in many cases, nothing needs to be changed - one just has to make sure
1325that all seed nodes are meshed together with the other seed nodes (as with
1326AEMP 1.x), and other nodes specify them as seed nodes. This is most easily
1327achieved by specifying the same set of seed nodes for all nodes in the
1328network.
1329
1330Not opening a connection to every other node is usually an advantage,
1331except when you need the lower latency of an already established
1332connection. To ensure a node establishes a connection to another node,
1333you can monitor the node port (C<mon $node, ...>), which will attempt to
1334create the connection (and notify you when the connection fails).
1335
1336=item Listener-less nodes (nodes without binds) are gone.
1337
1338And are not coming back, at least not in their old form. If no C<binds>
1339are specified for a node, AnyEvent::MP assumes a default of C<*:*>.
1340
1341There are vague plans to implement some form of routing domains, which
1342might or might not bring back listener-less nodes, but don't count on it.
1343
1344The fact that most connections are now optional somewhat mitigates this,
1345as a node can be effectively unreachable from the outside without any
1346problems, as long as it isn't a global node and only reaches out to other
1347nodes (as opposed to being contacted from other nodes).
1348
1349=item $AnyEvent::MP::Kernel::WARN has gone.
1350
1351AnyEvent has acquired a logging framework (L<AnyEvent::Log>), and AEMP now
1352uses this, and so should your programs.
1353
1354Every module now documents what kinds of messages it generates, with
1355AnyEvent::MP acting as a catch all.
1356
1357On the positive side, this means that instead of setting
1358C<PERL_ANYEVENT_MP_WARNLEVEL>, you can get away by setting C<AE_VERBOSE> -
1359much less to type.
1360
1361=back
1362
1363=head1 LOGGING
1364
1365AnyEvent::MP does not normally log anything by itself, but sinc eit is the
1366root of the contetx hierarchy for AnyEvent::MP modules, it will receive
1367all log messages by submodules.
1368
1198=head1 SEE ALSO 1369=head1 SEE ALSO
1199 1370
1200L<AnyEvent::MP::Intro> - a gentle introduction. 1371L<AnyEvent::MP::Intro> - a gentle introduction.
1201 1372
1202L<AnyEvent::MP::Kernel> - more, lower-level, stuff. 1373L<AnyEvent::MP::Kernel> - more, lower-level, stuff.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines