ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent.pm (file contents):
Revision 1.215 by root, Tue Jun 23 12:19:33 2009 UTC vs.
Revision 1.222 by root, Mon Jun 29 10:21:15 2009 UTC

392 392
393There is a slight catch to child watchers, however: you usually start them 393There is a slight catch to child watchers, however: you usually start them
394I<after> the child process was created, and this means the process could 394I<after> the child process was created, and this means the process could
395have exited already (and no SIGCHLD will be sent anymore). 395have exited already (and no SIGCHLD will be sent anymore).
396 396
397Not all event models handle this correctly (POE doesn't), but even for 397Not all event models handle this correctly (neither POE nor IO::Async do,
398see their AnyEvent::Impl manpages for details), but even for event models
398event models that I<do> handle this correctly, they usually need to be 399that I<do> handle this correctly, they usually need to be loaded before
399loaded before the process exits (i.e. before you fork in the first place). 400the process exits (i.e. before you fork in the first place). AnyEvent's
401pure perl event loop handles all cases correctly regardless of when you
402start the watcher.
400 403
401This means you cannot create a child watcher as the very first thing in an 404This means you cannot create a child watcher as the very first
402AnyEvent program, you I<have> to create at least one watcher before you 405thing in an AnyEvent program, you I<have> to create at least one
403C<fork> the child (alternatively, you can call C<AnyEvent::detect>). 406watcher before you C<fork> the child (alternatively, you can call
407C<AnyEvent::detect>).
404 408
405Example: fork a process and wait for it 409Example: fork a process and wait for it
406 410
407 my $done = AnyEvent->condvar; 411 my $done = AnyEvent->condvar;
408 412
595 599
596=item $cv->begin ([group callback]) 600=item $cv->begin ([group callback])
597 601
598=item $cv->end 602=item $cv->end
599 603
600These two methods are EXPERIMENTAL and MIGHT CHANGE.
601
602These two methods can be used to combine many transactions/events into 604These two methods can be used to combine many transactions/events into
603one. For example, a function that pings many hosts in parallel might want 605one. For example, a function that pings many hosts in parallel might want
604to use a condition variable for the whole process. 606to use a condition variable for the whole process.
605 607
606Every call to C<< ->begin >> will increment a counter, and every call to 608Every call to C<< ->begin >> will increment a counter, and every call to
607C<< ->end >> will decrement it. If the counter reaches C<0> in C<< ->end 609C<< ->end >> will decrement it. If the counter reaches C<0> in C<< ->end
608>>, the (last) callback passed to C<begin> will be executed. That callback 610>>, the (last) callback passed to C<begin> will be executed. That callback
609is I<supposed> to call C<< ->send >>, but that is not required. If no 611is I<supposed> to call C<< ->send >>, but that is not required. If no
610callback was set, C<send> will be called without any arguments. 612callback was set, C<send> will be called without any arguments.
611 613
612Let's clarify this with the ping example: 614You can think of C<< $cv->send >> giving you an OR condition (one call
615sends), while C<< $cv->begin >> and C<< $cv->end >> giving you an AND
616condition (all C<begin> calls must be C<end>'ed before the condvar sends).
617
618Let's start with a simple example: you have two I/O watchers (for example,
619STDOUT and STDERR for a program), and you want to wait for both streams to
620close before activating a condvar:
621
622 my $cv = AnyEvent->condvar;
623
624 $cv->begin; # first watcher
625 my $w1 = AnyEvent->io (fh => $fh1, cb => sub {
626 defined sysread $fh1, my $buf, 4096
627 or $cv->end;
628 });
629
630 $cv->begin; # second watcher
631 my $w2 = AnyEvent->io (fh => $fh2, cb => sub {
632 defined sysread $fh2, my $buf, 4096
633 or $cv->end;
634 });
635
636 $cv->recv;
637
638This works because for every event source (EOF on file handle), there is
639one call to C<begin>, so the condvar waits for all calls to C<end> before
640sending.
641
642The ping example mentioned above is slightly more complicated, as the
643there are results to be passwd back, and the number of tasks that are
644begung can potentially be zero:
613 645
614 my $cv = AnyEvent->condvar; 646 my $cv = AnyEvent->condvar;
615 647
616 my %result; 648 my %result;
617 $cv->begin (sub { $cv->send (\%result) }); 649 $cv->begin (sub { $cv->send (\%result) });
637loop, which serves two important purposes: first, it sets the callback 669loop, which serves two important purposes: first, it sets the callback
638to be called once the counter reaches C<0>, and second, it ensures that 670to be called once the counter reaches C<0>, and second, it ensures that
639C<send> is called even when C<no> hosts are being pinged (the loop 671C<send> is called even when C<no> hosts are being pinged (the loop
640doesn't execute once). 672doesn't execute once).
641 673
642This is the general pattern when you "fan out" into multiple subrequests: 674This is the general pattern when you "fan out" into multiple (but
643use an outer C<begin>/C<end> pair to set the callback and ensure C<end> 675potentially none) subrequests: use an outer C<begin>/C<end> pair to set
644is called at least once, and then, for each subrequest you start, call 676the callback and ensure C<end> is called at least once, and then, for each
645C<begin> and for each subrequest you finish, call C<end>. 677subrequest you start, call C<begin> and for each subrequest you finish,
678call C<end>.
646 679
647=back 680=back
648 681
649=head3 METHODS FOR CONSUMERS 682=head3 METHODS FOR CONSUMERS
650 683
730 AnyEvent::Impl::Tk based on Tk, very bad choice. 763 AnyEvent::Impl::Tk based on Tk, very bad choice.
731 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs). 764 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs).
732 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse. 765 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse.
733 AnyEvent::Impl::POE based on POE, not generic enough for full support. 766 AnyEvent::Impl::POE based on POE, not generic enough for full support.
734 767
768 # warning, support for IO::Async is only partial, as it is too broken
769 # and limited toe ven support the AnyEvent API. See AnyEvent::Impl::Async.
770 AnyEvent::Impl::IOAsync based on IO::Async, cannot be autoprobed (see its docs).
771
735There is no support for WxWidgets, as WxWidgets has no support for 772There is no support for WxWidgets, as WxWidgets has no support for
736watching file handles. However, you can use WxWidgets through the 773watching file handles. However, you can use WxWidgets through the
737POE Adaptor, as POE has a Wx backend that simply polls 20 times per 774POE Adaptor, as POE has a Wx backend that simply polls 20 times per
738second, which was considered to be too horrible to even consider for 775second, which was considered to be too horrible to even consider for
739AnyEvent. Likewise, other POE backends can be used by AnyEvent by using 776AnyEvent. Likewise, other POE backends can be used by AnyEvent by using
931no warnings; 968no warnings;
932use strict qw(vars subs); 969use strict qw(vars subs);
933 970
934use Carp; 971use Carp;
935 972
936our $VERSION = 4.411; 973our $VERSION = 4.42;
937our $MODEL; 974our $MODEL;
938 975
939our $AUTOLOAD; 976our $AUTOLOAD;
940our @ISA; 977our @ISA;
941 978
974 [Event::Lib:: => AnyEvent::Impl::EventLib::], # too buggy 1011 [Event::Lib:: => AnyEvent::Impl::EventLib::], # too buggy
975 [Qt:: => AnyEvent::Impl::Qt::], # requires special main program 1012 [Qt:: => AnyEvent::Impl::Qt::], # requires special main program
976 [POE::Kernel:: => AnyEvent::Impl::POE::], # lasciate ogni speranza 1013 [POE::Kernel:: => AnyEvent::Impl::POE::], # lasciate ogni speranza
977 [Wx:: => AnyEvent::Impl::POE::], 1014 [Wx:: => AnyEvent::Impl::POE::],
978 [Prima:: => AnyEvent::Impl::POE::], 1015 [Prima:: => AnyEvent::Impl::POE::],
1016 # IO::Async is just too broken - we would need workaorunds for its
1017 # byzantine signal and broken child handling, among others.
1018 # IO::Async is rather hard to detect, as it doesn't have any
1019 # obvious default class.
1020# [IO::Async:: => AnyEvent::Impl::IOAsync::], # requires special main program
1021# [IO::Async::Loop:: => AnyEvent::Impl::IOAsync::], # requires special main program
1022# [IO::Async::Notifier:: => AnyEvent::Impl::IOAsync::], # requires special main program
979); 1023);
980 1024
981our %method = map +($_ => 1), 1025our %method = map +($_ => 1),
982 qw(io timer time now now_update signal child idle condvar one_event DESTROY); 1026 qw(io timer time now now_update signal child idle condvar one_event DESTROY);
983 1027
1075} 1119}
1076 1120
1077# utility function to dup a filehandle. this is used by many backends 1121# utility function to dup a filehandle. this is used by many backends
1078# to support binding more than one watcher per filehandle (they usually 1122# to support binding more than one watcher per filehandle (they usually
1079# allow only one watcher per fd, so we dup it to get a different one). 1123# allow only one watcher per fd, so we dup it to get a different one).
1080sub _dupfh($$$$) { 1124sub _dupfh($$;$$) {
1081 my ($poll, $fh, $r, $w) = @_; 1125 my ($poll, $fh, $r, $w) = @_;
1082 1126
1083 # cygwin requires the fh mode to be matching, unix doesn't 1127 # cygwin requires the fh mode to be matching, unix doesn't
1084 my ($rw, $mode) = $poll eq "r" ? ($r, "<") 1128 my ($rw, $mode) = $poll eq "r" ? ($r, "<")
1085 : $poll eq "w" ? ($w, ">") 1129 : $poll eq "w" ? ($w, ">")
1366=item C<PERL_ANYEVENT_STRICT> 1410=item C<PERL_ANYEVENT_STRICT>
1367 1411
1368AnyEvent does not do much argument checking by default, as thorough 1412AnyEvent does not do much argument checking by default, as thorough
1369argument checking is very costly. Setting this variable to a true value 1413argument checking is very costly. Setting this variable to a true value
1370will cause AnyEvent to load C<AnyEvent::Strict> and then to thoroughly 1414will cause AnyEvent to load C<AnyEvent::Strict> and then to thoroughly
1371check the arguments passed to most method calls. If it finds any problems 1415check the arguments passed to most method calls. If it finds any problems,
1372it will croak. 1416it will croak.
1373 1417
1374In other words, enables "strict" mode. 1418In other words, enables "strict" mode.
1375 1419
1376Unlike C<use strict>, it is definitely recommended ot keep it off in 1420Unlike C<use strict>, it is definitely recommended to keep it off in
1377production. Keeping C<PERL_ANYEVENT_STRICT=1> in your environment while 1421production. Keeping C<PERL_ANYEVENT_STRICT=1> in your environment while
1378developing programs can be very useful, however. 1422developing programs can be very useful, however.
1379 1423
1380=item C<PERL_ANYEVENT_MODEL> 1424=item C<PERL_ANYEVENT_MODEL>
1381 1425
1680 EV/Any 100000 224 2.88 0.34 0.27 EV + AnyEvent watchers 1724 EV/Any 100000 224 2.88 0.34 0.27 EV + AnyEvent watchers
1681 CoroEV/Any 100000 224 2.85 0.35 0.28 coroutines + Coro::Signal 1725 CoroEV/Any 100000 224 2.85 0.35 0.28 coroutines + Coro::Signal
1682 Perl/Any 100000 452 4.13 0.73 0.95 pure perl implementation 1726 Perl/Any 100000 452 4.13 0.73 0.95 pure perl implementation
1683 Event/Event 16000 517 32.20 31.80 0.81 Event native interface 1727 Event/Event 16000 517 32.20 31.80 0.81 Event native interface
1684 Event/Any 16000 590 35.85 31.55 1.06 Event + AnyEvent watchers 1728 Event/Any 16000 590 35.85 31.55 1.06 Event + AnyEvent watchers
1729 IOAsync/Any 16000 989 38.10 32.77 11.13 via IO::Async::Loop::IO_Poll
1730 IOAsync/Any 16000 990 37.59 29.50 10.61 via IO::Async::Loop::Epoll
1685 Glib/Any 16000 1357 102.33 12.31 51.00 quadratic behaviour 1731 Glib/Any 16000 1357 102.33 12.31 51.00 quadratic behaviour
1686 Tk/Any 2000 1860 27.20 66.31 14.00 SEGV with >> 2000 watchers 1732 Tk/Any 2000 1860 27.20 66.31 14.00 SEGV with >> 2000 watchers
1687 POE/Event 2000 6328 109.99 751.67 14.02 via POE::Loop::Event 1733 POE/Event 2000 6328 109.99 751.67 14.02 via POE::Loop::Event
1688 POE/Select 2000 6027 94.54 809.13 579.80 via POE::Loop::Select 1734 POE/Select 2000 6027 94.54 809.13 579.80 via POE::Loop::Select
1689 1735
1718performance becomes really bad with lots of file descriptors (and few of 1764performance becomes really bad with lots of file descriptors (and few of
1719them active), of course, but this was not subject of this benchmark. 1765them active), of course, but this was not subject of this benchmark.
1720 1766
1721The C<Event> module has a relatively high setup and callback invocation 1767The C<Event> module has a relatively high setup and callback invocation
1722cost, but overall scores in on the third place. 1768cost, but overall scores in on the third place.
1769
1770C<IO::Async> performs admirably well, about on par with C<Event>, even
1771when using its pure perl backend.
1723 1772
1724C<Glib>'s memory usage is quite a bit higher, but it features a 1773C<Glib>'s memory usage is quite a bit higher, but it features a
1725faster callback invocation and overall ends up in the same class as 1774faster callback invocation and overall ends up in the same class as
1726C<Event>. However, Glib scales extremely badly, doubling the number of 1775C<Event>. However, Glib scales extremely badly, doubling the number of
1727watchers increases the processing time by more than a factor of four, 1776watchers increases the processing time by more than a factor of four,
1805it to another server. This includes deleting the old timeout and creating 1854it to another server. This includes deleting the old timeout and creating
1806a new one that moves the timeout into the future. 1855a new one that moves the timeout into the future.
1807 1856
1808=head3 Results 1857=head3 Results
1809 1858
1810 name sockets create request 1859 name sockets create request
1811 EV 20000 69.01 11.16 1860 EV 20000 69.01 11.16
1812 Perl 20000 73.32 35.87 1861 Perl 20000 73.32 35.87
1862 IOAsync 20000 157.00 98.14 epoll
1863 IOAsync 20000 159.31 616.06 poll
1813 Event 20000 212.62 257.32 1864 Event 20000 212.62 257.32
1814 Glib 20000 651.16 1896.30 1865 Glib 20000 651.16 1896.30
1815 POE 20000 349.67 12317.24 uses POE::Loop::Event 1866 POE 20000 349.67 12317.24 uses POE::Loop::Event
1816 1867
1817=head3 Discussion 1868=head3 Discussion
1818 1869
1819This benchmark I<does> measure scalability and overall performance of the 1870This benchmark I<does> measure scalability and overall performance of the
1820particular event loop. 1871particular event loop.
1822EV is again fastest. Since it is using epoll on my system, the setup time 1873EV is again fastest. Since it is using epoll on my system, the setup time
1823is relatively high, though. 1874is relatively high, though.
1824 1875
1825Perl surprisingly comes second. It is much faster than the C-based event 1876Perl surprisingly comes second. It is much faster than the C-based event
1826loops Event and Glib. 1877loops Event and Glib.
1878
1879IO::Async performs very well when using its epoll backend, and still quite
1880good compared to Glib when using its pure perl backend.
1827 1881
1828Event suffers from high setup time as well (look at its code and you will 1882Event suffers from high setup time as well (look at its code and you will
1829understand why). Callback invocation also has a high overhead compared to 1883understand why). Callback invocation also has a high overhead compared to
1830the C<< $_->() for .. >>-style loop that the Perl event loop uses. Event 1884the C<< $_->() for .. >>-style loop that the Perl event loop uses. Event
1831uses select or poll in basically all documented configurations. 1885uses select or poll in basically all documented configurations.
1900 1954
1901Recently I was told about the benchmark in the IO::Lambda manpage, which 1955Recently I was told about the benchmark in the IO::Lambda manpage, which
1902could be misinterpreted to make AnyEvent look bad. In fact, the benchmark 1956could be misinterpreted to make AnyEvent look bad. In fact, the benchmark
1903simply compares IO::Lambda with POE, and IO::Lambda looks better (which 1957simply compares IO::Lambda with POE, and IO::Lambda looks better (which
1904shouldn't come as a surprise to anybody). As such, the benchmark is 1958shouldn't come as a surprise to anybody). As such, the benchmark is
1905fine, and shows that the AnyEvent backend from IO::Lambda isn't very 1959fine, and mostly shows that the AnyEvent backend from IO::Lambda isn't
1906optimal. But how would AnyEvent compare when used without the extra 1960very optimal. But how would AnyEvent compare when used without the extra
1907baggage? To explore this, I wrote the equivalent benchmark for AnyEvent. 1961baggage? To explore this, I wrote the equivalent benchmark for AnyEvent.
1908 1962
1909The benchmark itself creates an echo-server, and then, for 500 times, 1963The benchmark itself creates an echo-server, and then, for 500 times,
1910connects to the echo server, sends a line, waits for the reply, and then 1964connects to the echo server, sends a line, waits for the reply, and then
1911creates the next connection. This is a rather bad benchmark, as it doesn't 1965creates the next connection. This is a rather bad benchmark, as it doesn't
1912test the efficiency of the framework, but it is a benchmark nevertheless. 1966test the efficiency of the framework or much non-blocking I/O, but it is a
1967benchmark nevertheless.
1913 1968
1914 name runtime 1969 name runtime
1915 Lambda/select 0.330 sec 1970 Lambda/select 0.330 sec
1916 + optimized 0.122 sec 1971 + optimized 0.122 sec
1917 Lambda/AnyEvent 0.327 sec 1972 Lambda/AnyEvent 0.327 sec
1923 1978
1924 AnyEvent/select/nb 0.085 sec 1979 AnyEvent/select/nb 0.085 sec
1925 AnyEvent/EV/nb 0.068 sec 1980 AnyEvent/EV/nb 0.068 sec
1926 +state machine 0.134 sec 1981 +state machine 0.134 sec
1927 1982
1928The benchmark is also a bit unfair (my fault) - the IO::Lambda 1983The benchmark is also a bit unfair (my fault): the IO::Lambda/POE
1929benchmarks actually make blocking connects and use 100% blocking I/O, 1984benchmarks actually make blocking connects and use 100% blocking I/O,
1930defeating the purpose of an event-based solution. All of the newly 1985defeating the purpose of an event-based solution. All of the newly
1931written AnyEvent benchmarks use 100% non-blocking connects (using 1986written AnyEvent benchmarks use 100% non-blocking connects (using
1932AnyEvent::Socket::tcp_connect and the asynchronous pure perl DNS 1987AnyEvent::Socket::tcp_connect and the asynchronous pure perl DNS
1933resolver), so AnyEvent is at a disadvantage here as non-blocking connects 1988resolver), so AnyEvent is at a disadvantage here, as non-blocking connects
1934generally require a lot more bookkeeping and event handling than blocking 1989generally require a lot more bookkeeping and event handling than blocking
1935connects (which involve a single syscall only). 1990connects (which involve a single syscall only).
1936 1991
1937The last AnyEvent benchmark additionally uses L<AnyEvent::Handle>, which 1992The last AnyEvent benchmark additionally uses L<AnyEvent::Handle>, which
1938offers similar expressive power as POE and IO::Lambda (using conventional 1993offers similar expressive power as POE and IO::Lambda, using conventional
1939Perl syntax), which means both the echo server and the client are 100% 1994Perl syntax. This means that both the echo server and the client are 100%
1940non-blocking w.r.t. I/O, further placing it at a disadvantage. 1995non-blocking, further placing it at a disadvantage.
1941 1996
1942As you can see, AnyEvent + EV even beats the hand-optimised "raw sockets 1997As you can see, the AnyEvent + EV combination even beats the
1943benchmark", while AnyEvent + its pure perl backend easily beats 1998hand-optimised "raw sockets benchmark", while AnyEvent + its pure perl
1944IO::Lambda and POE. 1999backend easily beats IO::Lambda and POE.
1945 2000
1946And even the 100% non-blocking version written using the high-level (and 2001And even the 100% non-blocking version written using the high-level (and
1947slow :) L<AnyEvent::Handle> abstraction beats both POE and IO::Lambda, 2002slow :) L<AnyEvent::Handle> abstraction beats both POE and IO::Lambda by a
1948even thought it does all of DNS, tcp-connect and socket I/O in a 2003large margin, even though it does all of DNS, tcp-connect and socket I/O
1949non-blocking way. 2004in a non-blocking way.
2005
2006The two AnyEvent benchmarks programs can be found as F<eg/ae0.pl> and
2007F<eg/ae2.pl> in the AnyEvent distribution, the remaining benchmarks are
2008part of the IO::lambda distribution and were used without any changes.
1950 2009
1951 2010
1952=head1 SIGNALS 2011=head1 SIGNALS
1953 2012
1954AnyEvent currently installs handlers for these signals: 2013AnyEvent currently installs handlers for these signals:
1958=item SIGCHLD 2017=item SIGCHLD
1959 2018
1960A handler for C<SIGCHLD> is installed by AnyEvent's child watcher 2019A handler for C<SIGCHLD> is installed by AnyEvent's child watcher
1961emulation for event loops that do not support them natively. Also, some 2020emulation for event loops that do not support them natively. Also, some
1962event loops install a similar handler. 2021event loops install a similar handler.
2022
2023If, when AnyEvent is loaded, SIGCHLD is set to IGNORE, then AnyEvent will
2024reset it to default, to avoid losing child exit statuses.
1963 2025
1964=item SIGPIPE 2026=item SIGPIPE
1965 2027
1966A no-op handler is installed for C<SIGPIPE> when C<$SIG{PIPE}> is C<undef> 2028A no-op handler is installed for C<SIGPIPE> when C<$SIG{PIPE}> is C<undef>
1967when AnyEvent gets loaded. 2029when AnyEvent gets loaded.
1979 2041
1980=back 2042=back
1981 2043
1982=cut 2044=cut
1983 2045
2046undef $SIG{CHLD}
2047 if $SIG{CHLD} eq 'IGNORE';
2048
1984$SIG{PIPE} = sub { } 2049$SIG{PIPE} = sub { }
1985 unless defined $SIG{PIPE}; 2050 unless defined $SIG{PIPE};
1986
1987 2051
1988=head1 FORK 2052=head1 FORK
1989 2053
1990Most event libraries are not fork-safe. The ones who are usually are 2054Most event libraries are not fork-safe. The ones who are usually are
1991because they rely on inefficient but fork-safe C<select> or C<poll> 2055because they rely on inefficient but fork-safe C<select> or C<poll>
2014Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can 2078Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can
2015be used to probe what backend is used and gain other information (which is 2079be used to probe what backend is used and gain other information (which is
2016probably even less useful to an attacker than PERL_ANYEVENT_MODEL), and 2080probably even less useful to an attacker than PERL_ANYEVENT_MODEL), and
2017$ENV{PERL_ANYEVENT_STRICT}. 2081$ENV{PERL_ANYEVENT_STRICT}.
2018 2082
2083Note that AnyEvent will remove I<all> environment variables starting with
2084C<PERL_ANYEVENT_> from C<%ENV> when it is loaded while taint mode is
2085enabled.
2086
2019 2087
2020=head1 BUGS 2088=head1 BUGS
2021 2089
2022Perl 5.8 has numerous memleaks that sometimes hit this module and are hard 2090Perl 5.8 has numerous memleaks that sometimes hit this module and are hard
2023to work around. If you suffer from memleaks, first upgrade to Perl 5.10 2091to work around. If you suffer from memleaks, first upgrade to Perl 5.10

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines