ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent.pm (file contents):
Revision 1.62 by root, Fri Apr 25 02:03:18 2008 UTC vs.
Revision 1.84 by root, Fri Apr 25 13:48:42 2008 UTC

80module. 80module.
81 81
82During the first call of any watcher-creation method, the module tries 82During the first call of any watcher-creation method, the module tries
83to detect the currently loaded event loop by probing whether one of the 83to detect the currently loaded event loop by probing whether one of the
84following modules is already loaded: L<Coro::EV>, L<Coro::Event>, L<EV>, 84following modules is already loaded: L<Coro::EV>, L<Coro::Event>, L<EV>,
85L<Event>, L<Glib>, L<Tk>, L<AnyEvent::Impl::Perl>, L<Event::Lib>, L<Qt>, 85L<Event>, L<Glib>, L<AnyEvent::Impl::Perl>, L<Tk>, L<Event::Lib>, L<Qt>,
86L<POE>. The first one found is used. If none are found, the module tries 86L<POE>. The first one found is used. If none are found, the module tries
87to load these modules (excluding Event::Lib, Qt and POE as the pure perl 87to load these modules (excluding Tk, Event::Lib, Qt and POE as the pure perl
88adaptor should always succeed) in the order given. The first one that can 88adaptor should always succeed) in the order given. The first one that can
89be successfully loaded will be used. If, after this, still none could be 89be successfully loaded will be used. If, after this, still none could be
90found, AnyEvent will fall back to a pure-perl event loop, which is not 90found, AnyEvent will fall back to a pure-perl event loop, which is not
91very efficient, but should work everywhere. 91very efficient, but should work everywhere.
92 92
136 136
137Note that C<my $w; $w => combination. This is necessary because in Perl, 137Note that C<my $w; $w => combination. This is necessary because in Perl,
138my variables are only visible after the statement in which they are 138my variables are only visible after the statement in which they are
139declared. 139declared.
140 140
141=head2 IO WATCHERS 141=head2 I/O WATCHERS
142 142
143You can create an I/O watcher by calling the C<< AnyEvent->io >> method 143You can create an I/O watcher by calling the C<< AnyEvent->io >> method
144with the following mandatory key-value pairs as arguments: 144with the following mandatory key-value pairs as arguments:
145 145
146C<fh> the Perl I<file handle> (I<not> file descriptor) to watch for 146C<fh> the Perl I<file handle> (I<not> file descriptor) to watch for
147events. C<poll> must be a string that is either C<r> or C<w>, which 147events. C<poll> must be a string that is either C<r> or C<w>, which
148creates a watcher waiting for "r"eadable or "w"ritable events, 148creates a watcher waiting for "r"eadable or "w"ritable events,
149respectively. C<cb> is the callback to invoke each time the file handle 149respectively. C<cb> is the callback to invoke each time the file handle
150becomes ready. 150becomes ready.
151 151
152As long as the I/O watcher exists it will keep the file descriptor or a 152The I/O watcher might use the underlying file descriptor or a copy of it.
153copy of it alive/open.
154
155It is not allowed to close a file handle as long as any watcher is active 153You must not close a file handle as long as any watcher is active on the
156on the underlying file descriptor. 154underlying file descriptor.
157 155
158Some event loops issue spurious readyness notifications, so you should 156Some event loops issue spurious readyness notifications, so you should
159always use non-blocking calls when reading/writing from/to your file 157always use non-blocking calls when reading/writing from/to your file
160handles. 158handles.
159
160Although the callback might get passed parameters, their value and
161presence is undefined and you cannot rely on them. Portable AnyEvent
162callbacks cannot use arguments passed to I/O watcher callbacks.
161 163
162Example: 164Example:
163 165
164 # wait for readability of STDIN, then read a line and disable the watcher 166 # wait for readability of STDIN, then read a line and disable the watcher
165 my $w; $w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub { 167 my $w; $w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub {
179 181
180The timer callback will be invoked at most once: if you want a repeating 182The timer callback will be invoked at most once: if you want a repeating
181timer you have to create a new watcher (this is a limitation by both Tk 183timer you have to create a new watcher (this is a limitation by both Tk
182and Glib). 184and Glib).
183 185
186Although the callback might get passed parameters, their value and
187presence is undefined and you cannot rely on them. Portable AnyEvent
188callbacks cannot use arguments passed to time watcher callbacks.
189
184Example: 190Example:
185 191
186 # fire an event after 7.7 seconds 192 # fire an event after 7.7 seconds
187 my $w = AnyEvent->timer (after => 7.7, cb => sub { 193 my $w = AnyEvent->timer (after => 7.7, cb => sub {
188 warn "timeout\n"; 194 warn "timeout\n";
253watches for any child process exit). The watcher will trigger as often 259watches for any child process exit). The watcher will trigger as often
254as status change for the child are received. This works by installing a 260as status change for the child are received. This works by installing a
255signal handler for C<SIGCHLD>. The callback will be called with the pid 261signal handler for C<SIGCHLD>. The callback will be called with the pid
256and exit status (as returned by waitpid). 262and exit status (as returned by waitpid).
257 263
258Example: wait for pid 1333 264There is a slight catch to child watchers, however: you usually start them
265I<after> the child process was created, and this means the process could
266have exited already (and no SIGCHLD will be sent anymore).
267
268Not all event models handle this correctly (POE doesn't), but even for
269event models that I<do> handle this correctly, they usually need to be
270loaded before the process exits (i.e. before you fork in the first place).
271
272This means you cannot create a child watcher as the very first thing in an
273AnyEvent program, you I<have> to create at least one watcher before you
274C<fork> the child (alternatively, you can call C<AnyEvent::detect>).
275
276Example: fork a process and wait for it
277
278 my $done = AnyEvent->condvar;
279
280 AnyEvent::detect; # force event module to be initialised
281
282 my $pid = fork or exit 5;
259 283
260 my $w = AnyEvent->child ( 284 my $w = AnyEvent->child (
261 pid => 1333, 285 pid => $pid,
262 cb => sub { 286 cb => sub {
263 my ($pid, $status) = @_; 287 my ($pid, $status) = @_;
264 warn "pid $pid exited with status $status"; 288 warn "pid $pid exited with status $status";
289 $done->broadcast;
265 }, 290 },
266 ); 291 );
292
293 # do something else, then wait for process exit
294 $done->wait;
267 295
268=head2 CONDITION VARIABLES 296=head2 CONDITION VARIABLES
269 297
270Condition variables can be created by calling the C<< AnyEvent->condvar >> 298Condition variables can be created by calling the C<< AnyEvent->condvar >>
271method without any arguments. 299method without any arguments.
359 AnyEvent::Impl::CoroEV based on Coro::EV, best choice. 387 AnyEvent::Impl::CoroEV based on Coro::EV, best choice.
360 AnyEvent::Impl::CoroEvent based on Coro::Event, second best choice. 388 AnyEvent::Impl::CoroEvent based on Coro::Event, second best choice.
361 AnyEvent::Impl::EV based on EV (an interface to libev, best choice). 389 AnyEvent::Impl::EV based on EV (an interface to libev, best choice).
362 AnyEvent::Impl::Event based on Event, second best choice. 390 AnyEvent::Impl::Event based on Event, second best choice.
363 AnyEvent::Impl::Glib based on Glib, third-best choice. 391 AnyEvent::Impl::Glib based on Glib, third-best choice.
392 AnyEvent::Impl::Perl pure-perl implementation, inefficient but portable.
364 AnyEvent::Impl::Tk based on Tk, very bad choice. 393 AnyEvent::Impl::Tk based on Tk, very bad choice.
365 AnyEvent::Impl::Perl pure-perl implementation, inefficient but portable.
366 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs). 394 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs).
367 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse. 395 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse.
368 AnyEvent::Impl::POE based on POE, not generic enough for full support. 396 AnyEvent::Impl::POE based on POE, not generic enough for full support.
369 397
370There is no support for WxWidgets, as WxWidgets has no support for 398There is no support for WxWidgets, as WxWidgets has no support for
434no warnings; 462no warnings;
435use strict; 463use strict;
436 464
437use Carp; 465use Carp;
438 466
439our $VERSION = '3.2'; 467our $VERSION = '3.3';
440our $MODEL; 468our $MODEL;
441 469
442our $AUTOLOAD; 470our $AUTOLOAD;
443our @ISA; 471our @ISA;
444 472
706 734
707=back 735=back
708 736
709=head1 EXAMPLE PROGRAM 737=head1 EXAMPLE PROGRAM
710 738
711The following program uses an IO watcher to read data from STDIN, a timer 739The following program uses an I/O watcher to read data from STDIN, a timer
712to display a message once per second, and a condition variable to quit the 740to display a message once per second, and a condition variable to quit the
713program when the user enters quit: 741program when the user enters quit:
714 742
715 use AnyEvent; 743 use AnyEvent;
716 744
860 $quit->broadcast; 888 $quit->broadcast;
861 }); 889 });
862 890
863 $quit->wait; 891 $quit->wait;
864 892
893
894=head1 BENCHMARK
895
896To give you an idea of the performance and overheads that AnyEvent adds
897over the event loops themselves (and to give you an impression of the
898speed of various event loops), here is a benchmark of various supported
899event models natively and with anyevent. The benchmark creates a lot of
900timers (with a zero timeout) and I/O watchers (watching STDOUT, a pty, to
901become writable, which it is), lets them fire exactly once and destroys
902them again.
903
904Rewriting the benchmark to use many different sockets instead of using
905the same filehandle for all I/O watchers results in a much longer runtime
906(socket creation is expensive), but qualitatively the same figures, so it
907was not used.
908
909=head2 Explanation of the columns
910
911I<watcher> is the number of event watchers created/destroyed. Since
912different event models feature vastly different performances, each event
913loop was given a number of watchers so that overall runtime is acceptable
914and similar between tested event loop (and keep them from crashing): Glib
915would probably take thousands of years if asked to process the same number
916of watchers as EV in this benchmark.
917
918I<bytes> is the number of bytes (as measured by the resident set size,
919RSS) consumed by each watcher. This method of measuring captures both C
920and Perl-based overheads.
921
922I<create> is the time, in microseconds (millionths of seconds), that it
923takes to create a single watcher. The callback is a closure shared between
924all watchers, to avoid adding memory overhead. That means closure creation
925and memory usage is not included in the figures.
926
927I<invoke> is the time, in microseconds, used to invoke a simple
928callback. The callback simply counts down a Perl variable and after it was
929invoked "watcher" times, it would C<< ->broadcast >> a condvar once to
930signal the end of this phase.
931
932I<destroy> is the time, in microseconds, that it takes to destroy a single
933watcher.
934
935=head2 Results
936
937 name watchers bytes create invoke destroy comment
938 EV/EV 400000 244 0.56 0.46 0.31 EV native interface
939 EV/Any 100000 244 2.50 0.46 0.29 EV + AnyEvent watchers
940 CoroEV/Any 100000 244 2.49 0.44 0.29 coroutines + Coro::Signal
941 Perl/Any 100000 513 4.92 0.87 1.12 pure perl implementation
942 Event/Event 16000 516 31.88 31.30 0.85 Event native interface
943 Event/Any 16000 936 39.17 33.63 1.43 Event + AnyEvent watchers
944 Glib/Any 16000 1357 98.22 12.41 54.00 quadratic behaviour
945 Tk/Any 2000 1860 26.97 67.98 14.00 SEGV with >> 2000 watchers
946 POE/Event 2000 6644 108.64 736.02 14.73 via POE::Loop::Event
947 POE/Select 2000 6343 94.13 809.12 565.96 via POE::Loop::Select
948
949=head2 Discussion
950
951The benchmark does I<not> measure scalability of the event loop very
952well. For example, a select-based event loop (such as the pure perl one)
953can never compete with an event loop that uses epoll when the number of
954file descriptors grows high. In this benchmark, all events become ready at
955the same time, so select/poll-based implementations get an unnatural speed
956boost.
957
958C<EV> is the sole leader regarding speed and memory use, which are both
959maximal/minimal, respectively. Even when going through AnyEvent, it uses
960far less memory than any other event loop and is still faster than Event
961natively.
962
963The pure perl implementation is hit in a few sweet spots (both the
964zero timeout and the use of a single fd hit optimisations in the perl
965interpreter and the backend itself, and all watchers become ready at the
966same time). Nevertheless this shows that it adds very little overhead in
967itself. Like any select-based backend its performance becomes really bad
968with lots of file descriptors (and few of them active), of course, but
969this was not subject of this benchmark.
970
971The C<Event> module has a relatively high setup and callback invocation cost,
972but overall scores on the third place.
973
974C<Glib>'s memory usage is quite a bit bit higher, but it features a
975faster callback invocation and overall ends up in the same class as
976C<Event>. However, Glib scales extremely badly, doubling the number of
977watchers increases the processing time by more than a factor of four,
978making it completely unusable when using larger numbers of watchers
979(note that only a single file descriptor was used in the benchmark, so
980inefficiencies of C<poll> do not account for this).
981
982The C<Tk> adaptor works relatively well. The fact that it crashes with
983more than 2000 watchers is a big setback, however, as correctness takes
984precedence over speed. Nevertheless, its performance is surprising, as the
985file descriptor is dup()ed for each watcher. This shows that the dup()
986employed by some adaptors is not a big performance issue (it does incur a
987hidden memory cost inside the kernel, though, that is not reflected in the
988figures above).
989
990C<POE>, regardless of underlying event loop (wether using its pure perl
991select-based backend or the Event module) shows abysmal performance and
992memory usage: Watchers use almost 30 times as much memory as EV watchers,
993and 10 times as much memory as both Event or EV via AnyEvent. Watcher
994invocation is almost 900 times slower than with AnyEvent's pure perl
995implementation. The design of the POE adaptor class in AnyEvent can not
996really account for this, as session creation overhead is small compared
997to execution of the state machine, which is coded pretty optimally within
998L<AnyEvent::Impl::POE>. POE simply seems to be abysmally slow.
999
1000=head2 Summary
1001
1002Using EV through AnyEvent is faster than any other event loop, but most
1003event loops have acceptable performance with or without AnyEvent.
1004
1005The overhead AnyEvent adds is usually much smaller than the overhead of
1006the actual event loop, only with extremely fast event loops such as the EV
1007adds AnyEvent significant overhead.
1008
1009And you should simply avoid POE like the plague if you want performance or
1010reasonable memory usage.
1011
1012
865=head1 FORK 1013=head1 FORK
866 1014
867Most event libraries are not fork-safe. The ones who are usually are 1015Most event libraries are not fork-safe. The ones who are usually are
868because they are so inefficient. Only L<EV> is fully fork-aware. 1016because they are so inefficient. Only L<EV> is fully fork-aware.
869 1017
870If you have to fork, you must either do so I<before> creating your first 1018If you have to fork, you must either do so I<before> creating your first
871watcher OR you must not use AnyEvent at all in the child. 1019watcher OR you must not use AnyEvent at all in the child.
1020
872 1021
873=head1 SECURITY CONSIDERATIONS 1022=head1 SECURITY CONSIDERATIONS
874 1023
875AnyEvent can be forced to load any event model via 1024AnyEvent can be forced to load any event model via
876$ENV{PERL_ANYEVENT_MODEL}. While this cannot (to my knowledge) be used to 1025$ENV{PERL_ANYEVENT_MODEL}. While this cannot (to my knowledge) be used to
884 1033
885 BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} } 1034 BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} }
886 1035
887 use AnyEvent; 1036 use AnyEvent;
888 1037
1038
889=head1 SEE ALSO 1039=head1 SEE ALSO
890 1040
891Event modules: L<Coro::EV>, L<EV>, L<EV::Glib>, L<Glib::EV>, 1041Event modules: L<Coro::EV>, L<EV>, L<EV::Glib>, L<Glib::EV>,
892L<Coro::Event>, L<Event>, L<Glib::Event>, L<Glib>, L<Coro>, L<Tk>, 1042L<Coro::Event>, L<Event>, L<Glib::Event>, L<Glib>, L<Coro>, L<Tk>,
893L<Event::Lib>, L<Qt>, L<POE>. 1043L<Event::Lib>, L<Qt>, L<POE>.
897L<AnyEvent::Impl::Tk>, L<AnyEvent::Impl::Perl>, L<AnyEvent::Impl::EventLib>, 1047L<AnyEvent::Impl::Tk>, L<AnyEvent::Impl::Perl>, L<AnyEvent::Impl::EventLib>,
898L<AnyEvent::Impl::Qt>, L<AnyEvent::Impl::POE>. 1048L<AnyEvent::Impl::Qt>, L<AnyEvent::Impl::POE>.
899 1049
900Nontrivial usage examples: L<Net::FCP>, L<Net::XMPP2>. 1050Nontrivial usage examples: L<Net::FCP>, L<Net::XMPP2>.
901 1051
1052
902=head1 AUTHOR 1053=head1 AUTHOR
903 1054
904 Marc Lehmann <schmorp@schmorp.de> 1055 Marc Lehmann <schmorp@schmorp.de>
905 http://home.schmorp.de/ 1056 http://home.schmorp.de/
906 1057

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines