ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent.pm (file contents):
Revision 1.70 by root, Fri Apr 25 07:25:44 2008 UTC vs.
Revision 1.97 by root, Sun Apr 27 03:31:53 2008 UTC

80module. 80module.
81 81
82During the first call of any watcher-creation method, the module tries 82During the first call of any watcher-creation method, the module tries
83to detect the currently loaded event loop by probing whether one of the 83to detect the currently loaded event loop by probing whether one of the
84following modules is already loaded: L<Coro::EV>, L<Coro::Event>, L<EV>, 84following modules is already loaded: L<Coro::EV>, L<Coro::Event>, L<EV>,
85L<Event>, L<Glib>, L<Tk>, L<AnyEvent::Impl::Perl>, L<Event::Lib>, L<Qt>, 85L<Event>, L<Glib>, L<AnyEvent::Impl::Perl>, L<Tk>, L<Event::Lib>, L<Qt>,
86L<POE>. The first one found is used. If none are found, the module tries 86L<POE>. The first one found is used. If none are found, the module tries
87to load these modules (excluding Event::Lib, Qt and POE as the pure perl 87to load these modules (excluding Tk, Event::Lib, Qt and POE as the pure perl
88adaptor should always succeed) in the order given. The first one that can 88adaptor should always succeed) in the order given. The first one that can
89be successfully loaded will be used. If, after this, still none could be 89be successfully loaded will be used. If, after this, still none could be
90found, AnyEvent will fall back to a pure-perl event loop, which is not 90found, AnyEvent will fall back to a pure-perl event loop, which is not
91very efficient, but should work everywhere. 91very efficient, but should work everywhere.
92 92
136 136
137Note that C<my $w; $w => combination. This is necessary because in Perl, 137Note that C<my $w; $w => combination. This is necessary because in Perl,
138my variables are only visible after the statement in which they are 138my variables are only visible after the statement in which they are
139declared. 139declared.
140 140
141=head2 IO WATCHERS 141=head2 I/O WATCHERS
142 142
143You can create an I/O watcher by calling the C<< AnyEvent->io >> method 143You can create an I/O watcher by calling the C<< AnyEvent->io >> method
144with the following mandatory key-value pairs as arguments: 144with the following mandatory key-value pairs as arguments:
145 145
146C<fh> the Perl I<file handle> (I<not> file descriptor) to watch for 146C<fh> the Perl I<file handle> (I<not> file descriptor) to watch
147events. C<poll> must be a string that is either C<r> or C<w>, which 147for events. C<poll> must be a string that is either C<r> or C<w>,
148creates a watcher waiting for "r"eadable or "w"ritable events, 148which creates a watcher waiting for "r"eadable or "w"ritable events,
149respectively. C<cb> is the callback to invoke each time the file handle 149respectively. C<cb> is the callback to invoke each time the file handle
150becomes ready. 150becomes ready.
151 151
152As long as the I/O watcher exists it will keep the file descriptor or a 152Although the callback might get passed parameters, their value and
153copy of it alive/open. 153presence is undefined and you cannot rely on them. Portable AnyEvent
154callbacks cannot use arguments passed to I/O watcher callbacks.
154 155
156The I/O watcher might use the underlying file descriptor or a copy of it.
155It is not allowed to close a file handle as long as any watcher is active 157You must not close a file handle as long as any watcher is active on the
156on the underlying file descriptor. 158underlying file descriptor.
157 159
158Some event loops issue spurious readyness notifications, so you should 160Some event loops issue spurious readyness notifications, so you should
159always use non-blocking calls when reading/writing from/to your file 161always use non-blocking calls when reading/writing from/to your file
160handles. 162handles.
161 163
172 174
173You can create a time watcher by calling the C<< AnyEvent->timer >> 175You can create a time watcher by calling the C<< AnyEvent->timer >>
174method with the following mandatory arguments: 176method with the following mandatory arguments:
175 177
176C<after> specifies after how many seconds (fractional values are 178C<after> specifies after how many seconds (fractional values are
177supported) should the timer activate. C<cb> the callback to invoke in that 179supported) the callback should be invoked. C<cb> is the callback to invoke
178case. 180in that case.
181
182Although the callback might get passed parameters, their value and
183presence is undefined and you cannot rely on them. Portable AnyEvent
184callbacks cannot use arguments passed to time watcher callbacks.
179 185
180The timer callback will be invoked at most once: if you want a repeating 186The timer callback will be invoked at most once: if you want a repeating
181timer you have to create a new watcher (this is a limitation by both Tk 187timer you have to create a new watcher (this is a limitation by both Tk
182and Glib). 188and Glib).
183 189
228 234
229You can watch for signals using a signal watcher, C<signal> is the signal 235You can watch for signals using a signal watcher, C<signal> is the signal
230I<name> without any C<SIG> prefix, C<cb> is the Perl callback to 236I<name> without any C<SIG> prefix, C<cb> is the Perl callback to
231be invoked whenever a signal occurs. 237be invoked whenever a signal occurs.
232 238
239Although the callback might get passed parameters, their value and
240presence is undefined and you cannot rely on them. Portable AnyEvent
241callbacks cannot use arguments passed to signal watcher callbacks.
242
233Multiple signal occurances can be clumped together into one callback 243Multiple signal occurances can be clumped together into one callback
234invocation, and callback invocation will be synchronous. synchronous means 244invocation, and callback invocation will be synchronous. synchronous means
235that it might take a while until the signal gets handled by the process, 245that it might take a while until the signal gets handled by the process,
236but it is guarenteed not to interrupt any other callbacks. 246but it is guarenteed not to interrupt any other callbacks.
237 247
251 261
252The child process is specified by the C<pid> argument (if set to C<0>, it 262The child process is specified by the C<pid> argument (if set to C<0>, it
253watches for any child process exit). The watcher will trigger as often 263watches for any child process exit). The watcher will trigger as often
254as status change for the child are received. This works by installing a 264as status change for the child are received. This works by installing a
255signal handler for C<SIGCHLD>. The callback will be called with the pid 265signal handler for C<SIGCHLD>. The callback will be called with the pid
256and exit status (as returned by waitpid). 266and exit status (as returned by waitpid), so unlike other watcher types,
267you I<can> rely on child watcher callback arguments.
257 268
258Example: wait for pid 1333 269There is a slight catch to child watchers, however: you usually start them
270I<after> the child process was created, and this means the process could
271have exited already (and no SIGCHLD will be sent anymore).
272
273Not all event models handle this correctly (POE doesn't), but even for
274event models that I<do> handle this correctly, they usually need to be
275loaded before the process exits (i.e. before you fork in the first place).
276
277This means you cannot create a child watcher as the very first thing in an
278AnyEvent program, you I<have> to create at least one watcher before you
279C<fork> the child (alternatively, you can call C<AnyEvent::detect>).
280
281Example: fork a process and wait for it
282
283 my $done = AnyEvent->condvar;
284
285 AnyEvent::detect; # force event module to be initialised
286
287 my $pid = fork or exit 5;
259 288
260 my $w = AnyEvent->child ( 289 my $w = AnyEvent->child (
261 pid => 1333, 290 pid => $pid,
262 cb => sub { 291 cb => sub {
263 my ($pid, $status) = @_; 292 my ($pid, $status) = @_;
264 warn "pid $pid exited with status $status"; 293 warn "pid $pid exited with status $status";
294 $done->broadcast;
265 }, 295 },
266 ); 296 );
297
298 # do something else, then wait for process exit
299 $done->wait;
267 300
268=head2 CONDITION VARIABLES 301=head2 CONDITION VARIABLES
269 302
270Condition variables can be created by calling the C<< AnyEvent->condvar >> 303Condition variables can be created by calling the C<< AnyEvent->condvar >>
271method without any arguments. 304method without any arguments.
359 AnyEvent::Impl::CoroEV based on Coro::EV, best choice. 392 AnyEvent::Impl::CoroEV based on Coro::EV, best choice.
360 AnyEvent::Impl::CoroEvent based on Coro::Event, second best choice. 393 AnyEvent::Impl::CoroEvent based on Coro::Event, second best choice.
361 AnyEvent::Impl::EV based on EV (an interface to libev, best choice). 394 AnyEvent::Impl::EV based on EV (an interface to libev, best choice).
362 AnyEvent::Impl::Event based on Event, second best choice. 395 AnyEvent::Impl::Event based on Event, second best choice.
363 AnyEvent::Impl::Glib based on Glib, third-best choice. 396 AnyEvent::Impl::Glib based on Glib, third-best choice.
397 AnyEvent::Impl::Perl pure-perl implementation, inefficient but portable.
364 AnyEvent::Impl::Tk based on Tk, very bad choice. 398 AnyEvent::Impl::Tk based on Tk, very bad choice.
365 AnyEvent::Impl::Perl pure-perl implementation, inefficient but portable.
366 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs). 399 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs).
367 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse. 400 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse.
368 AnyEvent::Impl::POE based on POE, not generic enough for full support. 401 AnyEvent::Impl::POE based on POE, not generic enough for full support.
369 402
370There is no support for WxWidgets, as WxWidgets has no support for 403There is no support for WxWidgets, as WxWidgets has no support for
706 739
707=back 740=back
708 741
709=head1 EXAMPLE PROGRAM 742=head1 EXAMPLE PROGRAM
710 743
711The following program uses an IO watcher to read data from STDIN, a timer 744The following program uses an I/O watcher to read data from STDIN, a timer
712to display a message once per second, and a condition variable to quit the 745to display a message once per second, and a condition variable to quit the
713program when the user enters quit: 746program when the user enters quit:
714 747
715 use AnyEvent; 748 use AnyEvent;
716 749
861 }); 894 });
862 895
863 $quit->wait; 896 $quit->wait;
864 897
865 898
866=head1 BENCHMARK 899=head1 BENCHMARKS
867 900
868To give you an idea of the performance and overheads that AnyEvent adds 901To give you an idea of the performance and overheads that AnyEvent adds
869over the event loops directly, here is a benchmark of various supported 902over the event loops themselves and to give you an impression of the speed
870event models natively and with anyevent. The benchmark creates a lot of 903of various event loops I prepared some benchmarks.
871timers (with a zero timeout) and io watchers (watching STDOUT, a pty, to 904
905=head2 BENCHMARKING ANYEVENT OVERHEAD
906
907Here is a benchmark of various supported event models used natively and
908through anyevent. The benchmark creates a lot of timers (with a zero
909timeout) and I/O watchers (watching STDOUT, a pty, to become writable,
872become writable, which it is), lets them fire exactly once and destroys 910which it is), lets them fire exactly once and destroys them again.
873them again.
874 911
912Source code for this benchmark is found as F<eg/bench> in the AnyEvent
913distribution.
914
875=head2 Explanation of the columns 915=head3 Explanation of the columns
876 916
877I<watcher> is the number of event watchers created/destroyed. Since 917I<watcher> is the number of event watchers created/destroyed. Since
878different event models feature vastly different performances, each event 918different event models feature vastly different performances, each event
879loop was given a number of watchers so that overall runtime is acceptable 919loop was given a number of watchers so that overall runtime is acceptable
880and similar between tested event loop (and keep them from crashing): Glib 920and similar between tested event loop (and keep them from crashing): Glib
893I<invoke> is the time, in microseconds, used to invoke a simple 933I<invoke> is the time, in microseconds, used to invoke a simple
894callback. The callback simply counts down a Perl variable and after it was 934callback. The callback simply counts down a Perl variable and after it was
895invoked "watcher" times, it would C<< ->broadcast >> a condvar once to 935invoked "watcher" times, it would C<< ->broadcast >> a condvar once to
896signal the end of this phase. 936signal the end of this phase.
897 937
898I<destroy> is the time, in microseconds, that it takes destroy a single 938I<destroy> is the time, in microseconds, that it takes to destroy a single
899watcher. 939watcher.
900 940
901=head2 Results 941=head3 Results
902 942
903 name watcher bytes create invoke destroy comment 943 name watchers bytes create invoke destroy comment
904 EV/EV 400000 244 0.56 0.46 0.31 EV native interface 944 EV/EV 400000 244 0.56 0.46 0.31 EV native interface
905 EV/Any 100000 610 3.52 0.91 0.75 EV + AnyEvent watchers 945 EV/Any 100000 244 2.50 0.46 0.29 EV + AnyEvent watchers
906 CoroEV/Any 100000 610 3.49 0.92 0.75 coroutines + Coro::Signal 946 CoroEV/Any 100000 244 2.49 0.44 0.29 coroutines + Coro::Signal
907 Perl/Any 16000 654 4.64 1.22 0.77 pure perl implementation 947 Perl/Any 100000 513 4.92 0.87 1.12 pure perl implementation
908 Event/Event 16000 523 28.05 21.38 0.86 Event native interface 948 Event/Event 16000 516 31.88 31.30 0.85 Event native interface
909 Event/Any 16000 943 34.43 20.48 1.39 Event + AnyEvent watchers 949 Event/Any 16000 936 39.17 33.63 1.43 Event + AnyEvent watchers
910 Glib/Any 16000 1357 96.99 12.55 55.51 quadratic behaviour 950 Glib/Any 16000 1357 98.22 12.41 54.00 quadratic behaviour
911 Tk/Any 2000 1855 27.01 66.61 14.03 SEGV with >> 2000 watchers 951 Tk/Any 2000 1860 26.97 67.98 14.00 SEGV with >> 2000 watchers
912 POE/Event 2000 6644 108.15 768.19 14.33 via POE::Loop::Event 952 POE/Event 2000 6644 108.64 736.02 14.73 via POE::Loop::Event
913 POE/Select 2000 6343 94.69 807.65 562.69 via POE::Loop::Select 953 POE/Select 2000 6343 94.13 809.12 565.96 via POE::Loop::Select
914 954
915=head2 Discussion 955=head3 Discussion
916 956
917The benchmark does I<not> measure scalability of the event loop very 957The benchmark does I<not> measure scalability of the event loop very
918well. For example, a select-based event loop (such as the pure perl one) 958well. For example, a select-based event loop (such as the pure perl one)
919can never compete with an event loop that uses epoll when the number of 959can never compete with an event loop that uses epoll when the number of
920file descriptors grows high. In this benchmark, only a single filehandle 960file descriptors grows high. In this benchmark, all events become ready at
921is used (although some of the AnyEvent adaptors dup() its file descriptor 961the same time, so select/poll-based implementations get an unnatural speed
922to worka round bugs). 962boost.
963
964Also, note that the number of watchers usually has a nonlinear effect on
965overall speed, that is, creating twice as many watchers doesn't take twice
966the time - usually it takes longer. This puts event loops tested with a
967higher number of watchers at a disadvantage.
968
969To put the range of results into perspective, consider that on the
970benchmark machine, handling an event takes roughly 1600 CPU cycles with
971EV, 3100 CPU cycles with AnyEvent's pure perl loop and almost 3000000 CPU
972cycles with POE.
923 973
924C<EV> is the sole leader regarding speed and memory use, which are both 974C<EV> is the sole leader regarding speed and memory use, which are both
925maximal/minimal, respectively. Even when going through AnyEvent, there is 975maximal/minimal, respectively. Even when going through AnyEvent, it uses
926only one event loop that uses less memory (the C<Event> module natively), and 976far less memory than any other event loop and is still faster than Event
927no faster event model, not event C<Event> natively. 977natively.
928 978
929The pure perl implementation is hit in a few sweet spots (both the 979The pure perl implementation is hit in a few sweet spots (both the
930zero timeout and the use of a single fd hit optimisations in the perl 980constant timeout and the use of a single fd hit optimisations in the perl
931interpreter and the backend itself). Nevertheless tis shows that it 981interpreter and the backend itself). Nevertheless this shows that it
932adds very little overhead in itself. Like any select-based backend its 982adds very little overhead in itself. Like any select-based backend its
933performance becomes really bad with lots of file descriptors, of course, 983performance becomes really bad with lots of file descriptors (and few of
934but this was not subjetc of this benchmark. 984them active), of course, but this was not subject of this benchmark.
935 985
936The C<Event> module has a relatively high setup and callback invocation cost, 986The C<Event> module has a relatively high setup and callback invocation
937but overall scores on the third place. 987cost, but overall scores in on the third place.
938 988
939C<Glib>'s memory usage is quite a bit bit higher, features a faster 989C<Glib>'s memory usage is quite a bit higher, but it features a
940callback invocation and overall lands in the same class as C<Event>. 990faster callback invocation and overall ends up in the same class as
991C<Event>. However, Glib scales extremely badly, doubling the number of
992watchers increases the processing time by more than a factor of four,
993making it completely unusable when using larger numbers of watchers
994(note that only a single file descriptor was used in the benchmark, so
995inefficiencies of C<poll> do not account for this).
941 996
942The C<Tk> adaptor works relatively well, the fact that it crashes with 997The C<Tk> adaptor works relatively well. The fact that it crashes with
943more than 2000 watchers is a big setback, however, as correctness takes 998more than 2000 watchers is a big setback, however, as correctness takes
944precedence over speed. Nevertheless, its performance is surprising, as the 999precedence over speed. Nevertheless, its performance is surprising, as the
945file descriptor is dup()ed for each watcher. This shows that the dup() 1000file descriptor is dup()ed for each watcher. This shows that the dup()
946employed by some adaptors is not a big performance issue (it does incur a 1001employed by some adaptors is not a big performance issue (it does incur a
947hidden memory cost inside the kernel, though). 1002hidden memory cost inside the kernel which is not reflected in the figures
1003above).
948 1004
949C<POE>, regardless of backend (wether using its pure perl select-based 1005C<POE>, regardless of underlying event loop (whether using its pure
950backend or the Event backend) shows abysmal performance and memory 1006perl select-based backend or the Event module, the POE-EV backend
1007couldn't be tested because it wasn't working) shows abysmal performance
951usage: Watchers use almost 30 times as much memory as EV watchers, and 10 1008and memory usage: Watchers use almost 30 times as much memory as
952times as much memory as both Event or EV via AnyEvent. Watcher invocation 1009EV watchers, and 10 times as much memory as Event (the high memory
953is almost 700 times slower as with AnyEvent's pure perl implementation. 1010requirements are caused by requiring a session for each watcher). Watcher
1011invocation speed is almost 900 times slower than with AnyEvent's pure perl
1012implementation. The design of the POE adaptor class in AnyEvent can not
1013really account for this, as session creation overhead is small compared
1014to execution of the state machine, which is coded pretty optimally within
1015L<AnyEvent::Impl::POE>. POE simply seems to be abysmally slow.
954 1016
1017=head3 Summary
1018
1019=over 4
1020
955Summary: using EV through AnyEvent is faster than any other event 1021=item * Using EV through AnyEvent is faster than any other event loop
956loop. The overhead AnyEvent adds can be very small, and you should avoid 1022(even when used without AnyEvent), but most event loops have acceptable
957POE like the plague if you want performance or reasonable memory usage. 1023performance with or without AnyEvent.
1024
1025=item * The overhead AnyEvent adds is usually much smaller than the overhead of
1026the actual event loop, only with extremely fast event loops such as EV
1027adds AnyEvent significant overhead.
1028
1029=item * You should avoid POE like the plague if you want performance or
1030reasonable memory usage.
1031
1032=back
1033
1034=head2 BENCHMARKING THE LARGE SERVER CASE
1035
1036This benchmark atcually benchmarks the event loop itself. It works by
1037creating a number of "servers": each server consists of a socketpair, a
1038timeout watcher that gets reset on activity (but never fires), and an I/O
1039watcher waiting for input on one side of the socket. Each time the socket
1040watcher reads a byte it will write that byte to a random other "server".
1041
1042The effect is that there will be a lot of I/O watchers, only part of which
1043are active at any one point (so there is a constant number of active
1044fds for each loop iterstaion, but which fds these are is random). The
1045timeout is reset each time something is read because that reflects how
1046most timeouts work (and puts extra pressure on the event loops).
1047
1048In this benchmark, we use 10000 socketpairs (20000 sockets), of which 100
1049(1%) are active. This mirrors the activity of large servers with many
1050connections, most of which are idle at any one point in time.
1051
1052Source code for this benchmark is found as F<eg/bench2> in the AnyEvent
1053distribution.
1054
1055=head3 Explanation of the columns
1056
1057I<sockets> is the number of sockets, and twice the number of "servers" (as
1058each server has a read and write socket end).
1059
1060I<create> is the time it takes to create a socketpair (which is
1061nontrivial) and two watchers: an I/O watcher and a timeout watcher.
1062
1063I<request>, the most important value, is the time it takes to handle a
1064single "request", that is, reading the token from the pipe and forwarding
1065it to another server. This includes deleting the old timeout and creating
1066a new one that moves the timeout into the future.
1067
1068=head3 Results
1069
1070 name sockets create request
1071 EV 20000 69.01 11.16
1072 Perl 20000 75.28 112.76
1073 Event 20000 212.62 257.32
1074 Glib 20000 651.16 1896.30
1075 POE 20000 349.67 12317.24 uses POE::Loop::Event
1076
1077=head3 Discussion
1078
1079This benchmark I<does> measure scalability and overall performance of the
1080particular event loop.
1081
1082EV is again fastest. Since it is using epoll on my system, the setup time
1083is relatively high, though.
1084
1085Perl surprisingly comes second. It is much faster than the C-based event
1086loops Event and Glib.
1087
1088Event suffers from high setup time as well (look at its code and you will
1089understand why). Callback invocation also has a high overhead compared to
1090the C<< $_->() for .. >>-style loop that the Perl event loop uses. Event
1091uses select or poll in basically all documented configurations.
1092
1093Glib is hit hard by its quadratic behaviour w.r.t. many watchers. It
1094clearly fails to perform with many filehandles or in busy servers.
1095
1096POE is still completely out of the picture, taking over 1000 times as long
1097as EV, and over 100 times as long as the Perl implementation, even though
1098it uses a C-based event loop in this case.
1099
1100=head3 Summary
1101
1102=over 4
1103
1104=item * The pure perl implementation performs extremely well, considering
1105that it uses select.
1106
1107=item * Avoid Glib or POE in large projects where performance matters.
1108
1109=back
1110
1111=head2 BENCHMARKING SMALL SERVERS
1112
1113While event loops should scale (and select-based ones do not...) even to
1114large servers, most programs we (or I :) actually write have only a few
1115I/O watchers.
1116
1117In this benchmark, I use the same benchmark program as in the large server
1118case, but it uses only eight "servers", of which three are active at any
1119one time. This should reflect performance for a small server relatively
1120well.
1121
1122The columns are identical to the previous table.
1123
1124=head3 Results
1125
1126 name sockets create request
1127 EV 16 20.00 6.54
1128 Event 16 81.27 35.86
1129 Glib 16 32.63 15.48
1130 Perl 16 24.62 162.37
1131 POE 16 261.87 276.28 uses POE::Loop::Event
1132
1133=head3 Discussion
1134
1135The benchmark tries to test the performance of a typical small
1136server. While knowing how various event loops perform is interesting, keep
1137in mind that their overhead in this case is usually not as important, due
1138to the small absolute number of watchers (that is, you need efficiency and
1139speed most when you have lots of watchers, not when you only have a few of
1140them).
1141
1142EV is again fastest.
1143
1144The C-based event loops Event and Glib come in second this time, as the
1145overhead of running an iteration is much smaller in C than in Perl (little
1146code to execute in the inner loop, and perl's function calling overhead is
1147high, and updating all the data structures is costly).
1148
1149The pure perl event loop is much slower, but still competitive.
1150
1151POE also performs much better in this case, but is is still far behind the
1152others.
1153
1154=head3 Summary
1155
1156=over 4
1157
1158=item * C-based event loops perform very well with small number of
1159watchers, as the management overhead dominates.
1160
1161=back
958 1162
959 1163
960=head1 FORK 1164=head1 FORK
961 1165
962Most event libraries are not fork-safe. The ones who are usually are 1166Most event libraries are not fork-safe. The ones who are usually are

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines