ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent.pm (file contents):
Revision 1.55 by root, Wed Apr 23 11:25:42 2008 UTC vs.
Revision 1.206 by root, Mon Apr 20 14:34:18 2009 UTC

1=head1 NAME 1=head1 NAME
2 2
3AnyEvent - provide framework for multiple event loops 3AnyEvent - provide framework for multiple event loops
4 4
5EV, Event, Coro::EV, Coro::Event, Glib, Tk, Perl, Event::Lib - various supported event loops 5EV, Event, Glib, Tk, Perl, Event::Lib, Qt, POE - various supported event loops
6 6
7=head1 SYNOPSIS 7=head1 SYNOPSIS
8 8
9 use AnyEvent; 9 use AnyEvent;
10 10
11 my $w = AnyEvent->io (fh => $fh, poll => "r|w", cb => sub { 11 my $w = AnyEvent->io (fh => $fh, poll => "r|w", cb => sub { ... });
12
13 my $w = AnyEvent->timer (after => $seconds, cb => sub { ... });
14 my $w = AnyEvent->timer (after => $seconds, interval => $seconds, cb => ...
15
16 print AnyEvent->now; # prints current event loop time
17 print AnyEvent->time; # think Time::HiRes::time or simply CORE::time.
18
19 my $w = AnyEvent->signal (signal => "TERM", cb => sub { ... });
20
21 my $w = AnyEvent->child (pid => $pid, cb => sub {
22 my ($pid, $status) = @_;
12 ... 23 ...
13 }); 24 });
14 25
15 my $w = AnyEvent->timer (after => $seconds, cb => sub {
16 ...
17 });
18
19 my $w = AnyEvent->condvar; # stores whether a condition was flagged 26 my $w = AnyEvent->condvar; # stores whether a condition was flagged
27 $w->send; # wake up current and all future recv's
20 $w->wait; # enters "main loop" till $condvar gets ->broadcast 28 $w->recv; # enters "main loop" till $condvar gets ->send
21 $w->broadcast; # wake up current and all future wait's 29 # use a condvar in callback mode:
30 $w->cb (sub { $_[0]->recv });
31
32=head1 INTRODUCTION/TUTORIAL
33
34This manpage is mainly a reference manual. If you are interested
35in a tutorial or some gentle introduction, have a look at the
36L<AnyEvent::Intro> manpage.
22 37
23=head1 WHY YOU SHOULD USE THIS MODULE (OR NOT) 38=head1 WHY YOU SHOULD USE THIS MODULE (OR NOT)
24 39
25Glib, POE, IO::Async, Event... CPAN offers event models by the dozen 40Glib, POE, IO::Async, Event... CPAN offers event models by the dozen
26nowadays. So what is different about AnyEvent? 41nowadays. So what is different about AnyEvent?
27 42
28Executive Summary: AnyEvent is I<compatible>, AnyEvent is I<free of 43Executive Summary: AnyEvent is I<compatible>, AnyEvent is I<free of
29policy> and AnyEvent is I<small and efficient>. 44policy> and AnyEvent is I<small and efficient>.
30 45
31First and foremost, I<AnyEvent is not an event model> itself, it only 46First and foremost, I<AnyEvent is not an event model> itself, it only
32interfaces to whatever event model the main program happens to use in a 47interfaces to whatever event model the main program happens to use, in a
33pragmatic way. For event models and certain classes of immortals alike, 48pragmatic way. For event models and certain classes of immortals alike,
34the statement "there can only be one" is a bitter reality: In general, 49the statement "there can only be one" is a bitter reality: In general,
35only one event loop can be active at the same time in a process. AnyEvent 50only one event loop can be active at the same time in a process. AnyEvent
36helps hiding the differences between those event loops. 51cannot change this, but it can hide the differences between those event
52loops.
37 53
38The goal of AnyEvent is to offer module authors the ability to do event 54The goal of AnyEvent is to offer module authors the ability to do event
39programming (waiting for I/O or timer events) without subscribing to a 55programming (waiting for I/O or timer events) without subscribing to a
40religion, a way of living, and most importantly: without forcing your 56religion, a way of living, and most importantly: without forcing your
41module users into the same thing by forcing them to use the same event 57module users into the same thing by forcing them to use the same event
42model you use. 58model you use.
43 59
44For modules like POE or IO::Async (which is a total misnomer as it is 60For modules like POE or IO::Async (which is a total misnomer as it is
45actually doing all I/O I<synchronously>...), using them in your module is 61actually doing all I/O I<synchronously>...), using them in your module is
46like joining a cult: After you joined, you are dependent on them and you 62like joining a cult: After you joined, you are dependent on them and you
47cannot use anything else, as it is simply incompatible to everything that 63cannot use anything else, as they are simply incompatible to everything
48isn't itself. What's worse, all the potential users of your module are 64that isn't them. What's worse, all the potential users of your
49I<also> forced to use the same event loop you use. 65module are I<also> forced to use the same event loop you use.
50 66
51AnyEvent is different: AnyEvent + POE works fine. AnyEvent + Glib works 67AnyEvent is different: AnyEvent + POE works fine. AnyEvent + Glib works
52fine. AnyEvent + Tk works fine etc. etc. but none of these work together 68fine. AnyEvent + Tk works fine etc. etc. but none of these work together
53with the rest: POE + IO::Async? no go. Tk + Event? no go. Again: if 69with the rest: POE + IO::Async? No go. Tk + Event? No go. Again: if
54your module uses one of those, every user of your module has to use it, 70your module uses one of those, every user of your module has to use it,
55too. But if your module uses AnyEvent, it works transparently with all 71too. But if your module uses AnyEvent, it works transparently with all
56event models it supports (including stuff like POE and IO::Async, as long 72event models it supports (including stuff like IO::Async, as long as those
57as those use one of the supported event loops. It is trivial to add new 73use one of the supported event loops. It is trivial to add new event loops
58event loops to AnyEvent, too, so it is future-proof). 74to AnyEvent, too, so it is future-proof).
59 75
60In addition to being free of having to use I<the one and only true event 76In addition to being free of having to use I<the one and only true event
61model>, AnyEvent also is free of bloat and policy: with POE or similar 77model>, AnyEvent also is free of bloat and policy: with POE or similar
62modules, you get an enourmous amount of code and strict rules you have to 78modules, you get an enormous amount of code and strict rules you have to
63follow. AnyEvent, on the other hand, is lean and up to the point, by only 79follow. AnyEvent, on the other hand, is lean and up to the point, by only
64offering the functionality that is necessary, in as thin as a wrapper as 80offering the functionality that is necessary, in as thin as a wrapper as
65technically possible. 81technically possible.
66 82
83Of course, AnyEvent comes with a big (and fully optional!) toolbox
84of useful functionality, such as an asynchronous DNS resolver, 100%
85non-blocking connects (even with TLS/SSL, IPv6 and on broken platforms
86such as Windows) and lots of real-world knowledge and workarounds for
87platform bugs and differences.
88
67Of course, if you want lots of policy (this can arguably be somewhat 89Now, if you I<do want> lots of policy (this can arguably be somewhat
68useful) and you want to force your users to use the one and only event 90useful) and you want to force your users to use the one and only event
69model, you should I<not> use this module. 91model, you should I<not> use this module.
70
71 92
72=head1 DESCRIPTION 93=head1 DESCRIPTION
73 94
74L<AnyEvent> provides an identical interface to multiple event loops. This 95L<AnyEvent> provides an identical interface to multiple event loops. This
75allows module authors to utilise an event loop without forcing module 96allows module authors to utilise an event loop without forcing module
79The interface itself is vaguely similar, but not identical to the L<Event> 100The interface itself is vaguely similar, but not identical to the L<Event>
80module. 101module.
81 102
82During the first call of any watcher-creation method, the module tries 103During the first call of any watcher-creation method, the module tries
83to detect the currently loaded event loop by probing whether one of the 104to detect the currently loaded event loop by probing whether one of the
84following modules is already loaded: L<Coro::EV>, L<Coro::Event>, L<EV>, 105following modules is already loaded: L<EV>,
85L<Event>, L<Glib>, L<Tk>. The first one found is used. If none are found, 106L<Event>, L<Glib>, L<AnyEvent::Impl::Perl>, L<Tk>, L<Event::Lib>, L<Qt>,
86the module tries to load these modules in the stated order. The first one 107L<POE>. The first one found is used. If none are found, the module tries
108to load these modules (excluding Tk, Event::Lib, Qt and POE as the pure perl
109adaptor should always succeed) in the order given. The first one that can
87that can be successfully loaded will be used. If, after this, still none 110be successfully loaded will be used. If, after this, still none could be
88could be found, AnyEvent will fall back to a pure-perl event loop, which 111found, AnyEvent will fall back to a pure-perl event loop, which is not
89is not very efficient, but should work everywhere. 112very efficient, but should work everywhere.
90 113
91Because AnyEvent first checks for modules that are already loaded, loading 114Because AnyEvent first checks for modules that are already loaded, loading
92an event model explicitly before first using AnyEvent will likely make 115an event model explicitly before first using AnyEvent will likely make
93that model the default. For example: 116that model the default. For example:
94 117
101starts using it, all bets are off. Maybe you should tell their authors to 124starts using it, all bets are off. Maybe you should tell their authors to
102use AnyEvent so their modules work together with others seamlessly... 125use AnyEvent so their modules work together with others seamlessly...
103 126
104The pure-perl implementation of AnyEvent is called 127The pure-perl implementation of AnyEvent is called
105C<AnyEvent::Impl::Perl>. Like other event modules you can load it 128C<AnyEvent::Impl::Perl>. Like other event modules you can load it
106explicitly. 129explicitly and enjoy the high availability of that event loop :)
107 130
108=head1 WATCHERS 131=head1 WATCHERS
109 132
110AnyEvent has the central concept of a I<watcher>, which is an object that 133AnyEvent has the central concept of a I<watcher>, which is an object that
111stores relevant data for each kind of event you are waiting for, such as 134stores relevant data for each kind of event you are waiting for, such as
112the callback to call, the filehandle to watch, etc. 135the callback to call, the file handle to watch, etc.
113 136
114These watchers are normal Perl objects with normal Perl lifetime. After 137These watchers are normal Perl objects with normal Perl lifetime. After
115creating a watcher it will immediately "watch" for events and invoke the 138creating a watcher it will immediately "watch" for events and invoke the
116callback when the event occurs (of course, only when the event model 139callback when the event occurs (of course, only when the event model
117is in control). 140is in control).
118 141
142Note that B<callbacks must not permanently change global variables>
143potentially in use by the event loop (such as C<$_> or C<$[>) and that B<<
144callbacks must not C<die> >>. The former is good programming practise in
145Perl and the latter stems from the fact that exception handling differs
146widely between event loops.
147
119To disable the watcher you have to destroy it (e.g. by setting the 148To disable the watcher you have to destroy it (e.g. by setting the
120variable you store it in to C<undef> or otherwise deleting all references 149variable you store it in to C<undef> or otherwise deleting all references
121to it). 150to it).
122 151
123All watchers are created by calling a method on the C<AnyEvent> class. 152All watchers are created by calling a method on the C<AnyEvent> class.
125Many watchers either are used with "recursion" (repeating timers for 154Many watchers either are used with "recursion" (repeating timers for
126example), or need to refer to their watcher object in other ways. 155example), or need to refer to their watcher object in other ways.
127 156
128An any way to achieve that is this pattern: 157An any way to achieve that is this pattern:
129 158
130 my $w; $w = AnyEvent->type (arg => value ..., cb => sub { 159 my $w; $w = AnyEvent->type (arg => value ..., cb => sub {
131 # you can use $w here, for example to undef it 160 # you can use $w here, for example to undef it
132 undef $w; 161 undef $w;
133 }); 162 });
134 163
135Note that C<my $w; $w => combination. This is necessary because in Perl, 164Note that C<my $w; $w => combination. This is necessary because in Perl,
136my variables are only visible after the statement in which they are 165my variables are only visible after the statement in which they are
137declared. 166declared.
138 167
139=head2 IO WATCHERS 168=head2 I/O WATCHERS
140 169
141You can create an I/O watcher by calling the C<< AnyEvent->io >> method 170You can create an I/O watcher by calling the C<< AnyEvent->io >> method
142with the following mandatory key-value pairs as arguments: 171with the following mandatory key-value pairs as arguments:
143 172
144C<fh> the Perl I<file handle> (I<not> file descriptor) to watch for 173C<fh> is the Perl I<file handle> (I<not> file descriptor) to watch
174for events (AnyEvent might or might not keep a reference to this file
175handle). Note that only file handles pointing to things for which
176non-blocking operation makes sense are allowed. This includes sockets,
177most character devices, pipes, fifos and so on, but not for example files
178or block devices.
179
145events. C<poll> must be a string that is either C<r> or C<w>, which 180C<poll> must be a string that is either C<r> or C<w>, which creates a
146creates a watcher waiting for "r"eadable or "w"ritable events, 181watcher waiting for "r"eadable or "w"ritable events, respectively.
182
147respectively. C<cb> is the callback to invoke each time the file handle 183C<cb> is the callback to invoke each time the file handle becomes ready.
148becomes ready.
149 184
150File handles will be kept alive, so as long as the watcher exists, the 185Although the callback might get passed parameters, their value and
151file handle exists, too. 186presence is undefined and you cannot rely on them. Portable AnyEvent
187callbacks cannot use arguments passed to I/O watcher callbacks.
152 188
189The I/O watcher might use the underlying file descriptor or a copy of it.
153It is not allowed to close a file handle as long as any watcher is active 190You must not close a file handle as long as any watcher is active on the
154on the underlying file descriptor. 191underlying file descriptor.
155 192
156Some event loops issue spurious readyness notifications, so you should 193Some event loops issue spurious readyness notifications, so you should
157always use non-blocking calls when reading/writing from/to your file 194always use non-blocking calls when reading/writing from/to your file
158handles. 195handles.
159 196
160Example:
161
162 # wait for readability of STDIN, then read a line and disable the watcher 197Example: wait for readability of STDIN, then read a line and disable the
198watcher.
199
163 my $w; $w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub { 200 my $w; $w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub {
164 chomp (my $input = <STDIN>); 201 chomp (my $input = <STDIN>);
165 warn "read: $input\n"; 202 warn "read: $input\n";
166 undef $w; 203 undef $w;
167 }); 204 });
170 207
171You can create a time watcher by calling the C<< AnyEvent->timer >> 208You can create a time watcher by calling the C<< AnyEvent->timer >>
172method with the following mandatory arguments: 209method with the following mandatory arguments:
173 210
174C<after> specifies after how many seconds (fractional values are 211C<after> specifies after how many seconds (fractional values are
175supported) should the timer activate. C<cb> the callback to invoke in that 212supported) the callback should be invoked. C<cb> is the callback to invoke
176case. 213in that case.
177 214
178The timer callback will be invoked at most once: if you want a repeating 215Although the callback might get passed parameters, their value and
179timer you have to create a new watcher (this is a limitation by both Tk 216presence is undefined and you cannot rely on them. Portable AnyEvent
180and Glib). 217callbacks cannot use arguments passed to time watcher callbacks.
181 218
182Example: 219The callback will normally be invoked once only. If you specify another
220parameter, C<interval>, as a strictly positive number (> 0), then the
221callback will be invoked regularly at that interval (in fractional
222seconds) after the first invocation. If C<interval> is specified with a
223false value, then it is treated as if it were missing.
183 224
225The callback will be rescheduled before invoking the callback, but no
226attempt is done to avoid timer drift in most backends, so the interval is
227only approximate.
228
184 # fire an event after 7.7 seconds 229Example: fire an event after 7.7 seconds.
230
185 my $w = AnyEvent->timer (after => 7.7, cb => sub { 231 my $w = AnyEvent->timer (after => 7.7, cb => sub {
186 warn "timeout\n"; 232 warn "timeout\n";
187 }); 233 });
188 234
189 # to cancel the timer: 235 # to cancel the timer:
190 undef $w; 236 undef $w;
191 237
192Example 2:
193
194 # fire an event after 0.5 seconds, then roughly every second 238Example 2: fire an event after 0.5 seconds, then roughly every second.
195 my $w;
196 239
197 my $cb = sub {
198 # cancel the old timer while creating a new one
199 $w = AnyEvent->timer (after => 1, cb => $cb); 240 my $w = AnyEvent->timer (after => 0.5, interval => 1, cb => sub {
241 warn "timeout\n";
200 }; 242 };
201
202 # start the "loop" by creating the first watcher
203 $w = AnyEvent->timer (after => 0.5, cb => $cb);
204 243
205=head3 TIMING ISSUES 244=head3 TIMING ISSUES
206 245
207There are two ways to handle timers: based on real time (relative, "fire 246There are two ways to handle timers: based on real time (relative, "fire
208in 10 seconds") and based on wallclock time (absolute, "fire at 12 247in 10 seconds") and based on wallclock time (absolute, "fire at 12
209o'clock"). 248o'clock").
210 249
211While most event loops expect timers to specified in a relative way, they use 250While most event loops expect timers to specified in a relative way, they
212absolute time internally. This makes a difference when your clock "jumps", 251use absolute time internally. This makes a difference when your clock
213for example, when ntp decides to set your clock backwards from the wrong 2014-01-01 to 252"jumps", for example, when ntp decides to set your clock backwards from
2142008-01-01, a watcher that you created to fire "after" a second might actually take 253the wrong date of 2014-01-01 to 2008-01-01, a watcher that is supposed to
215six years to finally fire. 254fire "after" a second might actually take six years to finally fire.
216 255
217AnyEvent cannot compensate for this. The only event loop that is conscious 256AnyEvent cannot compensate for this. The only event loop that is conscious
218about these issues is L<EV>, which offers both relative (ev_timer) and 257about these issues is L<EV>, which offers both relative (ev_timer, based
219absolute (ev_periodic) timers. 258on true relative time) and absolute (ev_periodic, based on wallclock time)
259timers.
220 260
221AnyEvent always prefers relative timers, if available, matching the 261AnyEvent always prefers relative timers, if available, matching the
222AnyEvent API. 262AnyEvent API.
223 263
264AnyEvent has two additional methods that return the "current time":
265
266=over 4
267
268=item AnyEvent->time
269
270This returns the "current wallclock time" as a fractional number of
271seconds since the Epoch (the same thing as C<time> or C<Time::HiRes::time>
272return, and the result is guaranteed to be compatible with those).
273
274It progresses independently of any event loop processing, i.e. each call
275will check the system clock, which usually gets updated frequently.
276
277=item AnyEvent->now
278
279This also returns the "current wallclock time", but unlike C<time>, above,
280this value might change only once per event loop iteration, depending on
281the event loop (most return the same time as C<time>, above). This is the
282time that AnyEvent's timers get scheduled against.
283
284I<In almost all cases (in all cases if you don't care), this is the
285function to call when you want to know the current time.>
286
287This function is also often faster then C<< AnyEvent->time >>, and
288thus the preferred method if you want some timestamp (for example,
289L<AnyEvent::Handle> uses this to update it's activity timeouts).
290
291The rest of this section is only of relevance if you try to be very exact
292with your timing, you can skip it without bad conscience.
293
294For a practical example of when these times differ, consider L<Event::Lib>
295and L<EV> and the following set-up:
296
297The event loop is running and has just invoked one of your callback at
298time=500 (assume no other callbacks delay processing). In your callback,
299you wait a second by executing C<sleep 1> (blocking the process for a
300second) and then (at time=501) you create a relative timer that fires
301after three seconds.
302
303With L<Event::Lib>, C<< AnyEvent->time >> and C<< AnyEvent->now >> will
304both return C<501>, because that is the current time, and the timer will
305be scheduled to fire at time=504 (C<501> + C<3>).
306
307With L<EV>, C<< AnyEvent->time >> returns C<501> (as that is the current
308time), but C<< AnyEvent->now >> returns C<500>, as that is the time the
309last event processing phase started. With L<EV>, your timer gets scheduled
310to run at time=503 (C<500> + C<3>).
311
312In one sense, L<Event::Lib> is more exact, as it uses the current time
313regardless of any delays introduced by event processing. However, most
314callbacks do not expect large delays in processing, so this causes a
315higher drift (and a lot more system calls to get the current time).
316
317In another sense, L<EV> is more exact, as your timer will be scheduled at
318the same time, regardless of how long event processing actually took.
319
320In either case, if you care (and in most cases, you don't), then you
321can get whatever behaviour you want with any event loop, by taking the
322difference between C<< AnyEvent->time >> and C<< AnyEvent->now >> into
323account.
324
325=item AnyEvent->now_update
326
327Some event loops (such as L<EV> or L<AnyEvent::Impl::Perl>) cache
328the current time for each loop iteration (see the discussion of L<<
329AnyEvent->now >>, above).
330
331When a callback runs for a long time (or when the process sleeps), then
332this "current" time will differ substantially from the real time, which
333might affect timers and time-outs.
334
335When this is the case, you can call this method, which will update the
336event loop's idea of "current time".
337
338Note that updating the time I<might> cause some events to be handled.
339
340=back
341
224=head2 SIGNAL WATCHERS 342=head2 SIGNAL WATCHERS
225 343
226You can watch for signals using a signal watcher, C<signal> is the signal 344You can watch for signals using a signal watcher, C<signal> is the signal
227I<name> without any C<SIG> prefix, C<cb> is the Perl callback to 345I<name> in uppercase and without any C<SIG> prefix, C<cb> is the Perl
228be invoked whenever a signal occurs. 346callback to be invoked whenever a signal occurs.
229 347
348Although the callback might get passed parameters, their value and
349presence is undefined and you cannot rely on them. Portable AnyEvent
350callbacks cannot use arguments passed to signal watcher callbacks.
351
230Multiple signals occurances can be clumped together into one callback 352Multiple signal occurrences can be clumped together into one callback
231invocation, and callback invocation will be synchronous. synchronous means 353invocation, and callback invocation will be synchronous. Synchronous means
232that it might take a while until the signal gets handled by the process, 354that it might take a while until the signal gets handled by the process,
233but it is guarenteed not to interrupt any other callbacks. 355but it is guaranteed not to interrupt any other callbacks.
234 356
235The main advantage of using these watchers is that you can share a signal 357The main advantage of using these watchers is that you can share a signal
236between multiple watchers. 358between multiple watchers.
237 359
238This watcher might use C<%SIG>, so programs overwriting those signals 360This watcher might use C<%SIG>, so programs overwriting those signals
245=head2 CHILD PROCESS WATCHERS 367=head2 CHILD PROCESS WATCHERS
246 368
247You can also watch on a child process exit and catch its exit status. 369You can also watch on a child process exit and catch its exit status.
248 370
249The child process is specified by the C<pid> argument (if set to C<0>, it 371The child process is specified by the C<pid> argument (if set to C<0>, it
250watches for any child process exit). The watcher will trigger as often 372watches for any child process exit). The watcher will triggered only when
251as status change for the child are received. This works by installing a 373the child process has finished and an exit status is available, not on
252signal handler for C<SIGCHLD>. The callback will be called with the pid 374any trace events (stopped/continued).
253and exit status (as returned by waitpid).
254 375
255Example: wait for pid 1333 376The callback will be called with the pid and exit status (as returned by
377waitpid), so unlike other watcher types, you I<can> rely on child watcher
378callback arguments.
256 379
380This watcher type works by installing a signal handler for C<SIGCHLD>,
381and since it cannot be shared, nothing else should use SIGCHLD or reap
382random child processes (waiting for specific child processes, e.g. inside
383C<system>, is just fine).
384
385There is a slight catch to child watchers, however: you usually start them
386I<after> the child process was created, and this means the process could
387have exited already (and no SIGCHLD will be sent anymore).
388
389Not all event models handle this correctly (POE doesn't), but even for
390event models that I<do> handle this correctly, they usually need to be
391loaded before the process exits (i.e. before you fork in the first place).
392
393This means you cannot create a child watcher as the very first thing in an
394AnyEvent program, you I<have> to create at least one watcher before you
395C<fork> the child (alternatively, you can call C<AnyEvent::detect>).
396
397Example: fork a process and wait for it
398
399 my $done = AnyEvent->condvar;
400
401 my $pid = fork or exit 5;
402
257 my $w = AnyEvent->child ( 403 my $w = AnyEvent->child (
258 pid => 1333, 404 pid => $pid,
259 cb => sub { 405 cb => sub {
260 my ($pid, $status) = @_; 406 my ($pid, $status) = @_;
261 warn "pid $pid exited with status $status"; 407 warn "pid $pid exited with status $status";
408 $done->send;
262 }, 409 },
263 ); 410 );
411
412 # do something else, then wait for process exit
413 $done->recv;
264 414
265=head2 CONDITION VARIABLES 415=head2 CONDITION VARIABLES
266 416
417If you are familiar with some event loops you will know that all of them
418require you to run some blocking "loop", "run" or similar function that
419will actively watch for new events and call your callbacks.
420
421AnyEvent is different, it expects somebody else to run the event loop and
422will only block when necessary (usually when told by the user).
423
424The instrument to do that is called a "condition variable", so called
425because they represent a condition that must become true.
426
267Condition variables can be created by calling the C<< AnyEvent->condvar >> 427Condition variables can be created by calling the C<< AnyEvent->condvar
268method without any arguments. 428>> method, usually without arguments. The only argument pair allowed is
269 429
270A condition variable waits for a condition - precisely that the C<< 430C<cb>, which specifies a callback to be called when the condition variable
271->broadcast >> method has been called. 431becomes true, with the condition variable as the first argument (but not
432the results).
272 433
273They are very useful to signal that a condition has been fulfilled, for 434After creation, the condition variable is "false" until it becomes "true"
435by calling the C<send> method (or calling the condition variable as if it
436were a callback, read about the caveats in the description for the C<<
437->send >> method).
438
439Condition variables are similar to callbacks, except that you can
440optionally wait for them. They can also be called merge points - points
441in time where multiple outstanding events have been processed. And yet
442another way to call them is transactions - each condition variable can be
443used to represent a transaction, which finishes at some point and delivers
444a result.
445
446Condition variables are very useful to signal that something has finished,
274example, if you write a module that does asynchronous http requests, 447for example, if you write a module that does asynchronous http requests,
275then a condition variable would be the ideal candidate to signal the 448then a condition variable would be the ideal candidate to signal the
276availability of results. 449availability of results. The user can either act when the callback is
450called or can synchronously C<< ->recv >> for the results.
277 451
278You can also use condition variables to block your main program until 452You can also use them to simulate traditional event loops - for example,
279an event occurs - for example, you could C<< ->wait >> in your main 453you can block your main program until an event occurs - for example, you
280program until the user clicks the Quit button in your app, which would C<< 454could C<< ->recv >> in your main program until the user clicks the Quit
281->broadcast >> the "quit" event. 455button of your app, which would C<< ->send >> the "quit" event.
282 456
283Note that condition variables recurse into the event loop - if you have 457Note that condition variables recurse into the event loop - if you have
284two pirces of code that call C<< ->wait >> in a round-robbin fashion, you 458two pieces of code that call C<< ->recv >> in a round-robin fashion, you
285lose. Therefore, condition variables are good to export to your caller, but 459lose. Therefore, condition variables are good to export to your caller, but
286you should avoid making a blocking wait yourself, at least in callbacks, 460you should avoid making a blocking wait yourself, at least in callbacks,
287as this asks for trouble. 461as this asks for trouble.
288 462
289This object has two methods: 463Condition variables are represented by hash refs in perl, and the keys
464used by AnyEvent itself are all named C<_ae_XXX> to make subclassing
465easy (it is often useful to build your own transaction class on top of
466AnyEvent). To subclass, use C<AnyEvent::CondVar> as base class and call
467it's C<new> method in your own C<new> method.
468
469There are two "sides" to a condition variable - the "producer side" which
470eventually calls C<< -> send >>, and the "consumer side", which waits
471for the send to occur.
472
473Example: wait for a timer.
474
475 # wait till the result is ready
476 my $result_ready = AnyEvent->condvar;
477
478 # do something such as adding a timer
479 # or socket watcher the calls $result_ready->send
480 # when the "result" is ready.
481 # in this case, we simply use a timer:
482 my $w = AnyEvent->timer (
483 after => 1,
484 cb => sub { $result_ready->send },
485 );
486
487 # this "blocks" (while handling events) till the callback
488 # calls send
489 $result_ready->recv;
490
491Example: wait for a timer, but take advantage of the fact that
492condition variables are also code references.
493
494 my $done = AnyEvent->condvar;
495 my $delay = AnyEvent->timer (after => 5, cb => $done);
496 $done->recv;
497
498Example: Imagine an API that returns a condvar and doesn't support
499callbacks. This is how you make a synchronous call, for example from
500the main program:
501
502 use AnyEvent::CouchDB;
503
504 ...
505
506 my @info = $couchdb->info->recv;
507
508And this is how you would just ste a callback to be called whenever the
509results are available:
510
511 $couchdb->info->cb (sub {
512 my @info = $_[0]->recv;
513 });
514
515=head3 METHODS FOR PRODUCERS
516
517These methods should only be used by the producing side, i.e. the
518code/module that eventually sends the signal. Note that it is also
519the producer side which creates the condvar in most cases, but it isn't
520uncommon for the consumer to create it as well.
290 521
291=over 4 522=over 4
292 523
524=item $cv->send (...)
525
526Flag the condition as ready - a running C<< ->recv >> and all further
527calls to C<recv> will (eventually) return after this method has been
528called. If nobody is waiting the send will be remembered.
529
530If a callback has been set on the condition variable, it is called
531immediately from within send.
532
533Any arguments passed to the C<send> call will be returned by all
534future C<< ->recv >> calls.
535
536Condition variables are overloaded so one can call them directly
537(as a code reference). Calling them directly is the same as calling
538C<send>. Note, however, that many C-based event loops do not handle
539overloading, so as tempting as it may be, passing a condition variable
540instead of a callback does not work. Both the pure perl and EV loops
541support overloading, however, as well as all functions that use perl to
542invoke a callback (as in L<AnyEvent::Socket> and L<AnyEvent::DNS> for
543example).
544
545=item $cv->croak ($error)
546
547Similar to send, but causes all call's to C<< ->recv >> to invoke
548C<Carp::croak> with the given error message/object/scalar.
549
550This can be used to signal any errors to the condition variable
551user/consumer.
552
553=item $cv->begin ([group callback])
554
293=item $cv->wait 555=item $cv->end
294 556
295Wait (blocking if necessary) until the C<< ->broadcast >> method has been 557These two methods are EXPERIMENTAL and MIGHT CHANGE.
558
559These two methods can be used to combine many transactions/events into
560one. For example, a function that pings many hosts in parallel might want
561to use a condition variable for the whole process.
562
563Every call to C<< ->begin >> will increment a counter, and every call to
564C<< ->end >> will decrement it. If the counter reaches C<0> in C<< ->end
565>>, the (last) callback passed to C<begin> will be executed. That callback
566is I<supposed> to call C<< ->send >>, but that is not required. If no
567callback was set, C<send> will be called without any arguments.
568
569Let's clarify this with the ping example:
570
571 my $cv = AnyEvent->condvar;
572
573 my %result;
574 $cv->begin (sub { $cv->send (\%result) });
575
576 for my $host (@list_of_hosts) {
577 $cv->begin;
578 ping_host_then_call_callback $host, sub {
579 $result{$host} = ...;
580 $cv->end;
581 };
582 }
583
584 $cv->end;
585
586This code fragment supposedly pings a number of hosts and calls
587C<send> after results for all then have have been gathered - in any
588order. To achieve this, the code issues a call to C<begin> when it starts
589each ping request and calls C<end> when it has received some result for
590it. Since C<begin> and C<end> only maintain a counter, the order in which
591results arrive is not relevant.
592
593There is an additional bracketing call to C<begin> and C<end> outside the
594loop, which serves two important purposes: first, it sets the callback
595to be called once the counter reaches C<0>, and second, it ensures that
596C<send> is called even when C<no> hosts are being pinged (the loop
597doesn't execute once).
598
599This is the general pattern when you "fan out" into multiple subrequests:
600use an outer C<begin>/C<end> pair to set the callback and ensure C<end>
601is called at least once, and then, for each subrequest you start, call
602C<begin> and for each subrequest you finish, call C<end>.
603
604=back
605
606=head3 METHODS FOR CONSUMERS
607
608These methods should only be used by the consuming side, i.e. the
609code awaits the condition.
610
611=over 4
612
613=item $cv->recv
614
615Wait (blocking if necessary) until the C<< ->send >> or C<< ->croak
296called on c<$cv>, while servicing other watchers normally. 616>> methods have been called on c<$cv>, while servicing other watchers
617normally.
297 618
298You can only wait once on a condition - additional calls will return 619You can only wait once on a condition - additional calls are valid but
299immediately. 620will return immediately.
621
622If an error condition has been set by calling C<< ->croak >>, then this
623function will call C<croak>.
624
625In list context, all parameters passed to C<send> will be returned,
626in scalar context only the first one will be returned.
300 627
301Not all event models support a blocking wait - some die in that case 628Not all event models support a blocking wait - some die in that case
302(programs might want to do that to stay interactive), so I<if you are 629(programs might want to do that to stay interactive), so I<if you are
303using this from a module, never require a blocking wait>, but let the 630using this from a module, never require a blocking wait>, but let the
304caller decide whether the call will block or not (for example, by coupling 631caller decide whether the call will block or not (for example, by coupling
305condition variables with some kind of request results and supporting 632condition variables with some kind of request results and supporting
306callbacks so the caller knows that getting the result will not block, 633callbacks so the caller knows that getting the result will not block,
307while still suppporting blocking waits if the caller so desires). 634while still supporting blocking waits if the caller so desires).
308 635
309Another reason I<never> to C<< ->wait >> in a module is that you cannot 636Another reason I<never> to C<< ->recv >> in a module is that you cannot
310sensibly have two C<< ->wait >>'s in parallel, as that would require 637sensibly have two C<< ->recv >>'s in parallel, as that would require
311multiple interpreters or coroutines/threads, none of which C<AnyEvent> 638multiple interpreters or coroutines/threads, none of which C<AnyEvent>
312can supply (the coroutine-aware backends L<AnyEvent::Impl::CoroEV> and 639can supply.
313L<AnyEvent::Impl::CoroEvent> explicitly support concurrent C<< ->wait >>'s
314from different coroutines, however).
315 640
316=item $cv->broadcast 641The L<Coro> module, however, I<can> and I<does> supply coroutines and, in
642fact, L<Coro::AnyEvent> replaces AnyEvent's condvars by coroutine-safe
643versions and also integrates coroutines into AnyEvent, making blocking
644C<< ->recv >> calls perfectly safe as long as they are done from another
645coroutine (one that doesn't run the event loop).
317 646
318Flag the condition as ready - a running C<< ->wait >> and all further 647You can ensure that C<< -recv >> never blocks by setting a callback and
319calls to C<wait> will (eventually) return after this method has been 648only calling C<< ->recv >> from within that callback (or at a later
320called. If nobody is waiting the broadcast will be remembered.. 649time). This will work even when the event loop does not support blocking
650waits otherwise.
651
652=item $bool = $cv->ready
653
654Returns true when the condition is "true", i.e. whether C<send> or
655C<croak> have been called.
656
657=item $cb = $cv->cb ($cb->($cv))
658
659This is a mutator function that returns the callback set and optionally
660replaces it before doing so.
661
662The callback will be called when the condition becomes "true", i.e. when
663C<send> or C<croak> are called, with the only argument being the condition
664variable itself. Calling C<recv> inside the callback or at any later time
665is guaranteed not to block.
321 666
322=back 667=back
323
324Example:
325
326 # wait till the result is ready
327 my $result_ready = AnyEvent->condvar;
328
329 # do something such as adding a timer
330 # or socket watcher the calls $result_ready->broadcast
331 # when the "result" is ready.
332 # in this case, we simply use a timer:
333 my $w = AnyEvent->timer (
334 after => 1,
335 cb => sub { $result_ready->broadcast },
336 );
337
338 # this "blocks" (while handling events) till the watcher
339 # calls broadcast
340 $result_ready->wait;
341 668
342=head1 GLOBAL VARIABLES AND FUNCTIONS 669=head1 GLOBAL VARIABLES AND FUNCTIONS
343 670
344=over 4 671=over 4
345 672
351C<AnyEvent::Impl:xxx> modules, but can be any other class in the case 678C<AnyEvent::Impl:xxx> modules, but can be any other class in the case
352AnyEvent has been extended at runtime (e.g. in I<rxvt-unicode>). 679AnyEvent has been extended at runtime (e.g. in I<rxvt-unicode>).
353 680
354The known classes so far are: 681The known classes so far are:
355 682
356 AnyEvent::Impl::CoroEV based on Coro::EV, best choice.
357 AnyEvent::Impl::CoroEvent based on Coro::Event, second best choice.
358 AnyEvent::Impl::EV based on EV (an interface to libev, also best choice). 683 AnyEvent::Impl::EV based on EV (an interface to libev, best choice).
359 AnyEvent::Impl::Event based on Event, also second best choice :) 684 AnyEvent::Impl::Event based on Event, second best choice.
685 AnyEvent::Impl::Perl pure-perl implementation, fast and portable.
360 AnyEvent::Impl::Glib based on Glib, third-best choice. 686 AnyEvent::Impl::Glib based on Glib, third-best choice.
361 AnyEvent::Impl::Tk based on Tk, very bad choice. 687 AnyEvent::Impl::Tk based on Tk, very bad choice.
362 AnyEvent::Impl::Perl pure-perl implementation, inefficient but portable. 688 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs).
363 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse. 689 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse.
690 AnyEvent::Impl::POE based on POE, not generic enough for full support.
691
692There is no support for WxWidgets, as WxWidgets has no support for
693watching file handles. However, you can use WxWidgets through the
694POE Adaptor, as POE has a Wx backend that simply polls 20 times per
695second, which was considered to be too horrible to even consider for
696AnyEvent. Likewise, other POE backends can be used by AnyEvent by using
697it's adaptor.
698
699AnyEvent knows about L<Prima> and L<Wx> and will try to use L<POE> when
700autodetecting them.
364 701
365=item AnyEvent::detect 702=item AnyEvent::detect
366 703
367Returns C<$AnyEvent::MODEL>, forcing autodetection of the event model 704Returns C<$AnyEvent::MODEL>, forcing autodetection of the event model
368if necessary. You should only call this function right before you would 705if necessary. You should only call this function right before you would
369have created an AnyEvent watcher anyway, that is, as late as possible at 706have created an AnyEvent watcher anyway, that is, as late as possible at
370runtime. 707runtime.
371 708
709=item $guard = AnyEvent::post_detect { BLOCK }
710
711Arranges for the code block to be executed as soon as the event model is
712autodetected (or immediately if this has already happened).
713
714If called in scalar or list context, then it creates and returns an object
715that automatically removes the callback again when it is destroyed. See
716L<Coro::BDB> for a case where this is useful.
717
718=item @AnyEvent::post_detect
719
720If there are any code references in this array (you can C<push> to it
721before or after loading AnyEvent), then they will called directly after
722the event loop has been chosen.
723
724You should check C<$AnyEvent::MODEL> before adding to this array, though:
725if it contains a true value then the event loop has already been detected,
726and the array will be ignored.
727
728Best use C<AnyEvent::post_detect { BLOCK }> instead.
729
372=back 730=back
373 731
374=head1 WHAT TO DO IN A MODULE 732=head1 WHAT TO DO IN A MODULE
375 733
376As a module author, you should C<use AnyEvent> and call AnyEvent methods 734As a module author, you should C<use AnyEvent> and call AnyEvent methods
379Be careful when you create watchers in the module body - AnyEvent will 737Be careful when you create watchers in the module body - AnyEvent will
380decide which event module to use as soon as the first method is called, so 738decide which event module to use as soon as the first method is called, so
381by calling AnyEvent in your module body you force the user of your module 739by calling AnyEvent in your module body you force the user of your module
382to load the event module first. 740to load the event module first.
383 741
384Never call C<< ->wait >> on a condition variable unless you I<know> that 742Never call C<< ->recv >> on a condition variable unless you I<know> that
385the C<< ->broadcast >> method has been called on it already. This is 743the C<< ->send >> method has been called on it already. This is
386because it will stall the whole program, and the whole point of using 744because it will stall the whole program, and the whole point of using
387events is to stay interactive. 745events is to stay interactive.
388 746
389It is fine, however, to call C<< ->wait >> when the user of your module 747It is fine, however, to call C<< ->recv >> when the user of your module
390requests it (i.e. if you create a http request object ad have a method 748requests it (i.e. if you create a http request object ad have a method
391called C<results> that returns the results, it should call C<< ->wait >> 749called C<results> that returns the results, it should call C<< ->recv >>
392freely, as the user of your module knows what she is doing. always). 750freely, as the user of your module knows what she is doing. always).
393 751
394=head1 WHAT TO DO IN THE MAIN PROGRAM 752=head1 WHAT TO DO IN THE MAIN PROGRAM
395 753
396There will always be a single main program - the only place that should 754There will always be a single main program - the only place that should
398 756
399If it doesn't care, it can just "use AnyEvent" and use it itself, or not 757If it doesn't care, it can just "use AnyEvent" and use it itself, or not
400do anything special (it does not need to be event-based) and let AnyEvent 758do anything special (it does not need to be event-based) and let AnyEvent
401decide which implementation to chose if some module relies on it. 759decide which implementation to chose if some module relies on it.
402 760
403If the main program relies on a specific event model. For example, in 761If the main program relies on a specific event model - for example, in
404Gtk2 programs you have to rely on the Glib module. You should load the 762Gtk2 programs you have to rely on the Glib module - you should load the
405event module before loading AnyEvent or any module that uses it: generally 763event module before loading AnyEvent or any module that uses it: generally
406speaking, you should load it as early as possible. The reason is that 764speaking, you should load it as early as possible. The reason is that
407modules might create watchers when they are loaded, and AnyEvent will 765modules might create watchers when they are loaded, and AnyEvent will
408decide on the event model to use as soon as it creates watchers, and it 766decide on the event model to use as soon as it creates watchers, and it
409might chose the wrong one unless you load the correct one yourself. 767might chose the wrong one unless you load the correct one yourself.
410 768
411You can chose to use a rather inefficient pure-perl implementation by 769You can chose to use a pure-perl implementation by loading the
412loading the C<AnyEvent::Impl::Perl> module, which gives you similar 770C<AnyEvent::Impl::Perl> module, which gives you similar behaviour
413behaviour everywhere, but letting AnyEvent chose is generally better. 771everywhere, but letting AnyEvent chose the model is generally better.
772
773=head2 MAINLOOP EMULATION
774
775Sometimes (often for short test scripts, or even standalone programs who
776only want to use AnyEvent), you do not want to run a specific event loop.
777
778In that case, you can use a condition variable like this:
779
780 AnyEvent->condvar->recv;
781
782This has the effect of entering the event loop and looping forever.
783
784Note that usually your program has some exit condition, in which case
785it is better to use the "traditional" approach of storing a condition
786variable somewhere, waiting for it, and sending it when the program should
787exit cleanly.
788
789
790=head1 OTHER MODULES
791
792The following is a non-exhaustive list of additional modules that use
793AnyEvent and can therefore be mixed easily with other AnyEvent modules
794in the same program. Some of the modules come with AnyEvent, some are
795available via CPAN.
796
797=over 4
798
799=item L<AnyEvent::Util>
800
801Contains various utility functions that replace often-used but blocking
802functions such as C<inet_aton> by event-/callback-based versions.
803
804=item L<AnyEvent::Socket>
805
806Provides various utility functions for (internet protocol) sockets,
807addresses and name resolution. Also functions to create non-blocking tcp
808connections or tcp servers, with IPv6 and SRV record support and more.
809
810=item L<AnyEvent::Handle>
811
812Provide read and write buffers, manages watchers for reads and writes,
813supports raw and formatted I/O, I/O queued and fully transparent and
814non-blocking SSL/TLS.
815
816=item L<AnyEvent::DNS>
817
818Provides rich asynchronous DNS resolver capabilities.
819
820=item L<AnyEvent::HTTP>
821
822A simple-to-use HTTP library that is capable of making a lot of concurrent
823HTTP requests.
824
825=item L<AnyEvent::HTTPD>
826
827Provides a simple web application server framework.
828
829=item L<AnyEvent::FastPing>
830
831The fastest ping in the west.
832
833=item L<AnyEvent::DBI>
834
835Executes L<DBI> requests asynchronously in a proxy process.
836
837=item L<AnyEvent::AIO>
838
839Truly asynchronous I/O, should be in the toolbox of every event
840programmer. AnyEvent::AIO transparently fuses L<IO::AIO> and AnyEvent
841together.
842
843=item L<AnyEvent::BDB>
844
845Truly asynchronous Berkeley DB access. AnyEvent::BDB transparently fuses
846L<BDB> and AnyEvent together.
847
848=item L<AnyEvent::GPSD>
849
850A non-blocking interface to gpsd, a daemon delivering GPS information.
851
852=item L<AnyEvent::IGS>
853
854A non-blocking interface to the Internet Go Server protocol (used by
855L<App::IGS>).
856
857=item L<AnyEvent::IRC>
858
859AnyEvent based IRC client module family (replacing the older Net::IRC3).
860
861=item L<Net::XMPP2>
862
863AnyEvent based XMPP (Jabber protocol) module family.
864
865=item L<Net::FCP>
866
867AnyEvent-based implementation of the Freenet Client Protocol, birthplace
868of AnyEvent.
869
870=item L<Event::ExecFlow>
871
872High level API for event-based execution flow control.
873
874=item L<Coro>
875
876Has special support for AnyEvent via L<Coro::AnyEvent>.
877
878=item L<IO::Lambda>
879
880The lambda approach to I/O - don't ask, look there. Can use AnyEvent.
881
882=back
414 883
415=cut 884=cut
416 885
417package AnyEvent; 886package AnyEvent;
418 887
419no warnings; 888no warnings;
420use strict; 889use strict qw(vars subs);
421 890
422use Carp; 891use Carp;
423 892
424our $VERSION = '3.12'; 893our $VERSION = 4.352;
425our $MODEL; 894our $MODEL;
426 895
427our $AUTOLOAD; 896our $AUTOLOAD;
428our @ISA; 897our @ISA;
429 898
899our @REGISTRY;
900
901our $WIN32;
902
903BEGIN {
904 my $win32 = ! ! ($^O =~ /mswin32/i);
905 eval "sub WIN32(){ $win32 }";
906}
907
430our $verbose = $ENV{PERL_ANYEVENT_VERBOSE}*1; 908our $verbose = $ENV{PERL_ANYEVENT_VERBOSE}*1;
431 909
432our @REGISTRY; 910our %PROTOCOL; # (ipv4|ipv6) => (1|2), higher numbers are preferred
911
912{
913 my $idx;
914 $PROTOCOL{$_} = ++$idx
915 for reverse split /\s*,\s*/,
916 $ENV{PERL_ANYEVENT_PROTOCOLS} || "ipv4,ipv6";
917}
433 918
434my @models = ( 919my @models = (
435 [Coro::EV:: => AnyEvent::Impl::CoroEV::],
436 [Coro::Event:: => AnyEvent::Impl::CoroEvent::],
437 [EV:: => AnyEvent::Impl::EV::], 920 [EV:: => AnyEvent::Impl::EV::],
438 [Event:: => AnyEvent::Impl::Event::], 921 [Event:: => AnyEvent::Impl::Event::],
439 [Glib:: => AnyEvent::Impl::Glib::],
440 [Tk:: => AnyEvent::Impl::Tk::],
441 [AnyEvent::Impl::Perl:: => AnyEvent::Impl::Perl::], 922 [AnyEvent::Impl::Perl:: => AnyEvent::Impl::Perl::],
923 # everything below here will not be autoprobed
924 # as the pureperl backend should work everywhere
925 # and is usually faster
926 [Tk:: => AnyEvent::Impl::Tk::], # crashes with many handles
927 [Glib:: => AnyEvent::Impl::Glib::], # becomes extremely slow with many watchers
442 [Event::Lib:: => AnyEvent::Impl::EventLib::], 928 [Event::Lib:: => AnyEvent::Impl::EventLib::], # too buggy
929 [Qt:: => AnyEvent::Impl::Qt::], # requires special main program
930 [POE::Kernel:: => AnyEvent::Impl::POE::], # lasciate ogni speranza
931 [Wx:: => AnyEvent::Impl::POE::],
932 [Prima:: => AnyEvent::Impl::POE::],
443); 933);
444 934
445our %method = map +($_ => 1), qw(io timer condvar broadcast wait signal one_event DESTROY); 935our %method = map +($_ => 1),
936 qw(io timer time now now_update signal child condvar one_event DESTROY);
937
938our @post_detect;
939
940sub post_detect(&) {
941 my ($cb) = @_;
942
943 if ($MODEL) {
944 $cb->();
945
946 1
947 } else {
948 push @post_detect, $cb;
949
950 defined wantarray
951 ? bless \$cb, "AnyEvent::Util::PostDetect"
952 : ()
953 }
954}
955
956sub AnyEvent::Util::PostDetect::DESTROY {
957 @post_detect = grep $_ != ${$_[0]}, @post_detect;
958}
446 959
447sub detect() { 960sub detect() {
448 unless ($MODEL) { 961 unless ($MODEL) {
449 no strict 'refs'; 962 no strict 'refs';
963 local $SIG{__DIE__};
450 964
451 if ($ENV{PERL_ANYEVENT_MODEL} =~ /^([a-zA-Z]+)$/) { 965 if ($ENV{PERL_ANYEVENT_MODEL} =~ /^([a-zA-Z]+)$/) {
452 my $model = "AnyEvent::Impl::$1"; 966 my $model = "AnyEvent::Impl::$1";
453 if (eval "require $model") { 967 if (eval "require $model") {
454 $MODEL = $model; 968 $MODEL = $model;
455 warn "AnyEvent: loaded model '$model' (forced by \$PERL_ANYEVENT_MODEL), using it.\n" if $verbose > 1; 969 warn "AnyEvent: loaded model '$model' (forced by \$PERL_ANYEVENT_MODEL), using it.\n" if $verbose > 1;
970 } else {
971 warn "AnyEvent: unable to load model '$model' (from \$PERL_ANYEVENT_MODEL):\n$@" if $verbose;
456 } 972 }
457 } 973 }
458 974
459 # check for already loaded models 975 # check for already loaded models
460 unless ($MODEL) { 976 unless ($MODEL) {
482 last; 998 last;
483 } 999 }
484 } 1000 }
485 1001
486 $MODEL 1002 $MODEL
487 or die "No event module selected for AnyEvent and autodetect failed. Install any one of these modules: EV (or Coro+EV), Event (or Coro+Event) or Glib."; 1003 or die "No event module selected for AnyEvent and autodetect failed. Install any one of these modules: EV, Event or Glib.\n";
488 } 1004 }
489 } 1005 }
490 1006
1007 push @{"$MODEL\::ISA"}, "AnyEvent::Base";
1008
491 unshift @ISA, $MODEL; 1009 unshift @ISA, $MODEL;
492 push @{"$MODEL\::ISA"}, "AnyEvent::Base"; 1010
1011 require AnyEvent::Strict if $ENV{PERL_ANYEVENT_STRICT};
1012
1013 (shift @post_detect)->() while @post_detect;
493 } 1014 }
494 1015
495 $MODEL 1016 $MODEL
496} 1017}
497 1018
505 1026
506 my $class = shift; 1027 my $class = shift;
507 $class->$func (@_); 1028 $class->$func (@_);
508} 1029}
509 1030
1031# utility function to dup a filehandle. this is used by many backends
1032# to support binding more than one watcher per filehandle (they usually
1033# allow only one watcher per fd, so we dup it to get a different one).
1034sub _dupfh($$$$) {
1035 my ($poll, $fh, $r, $w) = @_;
1036
1037 # cygwin requires the fh mode to be matching, unix doesn't
1038 my ($rw, $mode) = $poll eq "r" ? ($r, "<")
1039 : $poll eq "w" ? ($w, ">")
1040 : Carp::croak "AnyEvent->io requires poll set to either 'r' or 'w'";
1041
1042 open my $fh2, "$mode&" . fileno $fh
1043 or die "cannot dup() filehandle: $!,";
1044
1045 # we assume CLOEXEC is already set by perl in all important cases
1046
1047 ($fh2, $rw)
1048}
1049
510package AnyEvent::Base; 1050package AnyEvent::Base;
511 1051
1052# default implementations for many methods
1053
1054BEGIN {
1055 if (eval "use Time::HiRes (); time (); 1") {
1056 *_time = \&Time::HiRes::time;
1057 # if (eval "use POSIX (); (POSIX::times())...
1058 } else {
1059 *_time = sub { time }; # epic fail
1060 }
1061}
1062
1063sub time { _time }
1064sub now { _time }
1065sub now_update { }
1066
512# default implementation for ->condvar, ->wait, ->broadcast 1067# default implementation for ->condvar
513 1068
514sub condvar { 1069sub condvar {
515 bless \my $flag, "AnyEvent::Base::CondVar" 1070 bless { @_ == 3 ? (_ae_cb => $_[2]) : () }, AnyEvent::CondVar::
516}
517
518sub AnyEvent::Base::CondVar::broadcast {
519 ${$_[0]}++;
520}
521
522sub AnyEvent::Base::CondVar::wait {
523 AnyEvent->one_event while !${$_[0]};
524} 1071}
525 1072
526# default implementation for ->signal 1073# default implementation for ->signal
527 1074
528our %SIG_CB; 1075our ($SIGPIPE_R, $SIGPIPE_W, %SIG_CB, %SIG_EV, $SIG_IO);
1076
1077sub _signal_exec {
1078 sysread $SIGPIPE_R, my $dummy, 4;
1079
1080 while (%SIG_EV) {
1081 for (keys %SIG_EV) {
1082 delete $SIG_EV{$_};
1083 $_->() for values %{ $SIG_CB{$_} || {} };
1084 }
1085 }
1086}
529 1087
530sub signal { 1088sub signal {
531 my (undef, %arg) = @_; 1089 my (undef, %arg) = @_;
532 1090
1091 unless ($SIGPIPE_R) {
1092 require Fcntl;
1093
1094 if (AnyEvent::WIN32) {
1095 require AnyEvent::Util;
1096
1097 ($SIGPIPE_R, $SIGPIPE_W) = AnyEvent::Util::portable_pipe ();
1098 AnyEvent::Util::fh_nonblocking ($SIGPIPE_R) if $SIGPIPE_R;
1099 AnyEvent::Util::fh_nonblocking ($SIGPIPE_W) if $SIGPIPE_W; # just in case
1100 } else {
1101 pipe $SIGPIPE_R, $SIGPIPE_W;
1102 fcntl $SIGPIPE_R, &Fcntl::F_SETFL, &Fcntl::O_NONBLOCK if $SIGPIPE_R;
1103 fcntl $SIGPIPE_W, &Fcntl::F_SETFL, &Fcntl::O_NONBLOCK if $SIGPIPE_W; # just in case
1104 }
1105
1106 $SIGPIPE_R
1107 or Carp::croak "AnyEvent: unable to create a signal reporting pipe: $!\n";
1108
1109 # not strictly required, as $^F is normally 2, but let's make sure...
1110 fcntl $SIGPIPE_R, &Fcntl::F_SETFD, &Fcntl::FD_CLOEXEC;
1111 fcntl $SIGPIPE_W, &Fcntl::F_SETFD, &Fcntl::FD_CLOEXEC;
1112
1113 $SIG_IO = AnyEvent->io (fh => $SIGPIPE_R, poll => "r", cb => \&_signal_exec);
1114 }
1115
533 my $signal = uc $arg{signal} 1116 my $signal = uc $arg{signal}
534 or Carp::croak "required option 'signal' is missing"; 1117 or Carp::croak "required option 'signal' is missing";
535 1118
536 $SIG_CB{$signal}{$arg{cb}} = $arg{cb}; 1119 $SIG_CB{$signal}{$arg{cb}} = $arg{cb};
537 $SIG{$signal} ||= sub { 1120 $SIG{$signal} ||= sub {
538 $_->() for values %{ $SIG_CB{$signal} || {} }; 1121 local $!;
1122 syswrite $SIGPIPE_W, "\x00", 1 unless %SIG_EV;
1123 undef $SIG_EV{$signal};
539 }; 1124 };
540 1125
541 bless [$signal, $arg{cb}], "AnyEvent::Base::Signal" 1126 bless [$signal, $arg{cb}], "AnyEvent::Base::Signal"
542} 1127}
543 1128
544sub AnyEvent::Base::Signal::DESTROY { 1129sub AnyEvent::Base::Signal::DESTROY {
545 my ($signal, $cb) = @{$_[0]}; 1130 my ($signal, $cb) = @{$_[0]};
546 1131
547 delete $SIG_CB{$signal}{$cb}; 1132 delete $SIG_CB{$signal}{$cb};
548 1133
549 $SIG{$signal} = 'DEFAULT' unless keys %{ $SIG_CB{$signal} }; 1134 delete $SIG{$signal} unless keys %{ $SIG_CB{$signal} };
550} 1135}
551 1136
552# default implementation for ->child 1137# default implementation for ->child
553 1138
554our %PID_CB; 1139our %PID_CB;
581 or Carp::croak "required option 'pid' is missing"; 1166 or Carp::croak "required option 'pid' is missing";
582 1167
583 $PID_CB{$pid}{$arg{cb}} = $arg{cb}; 1168 $PID_CB{$pid}{$arg{cb}} = $arg{cb};
584 1169
585 unless ($WNOHANG) { 1170 unless ($WNOHANG) {
586 $WNOHANG = eval { require POSIX; &POSIX::WNOHANG } || 1; 1171 $WNOHANG = eval { local $SIG{__DIE__}; require POSIX; &POSIX::WNOHANG } || 1;
587 } 1172 }
588 1173
589 unless ($CHLD_W) { 1174 unless ($CHLD_W) {
590 $CHLD_W = AnyEvent->signal (signal => 'CHLD', cb => \&_sigchld); 1175 $CHLD_W = AnyEvent->signal (signal => 'CHLD', cb => \&_sigchld);
591 # child could be a zombie already, so make at least one round 1176 # child could be a zombie already, so make at least one round
601 delete $PID_CB{$pid}{$cb}; 1186 delete $PID_CB{$pid}{$cb};
602 delete $PID_CB{$pid} unless keys %{ $PID_CB{$pid} }; 1187 delete $PID_CB{$pid} unless keys %{ $PID_CB{$pid} };
603 1188
604 undef $CHLD_W unless keys %PID_CB; 1189 undef $CHLD_W unless keys %PID_CB;
605} 1190}
1191
1192package AnyEvent::CondVar;
1193
1194our @ISA = AnyEvent::CondVar::Base::;
1195
1196package AnyEvent::CondVar::Base;
1197
1198use overload
1199 '&{}' => sub { my $self = shift; sub { $self->send (@_) } },
1200 fallback => 1;
1201
1202sub _send {
1203 # nop
1204}
1205
1206sub send {
1207 my $cv = shift;
1208 $cv->{_ae_sent} = [@_];
1209 (delete $cv->{_ae_cb})->($cv) if $cv->{_ae_cb};
1210 $cv->_send;
1211}
1212
1213sub croak {
1214 $_[0]{_ae_croak} = $_[1];
1215 $_[0]->send;
1216}
1217
1218sub ready {
1219 $_[0]{_ae_sent}
1220}
1221
1222sub _wait {
1223 AnyEvent->one_event while !$_[0]{_ae_sent};
1224}
1225
1226sub recv {
1227 $_[0]->_wait;
1228
1229 Carp::croak $_[0]{_ae_croak} if $_[0]{_ae_croak};
1230 wantarray ? @{ $_[0]{_ae_sent} } : $_[0]{_ae_sent}[0]
1231}
1232
1233sub cb {
1234 $_[0]{_ae_cb} = $_[1] if @_ > 1;
1235 $_[0]{_ae_cb}
1236}
1237
1238sub begin {
1239 ++$_[0]{_ae_counter};
1240 $_[0]{_ae_end_cb} = $_[1] if @_ > 1;
1241}
1242
1243sub end {
1244 return if --$_[0]{_ae_counter};
1245 &{ $_[0]{_ae_end_cb} || sub { $_[0]->send } };
1246}
1247
1248# undocumented/compatibility with pre-3.4
1249*broadcast = \&send;
1250*wait = \&_wait;
1251
1252=head1 ERROR AND EXCEPTION HANDLING
1253
1254In general, AnyEvent does not do any error handling - it relies on the
1255caller to do that if required. The L<AnyEvent::Strict> module (see also
1256the C<PERL_ANYEVENT_STRICT> environment variable, below) provides strict
1257checking of all AnyEvent methods, however, which is highly useful during
1258development.
1259
1260As for exception handling (i.e. runtime errors and exceptions thrown while
1261executing a callback), this is not only highly event-loop specific, but
1262also not in any way wrapped by this module, as this is the job of the main
1263program.
1264
1265The pure perl event loop simply re-throws the exception (usually
1266within C<< condvar->recv >>), the L<Event> and L<EV> modules call C<<
1267$Event/EV::DIED->() >>, L<Glib> uses C<< install_exception_handler >> and
1268so on.
1269
1270=head1 ENVIRONMENT VARIABLES
1271
1272The following environment variables are used by this module or its
1273submodules:
1274
1275=over 4
1276
1277=item C<PERL_ANYEVENT_VERBOSE>
1278
1279By default, AnyEvent will be completely silent except in fatal
1280conditions. You can set this environment variable to make AnyEvent more
1281talkative.
1282
1283When set to C<1> or higher, causes AnyEvent to warn about unexpected
1284conditions, such as not being able to load the event model specified by
1285C<PERL_ANYEVENT_MODEL>.
1286
1287When set to C<2> or higher, cause AnyEvent to report to STDERR which event
1288model it chooses.
1289
1290=item C<PERL_ANYEVENT_STRICT>
1291
1292AnyEvent does not do much argument checking by default, as thorough
1293argument checking is very costly. Setting this variable to a true value
1294will cause AnyEvent to load C<AnyEvent::Strict> and then to thoroughly
1295check the arguments passed to most method calls. If it finds any problems
1296it will croak.
1297
1298In other words, enables "strict" mode.
1299
1300Unlike C<use strict>, it is definitely recommended ot keep it off in
1301production. Keeping C<PERL_ANYEVENT_STRICT=1> in your environment while
1302developing programs can be very useful, however.
1303
1304=item C<PERL_ANYEVENT_MODEL>
1305
1306This can be used to specify the event model to be used by AnyEvent, before
1307auto detection and -probing kicks in. It must be a string consisting
1308entirely of ASCII letters. The string C<AnyEvent::Impl::> gets prepended
1309and the resulting module name is loaded and if the load was successful,
1310used as event model. If it fails to load AnyEvent will proceed with
1311auto detection and -probing.
1312
1313This functionality might change in future versions.
1314
1315For example, to force the pure perl model (L<AnyEvent::Impl::Perl>) you
1316could start your program like this:
1317
1318 PERL_ANYEVENT_MODEL=Perl perl ...
1319
1320=item C<PERL_ANYEVENT_PROTOCOLS>
1321
1322Used by both L<AnyEvent::DNS> and L<AnyEvent::Socket> to determine preferences
1323for IPv4 or IPv6. The default is unspecified (and might change, or be the result
1324of auto probing).
1325
1326Must be set to a comma-separated list of protocols or address families,
1327current supported: C<ipv4> and C<ipv6>. Only protocols mentioned will be
1328used, and preference will be given to protocols mentioned earlier in the
1329list.
1330
1331This variable can effectively be used for denial-of-service attacks
1332against local programs (e.g. when setuid), although the impact is likely
1333small, as the program has to handle conenction and other failures anyways.
1334
1335Examples: C<PERL_ANYEVENT_PROTOCOLS=ipv4,ipv6> - prefer IPv4 over IPv6,
1336but support both and try to use both. C<PERL_ANYEVENT_PROTOCOLS=ipv4>
1337- only support IPv4, never try to resolve or contact IPv6
1338addresses. C<PERL_ANYEVENT_PROTOCOLS=ipv6,ipv4> support either IPv4 or
1339IPv6, but prefer IPv6 over IPv4.
1340
1341=item C<PERL_ANYEVENT_EDNS0>
1342
1343Used by L<AnyEvent::DNS> to decide whether to use the EDNS0 extension
1344for DNS. This extension is generally useful to reduce DNS traffic, but
1345some (broken) firewalls drop such DNS packets, which is why it is off by
1346default.
1347
1348Setting this variable to C<1> will cause L<AnyEvent::DNS> to announce
1349EDNS0 in its DNS requests.
1350
1351=item C<PERL_ANYEVENT_MAX_FORKS>
1352
1353The maximum number of child processes that C<AnyEvent::Util::fork_call>
1354will create in parallel.
1355
1356=back
606 1357
607=head1 SUPPLYING YOUR OWN EVENT MODEL INTERFACE 1358=head1 SUPPLYING YOUR OWN EVENT MODEL INTERFACE
608 1359
609This is an advanced topic that you do not normally need to use AnyEvent in 1360This is an advanced topic that you do not normally need to use AnyEvent in
610a module. This section is only of use to event loop authors who want to 1361a module. This section is only of use to event loop authors who want to
645I<rxvt-unicode> also cheats a bit by not providing blocking access to 1396I<rxvt-unicode> also cheats a bit by not providing blocking access to
646condition variables: code blocking while waiting for a condition will 1397condition variables: code blocking while waiting for a condition will
647C<die>. This still works with most modules/usages, and blocking calls must 1398C<die>. This still works with most modules/usages, and blocking calls must
648not be done in an interactive application, so it makes sense. 1399not be done in an interactive application, so it makes sense.
649 1400
650=head1 ENVIRONMENT VARIABLES
651
652The following environment variables are used by this module:
653
654=over 4
655
656=item C<PERL_ANYEVENT_VERBOSE>
657
658When set to C<2> or higher, cause AnyEvent to report to STDERR which event
659model it chooses.
660
661=item C<PERL_ANYEVENT_MODEL>
662
663This can be used to specify the event model to be used by AnyEvent, before
664autodetection and -probing kicks in. It must be a string consisting
665entirely of ASCII letters. The string C<AnyEvent::Impl::> gets prepended
666and the resulting module name is loaded and if the load was successful,
667used as event model. If it fails to load AnyEvent will proceed with
668autodetection and -probing.
669
670This functionality might change in future versions.
671
672For example, to force the pure perl model (L<AnyEvent::Impl::Perl>) you
673could start your program like this:
674
675 PERL_ANYEVENT_MODEL=Perl perl ...
676
677=back
678
679=head1 EXAMPLE PROGRAM 1401=head1 EXAMPLE PROGRAM
680 1402
681The following program uses an IO watcher to read data from STDIN, a timer 1403The following program uses an I/O watcher to read data from STDIN, a timer
682to display a message once per second, and a condition variable to quit the 1404to display a message once per second, and a condition variable to quit the
683program when the user enters quit: 1405program when the user enters quit:
684 1406
685 use AnyEvent; 1407 use AnyEvent;
686 1408
691 poll => 'r', 1413 poll => 'r',
692 cb => sub { 1414 cb => sub {
693 warn "io event <$_[0]>\n"; # will always output <r> 1415 warn "io event <$_[0]>\n"; # will always output <r>
694 chomp (my $input = <STDIN>); # read a line 1416 chomp (my $input = <STDIN>); # read a line
695 warn "read: $input\n"; # output what has been read 1417 warn "read: $input\n"; # output what has been read
696 $cv->broadcast if $input =~ /^q/i; # quit program if /^q/i 1418 $cv->send if $input =~ /^q/i; # quit program if /^q/i
697 }, 1419 },
698 ); 1420 );
699 1421
700 my $time_watcher; # can only be used once 1422 my $time_watcher; # can only be used once
701 1423
706 }); 1428 });
707 } 1429 }
708 1430
709 new_timer; # create first timer 1431 new_timer; # create first timer
710 1432
711 $cv->wait; # wait until user enters /^q/i 1433 $cv->recv; # wait until user enters /^q/i
712 1434
713=head1 REAL-WORLD EXAMPLE 1435=head1 REAL-WORLD EXAMPLE
714 1436
715Consider the L<Net::FCP> module. It features (among others) the following 1437Consider the L<Net::FCP> module. It features (among others) the following
716API calls, which are to freenet what HTTP GET requests are to http: 1438API calls, which are to freenet what HTTP GET requests are to http:
766 syswrite $txn->{fh}, $txn->{request} 1488 syswrite $txn->{fh}, $txn->{request}
767 or die "connection or write error"; 1489 or die "connection or write error";
768 $txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'r', cb => sub { $txn->fh_ready_r }); 1490 $txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'r', cb => sub { $txn->fh_ready_r });
769 1491
770Again, C<fh_ready_r> waits till all data has arrived, and then stores the 1492Again, C<fh_ready_r> waits till all data has arrived, and then stores the
771result and signals any possible waiters that the request ahs finished: 1493result and signals any possible waiters that the request has finished:
772 1494
773 sysread $txn->{fh}, $txn->{buf}, length $txn->{$buf}; 1495 sysread $txn->{fh}, $txn->{buf}, length $txn->{$buf};
774 1496
775 if (end-of-file or data complete) { 1497 if (end-of-file or data complete) {
776 $txn->{result} = $txn->{buf}; 1498 $txn->{result} = $txn->{buf};
777 $txn->{finished}->broadcast; 1499 $txn->{finished}->send;
778 $txb->{cb}->($txn) of $txn->{cb}; # also call callback 1500 $txb->{cb}->($txn) of $txn->{cb}; # also call callback
779 } 1501 }
780 1502
781The C<result> method, finally, just waits for the finished signal (if the 1503The C<result> method, finally, just waits for the finished signal (if the
782request was already finished, it doesn't wait, of course, and returns the 1504request was already finished, it doesn't wait, of course, and returns the
783data: 1505data:
784 1506
785 $txn->{finished}->wait; 1507 $txn->{finished}->recv;
786 return $txn->{result}; 1508 return $txn->{result};
787 1509
788The actual code goes further and collects all errors (C<die>s, exceptions) 1510The actual code goes further and collects all errors (C<die>s, exceptions)
789that occured during request processing. The C<result> method detects 1511that occurred during request processing. The C<result> method detects
790whether an exception as thrown (it is stored inside the $txn object) 1512whether an exception as thrown (it is stored inside the $txn object)
791and just throws the exception, which means connection errors and other 1513and just throws the exception, which means connection errors and other
792problems get reported tot he code that tries to use the result, not in a 1514problems get reported tot he code that tries to use the result, not in a
793random callback. 1515random callback.
794 1516
825 1547
826 my $quit = AnyEvent->condvar; 1548 my $quit = AnyEvent->condvar;
827 1549
828 $fcp->txn_client_get ($url)->cb (sub { 1550 $fcp->txn_client_get ($url)->cb (sub {
829 ... 1551 ...
830 $quit->broadcast; 1552 $quit->send;
831 }); 1553 });
832 1554
833 $quit->wait; 1555 $quit->recv;
1556
1557
1558=head1 BENCHMARKS
1559
1560To give you an idea of the performance and overheads that AnyEvent adds
1561over the event loops themselves and to give you an impression of the speed
1562of various event loops I prepared some benchmarks.
1563
1564=head2 BENCHMARKING ANYEVENT OVERHEAD
1565
1566Here is a benchmark of various supported event models used natively and
1567through AnyEvent. The benchmark creates a lot of timers (with a zero
1568timeout) and I/O watchers (watching STDOUT, a pty, to become writable,
1569which it is), lets them fire exactly once and destroys them again.
1570
1571Source code for this benchmark is found as F<eg/bench> in the AnyEvent
1572distribution.
1573
1574=head3 Explanation of the columns
1575
1576I<watcher> is the number of event watchers created/destroyed. Since
1577different event models feature vastly different performances, each event
1578loop was given a number of watchers so that overall runtime is acceptable
1579and similar between tested event loop (and keep them from crashing): Glib
1580would probably take thousands of years if asked to process the same number
1581of watchers as EV in this benchmark.
1582
1583I<bytes> is the number of bytes (as measured by the resident set size,
1584RSS) consumed by each watcher. This method of measuring captures both C
1585and Perl-based overheads.
1586
1587I<create> is the time, in microseconds (millionths of seconds), that it
1588takes to create a single watcher. The callback is a closure shared between
1589all watchers, to avoid adding memory overhead. That means closure creation
1590and memory usage is not included in the figures.
1591
1592I<invoke> is the time, in microseconds, used to invoke a simple
1593callback. The callback simply counts down a Perl variable and after it was
1594invoked "watcher" times, it would C<< ->send >> a condvar once to
1595signal the end of this phase.
1596
1597I<destroy> is the time, in microseconds, that it takes to destroy a single
1598watcher.
1599
1600=head3 Results
1601
1602 name watchers bytes create invoke destroy comment
1603 EV/EV 400000 224 0.47 0.35 0.27 EV native interface
1604 EV/Any 100000 224 2.88 0.34 0.27 EV + AnyEvent watchers
1605 CoroEV/Any 100000 224 2.85 0.35 0.28 coroutines + Coro::Signal
1606 Perl/Any 100000 452 4.13 0.73 0.95 pure perl implementation
1607 Event/Event 16000 517 32.20 31.80 0.81 Event native interface
1608 Event/Any 16000 590 35.85 31.55 1.06 Event + AnyEvent watchers
1609 Glib/Any 16000 1357 102.33 12.31 51.00 quadratic behaviour
1610 Tk/Any 2000 1860 27.20 66.31 14.00 SEGV with >> 2000 watchers
1611 POE/Event 2000 6328 109.99 751.67 14.02 via POE::Loop::Event
1612 POE/Select 2000 6027 94.54 809.13 579.80 via POE::Loop::Select
1613
1614=head3 Discussion
1615
1616The benchmark does I<not> measure scalability of the event loop very
1617well. For example, a select-based event loop (such as the pure perl one)
1618can never compete with an event loop that uses epoll when the number of
1619file descriptors grows high. In this benchmark, all events become ready at
1620the same time, so select/poll-based implementations get an unnatural speed
1621boost.
1622
1623Also, note that the number of watchers usually has a nonlinear effect on
1624overall speed, that is, creating twice as many watchers doesn't take twice
1625the time - usually it takes longer. This puts event loops tested with a
1626higher number of watchers at a disadvantage.
1627
1628To put the range of results into perspective, consider that on the
1629benchmark machine, handling an event takes roughly 1600 CPU cycles with
1630EV, 3100 CPU cycles with AnyEvent's pure perl loop and almost 3000000 CPU
1631cycles with POE.
1632
1633C<EV> is the sole leader regarding speed and memory use, which are both
1634maximal/minimal, respectively. Even when going through AnyEvent, it uses
1635far less memory than any other event loop and is still faster than Event
1636natively.
1637
1638The pure perl implementation is hit in a few sweet spots (both the
1639constant timeout and the use of a single fd hit optimisations in the perl
1640interpreter and the backend itself). Nevertheless this shows that it
1641adds very little overhead in itself. Like any select-based backend its
1642performance becomes really bad with lots of file descriptors (and few of
1643them active), of course, but this was not subject of this benchmark.
1644
1645The C<Event> module has a relatively high setup and callback invocation
1646cost, but overall scores in on the third place.
1647
1648C<Glib>'s memory usage is quite a bit higher, but it features a
1649faster callback invocation and overall ends up in the same class as
1650C<Event>. However, Glib scales extremely badly, doubling the number of
1651watchers increases the processing time by more than a factor of four,
1652making it completely unusable when using larger numbers of watchers
1653(note that only a single file descriptor was used in the benchmark, so
1654inefficiencies of C<poll> do not account for this).
1655
1656The C<Tk> adaptor works relatively well. The fact that it crashes with
1657more than 2000 watchers is a big setback, however, as correctness takes
1658precedence over speed. Nevertheless, its performance is surprising, as the
1659file descriptor is dup()ed for each watcher. This shows that the dup()
1660employed by some adaptors is not a big performance issue (it does incur a
1661hidden memory cost inside the kernel which is not reflected in the figures
1662above).
1663
1664C<POE>, regardless of underlying event loop (whether using its pure perl
1665select-based backend or the Event module, the POE-EV backend couldn't
1666be tested because it wasn't working) shows abysmal performance and
1667memory usage with AnyEvent: Watchers use almost 30 times as much memory
1668as EV watchers, and 10 times as much memory as Event (the high memory
1669requirements are caused by requiring a session for each watcher). Watcher
1670invocation speed is almost 900 times slower than with AnyEvent's pure perl
1671implementation.
1672
1673The design of the POE adaptor class in AnyEvent can not really account
1674for the performance issues, though, as session creation overhead is
1675small compared to execution of the state machine, which is coded pretty
1676optimally within L<AnyEvent::Impl::POE> (and while everybody agrees that
1677using multiple sessions is not a good approach, especially regarding
1678memory usage, even the author of POE could not come up with a faster
1679design).
1680
1681=head3 Summary
1682
1683=over 4
1684
1685=item * Using EV through AnyEvent is faster than any other event loop
1686(even when used without AnyEvent), but most event loops have acceptable
1687performance with or without AnyEvent.
1688
1689=item * The overhead AnyEvent adds is usually much smaller than the overhead of
1690the actual event loop, only with extremely fast event loops such as EV
1691adds AnyEvent significant overhead.
1692
1693=item * You should avoid POE like the plague if you want performance or
1694reasonable memory usage.
1695
1696=back
1697
1698=head2 BENCHMARKING THE LARGE SERVER CASE
1699
1700This benchmark actually benchmarks the event loop itself. It works by
1701creating a number of "servers": each server consists of a socket pair, a
1702timeout watcher that gets reset on activity (but never fires), and an I/O
1703watcher waiting for input on one side of the socket. Each time the socket
1704watcher reads a byte it will write that byte to a random other "server".
1705
1706The effect is that there will be a lot of I/O watchers, only part of which
1707are active at any one point (so there is a constant number of active
1708fds for each loop iteration, but which fds these are is random). The
1709timeout is reset each time something is read because that reflects how
1710most timeouts work (and puts extra pressure on the event loops).
1711
1712In this benchmark, we use 10000 socket pairs (20000 sockets), of which 100
1713(1%) are active. This mirrors the activity of large servers with many
1714connections, most of which are idle at any one point in time.
1715
1716Source code for this benchmark is found as F<eg/bench2> in the AnyEvent
1717distribution.
1718
1719=head3 Explanation of the columns
1720
1721I<sockets> is the number of sockets, and twice the number of "servers" (as
1722each server has a read and write socket end).
1723
1724I<create> is the time it takes to create a socket pair (which is
1725nontrivial) and two watchers: an I/O watcher and a timeout watcher.
1726
1727I<request>, the most important value, is the time it takes to handle a
1728single "request", that is, reading the token from the pipe and forwarding
1729it to another server. This includes deleting the old timeout and creating
1730a new one that moves the timeout into the future.
1731
1732=head3 Results
1733
1734 name sockets create request
1735 EV 20000 69.01 11.16
1736 Perl 20000 73.32 35.87
1737 Event 20000 212.62 257.32
1738 Glib 20000 651.16 1896.30
1739 POE 20000 349.67 12317.24 uses POE::Loop::Event
1740
1741=head3 Discussion
1742
1743This benchmark I<does> measure scalability and overall performance of the
1744particular event loop.
1745
1746EV is again fastest. Since it is using epoll on my system, the setup time
1747is relatively high, though.
1748
1749Perl surprisingly comes second. It is much faster than the C-based event
1750loops Event and Glib.
1751
1752Event suffers from high setup time as well (look at its code and you will
1753understand why). Callback invocation also has a high overhead compared to
1754the C<< $_->() for .. >>-style loop that the Perl event loop uses. Event
1755uses select or poll in basically all documented configurations.
1756
1757Glib is hit hard by its quadratic behaviour w.r.t. many watchers. It
1758clearly fails to perform with many filehandles or in busy servers.
1759
1760POE is still completely out of the picture, taking over 1000 times as long
1761as EV, and over 100 times as long as the Perl implementation, even though
1762it uses a C-based event loop in this case.
1763
1764=head3 Summary
1765
1766=over 4
1767
1768=item * The pure perl implementation performs extremely well.
1769
1770=item * Avoid Glib or POE in large projects where performance matters.
1771
1772=back
1773
1774=head2 BENCHMARKING SMALL SERVERS
1775
1776While event loops should scale (and select-based ones do not...) even to
1777large servers, most programs we (or I :) actually write have only a few
1778I/O watchers.
1779
1780In this benchmark, I use the same benchmark program as in the large server
1781case, but it uses only eight "servers", of which three are active at any
1782one time. This should reflect performance for a small server relatively
1783well.
1784
1785The columns are identical to the previous table.
1786
1787=head3 Results
1788
1789 name sockets create request
1790 EV 16 20.00 6.54
1791 Perl 16 25.75 12.62
1792 Event 16 81.27 35.86
1793 Glib 16 32.63 15.48
1794 POE 16 261.87 276.28 uses POE::Loop::Event
1795
1796=head3 Discussion
1797
1798The benchmark tries to test the performance of a typical small
1799server. While knowing how various event loops perform is interesting, keep
1800in mind that their overhead in this case is usually not as important, due
1801to the small absolute number of watchers (that is, you need efficiency and
1802speed most when you have lots of watchers, not when you only have a few of
1803them).
1804
1805EV is again fastest.
1806
1807Perl again comes second. It is noticeably faster than the C-based event
1808loops Event and Glib, although the difference is too small to really
1809matter.
1810
1811POE also performs much better in this case, but is is still far behind the
1812others.
1813
1814=head3 Summary
1815
1816=over 4
1817
1818=item * C-based event loops perform very well with small number of
1819watchers, as the management overhead dominates.
1820
1821=back
1822
1823
1824=head1 SIGNALS
1825
1826AnyEvent currently installs handlers for these signals:
1827
1828=over 4
1829
1830=item SIGCHLD
1831
1832A handler for C<SIGCHLD> is installed by AnyEvent's child watcher
1833emulation for event loops that do not support them natively. Also, some
1834event loops install a similar handler.
1835
1836=item SIGPIPE
1837
1838A no-op handler is installed for C<SIGPIPE> when C<$SIG{PIPE}> is C<undef>
1839when AnyEvent gets loaded.
1840
1841The rationale for this is that AnyEvent users usually do not really depend
1842on SIGPIPE delivery (which is purely an optimisation for shell use, or
1843badly-written programs), but C<SIGPIPE> can cause spurious and rare
1844program exits as a lot of people do not expect C<SIGPIPE> when writing to
1845some random socket.
1846
1847The rationale for installing a no-op handler as opposed to ignoring it is
1848that this way, the handler will be restored to defaults on exec.
1849
1850Feel free to install your own handler, or reset it to defaults.
1851
1852=back
1853
1854=cut
1855
1856$SIG{PIPE} = sub { }
1857 unless defined $SIG{PIPE};
1858
834 1859
835=head1 FORK 1860=head1 FORK
836 1861
837Most event libraries are not fork-safe. The ones who are usually are 1862Most event libraries are not fork-safe. The ones who are usually are
838because they are so inefficient. Only L<EV> is fully fork-aware. 1863because they rely on inefficient but fork-safe C<select> or C<poll>
1864calls. Only L<EV> is fully fork-aware.
839 1865
840If you have to fork, you must either do so I<before> creating your first 1866If you have to fork, you must either do so I<before> creating your first
841watcher OR you must not use AnyEvent at all in the child. 1867watcher OR you must not use AnyEvent at all in the child.
1868
842 1869
843=head1 SECURITY CONSIDERATIONS 1870=head1 SECURITY CONSIDERATIONS
844 1871
845AnyEvent can be forced to load any event model via 1872AnyEvent can be forced to load any event model via
846$ENV{PERL_ANYEVENT_MODEL}. While this cannot (to my knowledge) be used to 1873$ENV{PERL_ANYEVENT_MODEL}. While this cannot (to my knowledge) be used to
850specified in the variable. 1877specified in the variable.
851 1878
852You can make AnyEvent completely ignore this variable by deleting it 1879You can make AnyEvent completely ignore this variable by deleting it
853before the first watcher gets created, e.g. with a C<BEGIN> block: 1880before the first watcher gets created, e.g. with a C<BEGIN> block:
854 1881
855 BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} } 1882 BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} }
856 1883
857 use AnyEvent; 1884 use AnyEvent;
1885
1886Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can
1887be used to probe what backend is used and gain other information (which is
1888probably even less useful to an attacker than PERL_ANYEVENT_MODEL), and
1889$ENV{PERL_ANYEGENT_STRICT}.
1890
1891
1892=head1 BUGS
1893
1894Perl 5.8 has numerous memleaks that sometimes hit this module and are hard
1895to work around. If you suffer from memleaks, first upgrade to Perl 5.10
1896and check wether the leaks still show up. (Perl 5.10.0 has other annoying
1897memleaks, such as leaking on C<map> and C<grep> but it is usually not as
1898pronounced).
1899
858 1900
859=head1 SEE ALSO 1901=head1 SEE ALSO
860 1902
861Event modules: L<Coro::EV>, L<EV>, L<EV::Glib>, L<Glib::EV>, 1903Utility functions: L<AnyEvent::Util>.
862L<Coro::Event>, L<Event>, L<Glib::Event>, L<Glib>, L<Coro>, L<Tk>,
863L<Event::Lib>.
864 1904
865Implementations: L<AnyEvent::Impl::CoroEV>, L<AnyEvent::Impl::EV>, 1905Event modules: L<EV>, L<EV::Glib>, L<Glib::EV>, L<Event>, L<Glib::Event>,
866L<AnyEvent::Impl::CoroEvent>, L<AnyEvent::Impl::Event>, L<AnyEvent::Impl::Glib>, 1906L<Glib>, L<Tk>, L<Event::Lib>, L<Qt>, L<POE>.
867L<AnyEvent::Impl::Tk>, L<AnyEvent::Impl::Perl>, L<AnyEvent::Impl::EventLib>.
868 1907
1908Implementations: L<AnyEvent::Impl::EV>, L<AnyEvent::Impl::Event>,
1909L<AnyEvent::Impl::Glib>, L<AnyEvent::Impl::Tk>, L<AnyEvent::Impl::Perl>,
1910L<AnyEvent::Impl::EventLib>, L<AnyEvent::Impl::Qt>,
1911L<AnyEvent::Impl::POE>.
1912
1913Non-blocking file handles, sockets, TCP clients and
1914servers: L<AnyEvent::Handle>, L<AnyEvent::Socket>.
1915
1916Asynchronous DNS: L<AnyEvent::DNS>.
1917
1918Coroutine support: L<Coro>, L<Coro::AnyEvent>, L<Coro::EV>, L<Coro::Event>,
1919
869Nontrivial usage examples: L<Net::FCP>, L<Net::XMPP2>. 1920Nontrivial usage examples: L<Net::FCP>, L<Net::XMPP2>, L<AnyEvent::DNS>.
1921
870 1922
871=head1 AUTHOR 1923=head1 AUTHOR
872 1924
873 Marc Lehmann <schmorp@schmorp.de> 1925 Marc Lehmann <schmorp@schmorp.de>
874 http://home.schmorp.de/ 1926 http://home.schmorp.de/
875 1927
876=cut 1928=cut
877 1929
8781 19301
879 1931

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines