ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent.pm
Revision: 1.338
Committed: Tue Nov 23 04:45:59 2010 UTC (13 years, 7 months ago) by root
Branch: MAIN
Changes since 1.337: +2 -2 lines
Log Message:
*** empty log message ***

File Contents

# User Rev Content
1 root 1.150 =head1 NAME
2 root 1.1
3 root 1.256 AnyEvent - the DBI of event loop programming
4 root 1.2
5 root 1.258 EV, Event, Glib, Tk, Perl, Event::Lib, Irssi, rxvt-unicode, IO::Async, Qt
6     and POE are various supported event loops/environments.
7 root 1.1
8     =head1 SYNOPSIS
9    
10 root 1.7 use AnyEvent;
11 root 1.2
12 root 1.322 # if you prefer function calls, look at the AE manpage for
13 root 1.318 # an alternative API.
14    
15     # file handle or descriptor readable
16 root 1.207 my $w = AnyEvent->io (fh => $fh, poll => "r", cb => sub { ... });
17 root 1.173
18 root 1.207 # one-shot or repeating timers
19 root 1.173 my $w = AnyEvent->timer (after => $seconds, cb => sub { ... });
20 root 1.330 my $w = AnyEvent->timer (after => $seconds, interval => $seconds, cb => ...);
21 root 1.173
22     print AnyEvent->now; # prints current event loop time
23     print AnyEvent->time; # think Time::HiRes::time or simply CORE::time.
24    
25 root 1.207 # POSIX signal
26 root 1.173 my $w = AnyEvent->signal (signal => "TERM", cb => sub { ... });
27 root 1.5
28 root 1.207 # child process exit
29 root 1.173 my $w = AnyEvent->child (pid => $pid, cb => sub {
30     my ($pid, $status) = @_;
31 root 1.2 ...
32     });
33    
34 root 1.207 # called when event loop idle (if applicable)
35     my $w = AnyEvent->idle (cb => sub { ... });
36    
37 root 1.52 my $w = AnyEvent->condvar; # stores whether a condition was flagged
38 root 1.114 $w->send; # wake up current and all future recv's
39     $w->recv; # enters "main loop" till $condvar gets ->send
40 root 1.173 # use a condvar in callback mode:
41     $w->cb (sub { $_[0]->recv });
42 root 1.5
43 root 1.148 =head1 INTRODUCTION/TUTORIAL
44    
45     This manpage is mainly a reference manual. If you are interested
46     in a tutorial or some gentle introduction, have a look at the
47     L<AnyEvent::Intro> manpage.
48    
49 root 1.249 =head1 SUPPORT
50    
51 root 1.334 An FAQ document is available as L<AnyEvent::FAQ>.
52    
53     There also is a mailinglist for discussing all things AnyEvent, and an IRC
54 root 1.249 channel, too.
55    
56     See the AnyEvent project page at the B<Schmorpforge Ta-Sa Software
57 root 1.255 Repository>, at L<http://anyevent.schmorp.de>, for more info.
58 root 1.249
59 root 1.43 =head1 WHY YOU SHOULD USE THIS MODULE (OR NOT)
60 root 1.41
61     Glib, POE, IO::Async, Event... CPAN offers event models by the dozen
62     nowadays. So what is different about AnyEvent?
63    
64     Executive Summary: AnyEvent is I<compatible>, AnyEvent is I<free of
65     policy> and AnyEvent is I<small and efficient>.
66    
67     First and foremost, I<AnyEvent is not an event model> itself, it only
68 root 1.168 interfaces to whatever event model the main program happens to use, in a
69 root 1.41 pragmatic way. For event models and certain classes of immortals alike,
70 root 1.53 the statement "there can only be one" is a bitter reality: In general,
71     only one event loop can be active at the same time in a process. AnyEvent
72 root 1.168 cannot change this, but it can hide the differences between those event
73     loops.
74 root 1.41
75     The goal of AnyEvent is to offer module authors the ability to do event
76     programming (waiting for I/O or timer events) without subscribing to a
77     religion, a way of living, and most importantly: without forcing your
78     module users into the same thing by forcing them to use the same event
79     model you use.
80    
81 root 1.53 For modules like POE or IO::Async (which is a total misnomer as it is
82     actually doing all I/O I<synchronously>...), using them in your module is
83 root 1.330 like joining a cult: After you join, you are dependent on them and you
84 root 1.168 cannot use anything else, as they are simply incompatible to everything
85     that isn't them. What's worse, all the potential users of your
86     module are I<also> forced to use the same event loop you use.
87 root 1.53
88     AnyEvent is different: AnyEvent + POE works fine. AnyEvent + Glib works
89     fine. AnyEvent + Tk works fine etc. etc. but none of these work together
90 root 1.142 with the rest: POE + IO::Async? No go. Tk + Event? No go. Again: if
91 root 1.53 your module uses one of those, every user of your module has to use it,
92     too. But if your module uses AnyEvent, it works transparently with all
93 root 1.168 event models it supports (including stuff like IO::Async, as long as those
94 root 1.330 use one of the supported event loops. It is easy to add new event loops
95 root 1.168 to AnyEvent, too, so it is future-proof).
96 root 1.41
97 root 1.53 In addition to being free of having to use I<the one and only true event
98 root 1.41 model>, AnyEvent also is free of bloat and policy: with POE or similar
99 root 1.128 modules, you get an enormous amount of code and strict rules you have to
100 root 1.330 follow. AnyEvent, on the other hand, is lean and to the point, by only
101 root 1.53 offering the functionality that is necessary, in as thin as a wrapper as
102 root 1.41 technically possible.
103    
104 root 1.142 Of course, AnyEvent comes with a big (and fully optional!) toolbox
105     of useful functionality, such as an asynchronous DNS resolver, 100%
106     non-blocking connects (even with TLS/SSL, IPv6 and on broken platforms
107     such as Windows) and lots of real-world knowledge and workarounds for
108     platform bugs and differences.
109    
110     Now, if you I<do want> lots of policy (this can arguably be somewhat
111 root 1.46 useful) and you want to force your users to use the one and only event
112     model, you should I<not> use this module.
113 root 1.43
114 root 1.1 =head1 DESCRIPTION
115    
116 root 1.330 L<AnyEvent> provides a uniform interface to various event loops. This
117     allows module authors to use event loop functionality without forcing
118     module users to use a specific event loop implementation (since more
119     than one event loop cannot coexist peacefully).
120 root 1.2
121 root 1.53 The interface itself is vaguely similar, but not identical to the L<Event>
122 root 1.2 module.
123    
124 root 1.53 During the first call of any watcher-creation method, the module tries
125 root 1.61 to detect the currently loaded event loop by probing whether one of the
126 root 1.331 following modules is already loaded: L<EV>, L<AnyEvent::Impl::Perl>,
127     L<Event>, L<Glib>, L<Tk>, L<Event::Lib>, L<Qt>, L<POE>. The first one
128     found is used. If none are detected, the module tries to load the first
129     four modules in the order given; but note that if L<EV> is not
130     available, the pure-perl L<AnyEvent::Impl::Perl> should always work, so
131     the other two are not normally tried.
132 root 1.14
133     Because AnyEvent first checks for modules that are already loaded, loading
134 root 1.53 an event model explicitly before first using AnyEvent will likely make
135 root 1.14 that model the default. For example:
136    
137     use Tk;
138     use AnyEvent;
139    
140     # .. AnyEvent will likely default to Tk
141    
142 root 1.53 The I<likely> means that, if any module loads another event model and
143 root 1.329 starts using it, all bets are off - this case should be very rare though,
144     as very few modules hardcode event loops without announcing this very
145     loudly.
146 root 1.53
147 root 1.14 The pure-perl implementation of AnyEvent is called
148     C<AnyEvent::Impl::Perl>. Like other event modules you can load it
149 root 1.142 explicitly and enjoy the high availability of that event loop :)
150 root 1.14
151     =head1 WATCHERS
152    
153     AnyEvent has the central concept of a I<watcher>, which is an object that
154     stores relevant data for each kind of event you are waiting for, such as
155 root 1.128 the callback to call, the file handle to watch, etc.
156 root 1.14
157     These watchers are normal Perl objects with normal Perl lifetime. After
158 root 1.53 creating a watcher it will immediately "watch" for events and invoke the
159     callback when the event occurs (of course, only when the event model
160     is in control).
161    
162 root 1.196 Note that B<callbacks must not permanently change global variables>
163     potentially in use by the event loop (such as C<$_> or C<$[>) and that B<<
164 root 1.330 callbacks must not C<die> >>. The former is good programming practice in
165 root 1.196 Perl and the latter stems from the fact that exception handling differs
166     widely between event loops.
167    
168 root 1.330 To disable a watcher you have to destroy it (e.g. by setting the
169 root 1.53 variable you store it in to C<undef> or otherwise deleting all references
170     to it).
171 root 1.14
172     All watchers are created by calling a method on the C<AnyEvent> class.
173    
174 root 1.53 Many watchers either are used with "recursion" (repeating timers for
175     example), or need to refer to their watcher object in other ways.
176    
177 root 1.330 One way to achieve that is this pattern:
178 root 1.53
179 root 1.151 my $w; $w = AnyEvent->type (arg => value ..., cb => sub {
180     # you can use $w here, for example to undef it
181     undef $w;
182     });
183 root 1.53
184     Note that C<my $w; $w => combination. This is necessary because in Perl,
185     my variables are only visible after the statement in which they are
186     declared.
187    
188 root 1.78 =head2 I/O WATCHERS
189 root 1.14
190 root 1.266 $w = AnyEvent->io (
191     fh => <filehandle_or_fileno>,
192     poll => <"r" or "w">,
193     cb => <callback>,
194     );
195    
196 root 1.53 You can create an I/O watcher by calling the C<< AnyEvent->io >> method
197     with the following mandatory key-value pairs as arguments:
198 root 1.14
199 root 1.229 C<fh> is the Perl I<file handle> (or a naked file descriptor) to watch
200     for events (AnyEvent might or might not keep a reference to this file
201     handle). Note that only file handles pointing to things for which
202 root 1.199 non-blocking operation makes sense are allowed. This includes sockets,
203     most character devices, pipes, fifos and so on, but not for example files
204     or block devices.
205    
206     C<poll> must be a string that is either C<r> or C<w>, which creates a
207     watcher waiting for "r"eadable or "w"ritable events, respectively.
208    
209     C<cb> is the callback to invoke each time the file handle becomes ready.
210 root 1.53
211 root 1.85 Although the callback might get passed parameters, their value and
212     presence is undefined and you cannot rely on them. Portable AnyEvent
213     callbacks cannot use arguments passed to I/O watcher callbacks.
214    
215 root 1.82 The I/O watcher might use the underlying file descriptor or a copy of it.
216 root 1.84 You must not close a file handle as long as any watcher is active on the
217     underlying file descriptor.
218 root 1.53
219 root 1.330 Some event loops issue spurious readiness notifications, so you should
220 root 1.53 always use non-blocking calls when reading/writing from/to your file
221     handles.
222 root 1.14
223 root 1.164 Example: wait for readability of STDIN, then read a line and disable the
224     watcher.
225 root 1.14
226     my $w; $w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub {
227     chomp (my $input = <STDIN>);
228     warn "read: $input\n";
229     undef $w;
230     });
231    
232 root 1.19 =head2 TIME WATCHERS
233 root 1.14
234 root 1.266 $w = AnyEvent->timer (after => <seconds>, cb => <callback>);
235    
236     $w = AnyEvent->timer (
237     after => <fractional_seconds>,
238     interval => <fractional_seconds>,
239     cb => <callback>,
240     );
241    
242 root 1.19 You can create a time watcher by calling the C<< AnyEvent->timer >>
243 root 1.14 method with the following mandatory arguments:
244    
245 root 1.53 C<after> specifies after how many seconds (fractional values are
246 root 1.85 supported) the callback should be invoked. C<cb> is the callback to invoke
247     in that case.
248    
249     Although the callback might get passed parameters, their value and
250     presence is undefined and you cannot rely on them. Portable AnyEvent
251     callbacks cannot use arguments passed to time watcher callbacks.
252 root 1.14
253 root 1.330 The callback will normally be invoked only once. If you specify another
254 root 1.165 parameter, C<interval>, as a strictly positive number (> 0), then the
255     callback will be invoked regularly at that interval (in fractional
256     seconds) after the first invocation. If C<interval> is specified with a
257 root 1.330 false value, then it is treated as if it were not specified at all.
258 root 1.164
259     The callback will be rescheduled before invoking the callback, but no
260 root 1.330 attempt is made to avoid timer drift in most backends, so the interval is
261 root 1.164 only approximate.
262 root 1.14
263 root 1.164 Example: fire an event after 7.7 seconds.
264 root 1.14
265     my $w = AnyEvent->timer (after => 7.7, cb => sub {
266     warn "timeout\n";
267     });
268    
269     # to cancel the timer:
270 root 1.37 undef $w;
271 root 1.14
272 root 1.164 Example 2: fire an event after 0.5 seconds, then roughly every second.
273 root 1.53
274 root 1.164 my $w = AnyEvent->timer (after => 0.5, interval => 1, cb => sub {
275     warn "timeout\n";
276 root 1.53 };
277    
278     =head3 TIMING ISSUES
279    
280     There are two ways to handle timers: based on real time (relative, "fire
281     in 10 seconds") and based on wallclock time (absolute, "fire at 12
282     o'clock").
283    
284 root 1.58 While most event loops expect timers to specified in a relative way, they
285     use absolute time internally. This makes a difference when your clock
286     "jumps", for example, when ntp decides to set your clock backwards from
287     the wrong date of 2014-01-01 to 2008-01-01, a watcher that is supposed to
288 root 1.330 fire "after a second" might actually take six years to finally fire.
289 root 1.53
290     AnyEvent cannot compensate for this. The only event loop that is conscious
291 root 1.330 of these issues is L<EV>, which offers both relative (ev_timer, based
292 root 1.58 on true relative time) and absolute (ev_periodic, based on wallclock time)
293     timers.
294 root 1.53
295     AnyEvent always prefers relative timers, if available, matching the
296     AnyEvent API.
297    
298 root 1.143 AnyEvent has two additional methods that return the "current time":
299    
300     =over 4
301    
302     =item AnyEvent->time
303    
304     This returns the "current wallclock time" as a fractional number of
305     seconds since the Epoch (the same thing as C<time> or C<Time::HiRes::time>
306     return, and the result is guaranteed to be compatible with those).
307    
308 root 1.144 It progresses independently of any event loop processing, i.e. each call
309     will check the system clock, which usually gets updated frequently.
310 root 1.143
311     =item AnyEvent->now
312    
313     This also returns the "current wallclock time", but unlike C<time>, above,
314     this value might change only once per event loop iteration, depending on
315     the event loop (most return the same time as C<time>, above). This is the
316 root 1.144 time that AnyEvent's timers get scheduled against.
317    
318     I<In almost all cases (in all cases if you don't care), this is the
319     function to call when you want to know the current time.>
320    
321     This function is also often faster then C<< AnyEvent->time >>, and
322     thus the preferred method if you want some timestamp (for example,
323 root 1.330 L<AnyEvent::Handle> uses this to update its activity timeouts).
324 root 1.144
325     The rest of this section is only of relevance if you try to be very exact
326 root 1.330 with your timing; you can skip it without a bad conscience.
327 root 1.143
328     For a practical example of when these times differ, consider L<Event::Lib>
329     and L<EV> and the following set-up:
330    
331 root 1.330 The event loop is running and has just invoked one of your callbacks at
332 root 1.143 time=500 (assume no other callbacks delay processing). In your callback,
333     you wait a second by executing C<sleep 1> (blocking the process for a
334     second) and then (at time=501) you create a relative timer that fires
335     after three seconds.
336    
337     With L<Event::Lib>, C<< AnyEvent->time >> and C<< AnyEvent->now >> will
338     both return C<501>, because that is the current time, and the timer will
339     be scheduled to fire at time=504 (C<501> + C<3>).
340    
341 root 1.144 With L<EV>, C<< AnyEvent->time >> returns C<501> (as that is the current
342 root 1.143 time), but C<< AnyEvent->now >> returns C<500>, as that is the time the
343     last event processing phase started. With L<EV>, your timer gets scheduled
344     to run at time=503 (C<500> + C<3>).
345    
346     In one sense, L<Event::Lib> is more exact, as it uses the current time
347     regardless of any delays introduced by event processing. However, most
348     callbacks do not expect large delays in processing, so this causes a
349 root 1.144 higher drift (and a lot more system calls to get the current time).
350 root 1.143
351     In another sense, L<EV> is more exact, as your timer will be scheduled at
352     the same time, regardless of how long event processing actually took.
353    
354     In either case, if you care (and in most cases, you don't), then you
355     can get whatever behaviour you want with any event loop, by taking the
356     difference between C<< AnyEvent->time >> and C<< AnyEvent->now >> into
357     account.
358    
359 root 1.205 =item AnyEvent->now_update
360    
361     Some event loops (such as L<EV> or L<AnyEvent::Impl::Perl>) cache
362     the current time for each loop iteration (see the discussion of L<<
363     AnyEvent->now >>, above).
364    
365     When a callback runs for a long time (or when the process sleeps), then
366     this "current" time will differ substantially from the real time, which
367     might affect timers and time-outs.
368    
369     When this is the case, you can call this method, which will update the
370     event loop's idea of "current time".
371    
372 root 1.296 A typical example would be a script in a web server (e.g. C<mod_perl>) -
373     when mod_perl executes the script, then the event loop will have the wrong
374     idea about the "current time" (being potentially far in the past, when the
375     script ran the last time). In that case you should arrange a call to C<<
376     AnyEvent->now_update >> each time the web server process wakes up again
377     (e.g. at the start of your script, or in a handler).
378    
379 root 1.205 Note that updating the time I<might> cause some events to be handled.
380    
381 root 1.143 =back
382    
383 root 1.53 =head2 SIGNAL WATCHERS
384 root 1.14
385 root 1.266 $w = AnyEvent->signal (signal => <uppercase_signal_name>, cb => <callback>);
386    
387 root 1.53 You can watch for signals using a signal watcher, C<signal> is the signal
388 root 1.167 I<name> in uppercase and without any C<SIG> prefix, C<cb> is the Perl
389     callback to be invoked whenever a signal occurs.
390 root 1.53
391 root 1.85 Although the callback might get passed parameters, their value and
392     presence is undefined and you cannot rely on them. Portable AnyEvent
393     callbacks cannot use arguments passed to signal watcher callbacks.
394    
395 elmex 1.129 Multiple signal occurrences can be clumped together into one callback
396     invocation, and callback invocation will be synchronous. Synchronous means
397 root 1.53 that it might take a while until the signal gets handled by the process,
398 elmex 1.129 but it is guaranteed not to interrupt any other callbacks.
399 root 1.53
400     The main advantage of using these watchers is that you can share a signal
401 root 1.242 between multiple watchers, and AnyEvent will ensure that signals will not
402     interrupt your program at bad times.
403 root 1.53
404 root 1.242 This watcher might use C<%SIG> (depending on the event loop used),
405     so programs overwriting those signals directly will likely not work
406     correctly.
407    
408 root 1.247 Example: exit on SIGINT
409    
410     my $w = AnyEvent->signal (signal => "INT", cb => sub { exit 1 });
411    
412 root 1.298 =head3 Restart Behaviour
413    
414     While restart behaviour is up to the event loop implementation, most will
415     not restart syscalls (that includes L<Async::Interrupt> and AnyEvent's
416     pure perl implementation).
417    
418     =head3 Safe/Unsafe Signals
419    
420     Perl signals can be either "safe" (synchronous to opcode handling) or
421     "unsafe" (asynchronous) - the former might get delayed indefinitely, the
422     latter might corrupt your memory.
423    
424     AnyEvent signal handlers are, in addition, synchronous to the event loop,
425     i.e. they will not interrupt your running perl program but will only be
426     called as part of the normal event handling (just like timer, I/O etc.
427     callbacks, too).
428    
429 root 1.247 =head3 Signal Races, Delays and Workarounds
430    
431     Many event loops (e.g. Glib, Tk, Qt, IO::Async) do not support attaching
432 root 1.267 callbacks to signals in a generic way, which is a pity, as you cannot
433     do race-free signal handling in perl, requiring C libraries for
434 root 1.330 this. AnyEvent will try to do its best, which means in some cases,
435 root 1.267 signals will be delayed. The maximum time a signal might be delayed is
436     specified in C<$AnyEvent::MAX_SIGNAL_LATENCY> (default: 10 seconds). This
437     variable can be changed only before the first signal watcher is created,
438     and should be left alone otherwise. This variable determines how often
439     AnyEvent polls for signals (in case a wake-up was missed). Higher values
440 root 1.242 will cause fewer spurious wake-ups, which is better for power and CPU
441 root 1.267 saving.
442    
443     All these problems can be avoided by installing the optional
444     L<Async::Interrupt> module, which works with most event loops. It will not
445     work with inherently broken event loops such as L<Event> or L<Event::Lib>
446 root 1.330 (and not with L<POE> currently, as POE does its own workaround with
447 root 1.267 one-second latency). For those, you just have to suffer the delays.
448 root 1.53
449     =head2 CHILD PROCESS WATCHERS
450    
451 root 1.266 $w = AnyEvent->child (pid => <process id>, cb => <callback>);
452    
453 root 1.330 You can also watch for a child process exit and catch its exit status.
454 root 1.53
455 root 1.330 The child process is specified by the C<pid> argument (on some backends,
456 root 1.254 using C<0> watches for any child process exit, on others this will
457     croak). The watcher will be triggered only when the child process has
458     finished and an exit status is available, not on any trace events
459     (stopped/continued).
460 root 1.181
461     The callback will be called with the pid and exit status (as returned by
462     waitpid), so unlike other watcher types, you I<can> rely on child watcher
463     callback arguments.
464    
465     This watcher type works by installing a signal handler for C<SIGCHLD>,
466     and since it cannot be shared, nothing else should use SIGCHLD or reap
467     random child processes (waiting for specific child processes, e.g. inside
468     C<system>, is just fine).
469 root 1.53
470 root 1.82 There is a slight catch to child watchers, however: you usually start them
471     I<after> the child process was created, and this means the process could
472     have exited already (and no SIGCHLD will be sent anymore).
473    
474 root 1.219 Not all event models handle this correctly (neither POE nor IO::Async do,
475     see their AnyEvent::Impl manpages for details), but even for event models
476     that I<do> handle this correctly, they usually need to be loaded before
477     the process exits (i.e. before you fork in the first place). AnyEvent's
478     pure perl event loop handles all cases correctly regardless of when you
479     start the watcher.
480    
481     This means you cannot create a child watcher as the very first
482     thing in an AnyEvent program, you I<have> to create at least one
483     watcher before you C<fork> the child (alternatively, you can call
484     C<AnyEvent::detect>).
485 root 1.82
486 root 1.242 As most event loops do not support waiting for child events, they will be
487     emulated by AnyEvent in most cases, in which the latency and race problems
488     mentioned in the description of signal watchers apply.
489    
490 root 1.82 Example: fork a process and wait for it
491    
492 root 1.151 my $done = AnyEvent->condvar;
493    
494     my $pid = fork or exit 5;
495    
496     my $w = AnyEvent->child (
497     pid => $pid,
498     cb => sub {
499     my ($pid, $status) = @_;
500     warn "pid $pid exited with status $status";
501     $done->send;
502     },
503     );
504    
505     # do something else, then wait for process exit
506     $done->recv;
507 root 1.82
508 root 1.207 =head2 IDLE WATCHERS
509    
510 root 1.266 $w = AnyEvent->idle (cb => <callback>);
511    
512 root 1.330 This will repeatedly invoke the callback after the process becomes idle,
513     until either the watcher is destroyed or new events have been detected.
514 root 1.207
515 root 1.309 Idle watchers are useful when there is a need to do something, but it
516     is not so important (or wise) to do it instantly. The callback will be
517     invoked only when there is "nothing better to do", which is usually
518     defined as "all outstanding events have been handled and no new events
519     have been detected". That means that idle watchers ideally get invoked
520     when the event loop has just polled for new events but none have been
521     detected. Instead of blocking to wait for more events, the idle watchers
522     will be invoked.
523    
524     Unfortunately, most event loops do not really support idle watchers (only
525 root 1.207 EV, Event and Glib do it in a usable fashion) - for the rest, AnyEvent
526     will simply call the callback "from time to time".
527    
528     Example: read lines from STDIN, but only process them when the
529     program is otherwise idle:
530    
531     my @lines; # read data
532     my $idle_w;
533     my $io_w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub {
534     push @lines, scalar <STDIN>;
535    
536     # start an idle watcher, if not already done
537     $idle_w ||= AnyEvent->idle (cb => sub {
538     # handle only one line, when there are lines left
539     if (my $line = shift @lines) {
540     print "handled when idle: $line";
541     } else {
542     # otherwise disable the idle watcher again
543     undef $idle_w;
544     }
545     });
546     });
547    
548 root 1.53 =head2 CONDITION VARIABLES
549    
550 root 1.266 $cv = AnyEvent->condvar;
551    
552     $cv->send (<list>);
553     my @res = $cv->recv;
554    
555 root 1.105 If you are familiar with some event loops you will know that all of them
556     require you to run some blocking "loop", "run" or similar function that
557     will actively watch for new events and call your callbacks.
558    
559 root 1.239 AnyEvent is slightly different: it expects somebody else to run the event
560     loop and will only block when necessary (usually when told by the user).
561 root 1.105
562 root 1.326 The tool to do that is called a "condition variable", so called because
563     they represent a condition that must become true.
564 root 1.105
565 root 1.239 Now is probably a good time to look at the examples further below.
566    
567 root 1.105 Condition variables can be created by calling the C<< AnyEvent->condvar
568     >> method, usually without arguments. The only argument pair allowed is
569     C<cb>, which specifies a callback to be called when the condition variable
570 root 1.173 becomes true, with the condition variable as the first argument (but not
571     the results).
572 root 1.105
573 elmex 1.129 After creation, the condition variable is "false" until it becomes "true"
574 root 1.131 by calling the C<send> method (or calling the condition variable as if it
575 root 1.135 were a callback, read about the caveats in the description for the C<<
576     ->send >> method).
577 root 1.105
578 root 1.326 Since condition variables are the most complex part of the AnyEvent API, here are
579     some different mental models of what they are - pick the ones you can connect to:
580    
581     =over 4
582    
583     =item * Condition variables are like callbacks - you can call them (and pass them instead
584     of callbacks). Unlike callbacks however, you can also wait for them to be called.
585    
586     =item * Condition variables are signals - one side can emit or send them,
587     the other side can wait for them, or install a handler that is called when
588     the signal fires.
589    
590     =item * Condition variables are like "Merge Points" - points in your program
591     where you merge multiple independent results/control flows into one.
592    
593 root 1.330 =item * Condition variables represent a transaction - functions that start
594 root 1.326 some kind of transaction can return them, leaving the caller the choice
595     between waiting in a blocking fashion, or setting a callback.
596    
597     =item * Condition variables represent future values, or promises to deliver
598     some result, long before the result is available.
599    
600     =back
601 root 1.14
602 root 1.105 Condition variables are very useful to signal that something has finished,
603     for example, if you write a module that does asynchronous http requests,
604 root 1.53 then a condition variable would be the ideal candidate to signal the
605 root 1.105 availability of results. The user can either act when the callback is
606 root 1.114 called or can synchronously C<< ->recv >> for the results.
607 root 1.53
608 root 1.105 You can also use them to simulate traditional event loops - for example,
609     you can block your main program until an event occurs - for example, you
610 root 1.114 could C<< ->recv >> in your main program until the user clicks the Quit
611 root 1.106 button of your app, which would C<< ->send >> the "quit" event.
612 root 1.53
613     Note that condition variables recurse into the event loop - if you have
614 elmex 1.129 two pieces of code that call C<< ->recv >> in a round-robin fashion, you
615 root 1.53 lose. Therefore, condition variables are good to export to your caller, but
616     you should avoid making a blocking wait yourself, at least in callbacks,
617     as this asks for trouble.
618 root 1.41
619 root 1.105 Condition variables are represented by hash refs in perl, and the keys
620     used by AnyEvent itself are all named C<_ae_XXX> to make subclassing
621     easy (it is often useful to build your own transaction class on top of
622     AnyEvent). To subclass, use C<AnyEvent::CondVar> as base class and call
623 root 1.330 its C<new> method in your own C<new> method.
624 root 1.105
625     There are two "sides" to a condition variable - the "producer side" which
626 root 1.106 eventually calls C<< -> send >>, and the "consumer side", which waits
627     for the send to occur.
628 root 1.105
629 root 1.131 Example: wait for a timer.
630 root 1.105
631 root 1.319 # condition: "wait till the timer is fired"
632     my $timer_fired = AnyEvent->condvar;
633 root 1.105
634 root 1.319 # create the timer - we could wait for, say
635     # a handle becomign ready, or even an
636     # AnyEvent::HTTP request to finish, but
637 root 1.105 # in this case, we simply use a timer:
638     my $w = AnyEvent->timer (
639     after => 1,
640 root 1.319 cb => sub { $timer_fired->send },
641 root 1.105 );
642    
643     # this "blocks" (while handling events) till the callback
644 root 1.285 # calls ->send
645 root 1.319 $timer_fired->recv;
646 root 1.105
647 root 1.239 Example: wait for a timer, but take advantage of the fact that condition
648     variables are also callable directly.
649 root 1.131
650     my $done = AnyEvent->condvar;
651     my $delay = AnyEvent->timer (after => 5, cb => $done);
652     $done->recv;
653    
654 root 1.173 Example: Imagine an API that returns a condvar and doesn't support
655     callbacks. This is how you make a synchronous call, for example from
656     the main program:
657    
658     use AnyEvent::CouchDB;
659    
660     ...
661    
662     my @info = $couchdb->info->recv;
663    
664 root 1.239 And this is how you would just set a callback to be called whenever the
665 root 1.173 results are available:
666    
667     $couchdb->info->cb (sub {
668     my @info = $_[0]->recv;
669     });
670    
671 root 1.105 =head3 METHODS FOR PRODUCERS
672    
673     These methods should only be used by the producing side, i.e. the
674 root 1.106 code/module that eventually sends the signal. Note that it is also
675 root 1.105 the producer side which creates the condvar in most cases, but it isn't
676     uncommon for the consumer to create it as well.
677 root 1.2
678 root 1.1 =over 4
679    
680 root 1.106 =item $cv->send (...)
681 root 1.105
682 root 1.114 Flag the condition as ready - a running C<< ->recv >> and all further
683     calls to C<recv> will (eventually) return after this method has been
684 root 1.106 called. If nobody is waiting the send will be remembered.
685 root 1.105
686     If a callback has been set on the condition variable, it is called
687 root 1.106 immediately from within send.
688 root 1.105
689 root 1.106 Any arguments passed to the C<send> call will be returned by all
690 root 1.114 future C<< ->recv >> calls.
691 root 1.105
692 root 1.239 Condition variables are overloaded so one can call them directly (as if
693     they were a code reference). Calling them directly is the same as calling
694     C<send>.
695 root 1.131
696 root 1.105 =item $cv->croak ($error)
697    
698 root 1.330 Similar to send, but causes all calls to C<< ->recv >> to invoke
699 root 1.105 C<Carp::croak> with the given error message/object/scalar.
700    
701     This can be used to signal any errors to the condition variable
702 root 1.239 user/consumer. Doing it this way instead of calling C<croak> directly
703 root 1.330 delays the error detection, but has the overwhelming advantage that it
704 root 1.239 diagnoses the error at the place where the result is expected, and not
705 root 1.330 deep in some event callback with no connection to the actual code causing
706 root 1.239 the problem.
707 root 1.105
708     =item $cv->begin ([group callback])
709    
710     =item $cv->end
711    
712     These two methods can be used to combine many transactions/events into
713     one. For example, a function that pings many hosts in parallel might want
714     to use a condition variable for the whole process.
715    
716     Every call to C<< ->begin >> will increment a counter, and every call to
717     C<< ->end >> will decrement it. If the counter reaches C<0> in C<< ->end
718 root 1.280 >>, the (last) callback passed to C<begin> will be executed, passing the
719     condvar as first argument. That callback is I<supposed> to call C<< ->send
720     >>, but that is not required. If no group callback was set, C<send> will
721     be called without any arguments.
722 root 1.105
723 root 1.222 You can think of C<< $cv->send >> giving you an OR condition (one call
724     sends), while C<< $cv->begin >> and C<< $cv->end >> giving you an AND
725     condition (all C<begin> calls must be C<end>'ed before the condvar sends).
726    
727     Let's start with a simple example: you have two I/O watchers (for example,
728     STDOUT and STDERR for a program), and you want to wait for both streams to
729     close before activating a condvar:
730    
731     my $cv = AnyEvent->condvar;
732    
733     $cv->begin; # first watcher
734     my $w1 = AnyEvent->io (fh => $fh1, cb => sub {
735     defined sysread $fh1, my $buf, 4096
736     or $cv->end;
737     });
738    
739     $cv->begin; # second watcher
740     my $w2 = AnyEvent->io (fh => $fh2, cb => sub {
741     defined sysread $fh2, my $buf, 4096
742     or $cv->end;
743     });
744    
745     $cv->recv;
746    
747     This works because for every event source (EOF on file handle), there is
748     one call to C<begin>, so the condvar waits for all calls to C<end> before
749     sending.
750    
751     The ping example mentioned above is slightly more complicated, as the
752     there are results to be passwd back, and the number of tasks that are
753 root 1.330 begun can potentially be zero:
754 root 1.105
755     my $cv = AnyEvent->condvar;
756    
757     my %result;
758 root 1.280 $cv->begin (sub { shift->send (\%result) });
759 root 1.105
760     for my $host (@list_of_hosts) {
761     $cv->begin;
762     ping_host_then_call_callback $host, sub {
763     $result{$host} = ...;
764     $cv->end;
765     };
766     }
767    
768     $cv->end;
769    
770     This code fragment supposedly pings a number of hosts and calls
771 root 1.106 C<send> after results for all then have have been gathered - in any
772 root 1.105 order. To achieve this, the code issues a call to C<begin> when it starts
773     each ping request and calls C<end> when it has received some result for
774     it. Since C<begin> and C<end> only maintain a counter, the order in which
775     results arrive is not relevant.
776    
777     There is an additional bracketing call to C<begin> and C<end> outside the
778     loop, which serves two important purposes: first, it sets the callback
779     to be called once the counter reaches C<0>, and second, it ensures that
780 root 1.106 C<send> is called even when C<no> hosts are being pinged (the loop
781 root 1.105 doesn't execute once).
782    
783 root 1.222 This is the general pattern when you "fan out" into multiple (but
784 root 1.330 potentially zero) subrequests: use an outer C<begin>/C<end> pair to set
785 root 1.222 the callback and ensure C<end> is called at least once, and then, for each
786     subrequest you start, call C<begin> and for each subrequest you finish,
787     call C<end>.
788 root 1.105
789     =back
790    
791     =head3 METHODS FOR CONSUMERS
792    
793     These methods should only be used by the consuming side, i.e. the
794     code awaits the condition.
795    
796 root 1.106 =over 4
797    
798 root 1.114 =item $cv->recv
799 root 1.14
800 root 1.106 Wait (blocking if necessary) until the C<< ->send >> or C<< ->croak
801 root 1.330 >> methods have been called on C<$cv>, while servicing other watchers
802 root 1.105 normally.
803    
804     You can only wait once on a condition - additional calls are valid but
805     will return immediately.
806    
807     If an error condition has been set by calling C<< ->croak >>, then this
808     function will call C<croak>.
809 root 1.14
810 root 1.106 In list context, all parameters passed to C<send> will be returned,
811 root 1.105 in scalar context only the first one will be returned.
812 root 1.14
813 root 1.239 Note that doing a blocking wait in a callback is not supported by any
814     event loop, that is, recursive invocation of a blocking C<< ->recv
815     >> is not allowed, and the C<recv> call will C<croak> if such a
816     condition is detected. This condition can be slightly loosened by using
817     L<Coro::AnyEvent>, which allows you to do a blocking C<< ->recv >> from
818     any thread that doesn't run the event loop itself.
819    
820 root 1.47 Not all event models support a blocking wait - some die in that case
821 root 1.53 (programs might want to do that to stay interactive), so I<if you are
822 root 1.239 using this from a module, never require a blocking wait>. Instead, let the
823 root 1.52 caller decide whether the call will block or not (for example, by coupling
824 root 1.47 condition variables with some kind of request results and supporting
825     callbacks so the caller knows that getting the result will not block,
826 elmex 1.129 while still supporting blocking waits if the caller so desires).
827 root 1.47
828 root 1.330 You can ensure that C<< ->recv >> never blocks by setting a callback and
829 root 1.114 only calling C<< ->recv >> from within that callback (or at a later
830 root 1.105 time). This will work even when the event loop does not support blocking
831     waits otherwise.
832 root 1.53
833 root 1.106 =item $bool = $cv->ready
834    
835     Returns true when the condition is "true", i.e. whether C<send> or
836     C<croak> have been called.
837    
838 root 1.173 =item $cb = $cv->cb ($cb->($cv))
839 root 1.106
840     This is a mutator function that returns the callback set and optionally
841     replaces it before doing so.
842    
843 root 1.330 The callback will be called when the condition becomes "true", i.e. when
844     C<send> or C<croak> are called, with the only argument being the
845     condition variable itself. If the condition is already true, the
846     callback is called immediately when it is set. Calling C<recv> inside
847     the callback or at any later time is guaranteed not to block.
848 root 1.106
849 root 1.53 =back
850 root 1.14
851 root 1.232 =head1 SUPPORTED EVENT LOOPS/BACKENDS
852    
853     The available backend classes are (every class has its own manpage):
854    
855     =over 4
856    
857     =item Backends that are autoprobed when no other event loop can be found.
858    
859     EV is the preferred backend when no other event loop seems to be in
860 root 1.276 use. If EV is not installed, then AnyEvent will fall back to its own
861     pure-perl implementation, which is available everywhere as it comes with
862     AnyEvent itself.
863 root 1.232
864     AnyEvent::Impl::EV based on EV (interface to libev, best choice).
865     AnyEvent::Impl::Perl pure-perl implementation, fast and portable.
866    
867     =item Backends that are transparently being picked up when they are used.
868    
869 root 1.330 These will be used if they are already loaded when the first watcher
870 root 1.232 is created, in which case it is assumed that the application is using
871     them. This means that AnyEvent will automatically pick the right backend
872     when the main program loads an event module before anything starts to
873     create watchers. Nothing special needs to be done by the main program.
874    
875 root 1.276 AnyEvent::Impl::Event based on Event, very stable, few glitches.
876 root 1.232 AnyEvent::Impl::Glib based on Glib, slow but very stable.
877     AnyEvent::Impl::Tk based on Tk, very broken.
878     AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse.
879     AnyEvent::Impl::POE based on POE, very slow, some limitations.
880 root 1.254 AnyEvent::Impl::Irssi used when running within irssi.
881 root 1.232
882     =item Backends with special needs.
883    
884     Qt requires the Qt::Application to be instantiated first, but will
885     otherwise be picked up automatically. As long as the main program
886     instantiates the application before any AnyEvent watchers are created,
887     everything should just work.
888    
889     AnyEvent::Impl::Qt based on Qt.
890    
891     Support for IO::Async can only be partial, as it is too broken and
892     architecturally limited to even support the AnyEvent API. It also
893     is the only event loop that needs the loop to be set explicitly, so
894     it can only be used by a main program knowing about AnyEvent. See
895 root 1.330 L<AnyEvent::Impl::IOAsync> for the gory details.
896 root 1.232
897     AnyEvent::Impl::IOAsync based on IO::Async, cannot be autoprobed.
898    
899     =item Event loops that are indirectly supported via other backends.
900    
901     Some event loops can be supported via other modules:
902    
903     There is no direct support for WxWidgets (L<Wx>) or L<Prima>.
904    
905     B<WxWidgets> has no support for watching file handles. However, you can
906     use WxWidgets through the POE adaptor, as POE has a Wx backend that simply
907     polls 20 times per second, which was considered to be too horrible to even
908     consider for AnyEvent.
909    
910     B<Prima> is not supported as nobody seems to be using it, but it has a POE
911     backend, so it can be supported through POE.
912    
913     AnyEvent knows about both L<Prima> and L<Wx>, however, and will try to
914     load L<POE> when detecting them, in the hope that POE will pick them up,
915     in which case everything will be automatic.
916    
917     =back
918    
919 root 1.53 =head1 GLOBAL VARIABLES AND FUNCTIONS
920 root 1.16
921 root 1.233 These are not normally required to use AnyEvent, but can be useful to
922     write AnyEvent extension modules.
923    
924 root 1.16 =over 4
925    
926     =item $AnyEvent::MODEL
927    
928 root 1.233 Contains C<undef> until the first watcher is being created, before the
929     backend has been autodetected.
930    
931     Afterwards it contains the event model that is being used, which is the
932     name of the Perl class implementing the model. This class is usually one
933 root 1.330 of the C<AnyEvent::Impl::xxx> modules, but can be any other class in the
934 root 1.233 case AnyEvent has been extended at runtime (e.g. in I<rxvt-unicode> it
935     will be C<urxvt::anyevent>).
936 root 1.16
937 root 1.19 =item AnyEvent::detect
938    
939 root 1.53 Returns C<$AnyEvent::MODEL>, forcing autodetection of the event model
940     if necessary. You should only call this function right before you would
941     have created an AnyEvent watcher anyway, that is, as late as possible at
942 root 1.330 runtime, and not e.g. during initialisation of your module.
943 root 1.233
944     If you need to do some initialisation before AnyEvent watchers are
945     created, use C<post_detect>.
946 root 1.19
947 root 1.111 =item $guard = AnyEvent::post_detect { BLOCK }
948 root 1.109
949     Arranges for the code block to be executed as soon as the event model is
950 root 1.330 autodetected (or immediately if that has already happened).
951 root 1.109
952 root 1.233 The block will be executed I<after> the actual backend has been detected
953     (C<$AnyEvent::MODEL> is set), but I<before> any watchers have been
954     created, so it is possible to e.g. patch C<@AnyEvent::ISA> or do
955     other initialisations - see the sources of L<AnyEvent::Strict> or
956     L<AnyEvent::AIO> to see how this is used.
957    
958     The most common usage is to create some global watchers, without forcing
959     event module detection too early, for example, L<AnyEvent::AIO> creates
960     and installs the global L<IO::AIO> watcher in a C<post_detect> block to
961     avoid autodetecting the event module at load time.
962    
963 root 1.110 If called in scalar or list context, then it creates and returns an object
964 root 1.252 that automatically removes the callback again when it is destroyed (or
965     C<undef> when the hook was immediately executed). See L<AnyEvent::AIO> for
966     a case where this is useful.
967    
968     Example: Create a watcher for the IO::AIO module and store it in
969 root 1.330 C<$WATCHER>, but do so only do so after the event loop is initialised.
970 root 1.252
971     our WATCHER;
972    
973     my $guard = AnyEvent::post_detect {
974     $WATCHER = AnyEvent->io (fh => IO::AIO::poll_fileno, poll => 'r', cb => \&IO::AIO::poll_cb);
975     };
976    
977     # the ||= is important in case post_detect immediately runs the block,
978     # as to not clobber the newly-created watcher. assigning both watcher and
979     # post_detect guard to the same variable has the advantage of users being
980     # able to just C<undef $WATCHER> if the watcher causes them grief.
981    
982     $WATCHER ||= $guard;
983 root 1.110
984 root 1.111 =item @AnyEvent::post_detect
985 root 1.108
986     If there are any code references in this array (you can C<push> to it
987 root 1.330 before or after loading AnyEvent), then they will be called directly
988     after the event loop has been chosen.
989 root 1.108
990     You should check C<$AnyEvent::MODEL> before adding to this array, though:
991 root 1.233 if it is defined then the event loop has already been detected, and the
992     array will be ignored.
993    
994     Best use C<AnyEvent::post_detect { BLOCK }> when your application allows
995 root 1.304 it, as it takes care of these details.
996 root 1.108
997 root 1.233 This variable is mainly useful for modules that can do something useful
998     when AnyEvent is used and thus want to know when it is initialised, but do
999     not need to even load it by default. This array provides the means to hook
1000     into AnyEvent passively, without loading it.
1001 root 1.109
1002 root 1.304 Example: To load Coro::AnyEvent whenever Coro and AnyEvent are used
1003     together, you could put this into Coro (this is the actual code used by
1004     Coro to accomplish this):
1005    
1006     if (defined $AnyEvent::MODEL) {
1007     # AnyEvent already initialised, so load Coro::AnyEvent
1008     require Coro::AnyEvent;
1009     } else {
1010     # AnyEvent not yet initialised, so make sure to load Coro::AnyEvent
1011     # as soon as it is
1012     push @AnyEvent::post_detect, sub { require Coro::AnyEvent };
1013     }
1014    
1015 root 1.16 =back
1016    
1017 root 1.14 =head1 WHAT TO DO IN A MODULE
1018    
1019 root 1.53 As a module author, you should C<use AnyEvent> and call AnyEvent methods
1020 root 1.14 freely, but you should not load a specific event module or rely on it.
1021    
1022 root 1.53 Be careful when you create watchers in the module body - AnyEvent will
1023 root 1.14 decide which event module to use as soon as the first method is called, so
1024     by calling AnyEvent in your module body you force the user of your module
1025     to load the event module first.
1026    
1027 root 1.114 Never call C<< ->recv >> on a condition variable unless you I<know> that
1028 root 1.106 the C<< ->send >> method has been called on it already. This is
1029 root 1.53 because it will stall the whole program, and the whole point of using
1030     events is to stay interactive.
1031    
1032 root 1.114 It is fine, however, to call C<< ->recv >> when the user of your module
1033 root 1.53 requests it (i.e. if you create a http request object ad have a method
1034 root 1.330 called C<results> that returns the results, it may call C<< ->recv >>
1035     freely, as the user of your module knows what she is doing. Always).
1036 root 1.53
1037 root 1.14 =head1 WHAT TO DO IN THE MAIN PROGRAM
1038    
1039     There will always be a single main program - the only place that should
1040     dictate which event model to use.
1041    
1042 root 1.330 If the program is not event-based, it need not do anything special, even
1043     when it depends on a module that uses an AnyEvent. If the program itself
1044     uses AnyEvent, but does not care which event loop is used, all it needs
1045     to do is C<use AnyEvent>. In either case, AnyEvent will choose the best
1046     available loop implementation.
1047 root 1.14
1048 root 1.134 If the main program relies on a specific event model - for example, in
1049     Gtk2 programs you have to rely on the Glib module - you should load the
1050 root 1.53 event module before loading AnyEvent or any module that uses it: generally
1051     speaking, you should load it as early as possible. The reason is that
1052     modules might create watchers when they are loaded, and AnyEvent will
1053     decide on the event model to use as soon as it creates watchers, and it
1054 root 1.330 might choose the wrong one unless you load the correct one yourself.
1055 root 1.14
1056 root 1.134 You can chose to use a pure-perl implementation by loading the
1057     C<AnyEvent::Impl::Perl> module, which gives you similar behaviour
1058     everywhere, but letting AnyEvent chose the model is generally better.
1059    
1060     =head2 MAINLOOP EMULATION
1061    
1062     Sometimes (often for short test scripts, or even standalone programs who
1063     only want to use AnyEvent), you do not want to run a specific event loop.
1064    
1065     In that case, you can use a condition variable like this:
1066    
1067     AnyEvent->condvar->recv;
1068    
1069     This has the effect of entering the event loop and looping forever.
1070    
1071     Note that usually your program has some exit condition, in which case
1072     it is better to use the "traditional" approach of storing a condition
1073     variable somewhere, waiting for it, and sending it when the program should
1074     exit cleanly.
1075    
1076 root 1.14
1077 elmex 1.100 =head1 OTHER MODULES
1078    
1079 root 1.101 The following is a non-exhaustive list of additional modules that use
1080 root 1.230 AnyEvent as a client and can therefore be mixed easily with other AnyEvent
1081     modules and other event loops in the same program. Some of the modules
1082 root 1.325 come as part of AnyEvent, the others are available via CPAN.
1083 root 1.101
1084     =over 4
1085    
1086     =item L<AnyEvent::Util>
1087    
1088 root 1.330 Contains various utility functions that replace often-used blocking
1089     functions such as C<inet_aton> with event/callback-based versions.
1090 root 1.101
1091 root 1.125 =item L<AnyEvent::Socket>
1092    
1093     Provides various utility functions for (internet protocol) sockets,
1094     addresses and name resolution. Also functions to create non-blocking tcp
1095     connections or tcp servers, with IPv6 and SRV record support and more.
1096    
1097 root 1.164 =item L<AnyEvent::Handle>
1098    
1099     Provide read and write buffers, manages watchers for reads and writes,
1100     supports raw and formatted I/O, I/O queued and fully transparent and
1101 root 1.330 non-blocking SSL/TLS (via L<AnyEvent::TLS>).
1102 root 1.164
1103 root 1.134 =item L<AnyEvent::DNS>
1104    
1105     Provides rich asynchronous DNS resolver capabilities.
1106    
1107 root 1.323 =item L<AnyEvent::HTTP>, L<AnyEvent::IRC>, L<AnyEvent::XMPP>, L<AnyEvent::GPSD>, L<AnyEvent::IGS>, L<AnyEvent::FCP>
1108 root 1.155
1109 root 1.323 Implement event-based interfaces to the protocols of the same name (for
1110     the curious, IGS is the International Go Server and FCP is the Freenet
1111     Client Protocol).
1112    
1113     =item L<AnyEvent::Handle::UDP>
1114    
1115     Here be danger!
1116    
1117     As Pauli would put it, "Not only is it not right, it's not even wrong!" -
1118     there are so many things wrong with AnyEvent::Handle::UDP, most notably
1119 root 1.330 its use of a stream-based API with a protocol that isn't streamable, that
1120 root 1.323 the only way to improve it is to delete it.
1121    
1122     It features data corruption (but typically only under load) and general
1123     confusion. On top, the author is not only clueless about UDP but also
1124     fact-resistant - some gems of his understanding: "connect doesn't work
1125     with UDP", "UDP packets are not IP packets", "UDP only has datagrams, not
1126     packets", "I don't need to implement proper error checking as UDP doesn't
1127     support error checking" and so on - he doesn't even understand what's
1128     wrong with his module when it is explained to him.
1129 root 1.101
1130 root 1.159 =item L<AnyEvent::DBI>
1131    
1132 root 1.323 Executes L<DBI> requests asynchronously in a proxy process for you,
1133 root 1.330 notifying you in an event-based way when the operation is finished.
1134 root 1.164
1135     =item L<AnyEvent::AIO>
1136    
1137 root 1.323 Truly asynchronous (as opposed to non-blocking) I/O, should be in the
1138     toolbox of every event programmer. AnyEvent::AIO transparently fuses
1139     L<IO::AIO> and AnyEvent together, giving AnyEvent access to event-based
1140     file I/O, and much more.
1141 root 1.164
1142 root 1.323 =item L<AnyEvent::HTTPD>
1143 root 1.164
1144 root 1.323 A simple embedded webserver.
1145 root 1.164
1146 root 1.323 =item L<AnyEvent::FastPing>
1147 root 1.164
1148 root 1.323 The fastest ping in the west.
1149 root 1.101
1150     =item L<Coro>
1151    
1152 root 1.108 Has special support for AnyEvent via L<Coro::AnyEvent>.
1153 root 1.101
1154 elmex 1.100 =back
1155    
1156 root 1.1 =cut
1157    
1158     package AnyEvent;
1159    
1160 root 1.243 # basically a tuned-down version of common::sense
1161     sub common_sense {
1162 root 1.332 # from common:.sense 3.3
1163     ${^WARNING_BITS} ^= ${^WARNING_BITS} ^ "\x3c\x3f\x33\x00\x0f\xf3\x0f\xc0\xf0\xfc\x33\x00";
1164 root 1.306 # use strict vars subs - NO UTF-8, as Util.pm doesn't like this atm. (uts46data.pl)
1165 root 1.243 $^H |= 0x00000600;
1166     }
1167    
1168     BEGIN { AnyEvent::common_sense }
1169 root 1.24
1170 root 1.239 use Carp ();
1171 root 1.1
1172 root 1.337 our $VERSION = '5.29';
1173 root 1.2 our $MODEL;
1174 root 1.1
1175 root 1.2 our $AUTOLOAD;
1176     our @ISA;
1177 root 1.1
1178 root 1.135 our @REGISTRY;
1179    
1180 root 1.242 our $VERBOSE;
1181    
1182 root 1.138 BEGIN {
1183 root 1.313 require "AnyEvent/constants.pl";
1184    
1185 root 1.317 eval "sub TAINT (){" . (${^TAINT}*1) . "}";
1186 root 1.214
1187     delete @ENV{grep /^PERL_ANYEVENT_/, keys %ENV}
1188     if ${^TAINT};
1189 root 1.242
1190     $VERBOSE = $ENV{PERL_ANYEVENT_VERBOSE}*1;
1191    
1192 root 1.138 }
1193    
1194 root 1.242 our $MAX_SIGNAL_LATENCY = 10;
1195 root 1.7
1196 root 1.136 our %PROTOCOL; # (ipv4|ipv6) => (1|2), higher numbers are preferred
1197 root 1.126
1198     {
1199     my $idx;
1200     $PROTOCOL{$_} = ++$idx
1201 root 1.136 for reverse split /\s*,\s*/,
1202     $ENV{PERL_ANYEVENT_PROTOCOLS} || "ipv4,ipv6";
1203 root 1.126 }
1204    
1205 root 1.1 my @models = (
1206 root 1.254 [EV:: => AnyEvent::Impl::EV:: , 1],
1207     [AnyEvent::Impl::Perl:: => AnyEvent::Impl::Perl:: , 1],
1208     # everything below here will not (normally) be autoprobed
1209 root 1.135 # as the pureperl backend should work everywhere
1210     # and is usually faster
1211 root 1.276 [Event:: => AnyEvent::Impl::Event::, 1],
1212 root 1.254 [Glib:: => AnyEvent::Impl::Glib:: , 1], # becomes extremely slow with many watchers
1213 root 1.61 [Event::Lib:: => AnyEvent::Impl::EventLib::], # too buggy
1214 root 1.254 [Irssi:: => AnyEvent::Impl::Irssi::], # Irssi has a bogus "Event" package
1215 root 1.232 [Tk:: => AnyEvent::Impl::Tk::], # crashes with many handles
1216 root 1.237 [Qt:: => AnyEvent::Impl::Qt::], # requires special main program
1217 root 1.232 [POE::Kernel:: => AnyEvent::Impl::POE::], # lasciate ogni speranza
1218 root 1.135 [Wx:: => AnyEvent::Impl::POE::],
1219     [Prima:: => AnyEvent::Impl::POE::],
1220 root 1.232 # IO::Async is just too broken - we would need workarounds for its
1221 root 1.219 # byzantine signal and broken child handling, among others.
1222     # IO::Async is rather hard to detect, as it doesn't have any
1223     # obvious default class.
1224 root 1.277 [IO::Async:: => AnyEvent::Impl::IOAsync::], # requires special main program
1225     [IO::Async::Loop:: => AnyEvent::Impl::IOAsync::], # requires special main program
1226     [IO::Async::Notifier:: => AnyEvent::Impl::IOAsync::], # requires special main program
1227     [AnyEvent::Impl::IOAsync:: => AnyEvent::Impl::IOAsync::], # requires special main program
1228 root 1.1 );
1229    
1230 root 1.205 our %method = map +($_ => 1),
1231 root 1.207 qw(io timer time now now_update signal child idle condvar one_event DESTROY);
1232 root 1.3
1233 root 1.111 our @post_detect;
1234 root 1.109
1235 root 1.111 sub post_detect(&) {
1236 root 1.110 my ($cb) = @_;
1237    
1238 root 1.317 push @post_detect, $cb;
1239 root 1.110
1240 root 1.317 defined wantarray
1241     ? bless \$cb, "AnyEvent::Util::postdetect"
1242     : ()
1243 root 1.109 }
1244 root 1.108
1245 root 1.207 sub AnyEvent::Util::postdetect::DESTROY {
1246 root 1.111 @post_detect = grep $_ != ${$_[0]}, @post_detect;
1247 root 1.110 }
1248    
1249 root 1.19 sub detect() {
1250 root 1.312 # free some memory
1251     *detect = sub () { $MODEL };
1252    
1253     local $!; # for good measure
1254     local $SIG{__DIE__};
1255    
1256     if ($ENV{PERL_ANYEVENT_MODEL} =~ /^([a-zA-Z]+)$/) {
1257     my $model = "AnyEvent::Impl::$1";
1258     if (eval "require $model") {
1259     $MODEL = $model;
1260     warn "AnyEvent: loaded model '$model' (forced by \$ENV{PERL_ANYEVENT_MODEL}), using it.\n" if $VERBOSE >= 2;
1261     } else {
1262     warn "AnyEvent: unable to load model '$model' (from \$ENV{PERL_ANYEVENT_MODEL}):\n$@" if $VERBOSE;
1263     }
1264     }
1265    
1266     # check for already loaded models
1267 root 1.19 unless ($MODEL) {
1268 root 1.312 for (@REGISTRY, @models) {
1269     my ($package, $model) = @$_;
1270     if (${"$package\::VERSION"} > 0) {
1271     if (eval "require $model") {
1272     $MODEL = $model;
1273     warn "AnyEvent: autodetected model '$model', using it.\n" if $VERBOSE >= 2;
1274     last;
1275     }
1276 root 1.2 }
1277 root 1.1 }
1278    
1279 root 1.2 unless ($MODEL) {
1280 root 1.312 # try to autoload a model
1281 root 1.61 for (@REGISTRY, @models) {
1282 root 1.312 my ($package, $model, $autoload) = @$_;
1283     if (
1284     $autoload
1285     and eval "require $package"
1286     and ${"$package\::VERSION"} > 0
1287     and eval "require $model"
1288     ) {
1289     $MODEL = $model;
1290     warn "AnyEvent: autoloaded model '$model', using it.\n" if $VERBOSE >= 2;
1291     last;
1292 root 1.8 }
1293 root 1.2 }
1294    
1295 root 1.312 $MODEL
1296 root 1.338 or die "AnyEvent: backend autodetection failed - did you properly install AnyEvent?\n";
1297 root 1.1 }
1298 root 1.312 }
1299 root 1.19
1300 root 1.312 @models = (); # free probe data
1301 root 1.108
1302 root 1.312 push @{"$MODEL\::ISA"}, "AnyEvent::Base";
1303     unshift @ISA, $MODEL;
1304 root 1.168
1305 root 1.338 # now nuke some methods that are overridden by the backend.
1306 root 1.317 # SUPER is not allowed.
1307     for (qw(time signal child idle)) {
1308     undef &{"AnyEvent::Base::$_"}
1309     if defined &{"$MODEL\::$_"};
1310     }
1311    
1312 root 1.312 require AnyEvent::Strict if $ENV{PERL_ANYEVENT_STRICT};
1313 root 1.167
1314 root 1.312 (shift @post_detect)->() while @post_detect;
1315 root 1.1
1316 root 1.317 *post_detect = sub(&) {
1317     shift->();
1318    
1319     undef
1320     };
1321    
1322 root 1.19 $MODEL
1323     }
1324    
1325     sub AUTOLOAD {
1326     (my $func = $AUTOLOAD) =~ s/.*://;
1327    
1328     $method{$func}
1329 root 1.312 or Carp::croak "$func: not a valid AnyEvent class method";
1330 root 1.19
1331 root 1.312 detect;
1332 root 1.2
1333     my $class = shift;
1334 root 1.18 $class->$func (@_);
1335 root 1.1 }
1336    
1337 root 1.169 # utility function to dup a filehandle. this is used by many backends
1338     # to support binding more than one watcher per filehandle (they usually
1339     # allow only one watcher per fd, so we dup it to get a different one).
1340 root 1.219 sub _dupfh($$;$$) {
1341 root 1.169 my ($poll, $fh, $r, $w) = @_;
1342    
1343     # cygwin requires the fh mode to be matching, unix doesn't
1344 root 1.241 my ($rw, $mode) = $poll eq "r" ? ($r, "<&") : ($w, ">&");
1345 root 1.169
1346 root 1.241 open my $fh2, $mode, $fh
1347 root 1.229 or die "AnyEvent->io: cannot dup() filehandle in mode '$poll': $!,";
1348 root 1.169
1349     # we assume CLOEXEC is already set by perl in all important cases
1350    
1351     ($fh2, $rw)
1352     }
1353    
1354 root 1.278 =head1 SIMPLIFIED AE API
1355    
1356     Starting with version 5.0, AnyEvent officially supports a second, much
1357     simpler, API that is designed to reduce the calling, typing and memory
1358 root 1.318 overhead by using function call syntax and a fixed number of parameters.
1359 root 1.278
1360     See the L<AE> manpage for details.
1361    
1362     =cut
1363 root 1.273
1364     package AE;
1365    
1366 root 1.275 our $VERSION = $AnyEvent::VERSION;
1367    
1368 root 1.318 # fall back to the main API by default - backends and AnyEvent::Base
1369     # implementations can overwrite these.
1370    
1371 root 1.273 sub io($$$) {
1372     AnyEvent->io (fh => $_[0], poll => $_[1] ? "w" : "r", cb => $_[2])
1373     }
1374    
1375     sub timer($$$) {
1376 root 1.277 AnyEvent->timer (after => $_[0], interval => $_[1], cb => $_[2])
1377 root 1.273 }
1378    
1379     sub signal($$) {
1380 root 1.277 AnyEvent->signal (signal => $_[0], cb => $_[1])
1381 root 1.273 }
1382    
1383     sub child($$) {
1384 root 1.277 AnyEvent->child (pid => $_[0], cb => $_[1])
1385 root 1.273 }
1386    
1387     sub idle($) {
1388 root 1.277 AnyEvent->idle (cb => $_[0])
1389 root 1.273 }
1390    
1391     sub cv(;&) {
1392     AnyEvent->condvar (@_ ? (cb => $_[0]) : ())
1393     }
1394    
1395     sub now() {
1396     AnyEvent->now
1397     }
1398    
1399     sub now_update() {
1400     AnyEvent->now_update
1401     }
1402    
1403     sub time() {
1404     AnyEvent->time
1405     }
1406    
1407 root 1.19 package AnyEvent::Base;
1408    
1409 root 1.205 # default implementations for many methods
1410 root 1.143
1411 root 1.317 sub time {
1412     eval q{ # poor man's autoloading {}
1413 root 1.312 # probe for availability of Time::HiRes
1414     if (eval "use Time::HiRes (); Time::HiRes::time (); 1") {
1415     warn "AnyEvent: using Time::HiRes for sub-second timing accuracy.\n" if $VERBOSE >= 8;
1416 root 1.317 *AE::time = \&Time::HiRes::time;
1417 root 1.312 # if (eval "use POSIX (); (POSIX::times())...
1418     } else {
1419     warn "AnyEvent: using built-in time(), WARNING, no sub-second resolution!\n" if $VERBOSE;
1420 root 1.317 *AE::time = sub (){ time }; # epic fail
1421 root 1.312 }
1422 root 1.317
1423     *time = sub { AE::time }; # different prototypes
1424 root 1.312 };
1425     die if $@;
1426 root 1.242
1427 root 1.317 &time
1428 root 1.179 }
1429 root 1.143
1430 root 1.317 *now = \&time;
1431    
1432 root 1.205 sub now_update { }
1433 root 1.143
1434 root 1.114 # default implementation for ->condvar
1435 root 1.20
1436     sub condvar {
1437 root 1.317 eval q{ # poor man's autoloading {}
1438     *condvar = sub {
1439     bless { @_ == 3 ? (_ae_cb => $_[2]) : () }, "AnyEvent::CondVar"
1440     };
1441    
1442     *AE::cv = sub (;&) {
1443     bless { @_ ? (_ae_cb => shift) : () }, "AnyEvent::CondVar"
1444     };
1445     };
1446     die if $@;
1447    
1448     &condvar
1449 root 1.20 }
1450    
1451     # default implementation for ->signal
1452 root 1.19
1453 root 1.242 our $HAVE_ASYNC_INTERRUPT;
1454 root 1.263
1455     sub _have_async_interrupt() {
1456     $HAVE_ASYNC_INTERRUPT = 1*(!$ENV{PERL_ANYEVENT_AVOID_ASYNC_INTERRUPT}
1457 root 1.289 && eval "use Async::Interrupt 1.02 (); 1")
1458 root 1.263 unless defined $HAVE_ASYNC_INTERRUPT;
1459    
1460     $HAVE_ASYNC_INTERRUPT
1461     }
1462    
1463 root 1.195 our ($SIGPIPE_R, $SIGPIPE_W, %SIG_CB, %SIG_EV, $SIG_IO);
1464 root 1.242 our (%SIG_ASY, %SIG_ASY_W);
1465     our ($SIG_COUNT, $SIG_TW);
1466 root 1.195
1467 root 1.261 # install a dummy wakeup watcher to reduce signal catching latency
1468 root 1.312 # used by Impls
1469 root 1.246 sub _sig_add() {
1470     unless ($SIG_COUNT++) {
1471     # try to align timer on a full-second boundary, if possible
1472 root 1.273 my $NOW = AE::now;
1473 root 1.246
1474 root 1.273 $SIG_TW = AE::timer
1475     $MAX_SIGNAL_LATENCY - ($NOW - int $NOW),
1476     $MAX_SIGNAL_LATENCY,
1477     sub { } # just for the PERL_ASYNC_CHECK
1478     ;
1479 root 1.246 }
1480     }
1481    
1482     sub _sig_del {
1483     undef $SIG_TW
1484     unless --$SIG_COUNT;
1485     }
1486    
1487 root 1.263 our $_sig_name_init; $_sig_name_init = sub {
1488 root 1.317 eval q{ # poor man's autoloading {}
1489 root 1.265 undef $_sig_name_init;
1490 root 1.263
1491 root 1.265 if (_have_async_interrupt) {
1492     *sig2num = \&Async::Interrupt::sig2num;
1493     *sig2name = \&Async::Interrupt::sig2name;
1494     } else {
1495     require Config;
1496 root 1.264
1497 root 1.265 my %signame2num;
1498     @signame2num{ split ' ', $Config::Config{sig_name} }
1499     = split ' ', $Config::Config{sig_num};
1500    
1501     my @signum2name;
1502     @signum2name[values %signame2num] = keys %signame2num;
1503    
1504     *sig2num = sub($) {
1505     $_[0] > 0 ? shift : $signame2num{+shift}
1506     };
1507     *sig2name = sub ($) {
1508     $_[0] > 0 ? $signum2name[+shift] : shift
1509     };
1510     }
1511     };
1512     die if $@;
1513 root 1.263 };
1514    
1515     sub sig2num ($) { &$_sig_name_init; &sig2num }
1516     sub sig2name($) { &$_sig_name_init; &sig2name }
1517    
1518 root 1.265 sub signal {
1519     eval q{ # poor man's autoloading {}
1520     # probe for availability of Async::Interrupt
1521     if (_have_async_interrupt) {
1522     warn "AnyEvent: using Async::Interrupt for race-free signal handling.\n" if $VERBOSE >= 8;
1523    
1524     $SIGPIPE_R = new Async::Interrupt::EventPipe;
1525 root 1.273 $SIG_IO = AE::io $SIGPIPE_R->fileno, 0, \&_signal_exec;
1526 root 1.242
1527 root 1.265 } else {
1528     warn "AnyEvent: using emulated perl signal handling with latency timer.\n" if $VERBOSE >= 8;
1529 root 1.242
1530 root 1.265 if (AnyEvent::WIN32) {
1531     require AnyEvent::Util;
1532 root 1.261
1533 root 1.265 ($SIGPIPE_R, $SIGPIPE_W) = AnyEvent::Util::portable_pipe ();
1534     AnyEvent::Util::fh_nonblocking ($SIGPIPE_R, 1) if $SIGPIPE_R;
1535     AnyEvent::Util::fh_nonblocking ($SIGPIPE_W, 1) if $SIGPIPE_W; # just in case
1536     } else {
1537     pipe $SIGPIPE_R, $SIGPIPE_W;
1538 root 1.313 fcntl $SIGPIPE_R, AnyEvent::F_SETFL, AnyEvent::O_NONBLOCK if $SIGPIPE_R;
1539     fcntl $SIGPIPE_W, AnyEvent::F_SETFL, AnyEvent::O_NONBLOCK if $SIGPIPE_W; # just in case
1540 root 1.265
1541     # not strictly required, as $^F is normally 2, but let's make sure...
1542 root 1.313 fcntl $SIGPIPE_R, AnyEvent::F_SETFD, AnyEvent::FD_CLOEXEC;
1543     fcntl $SIGPIPE_W, AnyEvent::F_SETFD, AnyEvent::FD_CLOEXEC;
1544 root 1.265 }
1545 root 1.242
1546 root 1.265 $SIGPIPE_R
1547     or Carp::croak "AnyEvent: unable to create a signal reporting pipe: $!\n";
1548 root 1.242
1549 root 1.273 $SIG_IO = AE::io $SIGPIPE_R, 0, \&_signal_exec;
1550 root 1.265 }
1551 root 1.242
1552 root 1.317 *signal = $HAVE_ASYNC_INTERRUPT
1553     ? sub {
1554     my (undef, %arg) = @_;
1555    
1556     # async::interrupt
1557     my $signal = sig2num $arg{signal};
1558     $SIG_CB{$signal}{$arg{cb}} = $arg{cb};
1559    
1560     $SIG_ASY{$signal} ||= new Async::Interrupt
1561     cb => sub { undef $SIG_EV{$signal} },
1562     signal => $signal,
1563     pipe => [$SIGPIPE_R->filenos],
1564     pipe_autodrain => 0,
1565     ;
1566    
1567     bless [$signal, $arg{cb}], "AnyEvent::Base::signal"
1568     }
1569     : sub {
1570     my (undef, %arg) = @_;
1571    
1572     # pure perl
1573     my $signal = sig2name $arg{signal};
1574     $SIG_CB{$signal}{$arg{cb}} = $arg{cb};
1575    
1576     $SIG{$signal} ||= sub {
1577     local $!;
1578     syswrite $SIGPIPE_W, "\x00", 1 unless %SIG_EV;
1579     undef $SIG_EV{$signal};
1580     };
1581    
1582     # can't do signal processing without introducing races in pure perl,
1583     # so limit the signal latency.
1584     _sig_add;
1585 root 1.242
1586 root 1.317 bless [$signal, $arg{cb}], "AnyEvent::Base::signal"
1587     }
1588     ;
1589 root 1.200
1590 root 1.265 *AnyEvent::Base::signal::DESTROY = sub {
1591     my ($signal, $cb) = @{$_[0]};
1592 root 1.195
1593 root 1.265 _sig_del;
1594 root 1.195
1595 root 1.265 delete $SIG_CB{$signal}{$cb};
1596 root 1.195
1597 root 1.265 $HAVE_ASYNC_INTERRUPT
1598     ? delete $SIG_ASY{$signal}
1599     : # delete doesn't work with older perls - they then
1600     # print weird messages, or just unconditionally exit
1601     # instead of getting the default action.
1602     undef $SIG{$signal}
1603     unless keys %{ $SIG_CB{$signal} };
1604     };
1605 root 1.312
1606     *_signal_exec = sub {
1607     $HAVE_ASYNC_INTERRUPT
1608     ? $SIGPIPE_R->drain
1609     : sysread $SIGPIPE_R, (my $dummy), 9;
1610    
1611     while (%SIG_EV) {
1612     for (keys %SIG_EV) {
1613     delete $SIG_EV{$_};
1614     $_->() for values %{ $SIG_CB{$_} || {} };
1615     }
1616     }
1617     };
1618 root 1.265 };
1619     die if $@;
1620 root 1.312
1621 root 1.242 &signal
1622 root 1.19 }
1623    
1624 root 1.20 # default implementation for ->child
1625    
1626     our %PID_CB;
1627     our $CHLD_W;
1628 root 1.37 our $CHLD_DELAY_W;
1629 root 1.20 our $WNOHANG;
1630    
1631 root 1.312 # used by many Impl's
1632 root 1.254 sub _emit_childstatus($$) {
1633     my (undef, $rpid, $rstatus) = @_;
1634    
1635     $_->($rpid, $rstatus)
1636     for values %{ $PID_CB{$rpid} || {} },
1637     values %{ $PID_CB{0} || {} };
1638     }
1639    
1640 root 1.312 sub child {
1641     eval q{ # poor man's autoloading {}
1642     *_sigchld = sub {
1643     my $pid;
1644 root 1.254
1645 root 1.312 AnyEvent->_emit_childstatus ($pid, $?)
1646     while ($pid = waitpid -1, $WNOHANG) > 0;
1647     };
1648 root 1.37
1649 root 1.312 *child = sub {
1650     my (undef, %arg) = @_;
1651 root 1.20
1652 root 1.312 defined (my $pid = $arg{pid} + 0)
1653     or Carp::croak "required option 'pid' is missing";
1654 root 1.20
1655 root 1.312 $PID_CB{$pid}{$arg{cb}} = $arg{cb};
1656 root 1.20
1657 root 1.312 # WNOHANG is almost cetrainly 1 everywhere
1658     $WNOHANG ||= $^O =~ /^(?:openbsd|netbsd|linux|freebsd|cygwin|MSWin32)$/
1659     ? 1
1660     : eval { local $SIG{__DIE__}; require POSIX; &POSIX::WNOHANG } || 1;
1661    
1662     unless ($CHLD_W) {
1663     $CHLD_W = AE::signal CHLD => \&_sigchld;
1664     # child could be a zombie already, so make at least one round
1665     &_sigchld;
1666     }
1667 root 1.20
1668 root 1.312 bless [$pid, $arg{cb}], "AnyEvent::Base::child"
1669     };
1670 root 1.20
1671 root 1.312 *AnyEvent::Base::child::DESTROY = sub {
1672     my ($pid, $cb) = @{$_[0]};
1673 root 1.20
1674 root 1.312 delete $PID_CB{$pid}{$cb};
1675     delete $PID_CB{$pid} unless keys %{ $PID_CB{$pid} };
1676 root 1.20
1677 root 1.312 undef $CHLD_W unless keys %PID_CB;
1678     };
1679     };
1680     die if $@;
1681    
1682     &child
1683 root 1.20 }
1684    
1685 root 1.207 # idle emulation is done by simply using a timer, regardless
1686 root 1.210 # of whether the process is idle or not, and not letting
1687 root 1.207 # the callback use more than 50% of the time.
1688     sub idle {
1689 root 1.312 eval q{ # poor man's autoloading {}
1690     *idle = sub {
1691     my (undef, %arg) = @_;
1692 root 1.207
1693 root 1.312 my ($cb, $w, $rcb) = $arg{cb};
1694 root 1.207
1695 root 1.312 $rcb = sub {
1696     if ($cb) {
1697     $w = _time;
1698     &$cb;
1699     $w = _time - $w;
1700    
1701     # never use more then 50% of the time for the idle watcher,
1702     # within some limits
1703     $w = 0.0001 if $w < 0.0001;
1704     $w = 5 if $w > 5;
1705    
1706     $w = AE::timer $w, 0, $rcb;
1707     } else {
1708     # clean up...
1709     undef $w;
1710     undef $rcb;
1711     }
1712     };
1713 root 1.207
1714 root 1.312 $w = AE::timer 0.05, 0, $rcb;
1715 root 1.207
1716 root 1.312 bless \\$cb, "AnyEvent::Base::idle"
1717     };
1718 root 1.207
1719 root 1.312 *AnyEvent::Base::idle::DESTROY = sub {
1720     undef $${$_[0]};
1721     };
1722     };
1723     die if $@;
1724 root 1.207
1725 root 1.312 &idle
1726 root 1.207 }
1727    
1728 root 1.116 package AnyEvent::CondVar;
1729    
1730     our @ISA = AnyEvent::CondVar::Base::;
1731    
1732 root 1.333 # only to be used for subclassing
1733     sub new {
1734     my $class = shift;
1735     bless AnyEvent->condvar (@_), $class
1736     }
1737    
1738 root 1.116 package AnyEvent::CondVar::Base;
1739 root 1.114
1740 root 1.243 #use overload
1741     # '&{}' => sub { my $self = shift; sub { $self->send (@_) } },
1742     # fallback => 1;
1743    
1744     # save 300+ kilobytes by dirtily hardcoding overloading
1745     ${"AnyEvent::CondVar::Base::OVERLOAD"}{dummy}++; # Register with magic by touching.
1746     *{'AnyEvent::CondVar::Base::()'} = sub { }; # "Make it findable via fetchmethod."
1747     *{'AnyEvent::CondVar::Base::(&{}'} = sub { my $self = shift; sub { $self->send (@_) } }; # &{}
1748     ${'AnyEvent::CondVar::Base::()'} = 1; # fallback
1749 root 1.131
1750 root 1.239 our $WAITING;
1751    
1752 root 1.114 sub _send {
1753 root 1.116 # nop
1754 root 1.114 }
1755    
1756     sub send {
1757 root 1.115 my $cv = shift;
1758     $cv->{_ae_sent} = [@_];
1759 root 1.116 (delete $cv->{_ae_cb})->($cv) if $cv->{_ae_cb};
1760 root 1.115 $cv->_send;
1761 root 1.114 }
1762    
1763     sub croak {
1764 root 1.115 $_[0]{_ae_croak} = $_[1];
1765 root 1.114 $_[0]->send;
1766     }
1767    
1768     sub ready {
1769     $_[0]{_ae_sent}
1770     }
1771    
1772 root 1.116 sub _wait {
1773 root 1.239 $WAITING
1774     and !$_[0]{_ae_sent}
1775     and Carp::croak "AnyEvent::CondVar: recursive blocking wait detected";
1776    
1777     local $WAITING = 1;
1778 root 1.116 AnyEvent->one_event while !$_[0]{_ae_sent};
1779     }
1780    
1781 root 1.114 sub recv {
1782 root 1.116 $_[0]->_wait;
1783 root 1.114
1784     Carp::croak $_[0]{_ae_croak} if $_[0]{_ae_croak};
1785     wantarray ? @{ $_[0]{_ae_sent} } : $_[0]{_ae_sent}[0]
1786     }
1787    
1788     sub cb {
1789 root 1.269 my $cv = shift;
1790    
1791     @_
1792     and $cv->{_ae_cb} = shift
1793     and $cv->{_ae_sent}
1794     and (delete $cv->{_ae_cb})->($cv);
1795 root 1.270
1796 root 1.269 $cv->{_ae_cb}
1797 root 1.114 }
1798    
1799     sub begin {
1800     ++$_[0]{_ae_counter};
1801     $_[0]{_ae_end_cb} = $_[1] if @_ > 1;
1802     }
1803    
1804     sub end {
1805     return if --$_[0]{_ae_counter};
1806 root 1.124 &{ $_[0]{_ae_end_cb} || sub { $_[0]->send } };
1807 root 1.114 }
1808    
1809     # undocumented/compatibility with pre-3.4
1810     *broadcast = \&send;
1811 root 1.116 *wait = \&_wait;
1812 root 1.114
1813 root 1.180 =head1 ERROR AND EXCEPTION HANDLING
1814 root 1.53
1815 root 1.180 In general, AnyEvent does not do any error handling - it relies on the
1816     caller to do that if required. The L<AnyEvent::Strict> module (see also
1817     the C<PERL_ANYEVENT_STRICT> environment variable, below) provides strict
1818     checking of all AnyEvent methods, however, which is highly useful during
1819     development.
1820    
1821     As for exception handling (i.e. runtime errors and exceptions thrown while
1822     executing a callback), this is not only highly event-loop specific, but
1823     also not in any way wrapped by this module, as this is the job of the main
1824     program.
1825    
1826     The pure perl event loop simply re-throws the exception (usually
1827     within C<< condvar->recv >>), the L<Event> and L<EV> modules call C<<
1828     $Event/EV::DIED->() >>, L<Glib> uses C<< install_exception_handler >> and
1829     so on.
1830 root 1.12
1831 root 1.7 =head1 ENVIRONMENT VARIABLES
1832    
1833 root 1.180 The following environment variables are used by this module or its
1834 root 1.214 submodules.
1835    
1836     Note that AnyEvent will remove I<all> environment variables starting with
1837     C<PERL_ANYEVENT_> from C<%ENV> when it is loaded while taint mode is
1838     enabled.
1839 root 1.7
1840 root 1.55 =over 4
1841    
1842     =item C<PERL_ANYEVENT_VERBOSE>
1843    
1844 root 1.60 By default, AnyEvent will be completely silent except in fatal
1845     conditions. You can set this environment variable to make AnyEvent more
1846     talkative.
1847    
1848     When set to C<1> or higher, causes AnyEvent to warn about unexpected
1849     conditions, such as not being able to load the event model specified by
1850     C<PERL_ANYEVENT_MODEL>.
1851    
1852 root 1.55 When set to C<2> or higher, cause AnyEvent to report to STDERR which event
1853     model it chooses.
1854    
1855 root 1.244 When set to C<8> or higher, then AnyEvent will report extra information on
1856     which optional modules it loads and how it implements certain features.
1857    
1858 root 1.167 =item C<PERL_ANYEVENT_STRICT>
1859    
1860     AnyEvent does not do much argument checking by default, as thorough
1861     argument checking is very costly. Setting this variable to a true value
1862 root 1.170 will cause AnyEvent to load C<AnyEvent::Strict> and then to thoroughly
1863 root 1.218 check the arguments passed to most method calls. If it finds any problems,
1864 root 1.170 it will croak.
1865    
1866     In other words, enables "strict" mode.
1867    
1868 root 1.330 Unlike C<use strict> (or its modern cousin, C<< use L<common::sense>
1869 root 1.243 >>, it is definitely recommended to keep it off in production. Keeping
1870     C<PERL_ANYEVENT_STRICT=1> in your environment while developing programs
1871     can be very useful, however.
1872 root 1.167
1873 root 1.55 =item C<PERL_ANYEVENT_MODEL>
1874    
1875     This can be used to specify the event model to be used by AnyEvent, before
1876 root 1.128 auto detection and -probing kicks in. It must be a string consisting
1877 root 1.55 entirely of ASCII letters. The string C<AnyEvent::Impl::> gets prepended
1878     and the resulting module name is loaded and if the load was successful,
1879     used as event model. If it fails to load AnyEvent will proceed with
1880 root 1.128 auto detection and -probing.
1881 root 1.55
1882     This functionality might change in future versions.
1883    
1884     For example, to force the pure perl model (L<AnyEvent::Impl::Perl>) you
1885     could start your program like this:
1886    
1887 root 1.151 PERL_ANYEVENT_MODEL=Perl perl ...
1888 root 1.55
1889 root 1.125 =item C<PERL_ANYEVENT_PROTOCOLS>
1890    
1891     Used by both L<AnyEvent::DNS> and L<AnyEvent::Socket> to determine preferences
1892     for IPv4 or IPv6. The default is unspecified (and might change, or be the result
1893 root 1.128 of auto probing).
1894 root 1.125
1895     Must be set to a comma-separated list of protocols or address families,
1896     current supported: C<ipv4> and C<ipv6>. Only protocols mentioned will be
1897     used, and preference will be given to protocols mentioned earlier in the
1898     list.
1899    
1900 root 1.127 This variable can effectively be used for denial-of-service attacks
1901     against local programs (e.g. when setuid), although the impact is likely
1902 root 1.194 small, as the program has to handle conenction and other failures anyways.
1903 root 1.127
1904 root 1.125 Examples: C<PERL_ANYEVENT_PROTOCOLS=ipv4,ipv6> - prefer IPv4 over IPv6,
1905     but support both and try to use both. C<PERL_ANYEVENT_PROTOCOLS=ipv4>
1906     - only support IPv4, never try to resolve or contact IPv6
1907 root 1.128 addresses. C<PERL_ANYEVENT_PROTOCOLS=ipv6,ipv4> support either IPv4 or
1908 root 1.125 IPv6, but prefer IPv6 over IPv4.
1909    
1910 root 1.127 =item C<PERL_ANYEVENT_EDNS0>
1911    
1912 root 1.128 Used by L<AnyEvent::DNS> to decide whether to use the EDNS0 extension
1913 root 1.127 for DNS. This extension is generally useful to reduce DNS traffic, but
1914     some (broken) firewalls drop such DNS packets, which is why it is off by
1915     default.
1916    
1917     Setting this variable to C<1> will cause L<AnyEvent::DNS> to announce
1918     EDNS0 in its DNS requests.
1919    
1920 root 1.142 =item C<PERL_ANYEVENT_MAX_FORKS>
1921    
1922     The maximum number of child processes that C<AnyEvent::Util::fork_call>
1923     will create in parallel.
1924    
1925 root 1.226 =item C<PERL_ANYEVENT_MAX_OUTSTANDING_DNS>
1926    
1927     The default value for the C<max_outstanding> parameter for the default DNS
1928     resolver - this is the maximum number of parallel DNS requests that are
1929     sent to the DNS server.
1930    
1931     =item C<PERL_ANYEVENT_RESOLV_CONF>
1932    
1933     The file to use instead of F</etc/resolv.conf> (or OS-specific
1934     configuration) in the default resolver. When set to the empty string, no
1935     default config will be used.
1936    
1937 root 1.227 =item C<PERL_ANYEVENT_CA_FILE>, C<PERL_ANYEVENT_CA_PATH>.
1938    
1939     When neither C<ca_file> nor C<ca_path> was specified during
1940     L<AnyEvent::TLS> context creation, and either of these environment
1941     variables exist, they will be used to specify CA certificate locations
1942     instead of a system-dependent default.
1943    
1944 root 1.244 =item C<PERL_ANYEVENT_AVOID_GUARD> and C<PERL_ANYEVENT_AVOID_ASYNC_INTERRUPT>
1945    
1946     When these are set to C<1>, then the respective modules are not
1947     loaded. Mostly good for testing AnyEvent itself.
1948    
1949 root 1.55 =back
1950 root 1.7
1951 root 1.180 =head1 SUPPLYING YOUR OWN EVENT MODEL INTERFACE
1952    
1953     This is an advanced topic that you do not normally need to use AnyEvent in
1954     a module. This section is only of use to event loop authors who want to
1955     provide AnyEvent compatibility.
1956    
1957     If you need to support another event library which isn't directly
1958     supported by AnyEvent, you can supply your own interface to it by
1959     pushing, before the first watcher gets created, the package name of
1960     the event module and the package name of the interface to use onto
1961     C<@AnyEvent::REGISTRY>. You can do that before and even without loading
1962     AnyEvent, so it is reasonably cheap.
1963    
1964     Example:
1965    
1966     push @AnyEvent::REGISTRY, [urxvt => urxvt::anyevent::];
1967    
1968     This tells AnyEvent to (literally) use the C<urxvt::anyevent::>
1969     package/class when it finds the C<urxvt> package/module is already loaded.
1970    
1971     When AnyEvent is loaded and asked to find a suitable event model, it
1972     will first check for the presence of urxvt by trying to C<use> the
1973     C<urxvt::anyevent> module.
1974    
1975     The class should provide implementations for all watcher types. See
1976     L<AnyEvent::Impl::EV> (source code), L<AnyEvent::Impl::Glib> (Source code)
1977     and so on for actual examples. Use C<perldoc -m AnyEvent::Impl::Glib> to
1978     see the sources.
1979    
1980     If you don't provide C<signal> and C<child> watchers than AnyEvent will
1981     provide suitable (hopefully) replacements.
1982    
1983     The above example isn't fictitious, the I<rxvt-unicode> (a.k.a. urxvt)
1984     terminal emulator uses the above line as-is. An interface isn't included
1985     in AnyEvent because it doesn't make sense outside the embedded interpreter
1986     inside I<rxvt-unicode>, and it is updated and maintained as part of the
1987     I<rxvt-unicode> distribution.
1988    
1989     I<rxvt-unicode> also cheats a bit by not providing blocking access to
1990     condition variables: code blocking while waiting for a condition will
1991     C<die>. This still works with most modules/usages, and blocking calls must
1992     not be done in an interactive application, so it makes sense.
1993    
1994 root 1.53 =head1 EXAMPLE PROGRAM
1995 root 1.2
1996 root 1.78 The following program uses an I/O watcher to read data from STDIN, a timer
1997 root 1.53 to display a message once per second, and a condition variable to quit the
1998     program when the user enters quit:
1999 root 1.2
2000     use AnyEvent;
2001    
2002     my $cv = AnyEvent->condvar;
2003    
2004 root 1.53 my $io_watcher = AnyEvent->io (
2005     fh => \*STDIN,
2006     poll => 'r',
2007     cb => sub {
2008     warn "io event <$_[0]>\n"; # will always output <r>
2009     chomp (my $input = <STDIN>); # read a line
2010     warn "read: $input\n"; # output what has been read
2011 root 1.118 $cv->send if $input =~ /^q/i; # quit program if /^q/i
2012 root 1.53 },
2013     );
2014 root 1.2
2015 root 1.287 my $time_watcher = AnyEvent->timer (after => 1, interval => 1, cb => sub {
2016     warn "timeout\n"; # print 'timeout' at most every second
2017     });
2018 root 1.2
2019 root 1.118 $cv->recv; # wait until user enters /^q/i
2020 root 1.2
2021 root 1.5 =head1 REAL-WORLD EXAMPLE
2022    
2023     Consider the L<Net::FCP> module. It features (among others) the following
2024     API calls, which are to freenet what HTTP GET requests are to http:
2025    
2026     my $data = $fcp->client_get ($url); # blocks
2027    
2028     my $transaction = $fcp->txn_client_get ($url); # does not block
2029     $transaction->cb ( sub { ... } ); # set optional result callback
2030     my $data = $transaction->result; # possibly blocks
2031    
2032     The C<client_get> method works like C<LWP::Simple::get>: it requests the
2033     given URL and waits till the data has arrived. It is defined to be:
2034    
2035     sub client_get { $_[0]->txn_client_get ($_[1])->result }
2036    
2037     And in fact is automatically generated. This is the blocking API of
2038     L<Net::FCP>, and it works as simple as in any other, similar, module.
2039    
2040     More complicated is C<txn_client_get>: It only creates a transaction
2041     (completion, result, ...) object and initiates the transaction.
2042    
2043     my $txn = bless { }, Net::FCP::Txn::;
2044    
2045     It also creates a condition variable that is used to signal the completion
2046     of the request:
2047    
2048     $txn->{finished} = AnyAvent->condvar;
2049    
2050     It then creates a socket in non-blocking mode.
2051    
2052     socket $txn->{fh}, ...;
2053     fcntl $txn->{fh}, F_SETFL, O_NONBLOCK;
2054     connect $txn->{fh}, ...
2055     and !$!{EWOULDBLOCK}
2056     and !$!{EINPROGRESS}
2057     and Carp::croak "unable to connect: $!\n";
2058    
2059 root 1.6 Then it creates a write-watcher which gets called whenever an error occurs
2060 root 1.5 or the connection succeeds:
2061    
2062     $txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'w', cb => sub { $txn->fh_ready_w });
2063    
2064     And returns this transaction object. The C<fh_ready_w> callback gets
2065     called as soon as the event loop detects that the socket is ready for
2066     writing.
2067    
2068     The C<fh_ready_w> method makes the socket blocking again, writes the
2069     request data and replaces the watcher by a read watcher (waiting for reply
2070     data). The actual code is more complicated, but that doesn't matter for
2071     this example:
2072    
2073     fcntl $txn->{fh}, F_SETFL, 0;
2074     syswrite $txn->{fh}, $txn->{request}
2075     or die "connection or write error";
2076     $txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'r', cb => sub { $txn->fh_ready_r });
2077    
2078     Again, C<fh_ready_r> waits till all data has arrived, and then stores the
2079 root 1.128 result and signals any possible waiters that the request has finished:
2080 root 1.5
2081     sysread $txn->{fh}, $txn->{buf}, length $txn->{$buf};
2082    
2083     if (end-of-file or data complete) {
2084     $txn->{result} = $txn->{buf};
2085 root 1.118 $txn->{finished}->send;
2086 root 1.6 $txb->{cb}->($txn) of $txn->{cb}; # also call callback
2087 root 1.5 }
2088    
2089     The C<result> method, finally, just waits for the finished signal (if the
2090     request was already finished, it doesn't wait, of course, and returns the
2091     data:
2092    
2093 root 1.118 $txn->{finished}->recv;
2094 root 1.6 return $txn->{result};
2095 root 1.5
2096     The actual code goes further and collects all errors (C<die>s, exceptions)
2097 root 1.128 that occurred during request processing. The C<result> method detects
2098 root 1.52 whether an exception as thrown (it is stored inside the $txn object)
2099 root 1.5 and just throws the exception, which means connection errors and other
2100 root 1.318 problems get reported to the code that tries to use the result, not in a
2101 root 1.5 random callback.
2102    
2103     All of this enables the following usage styles:
2104    
2105     1. Blocking:
2106    
2107     my $data = $fcp->client_get ($url);
2108    
2109 root 1.49 2. Blocking, but running in parallel:
2110 root 1.5
2111     my @datas = map $_->result,
2112     map $fcp->txn_client_get ($_),
2113     @urls;
2114    
2115     Both blocking examples work without the module user having to know
2116     anything about events.
2117    
2118 root 1.49 3a. Event-based in a main program, using any supported event module:
2119 root 1.5
2120 root 1.49 use EV;
2121 root 1.5
2122     $fcp->txn_client_get ($url)->cb (sub {
2123     my $txn = shift;
2124     my $data = $txn->result;
2125     ...
2126     });
2127    
2128 root 1.49 EV::loop;
2129 root 1.5
2130     3b. The module user could use AnyEvent, too:
2131    
2132     use AnyEvent;
2133    
2134     my $quit = AnyEvent->condvar;
2135    
2136     $fcp->txn_client_get ($url)->cb (sub {
2137     ...
2138 root 1.118 $quit->send;
2139 root 1.5 });
2140    
2141 root 1.118 $quit->recv;
2142 root 1.5
2143 root 1.64
2144 root 1.91 =head1 BENCHMARKS
2145 root 1.64
2146 root 1.65 To give you an idea of the performance and overheads that AnyEvent adds
2147 root 1.91 over the event loops themselves and to give you an impression of the speed
2148     of various event loops I prepared some benchmarks.
2149 root 1.77
2150 root 1.91 =head2 BENCHMARKING ANYEVENT OVERHEAD
2151    
2152     Here is a benchmark of various supported event models used natively and
2153 root 1.128 through AnyEvent. The benchmark creates a lot of timers (with a zero
2154 root 1.91 timeout) and I/O watchers (watching STDOUT, a pty, to become writable,
2155     which it is), lets them fire exactly once and destroys them again.
2156    
2157     Source code for this benchmark is found as F<eg/bench> in the AnyEvent
2158 root 1.278 distribution. It uses the L<AE> interface, which makes a real difference
2159     for the EV and Perl backends only.
2160 root 1.91
2161     =head3 Explanation of the columns
2162 root 1.68
2163     I<watcher> is the number of event watchers created/destroyed. Since
2164     different event models feature vastly different performances, each event
2165     loop was given a number of watchers so that overall runtime is acceptable
2166     and similar between tested event loop (and keep them from crashing): Glib
2167     would probably take thousands of years if asked to process the same number
2168     of watchers as EV in this benchmark.
2169    
2170     I<bytes> is the number of bytes (as measured by the resident set size,
2171     RSS) consumed by each watcher. This method of measuring captures both C
2172     and Perl-based overheads.
2173    
2174     I<create> is the time, in microseconds (millionths of seconds), that it
2175     takes to create a single watcher. The callback is a closure shared between
2176     all watchers, to avoid adding memory overhead. That means closure creation
2177     and memory usage is not included in the figures.
2178    
2179     I<invoke> is the time, in microseconds, used to invoke a simple
2180     callback. The callback simply counts down a Perl variable and after it was
2181 root 1.118 invoked "watcher" times, it would C<< ->send >> a condvar once to
2182 root 1.69 signal the end of this phase.
2183 root 1.64
2184 root 1.71 I<destroy> is the time, in microseconds, that it takes to destroy a single
2185 root 1.68 watcher.
2186 root 1.64
2187 root 1.91 =head3 Results
2188 root 1.64
2189 root 1.75 name watchers bytes create invoke destroy comment
2190 root 1.278 EV/EV 100000 223 0.47 0.43 0.27 EV native interface
2191     EV/Any 100000 223 0.48 0.42 0.26 EV + AnyEvent watchers
2192     Coro::EV/Any 100000 223 0.47 0.42 0.26 coroutines + Coro::Signal
2193     Perl/Any 100000 431 2.70 0.74 0.92 pure perl implementation
2194     Event/Event 16000 516 31.16 31.84 0.82 Event native interface
2195     Event/Any 16000 1203 42.61 34.79 1.80 Event + AnyEvent watchers
2196     IOAsync/Any 16000 1911 41.92 27.45 16.81 via IO::Async::Loop::IO_Poll
2197     IOAsync/Any 16000 1726 40.69 26.37 15.25 via IO::Async::Loop::Epoll
2198     Glib/Any 16000 1118 89.00 12.57 51.17 quadratic behaviour
2199     Tk/Any 2000 1346 20.96 10.75 8.00 SEGV with >> 2000 watchers
2200     POE/Any 2000 6951 108.97 795.32 14.24 via POE::Loop::Event
2201     POE/Any 2000 6648 94.79 774.40 575.51 via POE::Loop::Select
2202 root 1.64
2203 root 1.91 =head3 Discussion
2204 root 1.68
2205     The benchmark does I<not> measure scalability of the event loop very
2206     well. For example, a select-based event loop (such as the pure perl one)
2207     can never compete with an event loop that uses epoll when the number of
2208 root 1.80 file descriptors grows high. In this benchmark, all events become ready at
2209     the same time, so select/poll-based implementations get an unnatural speed
2210     boost.
2211 root 1.68
2212 root 1.95 Also, note that the number of watchers usually has a nonlinear effect on
2213     overall speed, that is, creating twice as many watchers doesn't take twice
2214     the time - usually it takes longer. This puts event loops tested with a
2215     higher number of watchers at a disadvantage.
2216    
2217 root 1.96 To put the range of results into perspective, consider that on the
2218     benchmark machine, handling an event takes roughly 1600 CPU cycles with
2219     EV, 3100 CPU cycles with AnyEvent's pure perl loop and almost 3000000 CPU
2220     cycles with POE.
2221    
2222 root 1.68 C<EV> is the sole leader regarding speed and memory use, which are both
2223 root 1.278 maximal/minimal, respectively. When using the L<AE> API there is zero
2224     overhead (when going through the AnyEvent API create is about 5-6 times
2225     slower, with other times being equal, so still uses far less memory than
2226     any other event loop and is still faster than Event natively).
2227 root 1.64
2228     The pure perl implementation is hit in a few sweet spots (both the
2229 root 1.86 constant timeout and the use of a single fd hit optimisations in the perl
2230     interpreter and the backend itself). Nevertheless this shows that it
2231     adds very little overhead in itself. Like any select-based backend its
2232     performance becomes really bad with lots of file descriptors (and few of
2233     them active), of course, but this was not subject of this benchmark.
2234 root 1.64
2235 root 1.90 The C<Event> module has a relatively high setup and callback invocation
2236     cost, but overall scores in on the third place.
2237 root 1.64
2238 root 1.220 C<IO::Async> performs admirably well, about on par with C<Event>, even
2239     when using its pure perl backend.
2240    
2241 root 1.90 C<Glib>'s memory usage is quite a bit higher, but it features a
2242 root 1.73 faster callback invocation and overall ends up in the same class as
2243     C<Event>. However, Glib scales extremely badly, doubling the number of
2244     watchers increases the processing time by more than a factor of four,
2245     making it completely unusable when using larger numbers of watchers
2246     (note that only a single file descriptor was used in the benchmark, so
2247     inefficiencies of C<poll> do not account for this).
2248 root 1.64
2249 root 1.73 The C<Tk> adaptor works relatively well. The fact that it crashes with
2250 root 1.64 more than 2000 watchers is a big setback, however, as correctness takes
2251 root 1.68 precedence over speed. Nevertheless, its performance is surprising, as the
2252     file descriptor is dup()ed for each watcher. This shows that the dup()
2253     employed by some adaptors is not a big performance issue (it does incur a
2254 root 1.87 hidden memory cost inside the kernel which is not reflected in the figures
2255     above).
2256 root 1.68
2257 root 1.103 C<POE>, regardless of underlying event loop (whether using its pure perl
2258     select-based backend or the Event module, the POE-EV backend couldn't
2259     be tested because it wasn't working) shows abysmal performance and
2260     memory usage with AnyEvent: Watchers use almost 30 times as much memory
2261     as EV watchers, and 10 times as much memory as Event (the high memory
2262 root 1.87 requirements are caused by requiring a session for each watcher). Watcher
2263     invocation speed is almost 900 times slower than with AnyEvent's pure perl
2264 root 1.103 implementation.
2265    
2266     The design of the POE adaptor class in AnyEvent can not really account
2267     for the performance issues, though, as session creation overhead is
2268     small compared to execution of the state machine, which is coded pretty
2269     optimally within L<AnyEvent::Impl::POE> (and while everybody agrees that
2270     using multiple sessions is not a good approach, especially regarding
2271     memory usage, even the author of POE could not come up with a faster
2272     design).
2273 root 1.72
2274 root 1.91 =head3 Summary
2275 root 1.72
2276 root 1.87 =over 4
2277    
2278 root 1.89 =item * Using EV through AnyEvent is faster than any other event loop
2279     (even when used without AnyEvent), but most event loops have acceptable
2280     performance with or without AnyEvent.
2281 root 1.72
2282 root 1.87 =item * The overhead AnyEvent adds is usually much smaller than the overhead of
2283 root 1.89 the actual event loop, only with extremely fast event loops such as EV
2284 root 1.73 adds AnyEvent significant overhead.
2285 root 1.72
2286 root 1.90 =item * You should avoid POE like the plague if you want performance or
2287 root 1.72 reasonable memory usage.
2288 root 1.64
2289 root 1.87 =back
2290    
2291 root 1.91 =head2 BENCHMARKING THE LARGE SERVER CASE
2292    
2293 root 1.128 This benchmark actually benchmarks the event loop itself. It works by
2294     creating a number of "servers": each server consists of a socket pair, a
2295 root 1.91 timeout watcher that gets reset on activity (but never fires), and an I/O
2296     watcher waiting for input on one side of the socket. Each time the socket
2297     watcher reads a byte it will write that byte to a random other "server".
2298    
2299     The effect is that there will be a lot of I/O watchers, only part of which
2300     are active at any one point (so there is a constant number of active
2301 root 1.128 fds for each loop iteration, but which fds these are is random). The
2302 root 1.91 timeout is reset each time something is read because that reflects how
2303     most timeouts work (and puts extra pressure on the event loops).
2304    
2305 root 1.128 In this benchmark, we use 10000 socket pairs (20000 sockets), of which 100
2306 root 1.91 (1%) are active. This mirrors the activity of large servers with many
2307 root 1.92 connections, most of which are idle at any one point in time.
2308 root 1.91
2309     Source code for this benchmark is found as F<eg/bench2> in the AnyEvent
2310 root 1.278 distribution. It uses the L<AE> interface, which makes a real difference
2311     for the EV and Perl backends only.
2312 root 1.91
2313     =head3 Explanation of the columns
2314    
2315     I<sockets> is the number of sockets, and twice the number of "servers" (as
2316 root 1.94 each server has a read and write socket end).
2317 root 1.91
2318 root 1.128 I<create> is the time it takes to create a socket pair (which is
2319 root 1.91 nontrivial) and two watchers: an I/O watcher and a timeout watcher.
2320    
2321     I<request>, the most important value, is the time it takes to handle a
2322     single "request", that is, reading the token from the pipe and forwarding
2323 root 1.93 it to another server. This includes deleting the old timeout and creating
2324     a new one that moves the timeout into the future.
2325 root 1.91
2326     =head3 Results
2327    
2328 root 1.220 name sockets create request
2329 root 1.278 EV 20000 62.66 7.99
2330     Perl 20000 68.32 32.64
2331     IOAsync 20000 174.06 101.15 epoll
2332     IOAsync 20000 174.67 610.84 poll
2333     Event 20000 202.69 242.91
2334     Glib 20000 557.01 1689.52
2335     POE 20000 341.54 12086.32 uses POE::Loop::Event
2336 root 1.91
2337     =head3 Discussion
2338    
2339     This benchmark I<does> measure scalability and overall performance of the
2340     particular event loop.
2341    
2342     EV is again fastest. Since it is using epoll on my system, the setup time
2343     is relatively high, though.
2344    
2345     Perl surprisingly comes second. It is much faster than the C-based event
2346     loops Event and Glib.
2347    
2348 root 1.220 IO::Async performs very well when using its epoll backend, and still quite
2349     good compared to Glib when using its pure perl backend.
2350    
2351 root 1.91 Event suffers from high setup time as well (look at its code and you will
2352     understand why). Callback invocation also has a high overhead compared to
2353     the C<< $_->() for .. >>-style loop that the Perl event loop uses. Event
2354     uses select or poll in basically all documented configurations.
2355    
2356     Glib is hit hard by its quadratic behaviour w.r.t. many watchers. It
2357     clearly fails to perform with many filehandles or in busy servers.
2358    
2359     POE is still completely out of the picture, taking over 1000 times as long
2360     as EV, and over 100 times as long as the Perl implementation, even though
2361     it uses a C-based event loop in this case.
2362    
2363     =head3 Summary
2364    
2365     =over 4
2366    
2367 root 1.103 =item * The pure perl implementation performs extremely well.
2368 root 1.91
2369     =item * Avoid Glib or POE in large projects where performance matters.
2370    
2371     =back
2372    
2373     =head2 BENCHMARKING SMALL SERVERS
2374    
2375     While event loops should scale (and select-based ones do not...) even to
2376     large servers, most programs we (or I :) actually write have only a few
2377     I/O watchers.
2378    
2379     In this benchmark, I use the same benchmark program as in the large server
2380     case, but it uses only eight "servers", of which three are active at any
2381     one time. This should reflect performance for a small server relatively
2382     well.
2383    
2384     The columns are identical to the previous table.
2385    
2386     =head3 Results
2387    
2388     name sockets create request
2389     EV 16 20.00 6.54
2390 root 1.99 Perl 16 25.75 12.62
2391 root 1.91 Event 16 81.27 35.86
2392     Glib 16 32.63 15.48
2393     POE 16 261.87 276.28 uses POE::Loop::Event
2394    
2395     =head3 Discussion
2396    
2397     The benchmark tries to test the performance of a typical small
2398     server. While knowing how various event loops perform is interesting, keep
2399     in mind that their overhead in this case is usually not as important, due
2400 root 1.97 to the small absolute number of watchers (that is, you need efficiency and
2401     speed most when you have lots of watchers, not when you only have a few of
2402     them).
2403 root 1.91
2404     EV is again fastest.
2405    
2406 elmex 1.129 Perl again comes second. It is noticeably faster than the C-based event
2407 root 1.102 loops Event and Glib, although the difference is too small to really
2408     matter.
2409 root 1.91
2410 root 1.97 POE also performs much better in this case, but is is still far behind the
2411 root 1.91 others.
2412    
2413     =head3 Summary
2414    
2415     =over 4
2416    
2417     =item * C-based event loops perform very well with small number of
2418     watchers, as the management overhead dominates.
2419    
2420     =back
2421    
2422 root 1.215 =head2 THE IO::Lambda BENCHMARK
2423    
2424     Recently I was told about the benchmark in the IO::Lambda manpage, which
2425     could be misinterpreted to make AnyEvent look bad. In fact, the benchmark
2426     simply compares IO::Lambda with POE, and IO::Lambda looks better (which
2427     shouldn't come as a surprise to anybody). As such, the benchmark is
2428 root 1.218 fine, and mostly shows that the AnyEvent backend from IO::Lambda isn't
2429     very optimal. But how would AnyEvent compare when used without the extra
2430 root 1.215 baggage? To explore this, I wrote the equivalent benchmark for AnyEvent.
2431    
2432     The benchmark itself creates an echo-server, and then, for 500 times,
2433     connects to the echo server, sends a line, waits for the reply, and then
2434     creates the next connection. This is a rather bad benchmark, as it doesn't
2435 root 1.218 test the efficiency of the framework or much non-blocking I/O, but it is a
2436     benchmark nevertheless.
2437 root 1.215
2438     name runtime
2439     Lambda/select 0.330 sec
2440     + optimized 0.122 sec
2441     Lambda/AnyEvent 0.327 sec
2442     + optimized 0.138 sec
2443     Raw sockets/select 0.077 sec
2444     POE/select, components 0.662 sec
2445     POE/select, raw sockets 0.226 sec
2446     POE/select, optimized 0.404 sec
2447    
2448     AnyEvent/select/nb 0.085 sec
2449     AnyEvent/EV/nb 0.068 sec
2450     +state machine 0.134 sec
2451    
2452 root 1.218 The benchmark is also a bit unfair (my fault): the IO::Lambda/POE
2453 root 1.215 benchmarks actually make blocking connects and use 100% blocking I/O,
2454     defeating the purpose of an event-based solution. All of the newly
2455     written AnyEvent benchmarks use 100% non-blocking connects (using
2456     AnyEvent::Socket::tcp_connect and the asynchronous pure perl DNS
2457 root 1.218 resolver), so AnyEvent is at a disadvantage here, as non-blocking connects
2458 root 1.215 generally require a lot more bookkeeping and event handling than blocking
2459     connects (which involve a single syscall only).
2460    
2461     The last AnyEvent benchmark additionally uses L<AnyEvent::Handle>, which
2462 root 1.218 offers similar expressive power as POE and IO::Lambda, using conventional
2463     Perl syntax. This means that both the echo server and the client are 100%
2464     non-blocking, further placing it at a disadvantage.
2465    
2466     As you can see, the AnyEvent + EV combination even beats the
2467     hand-optimised "raw sockets benchmark", while AnyEvent + its pure perl
2468     backend easily beats IO::Lambda and POE.
2469 root 1.215
2470     And even the 100% non-blocking version written using the high-level (and
2471 root 1.288 slow :) L<AnyEvent::Handle> abstraction beats both POE and IO::Lambda
2472     higher level ("unoptimised") abstractions by a large margin, even though
2473     it does all of DNS, tcp-connect and socket I/O in a non-blocking way.
2474 root 1.218
2475     The two AnyEvent benchmarks programs can be found as F<eg/ae0.pl> and
2476     F<eg/ae2.pl> in the AnyEvent distribution, the remaining benchmarks are
2477 root 1.288 part of the IO::Lambda distribution and were used without any changes.
2478 root 1.216
2479 root 1.64
2480 root 1.185 =head1 SIGNALS
2481    
2482     AnyEvent currently installs handlers for these signals:
2483    
2484     =over 4
2485    
2486     =item SIGCHLD
2487    
2488     A handler for C<SIGCHLD> is installed by AnyEvent's child watcher
2489     emulation for event loops that do not support them natively. Also, some
2490     event loops install a similar handler.
2491    
2492 root 1.235 Additionally, when AnyEvent is loaded and SIGCHLD is set to IGNORE, then
2493     AnyEvent will reset it to default, to avoid losing child exit statuses.
2494 root 1.219
2495 root 1.185 =item SIGPIPE
2496    
2497     A no-op handler is installed for C<SIGPIPE> when C<$SIG{PIPE}> is C<undef>
2498     when AnyEvent gets loaded.
2499    
2500     The rationale for this is that AnyEvent users usually do not really depend
2501     on SIGPIPE delivery (which is purely an optimisation for shell use, or
2502     badly-written programs), but C<SIGPIPE> can cause spurious and rare
2503     program exits as a lot of people do not expect C<SIGPIPE> when writing to
2504     some random socket.
2505    
2506     The rationale for installing a no-op handler as opposed to ignoring it is
2507     that this way, the handler will be restored to defaults on exec.
2508    
2509     Feel free to install your own handler, or reset it to defaults.
2510    
2511     =back
2512    
2513     =cut
2514    
2515 root 1.219 undef $SIG{CHLD}
2516     if $SIG{CHLD} eq 'IGNORE';
2517    
2518 root 1.185 $SIG{PIPE} = sub { }
2519     unless defined $SIG{PIPE};
2520    
2521 root 1.242 =head1 RECOMMENDED/OPTIONAL MODULES
2522    
2523     One of AnyEvent's main goals is to be 100% Pure-Perl(tm): only perl (and
2524 root 1.330 its built-in modules) are required to use it.
2525 root 1.242
2526     That does not mean that AnyEvent won't take advantage of some additional
2527     modules if they are installed.
2528    
2529 root 1.301 This section explains which additional modules will be used, and how they
2530 root 1.299 affect AnyEvent's operation.
2531 root 1.242
2532     =over 4
2533    
2534     =item L<Async::Interrupt>
2535    
2536     This slightly arcane module is used to implement fast signal handling: To
2537     my knowledge, there is no way to do completely race-free and quick
2538     signal handling in pure perl. To ensure that signals still get
2539     delivered, AnyEvent will start an interval timer to wake up perl (and
2540 root 1.247 catch the signals) with some delay (default is 10 seconds, look for
2541 root 1.242 C<$AnyEvent::MAX_SIGNAL_LATENCY>).
2542    
2543     If this module is available, then it will be used to implement signal
2544     catching, which means that signals will not be delayed, and the event loop
2545 root 1.300 will not be interrupted regularly, which is more efficient (and good for
2546 root 1.242 battery life on laptops).
2547    
2548     This affects not just the pure-perl event loop, but also other event loops
2549     that have no signal handling on their own (e.g. Glib, Tk, Qt).
2550    
2551 root 1.247 Some event loops (POE, Event, Event::Lib) offer signal watchers natively,
2552     and either employ their own workarounds (POE) or use AnyEvent's workaround
2553     (using C<$AnyEvent::MAX_SIGNAL_LATENCY>). Installing L<Async::Interrupt>
2554     does nothing for those backends.
2555    
2556 root 1.242 =item L<EV>
2557    
2558     This module isn't really "optional", as it is simply one of the backend
2559     event loops that AnyEvent can use. However, it is simply the best event
2560     loop available in terms of features, speed and stability: It supports
2561     the AnyEvent API optimally, implements all the watcher types in XS, does
2562     automatic timer adjustments even when no monotonic clock is available,
2563     can take avdantage of advanced kernel interfaces such as C<epoll> and
2564     C<kqueue>, and is the fastest backend I<by far>. You can even embed
2565     L<Glib>/L<Gtk2> in it (or vice versa, see L<EV::Glib> and L<Glib::EV>).
2566    
2567 root 1.316 If you only use backends that rely on another event loop (e.g. C<Tk>),
2568     then this module will do nothing for you.
2569    
2570 root 1.242 =item L<Guard>
2571    
2572     The guard module, when used, will be used to implement
2573     C<AnyEvent::Util::guard>. This speeds up guards considerably (and uses a
2574     lot less memory), but otherwise doesn't affect guard operation much. It is
2575     purely used for performance.
2576    
2577     =item L<JSON> and L<JSON::XS>
2578    
2579 root 1.291 One of these modules is required when you want to read or write JSON data
2580 root 1.316 via L<AnyEvent::Handle>. L<JSON> is also written in pure-perl, but can take
2581 root 1.248 advantage of the ultra-high-speed L<JSON::XS> module when it is installed.
2582 root 1.242
2583     =item L<Net::SSLeay>
2584    
2585     Implementing TLS/SSL in Perl is certainly interesting, but not very
2586     worthwhile: If this module is installed, then L<AnyEvent::Handle> (with
2587     the help of L<AnyEvent::TLS>), gains the ability to do TLS/SSL.
2588    
2589     =item L<Time::HiRes>
2590    
2591     This module is part of perl since release 5.008. It will be used when the
2592 root 1.330 chosen event library does not come with a timing source of its own. The
2593 root 1.242 pure-perl event loop (L<AnyEvent::Impl::Perl>) will additionally use it to
2594     try to use a monotonic clock for timing stability.
2595    
2596     =back
2597    
2598    
2599 root 1.55 =head1 FORK
2600    
2601     Most event libraries are not fork-safe. The ones who are usually are
2602 root 1.308 because they rely on inefficient but fork-safe C<select> or C<poll> calls
2603     - higher performance APIs such as BSD's kqueue or the dreaded Linux epoll
2604     are usually badly thought-out hacks that are incompatible with fork in
2605     one way or another. Only L<EV> is fully fork-aware and ensures that you
2606     continue event-processing in both parent and child (or both, if you know
2607     what you are doing).
2608    
2609     This means that, in general, you cannot fork and do event processing in
2610     the child if the event library was initialised before the fork (which
2611     usually happens when the first AnyEvent watcher is created, or the library
2612     is loaded).
2613 root 1.301
2614 root 1.55 If you have to fork, you must either do so I<before> creating your first
2615 root 1.242 watcher OR you must not use AnyEvent at all in the child OR you must do
2616     something completely out of the scope of AnyEvent.
2617 root 1.55
2618 root 1.301 The problem of doing event processing in the parent I<and> the child
2619     is much more complicated: even for backends that I<are> fork-aware or
2620     fork-safe, their behaviour is not usually what you want: fork clones all
2621     watchers, that means all timers, I/O watchers etc. are active in both
2622 root 1.308 parent and child, which is almost never what you want. USing C<exec>
2623     to start worker children from some kind of manage rprocess is usually
2624     preferred, because it is much easier and cleaner, at the expense of having
2625     to have another binary.
2626 root 1.301
2627 root 1.64
2628 root 1.55 =head1 SECURITY CONSIDERATIONS
2629    
2630     AnyEvent can be forced to load any event model via
2631     $ENV{PERL_ANYEVENT_MODEL}. While this cannot (to my knowledge) be used to
2632     execute arbitrary code or directly gain access, it can easily be used to
2633     make the program hang or malfunction in subtle ways, as AnyEvent watchers
2634     will not be active when the program uses a different event model than
2635     specified in the variable.
2636    
2637     You can make AnyEvent completely ignore this variable by deleting it
2638     before the first watcher gets created, e.g. with a C<BEGIN> block:
2639    
2640 root 1.151 BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} }
2641    
2642     use AnyEvent;
2643 root 1.55
2644 root 1.107 Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can
2645     be used to probe what backend is used and gain other information (which is
2646 root 1.167 probably even less useful to an attacker than PERL_ANYEVENT_MODEL), and
2647 root 1.213 $ENV{PERL_ANYEVENT_STRICT}.
2648 root 1.107
2649 root 1.218 Note that AnyEvent will remove I<all> environment variables starting with
2650     C<PERL_ANYEVENT_> from C<%ENV> when it is loaded while taint mode is
2651     enabled.
2652    
2653 root 1.64
2654 root 1.156 =head1 BUGS
2655    
2656     Perl 5.8 has numerous memleaks that sometimes hit this module and are hard
2657     to work around. If you suffer from memleaks, first upgrade to Perl 5.10
2658     and check wether the leaks still show up. (Perl 5.10.0 has other annoying
2659 root 1.197 memleaks, such as leaking on C<map> and C<grep> but it is usually not as
2660 root 1.156 pronounced).
2661    
2662    
2663 root 1.2 =head1 SEE ALSO
2664    
2665 root 1.334 Tutorial/Introduction: L<AnyEvent::Intro>.
2666    
2667     FAQ: L<AnyEvent::FAQ>.
2668    
2669 root 1.125 Utility functions: L<AnyEvent::Util>.
2670    
2671 root 1.108 Event modules: L<EV>, L<EV::Glib>, L<Glib::EV>, L<Event>, L<Glib::Event>,
2672     L<Glib>, L<Tk>, L<Event::Lib>, L<Qt>, L<POE>.
2673    
2674     Implementations: L<AnyEvent::Impl::EV>, L<AnyEvent::Impl::Event>,
2675     L<AnyEvent::Impl::Glib>, L<AnyEvent::Impl::Tk>, L<AnyEvent::Impl::Perl>,
2676     L<AnyEvent::Impl::EventLib>, L<AnyEvent::Impl::Qt>,
2677 root 1.254 L<AnyEvent::Impl::POE>, L<AnyEvent::Impl::IOAsync>, L<Anyevent::Impl::Irssi>.
2678 root 1.108
2679 root 1.125 Non-blocking file handles, sockets, TCP clients and
2680 root 1.230 servers: L<AnyEvent::Handle>, L<AnyEvent::Socket>, L<AnyEvent::TLS>.
2681 root 1.125
2682 root 1.122 Asynchronous DNS: L<AnyEvent::DNS>.
2683    
2684 root 1.335 Thread support: L<Coro>, L<Coro::AnyEvent>, L<Coro::EV>, L<Coro::Event>.
2685 root 1.5
2686 root 1.334 Nontrivial usage examples: L<AnyEvent::GPSD>, L<AnyEvent::IRC>,
2687 root 1.230 L<AnyEvent::HTTP>.
2688 root 1.2
2689 root 1.64
2690 root 1.54 =head1 AUTHOR
2691    
2692 root 1.151 Marc Lehmann <schmorp@schmorp.de>
2693     http://home.schmorp.de/
2694 root 1.2
2695     =cut
2696    
2697     1
2698 root 1.1