1 |
NAME |
2 |
AnyEvent - the DBI of event loop programming |
3 |
|
4 |
EV, Event, Glib, Tk, Perl, Event::Lib, Irssi, rxvt-unicode, IO::Async, |
5 |
Qt and POE are various supported event loops/environments. |
6 |
|
7 |
SYNOPSIS |
8 |
use AnyEvent; |
9 |
|
10 |
# file descriptor readable |
11 |
my $w = AnyEvent->io (fh => $fh, poll => "r", cb => sub { ... }); |
12 |
|
13 |
# one-shot or repeating timers |
14 |
my $w = AnyEvent->timer (after => $seconds, cb => sub { ... }); |
15 |
my $w = AnyEvent->timer (after => $seconds, interval => $seconds, cb => ... |
16 |
|
17 |
print AnyEvent->now; # prints current event loop time |
18 |
print AnyEvent->time; # think Time::HiRes::time or simply CORE::time. |
19 |
|
20 |
# POSIX signal |
21 |
my $w = AnyEvent->signal (signal => "TERM", cb => sub { ... }); |
22 |
|
23 |
# child process exit |
24 |
my $w = AnyEvent->child (pid => $pid, cb => sub { |
25 |
my ($pid, $status) = @_; |
26 |
... |
27 |
}); |
28 |
|
29 |
# called when event loop idle (if applicable) |
30 |
my $w = AnyEvent->idle (cb => sub { ... }); |
31 |
|
32 |
my $w = AnyEvent->condvar; # stores whether a condition was flagged |
33 |
$w->send; # wake up current and all future recv's |
34 |
$w->recv; # enters "main loop" till $condvar gets ->send |
35 |
# use a condvar in callback mode: |
36 |
$w->cb (sub { $_[0]->recv }); |
37 |
|
38 |
INTRODUCTION/TUTORIAL |
39 |
This manpage is mainly a reference manual. If you are interested in a |
40 |
tutorial or some gentle introduction, have a look at the AnyEvent::Intro |
41 |
manpage. |
42 |
|
43 |
SUPPORT |
44 |
There is a mailinglist for discussing all things AnyEvent, and an IRC |
45 |
channel, too. |
46 |
|
47 |
See the AnyEvent project page at the Schmorpforge Ta-Sa Software |
48 |
Repository, at <http://anyevent.schmorp.de>, for more info. |
49 |
|
50 |
WHY YOU SHOULD USE THIS MODULE (OR NOT) |
51 |
Glib, POE, IO::Async, Event... CPAN offers event models by the dozen |
52 |
nowadays. So what is different about AnyEvent? |
53 |
|
54 |
Executive Summary: AnyEvent is *compatible*, AnyEvent is *free of |
55 |
policy* and AnyEvent is *small and efficient*. |
56 |
|
57 |
First and foremost, *AnyEvent is not an event model* itself, it only |
58 |
interfaces to whatever event model the main program happens to use, in a |
59 |
pragmatic way. For event models and certain classes of immortals alike, |
60 |
the statement "there can only be one" is a bitter reality: In general, |
61 |
only one event loop can be active at the same time in a process. |
62 |
AnyEvent cannot change this, but it can hide the differences between |
63 |
those event loops. |
64 |
|
65 |
The goal of AnyEvent is to offer module authors the ability to do event |
66 |
programming (waiting for I/O or timer events) without subscribing to a |
67 |
religion, a way of living, and most importantly: without forcing your |
68 |
module users into the same thing by forcing them to use the same event |
69 |
model you use. |
70 |
|
71 |
For modules like POE or IO::Async (which is a total misnomer as it is |
72 |
actually doing all I/O *synchronously*...), using them in your module is |
73 |
like joining a cult: After you joined, you are dependent on them and you |
74 |
cannot use anything else, as they are simply incompatible to everything |
75 |
that isn't them. What's worse, all the potential users of your module |
76 |
are *also* forced to use the same event loop you use. |
77 |
|
78 |
AnyEvent is different: AnyEvent + POE works fine. AnyEvent + Glib works |
79 |
fine. AnyEvent + Tk works fine etc. etc. but none of these work together |
80 |
with the rest: POE + IO::Async? No go. Tk + Event? No go. Again: if your |
81 |
module uses one of those, every user of your module has to use it, too. |
82 |
But if your module uses AnyEvent, it works transparently with all event |
83 |
models it supports (including stuff like IO::Async, as long as those use |
84 |
one of the supported event loops. It is trivial to add new event loops |
85 |
to AnyEvent, too, so it is future-proof). |
86 |
|
87 |
In addition to being free of having to use *the one and only true event |
88 |
model*, AnyEvent also is free of bloat and policy: with POE or similar |
89 |
modules, you get an enormous amount of code and strict rules you have to |
90 |
follow. AnyEvent, on the other hand, is lean and up to the point, by |
91 |
only offering the functionality that is necessary, in as thin as a |
92 |
wrapper as technically possible. |
93 |
|
94 |
Of course, AnyEvent comes with a big (and fully optional!) toolbox of |
95 |
useful functionality, such as an asynchronous DNS resolver, 100% |
96 |
non-blocking connects (even with TLS/SSL, IPv6 and on broken platforms |
97 |
such as Windows) and lots of real-world knowledge and workarounds for |
98 |
platform bugs and differences. |
99 |
|
100 |
Now, if you *do want* lots of policy (this can arguably be somewhat |
101 |
useful) and you want to force your users to use the one and only event |
102 |
model, you should *not* use this module. |
103 |
|
104 |
DESCRIPTION |
105 |
AnyEvent provides an identical interface to multiple event loops. This |
106 |
allows module authors to utilise an event loop without forcing module |
107 |
users to use the same event loop (as only a single event loop can |
108 |
coexist peacefully at any one time). |
109 |
|
110 |
The interface itself is vaguely similar, but not identical to the Event |
111 |
module. |
112 |
|
113 |
During the first call of any watcher-creation method, the module tries |
114 |
to detect the currently loaded event loop by probing whether one of the |
115 |
following modules is already loaded: EV, Event, Glib, |
116 |
AnyEvent::Impl::Perl, Tk, Event::Lib, Qt, POE. The first one found is |
117 |
used. If none are found, the module tries to load these modules |
118 |
(excluding Tk, Event::Lib, Qt and POE as the pure perl adaptor should |
119 |
always succeed) in the order given. The first one that can be |
120 |
successfully loaded will be used. If, after this, still none could be |
121 |
found, AnyEvent will fall back to a pure-perl event loop, which is not |
122 |
very efficient, but should work everywhere. |
123 |
|
124 |
Because AnyEvent first checks for modules that are already loaded, |
125 |
loading an event model explicitly before first using AnyEvent will |
126 |
likely make that model the default. For example: |
127 |
|
128 |
use Tk; |
129 |
use AnyEvent; |
130 |
|
131 |
# .. AnyEvent will likely default to Tk |
132 |
|
133 |
The *likely* means that, if any module loads another event model and |
134 |
starts using it, all bets are off. Maybe you should tell their authors |
135 |
to use AnyEvent so their modules work together with others seamlessly... |
136 |
|
137 |
The pure-perl implementation of AnyEvent is called |
138 |
"AnyEvent::Impl::Perl". Like other event modules you can load it |
139 |
explicitly and enjoy the high availability of that event loop :) |
140 |
|
141 |
WATCHERS |
142 |
AnyEvent has the central concept of a *watcher*, which is an object that |
143 |
stores relevant data for each kind of event you are waiting for, such as |
144 |
the callback to call, the file handle to watch, etc. |
145 |
|
146 |
These watchers are normal Perl objects with normal Perl lifetime. After |
147 |
creating a watcher it will immediately "watch" for events and invoke the |
148 |
callback when the event occurs (of course, only when the event model is |
149 |
in control). |
150 |
|
151 |
Note that callbacks must not permanently change global variables |
152 |
potentially in use by the event loop (such as $_ or $[) and that |
153 |
callbacks must not "die". The former is good programming practise in |
154 |
Perl and the latter stems from the fact that exception handling differs |
155 |
widely between event loops. |
156 |
|
157 |
To disable the watcher you have to destroy it (e.g. by setting the |
158 |
variable you store it in to "undef" or otherwise deleting all references |
159 |
to it). |
160 |
|
161 |
All watchers are created by calling a method on the "AnyEvent" class. |
162 |
|
163 |
Many watchers either are used with "recursion" (repeating timers for |
164 |
example), or need to refer to their watcher object in other ways. |
165 |
|
166 |
An any way to achieve that is this pattern: |
167 |
|
168 |
my $w; $w = AnyEvent->type (arg => value ..., cb => sub { |
169 |
# you can use $w here, for example to undef it |
170 |
undef $w; |
171 |
}); |
172 |
|
173 |
Note that "my $w; $w =" combination. This is necessary because in Perl, |
174 |
my variables are only visible after the statement in which they are |
175 |
declared. |
176 |
|
177 |
I/O WATCHERS |
178 |
$w = AnyEvent->io ( |
179 |
fh => <filehandle_or_fileno>, |
180 |
poll => <"r" or "w">, |
181 |
cb => <callback>, |
182 |
); |
183 |
|
184 |
You can create an I/O watcher by calling the "AnyEvent->io" method with |
185 |
the following mandatory key-value pairs as arguments: |
186 |
|
187 |
"fh" is the Perl *file handle* (or a naked file descriptor) to watch for |
188 |
events (AnyEvent might or might not keep a reference to this file |
189 |
handle). Note that only file handles pointing to things for which |
190 |
non-blocking operation makes sense are allowed. This includes sockets, |
191 |
most character devices, pipes, fifos and so on, but not for example |
192 |
files or block devices. |
193 |
|
194 |
"poll" must be a string that is either "r" or "w", which creates a |
195 |
watcher waiting for "r"eadable or "w"ritable events, respectively. |
196 |
|
197 |
"cb" is the callback to invoke each time the file handle becomes ready. |
198 |
|
199 |
Although the callback might get passed parameters, their value and |
200 |
presence is undefined and you cannot rely on them. Portable AnyEvent |
201 |
callbacks cannot use arguments passed to I/O watcher callbacks. |
202 |
|
203 |
The I/O watcher might use the underlying file descriptor or a copy of |
204 |
it. You must not close a file handle as long as any watcher is active on |
205 |
the underlying file descriptor. |
206 |
|
207 |
Some event loops issue spurious readyness notifications, so you should |
208 |
always use non-blocking calls when reading/writing from/to your file |
209 |
handles. |
210 |
|
211 |
Example: wait for readability of STDIN, then read a line and disable the |
212 |
watcher. |
213 |
|
214 |
my $w; $w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub { |
215 |
chomp (my $input = <STDIN>); |
216 |
warn "read: $input\n"; |
217 |
undef $w; |
218 |
}); |
219 |
|
220 |
TIME WATCHERS |
221 |
$w = AnyEvent->timer (after => <seconds>, cb => <callback>); |
222 |
|
223 |
$w = AnyEvent->timer ( |
224 |
after => <fractional_seconds>, |
225 |
interval => <fractional_seconds>, |
226 |
cb => <callback>, |
227 |
); |
228 |
|
229 |
You can create a time watcher by calling the "AnyEvent->timer" method |
230 |
with the following mandatory arguments: |
231 |
|
232 |
"after" specifies after how many seconds (fractional values are |
233 |
supported) the callback should be invoked. "cb" is the callback to |
234 |
invoke in that case. |
235 |
|
236 |
Although the callback might get passed parameters, their value and |
237 |
presence is undefined and you cannot rely on them. Portable AnyEvent |
238 |
callbacks cannot use arguments passed to time watcher callbacks. |
239 |
|
240 |
The callback will normally be invoked once only. If you specify another |
241 |
parameter, "interval", as a strictly positive number (> 0), then the |
242 |
callback will be invoked regularly at that interval (in fractional |
243 |
seconds) after the first invocation. If "interval" is specified with a |
244 |
false value, then it is treated as if it were missing. |
245 |
|
246 |
The callback will be rescheduled before invoking the callback, but no |
247 |
attempt is done to avoid timer drift in most backends, so the interval |
248 |
is only approximate. |
249 |
|
250 |
Example: fire an event after 7.7 seconds. |
251 |
|
252 |
my $w = AnyEvent->timer (after => 7.7, cb => sub { |
253 |
warn "timeout\n"; |
254 |
}); |
255 |
|
256 |
# to cancel the timer: |
257 |
undef $w; |
258 |
|
259 |
Example 2: fire an event after 0.5 seconds, then roughly every second. |
260 |
|
261 |
my $w = AnyEvent->timer (after => 0.5, interval => 1, cb => sub { |
262 |
warn "timeout\n"; |
263 |
}; |
264 |
|
265 |
TIMING ISSUES |
266 |
There are two ways to handle timers: based on real time (relative, "fire |
267 |
in 10 seconds") and based on wallclock time (absolute, "fire at 12 |
268 |
o'clock"). |
269 |
|
270 |
While most event loops expect timers to specified in a relative way, |
271 |
they use absolute time internally. This makes a difference when your |
272 |
clock "jumps", for example, when ntp decides to set your clock backwards |
273 |
from the wrong date of 2014-01-01 to 2008-01-01, a watcher that is |
274 |
supposed to fire "after" a second might actually take six years to |
275 |
finally fire. |
276 |
|
277 |
AnyEvent cannot compensate for this. The only event loop that is |
278 |
conscious about these issues is EV, which offers both relative |
279 |
(ev_timer, based on true relative time) and absolute (ev_periodic, based |
280 |
on wallclock time) timers. |
281 |
|
282 |
AnyEvent always prefers relative timers, if available, matching the |
283 |
AnyEvent API. |
284 |
|
285 |
AnyEvent has two additional methods that return the "current time": |
286 |
|
287 |
AnyEvent->time |
288 |
This returns the "current wallclock time" as a fractional number of |
289 |
seconds since the Epoch (the same thing as "time" or |
290 |
"Time::HiRes::time" return, and the result is guaranteed to be |
291 |
compatible with those). |
292 |
|
293 |
It progresses independently of any event loop processing, i.e. each |
294 |
call will check the system clock, which usually gets updated |
295 |
frequently. |
296 |
|
297 |
AnyEvent->now |
298 |
This also returns the "current wallclock time", but unlike "time", |
299 |
above, this value might change only once per event loop iteration, |
300 |
depending on the event loop (most return the same time as "time", |
301 |
above). This is the time that AnyEvent's timers get scheduled |
302 |
against. |
303 |
|
304 |
*In almost all cases (in all cases if you don't care), this is the |
305 |
function to call when you want to know the current time.* |
306 |
|
307 |
This function is also often faster then "AnyEvent->time", and thus |
308 |
the preferred method if you want some timestamp (for example, |
309 |
AnyEvent::Handle uses this to update it's activity timeouts). |
310 |
|
311 |
The rest of this section is only of relevance if you try to be very |
312 |
exact with your timing, you can skip it without bad conscience. |
313 |
|
314 |
For a practical example of when these times differ, consider |
315 |
Event::Lib and EV and the following set-up: |
316 |
|
317 |
The event loop is running and has just invoked one of your callback |
318 |
at time=500 (assume no other callbacks delay processing). In your |
319 |
callback, you wait a second by executing "sleep 1" (blocking the |
320 |
process for a second) and then (at time=501) you create a relative |
321 |
timer that fires after three seconds. |
322 |
|
323 |
With Event::Lib, "AnyEvent->time" and "AnyEvent->now" will both |
324 |
return 501, because that is the current time, and the timer will be |
325 |
scheduled to fire at time=504 (501 + 3). |
326 |
|
327 |
With EV, "AnyEvent->time" returns 501 (as that is the current time), |
328 |
but "AnyEvent->now" returns 500, as that is the time the last event |
329 |
processing phase started. With EV, your timer gets scheduled to run |
330 |
at time=503 (500 + 3). |
331 |
|
332 |
In one sense, Event::Lib is more exact, as it uses the current time |
333 |
regardless of any delays introduced by event processing. However, |
334 |
most callbacks do not expect large delays in processing, so this |
335 |
causes a higher drift (and a lot more system calls to get the |
336 |
current time). |
337 |
|
338 |
In another sense, EV is more exact, as your timer will be scheduled |
339 |
at the same time, regardless of how long event processing actually |
340 |
took. |
341 |
|
342 |
In either case, if you care (and in most cases, you don't), then you |
343 |
can get whatever behaviour you want with any event loop, by taking |
344 |
the difference between "AnyEvent->time" and "AnyEvent->now" into |
345 |
account. |
346 |
|
347 |
AnyEvent->now_update |
348 |
Some event loops (such as EV or AnyEvent::Impl::Perl) cache the |
349 |
current time for each loop iteration (see the discussion of |
350 |
AnyEvent->now, above). |
351 |
|
352 |
When a callback runs for a long time (or when the process sleeps), |
353 |
then this "current" time will differ substantially from the real |
354 |
time, which might affect timers and time-outs. |
355 |
|
356 |
When this is the case, you can call this method, which will update |
357 |
the event loop's idea of "current time". |
358 |
|
359 |
A typical example would be a script in a web server (e.g. |
360 |
"mod_perl") - when mod_perl executes the script, then the event loop |
361 |
will have the wrong idea about the "current time" (being potentially |
362 |
far in the past, when the script ran the last time). In that case |
363 |
you should arrange a call to "AnyEvent->now_update" each time the |
364 |
web server process wakes up again (e.g. at the start of your script, |
365 |
or in a handler). |
366 |
|
367 |
Note that updating the time *might* cause some events to be handled. |
368 |
|
369 |
SIGNAL WATCHERS |
370 |
$w = AnyEvent->signal (signal => <uppercase_signal_name>, cb => <callback>); |
371 |
|
372 |
You can watch for signals using a signal watcher, "signal" is the signal |
373 |
*name* in uppercase and without any "SIG" prefix, "cb" is the Perl |
374 |
callback to be invoked whenever a signal occurs. |
375 |
|
376 |
Although the callback might get passed parameters, their value and |
377 |
presence is undefined and you cannot rely on them. Portable AnyEvent |
378 |
callbacks cannot use arguments passed to signal watcher callbacks. |
379 |
|
380 |
Multiple signal occurrences can be clumped together into one callback |
381 |
invocation, and callback invocation will be synchronous. Synchronous |
382 |
means that it might take a while until the signal gets handled by the |
383 |
process, but it is guaranteed not to interrupt any other callbacks. |
384 |
|
385 |
The main advantage of using these watchers is that you can share a |
386 |
signal between multiple watchers, and AnyEvent will ensure that signals |
387 |
will not interrupt your program at bad times. |
388 |
|
389 |
This watcher might use %SIG (depending on the event loop used), so |
390 |
programs overwriting those signals directly will likely not work |
391 |
correctly. |
392 |
|
393 |
Example: exit on SIGINT |
394 |
|
395 |
my $w = AnyEvent->signal (signal => "INT", cb => sub { exit 1 }); |
396 |
|
397 |
Restart Behaviour |
398 |
While restart behaviour is up to the event loop implementation, most |
399 |
will not restart syscalls (that includes Async::Interrupt and AnyEvent's |
400 |
pure perl implementation). |
401 |
|
402 |
Safe/Unsafe Signals |
403 |
Perl signals can be either "safe" (synchronous to opcode handling) or |
404 |
"unsafe" (asynchronous) - the former might get delayed indefinitely, the |
405 |
latter might corrupt your memory. |
406 |
|
407 |
AnyEvent signal handlers are, in addition, synchronous to the event |
408 |
loop, i.e. they will not interrupt your running perl program but will |
409 |
only be called as part of the normal event handling (just like timer, |
410 |
I/O etc. callbacks, too). |
411 |
|
412 |
Signal Races, Delays and Workarounds |
413 |
Many event loops (e.g. Glib, Tk, Qt, IO::Async) do not support attaching |
414 |
callbacks to signals in a generic way, which is a pity, as you cannot do |
415 |
race-free signal handling in perl, requiring C libraries for this. |
416 |
AnyEvent will try to do it's best, which means in some cases, signals |
417 |
will be delayed. The maximum time a signal might be delayed is specified |
418 |
in $AnyEvent::MAX_SIGNAL_LATENCY (default: 10 seconds). This variable |
419 |
can be changed only before the first signal watcher is created, and |
420 |
should be left alone otherwise. This variable determines how often |
421 |
AnyEvent polls for signals (in case a wake-up was missed). Higher values |
422 |
will cause fewer spurious wake-ups, which is better for power and CPU |
423 |
saving. |
424 |
|
425 |
All these problems can be avoided by installing the optional |
426 |
Async::Interrupt module, which works with most event loops. It will not |
427 |
work with inherently broken event loops such as Event or Event::Lib (and |
428 |
not with POE currently, as POE does it's own workaround with one-second |
429 |
latency). For those, you just have to suffer the delays. |
430 |
|
431 |
CHILD PROCESS WATCHERS |
432 |
$w = AnyEvent->child (pid => <process id>, cb => <callback>); |
433 |
|
434 |
You can also watch on a child process exit and catch its exit status. |
435 |
|
436 |
The child process is specified by the "pid" argument (one some backends, |
437 |
using 0 watches for any child process exit, on others this will croak). |
438 |
The watcher will be triggered only when the child process has finished |
439 |
and an exit status is available, not on any trace events |
440 |
(stopped/continued). |
441 |
|
442 |
The callback will be called with the pid and exit status (as returned by |
443 |
waitpid), so unlike other watcher types, you *can* rely on child watcher |
444 |
callback arguments. |
445 |
|
446 |
This watcher type works by installing a signal handler for "SIGCHLD", |
447 |
and since it cannot be shared, nothing else should use SIGCHLD or reap |
448 |
random child processes (waiting for specific child processes, e.g. |
449 |
inside "system", is just fine). |
450 |
|
451 |
There is a slight catch to child watchers, however: you usually start |
452 |
them *after* the child process was created, and this means the process |
453 |
could have exited already (and no SIGCHLD will be sent anymore). |
454 |
|
455 |
Not all event models handle this correctly (neither POE nor IO::Async |
456 |
do, see their AnyEvent::Impl manpages for details), but even for event |
457 |
models that *do* handle this correctly, they usually need to be loaded |
458 |
before the process exits (i.e. before you fork in the first place). |
459 |
AnyEvent's pure perl event loop handles all cases correctly regardless |
460 |
of when you start the watcher. |
461 |
|
462 |
This means you cannot create a child watcher as the very first thing in |
463 |
an AnyEvent program, you *have* to create at least one watcher before |
464 |
you "fork" the child (alternatively, you can call "AnyEvent::detect"). |
465 |
|
466 |
As most event loops do not support waiting for child events, they will |
467 |
be emulated by AnyEvent in most cases, in which the latency and race |
468 |
problems mentioned in the description of signal watchers apply. |
469 |
|
470 |
Example: fork a process and wait for it |
471 |
|
472 |
my $done = AnyEvent->condvar; |
473 |
|
474 |
my $pid = fork or exit 5; |
475 |
|
476 |
my $w = AnyEvent->child ( |
477 |
pid => $pid, |
478 |
cb => sub { |
479 |
my ($pid, $status) = @_; |
480 |
warn "pid $pid exited with status $status"; |
481 |
$done->send; |
482 |
}, |
483 |
); |
484 |
|
485 |
# do something else, then wait for process exit |
486 |
$done->recv; |
487 |
|
488 |
IDLE WATCHERS |
489 |
$w = AnyEvent->idle (cb => <callback>); |
490 |
|
491 |
Sometimes there is a need to do something, but it is not so important to |
492 |
do it instantly, but only when there is nothing better to do. This |
493 |
"nothing better to do" is usually defined to be "no other events need |
494 |
attention by the event loop". |
495 |
|
496 |
Idle watchers ideally get invoked when the event loop has nothing better |
497 |
to do, just before it would block the process to wait for new events. |
498 |
Instead of blocking, the idle watcher is invoked. |
499 |
|
500 |
Most event loops unfortunately do not really support idle watchers (only |
501 |
EV, Event and Glib do it in a usable fashion) - for the rest, AnyEvent |
502 |
will simply call the callback "from time to time". |
503 |
|
504 |
Example: read lines from STDIN, but only process them when the program |
505 |
is otherwise idle: |
506 |
|
507 |
my @lines; # read data |
508 |
my $idle_w; |
509 |
my $io_w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub { |
510 |
push @lines, scalar <STDIN>; |
511 |
|
512 |
# start an idle watcher, if not already done |
513 |
$idle_w ||= AnyEvent->idle (cb => sub { |
514 |
# handle only one line, when there are lines left |
515 |
if (my $line = shift @lines) { |
516 |
print "handled when idle: $line"; |
517 |
} else { |
518 |
# otherwise disable the idle watcher again |
519 |
undef $idle_w; |
520 |
} |
521 |
}); |
522 |
}); |
523 |
|
524 |
CONDITION VARIABLES |
525 |
$cv = AnyEvent->condvar; |
526 |
|
527 |
$cv->send (<list>); |
528 |
my @res = $cv->recv; |
529 |
|
530 |
If you are familiar with some event loops you will know that all of them |
531 |
require you to run some blocking "loop", "run" or similar function that |
532 |
will actively watch for new events and call your callbacks. |
533 |
|
534 |
AnyEvent is slightly different: it expects somebody else to run the |
535 |
event loop and will only block when necessary (usually when told by the |
536 |
user). |
537 |
|
538 |
The instrument to do that is called a "condition variable", so called |
539 |
because they represent a condition that must become true. |
540 |
|
541 |
Now is probably a good time to look at the examples further below. |
542 |
|
543 |
Condition variables can be created by calling the "AnyEvent->condvar" |
544 |
method, usually without arguments. The only argument pair allowed is |
545 |
"cb", which specifies a callback to be called when the condition |
546 |
variable becomes true, with the condition variable as the first argument |
547 |
(but not the results). |
548 |
|
549 |
After creation, the condition variable is "false" until it becomes |
550 |
"true" by calling the "send" method (or calling the condition variable |
551 |
as if it were a callback, read about the caveats in the description for |
552 |
the "->send" method). |
553 |
|
554 |
Condition variables are similar to callbacks, except that you can |
555 |
optionally wait for them. They can also be called merge points - points |
556 |
in time where multiple outstanding events have been processed. And yet |
557 |
another way to call them is transactions - each condition variable can |
558 |
be used to represent a transaction, which finishes at some point and |
559 |
delivers a result. And yet some people know them as "futures" - a |
560 |
promise to compute/deliver something that you can wait for. |
561 |
|
562 |
Condition variables are very useful to signal that something has |
563 |
finished, for example, if you write a module that does asynchronous http |
564 |
requests, then a condition variable would be the ideal candidate to |
565 |
signal the availability of results. The user can either act when the |
566 |
callback is called or can synchronously "->recv" for the results. |
567 |
|
568 |
You can also use them to simulate traditional event loops - for example, |
569 |
you can block your main program until an event occurs - for example, you |
570 |
could "->recv" in your main program until the user clicks the Quit |
571 |
button of your app, which would "->send" the "quit" event. |
572 |
|
573 |
Note that condition variables recurse into the event loop - if you have |
574 |
two pieces of code that call "->recv" in a round-robin fashion, you |
575 |
lose. Therefore, condition variables are good to export to your caller, |
576 |
but you should avoid making a blocking wait yourself, at least in |
577 |
callbacks, as this asks for trouble. |
578 |
|
579 |
Condition variables are represented by hash refs in perl, and the keys |
580 |
used by AnyEvent itself are all named "_ae_XXX" to make subclassing easy |
581 |
(it is often useful to build your own transaction class on top of |
582 |
AnyEvent). To subclass, use "AnyEvent::CondVar" as base class and call |
583 |
it's "new" method in your own "new" method. |
584 |
|
585 |
There are two "sides" to a condition variable - the "producer side" |
586 |
which eventually calls "-> send", and the "consumer side", which waits |
587 |
for the send to occur. |
588 |
|
589 |
Example: wait for a timer. |
590 |
|
591 |
# wait till the result is ready |
592 |
my $result_ready = AnyEvent->condvar; |
593 |
|
594 |
# do something such as adding a timer |
595 |
# or socket watcher the calls $result_ready->send |
596 |
# when the "result" is ready. |
597 |
# in this case, we simply use a timer: |
598 |
my $w = AnyEvent->timer ( |
599 |
after => 1, |
600 |
cb => sub { $result_ready->send }, |
601 |
); |
602 |
|
603 |
# this "blocks" (while handling events) till the callback |
604 |
# calls ->send |
605 |
$result_ready->recv; |
606 |
|
607 |
Example: wait for a timer, but take advantage of the fact that condition |
608 |
variables are also callable directly. |
609 |
|
610 |
my $done = AnyEvent->condvar; |
611 |
my $delay = AnyEvent->timer (after => 5, cb => $done); |
612 |
$done->recv; |
613 |
|
614 |
Example: Imagine an API that returns a condvar and doesn't support |
615 |
callbacks. This is how you make a synchronous call, for example from the |
616 |
main program: |
617 |
|
618 |
use AnyEvent::CouchDB; |
619 |
|
620 |
... |
621 |
|
622 |
my @info = $couchdb->info->recv; |
623 |
|
624 |
And this is how you would just set a callback to be called whenever the |
625 |
results are available: |
626 |
|
627 |
$couchdb->info->cb (sub { |
628 |
my @info = $_[0]->recv; |
629 |
}); |
630 |
|
631 |
METHODS FOR PRODUCERS |
632 |
These methods should only be used by the producing side, i.e. the |
633 |
code/module that eventually sends the signal. Note that it is also the |
634 |
producer side which creates the condvar in most cases, but it isn't |
635 |
uncommon for the consumer to create it as well. |
636 |
|
637 |
$cv->send (...) |
638 |
Flag the condition as ready - a running "->recv" and all further |
639 |
calls to "recv" will (eventually) return after this method has been |
640 |
called. If nobody is waiting the send will be remembered. |
641 |
|
642 |
If a callback has been set on the condition variable, it is called |
643 |
immediately from within send. |
644 |
|
645 |
Any arguments passed to the "send" call will be returned by all |
646 |
future "->recv" calls. |
647 |
|
648 |
Condition variables are overloaded so one can call them directly (as |
649 |
if they were a code reference). Calling them directly is the same as |
650 |
calling "send". |
651 |
|
652 |
$cv->croak ($error) |
653 |
Similar to send, but causes all call's to "->recv" to invoke |
654 |
"Carp::croak" with the given error message/object/scalar. |
655 |
|
656 |
This can be used to signal any errors to the condition variable |
657 |
user/consumer. Doing it this way instead of calling "croak" directly |
658 |
delays the error detetcion, but has the overwhelmign advantage that |
659 |
it diagnoses the error at the place where the result is expected, |
660 |
and not deep in some event clalback without connection to the actual |
661 |
code causing the problem. |
662 |
|
663 |
$cv->begin ([group callback]) |
664 |
$cv->end |
665 |
These two methods can be used to combine many transactions/events |
666 |
into one. For example, a function that pings many hosts in parallel |
667 |
might want to use a condition variable for the whole process. |
668 |
|
669 |
Every call to "->begin" will increment a counter, and every call to |
670 |
"->end" will decrement it. If the counter reaches 0 in "->end", the |
671 |
(last) callback passed to "begin" will be executed, passing the |
672 |
condvar as first argument. That callback is *supposed* to call |
673 |
"->send", but that is not required. If no group callback was set, |
674 |
"send" will be called without any arguments. |
675 |
|
676 |
You can think of "$cv->send" giving you an OR condition (one call |
677 |
sends), while "$cv->begin" and "$cv->end" giving you an AND |
678 |
condition (all "begin" calls must be "end"'ed before the condvar |
679 |
sends). |
680 |
|
681 |
Let's start with a simple example: you have two I/O watchers (for |
682 |
example, STDOUT and STDERR for a program), and you want to wait for |
683 |
both streams to close before activating a condvar: |
684 |
|
685 |
my $cv = AnyEvent->condvar; |
686 |
|
687 |
$cv->begin; # first watcher |
688 |
my $w1 = AnyEvent->io (fh => $fh1, cb => sub { |
689 |
defined sysread $fh1, my $buf, 4096 |
690 |
or $cv->end; |
691 |
}); |
692 |
|
693 |
$cv->begin; # second watcher |
694 |
my $w2 = AnyEvent->io (fh => $fh2, cb => sub { |
695 |
defined sysread $fh2, my $buf, 4096 |
696 |
or $cv->end; |
697 |
}); |
698 |
|
699 |
$cv->recv; |
700 |
|
701 |
This works because for every event source (EOF on file handle), |
702 |
there is one call to "begin", so the condvar waits for all calls to |
703 |
"end" before sending. |
704 |
|
705 |
The ping example mentioned above is slightly more complicated, as |
706 |
the there are results to be passwd back, and the number of tasks |
707 |
that are begung can potentially be zero: |
708 |
|
709 |
my $cv = AnyEvent->condvar; |
710 |
|
711 |
my %result; |
712 |
$cv->begin (sub { shift->send (\%result) }); |
713 |
|
714 |
for my $host (@list_of_hosts) { |
715 |
$cv->begin; |
716 |
ping_host_then_call_callback $host, sub { |
717 |
$result{$host} = ...; |
718 |
$cv->end; |
719 |
}; |
720 |
} |
721 |
|
722 |
$cv->end; |
723 |
|
724 |
This code fragment supposedly pings a number of hosts and calls |
725 |
"send" after results for all then have have been gathered - in any |
726 |
order. To achieve this, the code issues a call to "begin" when it |
727 |
starts each ping request and calls "end" when it has received some |
728 |
result for it. Since "begin" and "end" only maintain a counter, the |
729 |
order in which results arrive is not relevant. |
730 |
|
731 |
There is an additional bracketing call to "begin" and "end" outside |
732 |
the loop, which serves two important purposes: first, it sets the |
733 |
callback to be called once the counter reaches 0, and second, it |
734 |
ensures that "send" is called even when "no" hosts are being pinged |
735 |
(the loop doesn't execute once). |
736 |
|
737 |
This is the general pattern when you "fan out" into multiple (but |
738 |
potentially none) subrequests: use an outer "begin"/"end" pair to |
739 |
set the callback and ensure "end" is called at least once, and then, |
740 |
for each subrequest you start, call "begin" and for each subrequest |
741 |
you finish, call "end". |
742 |
|
743 |
METHODS FOR CONSUMERS |
744 |
These methods should only be used by the consuming side, i.e. the code |
745 |
awaits the condition. |
746 |
|
747 |
$cv->recv |
748 |
Wait (blocking if necessary) until the "->send" or "->croak" methods |
749 |
have been called on c<$cv>, while servicing other watchers normally. |
750 |
|
751 |
You can only wait once on a condition - additional calls are valid |
752 |
but will return immediately. |
753 |
|
754 |
If an error condition has been set by calling "->croak", then this |
755 |
function will call "croak". |
756 |
|
757 |
In list context, all parameters passed to "send" will be returned, |
758 |
in scalar context only the first one will be returned. |
759 |
|
760 |
Note that doing a blocking wait in a callback is not supported by |
761 |
any event loop, that is, recursive invocation of a blocking "->recv" |
762 |
is not allowed, and the "recv" call will "croak" if such a condition |
763 |
is detected. This condition can be slightly loosened by using |
764 |
Coro::AnyEvent, which allows you to do a blocking "->recv" from any |
765 |
thread that doesn't run the event loop itself. |
766 |
|
767 |
Not all event models support a blocking wait - some die in that case |
768 |
(programs might want to do that to stay interactive), so *if you are |
769 |
using this from a module, never require a blocking wait*. Instead, |
770 |
let the caller decide whether the call will block or not (for |
771 |
example, by coupling condition variables with some kind of request |
772 |
results and supporting callbacks so the caller knows that getting |
773 |
the result will not block, while still supporting blocking waits if |
774 |
the caller so desires). |
775 |
|
776 |
You can ensure that "-recv" never blocks by setting a callback and |
777 |
only calling "->recv" from within that callback (or at a later |
778 |
time). This will work even when the event loop does not support |
779 |
blocking waits otherwise. |
780 |
|
781 |
$bool = $cv->ready |
782 |
Returns true when the condition is "true", i.e. whether "send" or |
783 |
"croak" have been called. |
784 |
|
785 |
$cb = $cv->cb ($cb->($cv)) |
786 |
This is a mutator function that returns the callback set and |
787 |
optionally replaces it before doing so. |
788 |
|
789 |
The callback will be called when the condition becomes (or already |
790 |
was) "true", i.e. when "send" or "croak" are called (or were |
791 |
called), with the only argument being the condition variable itself. |
792 |
Calling "recv" inside the callback or at any later time is |
793 |
guaranteed not to block. |
794 |
|
795 |
SUPPORTED EVENT LOOPS/BACKENDS |
796 |
The available backend classes are (every class has its own manpage): |
797 |
|
798 |
Backends that are autoprobed when no other event loop can be found. |
799 |
EV is the preferred backend when no other event loop seems to be in |
800 |
use. If EV is not installed, then AnyEvent will fall back to its own |
801 |
pure-perl implementation, which is available everywhere as it comes |
802 |
with AnyEvent itself. |
803 |
|
804 |
AnyEvent::Impl::EV based on EV (interface to libev, best choice). |
805 |
AnyEvent::Impl::Perl pure-perl implementation, fast and portable. |
806 |
|
807 |
Backends that are transparently being picked up when they are used. |
808 |
These will be used when they are currently loaded when the first |
809 |
watcher is created, in which case it is assumed that the application |
810 |
is using them. This means that AnyEvent will automatically pick the |
811 |
right backend when the main program loads an event module before |
812 |
anything starts to create watchers. Nothing special needs to be done |
813 |
by the main program. |
814 |
|
815 |
AnyEvent::Impl::Event based on Event, very stable, few glitches. |
816 |
AnyEvent::Impl::Glib based on Glib, slow but very stable. |
817 |
AnyEvent::Impl::Tk based on Tk, very broken. |
818 |
AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse. |
819 |
AnyEvent::Impl::POE based on POE, very slow, some limitations. |
820 |
AnyEvent::Impl::Irssi used when running within irssi. |
821 |
|
822 |
Backends with special needs. |
823 |
Qt requires the Qt::Application to be instantiated first, but will |
824 |
otherwise be picked up automatically. As long as the main program |
825 |
instantiates the application before any AnyEvent watchers are |
826 |
created, everything should just work. |
827 |
|
828 |
AnyEvent::Impl::Qt based on Qt. |
829 |
|
830 |
Support for IO::Async can only be partial, as it is too broken and |
831 |
architecturally limited to even support the AnyEvent API. It also is |
832 |
the only event loop that needs the loop to be set explicitly, so it |
833 |
can only be used by a main program knowing about AnyEvent. See |
834 |
AnyEvent::Impl::Async for the gory details. |
835 |
|
836 |
AnyEvent::Impl::IOAsync based on IO::Async, cannot be autoprobed. |
837 |
|
838 |
Event loops that are indirectly supported via other backends. |
839 |
Some event loops can be supported via other modules: |
840 |
|
841 |
There is no direct support for WxWidgets (Wx) or Prima. |
842 |
|
843 |
WxWidgets has no support for watching file handles. However, you can |
844 |
use WxWidgets through the POE adaptor, as POE has a Wx backend that |
845 |
simply polls 20 times per second, which was considered to be too |
846 |
horrible to even consider for AnyEvent. |
847 |
|
848 |
Prima is not supported as nobody seems to be using it, but it has a |
849 |
POE backend, so it can be supported through POE. |
850 |
|
851 |
AnyEvent knows about both Prima and Wx, however, and will try to |
852 |
load POE when detecting them, in the hope that POE will pick them |
853 |
up, in which case everything will be automatic. |
854 |
|
855 |
GLOBAL VARIABLES AND FUNCTIONS |
856 |
These are not normally required to use AnyEvent, but can be useful to |
857 |
write AnyEvent extension modules. |
858 |
|
859 |
$AnyEvent::MODEL |
860 |
Contains "undef" until the first watcher is being created, before |
861 |
the backend has been autodetected. |
862 |
|
863 |
Afterwards it contains the event model that is being used, which is |
864 |
the name of the Perl class implementing the model. This class is |
865 |
usually one of the "AnyEvent::Impl:xxx" modules, but can be any |
866 |
other class in the case AnyEvent has been extended at runtime (e.g. |
867 |
in *rxvt-unicode* it will be "urxvt::anyevent"). |
868 |
|
869 |
AnyEvent::detect |
870 |
Returns $AnyEvent::MODEL, forcing autodetection of the event model |
871 |
if necessary. You should only call this function right before you |
872 |
would have created an AnyEvent watcher anyway, that is, as late as |
873 |
possible at runtime, and not e.g. while initialising of your module. |
874 |
|
875 |
If you need to do some initialisation before AnyEvent watchers are |
876 |
created, use "post_detect". |
877 |
|
878 |
$guard = AnyEvent::post_detect { BLOCK } |
879 |
Arranges for the code block to be executed as soon as the event |
880 |
model is autodetected (or immediately if this has already happened). |
881 |
|
882 |
The block will be executed *after* the actual backend has been |
883 |
detected ($AnyEvent::MODEL is set), but *before* any watchers have |
884 |
been created, so it is possible to e.g. patch @AnyEvent::ISA or do |
885 |
other initialisations - see the sources of AnyEvent::Strict or |
886 |
AnyEvent::AIO to see how this is used. |
887 |
|
888 |
The most common usage is to create some global watchers, without |
889 |
forcing event module detection too early, for example, AnyEvent::AIO |
890 |
creates and installs the global IO::AIO watcher in a "post_detect" |
891 |
block to avoid autodetecting the event module at load time. |
892 |
|
893 |
If called in scalar or list context, then it creates and returns an |
894 |
object that automatically removes the callback again when it is |
895 |
destroyed (or "undef" when the hook was immediately executed). See |
896 |
AnyEvent::AIO for a case where this is useful. |
897 |
|
898 |
Example: Create a watcher for the IO::AIO module and store it in |
899 |
$WATCHER. Only do so after the event loop is initialised, though. |
900 |
|
901 |
our WATCHER; |
902 |
|
903 |
my $guard = AnyEvent::post_detect { |
904 |
$WATCHER = AnyEvent->io (fh => IO::AIO::poll_fileno, poll => 'r', cb => \&IO::AIO::poll_cb); |
905 |
}; |
906 |
|
907 |
# the ||= is important in case post_detect immediately runs the block, |
908 |
# as to not clobber the newly-created watcher. assigning both watcher and |
909 |
# post_detect guard to the same variable has the advantage of users being |
910 |
# able to just C<undef $WATCHER> if the watcher causes them grief. |
911 |
|
912 |
$WATCHER ||= $guard; |
913 |
|
914 |
@AnyEvent::post_detect |
915 |
If there are any code references in this array (you can "push" to it |
916 |
before or after loading AnyEvent), then they will called directly |
917 |
after the event loop has been chosen. |
918 |
|
919 |
You should check $AnyEvent::MODEL before adding to this array, |
920 |
though: if it is defined then the event loop has already been |
921 |
detected, and the array will be ignored. |
922 |
|
923 |
Best use "AnyEvent::post_detect { BLOCK }" when your application |
924 |
allows it,as it takes care of these details. |
925 |
|
926 |
This variable is mainly useful for modules that can do something |
927 |
useful when AnyEvent is used and thus want to know when it is |
928 |
initialised, but do not need to even load it by default. This array |
929 |
provides the means to hook into AnyEvent passively, without loading |
930 |
it. |
931 |
|
932 |
WHAT TO DO IN A MODULE |
933 |
As a module author, you should "use AnyEvent" and call AnyEvent methods |
934 |
freely, but you should not load a specific event module or rely on it. |
935 |
|
936 |
Be careful when you create watchers in the module body - AnyEvent will |
937 |
decide which event module to use as soon as the first method is called, |
938 |
so by calling AnyEvent in your module body you force the user of your |
939 |
module to load the event module first. |
940 |
|
941 |
Never call "->recv" on a condition variable unless you *know* that the |
942 |
"->send" method has been called on it already. This is because it will |
943 |
stall the whole program, and the whole point of using events is to stay |
944 |
interactive. |
945 |
|
946 |
It is fine, however, to call "->recv" when the user of your module |
947 |
requests it (i.e. if you create a http request object ad have a method |
948 |
called "results" that returns the results, it should call "->recv" |
949 |
freely, as the user of your module knows what she is doing. always). |
950 |
|
951 |
WHAT TO DO IN THE MAIN PROGRAM |
952 |
There will always be a single main program - the only place that should |
953 |
dictate which event model to use. |
954 |
|
955 |
If it doesn't care, it can just "use AnyEvent" and use it itself, or not |
956 |
do anything special (it does not need to be event-based) and let |
957 |
AnyEvent decide which implementation to chose if some module relies on |
958 |
it. |
959 |
|
960 |
If the main program relies on a specific event model - for example, in |
961 |
Gtk2 programs you have to rely on the Glib module - you should load the |
962 |
event module before loading AnyEvent or any module that uses it: |
963 |
generally speaking, you should load it as early as possible. The reason |
964 |
is that modules might create watchers when they are loaded, and AnyEvent |
965 |
will decide on the event model to use as soon as it creates watchers, |
966 |
and it might chose the wrong one unless you load the correct one |
967 |
yourself. |
968 |
|
969 |
You can chose to use a pure-perl implementation by loading the |
970 |
"AnyEvent::Impl::Perl" module, which gives you similar behaviour |
971 |
everywhere, but letting AnyEvent chose the model is generally better. |
972 |
|
973 |
MAINLOOP EMULATION |
974 |
Sometimes (often for short test scripts, or even standalone programs who |
975 |
only want to use AnyEvent), you do not want to run a specific event |
976 |
loop. |
977 |
|
978 |
In that case, you can use a condition variable like this: |
979 |
|
980 |
AnyEvent->condvar->recv; |
981 |
|
982 |
This has the effect of entering the event loop and looping forever. |
983 |
|
984 |
Note that usually your program has some exit condition, in which case it |
985 |
is better to use the "traditional" approach of storing a condition |
986 |
variable somewhere, waiting for it, and sending it when the program |
987 |
should exit cleanly. |
988 |
|
989 |
OTHER MODULES |
990 |
The following is a non-exhaustive list of additional modules that use |
991 |
AnyEvent as a client and can therefore be mixed easily with other |
992 |
AnyEvent modules and other event loops in the same program. Some of the |
993 |
modules come with AnyEvent, most are available via CPAN. |
994 |
|
995 |
AnyEvent::Util |
996 |
Contains various utility functions that replace often-used but |
997 |
blocking functions such as "inet_aton" by event-/callback-based |
998 |
versions. |
999 |
|
1000 |
AnyEvent::Socket |
1001 |
Provides various utility functions for (internet protocol) sockets, |
1002 |
addresses and name resolution. Also functions to create non-blocking |
1003 |
tcp connections or tcp servers, with IPv6 and SRV record support and |
1004 |
more. |
1005 |
|
1006 |
AnyEvent::Handle |
1007 |
Provide read and write buffers, manages watchers for reads and |
1008 |
writes, supports raw and formatted I/O, I/O queued and fully |
1009 |
transparent and non-blocking SSL/TLS (via AnyEvent::TLS. |
1010 |
|
1011 |
AnyEvent::DNS |
1012 |
Provides rich asynchronous DNS resolver capabilities. |
1013 |
|
1014 |
AnyEvent::HTTP |
1015 |
A simple-to-use HTTP library that is capable of making a lot of |
1016 |
concurrent HTTP requests. |
1017 |
|
1018 |
AnyEvent::HTTPD |
1019 |
Provides a simple web application server framework. |
1020 |
|
1021 |
AnyEvent::FastPing |
1022 |
The fastest ping in the west. |
1023 |
|
1024 |
AnyEvent::DBI |
1025 |
Executes DBI requests asynchronously in a proxy process. |
1026 |
|
1027 |
AnyEvent::AIO |
1028 |
Truly asynchronous I/O, should be in the toolbox of every event |
1029 |
programmer. AnyEvent::AIO transparently fuses IO::AIO and AnyEvent |
1030 |
together. |
1031 |
|
1032 |
AnyEvent::BDB |
1033 |
Truly asynchronous Berkeley DB access. AnyEvent::BDB transparently |
1034 |
fuses BDB and AnyEvent together. |
1035 |
|
1036 |
AnyEvent::GPSD |
1037 |
A non-blocking interface to gpsd, a daemon delivering GPS |
1038 |
information. |
1039 |
|
1040 |
AnyEvent::IRC |
1041 |
AnyEvent based IRC client module family (replacing the older |
1042 |
Net::IRC3). |
1043 |
|
1044 |
AnyEvent::XMPP |
1045 |
AnyEvent based XMPP (Jabber protocol) module family (replacing the |
1046 |
older Net::XMPP2>. |
1047 |
|
1048 |
AnyEvent::IGS |
1049 |
A non-blocking interface to the Internet Go Server protocol (used by |
1050 |
App::IGS). |
1051 |
|
1052 |
Net::FCP |
1053 |
AnyEvent-based implementation of the Freenet Client Protocol, |
1054 |
birthplace of AnyEvent. |
1055 |
|
1056 |
Event::ExecFlow |
1057 |
High level API for event-based execution flow control. |
1058 |
|
1059 |
Coro |
1060 |
Has special support for AnyEvent via Coro::AnyEvent. |
1061 |
|
1062 |
SIMPLIFIED AE API |
1063 |
Starting with version 5.0, AnyEvent officially supports a second, much |
1064 |
simpler, API that is designed to reduce the calling, typing and memory |
1065 |
overhead. |
1066 |
|
1067 |
See the AE manpage for details. |
1068 |
|
1069 |
ERROR AND EXCEPTION HANDLING |
1070 |
In general, AnyEvent does not do any error handling - it relies on the |
1071 |
caller to do that if required. The AnyEvent::Strict module (see also the |
1072 |
"PERL_ANYEVENT_STRICT" environment variable, below) provides strict |
1073 |
checking of all AnyEvent methods, however, which is highly useful during |
1074 |
development. |
1075 |
|
1076 |
As for exception handling (i.e. runtime errors and exceptions thrown |
1077 |
while executing a callback), this is not only highly event-loop |
1078 |
specific, but also not in any way wrapped by this module, as this is the |
1079 |
job of the main program. |
1080 |
|
1081 |
The pure perl event loop simply re-throws the exception (usually within |
1082 |
"condvar->recv"), the Event and EV modules call "$Event/EV::DIED->()", |
1083 |
Glib uses "install_exception_handler" and so on. |
1084 |
|
1085 |
ENVIRONMENT VARIABLES |
1086 |
The following environment variables are used by this module or its |
1087 |
submodules. |
1088 |
|
1089 |
Note that AnyEvent will remove *all* environment variables starting with |
1090 |
"PERL_ANYEVENT_" from %ENV when it is loaded while taint mode is |
1091 |
enabled. |
1092 |
|
1093 |
"PERL_ANYEVENT_VERBOSE" |
1094 |
By default, AnyEvent will be completely silent except in fatal |
1095 |
conditions. You can set this environment variable to make AnyEvent |
1096 |
more talkative. |
1097 |
|
1098 |
When set to 1 or higher, causes AnyEvent to warn about unexpected |
1099 |
conditions, such as not being able to load the event model specified |
1100 |
by "PERL_ANYEVENT_MODEL". |
1101 |
|
1102 |
When set to 2 or higher, cause AnyEvent to report to STDERR which |
1103 |
event model it chooses. |
1104 |
|
1105 |
When set to 8 or higher, then AnyEvent will report extra information |
1106 |
on which optional modules it loads and how it implements certain |
1107 |
features. |
1108 |
|
1109 |
"PERL_ANYEVENT_STRICT" |
1110 |
AnyEvent does not do much argument checking by default, as thorough |
1111 |
argument checking is very costly. Setting this variable to a true |
1112 |
value will cause AnyEvent to load "AnyEvent::Strict" and then to |
1113 |
thoroughly check the arguments passed to most method calls. If it |
1114 |
finds any problems, it will croak. |
1115 |
|
1116 |
In other words, enables "strict" mode. |
1117 |
|
1118 |
Unlike "use strict" (or it's modern cousin, "use common::sense", it |
1119 |
is definitely recommended to keep it off in production. Keeping |
1120 |
"PERL_ANYEVENT_STRICT=1" in your environment while developing |
1121 |
programs can be very useful, however. |
1122 |
|
1123 |
"PERL_ANYEVENT_MODEL" |
1124 |
This can be used to specify the event model to be used by AnyEvent, |
1125 |
before auto detection and -probing kicks in. It must be a string |
1126 |
consisting entirely of ASCII letters. The string "AnyEvent::Impl::" |
1127 |
gets prepended and the resulting module name is loaded and if the |
1128 |
load was successful, used as event model. If it fails to load |
1129 |
AnyEvent will proceed with auto detection and -probing. |
1130 |
|
1131 |
This functionality might change in future versions. |
1132 |
|
1133 |
For example, to force the pure perl model (AnyEvent::Impl::Perl) you |
1134 |
could start your program like this: |
1135 |
|
1136 |
PERL_ANYEVENT_MODEL=Perl perl ... |
1137 |
|
1138 |
"PERL_ANYEVENT_PROTOCOLS" |
1139 |
Used by both AnyEvent::DNS and AnyEvent::Socket to determine |
1140 |
preferences for IPv4 or IPv6. The default is unspecified (and might |
1141 |
change, or be the result of auto probing). |
1142 |
|
1143 |
Must be set to a comma-separated list of protocols or address |
1144 |
families, current supported: "ipv4" and "ipv6". Only protocols |
1145 |
mentioned will be used, and preference will be given to protocols |
1146 |
mentioned earlier in the list. |
1147 |
|
1148 |
This variable can effectively be used for denial-of-service attacks |
1149 |
against local programs (e.g. when setuid), although the impact is |
1150 |
likely small, as the program has to handle conenction and other |
1151 |
failures anyways. |
1152 |
|
1153 |
Examples: "PERL_ANYEVENT_PROTOCOLS=ipv4,ipv6" - prefer IPv4 over |
1154 |
IPv6, but support both and try to use both. |
1155 |
"PERL_ANYEVENT_PROTOCOLS=ipv4" - only support IPv4, never try to |
1156 |
resolve or contact IPv6 addresses. |
1157 |
"PERL_ANYEVENT_PROTOCOLS=ipv6,ipv4" support either IPv4 or IPv6, but |
1158 |
prefer IPv6 over IPv4. |
1159 |
|
1160 |
"PERL_ANYEVENT_EDNS0" |
1161 |
Used by AnyEvent::DNS to decide whether to use the EDNS0 extension |
1162 |
for DNS. This extension is generally useful to reduce DNS traffic, |
1163 |
but some (broken) firewalls drop such DNS packets, which is why it |
1164 |
is off by default. |
1165 |
|
1166 |
Setting this variable to 1 will cause AnyEvent::DNS to announce |
1167 |
EDNS0 in its DNS requests. |
1168 |
|
1169 |
"PERL_ANYEVENT_MAX_FORKS" |
1170 |
The maximum number of child processes that |
1171 |
"AnyEvent::Util::fork_call" will create in parallel. |
1172 |
|
1173 |
"PERL_ANYEVENT_MAX_OUTSTANDING_DNS" |
1174 |
The default value for the "max_outstanding" parameter for the |
1175 |
default DNS resolver - this is the maximum number of parallel DNS |
1176 |
requests that are sent to the DNS server. |
1177 |
|
1178 |
"PERL_ANYEVENT_RESOLV_CONF" |
1179 |
The file to use instead of /etc/resolv.conf (or OS-specific |
1180 |
configuration) in the default resolver. When set to the empty |
1181 |
string, no default config will be used. |
1182 |
|
1183 |
"PERL_ANYEVENT_CA_FILE", "PERL_ANYEVENT_CA_PATH". |
1184 |
When neither "ca_file" nor "ca_path" was specified during |
1185 |
AnyEvent::TLS context creation, and either of these environment |
1186 |
variables exist, they will be used to specify CA certificate |
1187 |
locations instead of a system-dependent default. |
1188 |
|
1189 |
"PERL_ANYEVENT_AVOID_GUARD" and "PERL_ANYEVENT_AVOID_ASYNC_INTERRUPT" |
1190 |
When these are set to 1, then the respective modules are not loaded. |
1191 |
Mostly good for testing AnyEvent itself. |
1192 |
|
1193 |
SUPPLYING YOUR OWN EVENT MODEL INTERFACE |
1194 |
This is an advanced topic that you do not normally need to use AnyEvent |
1195 |
in a module. This section is only of use to event loop authors who want |
1196 |
to provide AnyEvent compatibility. |
1197 |
|
1198 |
If you need to support another event library which isn't directly |
1199 |
supported by AnyEvent, you can supply your own interface to it by |
1200 |
pushing, before the first watcher gets created, the package name of the |
1201 |
event module and the package name of the interface to use onto |
1202 |
@AnyEvent::REGISTRY. You can do that before and even without loading |
1203 |
AnyEvent, so it is reasonably cheap. |
1204 |
|
1205 |
Example: |
1206 |
|
1207 |
push @AnyEvent::REGISTRY, [urxvt => urxvt::anyevent::]; |
1208 |
|
1209 |
This tells AnyEvent to (literally) use the "urxvt::anyevent::" |
1210 |
package/class when it finds the "urxvt" package/module is already |
1211 |
loaded. |
1212 |
|
1213 |
When AnyEvent is loaded and asked to find a suitable event model, it |
1214 |
will first check for the presence of urxvt by trying to "use" the |
1215 |
"urxvt::anyevent" module. |
1216 |
|
1217 |
The class should provide implementations for all watcher types. See |
1218 |
AnyEvent::Impl::EV (source code), AnyEvent::Impl::Glib (Source code) and |
1219 |
so on for actual examples. Use "perldoc -m AnyEvent::Impl::Glib" to see |
1220 |
the sources. |
1221 |
|
1222 |
If you don't provide "signal" and "child" watchers than AnyEvent will |
1223 |
provide suitable (hopefully) replacements. |
1224 |
|
1225 |
The above example isn't fictitious, the *rxvt-unicode* (a.k.a. urxvt) |
1226 |
terminal emulator uses the above line as-is. An interface isn't included |
1227 |
in AnyEvent because it doesn't make sense outside the embedded |
1228 |
interpreter inside *rxvt-unicode*, and it is updated and maintained as |
1229 |
part of the *rxvt-unicode* distribution. |
1230 |
|
1231 |
*rxvt-unicode* also cheats a bit by not providing blocking access to |
1232 |
condition variables: code blocking while waiting for a condition will |
1233 |
"die". This still works with most modules/usages, and blocking calls |
1234 |
must not be done in an interactive application, so it makes sense. |
1235 |
|
1236 |
EXAMPLE PROGRAM |
1237 |
The following program uses an I/O watcher to read data from STDIN, a |
1238 |
timer to display a message once per second, and a condition variable to |
1239 |
quit the program when the user enters quit: |
1240 |
|
1241 |
use AnyEvent; |
1242 |
|
1243 |
my $cv = AnyEvent->condvar; |
1244 |
|
1245 |
my $io_watcher = AnyEvent->io ( |
1246 |
fh => \*STDIN, |
1247 |
poll => 'r', |
1248 |
cb => sub { |
1249 |
warn "io event <$_[0]>\n"; # will always output <r> |
1250 |
chomp (my $input = <STDIN>); # read a line |
1251 |
warn "read: $input\n"; # output what has been read |
1252 |
$cv->send if $input =~ /^q/i; # quit program if /^q/i |
1253 |
}, |
1254 |
); |
1255 |
|
1256 |
my $time_watcher = AnyEvent->timer (after => 1, interval => 1, cb => sub { |
1257 |
warn "timeout\n"; # print 'timeout' at most every second |
1258 |
}); |
1259 |
|
1260 |
$cv->recv; # wait until user enters /^q/i |
1261 |
|
1262 |
REAL-WORLD EXAMPLE |
1263 |
Consider the Net::FCP module. It features (among others) the following |
1264 |
API calls, which are to freenet what HTTP GET requests are to http: |
1265 |
|
1266 |
my $data = $fcp->client_get ($url); # blocks |
1267 |
|
1268 |
my $transaction = $fcp->txn_client_get ($url); # does not block |
1269 |
$transaction->cb ( sub { ... } ); # set optional result callback |
1270 |
my $data = $transaction->result; # possibly blocks |
1271 |
|
1272 |
The "client_get" method works like "LWP::Simple::get": it requests the |
1273 |
given URL and waits till the data has arrived. It is defined to be: |
1274 |
|
1275 |
sub client_get { $_[0]->txn_client_get ($_[1])->result } |
1276 |
|
1277 |
And in fact is automatically generated. This is the blocking API of |
1278 |
Net::FCP, and it works as simple as in any other, similar, module. |
1279 |
|
1280 |
More complicated is "txn_client_get": It only creates a transaction |
1281 |
(completion, result, ...) object and initiates the transaction. |
1282 |
|
1283 |
my $txn = bless { }, Net::FCP::Txn::; |
1284 |
|
1285 |
It also creates a condition variable that is used to signal the |
1286 |
completion of the request: |
1287 |
|
1288 |
$txn->{finished} = AnyAvent->condvar; |
1289 |
|
1290 |
It then creates a socket in non-blocking mode. |
1291 |
|
1292 |
socket $txn->{fh}, ...; |
1293 |
fcntl $txn->{fh}, F_SETFL, O_NONBLOCK; |
1294 |
connect $txn->{fh}, ... |
1295 |
and !$!{EWOULDBLOCK} |
1296 |
and !$!{EINPROGRESS} |
1297 |
and Carp::croak "unable to connect: $!\n"; |
1298 |
|
1299 |
Then it creates a write-watcher which gets called whenever an error |
1300 |
occurs or the connection succeeds: |
1301 |
|
1302 |
$txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'w', cb => sub { $txn->fh_ready_w }); |
1303 |
|
1304 |
And returns this transaction object. The "fh_ready_w" callback gets |
1305 |
called as soon as the event loop detects that the socket is ready for |
1306 |
writing. |
1307 |
|
1308 |
The "fh_ready_w" method makes the socket blocking again, writes the |
1309 |
request data and replaces the watcher by a read watcher (waiting for |
1310 |
reply data). The actual code is more complicated, but that doesn't |
1311 |
matter for this example: |
1312 |
|
1313 |
fcntl $txn->{fh}, F_SETFL, 0; |
1314 |
syswrite $txn->{fh}, $txn->{request} |
1315 |
or die "connection or write error"; |
1316 |
$txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'r', cb => sub { $txn->fh_ready_r }); |
1317 |
|
1318 |
Again, "fh_ready_r" waits till all data has arrived, and then stores the |
1319 |
result and signals any possible waiters that the request has finished: |
1320 |
|
1321 |
sysread $txn->{fh}, $txn->{buf}, length $txn->{$buf}; |
1322 |
|
1323 |
if (end-of-file or data complete) { |
1324 |
$txn->{result} = $txn->{buf}; |
1325 |
$txn->{finished}->send; |
1326 |
$txb->{cb}->($txn) of $txn->{cb}; # also call callback |
1327 |
} |
1328 |
|
1329 |
The "result" method, finally, just waits for the finished signal (if the |
1330 |
request was already finished, it doesn't wait, of course, and returns |
1331 |
the data: |
1332 |
|
1333 |
$txn->{finished}->recv; |
1334 |
return $txn->{result}; |
1335 |
|
1336 |
The actual code goes further and collects all errors ("die"s, |
1337 |
exceptions) that occurred during request processing. The "result" method |
1338 |
detects whether an exception as thrown (it is stored inside the $txn |
1339 |
object) and just throws the exception, which means connection errors and |
1340 |
other problems get reported tot he code that tries to use the result, |
1341 |
not in a random callback. |
1342 |
|
1343 |
All of this enables the following usage styles: |
1344 |
|
1345 |
1. Blocking: |
1346 |
|
1347 |
my $data = $fcp->client_get ($url); |
1348 |
|
1349 |
2. Blocking, but running in parallel: |
1350 |
|
1351 |
my @datas = map $_->result, |
1352 |
map $fcp->txn_client_get ($_), |
1353 |
@urls; |
1354 |
|
1355 |
Both blocking examples work without the module user having to know |
1356 |
anything about events. |
1357 |
|
1358 |
3a. Event-based in a main program, using any supported event module: |
1359 |
|
1360 |
use EV; |
1361 |
|
1362 |
$fcp->txn_client_get ($url)->cb (sub { |
1363 |
my $txn = shift; |
1364 |
my $data = $txn->result; |
1365 |
... |
1366 |
}); |
1367 |
|
1368 |
EV::loop; |
1369 |
|
1370 |
3b. The module user could use AnyEvent, too: |
1371 |
|
1372 |
use AnyEvent; |
1373 |
|
1374 |
my $quit = AnyEvent->condvar; |
1375 |
|
1376 |
$fcp->txn_client_get ($url)->cb (sub { |
1377 |
... |
1378 |
$quit->send; |
1379 |
}); |
1380 |
|
1381 |
$quit->recv; |
1382 |
|
1383 |
BENCHMARKS |
1384 |
To give you an idea of the performance and overheads that AnyEvent adds |
1385 |
over the event loops themselves and to give you an impression of the |
1386 |
speed of various event loops I prepared some benchmarks. |
1387 |
|
1388 |
BENCHMARKING ANYEVENT OVERHEAD |
1389 |
Here is a benchmark of various supported event models used natively and |
1390 |
through AnyEvent. The benchmark creates a lot of timers (with a zero |
1391 |
timeout) and I/O watchers (watching STDOUT, a pty, to become writable, |
1392 |
which it is), lets them fire exactly once and destroys them again. |
1393 |
|
1394 |
Source code for this benchmark is found as eg/bench in the AnyEvent |
1395 |
distribution. It uses the AE interface, which makes a real difference |
1396 |
for the EV and Perl backends only. |
1397 |
|
1398 |
Explanation of the columns |
1399 |
*watcher* is the number of event watchers created/destroyed. Since |
1400 |
different event models feature vastly different performances, each event |
1401 |
loop was given a number of watchers so that overall runtime is |
1402 |
acceptable and similar between tested event loop (and keep them from |
1403 |
crashing): Glib would probably take thousands of years if asked to |
1404 |
process the same number of watchers as EV in this benchmark. |
1405 |
|
1406 |
*bytes* is the number of bytes (as measured by the resident set size, |
1407 |
RSS) consumed by each watcher. This method of measuring captures both C |
1408 |
and Perl-based overheads. |
1409 |
|
1410 |
*create* is the time, in microseconds (millionths of seconds), that it |
1411 |
takes to create a single watcher. The callback is a closure shared |
1412 |
between all watchers, to avoid adding memory overhead. That means |
1413 |
closure creation and memory usage is not included in the figures. |
1414 |
|
1415 |
*invoke* is the time, in microseconds, used to invoke a simple callback. |
1416 |
The callback simply counts down a Perl variable and after it was invoked |
1417 |
"watcher" times, it would "->send" a condvar once to signal the end of |
1418 |
this phase. |
1419 |
|
1420 |
*destroy* is the time, in microseconds, that it takes to destroy a |
1421 |
single watcher. |
1422 |
|
1423 |
Results |
1424 |
name watchers bytes create invoke destroy comment |
1425 |
EV/EV 100000 223 0.47 0.43 0.27 EV native interface |
1426 |
EV/Any 100000 223 0.48 0.42 0.26 EV + AnyEvent watchers |
1427 |
Coro::EV/Any 100000 223 0.47 0.42 0.26 coroutines + Coro::Signal |
1428 |
Perl/Any 100000 431 2.70 0.74 0.92 pure perl implementation |
1429 |
Event/Event 16000 516 31.16 31.84 0.82 Event native interface |
1430 |
Event/Any 16000 1203 42.61 34.79 1.80 Event + AnyEvent watchers |
1431 |
IOAsync/Any 16000 1911 41.92 27.45 16.81 via IO::Async::Loop::IO_Poll |
1432 |
IOAsync/Any 16000 1726 40.69 26.37 15.25 via IO::Async::Loop::Epoll |
1433 |
Glib/Any 16000 1118 89.00 12.57 51.17 quadratic behaviour |
1434 |
Tk/Any 2000 1346 20.96 10.75 8.00 SEGV with >> 2000 watchers |
1435 |
POE/Any 2000 6951 108.97 795.32 14.24 via POE::Loop::Event |
1436 |
POE/Any 2000 6648 94.79 774.40 575.51 via POE::Loop::Select |
1437 |
|
1438 |
Discussion |
1439 |
The benchmark does *not* measure scalability of the event loop very |
1440 |
well. For example, a select-based event loop (such as the pure perl one) |
1441 |
can never compete with an event loop that uses epoll when the number of |
1442 |
file descriptors grows high. In this benchmark, all events become ready |
1443 |
at the same time, so select/poll-based implementations get an unnatural |
1444 |
speed boost. |
1445 |
|
1446 |
Also, note that the number of watchers usually has a nonlinear effect on |
1447 |
overall speed, that is, creating twice as many watchers doesn't take |
1448 |
twice the time - usually it takes longer. This puts event loops tested |
1449 |
with a higher number of watchers at a disadvantage. |
1450 |
|
1451 |
To put the range of results into perspective, consider that on the |
1452 |
benchmark machine, handling an event takes roughly 1600 CPU cycles with |
1453 |
EV, 3100 CPU cycles with AnyEvent's pure perl loop and almost 3000000 |
1454 |
CPU cycles with POE. |
1455 |
|
1456 |
"EV" is the sole leader regarding speed and memory use, which are both |
1457 |
maximal/minimal, respectively. When using the AE API there is zero |
1458 |
overhead (when going through the AnyEvent API create is about 5-6 times |
1459 |
slower, with other times being equal, so still uses far less memory than |
1460 |
any other event loop and is still faster than Event natively). |
1461 |
|
1462 |
The pure perl implementation is hit in a few sweet spots (both the |
1463 |
constant timeout and the use of a single fd hit optimisations in the |
1464 |
perl interpreter and the backend itself). Nevertheless this shows that |
1465 |
it adds very little overhead in itself. Like any select-based backend |
1466 |
its performance becomes really bad with lots of file descriptors (and |
1467 |
few of them active), of course, but this was not subject of this |
1468 |
benchmark. |
1469 |
|
1470 |
The "Event" module has a relatively high setup and callback invocation |
1471 |
cost, but overall scores in on the third place. |
1472 |
|
1473 |
"IO::Async" performs admirably well, about on par with "Event", even |
1474 |
when using its pure perl backend. |
1475 |
|
1476 |
"Glib"'s memory usage is quite a bit higher, but it features a faster |
1477 |
callback invocation and overall ends up in the same class as "Event". |
1478 |
However, Glib scales extremely badly, doubling the number of watchers |
1479 |
increases the processing time by more than a factor of four, making it |
1480 |
completely unusable when using larger numbers of watchers (note that |
1481 |
only a single file descriptor was used in the benchmark, so |
1482 |
inefficiencies of "poll" do not account for this). |
1483 |
|
1484 |
The "Tk" adaptor works relatively well. The fact that it crashes with |
1485 |
more than 2000 watchers is a big setback, however, as correctness takes |
1486 |
precedence over speed. Nevertheless, its performance is surprising, as |
1487 |
the file descriptor is dup()ed for each watcher. This shows that the |
1488 |
dup() employed by some adaptors is not a big performance issue (it does |
1489 |
incur a hidden memory cost inside the kernel which is not reflected in |
1490 |
the figures above). |
1491 |
|
1492 |
"POE", regardless of underlying event loop (whether using its pure perl |
1493 |
select-based backend or the Event module, the POE-EV backend couldn't be |
1494 |
tested because it wasn't working) shows abysmal performance and memory |
1495 |
usage with AnyEvent: Watchers use almost 30 times as much memory as EV |
1496 |
watchers, and 10 times as much memory as Event (the high memory |
1497 |
requirements are caused by requiring a session for each watcher). |
1498 |
Watcher invocation speed is almost 900 times slower than with AnyEvent's |
1499 |
pure perl implementation. |
1500 |
|
1501 |
The design of the POE adaptor class in AnyEvent can not really account |
1502 |
for the performance issues, though, as session creation overhead is |
1503 |
small compared to execution of the state machine, which is coded pretty |
1504 |
optimally within AnyEvent::Impl::POE (and while everybody agrees that |
1505 |
using multiple sessions is not a good approach, especially regarding |
1506 |
memory usage, even the author of POE could not come up with a faster |
1507 |
design). |
1508 |
|
1509 |
Summary |
1510 |
* Using EV through AnyEvent is faster than any other event loop (even |
1511 |
when used without AnyEvent), but most event loops have acceptable |
1512 |
performance with or without AnyEvent. |
1513 |
|
1514 |
* The overhead AnyEvent adds is usually much smaller than the overhead |
1515 |
of the actual event loop, only with extremely fast event loops such |
1516 |
as EV adds AnyEvent significant overhead. |
1517 |
|
1518 |
* You should avoid POE like the plague if you want performance or |
1519 |
reasonable memory usage. |
1520 |
|
1521 |
BENCHMARKING THE LARGE SERVER CASE |
1522 |
This benchmark actually benchmarks the event loop itself. It works by |
1523 |
creating a number of "servers": each server consists of a socket pair, a |
1524 |
timeout watcher that gets reset on activity (but never fires), and an |
1525 |
I/O watcher waiting for input on one side of the socket. Each time the |
1526 |
socket watcher reads a byte it will write that byte to a random other |
1527 |
"server". |
1528 |
|
1529 |
The effect is that there will be a lot of I/O watchers, only part of |
1530 |
which are active at any one point (so there is a constant number of |
1531 |
active fds for each loop iteration, but which fds these are is random). |
1532 |
The timeout is reset each time something is read because that reflects |
1533 |
how most timeouts work (and puts extra pressure on the event loops). |
1534 |
|
1535 |
In this benchmark, we use 10000 socket pairs (20000 sockets), of which |
1536 |
100 (1%) are active. This mirrors the activity of large servers with |
1537 |
many connections, most of which are idle at any one point in time. |
1538 |
|
1539 |
Source code for this benchmark is found as eg/bench2 in the AnyEvent |
1540 |
distribution. It uses the AE interface, which makes a real difference |
1541 |
for the EV and Perl backends only. |
1542 |
|
1543 |
Explanation of the columns |
1544 |
*sockets* is the number of sockets, and twice the number of "servers" |
1545 |
(as each server has a read and write socket end). |
1546 |
|
1547 |
*create* is the time it takes to create a socket pair (which is |
1548 |
nontrivial) and two watchers: an I/O watcher and a timeout watcher. |
1549 |
|
1550 |
*request*, the most important value, is the time it takes to handle a |
1551 |
single "request", that is, reading the token from the pipe and |
1552 |
forwarding it to another server. This includes deleting the old timeout |
1553 |
and creating a new one that moves the timeout into the future. |
1554 |
|
1555 |
Results |
1556 |
name sockets create request |
1557 |
EV 20000 62.66 7.99 |
1558 |
Perl 20000 68.32 32.64 |
1559 |
IOAsync 20000 174.06 101.15 epoll |
1560 |
IOAsync 20000 174.67 610.84 poll |
1561 |
Event 20000 202.69 242.91 |
1562 |
Glib 20000 557.01 1689.52 |
1563 |
POE 20000 341.54 12086.32 uses POE::Loop::Event |
1564 |
|
1565 |
Discussion |
1566 |
This benchmark *does* measure scalability and overall performance of the |
1567 |
particular event loop. |
1568 |
|
1569 |
EV is again fastest. Since it is using epoll on my system, the setup |
1570 |
time is relatively high, though. |
1571 |
|
1572 |
Perl surprisingly comes second. It is much faster than the C-based event |
1573 |
loops Event and Glib. |
1574 |
|
1575 |
IO::Async performs very well when using its epoll backend, and still |
1576 |
quite good compared to Glib when using its pure perl backend. |
1577 |
|
1578 |
Event suffers from high setup time as well (look at its code and you |
1579 |
will understand why). Callback invocation also has a high overhead |
1580 |
compared to the "$_->() for .."-style loop that the Perl event loop |
1581 |
uses. Event uses select or poll in basically all documented |
1582 |
configurations. |
1583 |
|
1584 |
Glib is hit hard by its quadratic behaviour w.r.t. many watchers. It |
1585 |
clearly fails to perform with many filehandles or in busy servers. |
1586 |
|
1587 |
POE is still completely out of the picture, taking over 1000 times as |
1588 |
long as EV, and over 100 times as long as the Perl implementation, even |
1589 |
though it uses a C-based event loop in this case. |
1590 |
|
1591 |
Summary |
1592 |
* The pure perl implementation performs extremely well. |
1593 |
|
1594 |
* Avoid Glib or POE in large projects where performance matters. |
1595 |
|
1596 |
BENCHMARKING SMALL SERVERS |
1597 |
While event loops should scale (and select-based ones do not...) even to |
1598 |
large servers, most programs we (or I :) actually write have only a few |
1599 |
I/O watchers. |
1600 |
|
1601 |
In this benchmark, I use the same benchmark program as in the large |
1602 |
server case, but it uses only eight "servers", of which three are active |
1603 |
at any one time. This should reflect performance for a small server |
1604 |
relatively well. |
1605 |
|
1606 |
The columns are identical to the previous table. |
1607 |
|
1608 |
Results |
1609 |
name sockets create request |
1610 |
EV 16 20.00 6.54 |
1611 |
Perl 16 25.75 12.62 |
1612 |
Event 16 81.27 35.86 |
1613 |
Glib 16 32.63 15.48 |
1614 |
POE 16 261.87 276.28 uses POE::Loop::Event |
1615 |
|
1616 |
Discussion |
1617 |
The benchmark tries to test the performance of a typical small server. |
1618 |
While knowing how various event loops perform is interesting, keep in |
1619 |
mind that their overhead in this case is usually not as important, due |
1620 |
to the small absolute number of watchers (that is, you need efficiency |
1621 |
and speed most when you have lots of watchers, not when you only have a |
1622 |
few of them). |
1623 |
|
1624 |
EV is again fastest. |
1625 |
|
1626 |
Perl again comes second. It is noticeably faster than the C-based event |
1627 |
loops Event and Glib, although the difference is too small to really |
1628 |
matter. |
1629 |
|
1630 |
POE also performs much better in this case, but is is still far behind |
1631 |
the others. |
1632 |
|
1633 |
Summary |
1634 |
* C-based event loops perform very well with small number of watchers, |
1635 |
as the management overhead dominates. |
1636 |
|
1637 |
THE IO::Lambda BENCHMARK |
1638 |
Recently I was told about the benchmark in the IO::Lambda manpage, which |
1639 |
could be misinterpreted to make AnyEvent look bad. In fact, the |
1640 |
benchmark simply compares IO::Lambda with POE, and IO::Lambda looks |
1641 |
better (which shouldn't come as a surprise to anybody). As such, the |
1642 |
benchmark is fine, and mostly shows that the AnyEvent backend from |
1643 |
IO::Lambda isn't very optimal. But how would AnyEvent compare when used |
1644 |
without the extra baggage? To explore this, I wrote the equivalent |
1645 |
benchmark for AnyEvent. |
1646 |
|
1647 |
The benchmark itself creates an echo-server, and then, for 500 times, |
1648 |
connects to the echo server, sends a line, waits for the reply, and then |
1649 |
creates the next connection. This is a rather bad benchmark, as it |
1650 |
doesn't test the efficiency of the framework or much non-blocking I/O, |
1651 |
but it is a benchmark nevertheless. |
1652 |
|
1653 |
name runtime |
1654 |
Lambda/select 0.330 sec |
1655 |
+ optimized 0.122 sec |
1656 |
Lambda/AnyEvent 0.327 sec |
1657 |
+ optimized 0.138 sec |
1658 |
Raw sockets/select 0.077 sec |
1659 |
POE/select, components 0.662 sec |
1660 |
POE/select, raw sockets 0.226 sec |
1661 |
POE/select, optimized 0.404 sec |
1662 |
|
1663 |
AnyEvent/select/nb 0.085 sec |
1664 |
AnyEvent/EV/nb 0.068 sec |
1665 |
+state machine 0.134 sec |
1666 |
|
1667 |
The benchmark is also a bit unfair (my fault): the IO::Lambda/POE |
1668 |
benchmarks actually make blocking connects and use 100% blocking I/O, |
1669 |
defeating the purpose of an event-based solution. All of the newly |
1670 |
written AnyEvent benchmarks use 100% non-blocking connects (using |
1671 |
AnyEvent::Socket::tcp_connect and the asynchronous pure perl DNS |
1672 |
resolver), so AnyEvent is at a disadvantage here, as non-blocking |
1673 |
connects generally require a lot more bookkeeping and event handling |
1674 |
than blocking connects (which involve a single syscall only). |
1675 |
|
1676 |
The last AnyEvent benchmark additionally uses AnyEvent::Handle, which |
1677 |
offers similar expressive power as POE and IO::Lambda, using |
1678 |
conventional Perl syntax. This means that both the echo server and the |
1679 |
client are 100% non-blocking, further placing it at a disadvantage. |
1680 |
|
1681 |
As you can see, the AnyEvent + EV combination even beats the |
1682 |
hand-optimised "raw sockets benchmark", while AnyEvent + its pure perl |
1683 |
backend easily beats IO::Lambda and POE. |
1684 |
|
1685 |
And even the 100% non-blocking version written using the high-level (and |
1686 |
slow :) AnyEvent::Handle abstraction beats both POE and IO::Lambda |
1687 |
higher level ("unoptimised") abstractions by a large margin, even though |
1688 |
it does all of DNS, tcp-connect and socket I/O in a non-blocking way. |
1689 |
|
1690 |
The two AnyEvent benchmarks programs can be found as eg/ae0.pl and |
1691 |
eg/ae2.pl in the AnyEvent distribution, the remaining benchmarks are |
1692 |
part of the IO::Lambda distribution and were used without any changes. |
1693 |
|
1694 |
SIGNALS |
1695 |
AnyEvent currently installs handlers for these signals: |
1696 |
|
1697 |
SIGCHLD |
1698 |
A handler for "SIGCHLD" is installed by AnyEvent's child watcher |
1699 |
emulation for event loops that do not support them natively. Also, |
1700 |
some event loops install a similar handler. |
1701 |
|
1702 |
Additionally, when AnyEvent is loaded and SIGCHLD is set to IGNORE, |
1703 |
then AnyEvent will reset it to default, to avoid losing child exit |
1704 |
statuses. |
1705 |
|
1706 |
SIGPIPE |
1707 |
A no-op handler is installed for "SIGPIPE" when $SIG{PIPE} is |
1708 |
"undef" when AnyEvent gets loaded. |
1709 |
|
1710 |
The rationale for this is that AnyEvent users usually do not really |
1711 |
depend on SIGPIPE delivery (which is purely an optimisation for |
1712 |
shell use, or badly-written programs), but "SIGPIPE" can cause |
1713 |
spurious and rare program exits as a lot of people do not expect |
1714 |
"SIGPIPE" when writing to some random socket. |
1715 |
|
1716 |
The rationale for installing a no-op handler as opposed to ignoring |
1717 |
it is that this way, the handler will be restored to defaults on |
1718 |
exec. |
1719 |
|
1720 |
Feel free to install your own handler, or reset it to defaults. |
1721 |
|
1722 |
RECOMMENDED/OPTIONAL MODULES |
1723 |
One of AnyEvent's main goals is to be 100% Pure-Perl(tm): only perl (and |
1724 |
it's built-in modules) are required to use it. |
1725 |
|
1726 |
That does not mean that AnyEvent won't take advantage of some additional |
1727 |
modules if they are installed. |
1728 |
|
1729 |
This section explains which additional modules will be used, and how |
1730 |
they affect AnyEvent's operation. |
1731 |
|
1732 |
Async::Interrupt |
1733 |
This slightly arcane module is used to implement fast signal |
1734 |
handling: To my knowledge, there is no way to do completely |
1735 |
race-free and quick signal handling in pure perl. To ensure that |
1736 |
signals still get delivered, AnyEvent will start an interval timer |
1737 |
to wake up perl (and catch the signals) with some delay (default is |
1738 |
10 seconds, look for $AnyEvent::MAX_SIGNAL_LATENCY). |
1739 |
|
1740 |
If this module is available, then it will be used to implement |
1741 |
signal catching, which means that signals will not be delayed, and |
1742 |
the event loop will not be interrupted regularly, which is more |
1743 |
efficient (and good for battery life on laptops). |
1744 |
|
1745 |
This affects not just the pure-perl event loop, but also other event |
1746 |
loops that have no signal handling on their own (e.g. Glib, Tk, Qt). |
1747 |
|
1748 |
Some event loops (POE, Event, Event::Lib) offer signal watchers |
1749 |
natively, and either employ their own workarounds (POE) or use |
1750 |
AnyEvent's workaround (using $AnyEvent::MAX_SIGNAL_LATENCY). |
1751 |
Installing Async::Interrupt does nothing for those backends. |
1752 |
|
1753 |
EV This module isn't really "optional", as it is simply one of the |
1754 |
backend event loops that AnyEvent can use. However, it is simply the |
1755 |
best event loop available in terms of features, speed and stability: |
1756 |
It supports the AnyEvent API optimally, implements all the watcher |
1757 |
types in XS, does automatic timer adjustments even when no monotonic |
1758 |
clock is available, can take avdantage of advanced kernel interfaces |
1759 |
such as "epoll" and "kqueue", and is the fastest backend *by far*. |
1760 |
You can even embed Glib/Gtk2 in it (or vice versa, see EV::Glib and |
1761 |
Glib::EV). |
1762 |
|
1763 |
Guard |
1764 |
The guard module, when used, will be used to implement |
1765 |
"AnyEvent::Util::guard". This speeds up guards considerably (and |
1766 |
uses a lot less memory), but otherwise doesn't affect guard |
1767 |
operation much. It is purely used for performance. |
1768 |
|
1769 |
JSON and JSON::XS |
1770 |
One of these modules is required when you want to read or write JSON |
1771 |
data via AnyEvent::Handle. It is also written in pure-perl, but can |
1772 |
take advantage of the ultra-high-speed JSON::XS module when it is |
1773 |
installed. |
1774 |
|
1775 |
In fact, AnyEvent::Handle will use JSON::XS by default if it is |
1776 |
installed. |
1777 |
|
1778 |
Net::SSLeay |
1779 |
Implementing TLS/SSL in Perl is certainly interesting, but not very |
1780 |
worthwhile: If this module is installed, then AnyEvent::Handle (with |
1781 |
the help of AnyEvent::TLS), gains the ability to do TLS/SSL. |
1782 |
|
1783 |
Time::HiRes |
1784 |
This module is part of perl since release 5.008. It will be used |
1785 |
when the chosen event library does not come with a timing source on |
1786 |
it's own. The pure-perl event loop (AnyEvent::Impl::Perl) will |
1787 |
additionally use it to try to use a monotonic clock for timing |
1788 |
stability. |
1789 |
|
1790 |
FORK |
1791 |
Most event libraries are not fork-safe. The ones who are usually are |
1792 |
because they rely on inefficient but fork-safe "select" or "poll" calls. |
1793 |
Only EV is fully fork-aware. |
1794 |
|
1795 |
This means that, in general, you cannot fork and do event processing in |
1796 |
the child if a watcher was created before the fork (which in turn |
1797 |
initialises the event library). |
1798 |
|
1799 |
If you have to fork, you must either do so *before* creating your first |
1800 |
watcher OR you must not use AnyEvent at all in the child OR you must do |
1801 |
something completely out of the scope of AnyEvent. |
1802 |
|
1803 |
The problem of doing event processing in the parent *and* the child is |
1804 |
much more complicated: even for backends that *are* fork-aware or |
1805 |
fork-safe, their behaviour is not usually what you want: fork clones all |
1806 |
watchers, that means all timers, I/O watchers etc. are active in both |
1807 |
parent and child, which is almost never what you want. |
1808 |
|
1809 |
SECURITY CONSIDERATIONS |
1810 |
AnyEvent can be forced to load any event model via |
1811 |
$ENV{PERL_ANYEVENT_MODEL}. While this cannot (to my knowledge) be used |
1812 |
to execute arbitrary code or directly gain access, it can easily be used |
1813 |
to make the program hang or malfunction in subtle ways, as AnyEvent |
1814 |
watchers will not be active when the program uses a different event |
1815 |
model than specified in the variable. |
1816 |
|
1817 |
You can make AnyEvent completely ignore this variable by deleting it |
1818 |
before the first watcher gets created, e.g. with a "BEGIN" block: |
1819 |
|
1820 |
BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} } |
1821 |
|
1822 |
use AnyEvent; |
1823 |
|
1824 |
Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can |
1825 |
be used to probe what backend is used and gain other information (which |
1826 |
is probably even less useful to an attacker than PERL_ANYEVENT_MODEL), |
1827 |
and $ENV{PERL_ANYEVENT_STRICT}. |
1828 |
|
1829 |
Note that AnyEvent will remove *all* environment variables starting with |
1830 |
"PERL_ANYEVENT_" from %ENV when it is loaded while taint mode is |
1831 |
enabled. |
1832 |
|
1833 |
BUGS |
1834 |
Perl 5.8 has numerous memleaks that sometimes hit this module and are |
1835 |
hard to work around. If you suffer from memleaks, first upgrade to Perl |
1836 |
5.10 and check wether the leaks still show up. (Perl 5.10.0 has other |
1837 |
annoying memleaks, such as leaking on "map" and "grep" but it is usually |
1838 |
not as pronounced). |
1839 |
|
1840 |
SEE ALSO |
1841 |
Utility functions: AnyEvent::Util. |
1842 |
|
1843 |
Event modules: EV, EV::Glib, Glib::EV, Event, Glib::Event, Glib, Tk, |
1844 |
Event::Lib, Qt, POE. |
1845 |
|
1846 |
Implementations: AnyEvent::Impl::EV, AnyEvent::Impl::Event, |
1847 |
AnyEvent::Impl::Glib, AnyEvent::Impl::Tk, AnyEvent::Impl::Perl, |
1848 |
AnyEvent::Impl::EventLib, AnyEvent::Impl::Qt, AnyEvent::Impl::POE, |
1849 |
AnyEvent::Impl::IOAsync, Anyevent::Impl::Irssi. |
1850 |
|
1851 |
Non-blocking file handles, sockets, TCP clients and servers: |
1852 |
AnyEvent::Handle, AnyEvent::Socket, AnyEvent::TLS. |
1853 |
|
1854 |
Asynchronous DNS: AnyEvent::DNS. |
1855 |
|
1856 |
Coroutine support: Coro, Coro::AnyEvent, Coro::EV, Coro::Event, |
1857 |
|
1858 |
Nontrivial usage examples: AnyEvent::GPSD, AnyEvent::XMPP, |
1859 |
AnyEvent::HTTP. |
1860 |
|
1861 |
AUTHOR |
1862 |
Marc Lehmann <schmorp@schmorp.de> |
1863 |
http://home.schmorp.de/ |
1864 |
|