| 1 |
NAME |
| 2 |
AnyEvent - the DBI of event loop programming |
| 3 |
|
| 4 |
EV, Event, Glib, Tk, UV, Perl, Event::Lib, Irssi, rxvt-unicode, |
| 5 |
IO::Async, Qt, FLTK and POE are various supported event |
| 6 |
loops/environments. |
| 7 |
|
| 8 |
SYNOPSIS |
| 9 |
use AnyEvent; |
| 10 |
|
| 11 |
# if you prefer function calls, look at the AE manpage for |
| 12 |
# an alternative API. |
| 13 |
|
| 14 |
# file handle or descriptor readable |
| 15 |
my $w = AnyEvent->io (fh => $fh, poll => "r", cb => sub { ... }); |
| 16 |
|
| 17 |
# one-shot or repeating timers |
| 18 |
my $w = AnyEvent->timer (after => $seconds, cb => sub { ... }); |
| 19 |
my $w = AnyEvent->timer (after => $seconds, interval => $seconds, cb => ...); |
| 20 |
|
| 21 |
print AnyEvent->now; # prints current event loop time |
| 22 |
print AnyEvent->time; # think Time::HiRes::time or simply CORE::time. |
| 23 |
|
| 24 |
# POSIX signal |
| 25 |
my $w = AnyEvent->signal (signal => "TERM", cb => sub { ... }); |
| 26 |
|
| 27 |
# child process exit |
| 28 |
my $w = AnyEvent->child (pid => $pid, cb => sub { |
| 29 |
my ($pid, $status) = @_; |
| 30 |
... |
| 31 |
}); |
| 32 |
|
| 33 |
# called when event loop idle (if applicable) |
| 34 |
my $w = AnyEvent->idle (cb => sub { ... }); |
| 35 |
|
| 36 |
my $w = AnyEvent->condvar; # stores whether a condition was flagged |
| 37 |
$w->send; # wake up current and all future recv's |
| 38 |
$w->recv; # enters "main loop" till $condvar gets ->send |
| 39 |
# use a condvar in callback mode: |
| 40 |
$w->cb (sub { $_[0]->recv }); |
| 41 |
|
| 42 |
INTRODUCTION/TUTORIAL |
| 43 |
This manpage is mainly a reference manual. If you are interested in a |
| 44 |
tutorial or some gentle introduction, have a look at the AnyEvent::Intro |
| 45 |
manpage. |
| 46 |
|
| 47 |
SUPPORT |
| 48 |
An FAQ document is available as AnyEvent::FAQ. |
| 49 |
|
| 50 |
There also is a mailinglist for discussing all things AnyEvent, and an |
| 51 |
IRC channel, too. |
| 52 |
|
| 53 |
See the AnyEvent project page at the Schmorpforge Ta-Sa Software |
| 54 |
Repository, at <http://anyevent.schmorp.de>, for more info. |
| 55 |
|
| 56 |
WHY YOU SHOULD USE THIS MODULE (OR NOT) |
| 57 |
Glib, POE, IO::Async, Event... CPAN offers event models by the dozen |
| 58 |
nowadays. So what is different about AnyEvent? |
| 59 |
|
| 60 |
Executive Summary: AnyEvent is *compatible*, AnyEvent is *free of |
| 61 |
policy* and AnyEvent is *small and efficient*. |
| 62 |
|
| 63 |
First and foremost, *AnyEvent is not an event model* itself, it only |
| 64 |
interfaces to whatever event model the main program happens to use, in a |
| 65 |
pragmatic way. For event models and certain classes of immortals alike, |
| 66 |
the statement "there can only be one" is a bitter reality: In general, |
| 67 |
only one event loop can be active at the same time in a process. |
| 68 |
AnyEvent cannot change this, but it can hide the differences between |
| 69 |
those event loops. |
| 70 |
|
| 71 |
The goal of AnyEvent is to offer module authors the ability to do event |
| 72 |
programming (waiting for I/O or timer events) without subscribing to a |
| 73 |
religion, a way of living, and most importantly: without forcing your |
| 74 |
module users into the same thing by forcing them to use the same event |
| 75 |
model you use. |
| 76 |
|
| 77 |
For modules like POE or IO::Async (which is a total misnomer as it is |
| 78 |
actually doing all I/O *synchronously*...), using them in your module is |
| 79 |
like joining a cult: After you join, you are dependent on them and you |
| 80 |
cannot use anything else, as they are simply incompatible to everything |
| 81 |
that isn't them. What's worse, all the potential users of your module |
| 82 |
are *also* forced to use the same event loop you use. |
| 83 |
|
| 84 |
AnyEvent is different: AnyEvent + POE works fine. AnyEvent + Glib works |
| 85 |
fine. AnyEvent + Tk works fine etc. etc. but none of these work together |
| 86 |
with the rest: POE + EV? No go. Tk + Event? No go. Again: if your module |
| 87 |
uses one of those, every user of your module has to use it, too. But if |
| 88 |
your module uses AnyEvent, it works transparently with all event models |
| 89 |
it supports (including stuff like IO::Async, as long as those use one of |
| 90 |
the supported event loops. It is easy to add new event loops to |
| 91 |
AnyEvent, too, so it is future-proof). |
| 92 |
|
| 93 |
In addition to being free of having to use *the one and only true event |
| 94 |
model*, AnyEvent also is free of bloat and policy: with POE or similar |
| 95 |
modules, you get an enormous amount of code and strict rules you have to |
| 96 |
follow. AnyEvent, on the other hand, is lean and to the point, by only |
| 97 |
offering the functionality that is necessary, in as thin as a wrapper as |
| 98 |
technically possible. |
| 99 |
|
| 100 |
Of course, AnyEvent comes with a big (and fully optional!) toolbox of |
| 101 |
useful functionality, such as an asynchronous DNS resolver, 100% |
| 102 |
non-blocking connects (even with TLS/SSL, IPv6 and on broken platforms |
| 103 |
such as Windows) and lots of real-world knowledge and workarounds for |
| 104 |
platform bugs and differences. |
| 105 |
|
| 106 |
Now, if you *do want* lots of policy (this can arguably be somewhat |
| 107 |
useful) and you want to force your users to use the one and only event |
| 108 |
model, you should *not* use this module. |
| 109 |
|
| 110 |
DESCRIPTION |
| 111 |
AnyEvent provides a uniform interface to various event loops. This |
| 112 |
allows module authors to use event loop functionality without forcing |
| 113 |
module users to use a specific event loop implementation (since more |
| 114 |
than one event loop cannot coexist peacefully). |
| 115 |
|
| 116 |
The interface itself is vaguely similar, but not identical to the Event |
| 117 |
module. |
| 118 |
|
| 119 |
During the first call of any watcher-creation method, the module tries |
| 120 |
to detect the currently loaded event loop by probing whether one of the |
| 121 |
following modules is already loaded: EV, AnyEvent::Loop, Event, Glib, |
| 122 |
Tk, Event::Lib, Qt, POE. The first one found is used. If none are |
| 123 |
detected, the module tries to load the first four modules in the order |
| 124 |
given; but note that if EV is not available, the pure-perl |
| 125 |
AnyEvent::Loop should always work, so the other two are not normally |
| 126 |
tried. |
| 127 |
|
| 128 |
Because AnyEvent first checks for modules that are already loaded, |
| 129 |
loading an event model explicitly before first using AnyEvent will |
| 130 |
likely make that model the default. For example: |
| 131 |
|
| 132 |
use Tk; |
| 133 |
use AnyEvent; |
| 134 |
|
| 135 |
# .. AnyEvent will likely default to Tk |
| 136 |
|
| 137 |
The *likely* means that, if any module loads another event model and |
| 138 |
starts using it, all bets are off - this case should be very rare |
| 139 |
though, as very few modules hardcode event loops without announcing this |
| 140 |
very loudly. |
| 141 |
|
| 142 |
The pure-perl implementation of AnyEvent is called "AnyEvent::Loop". |
| 143 |
Like other event modules you can load it explicitly and enjoy the high |
| 144 |
availability of that event loop :) |
| 145 |
|
| 146 |
WATCHERS |
| 147 |
AnyEvent has the central concept of a *watcher*, which is an object that |
| 148 |
stores relevant data for each kind of event you are waiting for, such as |
| 149 |
the callback to call, the file handle to watch, etc. |
| 150 |
|
| 151 |
These watchers are normal Perl objects with normal Perl lifetime. After |
| 152 |
creating a watcher it will immediately "watch" for events and invoke the |
| 153 |
callback when the event occurs (of course, only when the event model is |
| 154 |
in control). |
| 155 |
|
| 156 |
Note that callbacks must not permanently change global variables |
| 157 |
potentially in use by the event loop (such as $_ or $[) and that |
| 158 |
callbacks must not "die". The former is good programming practice in |
| 159 |
Perl and the latter stems from the fact that exception handling differs |
| 160 |
widely between event loops. |
| 161 |
|
| 162 |
To disable a watcher you have to destroy it (e.g. by setting the |
| 163 |
variable you store it in to "undef" or otherwise deleting all references |
| 164 |
to it). |
| 165 |
|
| 166 |
All watchers are created by calling a method on the "AnyEvent" class. |
| 167 |
|
| 168 |
Many watchers either are used with "recursion" (repeating timers for |
| 169 |
example), or need to refer to their watcher object in other ways. |
| 170 |
|
| 171 |
One way to achieve that is this pattern: |
| 172 |
|
| 173 |
my $w; $w = AnyEvent->type (arg => value ..., cb => sub { |
| 174 |
# you can use $w here, for example to undef it |
| 175 |
undef $w; |
| 176 |
}); |
| 177 |
|
| 178 |
Note that "my $w; $w =" combination. This is necessary because in Perl, |
| 179 |
my variables are only visible after the statement in which they are |
| 180 |
declared. |
| 181 |
|
| 182 |
I/O WATCHERS |
| 183 |
$w = AnyEvent->io ( |
| 184 |
fh => <filehandle_or_fileno>, |
| 185 |
poll => <"r" or "w">, |
| 186 |
cb => <callback>, |
| 187 |
); |
| 188 |
|
| 189 |
You can create an I/O watcher by calling the "AnyEvent->io" method with |
| 190 |
the following mandatory key-value pairs as arguments: |
| 191 |
|
| 192 |
"fh" is the Perl *file handle* (or a naked file descriptor) to watch for |
| 193 |
events (AnyEvent might or might not keep a reference to this file |
| 194 |
handle). Note that only file handles pointing to things for which |
| 195 |
non-blocking operation makes sense are allowed. This includes sockets, |
| 196 |
most character devices, pipes, fifos and so on, but not for example |
| 197 |
files or block devices. |
| 198 |
|
| 199 |
"poll" must be a string that is either "r" or "w", which creates a |
| 200 |
watcher waiting for "r"eadable or "w"ritable events, respectively. |
| 201 |
|
| 202 |
"cb" is the callback to invoke each time the file handle becomes ready. |
| 203 |
|
| 204 |
Although the callback might get passed parameters, their value and |
| 205 |
presence is undefined and you cannot rely on them. Portable AnyEvent |
| 206 |
callbacks cannot use arguments passed to I/O watcher callbacks. |
| 207 |
|
| 208 |
The I/O watcher might use the underlying file descriptor or a copy of |
| 209 |
it. You must not close a file handle as long as any watcher is active on |
| 210 |
the underlying file descriptor. |
| 211 |
|
| 212 |
Some event loops issue spurious readiness notifications, so you should |
| 213 |
always use non-blocking calls when reading/writing from/to your file |
| 214 |
handles. |
| 215 |
|
| 216 |
Example: wait for readability of STDIN, then read a line and disable the |
| 217 |
watcher. |
| 218 |
|
| 219 |
my $w; $w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub { |
| 220 |
chomp (my $input = <STDIN>); |
| 221 |
warn "read: $input\n"; |
| 222 |
undef $w; |
| 223 |
}); |
| 224 |
|
| 225 |
TIME WATCHERS |
| 226 |
$w = AnyEvent->timer (after => <seconds>, cb => <callback>); |
| 227 |
|
| 228 |
$w = AnyEvent->timer ( |
| 229 |
after => <fractional_seconds>, |
| 230 |
interval => <fractional_seconds>, |
| 231 |
cb => <callback>, |
| 232 |
); |
| 233 |
|
| 234 |
You can create a time watcher by calling the "AnyEvent->timer" method |
| 235 |
with the following mandatory arguments: |
| 236 |
|
| 237 |
"after" specifies after how many seconds (fractional values are |
| 238 |
supported) the callback should be invoked. "cb" is the callback to |
| 239 |
invoke in that case. |
| 240 |
|
| 241 |
Although the callback might get passed parameters, their value and |
| 242 |
presence is undefined and you cannot rely on them. Portable AnyEvent |
| 243 |
callbacks cannot use arguments passed to time watcher callbacks. |
| 244 |
|
| 245 |
The callback will normally be invoked only once. If you specify another |
| 246 |
parameter, "interval", as a strictly positive number (> 0), then the |
| 247 |
callback will be invoked regularly at that interval (in fractional |
| 248 |
seconds) after the first invocation. If "interval" is specified with a |
| 249 |
false value, then it is treated as if it were not specified at all. |
| 250 |
|
| 251 |
The callback will be rescheduled before invoking the callback, but no |
| 252 |
attempt is made to avoid timer drift in most backends, so the interval |
| 253 |
is only approximate. |
| 254 |
|
| 255 |
Example: fire an event after 7.7 seconds. |
| 256 |
|
| 257 |
my $w = AnyEvent->timer (after => 7.7, cb => sub { |
| 258 |
warn "timeout\n"; |
| 259 |
}); |
| 260 |
|
| 261 |
# to cancel the timer: |
| 262 |
undef $w; |
| 263 |
|
| 264 |
Example 2: fire an event after 0.5 seconds, then roughly every second. |
| 265 |
|
| 266 |
my $w = AnyEvent->timer (after => 0.5, interval => 1, cb => sub { |
| 267 |
warn "timeout\n"; |
| 268 |
}); |
| 269 |
|
| 270 |
TIMING ISSUES |
| 271 |
There are two ways to handle timers: based on real time (relative, "fire |
| 272 |
in 10 seconds") and based on wallclock time (absolute, "fire at 12 |
| 273 |
o'clock"). |
| 274 |
|
| 275 |
While most event loops expect timers to specified in a relative way, |
| 276 |
they use absolute time internally. This makes a difference when your |
| 277 |
clock "jumps", for example, when ntp decides to set your clock backwards |
| 278 |
from the wrong date of 2014-01-01 to 2008-01-01, a watcher that is |
| 279 |
supposed to fire "after a second" might actually take six years to |
| 280 |
finally fire. |
| 281 |
|
| 282 |
AnyEvent cannot compensate for this. The only event loop that is |
| 283 |
conscious of these issues is EV, which offers both relative (ev_timer, |
| 284 |
based on true relative time) and absolute (ev_periodic, based on |
| 285 |
wallclock time) timers. |
| 286 |
|
| 287 |
AnyEvent always prefers relative timers, if available, matching the |
| 288 |
AnyEvent API. |
| 289 |
|
| 290 |
AnyEvent has two additional methods that return the "current time": |
| 291 |
|
| 292 |
AnyEvent->time |
| 293 |
This returns the "current wallclock time" as a fractional number of |
| 294 |
seconds since the Epoch (the same thing as "time" or |
| 295 |
"Time::HiRes::time" return, and the result is guaranteed to be |
| 296 |
compatible with those). |
| 297 |
|
| 298 |
It progresses independently of any event loop processing, i.e. each |
| 299 |
call will check the system clock, which usually gets updated |
| 300 |
frequently. |
| 301 |
|
| 302 |
AnyEvent->now |
| 303 |
This also returns the "current wallclock time", but unlike "time", |
| 304 |
above, this value might change only once per event loop iteration, |
| 305 |
depending on the event loop (most return the same time as "time", |
| 306 |
above). This is the time that AnyEvent's timers get scheduled |
| 307 |
against. |
| 308 |
|
| 309 |
*In almost all cases (in all cases if you don't care), this is the |
| 310 |
function to call when you want to know the current time.* |
| 311 |
|
| 312 |
This function is also often faster then "AnyEvent->time", and thus |
| 313 |
the preferred method if you want some timestamp (for example, |
| 314 |
AnyEvent::Handle uses this to update its activity timeouts). |
| 315 |
|
| 316 |
The rest of this section is only of relevance if you try to be very |
| 317 |
exact with your timing; you can skip it without a bad conscience. |
| 318 |
|
| 319 |
For a practical example of when these times differ, consider |
| 320 |
Event::Lib and EV and the following set-up: |
| 321 |
|
| 322 |
The event loop is running and has just invoked one of your callbacks |
| 323 |
at time=500 (assume no other callbacks delay processing). In your |
| 324 |
callback, you wait a second by executing "sleep 1" (blocking the |
| 325 |
process for a second) and then (at time=501) you create a relative |
| 326 |
timer that fires after three seconds. |
| 327 |
|
| 328 |
With Event::Lib, "AnyEvent->time" and "AnyEvent->now" will both |
| 329 |
return 501, because that is the current time, and the timer will be |
| 330 |
scheduled to fire at time=504 (501 + 3). |
| 331 |
|
| 332 |
With EV, "AnyEvent->time" returns 501 (as that is the current time), |
| 333 |
but "AnyEvent->now" returns 500, as that is the time the last event |
| 334 |
processing phase started. With EV, your timer gets scheduled to run |
| 335 |
at time=503 (500 + 3). |
| 336 |
|
| 337 |
In one sense, Event::Lib is more exact, as it uses the current time |
| 338 |
regardless of any delays introduced by event processing. However, |
| 339 |
most callbacks do not expect large delays in processing, so this |
| 340 |
causes a higher drift (and a lot more system calls to get the |
| 341 |
current time). |
| 342 |
|
| 343 |
In another sense, EV is more exact, as your timer will be scheduled |
| 344 |
at the same time, regardless of how long event processing actually |
| 345 |
took. |
| 346 |
|
| 347 |
In either case, if you care (and in most cases, you don't), then you |
| 348 |
can get whatever behaviour you want with any event loop, by taking |
| 349 |
the difference between "AnyEvent->time" and "AnyEvent->now" into |
| 350 |
account. |
| 351 |
|
| 352 |
AnyEvent->now_update |
| 353 |
Some event loops (such as EV or AnyEvent::Loop) cache the current |
| 354 |
time for each loop iteration (see the discussion of AnyEvent->now, |
| 355 |
above). |
| 356 |
|
| 357 |
When a callback runs for a long time (or when the process sleeps), |
| 358 |
then this "current" time will differ substantially from the real |
| 359 |
time, which might affect timers and time-outs. |
| 360 |
|
| 361 |
When this is the case, you can call this method, which will update |
| 362 |
the event loop's idea of "current time". |
| 363 |
|
| 364 |
A typical example would be a script in a web server (e.g. |
| 365 |
"mod_perl") - when mod_perl executes the script, then the event loop |
| 366 |
will have the wrong idea about the "current time" (being potentially |
| 367 |
far in the past, when the script ran the last time). In that case |
| 368 |
you should arrange a call to "AnyEvent->now_update" each time the |
| 369 |
web server process wakes up again (e.g. at the start of your script, |
| 370 |
or in a handler). |
| 371 |
|
| 372 |
Note that updating the time *might* cause some events to be handled. |
| 373 |
|
| 374 |
SIGNAL WATCHERS |
| 375 |
$w = AnyEvent->signal (signal => <uppercase_signal_name>, cb => <callback>); |
| 376 |
|
| 377 |
You can watch for signals using a signal watcher, "signal" is the signal |
| 378 |
*name* in uppercase and without any "SIG" prefix, "cb" is the Perl |
| 379 |
callback to be invoked whenever a signal occurs. |
| 380 |
|
| 381 |
Although the callback might get passed parameters, their value and |
| 382 |
presence is undefined and you cannot rely on them. Portable AnyEvent |
| 383 |
callbacks cannot use arguments passed to signal watcher callbacks. |
| 384 |
|
| 385 |
Multiple signal occurrences can be clumped together into one callback |
| 386 |
invocation, and callback invocation will be synchronous. Synchronous |
| 387 |
means that it might take a while until the signal gets handled by the |
| 388 |
process, but it is guaranteed not to interrupt any other callbacks. |
| 389 |
|
| 390 |
The main advantage of using these watchers is that you can share a |
| 391 |
signal between multiple watchers, and AnyEvent will ensure that signals |
| 392 |
will not interrupt your program at bad times. |
| 393 |
|
| 394 |
This watcher might use %SIG (depending on the event loop used), so |
| 395 |
programs overwriting those signals directly will likely not work |
| 396 |
correctly. |
| 397 |
|
| 398 |
Example: exit on SIGINT |
| 399 |
|
| 400 |
my $w = AnyEvent->signal (signal => "INT", cb => sub { exit 1 }); |
| 401 |
|
| 402 |
Restart Behaviour |
| 403 |
While restart behaviour is up to the event loop implementation, most |
| 404 |
will not restart syscalls (that includes Async::Interrupt and AnyEvent's |
| 405 |
pure perl implementation). |
| 406 |
|
| 407 |
Safe/Unsafe Signals |
| 408 |
Perl signals can be either "safe" (synchronous to opcode handling) or |
| 409 |
"unsafe" (asynchronous) - the former might delay signal delivery |
| 410 |
indefinitely, the latter might corrupt your memory. |
| 411 |
|
| 412 |
AnyEvent signal handlers are, in addition, synchronous to the event |
| 413 |
loop, i.e. they will not interrupt your running perl program but will |
| 414 |
only be called as part of the normal event handling (just like timer, |
| 415 |
I/O etc. callbacks, too). |
| 416 |
|
| 417 |
Signal Races, Delays and Workarounds |
| 418 |
Many event loops (e.g. Glib, Tk, Qt, IO::Async) do not support attaching |
| 419 |
callbacks to signals in a generic way, which is a pity, as you cannot do |
| 420 |
race-free signal handling in perl, requiring C libraries for this. |
| 421 |
AnyEvent will try to do its best, which means in some cases, signals |
| 422 |
will be delayed. The maximum time a signal might be delayed is 10 |
| 423 |
seconds by default, but can be overriden via |
| 424 |
$ENV{PERL_ANYEVENT_MAX_SIGNAL_LATENCY} or $AnyEvent::MAX_SIGNAL_LATENCY |
| 425 |
- see the "ENVIRONMENT VARIABLES" section for details. |
| 426 |
|
| 427 |
All these problems can be avoided by installing the optional |
| 428 |
Async::Interrupt module, which works with most event loops. It will not |
| 429 |
work with inherently broken event loops such as Event or Event::Lib (and |
| 430 |
not with POE currently). For those, you just have to suffer the delays. |
| 431 |
|
| 432 |
CHILD PROCESS WATCHERS |
| 433 |
$w = AnyEvent->child (pid => <process id>, cb => <callback>); |
| 434 |
|
| 435 |
You can also watch for a child process exit and catch its exit status. |
| 436 |
|
| 437 |
The child process is specified by the "pid" argument (on some backends, |
| 438 |
using 0 watches for any child process exit, on others this will croak). |
| 439 |
The watcher will be triggered only when the child process has finished |
| 440 |
and an exit status is available, not on any trace events |
| 441 |
(stopped/continued). |
| 442 |
|
| 443 |
The callback will be called with the pid and exit status (as returned by |
| 444 |
waitpid), so unlike other watcher types, you *can* rely on child watcher |
| 445 |
callback arguments. |
| 446 |
|
| 447 |
This watcher type works by installing a signal handler for "SIGCHLD", |
| 448 |
and since it cannot be shared, nothing else should use SIGCHLD or reap |
| 449 |
random child processes (waiting for specific child processes, e.g. |
| 450 |
inside "system", is just fine). |
| 451 |
|
| 452 |
There is a slight catch to child watchers, however: you usually start |
| 453 |
them *after* the child process was created, and this means the process |
| 454 |
could have exited already (and no SIGCHLD will be sent anymore). |
| 455 |
|
| 456 |
Not all event models handle this correctly (neither POE nor IO::Async |
| 457 |
do, see their AnyEvent::Impl manpages for details), but even for event |
| 458 |
models that *do* handle this correctly, they usually need to be loaded |
| 459 |
before the process exits (i.e. before you fork in the first place). |
| 460 |
AnyEvent's pure perl event loop handles all cases correctly regardless |
| 461 |
of when you start the watcher. |
| 462 |
|
| 463 |
This means you cannot create a child watcher as the very first thing in |
| 464 |
an AnyEvent program, you *have* to create at least one watcher before |
| 465 |
you "fork" the child (alternatively, you can call "AnyEvent::detect"). |
| 466 |
|
| 467 |
As most event loops do not support waiting for child events, they will |
| 468 |
be emulated by AnyEvent in most cases, in which case the latency and |
| 469 |
race problems mentioned in the description of signal watchers apply. |
| 470 |
|
| 471 |
Example: fork a process and wait for it |
| 472 |
|
| 473 |
my $done = AnyEvent->condvar; |
| 474 |
|
| 475 |
# this forks and immediately calls exit in the child. this |
| 476 |
# normally has all sorts of bad consequences for your parent, |
| 477 |
# so take this as an example only. always fork and exec, |
| 478 |
# or call POSIX::_exit, in real code. |
| 479 |
my $pid = fork or exit 5; |
| 480 |
|
| 481 |
my $w = AnyEvent->child ( |
| 482 |
pid => $pid, |
| 483 |
cb => sub { |
| 484 |
my ($pid, $status) = @_; |
| 485 |
warn "pid $pid exited with status $status"; |
| 486 |
$done->send; |
| 487 |
}, |
| 488 |
); |
| 489 |
|
| 490 |
# do something else, then wait for process exit |
| 491 |
$done->recv; |
| 492 |
|
| 493 |
IDLE WATCHERS |
| 494 |
$w = AnyEvent->idle (cb => <callback>); |
| 495 |
|
| 496 |
This will repeatedly invoke the callback after the process becomes idle, |
| 497 |
until either the watcher is destroyed or new events have been detected. |
| 498 |
|
| 499 |
Idle watchers are useful when there is a need to do something, but it is |
| 500 |
not so important (or wise) to do it instantly. The callback will be |
| 501 |
invoked only when there is "nothing better to do", which is usually |
| 502 |
defined as "all outstanding events have been handled and no new events |
| 503 |
have been detected". That means that idle watchers ideally get invoked |
| 504 |
when the event loop has just polled for new events but none have been |
| 505 |
detected. Instead of blocking to wait for more events, the idle watchers |
| 506 |
will be invoked. |
| 507 |
|
| 508 |
Unfortunately, most event loops do not really support idle watchers |
| 509 |
(only EV, Event and Glib do it in a usable fashion) - for the rest, |
| 510 |
AnyEvent will simply call the callback "from time to time". |
| 511 |
|
| 512 |
Example: read lines from STDIN, but only process them when the program |
| 513 |
is otherwise idle: |
| 514 |
|
| 515 |
my @lines; # read data |
| 516 |
my $idle_w; |
| 517 |
my $io_w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub { |
| 518 |
push @lines, scalar <STDIN>; |
| 519 |
|
| 520 |
# start an idle watcher, if not already done |
| 521 |
$idle_w ||= AnyEvent->idle (cb => sub { |
| 522 |
# handle only one line, when there are lines left |
| 523 |
if (my $line = shift @lines) { |
| 524 |
print "handled when idle: $line"; |
| 525 |
} else { |
| 526 |
# otherwise disable the idle watcher again |
| 527 |
undef $idle_w; |
| 528 |
} |
| 529 |
}); |
| 530 |
}); |
| 531 |
|
| 532 |
CONDITION VARIABLES |
| 533 |
$cv = AnyEvent->condvar; |
| 534 |
|
| 535 |
$cv->send (<list>); |
| 536 |
my @res = $cv->recv; |
| 537 |
|
| 538 |
If you are familiar with some event loops you will know that all of them |
| 539 |
require you to run some blocking "loop", "run" or similar function that |
| 540 |
will actively watch for new events and call your callbacks. |
| 541 |
|
| 542 |
AnyEvent is slightly different: it expects somebody else to run the |
| 543 |
event loop and will only block when necessary (usually when told by the |
| 544 |
user). |
| 545 |
|
| 546 |
The tool to do that is called a "condition variable", so called because |
| 547 |
they represent a condition that must become true. |
| 548 |
|
| 549 |
Now is probably a good time to look at the examples further below. |
| 550 |
|
| 551 |
Condition variables can be created by calling the "AnyEvent->condvar" |
| 552 |
method, usually without arguments. The only argument pair allowed is |
| 553 |
"cb", which specifies a callback to be called when the condition |
| 554 |
variable becomes true, with the condition variable as the first argument |
| 555 |
(but not the results). |
| 556 |
|
| 557 |
After creation, the condition variable is "false" until it becomes |
| 558 |
"true" by calling the "send" method (or calling the condition variable |
| 559 |
as if it were a callback, read about the caveats in the description for |
| 560 |
the "->send" method). |
| 561 |
|
| 562 |
Since condition variables are the most complex part of the AnyEvent API, |
| 563 |
here are some different mental models of what they are - pick the ones |
| 564 |
you can connect to: |
| 565 |
|
| 566 |
* Condition variables are like callbacks - you can call them (and pass |
| 567 |
them instead of callbacks). Unlike callbacks however, you can also |
| 568 |
wait for them to be called. |
| 569 |
|
| 570 |
* Condition variables are signals - one side can emit or send them, |
| 571 |
the other side can wait for them, or install a handler that is |
| 572 |
called when the signal fires. |
| 573 |
|
| 574 |
* Condition variables are like "Merge Points" - points in your program |
| 575 |
where you merge multiple independent results/control flows into one. |
| 576 |
|
| 577 |
* Condition variables represent a transaction - functions that start |
| 578 |
some kind of transaction can return them, leaving the caller the |
| 579 |
choice between waiting in a blocking fashion, or setting a callback. |
| 580 |
|
| 581 |
* Condition variables represent future values, or promises to deliver |
| 582 |
some result, long before the result is available. |
| 583 |
|
| 584 |
Condition variables are very useful to signal that something has |
| 585 |
finished, for example, if you write a module that does asynchronous http |
| 586 |
requests, then a condition variable would be the ideal candidate to |
| 587 |
signal the availability of results. The user can either act when the |
| 588 |
callback is called or can synchronously "->recv" for the results. |
| 589 |
|
| 590 |
You can also use them to simulate traditional event loops - for example, |
| 591 |
you can block your main program until an event occurs - for example, you |
| 592 |
could "->recv" in your main program until the user clicks the Quit |
| 593 |
button of your app, which would "->send" the "quit" event. |
| 594 |
|
| 595 |
Note that condition variables recurse into the event loop - if you have |
| 596 |
two pieces of code that call "->recv" in a round-robin fashion, you |
| 597 |
lose. Therefore, condition variables are good to export to your caller, |
| 598 |
but you should avoid making a blocking wait yourself, at least in |
| 599 |
callbacks, as this asks for trouble. |
| 600 |
|
| 601 |
Condition variables are represented by hash refs in perl, and the keys |
| 602 |
used by AnyEvent itself are all named "_ae_XXX" to make subclassing easy |
| 603 |
(it is often useful to build your own transaction class on top of |
| 604 |
AnyEvent). To subclass, use "AnyEvent::CondVar" as base class and call |
| 605 |
its "new" method in your own "new" method. |
| 606 |
|
| 607 |
There are two "sides" to a condition variable - the "producer side" |
| 608 |
which eventually calls "-> send", and the "consumer side", which waits |
| 609 |
for the send to occur. |
| 610 |
|
| 611 |
Example: wait for a timer. |
| 612 |
|
| 613 |
# condition: "wait till the timer is fired" |
| 614 |
my $timer_fired = AnyEvent->condvar; |
| 615 |
|
| 616 |
# create the timer - we could wait for, say |
| 617 |
# a handle becomign ready, or even an |
| 618 |
# AnyEvent::HTTP request to finish, but |
| 619 |
# in this case, we simply use a timer: |
| 620 |
my $w = AnyEvent->timer ( |
| 621 |
after => 1, |
| 622 |
cb => sub { $timer_fired->send }, |
| 623 |
); |
| 624 |
|
| 625 |
# this "blocks" (while handling events) till the callback |
| 626 |
# calls ->send |
| 627 |
$timer_fired->recv; |
| 628 |
|
| 629 |
Example: wait for a timer, but take advantage of the fact that condition |
| 630 |
variables are also callable directly. |
| 631 |
|
| 632 |
my $done = AnyEvent->condvar; |
| 633 |
my $delay = AnyEvent->timer (after => 5, cb => $done); |
| 634 |
$done->recv; |
| 635 |
|
| 636 |
Example: Imagine an API that returns a condvar and doesn't support |
| 637 |
callbacks. This is how you make a synchronous call, for example from the |
| 638 |
main program: |
| 639 |
|
| 640 |
use AnyEvent::CouchDB; |
| 641 |
|
| 642 |
... |
| 643 |
|
| 644 |
my @info = $couchdb->info->recv; |
| 645 |
|
| 646 |
And this is how you would just set a callback to be called whenever the |
| 647 |
results are available: |
| 648 |
|
| 649 |
$couchdb->info->cb (sub { |
| 650 |
my @info = $_[0]->recv; |
| 651 |
}); |
| 652 |
|
| 653 |
METHODS FOR PRODUCERS |
| 654 |
These methods should only be used by the producing side, i.e. the |
| 655 |
code/module that eventually sends the signal. Note that it is also the |
| 656 |
producer side which creates the condvar in most cases, but it isn't |
| 657 |
uncommon for the consumer to create it as well. |
| 658 |
|
| 659 |
$cv->send (...) |
| 660 |
Flag the condition as ready - a running "->recv" and all further |
| 661 |
calls to "recv" will (eventually) return after this method has been |
| 662 |
called. If nobody is waiting the send will be remembered. |
| 663 |
|
| 664 |
If a callback has been set on the condition variable, it is called |
| 665 |
immediately from within send. |
| 666 |
|
| 667 |
Any arguments passed to the "send" call will be returned by all |
| 668 |
future "->recv" calls. |
| 669 |
|
| 670 |
Condition variables are overloaded so one can call them directly (as |
| 671 |
if they were a code reference). Calling them directly is the same as |
| 672 |
calling "send". |
| 673 |
|
| 674 |
$cv->croak ($error) |
| 675 |
Similar to send, but causes all calls to "->recv" to invoke |
| 676 |
"Carp::croak" with the given error message/object/scalar. |
| 677 |
|
| 678 |
This can be used to signal any errors to the condition variable |
| 679 |
user/consumer. Doing it this way instead of calling "croak" directly |
| 680 |
delays the error detection, but has the overwhelming advantage that |
| 681 |
it diagnoses the error at the place where the result is expected, |
| 682 |
and not deep in some event callback with no connection to the actual |
| 683 |
code causing the problem. |
| 684 |
|
| 685 |
$cv->begin ([group callback]) |
| 686 |
$cv->end |
| 687 |
These two methods can be used to combine many transactions/events |
| 688 |
into one. For example, a function that pings many hosts in parallel |
| 689 |
might want to use a condition variable for the whole process. |
| 690 |
|
| 691 |
Every call to "->begin" will increment a counter, and every call to |
| 692 |
"->end" will decrement it. If the counter reaches 0 in "->end", the |
| 693 |
(last) callback passed to "begin" will be executed, passing the |
| 694 |
condvar as first argument. That callback is *supposed* to call |
| 695 |
"->send", but that is not required. If no group callback was set, |
| 696 |
"send" will be called without any arguments. |
| 697 |
|
| 698 |
You can think of "$cv->send" giving you an OR condition (one call |
| 699 |
sends), while "$cv->begin" and "$cv->end" giving you an AND |
| 700 |
condition (all "begin" calls must be "end"'ed before the condvar |
| 701 |
sends). |
| 702 |
|
| 703 |
Let's start with a simple example: you have two I/O watchers (for |
| 704 |
example, STDOUT and STDERR for a program), and you want to wait for |
| 705 |
both streams to close before activating a condvar: |
| 706 |
|
| 707 |
my $cv = AnyEvent->condvar; |
| 708 |
|
| 709 |
$cv->begin; # first watcher |
| 710 |
my $w1 = AnyEvent->io (fh => $fh1, cb => sub { |
| 711 |
defined sysread $fh1, my $buf, 4096 |
| 712 |
or $cv->end; |
| 713 |
}); |
| 714 |
|
| 715 |
$cv->begin; # second watcher |
| 716 |
my $w2 = AnyEvent->io (fh => $fh2, cb => sub { |
| 717 |
defined sysread $fh2, my $buf, 4096 |
| 718 |
or $cv->end; |
| 719 |
}); |
| 720 |
|
| 721 |
$cv->recv; |
| 722 |
|
| 723 |
This works because for every event source (EOF on file handle), |
| 724 |
there is one call to "begin", so the condvar waits for all calls to |
| 725 |
"end" before sending. |
| 726 |
|
| 727 |
The ping example mentioned above is slightly more complicated, as |
| 728 |
the there are results to be passed back, and the number of tasks |
| 729 |
that are begun can potentially be zero: |
| 730 |
|
| 731 |
my $cv = AnyEvent->condvar; |
| 732 |
|
| 733 |
my %result; |
| 734 |
$cv->begin (sub { shift->send (\%result) }); |
| 735 |
|
| 736 |
for my $host (@list_of_hosts) { |
| 737 |
$cv->begin; |
| 738 |
ping_host_then_call_callback $host, sub { |
| 739 |
$result{$host} = ...; |
| 740 |
$cv->end; |
| 741 |
}; |
| 742 |
} |
| 743 |
|
| 744 |
$cv->end; |
| 745 |
|
| 746 |
... |
| 747 |
|
| 748 |
my $results = $cv->recv; |
| 749 |
|
| 750 |
This code fragment supposedly pings a number of hosts and calls |
| 751 |
"send" after results for all then have have been gathered - in any |
| 752 |
order. To achieve this, the code issues a call to "begin" when it |
| 753 |
starts each ping request and calls "end" when it has received some |
| 754 |
result for it. Since "begin" and "end" only maintain a counter, the |
| 755 |
order in which results arrive is not relevant. |
| 756 |
|
| 757 |
There is an additional bracketing call to "begin" and "end" outside |
| 758 |
the loop, which serves two important purposes: first, it sets the |
| 759 |
callback to be called once the counter reaches 0, and second, it |
| 760 |
ensures that "send" is called even when "no" hosts are being pinged |
| 761 |
(the loop doesn't execute once). |
| 762 |
|
| 763 |
This is the general pattern when you "fan out" into multiple (but |
| 764 |
potentially zero) subrequests: use an outer "begin"/"end" pair to |
| 765 |
set the callback and ensure "end" is called at least once, and then, |
| 766 |
for each subrequest you start, call "begin" and for each subrequest |
| 767 |
you finish, call "end". |
| 768 |
|
| 769 |
METHODS FOR CONSUMERS |
| 770 |
These methods should only be used by the consuming side, i.e. the code |
| 771 |
awaits the condition. |
| 772 |
|
| 773 |
$cv->recv |
| 774 |
Wait (blocking if necessary) until the "->send" or "->croak" methods |
| 775 |
have been called on $cv, while servicing other watchers normally. |
| 776 |
|
| 777 |
You can only wait once on a condition - additional calls are valid |
| 778 |
but will return immediately. |
| 779 |
|
| 780 |
If an error condition has been set by calling "->croak", then this |
| 781 |
function will call "croak". |
| 782 |
|
| 783 |
In list context, all parameters passed to "send" will be returned, |
| 784 |
in scalar context only the first one will be returned. |
| 785 |
|
| 786 |
Note that doing a blocking wait in a callback is not supported by |
| 787 |
any event loop, that is, recursive invocation of a blocking "->recv" |
| 788 |
is not allowed and the "recv" call will "croak" if such a condition |
| 789 |
is detected. This requirement can be dropped by relying on |
| 790 |
Coro::AnyEvent , which allows you to do a blocking "->recv" from any |
| 791 |
thread that doesn't run the event loop itself. Coro::AnyEvent is |
| 792 |
loaded automatically when Coro is used with AnyEvent, so code does |
| 793 |
not need to do anything special to take advantage of that: any code |
| 794 |
that would normally block your program because it calls "recv", be |
| 795 |
executed in an "async" thread instead without blocking other |
| 796 |
threads. |
| 797 |
|
| 798 |
Not all event models support a blocking wait - some die in that case |
| 799 |
(programs might want to do that to stay interactive), so *if you are |
| 800 |
using this from a module, never require a blocking wait*. Instead, |
| 801 |
let the caller decide whether the call will block or not (for |
| 802 |
example, by coupling condition variables with some kind of request |
| 803 |
results and supporting callbacks so the caller knows that getting |
| 804 |
the result will not block, while still supporting blocking waits if |
| 805 |
the caller so desires). |
| 806 |
|
| 807 |
You can ensure that "->recv" never blocks by setting a callback and |
| 808 |
only calling "->recv" from within that callback (or at a later |
| 809 |
time). This will work even when the event loop does not support |
| 810 |
blocking waits otherwise. |
| 811 |
|
| 812 |
$bool = $cv->ready |
| 813 |
Returns true when the condition is "true", i.e. whether "send" or |
| 814 |
"croak" have been called. |
| 815 |
|
| 816 |
$cb = $cv->cb ($cb->($cv)) |
| 817 |
This is a mutator function that returns the callback set (or "undef" |
| 818 |
if not) and optionally replaces it before doing so. |
| 819 |
|
| 820 |
The callback will be called when the condition becomes "true", i.e. |
| 821 |
when "send" or "croak" are called, with the only argument being the |
| 822 |
condition variable itself. If the condition is already true, the |
| 823 |
callback is called immediately when it is set. Calling "recv" inside |
| 824 |
the callback or at any later time is guaranteed not to block. |
| 825 |
|
| 826 |
Additionally, when the callback is invoked, it is also removed from |
| 827 |
the condvar (reset to "undef"), so the condvar does not keep a |
| 828 |
reference to the callback after invocation. |
| 829 |
|
| 830 |
SUPPORTED EVENT LOOPS/BACKENDS |
| 831 |
The following backend classes are part of the AnyEvent distribution |
| 832 |
(every class has its own manpage): |
| 833 |
|
| 834 |
Backends that are autoprobed when no other event loop can be found. |
| 835 |
EV is the preferred backend when no other event loop seems to be in |
| 836 |
use. If EV is not installed, then AnyEvent will fall back to its own |
| 837 |
pure-perl implementation, which is available everywhere as it comes |
| 838 |
with AnyEvent itself. |
| 839 |
|
| 840 |
AnyEvent::Impl::EV based on EV (interface to libev, best choice). |
| 841 |
AnyEvent::Impl::Perl pure-perl AnyEvent::Loop, fast and portable. |
| 842 |
|
| 843 |
Backends that are transparently being picked up when they are used. |
| 844 |
These will be used if they are already loaded when the first watcher |
| 845 |
is created, in which case it is assumed that the application is |
| 846 |
using them. This means that AnyEvent will automatically pick the |
| 847 |
right backend when the main program loads an event module before |
| 848 |
anything starts to create watchers. Nothing special needs to be done |
| 849 |
by the main program. |
| 850 |
|
| 851 |
AnyEvent::Impl::Event based on Event, very stable, few glitches. |
| 852 |
AnyEvent::Impl::Glib based on Glib, slow but very stable. |
| 853 |
AnyEvent::Impl::Tk based on Tk, very broken. |
| 854 |
AnyEvent::Impl::UV based on UV, innovated square wheels. |
| 855 |
AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse. |
| 856 |
AnyEvent::Impl::POE based on POE, very slow, some limitations. |
| 857 |
AnyEvent::Impl::Irssi used when running within irssi. |
| 858 |
AnyEvent::Impl::IOAsync based on IO::Async. |
| 859 |
AnyEvent::Impl::Cocoa based on Cocoa::EventLoop. |
| 860 |
AnyEvent::Impl::FLTK based on FLTK (fltk 2 binding). |
| 861 |
|
| 862 |
Backends with special needs. |
| 863 |
Qt requires the Qt::Application to be instantiated first, but will |
| 864 |
otherwise be picked up automatically. As long as the main program |
| 865 |
instantiates the application before any AnyEvent watchers are |
| 866 |
created, everything should just work. |
| 867 |
|
| 868 |
AnyEvent::Impl::Qt based on Qt. |
| 869 |
|
| 870 |
Event loops that are indirectly supported via other backends. |
| 871 |
Some event loops can be supported via other modules: |
| 872 |
|
| 873 |
There is no direct support for WxWidgets (Wx) or Prima. |
| 874 |
|
| 875 |
WxWidgets has no support for watching file handles. However, you can |
| 876 |
use WxWidgets through the POE adaptor, as POE has a Wx backend that |
| 877 |
simply polls 20 times per second, which was considered to be too |
| 878 |
horrible to even consider for AnyEvent. |
| 879 |
|
| 880 |
Prima is not supported as nobody seems to be using it, but it has a |
| 881 |
POE backend, so it can be supported through POE. |
| 882 |
|
| 883 |
AnyEvent knows about both Prima and Wx, however, and will try to |
| 884 |
load POE when detecting them, in the hope that POE will pick them |
| 885 |
up, in which case everything will be automatic. |
| 886 |
|
| 887 |
Known event loops outside the AnyEvent distribution |
| 888 |
The following event loops or programs support AnyEvent by providing |
| 889 |
their own AnyEvent backend. They will be picked up automatically. |
| 890 |
|
| 891 |
urxvt::anyevent available to rxvt-unicode extensions |
| 892 |
|
| 893 |
GLOBAL VARIABLES AND FUNCTIONS |
| 894 |
These are not normally required to use AnyEvent, but can be useful to |
| 895 |
write AnyEvent extension modules. |
| 896 |
|
| 897 |
$AnyEvent::MODEL |
| 898 |
Contains "undef" until the first watcher is being created, before |
| 899 |
the backend has been autodetected. |
| 900 |
|
| 901 |
Afterwards it contains the event model that is being used, which is |
| 902 |
the name of the Perl class implementing the model. This class is |
| 903 |
usually one of the "AnyEvent::Impl::xxx" modules, but can be any |
| 904 |
other class in the case AnyEvent has been extended at runtime (e.g. |
| 905 |
in *rxvt-unicode* it will be "urxvt::anyevent"). |
| 906 |
|
| 907 |
AnyEvent::detect |
| 908 |
Returns $AnyEvent::MODEL, forcing autodetection of the event model |
| 909 |
if necessary. You should only call this function right before you |
| 910 |
would have created an AnyEvent watcher anyway, that is, as late as |
| 911 |
possible at runtime, and not e.g. during initialisation of your |
| 912 |
module. |
| 913 |
|
| 914 |
The effect of calling this function is as if a watcher had been |
| 915 |
created (specifically, actions that happen "when the first watcher |
| 916 |
is created" happen when calling detetc as well). |
| 917 |
|
| 918 |
If you need to do some initialisation before AnyEvent watchers are |
| 919 |
created, use "post_detect". |
| 920 |
|
| 921 |
$guard = AnyEvent::post_detect { BLOCK } |
| 922 |
Arranges for the code block to be executed as soon as the event |
| 923 |
model is autodetected (or immediately if that has already happened). |
| 924 |
|
| 925 |
The block will be executed *after* the actual backend has been |
| 926 |
detected ($AnyEvent::MODEL is set), so it is possible to do some |
| 927 |
initialisation only when AnyEvent is actually initialised - see the |
| 928 |
sources of AnyEvent::AIO to see how this is used. |
| 929 |
|
| 930 |
The most common usage is to create some global watchers, without |
| 931 |
forcing event module detection too early. For example, AnyEvent::AIO |
| 932 |
creates and installs the global IO::AIO watcher in a "post_detect" |
| 933 |
block to avoid autodetecting the event module at load time. |
| 934 |
|
| 935 |
If called in scalar or list context, then it creates and returns an |
| 936 |
object that automatically removes the callback again when it is |
| 937 |
destroyed (or "undef" when the hook was immediately executed). See |
| 938 |
AnyEvent::AIO for a case where this is useful. |
| 939 |
|
| 940 |
Example: Create a watcher for the IO::AIO module and store it in |
| 941 |
$WATCHER, but do so only do so after the event loop is initialised. |
| 942 |
|
| 943 |
our WATCHER; |
| 944 |
|
| 945 |
my $guard = AnyEvent::post_detect { |
| 946 |
$WATCHER = AnyEvent->io (fh => IO::AIO::poll_fileno, poll => 'r', cb => \&IO::AIO::poll_cb); |
| 947 |
}; |
| 948 |
|
| 949 |
# the ||= is important in case post_detect immediately runs the block, |
| 950 |
# as to not clobber the newly-created watcher. assigning both watcher and |
| 951 |
# post_detect guard to the same variable has the advantage of users being |
| 952 |
# able to just C<undef $WATCHER> if the watcher causes them grief. |
| 953 |
|
| 954 |
$WATCHER ||= $guard; |
| 955 |
|
| 956 |
@AnyEvent::post_detect |
| 957 |
This is a lower level interface then "AnyEvent::post_detect" (the |
| 958 |
function). This variable is mainly useful for modules that can do |
| 959 |
something useful when AnyEvent is used and thus want to know when it |
| 960 |
is initialised, but do not need to even load it by default. This |
| 961 |
array provides the means to hook into AnyEvent passively, without |
| 962 |
loading it. |
| 963 |
|
| 964 |
Here is how it works: If there are any code references in this array |
| 965 |
(you can "push" to it before or after loading AnyEvent), then they |
| 966 |
will be called directly after the event loop has been chosen. |
| 967 |
|
| 968 |
You should check $AnyEvent::MODEL before adding to this array, |
| 969 |
though: if it is defined then the event loop has already been |
| 970 |
detected, and the array will be ignored. |
| 971 |
|
| 972 |
Best use "AnyEvent::post_detect { BLOCK }" when your application |
| 973 |
allows it, as it takes care of these details. |
| 974 |
|
| 975 |
Example: To load Coro::AnyEvent whenever Coro and AnyEvent are used |
| 976 |
together, you could put this into Coro (this is the actual code used |
| 977 |
by Coro to accomplish this): |
| 978 |
|
| 979 |
if (defined $AnyEvent::MODEL) { |
| 980 |
# AnyEvent already initialised, so load Coro::AnyEvent |
| 981 |
require Coro::AnyEvent; |
| 982 |
} else { |
| 983 |
# AnyEvent not yet initialised, so make sure to load Coro::AnyEvent |
| 984 |
# as soon as it is |
| 985 |
push @AnyEvent::post_detect, sub { require Coro::AnyEvent }; |
| 986 |
} |
| 987 |
|
| 988 |
AnyEvent::postpone { BLOCK } |
| 989 |
Arranges for the block to be executed as soon as possible, but not |
| 990 |
before the call itself returns. In practise, the block will be |
| 991 |
executed just before the event loop polls for new events, or shortly |
| 992 |
afterwards. |
| 993 |
|
| 994 |
This function never returns anything (to make the "return postpone { |
| 995 |
... }" idiom more useful. |
| 996 |
|
| 997 |
To understand the usefulness of this function, consider a function |
| 998 |
that asynchronously does something for you and returns some |
| 999 |
transaction object or guard to let you cancel the operation. For |
| 1000 |
example, "AnyEvent::Socket::tcp_connect": |
| 1001 |
|
| 1002 |
# start a connection attempt unless one is active |
| 1003 |
$self->{connect_guard} ||= AnyEvent::Socket::tcp_connect "www.example.net", 80, sub { |
| 1004 |
delete $self->{connect_guard}; |
| 1005 |
... |
| 1006 |
}; |
| 1007 |
|
| 1008 |
Imagine that this function could instantly call the callback, for |
| 1009 |
example, because it detects an obvious error such as a negative port |
| 1010 |
number. Invoking the callback before the function returns causes |
| 1011 |
problems however: the callback will be called and will try to delete |
| 1012 |
the guard object. But since the function hasn't returned yet, there |
| 1013 |
is nothing to delete. When the function eventually returns it will |
| 1014 |
assign the guard object to "$self->{connect_guard}", where it will |
| 1015 |
likely never be deleted, so the program thinks it is still trying to |
| 1016 |
connect. |
| 1017 |
|
| 1018 |
This is where "AnyEvent::postpone" should be used. Instead of |
| 1019 |
calling the callback directly on error: |
| 1020 |
|
| 1021 |
$cb->(undef), return # signal error to callback, BAD! |
| 1022 |
if $some_error_condition; |
| 1023 |
|
| 1024 |
It should use "postpone": |
| 1025 |
|
| 1026 |
AnyEvent::postpone { $cb->(undef) }, return # signal error to callback, later |
| 1027 |
if $some_error_condition; |
| 1028 |
|
| 1029 |
AnyEvent::log $level, $msg[, @args] |
| 1030 |
Log the given $msg at the given $level. |
| 1031 |
|
| 1032 |
If AnyEvent::Log is not loaded then this function makes a simple |
| 1033 |
test to see whether the message will be logged. If the test succeeds |
| 1034 |
it will load AnyEvent::Log and call "AnyEvent::Log::log" - |
| 1035 |
consequently, look at the AnyEvent::Log documentation for details. |
| 1036 |
|
| 1037 |
If the test fails it will simply return. Right now this happens when |
| 1038 |
a numerical loglevel is used and it is larger than the level |
| 1039 |
specified via $ENV{PERL_ANYEVENT_VERBOSE}. |
| 1040 |
|
| 1041 |
If you want to sprinkle loads of logging calls around your code, |
| 1042 |
consider creating a logger callback with the "AnyEvent::Log::logger" |
| 1043 |
function, which can reduce typing, codesize and can reduce the |
| 1044 |
logging overhead enourmously. |
| 1045 |
|
| 1046 |
AnyEvent::fh_block $filehandle |
| 1047 |
AnyEvent::fh_unblock $filehandle |
| 1048 |
Sets blocking or non-blocking behaviour for the given filehandle. |
| 1049 |
|
| 1050 |
WHAT TO DO IN A MODULE |
| 1051 |
As a module author, you should "use AnyEvent" and call AnyEvent methods |
| 1052 |
freely, but you should not load a specific event module or rely on it. |
| 1053 |
|
| 1054 |
Be careful when you create watchers in the module body - AnyEvent will |
| 1055 |
decide which event module to use as soon as the first method is called, |
| 1056 |
so by calling AnyEvent in your module body you force the user of your |
| 1057 |
module to load the event module first. |
| 1058 |
|
| 1059 |
Never call "->recv" on a condition variable unless you *know* that the |
| 1060 |
"->send" method has been called on it already. This is because it will |
| 1061 |
stall the whole program, and the whole point of using events is to stay |
| 1062 |
interactive. |
| 1063 |
|
| 1064 |
It is fine, however, to call "->recv" when the user of your module |
| 1065 |
requests it (i.e. if you create a http request object ad have a method |
| 1066 |
called "results" that returns the results, it may call "->recv" freely, |
| 1067 |
as the user of your module knows what she is doing. Always). |
| 1068 |
|
| 1069 |
WHAT TO DO IN THE MAIN PROGRAM |
| 1070 |
There will always be a single main program - the only place that should |
| 1071 |
dictate which event model to use. |
| 1072 |
|
| 1073 |
If the program is not event-based, it need not do anything special, even |
| 1074 |
when it depends on a module that uses an AnyEvent. If the program itself |
| 1075 |
uses AnyEvent, but does not care which event loop is used, all it needs |
| 1076 |
to do is "use AnyEvent". In either case, AnyEvent will choose the best |
| 1077 |
available loop implementation. |
| 1078 |
|
| 1079 |
If the main program relies on a specific event model - for example, in |
| 1080 |
Gtk2 programs you have to rely on the Glib module - you should load the |
| 1081 |
event module before loading AnyEvent or any module that uses it: |
| 1082 |
generally speaking, you should load it as early as possible. The reason |
| 1083 |
is that modules might create watchers when they are loaded, and AnyEvent |
| 1084 |
will decide on the event model to use as soon as it creates watchers, |
| 1085 |
and it might choose the wrong one unless you load the correct one |
| 1086 |
yourself. |
| 1087 |
|
| 1088 |
You can chose to use a pure-perl implementation by loading the |
| 1089 |
"AnyEvent::Loop" module, which gives you similar behaviour everywhere, |
| 1090 |
but letting AnyEvent chose the model is generally better. |
| 1091 |
|
| 1092 |
MAINLOOP EMULATION |
| 1093 |
Sometimes (often for short test scripts, or even standalone programs who |
| 1094 |
only want to use AnyEvent), you do not want to run a specific event |
| 1095 |
loop. |
| 1096 |
|
| 1097 |
In that case, you can use a condition variable like this: |
| 1098 |
|
| 1099 |
AnyEvent->condvar->recv; |
| 1100 |
|
| 1101 |
This has the effect of entering the event loop and looping forever. |
| 1102 |
|
| 1103 |
Note that usually your program has some exit condition, in which case it |
| 1104 |
is better to use the "traditional" approach of storing a condition |
| 1105 |
variable somewhere, waiting for it, and sending it when the program |
| 1106 |
should exit cleanly. |
| 1107 |
|
| 1108 |
OTHER MODULES |
| 1109 |
The following is a non-exhaustive list of additional modules that use |
| 1110 |
AnyEvent as a client and can therefore be mixed easily with other |
| 1111 |
AnyEvent modules and other event loops in the same program. Some of the |
| 1112 |
modules come as part of AnyEvent, the others are available via CPAN (see |
| 1113 |
<http://search.cpan.org/search?m=module&q=anyevent%3A%3A*> for a longer |
| 1114 |
non-exhaustive list), and the list is heavily biased towards modules of |
| 1115 |
the AnyEvent author himself :) |
| 1116 |
|
| 1117 |
AnyEvent::Util (part of the AnyEvent distribution) |
| 1118 |
Contains various utility functions that replace often-used blocking |
| 1119 |
functions such as "inet_aton" with event/callback-based versions. |
| 1120 |
|
| 1121 |
AnyEvent::Socket (part of the AnyEvent distribution) |
| 1122 |
Provides various utility functions for (internet protocol) sockets, |
| 1123 |
addresses and name resolution. Also functions to create non-blocking |
| 1124 |
tcp connections or tcp servers, with IPv6 and SRV record support and |
| 1125 |
more. |
| 1126 |
|
| 1127 |
AnyEvent::Handle (part of the AnyEvent distribution) |
| 1128 |
Provide read and write buffers, manages watchers for reads and |
| 1129 |
writes, supports raw and formatted I/O, I/O queued and fully |
| 1130 |
transparent and non-blocking SSL/TLS (via AnyEvent::TLS). |
| 1131 |
|
| 1132 |
AnyEvent::DNS (part of the AnyEvent distribution) |
| 1133 |
Provides rich asynchronous DNS resolver capabilities. |
| 1134 |
|
| 1135 |
AnyEvent::HTTP, AnyEvent::IRC, AnyEvent::XMPP, AnyEvent::GPSD, |
| 1136 |
AnyEvent::IGS, AnyEvent::FCP |
| 1137 |
Implement event-based interfaces to the protocols of the same name |
| 1138 |
(for the curious, IGS is the International Go Server and FCP is the |
| 1139 |
Freenet Client Protocol). |
| 1140 |
|
| 1141 |
AnyEvent::AIO (part of the AnyEvent distribution) |
| 1142 |
Truly asynchronous (as opposed to non-blocking) I/O, should be in |
| 1143 |
the toolbox of every event programmer. AnyEvent::AIO transparently |
| 1144 |
fuses IO::AIO and AnyEvent together, giving AnyEvent access to |
| 1145 |
event-based file I/O, and much more. |
| 1146 |
|
| 1147 |
AnyEvent::Fork, AnyEvent::Fork::RPC, AnyEvent::Fork::Pool, |
| 1148 |
AnyEvent::Fork::Remote |
| 1149 |
These let you safely fork new subprocesses, either locally or |
| 1150 |
remotely (e.g.v ia ssh), using some RPC protocol or not, without the |
| 1151 |
limitations normally imposed by fork (AnyEvent works fine for |
| 1152 |
example). Dynamically-resized worker pools are obviously included as |
| 1153 |
well. |
| 1154 |
|
| 1155 |
And they are quite tiny and fast as well - "abusing" AnyEvent::Fork |
| 1156 |
just to exec external programs can easily beat using "fork" and |
| 1157 |
"exec" (or even "system") in most programs. |
| 1158 |
|
| 1159 |
AnyEvent::Filesys::Notify |
| 1160 |
AnyEvent is good for non-blocking stuff, but it can't detect file or |
| 1161 |
path changes (e.g. "watch this directory for new files", "watch this |
| 1162 |
file for changes"). The AnyEvent::Filesys::Notify module promises to |
| 1163 |
do just that in a portbale fashion, supporting inotify on GNU/Linux |
| 1164 |
and some weird, without doubt broken, stuff on OS X to monitor |
| 1165 |
files. It can fall back to blocking scans at regular intervals |
| 1166 |
transparently on other platforms, so it's about as portable as it |
| 1167 |
gets. |
| 1168 |
|
| 1169 |
(I haven't used it myself, but it seems the biggest problem with it |
| 1170 |
is it quite bad performance). |
| 1171 |
|
| 1172 |
AnyEvent::DBI |
| 1173 |
Executes DBI requests asynchronously in a proxy process for you, |
| 1174 |
notifying you in an event-based way when the operation is finished. |
| 1175 |
|
| 1176 |
AnyEvent::FastPing |
| 1177 |
The fastest ping in the west. |
| 1178 |
|
| 1179 |
Coro |
| 1180 |
Has special support for AnyEvent via Coro::AnyEvent, which allows |
| 1181 |
you to simply invert the flow control - don't call us, we will call |
| 1182 |
you: |
| 1183 |
|
| 1184 |
async { |
| 1185 |
Coro::AnyEvent::sleep 5; # creates a 5s timer and waits for it |
| 1186 |
print "5 seconds later!\n"; |
| 1187 |
|
| 1188 |
Coro::AnyEvent::readable *STDIN; # uses an I/O watcher |
| 1189 |
my $line = <STDIN>; # works for ttys |
| 1190 |
|
| 1191 |
AnyEvent::HTTP::http_get "url", Coro::rouse_cb; |
| 1192 |
my ($body, $hdr) = Coro::rouse_wait; |
| 1193 |
}; |
| 1194 |
|
| 1195 |
SIMPLIFIED AE API |
| 1196 |
Starting with version 5.0, AnyEvent officially supports a second, much |
| 1197 |
simpler, API that is designed to reduce the calling, typing and memory |
| 1198 |
overhead by using function call syntax and a fixed number of parameters. |
| 1199 |
|
| 1200 |
See the AE manpage for details. |
| 1201 |
|
| 1202 |
ERROR AND EXCEPTION HANDLING |
| 1203 |
In general, AnyEvent does not do any error handling - it relies on the |
| 1204 |
caller to do that if required. The AnyEvent::Strict module (see also the |
| 1205 |
"PERL_ANYEVENT_STRICT" environment variable, below) provides strict |
| 1206 |
checking of all AnyEvent methods, however, which is highly useful during |
| 1207 |
development. |
| 1208 |
|
| 1209 |
As for exception handling (i.e. runtime errors and exceptions thrown |
| 1210 |
while executing a callback), this is not only highly event-loop |
| 1211 |
specific, but also not in any way wrapped by this module, as this is the |
| 1212 |
job of the main program. |
| 1213 |
|
| 1214 |
The pure perl event loop simply re-throws the exception (usually within |
| 1215 |
"condvar->recv"), the Event and EV modules call "$Event/EV::DIED->()", |
| 1216 |
Glib uses "install_exception_handler" and so on. |
| 1217 |
|
| 1218 |
ENVIRONMENT VARIABLES |
| 1219 |
AnyEvent supports a number of environment variables that tune the |
| 1220 |
runtime behaviour. They are usually evaluated when AnyEvent is loaded, |
| 1221 |
initialised, or a submodule that uses them is loaded. Many of them also |
| 1222 |
cause AnyEvent to load additional modules - for example, |
| 1223 |
"PERL_ANYEVENT_DEBUG_WRAP" causes the AnyEvent::Debug module to be |
| 1224 |
loaded. |
| 1225 |
|
| 1226 |
All the environment variables documented here start with |
| 1227 |
"PERL_ANYEVENT_", which is what AnyEvent considers its own namespace. |
| 1228 |
Other modules are encouraged (but by no means required) to use |
| 1229 |
"PERL_ANYEVENT_SUBMODULE" if they have registered the |
| 1230 |
AnyEvent::Submodule namespace on CPAN, for any submodule. For example, |
| 1231 |
AnyEvent::HTTP could be expected to use "PERL_ANYEVENT_HTTP_PROXY" (it |
| 1232 |
should not access env variables starting with "AE_", see below). |
| 1233 |
|
| 1234 |
All variables can also be set via the "AE_" prefix, that is, instead of |
| 1235 |
setting "PERL_ANYEVENT_VERBOSE" you can also set "AE_VERBOSE". In case |
| 1236 |
there is a clash btween anyevent and another program that uses |
| 1237 |
"AE_something" you can set the corresponding "PERL_ANYEVENT_something" |
| 1238 |
variable to the empty string, as those variables take precedence. |
| 1239 |
|
| 1240 |
When AnyEvent is first loaded, it copies all "AE_xxx" env variables to |
| 1241 |
their "PERL_ANYEVENT_xxx" counterpart unless that variable already |
| 1242 |
exists. If taint mode is on, then AnyEvent will remove *all* environment |
| 1243 |
variables starting with "PERL_ANYEVENT_" from %ENV (or replace them with |
| 1244 |
"undef" or the empty string, if the corresaponding "AE_" variable is |
| 1245 |
set). |
| 1246 |
|
| 1247 |
The exact algorithm is currently: |
| 1248 |
|
| 1249 |
1. if taint mode enabled, delete all PERL_ANYEVENT_xyz variables from %ENV |
| 1250 |
2. copy over AE_xyz to PERL_ANYEVENT_xyz unless the latter alraedy exists |
| 1251 |
3. if taint mode enabled, set all PERL_ANYEVENT_xyz variables to undef. |
| 1252 |
|
| 1253 |
This ensures that child processes will not see the "AE_" variables. |
| 1254 |
|
| 1255 |
The following environment variables are currently known to AnyEvent: |
| 1256 |
|
| 1257 |
"PERL_ANYEVENT_VERBOSE" |
| 1258 |
By default, AnyEvent will log messages with loglevel 4 ("error") or |
| 1259 |
higher (see AnyEvent::Log). You can set this environment variable to |
| 1260 |
a numerical loglevel to make AnyEvent more (or less) talkative. |
| 1261 |
|
| 1262 |
If you want to do more than just set the global logging level you |
| 1263 |
should have a look at "PERL_ANYEVENT_LOG", which allows much more |
| 1264 |
complex specifications. |
| 1265 |
|
| 1266 |
When set to 0 ("off"), then no messages whatsoever will be logged |
| 1267 |
with everything else at defaults. |
| 1268 |
|
| 1269 |
When set to 5 or higher ("warn"), AnyEvent warns about unexpected |
| 1270 |
conditions, such as not being able to load the event model specified |
| 1271 |
by "PERL_ANYEVENT_MODEL", or a guard callback throwing an exception |
| 1272 |
- this is the minimum recommended level for use during development. |
| 1273 |
|
| 1274 |
When set to 7 or higher (info), AnyEvent reports which event model |
| 1275 |
it chooses. |
| 1276 |
|
| 1277 |
When set to 8 or higher (debug), then AnyEvent will report extra |
| 1278 |
information on which optional modules it loads and how it implements |
| 1279 |
certain features. |
| 1280 |
|
| 1281 |
"PERL_ANYEVENT_LOG" |
| 1282 |
Accepts rather complex logging specifications. For example, you |
| 1283 |
could log all "debug" messages of some module to stderr, warnings |
| 1284 |
and above to stderr, and errors and above to syslog, with: |
| 1285 |
|
| 1286 |
PERL_ANYEVENT_LOG=Some::Module=debug,+log:filter=warn,+%syslog:%syslog=error,syslog |
| 1287 |
|
| 1288 |
For the rather extensive details, see AnyEvent::Log. |
| 1289 |
|
| 1290 |
This variable is evaluated when AnyEvent (or AnyEvent::Log) is |
| 1291 |
loaded, so will take effect even before AnyEvent has initialised |
| 1292 |
itself. |
| 1293 |
|
| 1294 |
Note that specifying this environment variable causes the |
| 1295 |
AnyEvent::Log module to be loaded, while "PERL_ANYEVENT_VERBOSE" |
| 1296 |
does not, so only using the latter saves a few hundred kB of memory |
| 1297 |
unless a module explicitly needs the extra features of |
| 1298 |
AnyEvent::Log. |
| 1299 |
|
| 1300 |
"PERL_ANYEVENT_STRICT" |
| 1301 |
AnyEvent does not do much argument checking by default, as thorough |
| 1302 |
argument checking is very costly. Setting this variable to a true |
| 1303 |
value will cause AnyEvent to load "AnyEvent::Strict" and then to |
| 1304 |
thoroughly check the arguments passed to most method calls. If it |
| 1305 |
finds any problems, it will croak. |
| 1306 |
|
| 1307 |
In other words, enables "strict" mode. |
| 1308 |
|
| 1309 |
Unlike "use strict" (or its modern cousin, "use common::sense", it |
| 1310 |
is definitely recommended to keep it off in production. Keeping |
| 1311 |
"PERL_ANYEVENT_STRICT=1" in your environment while developing |
| 1312 |
programs can be very useful, however. |
| 1313 |
|
| 1314 |
"PERL_ANYEVENT_DEBUG_SHELL" |
| 1315 |
If this env variable is nonempty, then its contents will be |
| 1316 |
interpreted by "AnyEvent::Socket::parse_hostport" and |
| 1317 |
"AnyEvent::Debug::shell" (after replacing every occurance of $$ by |
| 1318 |
the process pid). The shell object is saved in |
| 1319 |
$AnyEvent::Debug::SHELL. |
| 1320 |
|
| 1321 |
This happens when the first watcher is created. |
| 1322 |
|
| 1323 |
For example, to bind a debug shell on a unix domain socket in |
| 1324 |
/tmp/debug<pid>.sock, you could use this: |
| 1325 |
|
| 1326 |
PERL_ANYEVENT_DEBUG_SHELL=/tmp/debug\$\$.sock perlprog |
| 1327 |
# connect with e.g.: socat readline /tmp/debug123.sock |
| 1328 |
|
| 1329 |
Or to bind to tcp port 4545 on localhost: |
| 1330 |
|
| 1331 |
PERL_ANYEVENT_DEBUG_SHELL=127.0.0.1:4545 perlprog |
| 1332 |
# connect with e.g.: telnet localhost 4545 |
| 1333 |
|
| 1334 |
Note that creating sockets in /tmp or on localhost is very unsafe on |
| 1335 |
multiuser systems. |
| 1336 |
|
| 1337 |
"PERL_ANYEVENT_DEBUG_WRAP" |
| 1338 |
Can be set to 0, 1 or 2 and enables wrapping of all watchers for |
| 1339 |
debugging purposes. See "AnyEvent::Debug::wrap" for details. |
| 1340 |
|
| 1341 |
"PERL_ANYEVENT_MODEL" |
| 1342 |
This can be used to specify the event model to be used by AnyEvent, |
| 1343 |
before auto detection and -probing kicks in. |
| 1344 |
|
| 1345 |
It normally is a string consisting entirely of ASCII letters (e.g. |
| 1346 |
"EV" or "IOAsync"). The string "AnyEvent::Impl::" gets prepended and |
| 1347 |
the resulting module name is loaded and - if the load was successful |
| 1348 |
- used as event model backend. If it fails to load then AnyEvent |
| 1349 |
will proceed with auto detection and -probing. |
| 1350 |
|
| 1351 |
If the string ends with "::" instead (e.g. "AnyEvent::Impl::EV::") |
| 1352 |
then nothing gets prepended and the module name is used as-is (hint: |
| 1353 |
"::" at the end of a string designates a module name and quotes it |
| 1354 |
appropriately). |
| 1355 |
|
| 1356 |
For example, to force the pure perl model (AnyEvent::Loop::Perl) you |
| 1357 |
could start your program like this: |
| 1358 |
|
| 1359 |
PERL_ANYEVENT_MODEL=Perl perl ... |
| 1360 |
|
| 1361 |
"PERL_ANYEVENT_IO_MODEL" |
| 1362 |
The current file I/O model - see AnyEvent::IO for more info. |
| 1363 |
|
| 1364 |
At the moment, only "Perl" (small, pure-perl, synchronous) and |
| 1365 |
"IOAIO" (truly asynchronous) are supported. The default is "IOAIO" |
| 1366 |
if AnyEvent::AIO can be loaded, otherwise it is "Perl". |
| 1367 |
|
| 1368 |
"PERL_ANYEVENT_PROTOCOLS" |
| 1369 |
Used by both AnyEvent::DNS and AnyEvent::Socket to determine |
| 1370 |
preferences for IPv4 or IPv6. The default is unspecified (and might |
| 1371 |
change, or be the result of auto probing). |
| 1372 |
|
| 1373 |
Must be set to a comma-separated list of protocols or address |
| 1374 |
families, current supported: "ipv4" and "ipv6". Only protocols |
| 1375 |
mentioned will be used, and preference will be given to protocols |
| 1376 |
mentioned earlier in the list. |
| 1377 |
|
| 1378 |
This variable can effectively be used for denial-of-service attacks |
| 1379 |
against local programs (e.g. when setuid), although the impact is |
| 1380 |
likely small, as the program has to handle connection and other |
| 1381 |
failures anyways. |
| 1382 |
|
| 1383 |
Examples: "PERL_ANYEVENT_PROTOCOLS=ipv4,ipv6" - prefer IPv4 over |
| 1384 |
IPv6, but support both and try to use both. |
| 1385 |
"PERL_ANYEVENT_PROTOCOLS=ipv4" - only support IPv4, never try to |
| 1386 |
resolve or contact IPv6 addresses. |
| 1387 |
"PERL_ANYEVENT_PROTOCOLS=ipv6,ipv4" support either IPv4 or IPv6, but |
| 1388 |
prefer IPv6 over IPv4. |
| 1389 |
|
| 1390 |
"PERL_ANYEVENT_HOSTS" |
| 1391 |
This variable, if specified, overrides the /etc/hosts file used by |
| 1392 |
AnyEvent::Socket"::resolve_sockaddr", i.e. hosts aliases will be |
| 1393 |
read from that file instead. |
| 1394 |
|
| 1395 |
"PERL_ANYEVENT_EDNS0" |
| 1396 |
Used by AnyEvent::DNS to decide whether to use the EDNS0 extension |
| 1397 |
for DNS. This extension is generally useful to reduce DNS traffic, |
| 1398 |
especially when DNSSEC is involved, but some (broken) firewalls drop |
| 1399 |
such DNS packets, which is why it is off by default. |
| 1400 |
|
| 1401 |
Setting this variable to 1 will cause AnyEvent::DNS to announce |
| 1402 |
EDNS0 in its DNS requests. |
| 1403 |
|
| 1404 |
"PERL_ANYEVENT_MAX_FORKS" |
| 1405 |
The maximum number of child processes that |
| 1406 |
"AnyEvent::Util::fork_call" will create in parallel. |
| 1407 |
|
| 1408 |
"PERL_ANYEVENT_MAX_OUTSTANDING_DNS" |
| 1409 |
The default value for the "max_outstanding" parameter for the |
| 1410 |
default DNS resolver - this is the maximum number of parallel DNS |
| 1411 |
requests that are sent to the DNS server. |
| 1412 |
|
| 1413 |
"PERL_ANYEVENT_MAX_SIGNAL_LATENCY" |
| 1414 |
Perl has inherently racy signal handling (you can basically choose |
| 1415 |
between losing signals and memory corruption) - pure perl event |
| 1416 |
loops (including "AnyEvent::Loop", when "Async::Interrupt" isn't |
| 1417 |
available) therefore have to poll regularly to avoid losing signals. |
| 1418 |
|
| 1419 |
Some event loops are racy, but don't poll regularly, and some event |
| 1420 |
loops are written in C but are still racy. For those event loops, |
| 1421 |
AnyEvent installs a timer that regularly wakes up the event loop. |
| 1422 |
|
| 1423 |
By default, the interval for this timer is 10 seconds, but you can |
| 1424 |
override this delay with this environment variable (or by setting |
| 1425 |
the $AnyEvent::MAX_SIGNAL_LATENCY variable before creating signal |
| 1426 |
watchers). |
| 1427 |
|
| 1428 |
Lower values increase CPU (and energy) usage, higher values can |
| 1429 |
introduce long delays when reaping children or waiting for signals. |
| 1430 |
|
| 1431 |
The AnyEvent::Async module, if available, will be used to avoid this |
| 1432 |
polling (with most event loops). |
| 1433 |
|
| 1434 |
"PERL_ANYEVENT_RESOLV_CONF" |
| 1435 |
The absolute path to a resolv.conf-style file to use instead of |
| 1436 |
/etc/resolv.conf (or the OS-specific configuration) in the default |
| 1437 |
resolver, or the empty string to select the default configuration. |
| 1438 |
|
| 1439 |
"PERL_ANYEVENT_CA_FILE", "PERL_ANYEVENT_CA_PATH". |
| 1440 |
When neither "ca_file" nor "ca_path" was specified during |
| 1441 |
AnyEvent::TLS context creation, and either of these environment |
| 1442 |
variables are nonempty, they will be used to specify CA certificate |
| 1443 |
locations instead of a system-dependent default. |
| 1444 |
|
| 1445 |
"PERL_ANYEVENT_AVOID_GUARD" and "PERL_ANYEVENT_AVOID_ASYNC_INTERRUPT" |
| 1446 |
When these are set to 1, then the respective modules are not loaded. |
| 1447 |
Mostly good for testing AnyEvent itself. |
| 1448 |
|
| 1449 |
SUPPLYING YOUR OWN EVENT MODEL INTERFACE |
| 1450 |
This is an advanced topic that you do not normally need to use AnyEvent |
| 1451 |
in a module. This section is only of use to event loop authors who want |
| 1452 |
to provide AnyEvent compatibility. |
| 1453 |
|
| 1454 |
If you need to support another event library which isn't directly |
| 1455 |
supported by AnyEvent, you can supply your own interface to it by |
| 1456 |
pushing, before the first watcher gets created, the package name of the |
| 1457 |
event module and the package name of the interface to use onto |
| 1458 |
@AnyEvent::REGISTRY. You can do that before and even without loading |
| 1459 |
AnyEvent, so it is reasonably cheap. |
| 1460 |
|
| 1461 |
Example: |
| 1462 |
|
| 1463 |
push @AnyEvent::REGISTRY, [urxvt => urxvt::anyevent::]; |
| 1464 |
|
| 1465 |
This tells AnyEvent to (literally) use the "urxvt::anyevent::" |
| 1466 |
package/class when it finds the "urxvt" package/module is already |
| 1467 |
loaded. |
| 1468 |
|
| 1469 |
When AnyEvent is loaded and asked to find a suitable event model, it |
| 1470 |
will first check for the presence of urxvt by trying to "use" the |
| 1471 |
"urxvt::anyevent" module. |
| 1472 |
|
| 1473 |
The class should provide implementations for all watcher types. See |
| 1474 |
AnyEvent::Impl::EV (source code), AnyEvent::Impl::Glib (Source code) and |
| 1475 |
so on for actual examples. Use "perldoc -m AnyEvent::Impl::Glib" to see |
| 1476 |
the sources. |
| 1477 |
|
| 1478 |
If you don't provide "signal" and "child" watchers than AnyEvent will |
| 1479 |
provide suitable (hopefully) replacements. |
| 1480 |
|
| 1481 |
The above example isn't fictitious, the *rxvt-unicode* (a.k.a. urxvt) |
| 1482 |
terminal emulator uses the above line as-is. An interface isn't included |
| 1483 |
in AnyEvent because it doesn't make sense outside the embedded |
| 1484 |
interpreter inside *rxvt-unicode*, and it is updated and maintained as |
| 1485 |
part of the *rxvt-unicode* distribution. |
| 1486 |
|
| 1487 |
*rxvt-unicode* also cheats a bit by not providing blocking access to |
| 1488 |
condition variables: code blocking while waiting for a condition will |
| 1489 |
"die". This still works with most modules/usages, and blocking calls |
| 1490 |
must not be done in an interactive application, so it makes sense. |
| 1491 |
|
| 1492 |
EXAMPLE PROGRAM |
| 1493 |
The following program uses an I/O watcher to read data from STDIN, a |
| 1494 |
timer to display a message once per second, and a condition variable to |
| 1495 |
quit the program when the user enters quit: |
| 1496 |
|
| 1497 |
use AnyEvent; |
| 1498 |
|
| 1499 |
my $cv = AnyEvent->condvar; |
| 1500 |
|
| 1501 |
my $io_watcher = AnyEvent->io ( |
| 1502 |
fh => \*STDIN, |
| 1503 |
poll => 'r', |
| 1504 |
cb => sub { |
| 1505 |
warn "io event <$_[0]>\n"; # will always output <r> |
| 1506 |
chomp (my $input = <STDIN>); # read a line |
| 1507 |
warn "read: $input\n"; # output what has been read |
| 1508 |
$cv->send if $input =~ /^q/i; # quit program if /^q/i |
| 1509 |
}, |
| 1510 |
); |
| 1511 |
|
| 1512 |
my $time_watcher = AnyEvent->timer (after => 1, interval => 1, cb => sub { |
| 1513 |
warn "timeout\n"; # print 'timeout' at most every second |
| 1514 |
}); |
| 1515 |
|
| 1516 |
$cv->recv; # wait until user enters /^q/i |
| 1517 |
|
| 1518 |
REAL-WORLD EXAMPLE |
| 1519 |
Consider the Net::FCP module. It features (among others) the following |
| 1520 |
API calls, which are to freenet what HTTP GET requests are to http: |
| 1521 |
|
| 1522 |
my $data = $fcp->client_get ($url); # blocks |
| 1523 |
|
| 1524 |
my $transaction = $fcp->txn_client_get ($url); # does not block |
| 1525 |
$transaction->cb ( sub { ... } ); # set optional result callback |
| 1526 |
my $data = $transaction->result; # possibly blocks |
| 1527 |
|
| 1528 |
The "client_get" method works like "LWP::Simple::get": it requests the |
| 1529 |
given URL and waits till the data has arrived. It is defined to be: |
| 1530 |
|
| 1531 |
sub client_get { $_[0]->txn_client_get ($_[1])->result } |
| 1532 |
|
| 1533 |
And in fact is automatically generated. This is the blocking API of |
| 1534 |
Net::FCP, and it works as simple as in any other, similar, module. |
| 1535 |
|
| 1536 |
More complicated is "txn_client_get": It only creates a transaction |
| 1537 |
(completion, result, ...) object and initiates the transaction. |
| 1538 |
|
| 1539 |
my $txn = bless { }, Net::FCP::Txn::; |
| 1540 |
|
| 1541 |
It also creates a condition variable that is used to signal the |
| 1542 |
completion of the request: |
| 1543 |
|
| 1544 |
$txn->{finished} = AnyAvent->condvar; |
| 1545 |
|
| 1546 |
It then creates a socket in non-blocking mode. |
| 1547 |
|
| 1548 |
socket $txn->{fh}, ...; |
| 1549 |
fcntl $txn->{fh}, F_SETFL, O_NONBLOCK; |
| 1550 |
connect $txn->{fh}, ... |
| 1551 |
and !$!{EWOULDBLOCK} |
| 1552 |
and !$!{EINPROGRESS} |
| 1553 |
and Carp::croak "unable to connect: $!\n"; |
| 1554 |
|
| 1555 |
Then it creates a write-watcher which gets called whenever an error |
| 1556 |
occurs or the connection succeeds: |
| 1557 |
|
| 1558 |
$txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'w', cb => sub { $txn->fh_ready_w }); |
| 1559 |
|
| 1560 |
And returns this transaction object. The "fh_ready_w" callback gets |
| 1561 |
called as soon as the event loop detects that the socket is ready for |
| 1562 |
writing. |
| 1563 |
|
| 1564 |
The "fh_ready_w" method makes the socket blocking again, writes the |
| 1565 |
request data and replaces the watcher by a read watcher (waiting for |
| 1566 |
reply data). The actual code is more complicated, but that doesn't |
| 1567 |
matter for this example: |
| 1568 |
|
| 1569 |
fcntl $txn->{fh}, F_SETFL, 0; |
| 1570 |
syswrite $txn->{fh}, $txn->{request} |
| 1571 |
or die "connection or write error"; |
| 1572 |
$txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'r', cb => sub { $txn->fh_ready_r }); |
| 1573 |
|
| 1574 |
Again, "fh_ready_r" waits till all data has arrived, and then stores the |
| 1575 |
result and signals any possible waiters that the request has finished: |
| 1576 |
|
| 1577 |
sysread $txn->{fh}, $txn->{buf}, length $txn->{$buf}; |
| 1578 |
|
| 1579 |
if (end-of-file or data complete) { |
| 1580 |
$txn->{result} = $txn->{buf}; |
| 1581 |
$txn->{finished}->send; |
| 1582 |
$txb->{cb}->($txn) of $txn->{cb}; # also call callback |
| 1583 |
} |
| 1584 |
|
| 1585 |
The "result" method, finally, just waits for the finished signal (if the |
| 1586 |
request was already finished, it doesn't wait, of course, and returns |
| 1587 |
the data: |
| 1588 |
|
| 1589 |
$txn->{finished}->recv; |
| 1590 |
return $txn->{result}; |
| 1591 |
|
| 1592 |
The actual code goes further and collects all errors ("die"s, |
| 1593 |
exceptions) that occurred during request processing. The "result" method |
| 1594 |
detects whether an exception as thrown (it is stored inside the $txn |
| 1595 |
object) and just throws the exception, which means connection errors and |
| 1596 |
other problems get reported to the code that tries to use the result, |
| 1597 |
not in a random callback. |
| 1598 |
|
| 1599 |
All of this enables the following usage styles: |
| 1600 |
|
| 1601 |
1. Blocking: |
| 1602 |
|
| 1603 |
my $data = $fcp->client_get ($url); |
| 1604 |
|
| 1605 |
2. Blocking, but running in parallel: |
| 1606 |
|
| 1607 |
my @datas = map $_->result, |
| 1608 |
map $fcp->txn_client_get ($_), |
| 1609 |
@urls; |
| 1610 |
|
| 1611 |
Both blocking examples work without the module user having to know |
| 1612 |
anything about events. |
| 1613 |
|
| 1614 |
3a. Event-based in a main program, using any supported event module: |
| 1615 |
|
| 1616 |
use EV; |
| 1617 |
|
| 1618 |
$fcp->txn_client_get ($url)->cb (sub { |
| 1619 |
my $txn = shift; |
| 1620 |
my $data = $txn->result; |
| 1621 |
... |
| 1622 |
}); |
| 1623 |
|
| 1624 |
EV::run; |
| 1625 |
|
| 1626 |
3b. The module user could use AnyEvent, too: |
| 1627 |
|
| 1628 |
use AnyEvent; |
| 1629 |
|
| 1630 |
my $quit = AnyEvent->condvar; |
| 1631 |
|
| 1632 |
$fcp->txn_client_get ($url)->cb (sub { |
| 1633 |
... |
| 1634 |
$quit->send; |
| 1635 |
}); |
| 1636 |
|
| 1637 |
$quit->recv; |
| 1638 |
|
| 1639 |
BENCHMARKS |
| 1640 |
To give you an idea of the performance and overheads that AnyEvent adds |
| 1641 |
over the event loops themselves and to give you an impression of the |
| 1642 |
speed of various event loops I prepared some benchmarks. |
| 1643 |
|
| 1644 |
BENCHMARKING ANYEVENT OVERHEAD |
| 1645 |
Here is a benchmark of various supported event models used natively and |
| 1646 |
through AnyEvent. The benchmark creates a lot of timers (with a zero |
| 1647 |
timeout) and I/O watchers (watching STDOUT, a pty, to become writable, |
| 1648 |
which it is), lets them fire exactly once and destroys them again. |
| 1649 |
|
| 1650 |
Source code for this benchmark is found as eg/bench in the AnyEvent |
| 1651 |
distribution. It uses the AE interface, which makes a real difference |
| 1652 |
for the EV and Perl backends only. |
| 1653 |
|
| 1654 |
Explanation of the columns |
| 1655 |
*watcher* is the number of event watchers created/destroyed. Since |
| 1656 |
different event models feature vastly different performances, each event |
| 1657 |
loop was given a number of watchers so that overall runtime is |
| 1658 |
acceptable and similar between tested event loop (and keep them from |
| 1659 |
crashing): Glib would probably take thousands of years if asked to |
| 1660 |
process the same number of watchers as EV in this benchmark. |
| 1661 |
|
| 1662 |
*bytes* is the number of bytes (as measured by the resident set size, |
| 1663 |
RSS) consumed by each watcher. This method of measuring captures both C |
| 1664 |
and Perl-based overheads. |
| 1665 |
|
| 1666 |
*create* is the time, in microseconds (millionths of seconds), that it |
| 1667 |
takes to create a single watcher. The callback is a closure shared |
| 1668 |
between all watchers, to avoid adding memory overhead. That means |
| 1669 |
closure creation and memory usage is not included in the figures. |
| 1670 |
|
| 1671 |
*invoke* is the time, in microseconds, used to invoke a simple callback. |
| 1672 |
The callback simply counts down a Perl variable and after it was invoked |
| 1673 |
"watcher" times, it would "->send" a condvar once to signal the end of |
| 1674 |
this phase. |
| 1675 |
|
| 1676 |
*destroy* is the time, in microseconds, that it takes to destroy a |
| 1677 |
single watcher. |
| 1678 |
|
| 1679 |
Results |
| 1680 |
name watchers bytes create invoke destroy comment |
| 1681 |
EV/EV 100000 223 0.47 0.43 0.27 EV native interface |
| 1682 |
EV/Any 100000 223 0.48 0.42 0.26 EV + AnyEvent watchers |
| 1683 |
Coro::EV/Any 100000 223 0.47 0.42 0.26 coroutines + Coro::Signal |
| 1684 |
Perl/Any 100000 431 2.70 0.74 0.92 pure perl implementation |
| 1685 |
Event/Event 16000 516 31.16 31.84 0.82 Event native interface |
| 1686 |
Event/Any 16000 1203 42.61 34.79 1.80 Event + AnyEvent watchers |
| 1687 |
IOAsync/Any 16000 1911 41.92 27.45 16.81 via IO::Async::Loop::IO_Poll |
| 1688 |
IOAsync/Any 16000 1726 40.69 26.37 15.25 via IO::Async::Loop::Epoll |
| 1689 |
Glib/Any 16000 1118 89.00 12.57 51.17 quadratic behaviour |
| 1690 |
Tk/Any 2000 1346 20.96 10.75 8.00 SEGV with >> 2000 watchers |
| 1691 |
POE/Any 2000 6951 108.97 795.32 14.24 via POE::Loop::Event |
| 1692 |
POE/Any 2000 6648 94.79 774.40 575.51 via POE::Loop::Select |
| 1693 |
|
| 1694 |
Discussion |
| 1695 |
The benchmark does *not* measure scalability of the event loop very |
| 1696 |
well. For example, a select-based event loop (such as the pure perl one) |
| 1697 |
can never compete with an event loop that uses epoll when the number of |
| 1698 |
file descriptors grows high. In this benchmark, all events become ready |
| 1699 |
at the same time, so select/poll-based implementations get an unnatural |
| 1700 |
speed boost. |
| 1701 |
|
| 1702 |
Also, note that the number of watchers usually has a nonlinear effect on |
| 1703 |
overall speed, that is, creating twice as many watchers doesn't take |
| 1704 |
twice the time - usually it takes longer. This puts event loops tested |
| 1705 |
with a higher number of watchers at a disadvantage. |
| 1706 |
|
| 1707 |
To put the range of results into perspective, consider that on the |
| 1708 |
benchmark machine, handling an event takes roughly 1600 CPU cycles with |
| 1709 |
EV, 3100 CPU cycles with AnyEvent's pure perl loop and almost 3000000 |
| 1710 |
CPU cycles with POE. |
| 1711 |
|
| 1712 |
"EV" is the sole leader regarding speed and memory use, which are both |
| 1713 |
maximal/minimal, respectively. When using the AE API there is zero |
| 1714 |
overhead (when going through the AnyEvent API create is about 5-6 times |
| 1715 |
slower, with other times being equal, so still uses far less memory than |
| 1716 |
any other event loop and is still faster than Event natively). |
| 1717 |
|
| 1718 |
The pure perl implementation is hit in a few sweet spots (both the |
| 1719 |
constant timeout and the use of a single fd hit optimisations in the |
| 1720 |
perl interpreter and the backend itself). Nevertheless this shows that |
| 1721 |
it adds very little overhead in itself. Like any select-based backend |
| 1722 |
its performance becomes really bad with lots of file descriptors (and |
| 1723 |
few of them active), of course, but this was not subject of this |
| 1724 |
benchmark. |
| 1725 |
|
| 1726 |
The "Event" module has a relatively high setup and callback invocation |
| 1727 |
cost, but overall scores in on the third place. |
| 1728 |
|
| 1729 |
"IO::Async" performs admirably well, about on par with "Event", even |
| 1730 |
when using its pure perl backend. |
| 1731 |
|
| 1732 |
"Glib"'s memory usage is quite a bit higher, but it features a faster |
| 1733 |
callback invocation and overall ends up in the same class as "Event". |
| 1734 |
However, Glib scales extremely badly, doubling the number of watchers |
| 1735 |
increases the processing time by more than a factor of four, making it |
| 1736 |
completely unusable when using larger numbers of watchers (note that |
| 1737 |
only a single file descriptor was used in the benchmark, so |
| 1738 |
inefficiencies of "poll" do not account for this). |
| 1739 |
|
| 1740 |
The "Tk" adaptor works relatively well. The fact that it crashes with |
| 1741 |
more than 2000 watchers is a big setback, however, as correctness takes |
| 1742 |
precedence over speed. Nevertheless, its performance is surprising, as |
| 1743 |
the file descriptor is dup()ed for each watcher. This shows that the |
| 1744 |
dup() employed by some adaptors is not a big performance issue (it does |
| 1745 |
incur a hidden memory cost inside the kernel which is not reflected in |
| 1746 |
the figures above). |
| 1747 |
|
| 1748 |
"POE", regardless of underlying event loop (whether using its pure perl |
| 1749 |
select-based backend or the Event module, the POE-EV backend couldn't be |
| 1750 |
tested because it wasn't working) shows abysmal performance and memory |
| 1751 |
usage with AnyEvent: Watchers use almost 30 times as much memory as EV |
| 1752 |
watchers, and 10 times as much memory as Event (the high memory |
| 1753 |
requirements are caused by requiring a session for each watcher). |
| 1754 |
Watcher invocation speed is almost 900 times slower than with AnyEvent's |
| 1755 |
pure perl implementation. |
| 1756 |
|
| 1757 |
The design of the POE adaptor class in AnyEvent can not really account |
| 1758 |
for the performance issues, though, as session creation overhead is |
| 1759 |
small compared to execution of the state machine, which is coded pretty |
| 1760 |
optimally within AnyEvent::Impl::POE (and while everybody agrees that |
| 1761 |
using multiple sessions is not a good approach, especially regarding |
| 1762 |
memory usage, even the author of POE could not come up with a faster |
| 1763 |
design). |
| 1764 |
|
| 1765 |
Summary |
| 1766 |
* Using EV through AnyEvent is faster than any other event loop (even |
| 1767 |
when used without AnyEvent), but most event loops have acceptable |
| 1768 |
performance with or without AnyEvent. |
| 1769 |
|
| 1770 |
* The overhead AnyEvent adds is usually much smaller than the overhead |
| 1771 |
of the actual event loop, only with extremely fast event loops such |
| 1772 |
as EV does AnyEvent add significant overhead. |
| 1773 |
|
| 1774 |
* You should avoid POE like the plague if you want performance or |
| 1775 |
reasonable memory usage. |
| 1776 |
|
| 1777 |
BENCHMARKING THE LARGE SERVER CASE |
| 1778 |
This benchmark actually benchmarks the event loop itself. It works by |
| 1779 |
creating a number of "servers": each server consists of a socket pair, a |
| 1780 |
timeout watcher that gets reset on activity (but never fires), and an |
| 1781 |
I/O watcher waiting for input on one side of the socket. Each time the |
| 1782 |
socket watcher reads a byte it will write that byte to a random other |
| 1783 |
"server". |
| 1784 |
|
| 1785 |
The effect is that there will be a lot of I/O watchers, only part of |
| 1786 |
which are active at any one point (so there is a constant number of |
| 1787 |
active fds for each loop iteration, but which fds these are is random). |
| 1788 |
The timeout is reset each time something is read because that reflects |
| 1789 |
how most timeouts work (and puts extra pressure on the event loops). |
| 1790 |
|
| 1791 |
In this benchmark, we use 10000 socket pairs (20000 sockets), of which |
| 1792 |
100 (1%) are active. This mirrors the activity of large servers with |
| 1793 |
many connections, most of which are idle at any one point in time. |
| 1794 |
|
| 1795 |
Source code for this benchmark is found as eg/bench2 in the AnyEvent |
| 1796 |
distribution. It uses the AE interface, which makes a real difference |
| 1797 |
for the EV and Perl backends only. |
| 1798 |
|
| 1799 |
Explanation of the columns |
| 1800 |
*sockets* is the number of sockets, and twice the number of "servers" |
| 1801 |
(as each server has a read and write socket end). |
| 1802 |
|
| 1803 |
*create* is the time it takes to create a socket pair (which is |
| 1804 |
nontrivial) and two watchers: an I/O watcher and a timeout watcher. |
| 1805 |
|
| 1806 |
*request*, the most important value, is the time it takes to handle a |
| 1807 |
single "request", that is, reading the token from the pipe and |
| 1808 |
forwarding it to another server. This includes deleting the old timeout |
| 1809 |
and creating a new one that moves the timeout into the future. |
| 1810 |
|
| 1811 |
Results |
| 1812 |
name sockets create request |
| 1813 |
EV 20000 62.66 7.99 |
| 1814 |
Perl 20000 68.32 32.64 |
| 1815 |
IOAsync 20000 174.06 101.15 epoll |
| 1816 |
IOAsync 20000 174.67 610.84 poll |
| 1817 |
Event 20000 202.69 242.91 |
| 1818 |
Glib 20000 557.01 1689.52 |
| 1819 |
POE 20000 341.54 12086.32 uses POE::Loop::Event |
| 1820 |
|
| 1821 |
Discussion |
| 1822 |
This benchmark *does* measure scalability and overall performance of the |
| 1823 |
particular event loop. |
| 1824 |
|
| 1825 |
EV is again fastest. Since it is using epoll on my system, the setup |
| 1826 |
time is relatively high, though. |
| 1827 |
|
| 1828 |
Perl surprisingly comes second. It is much faster than the C-based event |
| 1829 |
loops Event and Glib. |
| 1830 |
|
| 1831 |
IO::Async performs very well when using its epoll backend, and still |
| 1832 |
quite good compared to Glib when using its pure perl backend. |
| 1833 |
|
| 1834 |
Event suffers from high setup time as well (look at its code and you |
| 1835 |
will understand why). Callback invocation also has a high overhead |
| 1836 |
compared to the "$_->() for .."-style loop that the Perl event loop |
| 1837 |
uses. Event uses select or poll in basically all documented |
| 1838 |
configurations. |
| 1839 |
|
| 1840 |
Glib is hit hard by its quadratic behaviour w.r.t. many watchers. It |
| 1841 |
clearly fails to perform with many filehandles or in busy servers. |
| 1842 |
|
| 1843 |
POE is still completely out of the picture, taking over 1000 times as |
| 1844 |
long as EV, and over 100 times as long as the Perl implementation, even |
| 1845 |
though it uses a C-based event loop in this case. |
| 1846 |
|
| 1847 |
Summary |
| 1848 |
* The pure perl implementation performs extremely well. |
| 1849 |
|
| 1850 |
* Avoid Glib or POE in large projects where performance matters. |
| 1851 |
|
| 1852 |
BENCHMARKING SMALL SERVERS |
| 1853 |
While event loops should scale (and select-based ones do not...) even to |
| 1854 |
large servers, most programs we (or I :) actually write have only a few |
| 1855 |
I/O watchers. |
| 1856 |
|
| 1857 |
In this benchmark, I use the same benchmark program as in the large |
| 1858 |
server case, but it uses only eight "servers", of which three are active |
| 1859 |
at any one time. This should reflect performance for a small server |
| 1860 |
relatively well. |
| 1861 |
|
| 1862 |
The columns are identical to the previous table. |
| 1863 |
|
| 1864 |
Results |
| 1865 |
name sockets create request |
| 1866 |
EV 16 20.00 6.54 |
| 1867 |
Perl 16 25.75 12.62 |
| 1868 |
Event 16 81.27 35.86 |
| 1869 |
Glib 16 32.63 15.48 |
| 1870 |
POE 16 261.87 276.28 uses POE::Loop::Event |
| 1871 |
|
| 1872 |
Discussion |
| 1873 |
The benchmark tries to test the performance of a typical small server. |
| 1874 |
While knowing how various event loops perform is interesting, keep in |
| 1875 |
mind that their overhead in this case is usually not as important, due |
| 1876 |
to the small absolute number of watchers (that is, you need efficiency |
| 1877 |
and speed most when you have lots of watchers, not when you only have a |
| 1878 |
few of them). |
| 1879 |
|
| 1880 |
EV is again fastest. |
| 1881 |
|
| 1882 |
Perl again comes second. It is noticeably faster than the C-based event |
| 1883 |
loops Event and Glib, although the difference is too small to really |
| 1884 |
matter. |
| 1885 |
|
| 1886 |
POE also performs much better in this case, but is is still far behind |
| 1887 |
the others. |
| 1888 |
|
| 1889 |
Summary |
| 1890 |
* C-based event loops perform very well with small number of watchers, |
| 1891 |
as the management overhead dominates. |
| 1892 |
|
| 1893 |
THE IO::Lambda BENCHMARK |
| 1894 |
Recently I was told about the benchmark in the IO::Lambda manpage, which |
| 1895 |
could be misinterpreted to make AnyEvent look bad. In fact, the |
| 1896 |
benchmark simply compares IO::Lambda with POE, and IO::Lambda looks |
| 1897 |
better (which shouldn't come as a surprise to anybody). As such, the |
| 1898 |
benchmark is fine, and mostly shows that the AnyEvent backend from |
| 1899 |
IO::Lambda isn't very optimal. But how would AnyEvent compare when used |
| 1900 |
without the extra baggage? To explore this, I wrote the equivalent |
| 1901 |
benchmark for AnyEvent. |
| 1902 |
|
| 1903 |
The benchmark itself creates an echo-server, and then, for 500 times, |
| 1904 |
connects to the echo server, sends a line, waits for the reply, and then |
| 1905 |
creates the next connection. This is a rather bad benchmark, as it |
| 1906 |
doesn't test the efficiency of the framework or much non-blocking I/O, |
| 1907 |
but it is a benchmark nevertheless. |
| 1908 |
|
| 1909 |
name runtime |
| 1910 |
Lambda/select 0.330 sec |
| 1911 |
+ optimized 0.122 sec |
| 1912 |
Lambda/AnyEvent 0.327 sec |
| 1913 |
+ optimized 0.138 sec |
| 1914 |
Raw sockets/select 0.077 sec |
| 1915 |
POE/select, components 0.662 sec |
| 1916 |
POE/select, raw sockets 0.226 sec |
| 1917 |
POE/select, optimized 0.404 sec |
| 1918 |
|
| 1919 |
AnyEvent/select/nb 0.085 sec |
| 1920 |
AnyEvent/EV/nb 0.068 sec |
| 1921 |
+state machine 0.134 sec |
| 1922 |
|
| 1923 |
The benchmark is also a bit unfair (my fault): the IO::Lambda/POE |
| 1924 |
benchmarks actually make blocking connects and use 100% blocking I/O, |
| 1925 |
defeating the purpose of an event-based solution. All of the newly |
| 1926 |
written AnyEvent benchmarks use 100% non-blocking connects (using |
| 1927 |
AnyEvent::Socket::tcp_connect and the asynchronous pure perl DNS |
| 1928 |
resolver), so AnyEvent is at a disadvantage here, as non-blocking |
| 1929 |
connects generally require a lot more bookkeeping and event handling |
| 1930 |
than blocking connects (which involve a single syscall only). |
| 1931 |
|
| 1932 |
The last AnyEvent benchmark additionally uses AnyEvent::Handle, which |
| 1933 |
offers similar expressive power as POE and IO::Lambda, using |
| 1934 |
conventional Perl syntax. This means that both the echo server and the |
| 1935 |
client are 100% non-blocking, further placing it at a disadvantage. |
| 1936 |
|
| 1937 |
As you can see, the AnyEvent + EV combination even beats the |
| 1938 |
hand-optimised "raw sockets benchmark", while AnyEvent + its pure perl |
| 1939 |
backend easily beats IO::Lambda and POE. |
| 1940 |
|
| 1941 |
And even the 100% non-blocking version written using the high-level (and |
| 1942 |
slow :) AnyEvent::Handle abstraction beats both POE and IO::Lambda |
| 1943 |
higher level ("unoptimised") abstractions by a large margin, even though |
| 1944 |
it does all of DNS, tcp-connect and socket I/O in a non-blocking way. |
| 1945 |
|
| 1946 |
The two AnyEvent benchmarks programs can be found as eg/ae0.pl and |
| 1947 |
eg/ae2.pl in the AnyEvent distribution, the remaining benchmarks are |
| 1948 |
part of the IO::Lambda distribution and were used without any changes. |
| 1949 |
|
| 1950 |
SIGNALS |
| 1951 |
AnyEvent currently installs handlers for these signals: |
| 1952 |
|
| 1953 |
SIGCHLD |
| 1954 |
A handler for "SIGCHLD" is installed by AnyEvent's child watcher |
| 1955 |
emulation for event loops that do not support them natively. Also, |
| 1956 |
some event loops install a similar handler. |
| 1957 |
|
| 1958 |
Additionally, when AnyEvent is loaded and SIGCHLD is set to IGNORE, |
| 1959 |
then AnyEvent will reset it to default, to avoid losing child exit |
| 1960 |
statuses. |
| 1961 |
|
| 1962 |
SIGPIPE |
| 1963 |
A no-op handler is installed for "SIGPIPE" when $SIG{PIPE} is |
| 1964 |
"undef" when AnyEvent gets loaded. |
| 1965 |
|
| 1966 |
The rationale for this is that AnyEvent users usually do not really |
| 1967 |
depend on SIGPIPE delivery (which is purely an optimisation for |
| 1968 |
shell use, or badly-written programs), but "SIGPIPE" can cause |
| 1969 |
spurious and rare program exits as a lot of people do not expect |
| 1970 |
"SIGPIPE" when writing to some random socket. |
| 1971 |
|
| 1972 |
The rationale for installing a no-op handler as opposed to ignoring |
| 1973 |
it is that this way, the handler will be restored to defaults on |
| 1974 |
exec. |
| 1975 |
|
| 1976 |
Feel free to install your own handler, or reset it to defaults. |
| 1977 |
|
| 1978 |
RECOMMENDED/OPTIONAL MODULES |
| 1979 |
One of AnyEvent's main goals is to be 100% Pure-Perl(tm): only perl (and |
| 1980 |
its built-in modules) are required to use it. |
| 1981 |
|
| 1982 |
That does not mean that AnyEvent won't take advantage of some additional |
| 1983 |
modules if they are installed. |
| 1984 |
|
| 1985 |
This section explains which additional modules will be used, and how |
| 1986 |
they affect AnyEvent's operation. |
| 1987 |
|
| 1988 |
Async::Interrupt |
| 1989 |
This slightly arcane module is used to implement fast signal |
| 1990 |
handling: To my knowledge, there is no way to do completely |
| 1991 |
race-free and quick signal handling in pure perl. To ensure that |
| 1992 |
signals still get delivered, AnyEvent will start an interval timer |
| 1993 |
to wake up perl (and catch the signals) with some delay (default is |
| 1994 |
10 seconds, look for $AnyEvent::MAX_SIGNAL_LATENCY). |
| 1995 |
|
| 1996 |
If this module is available, then it will be used to implement |
| 1997 |
signal catching, which means that signals will not be delayed, and |
| 1998 |
the event loop will not be interrupted regularly, which is more |
| 1999 |
efficient (and good for battery life on laptops). |
| 2000 |
|
| 2001 |
This affects not just the pure-perl event loop, but also other event |
| 2002 |
loops that have no signal handling on their own (e.g. Glib, Tk, Qt). |
| 2003 |
|
| 2004 |
Some event loops (POE, Event, Event::Lib) offer signal watchers |
| 2005 |
natively, and either employ their own workarounds (POE) or use |
| 2006 |
AnyEvent's workaround (using $AnyEvent::MAX_SIGNAL_LATENCY). |
| 2007 |
Installing Async::Interrupt does nothing for those backends. |
| 2008 |
|
| 2009 |
EV This module isn't really "optional", as it is simply one of the |
| 2010 |
backend event loops that AnyEvent can use. However, it is simply the |
| 2011 |
best event loop available in terms of features, speed and stability: |
| 2012 |
It supports the AnyEvent API optimally, implements all the watcher |
| 2013 |
types in XS, does automatic timer adjustments even when no monotonic |
| 2014 |
clock is available, can take avdantage of advanced kernel interfaces |
| 2015 |
such as "epoll" and "kqueue", and is the fastest backend *by far*. |
| 2016 |
You can even embed Glib/Gtk2 in it (or vice versa, see EV::Glib and |
| 2017 |
Glib::EV). |
| 2018 |
|
| 2019 |
If you only use backends that rely on another event loop (e.g. |
| 2020 |
"Tk"), then this module will do nothing for you. |
| 2021 |
|
| 2022 |
Guard |
| 2023 |
The guard module, when used, will be used to implement |
| 2024 |
"AnyEvent::Util::guard". This speeds up guards considerably (and |
| 2025 |
uses a lot less memory), but otherwise doesn't affect guard |
| 2026 |
operation much. It is purely used for performance. |
| 2027 |
|
| 2028 |
JSON and JSON::XS |
| 2029 |
One of these modules is required when you want to read or write JSON |
| 2030 |
data via AnyEvent::Handle. JSON is also written in pure-perl, but |
| 2031 |
can take advantage of the ultra-high-speed JSON::XS module when it |
| 2032 |
is installed. |
| 2033 |
|
| 2034 |
Net::SSLeay |
| 2035 |
Implementing TLS/SSL in Perl is certainly interesting, but not very |
| 2036 |
worthwhile: If this module is installed, then AnyEvent::Handle (with |
| 2037 |
the help of AnyEvent::TLS), gains the ability to do TLS/SSL. |
| 2038 |
|
| 2039 |
Time::HiRes |
| 2040 |
This module is part of perl since release 5.008. It will be used |
| 2041 |
when the chosen event library does not come with a timing source of |
| 2042 |
its own. The pure-perl event loop (AnyEvent::Loop) will additionally |
| 2043 |
load it to try to use a monotonic clock for timing stability. |
| 2044 |
|
| 2045 |
AnyEvent::AIO (and IO::AIO) |
| 2046 |
The default implementation of AnyEvent::IO is to do I/O |
| 2047 |
synchronously, stopping programs while they access the disk, which |
| 2048 |
is fine for a lot of programs. |
| 2049 |
|
| 2050 |
Installing AnyEvent::AIO (and its IO::AIO dependency) makes it |
| 2051 |
switch to a true asynchronous implementation, so event processing |
| 2052 |
can continue even while waiting for disk I/O. |
| 2053 |
|
| 2054 |
FORK |
| 2055 |
Most event libraries are not fork-safe. The ones who are usually are |
| 2056 |
because they rely on inefficient but fork-safe "select" or "poll" calls |
| 2057 |
- higher performance APIs such as BSD's kqueue or the dreaded Linux |
| 2058 |
epoll are usually badly thought-out hacks that are incompatible with |
| 2059 |
fork in one way or another. Only EV is fully fork-aware and ensures that |
| 2060 |
you continue event-processing in both parent and child (or both, if you |
| 2061 |
know what you are doing). |
| 2062 |
|
| 2063 |
This means that, in general, you cannot fork and do event processing in |
| 2064 |
the child if the event library was initialised before the fork (which |
| 2065 |
usually happens when the first AnyEvent watcher is created, or the |
| 2066 |
library is loaded). |
| 2067 |
|
| 2068 |
If you have to fork, you must either do so *before* creating your first |
| 2069 |
watcher OR you must not use AnyEvent at all in the child OR you must do |
| 2070 |
something completely out of the scope of AnyEvent (see below). |
| 2071 |
|
| 2072 |
The problem of doing event processing in the parent *and* the child is |
| 2073 |
much more complicated: even for backends that *are* fork-aware or |
| 2074 |
fork-safe, their behaviour is not usually what you want: fork clones all |
| 2075 |
watchers, that means all timers, I/O watchers etc. are active in both |
| 2076 |
parent and child, which is almost never what you want. Using "exec" to |
| 2077 |
start worker children from some kind of manage prrocess is usually |
| 2078 |
preferred, because it is much easier and cleaner, at the expense of |
| 2079 |
having to have another binary. |
| 2080 |
|
| 2081 |
In addition to logical problems with fork, there are also implementation |
| 2082 |
problems. For example, on POSIX systems, you cannot fork at all in Perl |
| 2083 |
code if a thread (I am talking of pthreads here) was ever created in the |
| 2084 |
process, and this is just the tip of the iceberg. In general, using fork |
| 2085 |
from Perl is difficult, and attempting to use fork without an exec to |
| 2086 |
implement some kind of parallel processing is almost certainly doomed. |
| 2087 |
|
| 2088 |
To safely fork and exec, you should use a module such as Proc::FastSpawn |
| 2089 |
that let's you safely fork and exec new processes. |
| 2090 |
|
| 2091 |
If you want to do multiprocessing using processes, you can look at the |
| 2092 |
AnyEvent::Fork module (and some related modules such as |
| 2093 |
AnyEvent::Fork::RPC, AnyEvent::Fork::Pool and AnyEvent::Fork::Remote). |
| 2094 |
This module allows you to safely create subprocesses without any |
| 2095 |
limitations - you can use X11 toolkits or AnyEvent in the children |
| 2096 |
created by AnyEvent::Fork safely and without any special precautions. |
| 2097 |
|
| 2098 |
SECURITY CONSIDERATIONS |
| 2099 |
AnyEvent can be forced to load any event model via |
| 2100 |
$ENV{PERL_ANYEVENT_MODEL}. While this cannot (to my knowledge) be used |
| 2101 |
to execute arbitrary code or directly gain access, it can easily be used |
| 2102 |
to make the program hang or malfunction in subtle ways, as AnyEvent |
| 2103 |
watchers will not be active when the program uses a different event |
| 2104 |
model than specified in the variable. |
| 2105 |
|
| 2106 |
You can make AnyEvent completely ignore this variable by deleting it |
| 2107 |
before the first watcher gets created, e.g. with a "BEGIN" block: |
| 2108 |
|
| 2109 |
BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} } |
| 2110 |
|
| 2111 |
use AnyEvent; |
| 2112 |
|
| 2113 |
Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can |
| 2114 |
be used to probe what backend is used and gain other information (which |
| 2115 |
is probably even less useful to an attacker than PERL_ANYEVENT_MODEL), |
| 2116 |
and $ENV{PERL_ANYEVENT_STRICT}. |
| 2117 |
|
| 2118 |
Note that AnyEvent will remove *all* environment variables starting with |
| 2119 |
"PERL_ANYEVENT_" from %ENV when it is loaded while taint mode is |
| 2120 |
enabled. |
| 2121 |
|
| 2122 |
BUGS |
| 2123 |
Perl 5.8 has numerous memleaks that sometimes hit this module and are |
| 2124 |
hard to work around. If you suffer from memleaks, first upgrade to Perl |
| 2125 |
5.10 and check wether the leaks still show up. (Perl 5.10.0 has other |
| 2126 |
annoying memleaks, such as leaking on "map" and "grep" but it is usually |
| 2127 |
not as pronounced). |
| 2128 |
|
| 2129 |
SEE ALSO |
| 2130 |
Tutorial/Introduction: AnyEvent::Intro. |
| 2131 |
|
| 2132 |
FAQ: AnyEvent::FAQ. |
| 2133 |
|
| 2134 |
Utility functions: AnyEvent::Util (misc. grab-bag), AnyEvent::Log |
| 2135 |
(simply logging). |
| 2136 |
|
| 2137 |
Development/Debugging: AnyEvent::Strict (stricter checking), |
| 2138 |
AnyEvent::Debug (interactive shell, watcher tracing). |
| 2139 |
|
| 2140 |
Supported event modules: AnyEvent::Loop, EV, EV::Glib, Glib::EV, Event, |
| 2141 |
Glib::Event, Glib, Tk, Event::Lib, Qt, POE, FLTK, Cocoa::EventLoop, UV. |
| 2142 |
|
| 2143 |
Implementations: AnyEvent::Impl::EV, AnyEvent::Impl::Event, |
| 2144 |
AnyEvent::Impl::Glib, AnyEvent::Impl::Tk, AnyEvent::Impl::Perl, |
| 2145 |
AnyEvent::Impl::EventLib, AnyEvent::Impl::Qt, AnyEvent::Impl::POE, |
| 2146 |
AnyEvent::Impl::IOAsync, AnyEvent::Impl::Irssi, AnyEvent::Impl::FLTK, |
| 2147 |
AnyEvent::Impl::Cocoa, AnyEvent::Impl::UV. |
| 2148 |
|
| 2149 |
Non-blocking handles, pipes, stream sockets, TCP clients and servers: |
| 2150 |
AnyEvent::Handle, AnyEvent::Socket, AnyEvent::TLS. |
| 2151 |
|
| 2152 |
Asynchronous File I/O: AnyEvent::IO. |
| 2153 |
|
| 2154 |
Asynchronous DNS: AnyEvent::DNS. |
| 2155 |
|
| 2156 |
Thread support: Coro, Coro::AnyEvent, Coro::EV, Coro::Event. |
| 2157 |
|
| 2158 |
Nontrivial usage examples: AnyEvent::GPSD, AnyEvent::IRC, |
| 2159 |
AnyEvent::HTTP. |
| 2160 |
|
| 2161 |
AUTHOR |
| 2162 |
Marc Lehmann <schmorp@schmorp.de> |
| 2163 |
http://anyevent.schmorp.de |
| 2164 |
|