ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/README
Revision: 1.70
Committed: Fri Apr 13 09:57:41 2012 UTC (12 years, 1 month ago) by root
Branch: MAIN
CVS Tags: rel-7_01, rel-7_02, rel-7_03, rel-7_0, rel-7_04
Changes since 1.69: +23 -14 lines
Log Message:
7.0

File Contents

# Content
1 NAME
2 AnyEvent - the DBI of event loop programming
3
4 EV, Event, Glib, Tk, Perl, Event::Lib, Irssi, rxvt-unicode, IO::Async,
5 Qt, FLTK and POE are various supported event loops/environments.
6
7 SYNOPSIS
8 use AnyEvent;
9
10 # if you prefer function calls, look at the AE manpage for
11 # an alternative API.
12
13 # file handle or descriptor readable
14 my $w = AnyEvent->io (fh => $fh, poll => "r", cb => sub { ... });
15
16 # one-shot or repeating timers
17 my $w = AnyEvent->timer (after => $seconds, cb => sub { ... });
18 my $w = AnyEvent->timer (after => $seconds, interval => $seconds, cb => ...);
19
20 print AnyEvent->now; # prints current event loop time
21 print AnyEvent->time; # think Time::HiRes::time or simply CORE::time.
22
23 # POSIX signal
24 my $w = AnyEvent->signal (signal => "TERM", cb => sub { ... });
25
26 # child process exit
27 my $w = AnyEvent->child (pid => $pid, cb => sub {
28 my ($pid, $status) = @_;
29 ...
30 });
31
32 # called when event loop idle (if applicable)
33 my $w = AnyEvent->idle (cb => sub { ... });
34
35 my $w = AnyEvent->condvar; # stores whether a condition was flagged
36 $w->send; # wake up current and all future recv's
37 $w->recv; # enters "main loop" till $condvar gets ->send
38 # use a condvar in callback mode:
39 $w->cb (sub { $_[0]->recv });
40
41 INTRODUCTION/TUTORIAL
42 This manpage is mainly a reference manual. If you are interested in a
43 tutorial or some gentle introduction, have a look at the AnyEvent::Intro
44 manpage.
45
46 SUPPORT
47 An FAQ document is available as AnyEvent::FAQ.
48
49 There also is a mailinglist for discussing all things AnyEvent, and an
50 IRC channel, too.
51
52 See the AnyEvent project page at the Schmorpforge Ta-Sa Software
53 Repository, at <http://anyevent.schmorp.de>, for more info.
54
55 WHY YOU SHOULD USE THIS MODULE (OR NOT)
56 Glib, POE, IO::Async, Event... CPAN offers event models by the dozen
57 nowadays. So what is different about AnyEvent?
58
59 Executive Summary: AnyEvent is *compatible*, AnyEvent is *free of
60 policy* and AnyEvent is *small and efficient*.
61
62 First and foremost, *AnyEvent is not an event model* itself, it only
63 interfaces to whatever event model the main program happens to use, in a
64 pragmatic way. For event models and certain classes of immortals alike,
65 the statement "there can only be one" is a bitter reality: In general,
66 only one event loop can be active at the same time in a process.
67 AnyEvent cannot change this, but it can hide the differences between
68 those event loops.
69
70 The goal of AnyEvent is to offer module authors the ability to do event
71 programming (waiting for I/O or timer events) without subscribing to a
72 religion, a way of living, and most importantly: without forcing your
73 module users into the same thing by forcing them to use the same event
74 model you use.
75
76 For modules like POE or IO::Async (which is a total misnomer as it is
77 actually doing all I/O *synchronously*...), using them in your module is
78 like joining a cult: After you join, you are dependent on them and you
79 cannot use anything else, as they are simply incompatible to everything
80 that isn't them. What's worse, all the potential users of your module
81 are *also* forced to use the same event loop you use.
82
83 AnyEvent is different: AnyEvent + POE works fine. AnyEvent + Glib works
84 fine. AnyEvent + Tk works fine etc. etc. but none of these work together
85 with the rest: POE + EV? No go. Tk + Event? No go. Again: if your module
86 uses one of those, every user of your module has to use it, too. But if
87 your module uses AnyEvent, it works transparently with all event models
88 it supports (including stuff like IO::Async, as long as those use one of
89 the supported event loops. It is easy to add new event loops to
90 AnyEvent, too, so it is future-proof).
91
92 In addition to being free of having to use *the one and only true event
93 model*, AnyEvent also is free of bloat and policy: with POE or similar
94 modules, you get an enormous amount of code and strict rules you have to
95 follow. AnyEvent, on the other hand, is lean and to the point, by only
96 offering the functionality that is necessary, in as thin as a wrapper as
97 technically possible.
98
99 Of course, AnyEvent comes with a big (and fully optional!) toolbox of
100 useful functionality, such as an asynchronous DNS resolver, 100%
101 non-blocking connects (even with TLS/SSL, IPv6 and on broken platforms
102 such as Windows) and lots of real-world knowledge and workarounds for
103 platform bugs and differences.
104
105 Now, if you *do want* lots of policy (this can arguably be somewhat
106 useful) and you want to force your users to use the one and only event
107 model, you should *not* use this module.
108
109 DESCRIPTION
110 AnyEvent provides a uniform interface to various event loops. This
111 allows module authors to use event loop functionality without forcing
112 module users to use a specific event loop implementation (since more
113 than one event loop cannot coexist peacefully).
114
115 The interface itself is vaguely similar, but not identical to the Event
116 module.
117
118 During the first call of any watcher-creation method, the module tries
119 to detect the currently loaded event loop by probing whether one of the
120 following modules is already loaded: EV, AnyEvent::Loop, Event, Glib,
121 Tk, Event::Lib, Qt, POE. The first one found is used. If none are
122 detected, the module tries to load the first four modules in the order
123 given; but note that if EV is not available, the pure-perl
124 AnyEvent::Loop should always work, so the other two are not normally
125 tried.
126
127 Because AnyEvent first checks for modules that are already loaded,
128 loading an event model explicitly before first using AnyEvent will
129 likely make that model the default. For example:
130
131 use Tk;
132 use AnyEvent;
133
134 # .. AnyEvent will likely default to Tk
135
136 The *likely* means that, if any module loads another event model and
137 starts using it, all bets are off - this case should be very rare
138 though, as very few modules hardcode event loops without announcing this
139 very loudly.
140
141 The pure-perl implementation of AnyEvent is called "AnyEvent::Loop".
142 Like other event modules you can load it explicitly and enjoy the high
143 availability of that event loop :)
144
145 WATCHERS
146 AnyEvent has the central concept of a *watcher*, which is an object that
147 stores relevant data for each kind of event you are waiting for, such as
148 the callback to call, the file handle to watch, etc.
149
150 These watchers are normal Perl objects with normal Perl lifetime. After
151 creating a watcher it will immediately "watch" for events and invoke the
152 callback when the event occurs (of course, only when the event model is
153 in control).
154
155 Note that callbacks must not permanently change global variables
156 potentially in use by the event loop (such as $_ or $[) and that
157 callbacks must not "die". The former is good programming practice in
158 Perl and the latter stems from the fact that exception handling differs
159 widely between event loops.
160
161 To disable a watcher you have to destroy it (e.g. by setting the
162 variable you store it in to "undef" or otherwise deleting all references
163 to it).
164
165 All watchers are created by calling a method on the "AnyEvent" class.
166
167 Many watchers either are used with "recursion" (repeating timers for
168 example), or need to refer to their watcher object in other ways.
169
170 One way to achieve that is this pattern:
171
172 my $w; $w = AnyEvent->type (arg => value ..., cb => sub {
173 # you can use $w here, for example to undef it
174 undef $w;
175 });
176
177 Note that "my $w; $w =" combination. This is necessary because in Perl,
178 my variables are only visible after the statement in which they are
179 declared.
180
181 I/O WATCHERS
182 $w = AnyEvent->io (
183 fh => <filehandle_or_fileno>,
184 poll => <"r" or "w">,
185 cb => <callback>,
186 );
187
188 You can create an I/O watcher by calling the "AnyEvent->io" method with
189 the following mandatory key-value pairs as arguments:
190
191 "fh" is the Perl *file handle* (or a naked file descriptor) to watch for
192 events (AnyEvent might or might not keep a reference to this file
193 handle). Note that only file handles pointing to things for which
194 non-blocking operation makes sense are allowed. This includes sockets,
195 most character devices, pipes, fifos and so on, but not for example
196 files or block devices.
197
198 "poll" must be a string that is either "r" or "w", which creates a
199 watcher waiting for "r"eadable or "w"ritable events, respectively.
200
201 "cb" is the callback to invoke each time the file handle becomes ready.
202
203 Although the callback might get passed parameters, their value and
204 presence is undefined and you cannot rely on them. Portable AnyEvent
205 callbacks cannot use arguments passed to I/O watcher callbacks.
206
207 The I/O watcher might use the underlying file descriptor or a copy of
208 it. You must not close a file handle as long as any watcher is active on
209 the underlying file descriptor.
210
211 Some event loops issue spurious readiness notifications, so you should
212 always use non-blocking calls when reading/writing from/to your file
213 handles.
214
215 Example: wait for readability of STDIN, then read a line and disable the
216 watcher.
217
218 my $w; $w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub {
219 chomp (my $input = <STDIN>);
220 warn "read: $input\n";
221 undef $w;
222 });
223
224 TIME WATCHERS
225 $w = AnyEvent->timer (after => <seconds>, cb => <callback>);
226
227 $w = AnyEvent->timer (
228 after => <fractional_seconds>,
229 interval => <fractional_seconds>,
230 cb => <callback>,
231 );
232
233 You can create a time watcher by calling the "AnyEvent->timer" method
234 with the following mandatory arguments:
235
236 "after" specifies after how many seconds (fractional values are
237 supported) the callback should be invoked. "cb" is the callback to
238 invoke in that case.
239
240 Although the callback might get passed parameters, their value and
241 presence is undefined and you cannot rely on them. Portable AnyEvent
242 callbacks cannot use arguments passed to time watcher callbacks.
243
244 The callback will normally be invoked only once. If you specify another
245 parameter, "interval", as a strictly positive number (> 0), then the
246 callback will be invoked regularly at that interval (in fractional
247 seconds) after the first invocation. If "interval" is specified with a
248 false value, then it is treated as if it were not specified at all.
249
250 The callback will be rescheduled before invoking the callback, but no
251 attempt is made to avoid timer drift in most backends, so the interval
252 is only approximate.
253
254 Example: fire an event after 7.7 seconds.
255
256 my $w = AnyEvent->timer (after => 7.7, cb => sub {
257 warn "timeout\n";
258 });
259
260 # to cancel the timer:
261 undef $w;
262
263 Example 2: fire an event after 0.5 seconds, then roughly every second.
264
265 my $w = AnyEvent->timer (after => 0.5, interval => 1, cb => sub {
266 warn "timeout\n";
267 };
268
269 TIMING ISSUES
270 There are two ways to handle timers: based on real time (relative, "fire
271 in 10 seconds") and based on wallclock time (absolute, "fire at 12
272 o'clock").
273
274 While most event loops expect timers to specified in a relative way,
275 they use absolute time internally. This makes a difference when your
276 clock "jumps", for example, when ntp decides to set your clock backwards
277 from the wrong date of 2014-01-01 to 2008-01-01, a watcher that is
278 supposed to fire "after a second" might actually take six years to
279 finally fire.
280
281 AnyEvent cannot compensate for this. The only event loop that is
282 conscious of these issues is EV, which offers both relative (ev_timer,
283 based on true relative time) and absolute (ev_periodic, based on
284 wallclock time) timers.
285
286 AnyEvent always prefers relative timers, if available, matching the
287 AnyEvent API.
288
289 AnyEvent has two additional methods that return the "current time":
290
291 AnyEvent->time
292 This returns the "current wallclock time" as a fractional number of
293 seconds since the Epoch (the same thing as "time" or
294 "Time::HiRes::time" return, and the result is guaranteed to be
295 compatible with those).
296
297 It progresses independently of any event loop processing, i.e. each
298 call will check the system clock, which usually gets updated
299 frequently.
300
301 AnyEvent->now
302 This also returns the "current wallclock time", but unlike "time",
303 above, this value might change only once per event loop iteration,
304 depending on the event loop (most return the same time as "time",
305 above). This is the time that AnyEvent's timers get scheduled
306 against.
307
308 *In almost all cases (in all cases if you don't care), this is the
309 function to call when you want to know the current time.*
310
311 This function is also often faster then "AnyEvent->time", and thus
312 the preferred method if you want some timestamp (for example,
313 AnyEvent::Handle uses this to update its activity timeouts).
314
315 The rest of this section is only of relevance if you try to be very
316 exact with your timing; you can skip it without a bad conscience.
317
318 For a practical example of when these times differ, consider
319 Event::Lib and EV and the following set-up:
320
321 The event loop is running and has just invoked one of your callbacks
322 at time=500 (assume no other callbacks delay processing). In your
323 callback, you wait a second by executing "sleep 1" (blocking the
324 process for a second) and then (at time=501) you create a relative
325 timer that fires after three seconds.
326
327 With Event::Lib, "AnyEvent->time" and "AnyEvent->now" will both
328 return 501, because that is the current time, and the timer will be
329 scheduled to fire at time=504 (501 + 3).
330
331 With EV, "AnyEvent->time" returns 501 (as that is the current time),
332 but "AnyEvent->now" returns 500, as that is the time the last event
333 processing phase started. With EV, your timer gets scheduled to run
334 at time=503 (500 + 3).
335
336 In one sense, Event::Lib is more exact, as it uses the current time
337 regardless of any delays introduced by event processing. However,
338 most callbacks do not expect large delays in processing, so this
339 causes a higher drift (and a lot more system calls to get the
340 current time).
341
342 In another sense, EV is more exact, as your timer will be scheduled
343 at the same time, regardless of how long event processing actually
344 took.
345
346 In either case, if you care (and in most cases, you don't), then you
347 can get whatever behaviour you want with any event loop, by taking
348 the difference between "AnyEvent->time" and "AnyEvent->now" into
349 account.
350
351 AnyEvent->now_update
352 Some event loops (such as EV or AnyEvent::Loop) cache the current
353 time for each loop iteration (see the discussion of AnyEvent->now,
354 above).
355
356 When a callback runs for a long time (or when the process sleeps),
357 then this "current" time will differ substantially from the real
358 time, which might affect timers and time-outs.
359
360 When this is the case, you can call this method, which will update
361 the event loop's idea of "current time".
362
363 A typical example would be a script in a web server (e.g.
364 "mod_perl") - when mod_perl executes the script, then the event loop
365 will have the wrong idea about the "current time" (being potentially
366 far in the past, when the script ran the last time). In that case
367 you should arrange a call to "AnyEvent->now_update" each time the
368 web server process wakes up again (e.g. at the start of your script,
369 or in a handler).
370
371 Note that updating the time *might* cause some events to be handled.
372
373 SIGNAL WATCHERS
374 $w = AnyEvent->signal (signal => <uppercase_signal_name>, cb => <callback>);
375
376 You can watch for signals using a signal watcher, "signal" is the signal
377 *name* in uppercase and without any "SIG" prefix, "cb" is the Perl
378 callback to be invoked whenever a signal occurs.
379
380 Although the callback might get passed parameters, their value and
381 presence is undefined and you cannot rely on them. Portable AnyEvent
382 callbacks cannot use arguments passed to signal watcher callbacks.
383
384 Multiple signal occurrences can be clumped together into one callback
385 invocation, and callback invocation will be synchronous. Synchronous
386 means that it might take a while until the signal gets handled by the
387 process, but it is guaranteed not to interrupt any other callbacks.
388
389 The main advantage of using these watchers is that you can share a
390 signal between multiple watchers, and AnyEvent will ensure that signals
391 will not interrupt your program at bad times.
392
393 This watcher might use %SIG (depending on the event loop used), so
394 programs overwriting those signals directly will likely not work
395 correctly.
396
397 Example: exit on SIGINT
398
399 my $w = AnyEvent->signal (signal => "INT", cb => sub { exit 1 });
400
401 Restart Behaviour
402 While restart behaviour is up to the event loop implementation, most
403 will not restart syscalls (that includes Async::Interrupt and AnyEvent's
404 pure perl implementation).
405
406 Safe/Unsafe Signals
407 Perl signals can be either "safe" (synchronous to opcode handling) or
408 "unsafe" (asynchronous) - the former might delay signal delivery
409 indefinitely, the latter might corrupt your memory.
410
411 AnyEvent signal handlers are, in addition, synchronous to the event
412 loop, i.e. they will not interrupt your running perl program but will
413 only be called as part of the normal event handling (just like timer,
414 I/O etc. callbacks, too).
415
416 Signal Races, Delays and Workarounds
417 Many event loops (e.g. Glib, Tk, Qt, IO::Async) do not support attaching
418 callbacks to signals in a generic way, which is a pity, as you cannot do
419 race-free signal handling in perl, requiring C libraries for this.
420 AnyEvent will try to do its best, which means in some cases, signals
421 will be delayed. The maximum time a signal might be delayed is 10
422 seconds by default, but can be overriden via
423 $ENV{PERL_ANYEVENT_MAX_SIGNAL_LATENCY} or $AnyEvent::MAX_SIGNAL_LATENCY
424 - see the "ENVIRONMENT VARIABLES" section for details.
425
426 All these problems can be avoided by installing the optional
427 Async::Interrupt module, which works with most event loops. It will not
428 work with inherently broken event loops such as Event or Event::Lib (and
429 not with POE currently). For those, you just have to suffer the delays.
430
431 CHILD PROCESS WATCHERS
432 $w = AnyEvent->child (pid => <process id>, cb => <callback>);
433
434 You can also watch for a child process exit and catch its exit status.
435
436 The child process is specified by the "pid" argument (on some backends,
437 using 0 watches for any child process exit, on others this will croak).
438 The watcher will be triggered only when the child process has finished
439 and an exit status is available, not on any trace events
440 (stopped/continued).
441
442 The callback will be called with the pid and exit status (as returned by
443 waitpid), so unlike other watcher types, you *can* rely on child watcher
444 callback arguments.
445
446 This watcher type works by installing a signal handler for "SIGCHLD",
447 and since it cannot be shared, nothing else should use SIGCHLD or reap
448 random child processes (waiting for specific child processes, e.g.
449 inside "system", is just fine).
450
451 There is a slight catch to child watchers, however: you usually start
452 them *after* the child process was created, and this means the process
453 could have exited already (and no SIGCHLD will be sent anymore).
454
455 Not all event models handle this correctly (neither POE nor IO::Async
456 do, see their AnyEvent::Impl manpages for details), but even for event
457 models that *do* handle this correctly, they usually need to be loaded
458 before the process exits (i.e. before you fork in the first place).
459 AnyEvent's pure perl event loop handles all cases correctly regardless
460 of when you start the watcher.
461
462 This means you cannot create a child watcher as the very first thing in
463 an AnyEvent program, you *have* to create at least one watcher before
464 you "fork" the child (alternatively, you can call "AnyEvent::detect").
465
466 As most event loops do not support waiting for child events, they will
467 be emulated by AnyEvent in most cases, in which case the latency and
468 race problems mentioned in the description of signal watchers apply.
469
470 Example: fork a process and wait for it
471
472 my $done = AnyEvent->condvar;
473
474 my $pid = fork or exit 5;
475
476 my $w = AnyEvent->child (
477 pid => $pid,
478 cb => sub {
479 my ($pid, $status) = @_;
480 warn "pid $pid exited with status $status";
481 $done->send;
482 },
483 );
484
485 # do something else, then wait for process exit
486 $done->recv;
487
488 IDLE WATCHERS
489 $w = AnyEvent->idle (cb => <callback>);
490
491 This will repeatedly invoke the callback after the process becomes idle,
492 until either the watcher is destroyed or new events have been detected.
493
494 Idle watchers are useful when there is a need to do something, but it is
495 not so important (or wise) to do it instantly. The callback will be
496 invoked only when there is "nothing better to do", which is usually
497 defined as "all outstanding events have been handled and no new events
498 have been detected". That means that idle watchers ideally get invoked
499 when the event loop has just polled for new events but none have been
500 detected. Instead of blocking to wait for more events, the idle watchers
501 will be invoked.
502
503 Unfortunately, most event loops do not really support idle watchers
504 (only EV, Event and Glib do it in a usable fashion) - for the rest,
505 AnyEvent will simply call the callback "from time to time".
506
507 Example: read lines from STDIN, but only process them when the program
508 is otherwise idle:
509
510 my @lines; # read data
511 my $idle_w;
512 my $io_w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub {
513 push @lines, scalar <STDIN>;
514
515 # start an idle watcher, if not already done
516 $idle_w ||= AnyEvent->idle (cb => sub {
517 # handle only one line, when there are lines left
518 if (my $line = shift @lines) {
519 print "handled when idle: $line";
520 } else {
521 # otherwise disable the idle watcher again
522 undef $idle_w;
523 }
524 });
525 });
526
527 CONDITION VARIABLES
528 $cv = AnyEvent->condvar;
529
530 $cv->send (<list>);
531 my @res = $cv->recv;
532
533 If you are familiar with some event loops you will know that all of them
534 require you to run some blocking "loop", "run" or similar function that
535 will actively watch for new events and call your callbacks.
536
537 AnyEvent is slightly different: it expects somebody else to run the
538 event loop and will only block when necessary (usually when told by the
539 user).
540
541 The tool to do that is called a "condition variable", so called because
542 they represent a condition that must become true.
543
544 Now is probably a good time to look at the examples further below.
545
546 Condition variables can be created by calling the "AnyEvent->condvar"
547 method, usually without arguments. The only argument pair allowed is
548 "cb", which specifies a callback to be called when the condition
549 variable becomes true, with the condition variable as the first argument
550 (but not the results).
551
552 After creation, the condition variable is "false" until it becomes
553 "true" by calling the "send" method (or calling the condition variable
554 as if it were a callback, read about the caveats in the description for
555 the "->send" method).
556
557 Since condition variables are the most complex part of the AnyEvent API,
558 here are some different mental models of what they are - pick the ones
559 you can connect to:
560
561 * Condition variables are like callbacks - you can call them (and pass
562 them instead of callbacks). Unlike callbacks however, you can also
563 wait for them to be called.
564
565 * Condition variables are signals - one side can emit or send them,
566 the other side can wait for them, or install a handler that is
567 called when the signal fires.
568
569 * Condition variables are like "Merge Points" - points in your program
570 where you merge multiple independent results/control flows into one.
571
572 * Condition variables represent a transaction - functions that start
573 some kind of transaction can return them, leaving the caller the
574 choice between waiting in a blocking fashion, or setting a callback.
575
576 * Condition variables represent future values, or promises to deliver
577 some result, long before the result is available.
578
579 Condition variables are very useful to signal that something has
580 finished, for example, if you write a module that does asynchronous http
581 requests, then a condition variable would be the ideal candidate to
582 signal the availability of results. The user can either act when the
583 callback is called or can synchronously "->recv" for the results.
584
585 You can also use them to simulate traditional event loops - for example,
586 you can block your main program until an event occurs - for example, you
587 could "->recv" in your main program until the user clicks the Quit
588 button of your app, which would "->send" the "quit" event.
589
590 Note that condition variables recurse into the event loop - if you have
591 two pieces of code that call "->recv" in a round-robin fashion, you
592 lose. Therefore, condition variables are good to export to your caller,
593 but you should avoid making a blocking wait yourself, at least in
594 callbacks, as this asks for trouble.
595
596 Condition variables are represented by hash refs in perl, and the keys
597 used by AnyEvent itself are all named "_ae_XXX" to make subclassing easy
598 (it is often useful to build your own transaction class on top of
599 AnyEvent). To subclass, use "AnyEvent::CondVar" as base class and call
600 its "new" method in your own "new" method.
601
602 There are two "sides" to a condition variable - the "producer side"
603 which eventually calls "-> send", and the "consumer side", which waits
604 for the send to occur.
605
606 Example: wait for a timer.
607
608 # condition: "wait till the timer is fired"
609 my $timer_fired = AnyEvent->condvar;
610
611 # create the timer - we could wait for, say
612 # a handle becomign ready, or even an
613 # AnyEvent::HTTP request to finish, but
614 # in this case, we simply use a timer:
615 my $w = AnyEvent->timer (
616 after => 1,
617 cb => sub { $timer_fired->send },
618 );
619
620 # this "blocks" (while handling events) till the callback
621 # calls ->send
622 $timer_fired->recv;
623
624 Example: wait for a timer, but take advantage of the fact that condition
625 variables are also callable directly.
626
627 my $done = AnyEvent->condvar;
628 my $delay = AnyEvent->timer (after => 5, cb => $done);
629 $done->recv;
630
631 Example: Imagine an API that returns a condvar and doesn't support
632 callbacks. This is how you make a synchronous call, for example from the
633 main program:
634
635 use AnyEvent::CouchDB;
636
637 ...
638
639 my @info = $couchdb->info->recv;
640
641 And this is how you would just set a callback to be called whenever the
642 results are available:
643
644 $couchdb->info->cb (sub {
645 my @info = $_[0]->recv;
646 });
647
648 METHODS FOR PRODUCERS
649 These methods should only be used by the producing side, i.e. the
650 code/module that eventually sends the signal. Note that it is also the
651 producer side which creates the condvar in most cases, but it isn't
652 uncommon for the consumer to create it as well.
653
654 $cv->send (...)
655 Flag the condition as ready - a running "->recv" and all further
656 calls to "recv" will (eventually) return after this method has been
657 called. If nobody is waiting the send will be remembered.
658
659 If a callback has been set on the condition variable, it is called
660 immediately from within send.
661
662 Any arguments passed to the "send" call will be returned by all
663 future "->recv" calls.
664
665 Condition variables are overloaded so one can call them directly (as
666 if they were a code reference). Calling them directly is the same as
667 calling "send".
668
669 $cv->croak ($error)
670 Similar to send, but causes all calls to "->recv" to invoke
671 "Carp::croak" with the given error message/object/scalar.
672
673 This can be used to signal any errors to the condition variable
674 user/consumer. Doing it this way instead of calling "croak" directly
675 delays the error detection, but has the overwhelming advantage that
676 it diagnoses the error at the place where the result is expected,
677 and not deep in some event callback with no connection to the actual
678 code causing the problem.
679
680 $cv->begin ([group callback])
681 $cv->end
682 These two methods can be used to combine many transactions/events
683 into one. For example, a function that pings many hosts in parallel
684 might want to use a condition variable for the whole process.
685
686 Every call to "->begin" will increment a counter, and every call to
687 "->end" will decrement it. If the counter reaches 0 in "->end", the
688 (last) callback passed to "begin" will be executed, passing the
689 condvar as first argument. That callback is *supposed* to call
690 "->send", but that is not required. If no group callback was set,
691 "send" will be called without any arguments.
692
693 You can think of "$cv->send" giving you an OR condition (one call
694 sends), while "$cv->begin" and "$cv->end" giving you an AND
695 condition (all "begin" calls must be "end"'ed before the condvar
696 sends).
697
698 Let's start with a simple example: you have two I/O watchers (for
699 example, STDOUT and STDERR for a program), and you want to wait for
700 both streams to close before activating a condvar:
701
702 my $cv = AnyEvent->condvar;
703
704 $cv->begin; # first watcher
705 my $w1 = AnyEvent->io (fh => $fh1, cb => sub {
706 defined sysread $fh1, my $buf, 4096
707 or $cv->end;
708 });
709
710 $cv->begin; # second watcher
711 my $w2 = AnyEvent->io (fh => $fh2, cb => sub {
712 defined sysread $fh2, my $buf, 4096
713 or $cv->end;
714 });
715
716 $cv->recv;
717
718 This works because for every event source (EOF on file handle),
719 there is one call to "begin", so the condvar waits for all calls to
720 "end" before sending.
721
722 The ping example mentioned above is slightly more complicated, as
723 the there are results to be passwd back, and the number of tasks
724 that are begun can potentially be zero:
725
726 my $cv = AnyEvent->condvar;
727
728 my %result;
729 $cv->begin (sub { shift->send (\%result) });
730
731 for my $host (@list_of_hosts) {
732 $cv->begin;
733 ping_host_then_call_callback $host, sub {
734 $result{$host} = ...;
735 $cv->end;
736 };
737 }
738
739 $cv->end;
740
741 This code fragment supposedly pings a number of hosts and calls
742 "send" after results for all then have have been gathered - in any
743 order. To achieve this, the code issues a call to "begin" when it
744 starts each ping request and calls "end" when it has received some
745 result for it. Since "begin" and "end" only maintain a counter, the
746 order in which results arrive is not relevant.
747
748 There is an additional bracketing call to "begin" and "end" outside
749 the loop, which serves two important purposes: first, it sets the
750 callback to be called once the counter reaches 0, and second, it
751 ensures that "send" is called even when "no" hosts are being pinged
752 (the loop doesn't execute once).
753
754 This is the general pattern when you "fan out" into multiple (but
755 potentially zero) subrequests: use an outer "begin"/"end" pair to
756 set the callback and ensure "end" is called at least once, and then,
757 for each subrequest you start, call "begin" and for each subrequest
758 you finish, call "end".
759
760 METHODS FOR CONSUMERS
761 These methods should only be used by the consuming side, i.e. the code
762 awaits the condition.
763
764 $cv->recv
765 Wait (blocking if necessary) until the "->send" or "->croak" methods
766 have been called on $cv, while servicing other watchers normally.
767
768 You can only wait once on a condition - additional calls are valid
769 but will return immediately.
770
771 If an error condition has been set by calling "->croak", then this
772 function will call "croak".
773
774 In list context, all parameters passed to "send" will be returned,
775 in scalar context only the first one will be returned.
776
777 Note that doing a blocking wait in a callback is not supported by
778 any event loop, that is, recursive invocation of a blocking "->recv"
779 is not allowed, and the "recv" call will "croak" if such a condition
780 is detected. This condition can be slightly loosened by using
781 Coro::AnyEvent, which allows you to do a blocking "->recv" from any
782 thread that doesn't run the event loop itself.
783
784 Not all event models support a blocking wait - some die in that case
785 (programs might want to do that to stay interactive), so *if you are
786 using this from a module, never require a blocking wait*. Instead,
787 let the caller decide whether the call will block or not (for
788 example, by coupling condition variables with some kind of request
789 results and supporting callbacks so the caller knows that getting
790 the result will not block, while still supporting blocking waits if
791 the caller so desires).
792
793 You can ensure that "->recv" never blocks by setting a callback and
794 only calling "->recv" from within that callback (or at a later
795 time). This will work even when the event loop does not support
796 blocking waits otherwise.
797
798 $bool = $cv->ready
799 Returns true when the condition is "true", i.e. whether "send" or
800 "croak" have been called.
801
802 $cb = $cv->cb ($cb->($cv))
803 This is a mutator function that returns the callback set and
804 optionally replaces it before doing so.
805
806 The callback will be called when the condition becomes "true", i.e.
807 when "send" or "croak" are called, with the only argument being the
808 condition variable itself. If the condition is already true, the
809 callback is called immediately when it is set. Calling "recv" inside
810 the callback or at any later time is guaranteed not to block.
811
812 SUPPORTED EVENT LOOPS/BACKENDS
813 The available backend classes are (every class has its own manpage):
814
815 Backends that are autoprobed when no other event loop can be found.
816 EV is the preferred backend when no other event loop seems to be in
817 use. If EV is not installed, then AnyEvent will fall back to its own
818 pure-perl implementation, which is available everywhere as it comes
819 with AnyEvent itself.
820
821 AnyEvent::Impl::EV based on EV (interface to libev, best choice).
822 AnyEvent::Impl::Perl pure-perl AnyEvent::Loop, fast and portable.
823
824 Backends that are transparently being picked up when they are used.
825 These will be used if they are already loaded when the first watcher
826 is created, in which case it is assumed that the application is
827 using them. This means that AnyEvent will automatically pick the
828 right backend when the main program loads an event module before
829 anything starts to create watchers. Nothing special needs to be done
830 by the main program.
831
832 AnyEvent::Impl::Event based on Event, very stable, few glitches.
833 AnyEvent::Impl::Glib based on Glib, slow but very stable.
834 AnyEvent::Impl::Tk based on Tk, very broken.
835 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse.
836 AnyEvent::Impl::POE based on POE, very slow, some limitations.
837 AnyEvent::Impl::Irssi used when running within irssi.
838 AnyEvent::Impl::IOAsync based on IO::Async.
839 AnyEvent::Impl::Cocoa based on Cocoa::EventLoop.
840 AnyEvent::Impl::FLTK based on FLTK (fltk 2 binding).
841
842 Backends with special needs.
843 Qt requires the Qt::Application to be instantiated first, but will
844 otherwise be picked up automatically. As long as the main program
845 instantiates the application before any AnyEvent watchers are
846 created, everything should just work.
847
848 AnyEvent::Impl::Qt based on Qt.
849
850 Event loops that are indirectly supported via other backends.
851 Some event loops can be supported via other modules:
852
853 There is no direct support for WxWidgets (Wx) or Prima.
854
855 WxWidgets has no support for watching file handles. However, you can
856 use WxWidgets through the POE adaptor, as POE has a Wx backend that
857 simply polls 20 times per second, which was considered to be too
858 horrible to even consider for AnyEvent.
859
860 Prima is not supported as nobody seems to be using it, but it has a
861 POE backend, so it can be supported through POE.
862
863 AnyEvent knows about both Prima and Wx, however, and will try to
864 load POE when detecting them, in the hope that POE will pick them
865 up, in which case everything will be automatic.
866
867 GLOBAL VARIABLES AND FUNCTIONS
868 These are not normally required to use AnyEvent, but can be useful to
869 write AnyEvent extension modules.
870
871 $AnyEvent::MODEL
872 Contains "undef" until the first watcher is being created, before
873 the backend has been autodetected.
874
875 Afterwards it contains the event model that is being used, which is
876 the name of the Perl class implementing the model. This class is
877 usually one of the "AnyEvent::Impl::xxx" modules, but can be any
878 other class in the case AnyEvent has been extended at runtime (e.g.
879 in *rxvt-unicode* it will be "urxvt::anyevent").
880
881 AnyEvent::detect
882 Returns $AnyEvent::MODEL, forcing autodetection of the event model
883 if necessary. You should only call this function right before you
884 would have created an AnyEvent watcher anyway, that is, as late as
885 possible at runtime, and not e.g. during initialisation of your
886 module.
887
888 The effect of calling this function is as if a watcher had been
889 created (specifically, actions that happen "when the first watcher
890 is created" happen when calling detetc as well).
891
892 If you need to do some initialisation before AnyEvent watchers are
893 created, use "post_detect".
894
895 $guard = AnyEvent::post_detect { BLOCK }
896 Arranges for the code block to be executed as soon as the event
897 model is autodetected (or immediately if that has already happened).
898
899 The block will be executed *after* the actual backend has been
900 detected ($AnyEvent::MODEL is set), but *before* any watchers have
901 been created, so it is possible to e.g. patch @AnyEvent::ISA or do
902 other initialisations - see the sources of AnyEvent::Strict or
903 AnyEvent::AIO to see how this is used.
904
905 The most common usage is to create some global watchers, without
906 forcing event module detection too early, for example, AnyEvent::AIO
907 creates and installs the global IO::AIO watcher in a "post_detect"
908 block to avoid autodetecting the event module at load time.
909
910 If called in scalar or list context, then it creates and returns an
911 object that automatically removes the callback again when it is
912 destroyed (or "undef" when the hook was immediately executed). See
913 AnyEvent::AIO for a case where this is useful.
914
915 Example: Create a watcher for the IO::AIO module and store it in
916 $WATCHER, but do so only do so after the event loop is initialised.
917
918 our WATCHER;
919
920 my $guard = AnyEvent::post_detect {
921 $WATCHER = AnyEvent->io (fh => IO::AIO::poll_fileno, poll => 'r', cb => \&IO::AIO::poll_cb);
922 };
923
924 # the ||= is important in case post_detect immediately runs the block,
925 # as to not clobber the newly-created watcher. assigning both watcher and
926 # post_detect guard to the same variable has the advantage of users being
927 # able to just C<undef $WATCHER> if the watcher causes them grief.
928
929 $WATCHER ||= $guard;
930
931 @AnyEvent::post_detect
932 If there are any code references in this array (you can "push" to it
933 before or after loading AnyEvent), then they will be called directly
934 after the event loop has been chosen.
935
936 You should check $AnyEvent::MODEL before adding to this array,
937 though: if it is defined then the event loop has already been
938 detected, and the array will be ignored.
939
940 Best use "AnyEvent::post_detect { BLOCK }" when your application
941 allows it, as it takes care of these details.
942
943 This variable is mainly useful for modules that can do something
944 useful when AnyEvent is used and thus want to know when it is
945 initialised, but do not need to even load it by default. This array
946 provides the means to hook into AnyEvent passively, without loading
947 it.
948
949 Example: To load Coro::AnyEvent whenever Coro and AnyEvent are used
950 together, you could put this into Coro (this is the actual code used
951 by Coro to accomplish this):
952
953 if (defined $AnyEvent::MODEL) {
954 # AnyEvent already initialised, so load Coro::AnyEvent
955 require Coro::AnyEvent;
956 } else {
957 # AnyEvent not yet initialised, so make sure to load Coro::AnyEvent
958 # as soon as it is
959 push @AnyEvent::post_detect, sub { require Coro::AnyEvent };
960 }
961
962 AnyEvent::postpone { BLOCK }
963 Arranges for the block to be executed as soon as possible, but not
964 before the call itself returns. In practise, the block will be
965 executed just before the event loop polls for new events, or shortly
966 afterwards.
967
968 This function never returns anything (to make the "return postpone {
969 ... }" idiom more useful.
970
971 To understand the usefulness of this function, consider a function
972 that asynchronously does something for you and returns some
973 transaction object or guard to let you cancel the operation. For
974 example, "AnyEvent::Socket::tcp_connect":
975
976 # start a conenction attempt unless one is active
977 $self->{connect_guard} ||= AnyEvent::Socket::tcp_connect "www.example.net", 80, sub {
978 delete $self->{connect_guard};
979 ...
980 };
981
982 Imagine that this function could instantly call the callback, for
983 example, because it detects an obvious error such as a negative port
984 number. Invoking the callback before the function returns causes
985 problems however: the callback will be called and will try to delete
986 the guard object. But since the function hasn't returned yet, there
987 is nothing to delete. When the function eventually returns it will
988 assign the guard object to "$self->{connect_guard}", where it will
989 likely never be deleted, so the program thinks it is still trying to
990 connect.
991
992 This is where "AnyEvent::postpone" should be used. Instead of
993 calling the callback directly on error:
994
995 $cb->(undef), return # signal error to callback, BAD!
996 if $some_error_condition;
997
998 It should use "postpone":
999
1000 AnyEvent::postpone { $cb->(undef) }, return # signal error to callback, later
1001 if $some_error_condition;
1002
1003 AnyEvent::log $level, $msg[, @args]
1004 Log the given $msg at the given $level.
1005
1006 If AnyEvent::Log is not loaded then this function makes a simple
1007 test to see whether the message will be logged. If the test succeeds
1008 it will load AnyEvent::Log and call "AnyEvent::Log::log" -
1009 consequently, look at the AnyEvent::Log documentation for details.
1010
1011 If the test fails it will simply return. Right now this happens when
1012 a numerical loglevel is used and it is larger than the level
1013 specified via $ENV{PERL_ANYEVENT_VERBOSE}.
1014
1015 If you want to sprinkle loads of logging calls around your code,
1016 consider creating a logger callback with the "AnyEvent::Log::logger"
1017 function, which can reduce typing, codesize and can reduce the
1018 logging overhead enourmously.
1019
1020 WHAT TO DO IN A MODULE
1021 As a module author, you should "use AnyEvent" and call AnyEvent methods
1022 freely, but you should not load a specific event module or rely on it.
1023
1024 Be careful when you create watchers in the module body - AnyEvent will
1025 decide which event module to use as soon as the first method is called,
1026 so by calling AnyEvent in your module body you force the user of your
1027 module to load the event module first.
1028
1029 Never call "->recv" on a condition variable unless you *know* that the
1030 "->send" method has been called on it already. This is because it will
1031 stall the whole program, and the whole point of using events is to stay
1032 interactive.
1033
1034 It is fine, however, to call "->recv" when the user of your module
1035 requests it (i.e. if you create a http request object ad have a method
1036 called "results" that returns the results, it may call "->recv" freely,
1037 as the user of your module knows what she is doing. Always).
1038
1039 WHAT TO DO IN THE MAIN PROGRAM
1040 There will always be a single main program - the only place that should
1041 dictate which event model to use.
1042
1043 If the program is not event-based, it need not do anything special, even
1044 when it depends on a module that uses an AnyEvent. If the program itself
1045 uses AnyEvent, but does not care which event loop is used, all it needs
1046 to do is "use AnyEvent". In either case, AnyEvent will choose the best
1047 available loop implementation.
1048
1049 If the main program relies on a specific event model - for example, in
1050 Gtk2 programs you have to rely on the Glib module - you should load the
1051 event module before loading AnyEvent or any module that uses it:
1052 generally speaking, you should load it as early as possible. The reason
1053 is that modules might create watchers when they are loaded, and AnyEvent
1054 will decide on the event model to use as soon as it creates watchers,
1055 and it might choose the wrong one unless you load the correct one
1056 yourself.
1057
1058 You can chose to use a pure-perl implementation by loading the
1059 "AnyEvent::Loop" module, which gives you similar behaviour everywhere,
1060 but letting AnyEvent chose the model is generally better.
1061
1062 MAINLOOP EMULATION
1063 Sometimes (often for short test scripts, or even standalone programs who
1064 only want to use AnyEvent), you do not want to run a specific event
1065 loop.
1066
1067 In that case, you can use a condition variable like this:
1068
1069 AnyEvent->condvar->recv;
1070
1071 This has the effect of entering the event loop and looping forever.
1072
1073 Note that usually your program has some exit condition, in which case it
1074 is better to use the "traditional" approach of storing a condition
1075 variable somewhere, waiting for it, and sending it when the program
1076 should exit cleanly.
1077
1078 OTHER MODULES
1079 The following is a non-exhaustive list of additional modules that use
1080 AnyEvent as a client and can therefore be mixed easily with other
1081 AnyEvent modules and other event loops in the same program. Some of the
1082 modules come as part of AnyEvent, the others are available via CPAN (see
1083 <http://search.cpan.org/search?m=module&q=anyevent%3A%3A*> for a longer
1084 non-exhaustive list), and the list is heavily biased towards modules of
1085 the AnyEvent author himself :)
1086
1087 AnyEvent::Util
1088 Contains various utility functions that replace often-used blocking
1089 functions such as "inet_aton" with event/callback-based versions.
1090
1091 AnyEvent::Socket
1092 Provides various utility functions for (internet protocol) sockets,
1093 addresses and name resolution. Also functions to create non-blocking
1094 tcp connections or tcp servers, with IPv6 and SRV record support and
1095 more.
1096
1097 AnyEvent::Handle
1098 Provide read and write buffers, manages watchers for reads and
1099 writes, supports raw and formatted I/O, I/O queued and fully
1100 transparent and non-blocking SSL/TLS (via AnyEvent::TLS).
1101
1102 AnyEvent::DNS
1103 Provides rich asynchronous DNS resolver capabilities.
1104
1105 AnyEvent::HTTP, AnyEvent::IRC, AnyEvent::XMPP, AnyEvent::GPSD,
1106 AnyEvent::IGS, AnyEvent::FCP
1107 Implement event-based interfaces to the protocols of the same name
1108 (for the curious, IGS is the International Go Server and FCP is the
1109 Freenet Client Protocol).
1110
1111 AnyEvent::AIO
1112 Truly asynchronous (as opposed to non-blocking) I/O, should be in
1113 the toolbox of every event programmer. AnyEvent::AIO transparently
1114 fuses IO::AIO and AnyEvent together, giving AnyEvent access to
1115 event-based file I/O, and much more.
1116
1117 AnyEvent::Filesys::Notify
1118 AnyEvent is good for non-blocking stuff, but it can't detect file or
1119 path changes (e.g. "watch this directory for new files", "watch this
1120 file for changes"). The AnyEvent::Filesys::Notify module promises to
1121 do just that in a portbale fashion, supporting inotify on GNU/Linux
1122 and some weird, without doubt broken, stuff on OS X to monitor
1123 files. It can fall back to blocking scans at regular intervals
1124 transparently on other platforms, so it's about as portable as it
1125 gets.
1126
1127 (I haven't used it myself, but I haven't heard anybody complaining
1128 about it yet).
1129
1130 AnyEvent::DBI
1131 Executes DBI requests asynchronously in a proxy process for you,
1132 notifying you in an event-based way when the operation is finished.
1133
1134 AnyEvent::HTTPD
1135 A simple embedded webserver.
1136
1137 AnyEvent::FastPing
1138 The fastest ping in the west.
1139
1140 Coro
1141 Has special support for AnyEvent via Coro::AnyEvent, which allows
1142 you to simply invert the flow control - don't call us, we will call
1143 you:
1144
1145 async {
1146 Coro::AnyEvent::sleep 5; # creates a 5s timer and waits for it
1147 print "5 seconds later!\n";
1148
1149 Coro::AnyEvent::readable *STDIN; # uses an I/O watcher
1150 my $line = <STDIN>; # works for ttys
1151
1152 AnyEvent::HTTP::http_get "url", Coro::rouse_cb;
1153 my ($body, $hdr) = Coro::rouse_wait;
1154 };
1155
1156 SIMPLIFIED AE API
1157 Starting with version 5.0, AnyEvent officially supports a second, much
1158 simpler, API that is designed to reduce the calling, typing and memory
1159 overhead by using function call syntax and a fixed number of parameters.
1160
1161 See the AE manpage for details.
1162
1163 ERROR AND EXCEPTION HANDLING
1164 In general, AnyEvent does not do any error handling - it relies on the
1165 caller to do that if required. The AnyEvent::Strict module (see also the
1166 "PERL_ANYEVENT_STRICT" environment variable, below) provides strict
1167 checking of all AnyEvent methods, however, which is highly useful during
1168 development.
1169
1170 As for exception handling (i.e. runtime errors and exceptions thrown
1171 while executing a callback), this is not only highly event-loop
1172 specific, but also not in any way wrapped by this module, as this is the
1173 job of the main program.
1174
1175 The pure perl event loop simply re-throws the exception (usually within
1176 "condvar->recv"), the Event and EV modules call "$Event/EV::DIED->()",
1177 Glib uses "install_exception_handler" and so on.
1178
1179 ENVIRONMENT VARIABLES
1180 AnyEvent supports a number of environment variables that tune the
1181 runtime behaviour. They are usually evaluated when AnyEvent is loaded,
1182 initialised, or a submodule that uses them is loaded. Many of them also
1183 cause AnyEvent to load additional modules - for example,
1184 "PERL_ANYEVENT_DEBUG_WRAP" causes the AnyEvent::Debug module to be
1185 loaded.
1186
1187 All the environment variables documented here start with
1188 "PERL_ANYEVENT_", which is what AnyEvent considers its own namespace.
1189 Other modules are encouraged (but by no means required) to use
1190 "PERL_ANYEVENT_SUBMODULE" if they have registered the
1191 AnyEvent::Submodule namespace on CPAN, for any submodule. For example,
1192 AnyEvent::HTTP could be expected to use "PERL_ANYEVENT_HTTP_PROXY" (it
1193 should not access env variables starting with "AE_", see below).
1194
1195 All variables can also be set via the "AE_" prefix, that is, instead of
1196 setting "PERL_ANYEVENT_VERBOSE" you can also set "AE_VERBOSE". In case
1197 there is a clash btween anyevent and another program that uses
1198 "AE_something" you can set the corresponding "PERL_ANYEVENT_something"
1199 variable to the empty string, as those variables take precedence.
1200
1201 When AnyEvent is first loaded, it copies all "AE_xxx" env variables to
1202 their "PERL_ANYEVENT_xxx" counterpart unless that variable already
1203 exists. If taint mode is on, then AnyEvent will remove *all* environment
1204 variables starting with "PERL_ANYEVENT_" from %ENV (or replace them with
1205 "undef" or the empty string, if the corresaponding "AE_" variable is
1206 set).
1207
1208 The exact algorithm is currently:
1209
1210 1. if taint mode enabled, delete all PERL_ANYEVENT_xyz variables from %ENV
1211 2. copy over AE_xyz to PERL_ANYEVENT_xyz unless the latter alraedy exists
1212 3. if taint mode enabled, set all PERL_ANYEVENT_xyz variables to undef.
1213
1214 This ensures that child processes will not see the "AE_" variables.
1215
1216 The following environment variables are currently known to AnyEvent:
1217
1218 "PERL_ANYEVENT_VERBOSE"
1219 By default, AnyEvent will log messages with loglevel 4 ("error") or
1220 higher (see AnyEvent::Log). You can set this environment variable to
1221 a numerical loglevel to make AnyEvent more (or less) talkative.
1222
1223 If you want to do more than just set the global logging level you
1224 should have a look at "PERL_ANYEVENT_LOG", which allows much more
1225 complex specifications.
1226
1227 When set to 0 ("off"), then no messages whatsoever will be logged
1228 with everything else at defaults.
1229
1230 When set to 5 or higher ("warn"), AnyEvent warns about unexpected
1231 conditions, such as not being able to load the event model specified
1232 by "PERL_ANYEVENT_MODEL", or a guard callback throwing an exception
1233 - this is the minimum recommended level for use during development.
1234
1235 When set to 7 or higher (info), AnyEvent reports which event model
1236 it chooses.
1237
1238 When set to 8 or higher (debug), then AnyEvent will report extra
1239 information on which optional modules it loads and how it implements
1240 certain features.
1241
1242 "PERL_ANYEVENT_LOG"
1243 Accepts rather complex logging specifications. For example, you
1244 could log all "debug" messages of some module to stderr, warnings
1245 and above to stderr, and errors and above to syslog, with:
1246
1247 PERL_ANYEVENT_LOG=Some::Module=debug,+log:filter=warn,+%syslog:%syslog=error,syslog
1248
1249 For the rather extensive details, see AnyEvent::Log.
1250
1251 This variable is evaluated when AnyEvent (or AnyEvent::Log) is
1252 loaded, so will take effect even before AnyEvent has initialised
1253 itself.
1254
1255 Note that specifying this environment variable causes the
1256 AnyEvent::Log module to be loaded, while "PERL_ANYEVENT_VERBOSE"
1257 does not, so only using the latter saves a few hundred kB of memory
1258 unless a module explicitly needs the extra features of
1259 AnyEvent::Log.
1260
1261 "PERL_ANYEVENT_STRICT"
1262 AnyEvent does not do much argument checking by default, as thorough
1263 argument checking is very costly. Setting this variable to a true
1264 value will cause AnyEvent to load "AnyEvent::Strict" and then to
1265 thoroughly check the arguments passed to most method calls. If it
1266 finds any problems, it will croak.
1267
1268 In other words, enables "strict" mode.
1269
1270 Unlike "use strict" (or its modern cousin, "use common::sense", it
1271 is definitely recommended to keep it off in production. Keeping
1272 "PERL_ANYEVENT_STRICT=1" in your environment while developing
1273 programs can be very useful, however.
1274
1275 "PERL_ANYEVENT_DEBUG_SHELL"
1276 If this env variable is nonempty, then its contents will be
1277 interpreted by "AnyEvent::Socket::parse_hostport" and
1278 "AnyEvent::Debug::shell" (after replacing every occurance of $$ by
1279 the process pid). The shell object is saved in
1280 $AnyEvent::Debug::SHELL.
1281
1282 This happens when the first watcher is created.
1283
1284 For example, to bind a debug shell on a unix domain socket in
1285 /tmp/debug<pid>.sock, you could use this:
1286
1287 PERL_ANYEVENT_DEBUG_SHELL=/tmp/debug\$\$.sock perlprog
1288 # connect with e.g.: socat readline /tmp/debug123.sock
1289
1290 Or to bind to tcp port 4545 on localhost:
1291
1292 PERL_ANYEVENT_DEBUG_SHELL=127.0.0.1:4545 perlprog
1293 # connect with e.g.: telnet localhost 4545
1294
1295 Note that creating sockets in /tmp or on localhost is very unsafe on
1296 multiuser systems.
1297
1298 "PERL_ANYEVENT_DEBUG_WRAP"
1299 Can be set to 0, 1 or 2 and enables wrapping of all watchers for
1300 debugging purposes. See "AnyEvent::Debug::wrap" for details.
1301
1302 "PERL_ANYEVENT_MODEL"
1303 This can be used to specify the event model to be used by AnyEvent,
1304 before auto detection and -probing kicks in.
1305
1306 It normally is a string consisting entirely of ASCII letters (e.g.
1307 "EV" or "IOAsync"). The string "AnyEvent::Impl::" gets prepended and
1308 the resulting module name is loaded and - if the load was successful
1309 - used as event model backend. If it fails to load then AnyEvent
1310 will proceed with auto detection and -probing.
1311
1312 If the string ends with "::" instead (e.g. "AnyEvent::Impl::EV::")
1313 then nothing gets prepended and the module name is used as-is (hint:
1314 "::" at the end of a string designates a module name and quotes it
1315 appropriately).
1316
1317 For example, to force the pure perl model (AnyEvent::Loop::Perl) you
1318 could start your program like this:
1319
1320 PERL_ANYEVENT_MODEL=Perl perl ...
1321
1322 "PERL_ANYEVENT_IO_MODEL"
1323 The current file I/O model - see AnyEvent::IO for more info.
1324
1325 At the moment, only "Perl" (small, pure-perl, synchronous) and
1326 "IOAIO" (truly asynchronous) are supported. The default is "IOAIO"
1327 if AnyEvent::AIO can be loaded, otherwise it is "Perl".
1328
1329 "PERL_ANYEVENT_PROTOCOLS"
1330 Used by both AnyEvent::DNS and AnyEvent::Socket to determine
1331 preferences for IPv4 or IPv6. The default is unspecified (and might
1332 change, or be the result of auto probing).
1333
1334 Must be set to a comma-separated list of protocols or address
1335 families, current supported: "ipv4" and "ipv6". Only protocols
1336 mentioned will be used, and preference will be given to protocols
1337 mentioned earlier in the list.
1338
1339 This variable can effectively be used for denial-of-service attacks
1340 against local programs (e.g. when setuid), although the impact is
1341 likely small, as the program has to handle conenction and other
1342 failures anyways.
1343
1344 Examples: "PERL_ANYEVENT_PROTOCOLS=ipv4,ipv6" - prefer IPv4 over
1345 IPv6, but support both and try to use both.
1346 "PERL_ANYEVENT_PROTOCOLS=ipv4" - only support IPv4, never try to
1347 resolve or contact IPv6 addresses.
1348 "PERL_ANYEVENT_PROTOCOLS=ipv6,ipv4" support either IPv4 or IPv6, but
1349 prefer IPv6 over IPv4.
1350
1351 "PERL_ANYEVENT_HOSTS"
1352 This variable, if specified, overrides the /etc/hosts file used by
1353 AnyEvent::Socket"::resolve_sockaddr", i.e. hosts aliases will be
1354 read from that file instead.
1355
1356 "PERL_ANYEVENT_EDNS0"
1357 Used by AnyEvent::DNS to decide whether to use the EDNS0 extension
1358 for DNS. This extension is generally useful to reduce DNS traffic,
1359 especially when DNSSEC is involved, but some (broken) firewalls drop
1360 such DNS packets, which is why it is off by default.
1361
1362 Setting this variable to 1 will cause AnyEvent::DNS to announce
1363 EDNS0 in its DNS requests.
1364
1365 "PERL_ANYEVENT_MAX_FORKS"
1366 The maximum number of child processes that
1367 "AnyEvent::Util::fork_call" will create in parallel.
1368
1369 "PERL_ANYEVENT_MAX_OUTSTANDING_DNS"
1370 The default value for the "max_outstanding" parameter for the
1371 default DNS resolver - this is the maximum number of parallel DNS
1372 requests that are sent to the DNS server.
1373
1374 "PERL_ANYEVENT_MAX_SIGNAL_LATENCY"
1375 Perl has inherently racy signal handling (you can basically choose
1376 between losing signals and memory corruption) - pure perl event
1377 loops (including "AnyEvent::Loop", when "Async::Interrupt" isn't
1378 available) therefore have to poll regularly to avoid losing signals.
1379
1380 Some event loops are racy, but don't poll regularly, and some event
1381 loops are written in C but are still racy. For those event loops,
1382 AnyEvent installs a timer that regularly wakes up the event loop.
1383
1384 By default, the interval for this timer is 10 seconds, but you can
1385 override this delay with this environment variable (or by setting
1386 the $AnyEvent::MAX_SIGNAL_LATENCY variable before creating signal
1387 watchers).
1388
1389 Lower values increase CPU (and energy) usage, higher values can
1390 introduce long delays when reaping children or waiting for signals.
1391
1392 The AnyEvent::Async module, if available, will be used to avoid this
1393 polling (with most event loops).
1394
1395 "PERL_ANYEVENT_RESOLV_CONF"
1396 The absolute path to a resolv.conf-style file to use instead of
1397 /etc/resolv.conf (or the OS-specific configuration) in the default
1398 resolver, or the empty string to select the default configuration.
1399
1400 "PERL_ANYEVENT_CA_FILE", "PERL_ANYEVENT_CA_PATH".
1401 When neither "ca_file" nor "ca_path" was specified during
1402 AnyEvent::TLS context creation, and either of these environment
1403 variables are nonempty, they will be used to specify CA certificate
1404 locations instead of a system-dependent default.
1405
1406 "PERL_ANYEVENT_AVOID_GUARD" and "PERL_ANYEVENT_AVOID_ASYNC_INTERRUPT"
1407 When these are set to 1, then the respective modules are not loaded.
1408 Mostly good for testing AnyEvent itself.
1409
1410 SUPPLYING YOUR OWN EVENT MODEL INTERFACE
1411 This is an advanced topic that you do not normally need to use AnyEvent
1412 in a module. This section is only of use to event loop authors who want
1413 to provide AnyEvent compatibility.
1414
1415 If you need to support another event library which isn't directly
1416 supported by AnyEvent, you can supply your own interface to it by
1417 pushing, before the first watcher gets created, the package name of the
1418 event module and the package name of the interface to use onto
1419 @AnyEvent::REGISTRY. You can do that before and even without loading
1420 AnyEvent, so it is reasonably cheap.
1421
1422 Example:
1423
1424 push @AnyEvent::REGISTRY, [urxvt => urxvt::anyevent::];
1425
1426 This tells AnyEvent to (literally) use the "urxvt::anyevent::"
1427 package/class when it finds the "urxvt" package/module is already
1428 loaded.
1429
1430 When AnyEvent is loaded and asked to find a suitable event model, it
1431 will first check for the presence of urxvt by trying to "use" the
1432 "urxvt::anyevent" module.
1433
1434 The class should provide implementations for all watcher types. See
1435 AnyEvent::Impl::EV (source code), AnyEvent::Impl::Glib (Source code) and
1436 so on for actual examples. Use "perldoc -m AnyEvent::Impl::Glib" to see
1437 the sources.
1438
1439 If you don't provide "signal" and "child" watchers than AnyEvent will
1440 provide suitable (hopefully) replacements.
1441
1442 The above example isn't fictitious, the *rxvt-unicode* (a.k.a. urxvt)
1443 terminal emulator uses the above line as-is. An interface isn't included
1444 in AnyEvent because it doesn't make sense outside the embedded
1445 interpreter inside *rxvt-unicode*, and it is updated and maintained as
1446 part of the *rxvt-unicode* distribution.
1447
1448 *rxvt-unicode* also cheats a bit by not providing blocking access to
1449 condition variables: code blocking while waiting for a condition will
1450 "die". This still works with most modules/usages, and blocking calls
1451 must not be done in an interactive application, so it makes sense.
1452
1453 EXAMPLE PROGRAM
1454 The following program uses an I/O watcher to read data from STDIN, a
1455 timer to display a message once per second, and a condition variable to
1456 quit the program when the user enters quit:
1457
1458 use AnyEvent;
1459
1460 my $cv = AnyEvent->condvar;
1461
1462 my $io_watcher = AnyEvent->io (
1463 fh => \*STDIN,
1464 poll => 'r',
1465 cb => sub {
1466 warn "io event <$_[0]>\n"; # will always output <r>
1467 chomp (my $input = <STDIN>); # read a line
1468 warn "read: $input\n"; # output what has been read
1469 $cv->send if $input =~ /^q/i; # quit program if /^q/i
1470 },
1471 );
1472
1473 my $time_watcher = AnyEvent->timer (after => 1, interval => 1, cb => sub {
1474 warn "timeout\n"; # print 'timeout' at most every second
1475 });
1476
1477 $cv->recv; # wait until user enters /^q/i
1478
1479 REAL-WORLD EXAMPLE
1480 Consider the Net::FCP module. It features (among others) the following
1481 API calls, which are to freenet what HTTP GET requests are to http:
1482
1483 my $data = $fcp->client_get ($url); # blocks
1484
1485 my $transaction = $fcp->txn_client_get ($url); # does not block
1486 $transaction->cb ( sub { ... } ); # set optional result callback
1487 my $data = $transaction->result; # possibly blocks
1488
1489 The "client_get" method works like "LWP::Simple::get": it requests the
1490 given URL and waits till the data has arrived. It is defined to be:
1491
1492 sub client_get { $_[0]->txn_client_get ($_[1])->result }
1493
1494 And in fact is automatically generated. This is the blocking API of
1495 Net::FCP, and it works as simple as in any other, similar, module.
1496
1497 More complicated is "txn_client_get": It only creates a transaction
1498 (completion, result, ...) object and initiates the transaction.
1499
1500 my $txn = bless { }, Net::FCP::Txn::;
1501
1502 It also creates a condition variable that is used to signal the
1503 completion of the request:
1504
1505 $txn->{finished} = AnyAvent->condvar;
1506
1507 It then creates a socket in non-blocking mode.
1508
1509 socket $txn->{fh}, ...;
1510 fcntl $txn->{fh}, F_SETFL, O_NONBLOCK;
1511 connect $txn->{fh}, ...
1512 and !$!{EWOULDBLOCK}
1513 and !$!{EINPROGRESS}
1514 and Carp::croak "unable to connect: $!\n";
1515
1516 Then it creates a write-watcher which gets called whenever an error
1517 occurs or the connection succeeds:
1518
1519 $txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'w', cb => sub { $txn->fh_ready_w });
1520
1521 And returns this transaction object. The "fh_ready_w" callback gets
1522 called as soon as the event loop detects that the socket is ready for
1523 writing.
1524
1525 The "fh_ready_w" method makes the socket blocking again, writes the
1526 request data and replaces the watcher by a read watcher (waiting for
1527 reply data). The actual code is more complicated, but that doesn't
1528 matter for this example:
1529
1530 fcntl $txn->{fh}, F_SETFL, 0;
1531 syswrite $txn->{fh}, $txn->{request}
1532 or die "connection or write error";
1533 $txn->{w} = AnyEvent->io (fh => $txn->{fh}, poll => 'r', cb => sub { $txn->fh_ready_r });
1534
1535 Again, "fh_ready_r" waits till all data has arrived, and then stores the
1536 result and signals any possible waiters that the request has finished:
1537
1538 sysread $txn->{fh}, $txn->{buf}, length $txn->{$buf};
1539
1540 if (end-of-file or data complete) {
1541 $txn->{result} = $txn->{buf};
1542 $txn->{finished}->send;
1543 $txb->{cb}->($txn) of $txn->{cb}; # also call callback
1544 }
1545
1546 The "result" method, finally, just waits for the finished signal (if the
1547 request was already finished, it doesn't wait, of course, and returns
1548 the data:
1549
1550 $txn->{finished}->recv;
1551 return $txn->{result};
1552
1553 The actual code goes further and collects all errors ("die"s,
1554 exceptions) that occurred during request processing. The "result" method
1555 detects whether an exception as thrown (it is stored inside the $txn
1556 object) and just throws the exception, which means connection errors and
1557 other problems get reported to the code that tries to use the result,
1558 not in a random callback.
1559
1560 All of this enables the following usage styles:
1561
1562 1. Blocking:
1563
1564 my $data = $fcp->client_get ($url);
1565
1566 2. Blocking, but running in parallel:
1567
1568 my @datas = map $_->result,
1569 map $fcp->txn_client_get ($_),
1570 @urls;
1571
1572 Both blocking examples work without the module user having to know
1573 anything about events.
1574
1575 3a. Event-based in a main program, using any supported event module:
1576
1577 use EV;
1578
1579 $fcp->txn_client_get ($url)->cb (sub {
1580 my $txn = shift;
1581 my $data = $txn->result;
1582 ...
1583 });
1584
1585 EV::loop;
1586
1587 3b. The module user could use AnyEvent, too:
1588
1589 use AnyEvent;
1590
1591 my $quit = AnyEvent->condvar;
1592
1593 $fcp->txn_client_get ($url)->cb (sub {
1594 ...
1595 $quit->send;
1596 });
1597
1598 $quit->recv;
1599
1600 BENCHMARKS
1601 To give you an idea of the performance and overheads that AnyEvent adds
1602 over the event loops themselves and to give you an impression of the
1603 speed of various event loops I prepared some benchmarks.
1604
1605 BENCHMARKING ANYEVENT OVERHEAD
1606 Here is a benchmark of various supported event models used natively and
1607 through AnyEvent. The benchmark creates a lot of timers (with a zero
1608 timeout) and I/O watchers (watching STDOUT, a pty, to become writable,
1609 which it is), lets them fire exactly once and destroys them again.
1610
1611 Source code for this benchmark is found as eg/bench in the AnyEvent
1612 distribution. It uses the AE interface, which makes a real difference
1613 for the EV and Perl backends only.
1614
1615 Explanation of the columns
1616 *watcher* is the number of event watchers created/destroyed. Since
1617 different event models feature vastly different performances, each event
1618 loop was given a number of watchers so that overall runtime is
1619 acceptable and similar between tested event loop (and keep them from
1620 crashing): Glib would probably take thousands of years if asked to
1621 process the same number of watchers as EV in this benchmark.
1622
1623 *bytes* is the number of bytes (as measured by the resident set size,
1624 RSS) consumed by each watcher. This method of measuring captures both C
1625 and Perl-based overheads.
1626
1627 *create* is the time, in microseconds (millionths of seconds), that it
1628 takes to create a single watcher. The callback is a closure shared
1629 between all watchers, to avoid adding memory overhead. That means
1630 closure creation and memory usage is not included in the figures.
1631
1632 *invoke* is the time, in microseconds, used to invoke a simple callback.
1633 The callback simply counts down a Perl variable and after it was invoked
1634 "watcher" times, it would "->send" a condvar once to signal the end of
1635 this phase.
1636
1637 *destroy* is the time, in microseconds, that it takes to destroy a
1638 single watcher.
1639
1640 Results
1641 name watchers bytes create invoke destroy comment
1642 EV/EV 100000 223 0.47 0.43 0.27 EV native interface
1643 EV/Any 100000 223 0.48 0.42 0.26 EV + AnyEvent watchers
1644 Coro::EV/Any 100000 223 0.47 0.42 0.26 coroutines + Coro::Signal
1645 Perl/Any 100000 431 2.70 0.74 0.92 pure perl implementation
1646 Event/Event 16000 516 31.16 31.84 0.82 Event native interface
1647 Event/Any 16000 1203 42.61 34.79 1.80 Event + AnyEvent watchers
1648 IOAsync/Any 16000 1911 41.92 27.45 16.81 via IO::Async::Loop::IO_Poll
1649 IOAsync/Any 16000 1726 40.69 26.37 15.25 via IO::Async::Loop::Epoll
1650 Glib/Any 16000 1118 89.00 12.57 51.17 quadratic behaviour
1651 Tk/Any 2000 1346 20.96 10.75 8.00 SEGV with >> 2000 watchers
1652 POE/Any 2000 6951 108.97 795.32 14.24 via POE::Loop::Event
1653 POE/Any 2000 6648 94.79 774.40 575.51 via POE::Loop::Select
1654
1655 Discussion
1656 The benchmark does *not* measure scalability of the event loop very
1657 well. For example, a select-based event loop (such as the pure perl one)
1658 can never compete with an event loop that uses epoll when the number of
1659 file descriptors grows high. In this benchmark, all events become ready
1660 at the same time, so select/poll-based implementations get an unnatural
1661 speed boost.
1662
1663 Also, note that the number of watchers usually has a nonlinear effect on
1664 overall speed, that is, creating twice as many watchers doesn't take
1665 twice the time - usually it takes longer. This puts event loops tested
1666 with a higher number of watchers at a disadvantage.
1667
1668 To put the range of results into perspective, consider that on the
1669 benchmark machine, handling an event takes roughly 1600 CPU cycles with
1670 EV, 3100 CPU cycles with AnyEvent's pure perl loop and almost 3000000
1671 CPU cycles with POE.
1672
1673 "EV" is the sole leader regarding speed and memory use, which are both
1674 maximal/minimal, respectively. When using the AE API there is zero
1675 overhead (when going through the AnyEvent API create is about 5-6 times
1676 slower, with other times being equal, so still uses far less memory than
1677 any other event loop and is still faster than Event natively).
1678
1679 The pure perl implementation is hit in a few sweet spots (both the
1680 constant timeout and the use of a single fd hit optimisations in the
1681 perl interpreter and the backend itself). Nevertheless this shows that
1682 it adds very little overhead in itself. Like any select-based backend
1683 its performance becomes really bad with lots of file descriptors (and
1684 few of them active), of course, but this was not subject of this
1685 benchmark.
1686
1687 The "Event" module has a relatively high setup and callback invocation
1688 cost, but overall scores in on the third place.
1689
1690 "IO::Async" performs admirably well, about on par with "Event", even
1691 when using its pure perl backend.
1692
1693 "Glib"'s memory usage is quite a bit higher, but it features a faster
1694 callback invocation and overall ends up in the same class as "Event".
1695 However, Glib scales extremely badly, doubling the number of watchers
1696 increases the processing time by more than a factor of four, making it
1697 completely unusable when using larger numbers of watchers (note that
1698 only a single file descriptor was used in the benchmark, so
1699 inefficiencies of "poll" do not account for this).
1700
1701 The "Tk" adaptor works relatively well. The fact that it crashes with
1702 more than 2000 watchers is a big setback, however, as correctness takes
1703 precedence over speed. Nevertheless, its performance is surprising, as
1704 the file descriptor is dup()ed for each watcher. This shows that the
1705 dup() employed by some adaptors is not a big performance issue (it does
1706 incur a hidden memory cost inside the kernel which is not reflected in
1707 the figures above).
1708
1709 "POE", regardless of underlying event loop (whether using its pure perl
1710 select-based backend or the Event module, the POE-EV backend couldn't be
1711 tested because it wasn't working) shows abysmal performance and memory
1712 usage with AnyEvent: Watchers use almost 30 times as much memory as EV
1713 watchers, and 10 times as much memory as Event (the high memory
1714 requirements are caused by requiring a session for each watcher).
1715 Watcher invocation speed is almost 900 times slower than with AnyEvent's
1716 pure perl implementation.
1717
1718 The design of the POE adaptor class in AnyEvent can not really account
1719 for the performance issues, though, as session creation overhead is
1720 small compared to execution of the state machine, which is coded pretty
1721 optimally within AnyEvent::Impl::POE (and while everybody agrees that
1722 using multiple sessions is not a good approach, especially regarding
1723 memory usage, even the author of POE could not come up with a faster
1724 design).
1725
1726 Summary
1727 * Using EV through AnyEvent is faster than any other event loop (even
1728 when used without AnyEvent), but most event loops have acceptable
1729 performance with or without AnyEvent.
1730
1731 * The overhead AnyEvent adds is usually much smaller than the overhead
1732 of the actual event loop, only with extremely fast event loops such
1733 as EV does AnyEvent add significant overhead.
1734
1735 * You should avoid POE like the plague if you want performance or
1736 reasonable memory usage.
1737
1738 BENCHMARKING THE LARGE SERVER CASE
1739 This benchmark actually benchmarks the event loop itself. It works by
1740 creating a number of "servers": each server consists of a socket pair, a
1741 timeout watcher that gets reset on activity (but never fires), and an
1742 I/O watcher waiting for input on one side of the socket. Each time the
1743 socket watcher reads a byte it will write that byte to a random other
1744 "server".
1745
1746 The effect is that there will be a lot of I/O watchers, only part of
1747 which are active at any one point (so there is a constant number of
1748 active fds for each loop iteration, but which fds these are is random).
1749 The timeout is reset each time something is read because that reflects
1750 how most timeouts work (and puts extra pressure on the event loops).
1751
1752 In this benchmark, we use 10000 socket pairs (20000 sockets), of which
1753 100 (1%) are active. This mirrors the activity of large servers with
1754 many connections, most of which are idle at any one point in time.
1755
1756 Source code for this benchmark is found as eg/bench2 in the AnyEvent
1757 distribution. It uses the AE interface, which makes a real difference
1758 for the EV and Perl backends only.
1759
1760 Explanation of the columns
1761 *sockets* is the number of sockets, and twice the number of "servers"
1762 (as each server has a read and write socket end).
1763
1764 *create* is the time it takes to create a socket pair (which is
1765 nontrivial) and two watchers: an I/O watcher and a timeout watcher.
1766
1767 *request*, the most important value, is the time it takes to handle a
1768 single "request", that is, reading the token from the pipe and
1769 forwarding it to another server. This includes deleting the old timeout
1770 and creating a new one that moves the timeout into the future.
1771
1772 Results
1773 name sockets create request
1774 EV 20000 62.66 7.99
1775 Perl 20000 68.32 32.64
1776 IOAsync 20000 174.06 101.15 epoll
1777 IOAsync 20000 174.67 610.84 poll
1778 Event 20000 202.69 242.91
1779 Glib 20000 557.01 1689.52
1780 POE 20000 341.54 12086.32 uses POE::Loop::Event
1781
1782 Discussion
1783 This benchmark *does* measure scalability and overall performance of the
1784 particular event loop.
1785
1786 EV is again fastest. Since it is using epoll on my system, the setup
1787 time is relatively high, though.
1788
1789 Perl surprisingly comes second. It is much faster than the C-based event
1790 loops Event and Glib.
1791
1792 IO::Async performs very well when using its epoll backend, and still
1793 quite good compared to Glib when using its pure perl backend.
1794
1795 Event suffers from high setup time as well (look at its code and you
1796 will understand why). Callback invocation also has a high overhead
1797 compared to the "$_->() for .."-style loop that the Perl event loop
1798 uses. Event uses select or poll in basically all documented
1799 configurations.
1800
1801 Glib is hit hard by its quadratic behaviour w.r.t. many watchers. It
1802 clearly fails to perform with many filehandles or in busy servers.
1803
1804 POE is still completely out of the picture, taking over 1000 times as
1805 long as EV, and over 100 times as long as the Perl implementation, even
1806 though it uses a C-based event loop in this case.
1807
1808 Summary
1809 * The pure perl implementation performs extremely well.
1810
1811 * Avoid Glib or POE in large projects where performance matters.
1812
1813 BENCHMARKING SMALL SERVERS
1814 While event loops should scale (and select-based ones do not...) even to
1815 large servers, most programs we (or I :) actually write have only a few
1816 I/O watchers.
1817
1818 In this benchmark, I use the same benchmark program as in the large
1819 server case, but it uses only eight "servers", of which three are active
1820 at any one time. This should reflect performance for a small server
1821 relatively well.
1822
1823 The columns are identical to the previous table.
1824
1825 Results
1826 name sockets create request
1827 EV 16 20.00 6.54
1828 Perl 16 25.75 12.62
1829 Event 16 81.27 35.86
1830 Glib 16 32.63 15.48
1831 POE 16 261.87 276.28 uses POE::Loop::Event
1832
1833 Discussion
1834 The benchmark tries to test the performance of a typical small server.
1835 While knowing how various event loops perform is interesting, keep in
1836 mind that their overhead in this case is usually not as important, due
1837 to the small absolute number of watchers (that is, you need efficiency
1838 and speed most when you have lots of watchers, not when you only have a
1839 few of them).
1840
1841 EV is again fastest.
1842
1843 Perl again comes second. It is noticeably faster than the C-based event
1844 loops Event and Glib, although the difference is too small to really
1845 matter.
1846
1847 POE also performs much better in this case, but is is still far behind
1848 the others.
1849
1850 Summary
1851 * C-based event loops perform very well with small number of watchers,
1852 as the management overhead dominates.
1853
1854 THE IO::Lambda BENCHMARK
1855 Recently I was told about the benchmark in the IO::Lambda manpage, which
1856 could be misinterpreted to make AnyEvent look bad. In fact, the
1857 benchmark simply compares IO::Lambda with POE, and IO::Lambda looks
1858 better (which shouldn't come as a surprise to anybody). As such, the
1859 benchmark is fine, and mostly shows that the AnyEvent backend from
1860 IO::Lambda isn't very optimal. But how would AnyEvent compare when used
1861 without the extra baggage? To explore this, I wrote the equivalent
1862 benchmark for AnyEvent.
1863
1864 The benchmark itself creates an echo-server, and then, for 500 times,
1865 connects to the echo server, sends a line, waits for the reply, and then
1866 creates the next connection. This is a rather bad benchmark, as it
1867 doesn't test the efficiency of the framework or much non-blocking I/O,
1868 but it is a benchmark nevertheless.
1869
1870 name runtime
1871 Lambda/select 0.330 sec
1872 + optimized 0.122 sec
1873 Lambda/AnyEvent 0.327 sec
1874 + optimized 0.138 sec
1875 Raw sockets/select 0.077 sec
1876 POE/select, components 0.662 sec
1877 POE/select, raw sockets 0.226 sec
1878 POE/select, optimized 0.404 sec
1879
1880 AnyEvent/select/nb 0.085 sec
1881 AnyEvent/EV/nb 0.068 sec
1882 +state machine 0.134 sec
1883
1884 The benchmark is also a bit unfair (my fault): the IO::Lambda/POE
1885 benchmarks actually make blocking connects and use 100% blocking I/O,
1886 defeating the purpose of an event-based solution. All of the newly
1887 written AnyEvent benchmarks use 100% non-blocking connects (using
1888 AnyEvent::Socket::tcp_connect and the asynchronous pure perl DNS
1889 resolver), so AnyEvent is at a disadvantage here, as non-blocking
1890 connects generally require a lot more bookkeeping and event handling
1891 than blocking connects (which involve a single syscall only).
1892
1893 The last AnyEvent benchmark additionally uses AnyEvent::Handle, which
1894 offers similar expressive power as POE and IO::Lambda, using
1895 conventional Perl syntax. This means that both the echo server and the
1896 client are 100% non-blocking, further placing it at a disadvantage.
1897
1898 As you can see, the AnyEvent + EV combination even beats the
1899 hand-optimised "raw sockets benchmark", while AnyEvent + its pure perl
1900 backend easily beats IO::Lambda and POE.
1901
1902 And even the 100% non-blocking version written using the high-level (and
1903 slow :) AnyEvent::Handle abstraction beats both POE and IO::Lambda
1904 higher level ("unoptimised") abstractions by a large margin, even though
1905 it does all of DNS, tcp-connect and socket I/O in a non-blocking way.
1906
1907 The two AnyEvent benchmarks programs can be found as eg/ae0.pl and
1908 eg/ae2.pl in the AnyEvent distribution, the remaining benchmarks are
1909 part of the IO::Lambda distribution and were used without any changes.
1910
1911 SIGNALS
1912 AnyEvent currently installs handlers for these signals:
1913
1914 SIGCHLD
1915 A handler for "SIGCHLD" is installed by AnyEvent's child watcher
1916 emulation for event loops that do not support them natively. Also,
1917 some event loops install a similar handler.
1918
1919 Additionally, when AnyEvent is loaded and SIGCHLD is set to IGNORE,
1920 then AnyEvent will reset it to default, to avoid losing child exit
1921 statuses.
1922
1923 SIGPIPE
1924 A no-op handler is installed for "SIGPIPE" when $SIG{PIPE} is
1925 "undef" when AnyEvent gets loaded.
1926
1927 The rationale for this is that AnyEvent users usually do not really
1928 depend on SIGPIPE delivery (which is purely an optimisation for
1929 shell use, or badly-written programs), but "SIGPIPE" can cause
1930 spurious and rare program exits as a lot of people do not expect
1931 "SIGPIPE" when writing to some random socket.
1932
1933 The rationale for installing a no-op handler as opposed to ignoring
1934 it is that this way, the handler will be restored to defaults on
1935 exec.
1936
1937 Feel free to install your own handler, or reset it to defaults.
1938
1939 RECOMMENDED/OPTIONAL MODULES
1940 One of AnyEvent's main goals is to be 100% Pure-Perl(tm): only perl (and
1941 its built-in modules) are required to use it.
1942
1943 That does not mean that AnyEvent won't take advantage of some additional
1944 modules if they are installed.
1945
1946 This section explains which additional modules will be used, and how
1947 they affect AnyEvent's operation.
1948
1949 Async::Interrupt
1950 This slightly arcane module is used to implement fast signal
1951 handling: To my knowledge, there is no way to do completely
1952 race-free and quick signal handling in pure perl. To ensure that
1953 signals still get delivered, AnyEvent will start an interval timer
1954 to wake up perl (and catch the signals) with some delay (default is
1955 10 seconds, look for $AnyEvent::MAX_SIGNAL_LATENCY).
1956
1957 If this module is available, then it will be used to implement
1958 signal catching, which means that signals will not be delayed, and
1959 the event loop will not be interrupted regularly, which is more
1960 efficient (and good for battery life on laptops).
1961
1962 This affects not just the pure-perl event loop, but also other event
1963 loops that have no signal handling on their own (e.g. Glib, Tk, Qt).
1964
1965 Some event loops (POE, Event, Event::Lib) offer signal watchers
1966 natively, and either employ their own workarounds (POE) or use
1967 AnyEvent's workaround (using $AnyEvent::MAX_SIGNAL_LATENCY).
1968 Installing Async::Interrupt does nothing for those backends.
1969
1970 EV This module isn't really "optional", as it is simply one of the
1971 backend event loops that AnyEvent can use. However, it is simply the
1972 best event loop available in terms of features, speed and stability:
1973 It supports the AnyEvent API optimally, implements all the watcher
1974 types in XS, does automatic timer adjustments even when no monotonic
1975 clock is available, can take avdantage of advanced kernel interfaces
1976 such as "epoll" and "kqueue", and is the fastest backend *by far*.
1977 You can even embed Glib/Gtk2 in it (or vice versa, see EV::Glib and
1978 Glib::EV).
1979
1980 If you only use backends that rely on another event loop (e.g.
1981 "Tk"), then this module will do nothing for you.
1982
1983 Guard
1984 The guard module, when used, will be used to implement
1985 "AnyEvent::Util::guard". This speeds up guards considerably (and
1986 uses a lot less memory), but otherwise doesn't affect guard
1987 operation much. It is purely used for performance.
1988
1989 JSON and JSON::XS
1990 One of these modules is required when you want to read or write JSON
1991 data via AnyEvent::Handle. JSON is also written in pure-perl, but
1992 can take advantage of the ultra-high-speed JSON::XS module when it
1993 is installed.
1994
1995 Net::SSLeay
1996 Implementing TLS/SSL in Perl is certainly interesting, but not very
1997 worthwhile: If this module is installed, then AnyEvent::Handle (with
1998 the help of AnyEvent::TLS), gains the ability to do TLS/SSL.
1999
2000 Time::HiRes
2001 This module is part of perl since release 5.008. It will be used
2002 when the chosen event library does not come with a timing source of
2003 its own. The pure-perl event loop (AnyEvent::Loop) will additionally
2004 load it to try to use a monotonic clock for timing stability.
2005
2006 FORK
2007 Most event libraries are not fork-safe. The ones who are usually are
2008 because they rely on inefficient but fork-safe "select" or "poll" calls
2009 - higher performance APIs such as BSD's kqueue or the dreaded Linux
2010 epoll are usually badly thought-out hacks that are incompatible with
2011 fork in one way or another. Only EV is fully fork-aware and ensures that
2012 you continue event-processing in both parent and child (or both, if you
2013 know what you are doing).
2014
2015 This means that, in general, you cannot fork and do event processing in
2016 the child if the event library was initialised before the fork (which
2017 usually happens when the first AnyEvent watcher is created, or the
2018 library is loaded).
2019
2020 If you have to fork, you must either do so *before* creating your first
2021 watcher OR you must not use AnyEvent at all in the child OR you must do
2022 something completely out of the scope of AnyEvent.
2023
2024 The problem of doing event processing in the parent *and* the child is
2025 much more complicated: even for backends that *are* fork-aware or
2026 fork-safe, their behaviour is not usually what you want: fork clones all
2027 watchers, that means all timers, I/O watchers etc. are active in both
2028 parent and child, which is almost never what you want. USing "exec" to
2029 start worker children from some kind of manage rprocess is usually
2030 preferred, because it is much easier and cleaner, at the expense of
2031 having to have another binary.
2032
2033 SECURITY CONSIDERATIONS
2034 AnyEvent can be forced to load any event model via
2035 $ENV{PERL_ANYEVENT_MODEL}. While this cannot (to my knowledge) be used
2036 to execute arbitrary code or directly gain access, it can easily be used
2037 to make the program hang or malfunction in subtle ways, as AnyEvent
2038 watchers will not be active when the program uses a different event
2039 model than specified in the variable.
2040
2041 You can make AnyEvent completely ignore this variable by deleting it
2042 before the first watcher gets created, e.g. with a "BEGIN" block:
2043
2044 BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} }
2045
2046 use AnyEvent;
2047
2048 Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can
2049 be used to probe what backend is used and gain other information (which
2050 is probably even less useful to an attacker than PERL_ANYEVENT_MODEL),
2051 and $ENV{PERL_ANYEVENT_STRICT}.
2052
2053 Note that AnyEvent will remove *all* environment variables starting with
2054 "PERL_ANYEVENT_" from %ENV when it is loaded while taint mode is
2055 enabled.
2056
2057 BUGS
2058 Perl 5.8 has numerous memleaks that sometimes hit this module and are
2059 hard to work around. If you suffer from memleaks, first upgrade to Perl
2060 5.10 and check wether the leaks still show up. (Perl 5.10.0 has other
2061 annoying memleaks, such as leaking on "map" and "grep" but it is usually
2062 not as pronounced).
2063
2064 SEE ALSO
2065 Tutorial/Introduction: AnyEvent::Intro.
2066
2067 FAQ: AnyEvent::FAQ.
2068
2069 Utility functions: AnyEvent::Util (misc. grab-bag), AnyEvent::Log
2070 (simply logging).
2071
2072 Development/Debugging: AnyEvent::Strict (stricter checking),
2073 AnyEvent::Debug (interactive shell, watcher tracing).
2074
2075 Supported event modules: AnyEvent::Loop, EV, EV::Glib, Glib::EV, Event,
2076 Glib::Event, Glib, Tk, Event::Lib, Qt, POE, FLTK.
2077
2078 Implementations: AnyEvent::Impl::EV, AnyEvent::Impl::Event,
2079 AnyEvent::Impl::Glib, AnyEvent::Impl::Tk, AnyEvent::Impl::Perl,
2080 AnyEvent::Impl::EventLib, AnyEvent::Impl::Qt, AnyEvent::Impl::POE,
2081 AnyEvent::Impl::IOAsync, Anyevent::Impl::Irssi, AnyEvent::Impl::FLTK.
2082
2083 Non-blocking handles, pipes, stream sockets, TCP clients and servers:
2084 AnyEvent::Handle, AnyEvent::Socket, AnyEvent::TLS.
2085
2086 Asynchronous File I/O: AnyEvent::IO.
2087
2088 Asynchronous DNS: AnyEvent::DNS.
2089
2090 Thread support: Coro, Coro::AnyEvent, Coro::EV, Coro::Event.
2091
2092 Nontrivial usage examples: AnyEvent::GPSD, AnyEvent::IRC,
2093 AnyEvent::HTTP.
2094
2095 AUTHOR
2096 Marc Lehmann <schmorp@schmorp.de>
2097 http://anyevent.schmorp.de
2098