ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/README
(Generate patch)

Comparing AnyEvent/README (file contents):
Revision 1.37 by root, Mon Apr 20 14:34:18 2009 UTC vs.
Revision 1.41 by root, Fri Jun 26 06:33:17 2009 UTC

1NAME 1NAME
2 AnyEvent - provide framework for multiple event loops 2 AnyEvent - provide framework for multiple event loops
3 3
4 EV, Event, Glib, Tk, Perl, Event::Lib, Qt, POE - various supported event 4 EV, Event, Glib, Tk, Perl, Event::Lib, Qt and POE are various supported
5 loops 5 event loops.
6 6
7SYNOPSIS 7SYNOPSIS
8 use AnyEvent; 8 use AnyEvent;
9 9
10 # file descriptor readable
10 my $w = AnyEvent->io (fh => $fh, poll => "r|w", cb => sub { ... }); 11 my $w = AnyEvent->io (fh => $fh, poll => "r", cb => sub { ... });
11 12
13 # one-shot or repeating timers
12 my $w = AnyEvent->timer (after => $seconds, cb => sub { ... }); 14 my $w = AnyEvent->timer (after => $seconds, cb => sub { ... });
13 my $w = AnyEvent->timer (after => $seconds, interval => $seconds, cb => ... 15 my $w = AnyEvent->timer (after => $seconds, interval => $seconds, cb => ...
14 16
15 print AnyEvent->now; # prints current event loop time 17 print AnyEvent->now; # prints current event loop time
16 print AnyEvent->time; # think Time::HiRes::time or simply CORE::time. 18 print AnyEvent->time; # think Time::HiRes::time or simply CORE::time.
17 19
20 # POSIX signal
18 my $w = AnyEvent->signal (signal => "TERM", cb => sub { ... }); 21 my $w = AnyEvent->signal (signal => "TERM", cb => sub { ... });
19 22
23 # child process exit
20 my $w = AnyEvent->child (pid => $pid, cb => sub { 24 my $w = AnyEvent->child (pid => $pid, cb => sub {
21 my ($pid, $status) = @_; 25 my ($pid, $status) = @_;
22 ... 26 ...
23 }); 27 });
28
29 # called when event loop idle (if applicable)
30 my $w = AnyEvent->idle (cb => sub { ... });
24 31
25 my $w = AnyEvent->condvar; # stores whether a condition was flagged 32 my $w = AnyEvent->condvar; # stores whether a condition was flagged
26 $w->send; # wake up current and all future recv's 33 $w->send; # wake up current and all future recv's
27 $w->recv; # enters "main loop" till $condvar gets ->send 34 $w->recv; # enters "main loop" till $condvar gets ->send
28 # use a condvar in callback mode: 35 # use a condvar in callback mode:
373 380
374 There is a slight catch to child watchers, however: you usually start 381 There is a slight catch to child watchers, however: you usually start
375 them *after* the child process was created, and this means the process 382 them *after* the child process was created, and this means the process
376 could have exited already (and no SIGCHLD will be sent anymore). 383 could have exited already (and no SIGCHLD will be sent anymore).
377 384
378 Not all event models handle this correctly (POE doesn't), but even for 385 Not all event models handle this correctly (neither POE nor IO::Async
386 do, see their AnyEvent::Impl manpages for details), but even for event
379 event models that *do* handle this correctly, they usually need to be 387 models that *do* handle this correctly, they usually need to be loaded
380 loaded before the process exits (i.e. before you fork in the first 388 before the process exits (i.e. before you fork in the first place).
381 place). 389 AnyEvent's pure perl event loop handles all cases correctly regardless
390 of when you start the watcher.
382 391
383 This means you cannot create a child watcher as the very first thing in 392 This means you cannot create a child watcher as the very first thing in
384 an AnyEvent program, you *have* to create at least one watcher before 393 an AnyEvent program, you *have* to create at least one watcher before
385 you "fork" the child (alternatively, you can call "AnyEvent::detect"). 394 you "fork" the child (alternatively, you can call "AnyEvent::detect").
386 395
387 Example: fork a process and wait for it 396 Example: fork a process and wait for it
388 397
389 my $done = AnyEvent->condvar; 398 my $done = AnyEvent->condvar;
390 399
391 my $pid = fork or exit 5; 400 my $pid = fork or exit 5;
392 401
393 my $w = AnyEvent->child ( 402 my $w = AnyEvent->child (
394 pid => $pid, 403 pid => $pid,
395 cb => sub { 404 cb => sub {
396 my ($pid, $status) = @_; 405 my ($pid, $status) = @_;
397 warn "pid $pid exited with status $status"; 406 warn "pid $pid exited with status $status";
398 $done->send; 407 $done->send;
399 }, 408 },
400 ); 409 );
401 410
402 # do something else, then wait for process exit 411 # do something else, then wait for process exit
403 $done->recv; 412 $done->recv;
413
414 IDLE WATCHERS
415 Sometimes there is a need to do something, but it is not so important to
416 do it instantly, but only when there is nothing better to do. This
417 "nothing better to do" is usually defined to be "no other events need
418 attention by the event loop".
419
420 Idle watchers ideally get invoked when the event loop has nothing better
421 to do, just before it would block the process to wait for new events.
422 Instead of blocking, the idle watcher is invoked.
423
424 Most event loops unfortunately do not really support idle watchers (only
425 EV, Event and Glib do it in a usable fashion) - for the rest, AnyEvent
426 will simply call the callback "from time to time".
427
428 Example: read lines from STDIN, but only process them when the program
429 is otherwise idle:
430
431 my @lines; # read data
432 my $idle_w;
433 my $io_w = AnyEvent->io (fh => \*STDIN, poll => 'r', cb => sub {
434 push @lines, scalar <STDIN>;
435
436 # start an idle watcher, if not already done
437 $idle_w ||= AnyEvent->idle (cb => sub {
438 # handle only one line, when there are lines left
439 if (my $line = shift @lines) {
440 print "handled when idle: $line";
441 } else {
442 # otherwise disable the idle watcher again
443 undef $idle_w;
444 }
445 });
446 });
404 447
405 CONDITION VARIABLES 448 CONDITION VARIABLES
406 If you are familiar with some event loops you will know that all of them 449 If you are familiar with some event loops you will know that all of them
407 require you to run some blocking "loop", "run" or similar function that 450 require you to run some blocking "loop", "run" or similar function that
408 will actively watch for new events and call your callbacks. 451 will actively watch for new events and call your callbacks.
656 AnyEvent::Impl::Tk based on Tk, very bad choice. 699 AnyEvent::Impl::Tk based on Tk, very bad choice.
657 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs). 700 AnyEvent::Impl::Qt based on Qt, cannot be autoprobed (see its docs).
658 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse. 701 AnyEvent::Impl::EventLib based on Event::Lib, leaks memory and worse.
659 AnyEvent::Impl::POE based on POE, not generic enough for full support. 702 AnyEvent::Impl::POE based on POE, not generic enough for full support.
660 703
704 # warning, support for IO::Async is only partial, as it is too broken
705 # and limited toe ven support the AnyEvent API. See AnyEvent::Impl::Async.
706 AnyEvent::Impl::IOAsync based on IO::Async, cannot be autoprobed (see its docs).
707
661 There is no support for WxWidgets, as WxWidgets has no support for 708 There is no support for WxWidgets, as WxWidgets has no support for
662 watching file handles. However, you can use WxWidgets through the 709 watching file handles. However, you can use WxWidgets through the
663 POE Adaptor, as POE has a Wx backend that simply polls 20 times per 710 POE Adaptor, as POE has a Wx backend that simply polls 20 times per
664 second, which was considered to be too horrible to even consider for 711 second, which was considered to be too horrible to even consider for
665 AnyEvent. Likewise, other POE backends can be used by AnyEvent by 712 AnyEvent. Likewise, other POE backends can be used by AnyEvent by
842 "condvar->recv"), the Event and EV modules call "$Event/EV::DIED->()", 889 "condvar->recv"), the Event and EV modules call "$Event/EV::DIED->()",
843 Glib uses "install_exception_handler" and so on. 890 Glib uses "install_exception_handler" and so on.
844 891
845ENVIRONMENT VARIABLES 892ENVIRONMENT VARIABLES
846 The following environment variables are used by this module or its 893 The following environment variables are used by this module or its
847 submodules: 894 submodules.
895
896 Note that AnyEvent will remove *all* environment variables starting with
897 "PERL_ANYEVENT_" from %ENV when it is loaded while taint mode is
898 enabled.
848 899
849 "PERL_ANYEVENT_VERBOSE" 900 "PERL_ANYEVENT_VERBOSE"
850 By default, AnyEvent will be completely silent except in fatal 901 By default, AnyEvent will be completely silent except in fatal
851 conditions. You can set this environment variable to make AnyEvent 902 conditions. You can set this environment variable to make AnyEvent
852 more talkative. 903 more talkative.
861 "PERL_ANYEVENT_STRICT" 912 "PERL_ANYEVENT_STRICT"
862 AnyEvent does not do much argument checking by default, as thorough 913 AnyEvent does not do much argument checking by default, as thorough
863 argument checking is very costly. Setting this variable to a true 914 argument checking is very costly. Setting this variable to a true
864 value will cause AnyEvent to load "AnyEvent::Strict" and then to 915 value will cause AnyEvent to load "AnyEvent::Strict" and then to
865 thoroughly check the arguments passed to most method calls. If it 916 thoroughly check the arguments passed to most method calls. If it
866 finds any problems it will croak. 917 finds any problems, it will croak.
867 918
868 In other words, enables "strict" mode. 919 In other words, enables "strict" mode.
869 920
870 Unlike "use strict", it is definitely recommended ot keep it off in 921 Unlike "use strict", it is definitely recommended to keep it off in
871 production. Keeping "PERL_ANYEVENT_STRICT=1" in your environment 922 production. Keeping "PERL_ANYEVENT_STRICT=1" in your environment
872 while developing programs can be very useful, however. 923 while developing programs can be very useful, however.
873 924
874 "PERL_ANYEVENT_MODEL" 925 "PERL_ANYEVENT_MODEL"
875 This can be used to specify the event model to be used by AnyEvent, 926 This can be used to specify the event model to be used by AnyEvent,
1163 EV/Any 100000 224 2.88 0.34 0.27 EV + AnyEvent watchers 1214 EV/Any 100000 224 2.88 0.34 0.27 EV + AnyEvent watchers
1164 CoroEV/Any 100000 224 2.85 0.35 0.28 coroutines + Coro::Signal 1215 CoroEV/Any 100000 224 2.85 0.35 0.28 coroutines + Coro::Signal
1165 Perl/Any 100000 452 4.13 0.73 0.95 pure perl implementation 1216 Perl/Any 100000 452 4.13 0.73 0.95 pure perl implementation
1166 Event/Event 16000 517 32.20 31.80 0.81 Event native interface 1217 Event/Event 16000 517 32.20 31.80 0.81 Event native interface
1167 Event/Any 16000 590 35.85 31.55 1.06 Event + AnyEvent watchers 1218 Event/Any 16000 590 35.85 31.55 1.06 Event + AnyEvent watchers
1219 IOAsync/Any 16000 989 38.10 32.77 11.13 via IO::Async::Loop::IO_Poll
1220 IOAsync/Any 16000 990 37.59 29.50 10.61 via IO::Async::Loop::Epoll
1168 Glib/Any 16000 1357 102.33 12.31 51.00 quadratic behaviour 1221 Glib/Any 16000 1357 102.33 12.31 51.00 quadratic behaviour
1169 Tk/Any 2000 1860 27.20 66.31 14.00 SEGV with >> 2000 watchers 1222 Tk/Any 2000 1860 27.20 66.31 14.00 SEGV with >> 2000 watchers
1170 POE/Event 2000 6328 109.99 751.67 14.02 via POE::Loop::Event 1223 POE/Event 2000 6328 109.99 751.67 14.02 via POE::Loop::Event
1171 POE/Select 2000 6027 94.54 809.13 579.80 via POE::Loop::Select 1224 POE/Select 2000 6027 94.54 809.13 579.80 via POE::Loop::Select
1172 1225
1201 few of them active), of course, but this was not subject of this 1254 few of them active), of course, but this was not subject of this
1202 benchmark. 1255 benchmark.
1203 1256
1204 The "Event" module has a relatively high setup and callback invocation 1257 The "Event" module has a relatively high setup and callback invocation
1205 cost, but overall scores in on the third place. 1258 cost, but overall scores in on the third place.
1259
1260 "IO::Async" performs admirably well, about on par with "Event", even
1261 when using its pure perl backend.
1206 1262
1207 "Glib"'s memory usage is quite a bit higher, but it features a faster 1263 "Glib"'s memory usage is quite a bit higher, but it features a faster
1208 callback invocation and overall ends up in the same class as "Event". 1264 callback invocation and overall ends up in the same class as "Event".
1209 However, Glib scales extremely badly, doubling the number of watchers 1265 However, Glib scales extremely badly, doubling the number of watchers
1210 increases the processing time by more than a factor of four, making it 1266 increases the processing time by more than a factor of four, making it
1281 single "request", that is, reading the token from the pipe and 1337 single "request", that is, reading the token from the pipe and
1282 forwarding it to another server. This includes deleting the old timeout 1338 forwarding it to another server. This includes deleting the old timeout
1283 and creating a new one that moves the timeout into the future. 1339 and creating a new one that moves the timeout into the future.
1284 1340
1285 Results 1341 Results
1286 name sockets create request 1342 name sockets create request
1287 EV 20000 69.01 11.16 1343 EV 20000 69.01 11.16
1288 Perl 20000 73.32 35.87 1344 Perl 20000 73.32 35.87
1345 IOAsync 20000 157.00 98.14 epoll
1346 IOAsync 20000 159.31 616.06 poll
1289 Event 20000 212.62 257.32 1347 Event 20000 212.62 257.32
1290 Glib 20000 651.16 1896.30 1348 Glib 20000 651.16 1896.30
1291 POE 20000 349.67 12317.24 uses POE::Loop::Event 1349 POE 20000 349.67 12317.24 uses POE::Loop::Event
1292 1350
1293 Discussion 1351 Discussion
1294 This benchmark *does* measure scalability and overall performance of the 1352 This benchmark *does* measure scalability and overall performance of the
1295 particular event loop. 1353 particular event loop.
1296 1354
1297 EV is again fastest. Since it is using epoll on my system, the setup 1355 EV is again fastest. Since it is using epoll on my system, the setup
1298 time is relatively high, though. 1356 time is relatively high, though.
1299 1357
1300 Perl surprisingly comes second. It is much faster than the C-based event 1358 Perl surprisingly comes second. It is much faster than the C-based event
1301 loops Event and Glib. 1359 loops Event and Glib.
1360
1361 IO::Async performs very well when using its epoll backend, and still
1362 quite good compared to Glib when using its pure perl backend.
1302 1363
1303 Event suffers from high setup time as well (look at its code and you 1364 Event suffers from high setup time as well (look at its code and you
1304 will understand why). Callback invocation also has a high overhead 1365 will understand why). Callback invocation also has a high overhead
1305 compared to the "$_->() for .."-style loop that the Perl event loop 1366 compared to the "$_->() for .."-style loop that the Perl event loop
1306 uses. Event uses select or poll in basically all documented 1367 uses. Event uses select or poll in basically all documented
1357 1418
1358 Summary 1419 Summary
1359 * C-based event loops perform very well with small number of watchers, 1420 * C-based event loops perform very well with small number of watchers,
1360 as the management overhead dominates. 1421 as the management overhead dominates.
1361 1422
1423 THE IO::Lambda BENCHMARK
1424 Recently I was told about the benchmark in the IO::Lambda manpage, which
1425 could be misinterpreted to make AnyEvent look bad. In fact, the
1426 benchmark simply compares IO::Lambda with POE, and IO::Lambda looks
1427 better (which shouldn't come as a surprise to anybody). As such, the
1428 benchmark is fine, and mostly shows that the AnyEvent backend from
1429 IO::Lambda isn't very optimal. But how would AnyEvent compare when used
1430 without the extra baggage? To explore this, I wrote the equivalent
1431 benchmark for AnyEvent.
1432
1433 The benchmark itself creates an echo-server, and then, for 500 times,
1434 connects to the echo server, sends a line, waits for the reply, and then
1435 creates the next connection. This is a rather bad benchmark, as it
1436 doesn't test the efficiency of the framework or much non-blocking I/O,
1437 but it is a benchmark nevertheless.
1438
1439 name runtime
1440 Lambda/select 0.330 sec
1441 + optimized 0.122 sec
1442 Lambda/AnyEvent 0.327 sec
1443 + optimized 0.138 sec
1444 Raw sockets/select 0.077 sec
1445 POE/select, components 0.662 sec
1446 POE/select, raw sockets 0.226 sec
1447 POE/select, optimized 0.404 sec
1448
1449 AnyEvent/select/nb 0.085 sec
1450 AnyEvent/EV/nb 0.068 sec
1451 +state machine 0.134 sec
1452
1453 The benchmark is also a bit unfair (my fault): the IO::Lambda/POE
1454 benchmarks actually make blocking connects and use 100% blocking I/O,
1455 defeating the purpose of an event-based solution. All of the newly
1456 written AnyEvent benchmarks use 100% non-blocking connects (using
1457 AnyEvent::Socket::tcp_connect and the asynchronous pure perl DNS
1458 resolver), so AnyEvent is at a disadvantage here, as non-blocking
1459 connects generally require a lot more bookkeeping and event handling
1460 than blocking connects (which involve a single syscall only).
1461
1462 The last AnyEvent benchmark additionally uses AnyEvent::Handle, which
1463 offers similar expressive power as POE and IO::Lambda, using
1464 conventional Perl syntax. This means that both the echo server and the
1465 client are 100% non-blocking, further placing it at a disadvantage.
1466
1467 As you can see, the AnyEvent + EV combination even beats the
1468 hand-optimised "raw sockets benchmark", while AnyEvent + its pure perl
1469 backend easily beats IO::Lambda and POE.
1470
1471 And even the 100% non-blocking version written using the high-level (and
1472 slow :) AnyEvent::Handle abstraction beats both POE and IO::Lambda by a
1473 large margin, even though it does all of DNS, tcp-connect and socket I/O
1474 in a non-blocking way.
1475
1476 The two AnyEvent benchmarks programs can be found as eg/ae0.pl and
1477 eg/ae2.pl in the AnyEvent distribution, the remaining benchmarks are
1478 part of the IO::lambda distribution and were used without any changes.
1479
1362SIGNALS 1480SIGNALS
1363 AnyEvent currently installs handlers for these signals: 1481 AnyEvent currently installs handlers for these signals:
1364 1482
1365 SIGCHLD 1483 SIGCHLD
1366 A handler for "SIGCHLD" is installed by AnyEvent's child watcher 1484 A handler for "SIGCHLD" is installed by AnyEvent's child watcher
1367 emulation for event loops that do not support them natively. Also, 1485 emulation for event loops that do not support them natively. Also,
1368 some event loops install a similar handler. 1486 some event loops install a similar handler.
1487
1488 If, when AnyEvent is loaded, SIGCHLD is set to IGNORE, then AnyEvent
1489 will reset it to default, to avoid losing child exit statuses.
1369 1490
1370 SIGPIPE 1491 SIGPIPE
1371 A no-op handler is installed for "SIGPIPE" when $SIG{PIPE} is 1492 A no-op handler is installed for "SIGPIPE" when $SIG{PIPE} is
1372 "undef" when AnyEvent gets loaded. 1493 "undef" when AnyEvent gets loaded.
1373 1494
1401 1522
1402 You can make AnyEvent completely ignore this variable by deleting it 1523 You can make AnyEvent completely ignore this variable by deleting it
1403 before the first watcher gets created, e.g. with a "BEGIN" block: 1524 before the first watcher gets created, e.g. with a "BEGIN" block:
1404 1525
1405 BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} } 1526 BEGIN { delete $ENV{PERL_ANYEVENT_MODEL} }
1406 1527
1407 use AnyEvent; 1528 use AnyEvent;
1408 1529
1409 Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can 1530 Similar considerations apply to $ENV{PERL_ANYEVENT_VERBOSE}, as that can
1410 be used to probe what backend is used and gain other information (which 1531 be used to probe what backend is used and gain other information (which
1411 is probably even less useful to an attacker than PERL_ANYEVENT_MODEL), 1532 is probably even less useful to an attacker than PERL_ANYEVENT_MODEL),
1412 and $ENV{PERL_ANYEGENT_STRICT}. 1533 and $ENV{PERL_ANYEVENT_STRICT}.
1534
1535 Note that AnyEvent will remove *all* environment variables starting with
1536 "PERL_ANYEVENT_" from %ENV when it is loaded while taint mode is
1537 enabled.
1413 1538
1414BUGS 1539BUGS
1415 Perl 5.8 has numerous memleaks that sometimes hit this module and are 1540 Perl 5.8 has numerous memleaks that sometimes hit this module and are
1416 hard to work around. If you suffer from memleaks, first upgrade to Perl 1541 hard to work around. If you suffer from memleaks, first upgrade to Perl
1417 5.10 and check wether the leaks still show up. (Perl 5.10.0 has other 1542 5.10 and check wether the leaks still show up. (Perl 5.10.0 has other

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines