ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libev/ev.pod
(Generate patch)

Comparing libev/ev.pod (file contents):
Revision 1.204 by root, Mon Oct 27 11:08:29 2008 UTC vs.
Revision 1.216 by root, Thu Nov 13 15:55:38 2008 UTC

298If you don't know what event loop to use, use the one returned from this 298If you don't know what event loop to use, use the one returned from this
299function. 299function.
300 300
301Note that this function is I<not> thread-safe, so if you want to use it 301Note that this function is I<not> thread-safe, so if you want to use it
302from multiple threads, you have to lock (note also that this is unlikely, 302from multiple threads, you have to lock (note also that this is unlikely,
303as loops cannot bes hared easily between threads anyway). 303as loops cannot be shared easily between threads anyway).
304 304
305The default loop is the only loop that can handle C<ev_signal> and 305The default loop is the only loop that can handle C<ev_signal> and
306C<ev_child> watchers, and to do this, it always registers a handler 306C<ev_child> watchers, and to do this, it always registers a handler
307for C<SIGCHLD>. If this is a problem for your application you can either 307for C<SIGCHLD>. If this is a problem for your application you can either
308create a dynamic loop with C<ev_loop_new> that doesn't do that, or you 308create a dynamic loop with C<ev_loop_new> that doesn't do that, or you
384=item C<EVBACKEND_EPOLL> (value 4, Linux) 384=item C<EVBACKEND_EPOLL> (value 4, Linux)
385 385
386For few fds, this backend is a bit little slower than poll and select, 386For few fds, this backend is a bit little slower than poll and select,
387but it scales phenomenally better. While poll and select usually scale 387but it scales phenomenally better. While poll and select usually scale
388like O(total_fds) where n is the total number of fds (or the highest fd), 388like O(total_fds) where n is the total number of fds (or the highest fd),
389epoll scales either O(1) or O(active_fds). The epoll design has a number 389epoll scales either O(1) or O(active_fds).
390of shortcomings, such as silently dropping events in some hard-to-detect
391cases and requiring a system call per fd change, no fork support and bad
392support for dup.
393 390
391The epoll mechanism deserves honorable mention as the most misdesigned
392of the more advanced event mechanisms: mere annoyances include silently
393dropping file descriptors, requiring a system call per change per file
394descriptor (and unnecessary guessing of parameters), problems with dup and
395so on. The biggest issue is fork races, however - if a program forks then
396I<both> parent and child process have to recreate the epoll set, which can
397take considerable time (one syscall per file descriptor) and is of course
398hard to detect.
399
394Epoll is also notoriously buggy - embedding epoll fds should work, but 400Epoll is also notoriously buggy - embedding epoll fds I<should> work, but
395of course doesn't, and epoll just loves to report events for totally 401of course I<doesn't>, and epoll just loves to report events for totally
396I<different> file descriptors (even already closed ones) than registered 402I<different> file descriptors (even already closed ones, so one cannot
397in the set (especially on SMP systems). Libev tries to counter these 403even remove them from the set) than registered in the set (especially
398spurious notifications by employing an additional generation counter and 404on SMP systems). Libev tries to counter these spurious notifications by
399comparing that against the events to filter out spurious ones. 405employing an additional generation counter and comparing that against the
406events to filter out spurious ones, recreating the set when required.
400 407
401While stopping, setting and starting an I/O watcher in the same iteration 408While stopping, setting and starting an I/O watcher in the same iteration
402will result in some caching, there is still a system call per such incident 409will result in some caching, there is still a system call per such
403(because the fd could point to a different file description now), so its 410incident (because the same I<file descriptor> could point to a different
404best to avoid that. Also, C<dup ()>'ed file descriptors might not work 411I<file description> now), so its best to avoid that. Also, C<dup ()>'ed
405very well if you register events for both fds. 412file descriptors might not work very well if you register events for both
413file descriptors.
406 414
407Best performance from this backend is achieved by not unregistering all 415Best performance from this backend is achieved by not unregistering all
408watchers for a file descriptor until it has been closed, if possible, 416watchers for a file descriptor until it has been closed, if possible,
409i.e. keep at least one watcher active per fd at all times. Stopping and 417i.e. keep at least one watcher active per fd at all times. Stopping and
410starting a watcher (without re-setting it) also usually doesn't cause 418starting a watcher (without re-setting it) also usually doesn't cause
411extra overhead. 419extra overhead. A fork can both result in spurious notifications as well
420as in libev having to destroy and recreate the epoll object, which can
421take considerable time and thus should be avoided.
422
423All this means that, in practice, C<EVBACKEND_SELECT> can be as fast or
424faster than epoll for maybe up to a hundred file descriptors, depending on
425the usage. So sad.
412 426
413While nominally embeddable in other event loops, this feature is broken in 427While nominally embeddable in other event loops, this feature is broken in
414all kernel versions tested so far. 428all kernel versions tested so far.
415 429
416This backend maps C<EV_READ> and C<EV_WRITE> in the same way as 430This backend maps C<EV_READ> and C<EV_WRITE> in the same way as
417C<EVBACKEND_POLL>. 431C<EVBACKEND_POLL>.
418 432
419=item C<EVBACKEND_KQUEUE> (value 8, most BSD clones) 433=item C<EVBACKEND_KQUEUE> (value 8, most BSD clones)
420 434
421Kqueue deserves special mention, as at the time of this writing, it was 435Kqueue deserves special mention, as at the time of this writing, it
422broken on all BSDs except NetBSD (usually it doesn't work reliably with 436was broken on all BSDs except NetBSD (usually it doesn't work reliably
423anything but sockets and pipes, except on Darwin, where of course it's 437with anything but sockets and pipes, except on Darwin, where of course
424completely useless). For this reason it's not being "auto-detected" unless 438it's completely useless). Unlike epoll, however, whose brokenness
425you explicitly specify it in the flags (i.e. using C<EVBACKEND_KQUEUE>) or 439is by design, these kqueue bugs can (and eventually will) be fixed
426libev was compiled on a known-to-be-good (-enough) system like NetBSD. 440without API changes to existing programs. For this reason it's not being
441"auto-detected" unless you explicitly specify it in the flags (i.e. using
442C<EVBACKEND_KQUEUE>) or libev was compiled on a known-to-be-good (-enough)
443system like NetBSD.
427 444
428You still can embed kqueue into a normal poll or select backend and use it 445You still can embed kqueue into a normal poll or select backend and use it
429only for sockets (after having made sure that sockets work with kqueue on 446only for sockets (after having made sure that sockets work with kqueue on
430the target platform). See C<ev_embed> watchers for more info. 447the target platform). See C<ev_embed> watchers for more info.
431 448
432It scales in the same way as the epoll backend, but the interface to the 449It scales in the same way as the epoll backend, but the interface to the
433kernel is more efficient (which says nothing about its actual speed, of 450kernel is more efficient (which says nothing about its actual speed, of
434course). While stopping, setting and starting an I/O watcher does never 451course). While stopping, setting and starting an I/O watcher does never
435cause an extra system call as with C<EVBACKEND_EPOLL>, it still adds up to 452cause an extra system call as with C<EVBACKEND_EPOLL>, it still adds up to
436two event changes per incident. Support for C<fork ()> is very bad and it 453two event changes per incident. Support for C<fork ()> is very bad (but
437drops fds silently in similarly hard-to-detect cases. 454sane, unlike epoll) and it drops fds silently in similarly hard-to-detect
455cases
438 456
439This backend usually performs well under most conditions. 457This backend usually performs well under most conditions.
440 458
441While nominally embeddable in other event loops, this doesn't work 459While nominally embeddable in other event loops, this doesn't work
442everywhere, so you might need to test for this. And since it is broken 460everywhere, so you might need to test for this. And since it is broken
471might perform better. 489might perform better.
472 490
473On the positive side, with the exception of the spurious readiness 491On the positive side, with the exception of the spurious readiness
474notifications, this backend actually performed fully to specification 492notifications, this backend actually performed fully to specification
475in all tests and is fully embeddable, which is a rare feat among the 493in all tests and is fully embeddable, which is a rare feat among the
476OS-specific backends. 494OS-specific backends (I vastly prefer correctness over speed hacks).
477 495
478This backend maps C<EV_READ> and C<EV_WRITE> in the same way as 496This backend maps C<EV_READ> and C<EV_WRITE> in the same way as
479C<EVBACKEND_POLL>. 497C<EVBACKEND_POLL>.
480 498
481=item C<EVBACKEND_ALL> 499=item C<EVBACKEND_ALL>
638the loop. 656the loop.
639 657
640A flags value of C<EVLOOP_ONESHOT> will look for new events (waiting if 658A flags value of C<EVLOOP_ONESHOT> will look for new events (waiting if
641necessary) and will handle those and any already outstanding ones. It 659necessary) and will handle those and any already outstanding ones. It
642will block your process until at least one new event arrives (which could 660will block your process until at least one new event arrives (which could
643be an event internal to libev itself, so there is no guarentee that a 661be an event internal to libev itself, so there is no guarantee that a
644user-registered callback will be called), and will return after one 662user-registered callback will be called), and will return after one
645iteration of the loop. 663iteration of the loop.
646 664
647This is useful if you are waiting for some external event in conjunction 665This is useful if you are waiting for some external event in conjunction
648with something not expressible using other libev watchers (i.e. "roll your 666with something not expressible using other libev watchers (i.e. "roll your
1401 else 1419 else
1402 { 1420 {
1403 // callback was invoked, but there was some activity, re-arm 1421 // callback was invoked, but there was some activity, re-arm
1404 // the watcher to fire in last_activity + 60, which is 1422 // the watcher to fire in last_activity + 60, which is
1405 // guaranteed to be in the future, so "again" is positive: 1423 // guaranteed to be in the future, so "again" is positive:
1406 w->again = timeout - now; 1424 w->repeat = timeout - now;
1407 ev_timer_again (EV_A_ w); 1425 ev_timer_again (EV_A_ w);
1408 } 1426 }
1409 } 1427 }
1410 1428
1411To summarise the callback: first calculate the real timeout (defined 1429To summarise the callback: first calculate the real timeout (defined
1913 1931
1914 1932
1915=head2 C<ev_stat> - did the file attributes just change? 1933=head2 C<ev_stat> - did the file attributes just change?
1916 1934
1917This watches a file system path for attribute changes. That is, it calls 1935This watches a file system path for attribute changes. That is, it calls
1918C<stat> regularly (or when the OS says it changed) and sees if it changed 1936C<stat> on that path in regular intervals (or when the OS says it changed)
1919compared to the last time, invoking the callback if it did. 1937and sees if it changed compared to the last time, invoking the callback if
1938it did.
1920 1939
1921The path does not need to exist: changing from "path exists" to "path does 1940The path does not need to exist: changing from "path exists" to "path does
1922not exist" is a status change like any other. The condition "path does 1941not exist" is a status change like any other. The condition "path does not
1923not exist" is signified by the C<st_nlink> field being zero (which is 1942exist" (or more correctly "path cannot be stat'ed") is signified by the
1924otherwise always forced to be at least one) and all the other fields of 1943C<st_nlink> field being zero (which is otherwise always forced to be at
1925the stat buffer having unspecified contents. 1944least one) and all the other fields of the stat buffer having unspecified
1945contents.
1926 1946
1927The path I<should> be absolute and I<must not> end in a slash. If it is 1947The path I<must not> end in a slash or contain special components such as
1948C<.> or C<..>. The path I<should> be absolute: If it is relative and
1928relative and your working directory changes, the behaviour is undefined. 1949your working directory changes, then the behaviour is undefined.
1929 1950
1930Since there is no standard kernel interface to do this, the portable 1951Since there is no portable change notification interface available, the
1931implementation simply calls C<stat (2)> regularly on the path to see if 1952portable implementation simply calls C<stat(2)> regularly on the path
1932it changed somehow. You can specify a recommended polling interval for 1953to see if it changed somehow. You can specify a recommended polling
1933this case. If you specify a polling interval of C<0> (highly recommended!) 1954interval for this case. If you specify a polling interval of C<0> (highly
1934then a I<suitable, unspecified default> value will be used (which 1955recommended!) then a I<suitable, unspecified default> value will be used
1935you can expect to be around five seconds, although this might change 1956(which you can expect to be around five seconds, although this might
1936dynamically). Libev will also impose a minimum interval which is currently 1957change dynamically). Libev will also impose a minimum interval which is
1937around C<0.1>, but thats usually overkill. 1958currently around C<0.1>, but that's usually overkill.
1938 1959
1939This watcher type is not meant for massive numbers of stat watchers, 1960This watcher type is not meant for massive numbers of stat watchers,
1940as even with OS-supported change notifications, this can be 1961as even with OS-supported change notifications, this can be
1941resource-intensive. 1962resource-intensive.
1942 1963
1943At the time of this writing, the only OS-specific interface implemented 1964At the time of this writing, the only OS-specific interface implemented
1944is the Linux inotify interface (implementing kqueue support is left as 1965is the Linux inotify interface (implementing kqueue support is left as an
1945an exercise for the reader. Note, however, that the author sees no way 1966exercise for the reader. Note, however, that the author sees no way of
1946of implementing C<ev_stat> semantics with kqueue). 1967implementing C<ev_stat> semantics with kqueue, except as a hint).
1947 1968
1948=head3 ABI Issues (Largefile Support) 1969=head3 ABI Issues (Largefile Support)
1949 1970
1950Libev by default (unless the user overrides this) uses the default 1971Libev by default (unless the user overrides this) uses the default
1951compilation environment, which means that on systems with large file 1972compilation environment, which means that on systems with large file
1952support disabled by default, you get the 32 bit version of the stat 1973support disabled by default, you get the 32 bit version of the stat
1953structure. When using the library from programs that change the ABI to 1974structure. When using the library from programs that change the ABI to
1954use 64 bit file offsets the programs will fail. In that case you have to 1975use 64 bit file offsets the programs will fail. In that case you have to
1955compile libev with the same flags to get binary compatibility. This is 1976compile libev with the same flags to get binary compatibility. This is
1956obviously the case with any flags that change the ABI, but the problem is 1977obviously the case with any flags that change the ABI, but the problem is
1957most noticeably disabled with ev_stat and large file support. 1978most noticeably displayed with ev_stat and large file support.
1958 1979
1959The solution for this is to lobby your distribution maker to make large 1980The solution for this is to lobby your distribution maker to make large
1960file interfaces available by default (as e.g. FreeBSD does) and not 1981file interfaces available by default (as e.g. FreeBSD does) and not
1961optional. Libev cannot simply switch on large file support because it has 1982optional. Libev cannot simply switch on large file support because it has
1962to exchange stat structures with application programs compiled using the 1983to exchange stat structures with application programs compiled using the
1963default compilation environment. 1984default compilation environment.
1964 1985
1965=head3 Inotify and Kqueue 1986=head3 Inotify and Kqueue
1966 1987
1967When C<inotify (7)> support has been compiled into libev (generally 1988When C<inotify (7)> support has been compiled into libev and present at
1968only available with Linux 2.6.25 or above due to bugs in earlier 1989runtime, it will be used to speed up change detection where possible. The
1969implementations) and present at runtime, it will be used to speed up 1990inotify descriptor will be created lazily when the first C<ev_stat>
1970change detection where possible. The inotify descriptor will be created 1991watcher is being started.
1971lazily when the first C<ev_stat> watcher is being started.
1972 1992
1973Inotify presence does not change the semantics of C<ev_stat> watchers 1993Inotify presence does not change the semantics of C<ev_stat> watchers
1974except that changes might be detected earlier, and in some cases, to avoid 1994except that changes might be detected earlier, and in some cases, to avoid
1975making regular C<stat> calls. Even in the presence of inotify support 1995making regular C<stat> calls. Even in the presence of inotify support
1976there are many cases where libev has to resort to regular C<stat> polling, 1996there are many cases where libev has to resort to regular C<stat> polling,
1977but as long as the path exists, libev usually gets away without polling. 1997but as long as kernel 2.6.25 or newer is used (2.6.24 and older have too
1998many bugs), the path exists (i.e. stat succeeds), and the path resides on
1999a local filesystem (libev currently assumes only ext2/3, jfs, reiserfs and
2000xfs are fully working) libev usually gets away without polling.
1978 2001
1979There is no support for kqueue, as apparently it cannot be used to 2002There is no support for kqueue, as apparently it cannot be used to
1980implement this functionality, due to the requirement of having a file 2003implement this functionality, due to the requirement of having a file
1981descriptor open on the object at all times, and detecting renames, unlinks 2004descriptor open on the object at all times, and detecting renames, unlinks
1982etc. is difficult. 2005etc. is difficult.
1983 2006
2007=head3 C<stat ()> is a synchronous operation
2008
2009Libev doesn't normally do any kind of I/O itself, and so is not blocking
2010the process. The exception are C<ev_stat> watchers - those call C<stat
2011()>, which is a synchronous operation.
2012
2013For local paths, this usually doesn't matter: unless the system is very
2014busy or the intervals between stat's are large, a stat call will be fast,
2015as the path data is suually in memory already (except when starting the
2016watcher).
2017
2018For networked file systems, calling C<stat ()> can block an indefinite
2019time due to network issues, and even under good conditions, a stat call
2020often takes multiple milliseconds.
2021
2022Therefore, it is best to avoid using C<ev_stat> watchers on networked
2023paths, although this is fully supported by libev.
2024
1984=head3 The special problem of stat time resolution 2025=head3 The special problem of stat time resolution
1985 2026
1986The C<stat ()> system call only supports full-second resolution portably, and 2027The C<stat ()> system call only supports full-second resolution portably,
1987even on systems where the resolution is higher, most file systems still 2028and even on systems where the resolution is higher, most file systems
1988only support whole seconds. 2029still only support whole seconds.
1989 2030
1990That means that, if the time is the only thing that changes, you can 2031That means that, if the time is the only thing that changes, you can
1991easily miss updates: on the first update, C<ev_stat> detects a change and 2032easily miss updates: on the first update, C<ev_stat> detects a change and
1992calls your callback, which does something. When there is another update 2033calls your callback, which does something. When there is another update
1993within the same second, C<ev_stat> will be unable to detect unless the 2034within the same second, C<ev_stat> will be unable to detect unless the
2632=over 4 2673=over 4
2633 2674
2634=item ev_async_init (ev_async *, callback) 2675=item ev_async_init (ev_async *, callback)
2635 2676
2636Initialises and configures the async watcher - it has no parameters of any 2677Initialises and configures the async watcher - it has no parameters of any
2637kind. There is a C<ev_asynd_set> macro, but using it is utterly pointless, 2678kind. There is a C<ev_async_set> macro, but using it is utterly pointless,
2638trust me. 2679trust me.
2639 2680
2640=item ev_async_send (loop, ev_async *) 2681=item ev_async_send (loop, ev_async *)
2641 2682
2642Sends/signals/activates the given C<ev_async> watcher, that is, feeds 2683Sends/signals/activates the given C<ev_async> watcher, that is, feeds
3075 3116
3076 #define EV_STANDALONE 1 3117 #define EV_STANDALONE 1
3077 #include "ev.h" 3118 #include "ev.h"
3078 3119
3079Both header files and implementation files can be compiled with a C++ 3120Both header files and implementation files can be compiled with a C++
3080compiler (at least, thats a stated goal, and breakage will be treated 3121compiler (at least, that's a stated goal, and breakage will be treated
3081as a bug). 3122as a bug).
3082 3123
3083You need the following files in your source tree, or in a directory 3124You need the following files in your source tree, or in a directory
3084in your include path (e.g. in libev/ when using -Ilibev): 3125in your include path (e.g. in libev/ when using -Ilibev):
3085 3126
3557loop, as long as you don't confuse yourself). The only exception is that 3598loop, as long as you don't confuse yourself). The only exception is that
3558you must not do this from C<ev_periodic> reschedule callbacks. 3599you must not do this from C<ev_periodic> reschedule callbacks.
3559 3600
3560Care has been taken to ensure that libev does not keep local state inside 3601Care has been taken to ensure that libev does not keep local state inside
3561C<ev_loop>, and other calls do not usually allow for coroutine switches as 3602C<ev_loop>, and other calls do not usually allow for coroutine switches as
3562they do not clal any callbacks. 3603they do not call any callbacks.
3563 3604
3564=head2 COMPILER WARNINGS 3605=head2 COMPILER WARNINGS
3565 3606
3566Depending on your compiler and compiler settings, you might get no or a 3607Depending on your compiler and compiler settings, you might get no or a
3567lot of warnings when compiling libev code. Some people are apparently 3608lot of warnings when compiling libev code. Some people are apparently
3601 ==2274== definitely lost: 0 bytes in 0 blocks. 3642 ==2274== definitely lost: 0 bytes in 0 blocks.
3602 ==2274== possibly lost: 0 bytes in 0 blocks. 3643 ==2274== possibly lost: 0 bytes in 0 blocks.
3603 ==2274== still reachable: 256 bytes in 1 blocks. 3644 ==2274== still reachable: 256 bytes in 1 blocks.
3604 3645
3605Then there is no memory leak, just as memory accounted to global variables 3646Then there is no memory leak, just as memory accounted to global variables
3606is not a memleak - the memory is still being refernced, and didn't leak. 3647is not a memleak - the memory is still being referenced, and didn't leak.
3607 3648
3608Similarly, under some circumstances, valgrind might report kernel bugs 3649Similarly, under some circumstances, valgrind might report kernel bugs
3609as if it were a bug in libev (e.g. in realloc or in the poll backend, 3650as if it were a bug in libev (e.g. in realloc or in the poll backend,
3610although an acceptable workaround has been found here), or it might be 3651although an acceptable workaround has been found here), or it might be
3611confused. 3652confused.
3849=back 3890=back
3850 3891
3851 3892
3852=head1 AUTHOR 3893=head1 AUTHOR
3853 3894
3854Marc Lehmann <libev@schmorp.de>. 3895Marc Lehmann <libev@schmorp.de>, with repeated corrections by Mikael Magnusson.
3855 3896

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines