ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libev/ev.pod
(Generate patch)

Comparing libev/ev.pod (file contents):
Revision 1.208 by root, Wed Oct 29 10:24:23 2008 UTC vs.
Revision 1.217 by root, Mon Nov 17 03:37:08 2008 UTC

8 8
9=head2 EXAMPLE PROGRAM 9=head2 EXAMPLE PROGRAM
10 10
11 // a single header file is required 11 // a single header file is required
12 #include <ev.h> 12 #include <ev.h>
13
14 #include <stdio.h> // for puts
13 15
14 // every watcher type has its own typedef'd struct 16 // every watcher type has its own typedef'd struct
15 // with the name ev_TYPE 17 // with the name ev_TYPE
16 ev_io stdin_watcher; 18 ev_io stdin_watcher;
17 ev_timer timeout_watcher; 19 ev_timer timeout_watcher;
386For few fds, this backend is a bit little slower than poll and select, 388For few fds, this backend is a bit little slower than poll and select,
387but it scales phenomenally better. While poll and select usually scale 389but it scales phenomenally better. While poll and select usually scale
388like O(total_fds) where n is the total number of fds (or the highest fd), 390like O(total_fds) where n is the total number of fds (or the highest fd),
389epoll scales either O(1) or O(active_fds). 391epoll scales either O(1) or O(active_fds).
390 392
391The epoll syscalls are the most misdesigned of the more advanced event 393The epoll mechanism deserves honorable mention as the most misdesigned
392mechanisms: problems include silently dropping fds, requiring a system 394of the more advanced event mechanisms: mere annoyances include silently
393call per change per fd (and unnecessary guessing of parameters), problems 395dropping file descriptors, requiring a system call per change per file
396descriptor (and unnecessary guessing of parameters), problems with dup and
394with dup and so on. The biggest issue is fork races, however - if a 397so on. The biggest issue is fork races, however - if a program forks then
395program forks then I<both> parent and child process have to recreate the 398I<both> parent and child process have to recreate the epoll set, which can
396epoll set, which can take considerable time (one syscall per fd) and is of 399take considerable time (one syscall per file descriptor) and is of course
397course hard to detect. 400hard to detect.
398 401
399Epoll is also notoriously buggy - embedding epoll fds should work, but 402Epoll is also notoriously buggy - embedding epoll fds I<should> work, but
400of course doesn't, and epoll just loves to report events for totally 403of course I<doesn't>, and epoll just loves to report events for totally
401I<different> file descriptors (even already closed ones, so one cannot 404I<different> file descriptors (even already closed ones, so one cannot
402even remove them from the set) than registered in the set (especially 405even remove them from the set) than registered in the set (especially
403on SMP systems). Libev tries to counter these spurious notifications by 406on SMP systems). Libev tries to counter these spurious notifications by
404employing an additional generation counter and comparing that against the 407employing an additional generation counter and comparing that against the
405events to filter out spurious ones. 408events to filter out spurious ones, recreating the set when required.
406 409
407While stopping, setting and starting an I/O watcher in the same iteration 410While stopping, setting and starting an I/O watcher in the same iteration
408will result in some caching, there is still a system call per such incident 411will result in some caching, there is still a system call per such
409(because the fd could point to a different file description now), so its 412incident (because the same I<file descriptor> could point to a different
410best to avoid that. Also, C<dup ()>'ed file descriptors might not work 413I<file description> now), so its best to avoid that. Also, C<dup ()>'ed
411very well if you register events for both fds. 414file descriptors might not work very well if you register events for both
415file descriptors.
412 416
413Best performance from this backend is achieved by not unregistering all 417Best performance from this backend is achieved by not unregistering all
414watchers for a file descriptor until it has been closed, if possible, 418watchers for a file descriptor until it has been closed, if possible,
415i.e. keep at least one watcher active per fd at all times. Stopping and 419i.e. keep at least one watcher active per fd at all times. Stopping and
416starting a watcher (without re-setting it) also usually doesn't cause 420starting a watcher (without re-setting it) also usually doesn't cause
417extra overhead. A fork can both result in spurious notifications as well 421extra overhead. A fork can both result in spurious notifications as well
418as in libev having to destroy and recreate the epoll object, which can 422as in libev having to destroy and recreate the epoll object, which can
419take considerable time and thus should be avoided. 423take considerable time and thus should be avoided.
420 424
425All this means that, in practice, C<EVBACKEND_SELECT> can be as fast or
426faster than epoll for maybe up to a hundred file descriptors, depending on
427the usage. So sad.
428
421While nominally embeddable in other event loops, this feature is broken in 429While nominally embeddable in other event loops, this feature is broken in
422all kernel versions tested so far. 430all kernel versions tested so far.
423 431
424This backend maps C<EV_READ> and C<EV_WRITE> in the same way as 432This backend maps C<EV_READ> and C<EV_WRITE> in the same way as
425C<EVBACKEND_POLL>. 433C<EVBACKEND_POLL>.
426 434
427=item C<EVBACKEND_KQUEUE> (value 8, most BSD clones) 435=item C<EVBACKEND_KQUEUE> (value 8, most BSD clones)
428 436
429Kqueue deserves special mention, as at the time of this writing, it was 437Kqueue deserves special mention, as at the time of this writing, it
430broken on all BSDs except NetBSD (usually it doesn't work reliably with 438was broken on all BSDs except NetBSD (usually it doesn't work reliably
431anything but sockets and pipes, except on Darwin, where of course it's 439with anything but sockets and pipes, except on Darwin, where of course
432completely useless). For this reason it's not being "auto-detected" unless 440it's completely useless). Unlike epoll, however, whose brokenness
433you explicitly specify it in the flags (i.e. using C<EVBACKEND_KQUEUE>) or 441is by design, these kqueue bugs can (and eventually will) be fixed
434libev was compiled on a known-to-be-good (-enough) system like NetBSD. 442without API changes to existing programs. For this reason it's not being
443"auto-detected" unless you explicitly specify it in the flags (i.e. using
444C<EVBACKEND_KQUEUE>) or libev was compiled on a known-to-be-good (-enough)
445system like NetBSD.
435 446
436You still can embed kqueue into a normal poll or select backend and use it 447You still can embed kqueue into a normal poll or select backend and use it
437only for sockets (after having made sure that sockets work with kqueue on 448only for sockets (after having made sure that sockets work with kqueue on
438the target platform). See C<ev_embed> watchers for more info. 449the target platform). See C<ev_embed> watchers for more info.
439 450
1410 else 1421 else
1411 { 1422 {
1412 // callback was invoked, but there was some activity, re-arm 1423 // callback was invoked, but there was some activity, re-arm
1413 // the watcher to fire in last_activity + 60, which is 1424 // the watcher to fire in last_activity + 60, which is
1414 // guaranteed to be in the future, so "again" is positive: 1425 // guaranteed to be in the future, so "again" is positive:
1415 w->again = timeout - now; 1426 w->repeat = timeout - now;
1416 ev_timer_again (EV_A_ w); 1427 ev_timer_again (EV_A_ w);
1417 } 1428 }
1418 } 1429 }
1419 1430
1420To summarise the callback: first calculate the real timeout (defined 1431To summarise the callback: first calculate the real timeout (defined
1927C<stat> on that path in regular intervals (or when the OS says it changed) 1938C<stat> on that path in regular intervals (or when the OS says it changed)
1928and sees if it changed compared to the last time, invoking the callback if 1939and sees if it changed compared to the last time, invoking the callback if
1929it did. 1940it did.
1930 1941
1931The path does not need to exist: changing from "path exists" to "path does 1942The path does not need to exist: changing from "path exists" to "path does
1932not exist" is a status change like any other. The condition "path does 1943not exist" is a status change like any other. The condition "path does not
1933not exist" is signified by the C<st_nlink> field being zero (which is 1944exist" (or more correctly "path cannot be stat'ed") is signified by the
1934otherwise always forced to be at least one) and all the other fields of 1945C<st_nlink> field being zero (which is otherwise always forced to be at
1935the stat buffer having unspecified contents. 1946least one) and all the other fields of the stat buffer having unspecified
1947contents.
1936 1948
1937The path I<must not> end in a slash or contain special components such as 1949The path I<must not> end in a slash or contain special components such as
1938C<.> or C<..>. The path I<should> be absolute: If it is relative and 1950C<.> or C<..>. The path I<should> be absolute: If it is relative and
1939your working directory changes, then the behaviour is undefined. 1951your working directory changes, then the behaviour is undefined.
1940 1952
1950This watcher type is not meant for massive numbers of stat watchers, 1962This watcher type is not meant for massive numbers of stat watchers,
1951as even with OS-supported change notifications, this can be 1963as even with OS-supported change notifications, this can be
1952resource-intensive. 1964resource-intensive.
1953 1965
1954At the time of this writing, the only OS-specific interface implemented 1966At the time of this writing, the only OS-specific interface implemented
1955is the Linux inotify interface (implementing kqueue support is left as 1967is the Linux inotify interface (implementing kqueue support is left as an
1956an exercise for the reader. Note, however, that the author sees no way 1968exercise for the reader. Note, however, that the author sees no way of
1957of implementing C<ev_stat> semantics with kqueue). 1969implementing C<ev_stat> semantics with kqueue, except as a hint).
1958 1970
1959=head3 ABI Issues (Largefile Support) 1971=head3 ABI Issues (Largefile Support)
1960 1972
1961Libev by default (unless the user overrides this) uses the default 1973Libev by default (unless the user overrides this) uses the default
1962compilation environment, which means that on systems with large file 1974compilation environment, which means that on systems with large file
1973to exchange stat structures with application programs compiled using the 1985to exchange stat structures with application programs compiled using the
1974default compilation environment. 1986default compilation environment.
1975 1987
1976=head3 Inotify and Kqueue 1988=head3 Inotify and Kqueue
1977 1989
1978When C<inotify (7)> support has been compiled into libev (generally 1990When C<inotify (7)> support has been compiled into libev and present at
1979only available with Linux 2.6.25 or above due to bugs in earlier 1991runtime, it will be used to speed up change detection where possible. The
1980implementations) and present at runtime, it will be used to speed up 1992inotify descriptor will be created lazily when the first C<ev_stat>
1981change detection where possible. The inotify descriptor will be created 1993watcher is being started.
1982lazily when the first C<ev_stat> watcher is being started.
1983 1994
1984Inotify presence does not change the semantics of C<ev_stat> watchers 1995Inotify presence does not change the semantics of C<ev_stat> watchers
1985except that changes might be detected earlier, and in some cases, to avoid 1996except that changes might be detected earlier, and in some cases, to avoid
1986making regular C<stat> calls. Even in the presence of inotify support 1997making regular C<stat> calls. Even in the presence of inotify support
1987there are many cases where libev has to resort to regular C<stat> polling, 1998there are many cases where libev has to resort to regular C<stat> polling,
1988but as long as the path exists, libev usually gets away without polling. 1999but as long as kernel 2.6.25 or newer is used (2.6.24 and older have too
2000many bugs), the path exists (i.e. stat succeeds), and the path resides on
2001a local filesystem (libev currently assumes only ext2/3, jfs, reiserfs and
2002xfs are fully working) libev usually gets away without polling.
1989 2003
1990There is no support for kqueue, as apparently it cannot be used to 2004There is no support for kqueue, as apparently it cannot be used to
1991implement this functionality, due to the requirement of having a file 2005implement this functionality, due to the requirement of having a file
1992descriptor open on the object at all times, and detecting renames, unlinks 2006descriptor open on the object at all times, and detecting renames, unlinks
1993etc. is difficult. 2007etc. is difficult.
2008
2009=head3 C<stat ()> is a synchronous operation
2010
2011Libev doesn't normally do any kind of I/O itself, and so is not blocking
2012the process. The exception are C<ev_stat> watchers - those call C<stat
2013()>, which is a synchronous operation.
2014
2015For local paths, this usually doesn't matter: unless the system is very
2016busy or the intervals between stat's are large, a stat call will be fast,
2017as the path data is suually in memory already (except when starting the
2018watcher).
2019
2020For networked file systems, calling C<stat ()> can block an indefinite
2021time due to network issues, and even under good conditions, a stat call
2022often takes multiple milliseconds.
2023
2024Therefore, it is best to avoid using C<ev_stat> watchers on networked
2025paths, although this is fully supported by libev.
1994 2026
1995=head3 The special problem of stat time resolution 2027=head3 The special problem of stat time resolution
1996 2028
1997The C<stat ()> system call only supports full-second resolution portably, 2029The C<stat ()> system call only supports full-second resolution portably,
1998and even on systems where the resolution is higher, most file systems 2030and even on systems where the resolution is higher, most file systems
3860=back 3892=back
3861 3893
3862 3894
3863=head1 AUTHOR 3895=head1 AUTHOR
3864 3896
3865Marc Lehmann <libev@schmorp.de>. 3897Marc Lehmann <libev@schmorp.de>, with repeated corrections by Mikael Magnusson.
3866 3898

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines