ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libev/ev.pod
(Generate patch)

Comparing libev/ev.pod (file contents):
Revision 1.352 by root, Mon Jan 10 14:30:15 2011 UTC vs.
Revision 1.356 by root, Tue Jan 11 01:42:47 2011 UTC

506employing an additional generation counter and comparing that against the 506employing an additional generation counter and comparing that against the
507events to filter out spurious ones, recreating the set when required. Last 507events to filter out spurious ones, recreating the set when required. Last
508not least, it also refuses to work with some file descriptors which work 508not least, it also refuses to work with some file descriptors which work
509perfectly fine with C<select> (files, many character devices...). 509perfectly fine with C<select> (files, many character devices...).
510 510
511Epoll is truly the train wreck analog among event poll mechanisms. 511Epoll is truly the train wreck analog among event poll mechanisms,
512a frankenpoll, cobbled together in a hurry, no thought to design or
513interaction with others.
512 514
513While stopping, setting and starting an I/O watcher in the same iteration 515While stopping, setting and starting an I/O watcher in the same iteration
514will result in some caching, there is still a system call per such 516will result in some caching, there is still a system call per such
515incident (because the same I<file descriptor> could point to a different 517incident (because the same I<file descriptor> could point to a different
516I<file description> now), so its best to avoid that. Also, C<dup ()>'ed 518I<file description> now), so its best to avoid that. Also, C<dup ()>'ed
595hacks). 597hacks).
596 598
597On the negative side, the interface is I<bizarre> - so bizarre that 599On the negative side, the interface is I<bizarre> - so bizarre that
598even sun itself gets it wrong in their code examples: The event polling 600even sun itself gets it wrong in their code examples: The event polling
599function sometimes returning events to the caller even though an error 601function sometimes returning events to the caller even though an error
600occured, but with no indication whether it has done so or not (yes, it's 602occurred, but with no indication whether it has done so or not (yes, it's
601even documented that way) - deadly for edge-triggered interfaces where 603even documented that way) - deadly for edge-triggered interfaces where
602you absolutely have to know whether an event occured or not because you 604you absolutely have to know whether an event occurred or not because you
603have to re-arm the watcher. 605have to re-arm the watcher.
604 606
605Fortunately libev seems to be able to work around these idiocies. 607Fortunately libev seems to be able to work around these idiocies.
606 608
607This backend maps C<EV_READ> and C<EV_WRITE> in the same way as 609This backend maps C<EV_READ> and C<EV_WRITE> in the same way as
1614In general you can register as many read and/or write event watchers per 1616In general you can register as many read and/or write event watchers per
1615fd as you want (as long as you don't confuse yourself). Setting all file 1617fd as you want (as long as you don't confuse yourself). Setting all file
1616descriptors to non-blocking mode is also usually a good idea (but not 1618descriptors to non-blocking mode is also usually a good idea (but not
1617required if you know what you are doing). 1619required if you know what you are doing).
1618 1620
1619If you cannot use non-blocking mode, then force the use of a
1620known-to-be-good backend (at the time of this writing, this includes only
1621C<EVBACKEND_SELECT> and C<EVBACKEND_POLL>). The same applies to file
1622descriptors for which non-blocking operation makes no sense (such as
1623files) - libev doesn't guarantee any specific behaviour in that case.
1624
1625Another thing you have to watch out for is that it is quite easy to 1621Another thing you have to watch out for is that it is quite easy to
1626receive "spurious" readiness notifications, that is your callback might 1622receive "spurious" readiness notifications, that is, your callback might
1627be called with C<EV_READ> but a subsequent C<read>(2) will actually block 1623be called with C<EV_READ> but a subsequent C<read>(2) will actually block
1628because there is no data. Not only are some backends known to create a 1624because there is no data. It is very easy to get into this situation even
1629lot of those (for example Solaris ports), it is very easy to get into 1625with a relatively standard program structure. Thus it is best to always
1630this situation even with a relatively standard program structure. Thus 1626use non-blocking I/O: An extra C<read>(2) returning C<EAGAIN> is far
1631it is best to always use non-blocking I/O: An extra C<read>(2) returning
1632C<EAGAIN> is far preferable to a program hanging until some data arrives. 1627preferable to a program hanging until some data arrives.
1633 1628
1634If you cannot run the fd in non-blocking mode (for example you should 1629If you cannot run the fd in non-blocking mode (for example you should
1635not play around with an Xlib connection), then you have to separately 1630not play around with an Xlib connection), then you have to separately
1636re-test whether a file descriptor is really ready with a known-to-be good 1631re-test whether a file descriptor is really ready with a known-to-be good
1637interface such as poll (fortunately in our Xlib example, Xlib already 1632interface such as poll (fortunately in the case of Xlib, it already does
1638does this on its own, so its quite safe to use). Some people additionally 1633this on its own, so its quite safe to use). Some people additionally
1639use C<SIGALRM> and an interval timer, just to be sure you won't block 1634use C<SIGALRM> and an interval timer, just to be sure you won't block
1640indefinitely. 1635indefinitely.
1641 1636
1642But really, best use non-blocking mode. 1637But really, best use non-blocking mode.
1643 1638
1671 1666
1672There is no workaround possible except not registering events 1667There is no workaround possible except not registering events
1673for potentially C<dup ()>'ed file descriptors, or to resort to 1668for potentially C<dup ()>'ed file descriptors, or to resort to
1674C<EVBACKEND_SELECT> or C<EVBACKEND_POLL>. 1669C<EVBACKEND_SELECT> or C<EVBACKEND_POLL>.
1675 1670
1671=head3 The special problem of files
1672
1673Many people try to use C<select> (or libev) on file descriptors
1674representing files, and expect it to become ready when their program
1675doesn't block on disk accesses (which can take a long time on their own).
1676
1677However, this cannot ever work in the "expected" way - you get a readiness
1678notification as soon as the kernel knows whether and how much data is
1679there, and in the case of open files, that's always the case, so you
1680always get a readiness notification instantly, and your read (or possibly
1681write) will still block on the disk I/O.
1682
1683Another way to view it is that in the case of sockets, pipes, character
1684devices and so on, there is another party (the sender) that delivers data
1685on it's own, but in the case of files, there is no such thing: the disk
1686will not send data on it's own, simply because it doesn't know what you
1687wish to read - you would first have to request some data.
1688
1689Since files are typically not-so-well supported by advanced notification
1690mechanism, libev tries hard to emulate POSIX behaviour with respect
1691to files, even though you should not use it. The reason for this is
1692convenience: sometimes you want to watch STDIN or STDOUT, which is
1693usually a tty, often a pipe, but also sometimes files or special devices
1694(for example, C<epoll> on Linux works with F</dev/random> but not with
1695F</dev/urandom>), and even though the file might better be served with
1696asynchronous I/O instead of with non-blocking I/O, it is still useful when
1697it "just works" instead of freezing.
1698
1699So avoid file descriptors pointing to files when you know it (e.g. use
1700libeio), but use them when it is convenient, e.g. for STDIN/STDOUT, or
1701when you rarely read from a file instead of from a socket, and want to
1702reuse the same code path.
1703
1676=head3 The special problem of fork 1704=head3 The special problem of fork
1677 1705
1678Some backends (epoll, kqueue) do not support C<fork ()> at all or exhibit 1706Some backends (epoll, kqueue) do not support C<fork ()> at all or exhibit
1679useless behaviour. Libev fully supports fork, but needs to be told about 1707useless behaviour. Libev fully supports fork, but needs to be told about
1680it in the child. 1708it in the child if you want to continue to use it in the child.
1681 1709
1682To support fork in your programs, you either have to call 1710To support fork in your child processes, you have to call C<ev_loop_fork
1683C<ev_default_fork ()> or C<ev_loop_fork ()> after a fork in the child, 1711()> after a fork in the child, enable C<EVFLAG_FORKCHECK>, or resort to
1684enable C<EVFLAG_FORKCHECK>, or resort to C<EVBACKEND_SELECT> or 1712C<EVBACKEND_SELECT> or C<EVBACKEND_POLL>.
1685C<EVBACKEND_POLL>.
1686 1713
1687=head3 The special problem of SIGPIPE 1714=head3 The special problem of SIGPIPE
1688 1715
1689While not really specific to libev, it is easy to forget about C<SIGPIPE>: 1716While not really specific to libev, it is easy to forget about C<SIGPIPE>:
1690when writing to a pipe whose other end has been closed, your program gets 1717when writing to a pipe whose other end has been closed, your program gets
3429 3456
3430This section explains some common idioms that are not immediately 3457This section explains some common idioms that are not immediately
3431obvious. Note that examples are sprinkled over the whole manual, and this 3458obvious. Note that examples are sprinkled over the whole manual, and this
3432section only contains stuff that wouldn't fit anywhere else. 3459section only contains stuff that wouldn't fit anywhere else.
3433 3460
3434=over 4 3461=head2 MODEL/NESTED EVENT LOOP INVOCATIONS AND EXIT CONDITIONS
3435
3436=item Model/nested event loop invocations and exit conditions.
3437 3462
3438Often (especially in GUI toolkits) there are places where you have 3463Often (especially in GUI toolkits) there are places where you have
3439I<modal> interaction, which is most easily implemented by recursively 3464I<modal> interaction, which is most easily implemented by recursively
3440invoking C<ev_run>. 3465invoking C<ev_run>.
3441 3466
3470 exit_main_loop = 1; 3495 exit_main_loop = 1;
3471 3496
3472 // exit both 3497 // exit both
3473 exit_main_loop = exit_nested_loop = 1; 3498 exit_main_loop = exit_nested_loop = 1;
3474 3499
3475=back 3500=head2 THREAD LOCKING EXAMPLE
3501
3502Here is a fictitious example of how to run an event loop in a different
3503thread than where callbacks are being invoked and watchers are
3504created/added/removed.
3505
3506For a real-world example, see the C<EV::Loop::Async> perl module,
3507which uses exactly this technique (which is suited for many high-level
3508languages).
3509
3510The example uses a pthread mutex to protect the loop data, a condition
3511variable to wait for callback invocations, an async watcher to notify the
3512event loop thread and an unspecified mechanism to wake up the main thread.
3513
3514First, you need to associate some data with the event loop:
3515
3516 typedef struct {
3517 mutex_t lock; /* global loop lock */
3518 ev_async async_w;
3519 thread_t tid;
3520 cond_t invoke_cv;
3521 } userdata;
3522
3523 void prepare_loop (EV_P)
3524 {
3525 // for simplicity, we use a static userdata struct.
3526 static userdata u;
3527
3528 ev_async_init (&u->async_w, async_cb);
3529 ev_async_start (EV_A_ &u->async_w);
3530
3531 pthread_mutex_init (&u->lock, 0);
3532 pthread_cond_init (&u->invoke_cv, 0);
3533
3534 // now associate this with the loop
3535 ev_set_userdata (EV_A_ u);
3536 ev_set_invoke_pending_cb (EV_A_ l_invoke);
3537 ev_set_loop_release_cb (EV_A_ l_release, l_acquire);
3538
3539 // then create the thread running ev_loop
3540 pthread_create (&u->tid, 0, l_run, EV_A);
3541 }
3542
3543The callback for the C<ev_async> watcher does nothing: the watcher is used
3544solely to wake up the event loop so it takes notice of any new watchers
3545that might have been added:
3546
3547 static void
3548 async_cb (EV_P_ ev_async *w, int revents)
3549 {
3550 // just used for the side effects
3551 }
3552
3553The C<l_release> and C<l_acquire> callbacks simply unlock/lock the mutex
3554protecting the loop data, respectively.
3555
3556 static void
3557 l_release (EV_P)
3558 {
3559 userdata *u = ev_userdata (EV_A);
3560 pthread_mutex_unlock (&u->lock);
3561 }
3562
3563 static void
3564 l_acquire (EV_P)
3565 {
3566 userdata *u = ev_userdata (EV_A);
3567 pthread_mutex_lock (&u->lock);
3568 }
3569
3570The event loop thread first acquires the mutex, and then jumps straight
3571into C<ev_run>:
3572
3573 void *
3574 l_run (void *thr_arg)
3575 {
3576 struct ev_loop *loop = (struct ev_loop *)thr_arg;
3577
3578 l_acquire (EV_A);
3579 pthread_setcanceltype (PTHREAD_CANCEL_ASYNCHRONOUS, 0);
3580 ev_run (EV_A_ 0);
3581 l_release (EV_A);
3582
3583 return 0;
3584 }
3585
3586Instead of invoking all pending watchers, the C<l_invoke> callback will
3587signal the main thread via some unspecified mechanism (signals? pipe
3588writes? C<Async::Interrupt>?) and then waits until all pending watchers
3589have been called (in a while loop because a) spurious wakeups are possible
3590and b) skipping inter-thread-communication when there are no pending
3591watchers is very beneficial):
3592
3593 static void
3594 l_invoke (EV_P)
3595 {
3596 userdata *u = ev_userdata (EV_A);
3597
3598 while (ev_pending_count (EV_A))
3599 {
3600 wake_up_other_thread_in_some_magic_or_not_so_magic_way ();
3601 pthread_cond_wait (&u->invoke_cv, &u->lock);
3602 }
3603 }
3604
3605Now, whenever the main thread gets told to invoke pending watchers, it
3606will grab the lock, call C<ev_invoke_pending> and then signal the loop
3607thread to continue:
3608
3609 static void
3610 real_invoke_pending (EV_P)
3611 {
3612 userdata *u = ev_userdata (EV_A);
3613
3614 pthread_mutex_lock (&u->lock);
3615 ev_invoke_pending (EV_A);
3616 pthread_cond_signal (&u->invoke_cv);
3617 pthread_mutex_unlock (&u->lock);
3618 }
3619
3620Whenever you want to start/stop a watcher or do other modifications to an
3621event loop, you will now have to lock:
3622
3623 ev_timer timeout_watcher;
3624 userdata *u = ev_userdata (EV_A);
3625
3626 ev_timer_init (&timeout_watcher, timeout_cb, 5.5, 0.);
3627
3628 pthread_mutex_lock (&u->lock);
3629 ev_timer_start (EV_A_ &timeout_watcher);
3630 ev_async_send (EV_A_ &u->async_w);
3631 pthread_mutex_unlock (&u->lock);
3632
3633Note that sending the C<ev_async> watcher is required because otherwise
3634an event loop currently blocking in the kernel will have no knowledge
3635about the newly added timer. By waking up the loop it will pick up any new
3636watchers in the next event loop iteration.
3476 3637
3477 3638
3478=head1 LIBEVENT EMULATION 3639=head1 LIBEVENT EMULATION
3479 3640
3480Libev offers a compatibility emulation layer for libevent. It cannot 3641Libev offers a compatibility emulation layer for libevent. It cannot
4410And a F<ev_cpp.C> implementation file that contains libev proper and is compiled: 4571And a F<ev_cpp.C> implementation file that contains libev proper and is compiled:
4411 4572
4412 #include "ev_cpp.h" 4573 #include "ev_cpp.h"
4413 #include "ev.c" 4574 #include "ev.c"
4414 4575
4415=head1 INTERACTION WITH OTHER PROGRAMS OR LIBRARIES 4576=head1 INTERACTION WITH OTHER PROGRAMS, LIBRARIES OR THE ENVIRONMENT
4416 4577
4417=head2 THREADS AND COROUTINES 4578=head2 THREADS AND COROUTINES
4418 4579
4419=head3 THREADS 4580=head3 THREADS
4420 4581
4471default loop and triggering an C<ev_async> watcher from the default loop 4632default loop and triggering an C<ev_async> watcher from the default loop
4472watcher callback into the event loop interested in the signal. 4633watcher callback into the event loop interested in the signal.
4473 4634
4474=back 4635=back
4475 4636
4476=head4 THREAD LOCKING EXAMPLE 4637See also L<THREAD LOCKING EXAMPLE>.
4477
4478Here is a fictitious example of how to run an event loop in a different
4479thread than where callbacks are being invoked and watchers are
4480created/added/removed.
4481
4482For a real-world example, see the C<EV::Loop::Async> perl module,
4483which uses exactly this technique (which is suited for many high-level
4484languages).
4485
4486The example uses a pthread mutex to protect the loop data, a condition
4487variable to wait for callback invocations, an async watcher to notify the
4488event loop thread and an unspecified mechanism to wake up the main thread.
4489
4490First, you need to associate some data with the event loop:
4491
4492 typedef struct {
4493 mutex_t lock; /* global loop lock */
4494 ev_async async_w;
4495 thread_t tid;
4496 cond_t invoke_cv;
4497 } userdata;
4498
4499 void prepare_loop (EV_P)
4500 {
4501 // for simplicity, we use a static userdata struct.
4502 static userdata u;
4503
4504 ev_async_init (&u->async_w, async_cb);
4505 ev_async_start (EV_A_ &u->async_w);
4506
4507 pthread_mutex_init (&u->lock, 0);
4508 pthread_cond_init (&u->invoke_cv, 0);
4509
4510 // now associate this with the loop
4511 ev_set_userdata (EV_A_ u);
4512 ev_set_invoke_pending_cb (EV_A_ l_invoke);
4513 ev_set_loop_release_cb (EV_A_ l_release, l_acquire);
4514
4515 // then create the thread running ev_loop
4516 pthread_create (&u->tid, 0, l_run, EV_A);
4517 }
4518
4519The callback for the C<ev_async> watcher does nothing: the watcher is used
4520solely to wake up the event loop so it takes notice of any new watchers
4521that might have been added:
4522
4523 static void
4524 async_cb (EV_P_ ev_async *w, int revents)
4525 {
4526 // just used for the side effects
4527 }
4528
4529The C<l_release> and C<l_acquire> callbacks simply unlock/lock the mutex
4530protecting the loop data, respectively.
4531
4532 static void
4533 l_release (EV_P)
4534 {
4535 userdata *u = ev_userdata (EV_A);
4536 pthread_mutex_unlock (&u->lock);
4537 }
4538
4539 static void
4540 l_acquire (EV_P)
4541 {
4542 userdata *u = ev_userdata (EV_A);
4543 pthread_mutex_lock (&u->lock);
4544 }
4545
4546The event loop thread first acquires the mutex, and then jumps straight
4547into C<ev_run>:
4548
4549 void *
4550 l_run (void *thr_arg)
4551 {
4552 struct ev_loop *loop = (struct ev_loop *)thr_arg;
4553
4554 l_acquire (EV_A);
4555 pthread_setcanceltype (PTHREAD_CANCEL_ASYNCHRONOUS, 0);
4556 ev_run (EV_A_ 0);
4557 l_release (EV_A);
4558
4559 return 0;
4560 }
4561
4562Instead of invoking all pending watchers, the C<l_invoke> callback will
4563signal the main thread via some unspecified mechanism (signals? pipe
4564writes? C<Async::Interrupt>?) and then waits until all pending watchers
4565have been called (in a while loop because a) spurious wakeups are possible
4566and b) skipping inter-thread-communication when there are no pending
4567watchers is very beneficial):
4568
4569 static void
4570 l_invoke (EV_P)
4571 {
4572 userdata *u = ev_userdata (EV_A);
4573
4574 while (ev_pending_count (EV_A))
4575 {
4576 wake_up_other_thread_in_some_magic_or_not_so_magic_way ();
4577 pthread_cond_wait (&u->invoke_cv, &u->lock);
4578 }
4579 }
4580
4581Now, whenever the main thread gets told to invoke pending watchers, it
4582will grab the lock, call C<ev_invoke_pending> and then signal the loop
4583thread to continue:
4584
4585 static void
4586 real_invoke_pending (EV_P)
4587 {
4588 userdata *u = ev_userdata (EV_A);
4589
4590 pthread_mutex_lock (&u->lock);
4591 ev_invoke_pending (EV_A);
4592 pthread_cond_signal (&u->invoke_cv);
4593 pthread_mutex_unlock (&u->lock);
4594 }
4595
4596Whenever you want to start/stop a watcher or do other modifications to an
4597event loop, you will now have to lock:
4598
4599 ev_timer timeout_watcher;
4600 userdata *u = ev_userdata (EV_A);
4601
4602 ev_timer_init (&timeout_watcher, timeout_cb, 5.5, 0.);
4603
4604 pthread_mutex_lock (&u->lock);
4605 ev_timer_start (EV_A_ &timeout_watcher);
4606 ev_async_send (EV_A_ &u->async_w);
4607 pthread_mutex_unlock (&u->lock);
4608
4609Note that sending the C<ev_async> watcher is required because otherwise
4610an event loop currently blocking in the kernel will have no knowledge
4611about the newly added timer. By waking up the loop it will pick up any new
4612watchers in the next event loop iteration.
4613 4638
4614=head3 COROUTINES 4639=head3 COROUTINES
4615 4640
4616Libev is very accommodating to coroutines ("cooperative threads"): 4641Libev is very accommodating to coroutines ("cooperative threads"):
4617libev fully supports nesting calls to its functions from different 4642libev fully supports nesting calls to its functions from different

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines