ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libeio/eio.pod
(Generate patch)

Comparing libeio/eio.pod (file contents):
Revision 1.15 by root, Tue Jul 5 16:57:41 2011 UTC vs.
Revision 1.17 by root, Tue Jul 5 18:59:28 2011 UTC

45Unlike the name component C<stamp> might indicate, it is also used for 45Unlike the name component C<stamp> might indicate, it is also used for
46time differences throughout libeio. 46time differences throughout libeio.
47 47
48=head2 FORK SUPPORT 48=head2 FORK SUPPORT
49 49
50Calling C<fork ()> is fully supported by this module. It is implemented in these steps: 50Calling C<fork ()> is fully supported by this module - but you must not
51rely on this. It is currently implemented in these steps:
51 52
52 1. wait till all requests in "execute" state have been handled 53 1. wait till all requests in "execute" state have been handled
53 (basically requests that are already handed over to the kernel). 54 (basically requests that are already handed over to the kernel).
54 2. fork 55 2. fork
55 3. in the parent, continue business as usual, done 56 3. in the parent, continue business as usual, done
56 4. in the child, destroy all ready and pending requests and free the 57 4. in the child, destroy all ready and pending requests and free the
57 memory used by the worker threads. This gives you a fully empty 58 memory used by the worker threads. This gives you a fully empty
58 libeio queue. 59 libeio queue.
59 60
60Note, however, since libeio does use threads, thr above guarantee doesn't 61Note, however, since libeio does use threads, the above guarantee doesn't
61cover your libc, for example, malloc and other libc functions are not 62cover your libc, for example, malloc and other libc functions are not
62fork-safe, so there is very little you can do after a fork, and in fatc, 63fork-safe, so there is very little you can do after a fork, and in fact,
63the above might crash, and thus change. 64the above might crash, and thus change.
64 65
65=head1 INITIALISATION/INTEGRATION 66=head1 INITIALISATION/INTEGRATION
66 67
67Before you can call any eio functions you first have to initialise the 68Before you can call any eio functions you first have to initialise the
130 131
131If C<eio_poll ()> is configured to not handle all results in one go 132If C<eio_poll ()> is configured to not handle all results in one go
132(i.e. it returns C<-1>) then you should start an idle watcher that calls 133(i.e. it returns C<-1>) then you should start an idle watcher that calls
133C<eio_poll> until it returns something C<!= -1>. 134C<eio_poll> until it returns something C<!= -1>.
134 135
135A full-featured wrapper would look as follows (if C<eio_poll> is handling 136A full-featured conenctor between libeio and libev would look as follows
136all requests, it can of course be simplified a lot by removing the idle 137(if C<eio_poll> is handling all requests, it can of course be simplified a
137watcher logic): 138lot by removing the idle watcher logic):
138 139
139 static struct ev_loop *loop; 140 static struct ev_loop *loop;
140 static ev_idle repeat_watcher; 141 static ev_idle repeat_watcher;
141 static ev_async ready_watcher; 142 static ev_async ready_watcher;
142 143
143 /* idle watcher callback, only used when eio_poll */ 144 /* idle watcher callback, only used when eio_poll */
144 /* didn't handle all results in one call */ 145 /* didn't handle all results in one call */
145 static void 146 static void
146 repeat (EV_P_ ev_idle *w, int revents) 147 repeat (EV_P_ ev_idle *w, int revents)
147 { 148 {
148 if (eio_poll () != -1) 149 if (eio_poll () != -1)
149 ev_idle_stop (EV_A_ w); 150 ev_idle_stop (EV_A_ w);
150 } 151 }
151 152
152 /* eio has some results, process them */ 153 /* eio has some results, process them */
153 static void 154 static void
154 ready (EV_P_ ev_async *w, int revents) 155 ready (EV_P_ ev_async *w, int revents)
155 { 156 {
156 if (eio_poll () == -1) 157 if (eio_poll () == -1)
157 ev_idle_start (EV_A_ &repeat_watcher); 158 ev_idle_start (EV_A_ &repeat_watcher);
158 } 159 }
159 160
160 /* wake up the event loop */ 161 /* wake up the event loop */
161 static void 162 static void
162 want_poll (void) 163 want_poll (void)
163 { 164 {
164 ev_async_send (loop, &ready_watcher) 165 ev_async_send (loop, &ready_watcher)
165 } 166 }
166 167
167 void 168 void
168 my_init_eio () 169 my_init_eio ()
169 { 170 {
170 loop = EV_DEFAULT; 171 loop = EV_DEFAULT;
171 172
172 ev_idle_init (&repeat_watcher, repeat); 173 ev_idle_init (&repeat_watcher, repeat);
173 ev_async_init (&ready_watcher, ready); 174 ev_async_init (&ready_watcher, ready);
174 ev_async_start (loop &watcher); 175 ev_async_start (loop &watcher);
175 176
176 eio_init (want_poll, 0); 177 eio_init (want_poll, 0);
177 } 178 }
178 179
179For most other event loops, you would typically use a pipe - the event 180For most other event loops, you would typically use a pipe - the event
180loop should be told to wait for read readiness on the read end. In 181loop should be told to wait for read readiness on the read end. In
181C<want_poll> you would write a single byte, in C<done_poll> you would try 182C<want_poll> you would write a single byte, in C<done_poll> you would try
182to read that byte, and in the callback for the read end, you would call 183to read that byte, and in the callback for the read end, you would call
183C<eio_poll>. The race is avoided here because the event loop should invoke 184C<eio_poll>.
184your callback again and again until the byte has been read (as the pipe 185
185read callback does not read it, only C<done_poll>). 186You don't have to take special care in the case C<eio_poll> doesn't handle
187all requests, as the done callback will not be invoked, so the event loop
188will still signal readyness for the pipe until I<all> results have been
189processed.
186 190
187 191
188=head1 HIGH LEVEL REQUEST API 192=head1 HIGH LEVEL REQUEST API
189 193
190Libeio has both a high-level API, which consists of calling a request 194Libeio has both a high-level API, which consists of calling a request
262 abort (); /* something ent wrong, we will all die!!! */ 266 abort (); /* something ent wrong, we will all die!!! */
263 267
264Note that you additionally need to call C<eio_poll> when the C<want_cb> 268Note that you additionally need to call C<eio_poll> when the C<want_cb>
265indicates that requests are ready to be processed. 269indicates that requests are ready to be processed.
266 270
271=head2 CANCELLING REQUESTS
272
273Sometimes the need for a request goes away before the request is
274finished. In that case, one can cancel the reqiest by a call to
275C<eio_cancel>:
276
277=over 4
278
279=item eio_cancel (eio_req *req)
280
281Cancel the request. If the request is currently executing it might still
282continue to execute, and in other cases it might still take a while till
283the request is cancelled.
284
285Even if cancelled, the finish callback will still be invoked - the
286callbacks of all cancellable requests need to check whether the request
287has been cancelled by calling C<EIO_CANCELLED (req)>:
288
289 static int
290 my_eio_cb (eio_req *req)
291 {
292 if (EIO_CANCELLED (req))
293 return 0;
294 }
295
296In addition, cancelled requests will either have C<< req->result >> set to
297C<-1> and C<errno> to C<ECANCELED>, or otherwise they were successfully
298executed despite being cancelled (e.g. when they have already been
299executed at the time they were cancelled).
300
301=back
302
267=head2 AVAILABLE REQUESTS 303=head2 AVAILABLE REQUESTS
268 304
269The following request functions are available. I<All> of them return the 305The following request functions are available. I<All> of them return the
270C<eio_req *> on success and C<0> on failure, and I<all> of them have the 306C<eio_req *> on success and C<0> on failure, and I<all> of them have the
271same three trailing arguments: C<pri>, C<cb> and C<data>. The C<cb> is 307same three trailing arguments: C<pri>, C<cb> and C<data>. The C<cb> is
379=item eio_fstat (int fd, int pri, eio_cb cb, void *data) 415=item eio_fstat (int fd, int pri, eio_cb cb, void *data)
380 416
381Stats a file - if C<< req->result >> indicates success, then you can 417Stats a file - if C<< req->result >> indicates success, then you can
382access the C<struct stat>-like structure via C<< req->ptr2 >>: 418access the C<struct stat>-like structure via C<< req->ptr2 >>:
383 419
384 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2; 420 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2;
385 421
386=item eio_statvfs (const char *path, int pri, eio_cb cb, void *data) 422=item eio_statvfs (const char *path, int pri, eio_cb cb, void *data)
387 423
388=item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data) 424=item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data)
389 425
390Stats a filesystem - if C<< req->result >> indicates success, then you can 426Stats a filesystem - if C<< req->result >> indicates success, then you can
391access the C<struct statvfs>-like structure via C<< req->ptr2 >>: 427access the C<struct statvfs>-like structure via C<< req->ptr2 >>:
392 428
393 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2; 429 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2;
394 430
395=back 431=back
396 432
397=head3 READING DIRECTORIES 433=head3 READING DIRECTORIES
398 434
438 474
439If this flag is specified, then, in addition to the names in C<ptr2>, 475If this flag is specified, then, in addition to the names in C<ptr2>,
440also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct 476also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct
441eio_dirent> looks like this: 477eio_dirent> looks like this:
442 478
443 struct eio_dirent 479 struct eio_dirent
444 { 480 {
445 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */ 481 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */
446 unsigned short namelen; /* size of filename without trailing 0 */ 482 unsigned short namelen; /* size of filename without trailing 0 */
447 unsigned char type; /* one of EIO_DT_* */ 483 unsigned char type; /* one of EIO_DT_* */
448 signed char score; /* internal use */ 484 signed char score; /* internal use */
449 ino_t inode; /* the inode number, if available, otherwise unspecified */ 485 ino_t inode; /* the inode number, if available, otherwise unspecified */
450 }; 486 };
451 487
452The only members you normally would access are C<nameofs>, which is the 488The only members you normally would access are C<nameofs>, which is the
453byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>. 489byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>.
454 490
455C<type> can be one of: 491C<type> can be one of:
635Further below you will find more dicussion of these topics - first follows 671Further below you will find more dicussion of these topics - first follows
636the reference section detailing the request generator and other methods. 672the reference section detailing the request generator and other methods.
637 673
638=over 4 674=over 4
639 675
640=item eio_grp (eio_cb cb, void *data) 676=item eio_req *grp = eio_grp (eio_cb cb, void *data)
641 677
642Creates and submits a group request. 678Creates, submits and returns a group request.
679
680=item eio_grp_add (eio_req *grp, eio_req *req)
681
682Adds a request to the request group.
683
684=item eio_grp_cancel (eio_req *grp)
685
686Cancels all requests I<in> the group, but I<not> the group request
687itself. You can cancel the group request via a normal C<eio_cancel> call.
688
689
643 690
644=back 691=back
645 692
646 693
647 694
651/* groups */ 698/* groups */
652 699
653eio_req *eio_grp (eio_cb cb, void *data); 700eio_req *eio_grp (eio_cb cb, void *data);
654void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit); 701void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit);
655void eio_grp_limit (eio_req *grp, int limit); 702void eio_grp_limit (eio_req *grp, int limit);
656void eio_grp_add (eio_req *grp, eio_req *req);
657void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */ 703void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */
658 704
659 705
660=back 706=back
661 707
668=head1 ANATOMY AND LIFETIME OF AN EIO REQUEST 714=head1 ANATOMY AND LIFETIME OF AN EIO REQUEST
669 715
670A request is represented by a structure of type C<eio_req>. To initialise 716A request is represented by a structure of type C<eio_req>. To initialise
671it, clear it to all zero bytes: 717it, clear it to all zero bytes:
672 718
673 eio_req req; 719 eio_req req;
674 720
675 memset (&req, 0, sizeof (req)); 721 memset (&req, 0, sizeof (req));
676 722
677A more common way to initialise a new C<eio_req> is to use C<calloc>: 723A more common way to initialise a new C<eio_req> is to use C<calloc>:
678 724
679 eio_req *req = calloc (1, sizeof (*req)); 725 eio_req *req = calloc (1, sizeof (*req));
680 726
681In either case, libeio neither allocates, initialises or frees the 727In either case, libeio neither allocates, initialises or frees the
682C<eio_req> structure for you - it merely uses it. 728C<eio_req> structure for you - it merely uses it.
683 729
684zero 730zero

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines