ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libeio/eio.pod
(Generate patch)

Comparing libeio/eio.pod (file contents):
Revision 1.3 by root, Wed Oct 22 18:15:36 2008 UTC vs.
Revision 1.17 by root, Tue Jul 5 18:59:28 2011 UTC

11The newest version of this document is also available as an html-formatted 11The newest version of this document is also available as an html-formatted
12web page you might find easier to navigate when reading it for the first 12web page you might find easier to navigate when reading it for the first
13time: L<http://pod.tst.eu/http://cvs.schmorp.de/libeio/eio.pod>. 13time: L<http://pod.tst.eu/http://cvs.schmorp.de/libeio/eio.pod>.
14 14
15Note that this library is a by-product of the C<IO::AIO> perl 15Note that this library is a by-product of the C<IO::AIO> perl
16module, and many of the subtler points regarding requets lifetime 16module, and many of the subtler points regarding requests lifetime
17and so on are only documented in its documentation at the 17and so on are only documented in its documentation at the
18moment: L<http://pod.tst.eu/http://cvs.schmorp.de/IO-AIO/AIO.pm>. 18moment: L<http://pod.tst.eu/http://cvs.schmorp.de/IO-AIO/AIO.pm>.
19 19
20=head2 FEATURES 20=head2 FEATURES
21 21
22This library provides fully asynchronous versions of most POSIX functions 22This library provides fully asynchronous versions of most POSIX functions
23dealign with I/O. Unlike most asynchronous libraries, this not only 23dealing with I/O. Unlike most asynchronous libraries, this not only
24includes C<read> and C<write>, but also C<open>, C<stat>, C<unlink> and 24includes C<read> and C<write>, but also C<open>, C<stat>, C<unlink> and
25similar functions, as well as less rarely ones such as C<mknod>, C<futime> 25similar functions, as well as less rarely ones such as C<mknod>, C<futime>
26or C<readlink>. 26or C<readlink>.
27 27
28It also offers wrappers around C<sendfile> (Solaris, Linux, HP-UX and 28It also offers wrappers around C<sendfile> (Solaris, Linux, HP-UX and
29FreeBSD, with emulation on other platforms) and C<readahead> (Linux, with 29FreeBSD, with emulation on other platforms) and C<readahead> (Linux, with
30emulation elsewhere>). 30emulation elsewhere>).
31 31
32The goal is to enbale you to write fully non-blocking programs. For 32The goal is to enable you to write fully non-blocking programs. For
33example, in a game server, you would not want to freeze for a few seconds 33example, in a game server, you would not want to freeze for a few seconds
34just because the server is running a backup and you happen to call 34just because the server is running a backup and you happen to call
35C<readdir>. 35C<readdir>.
36 36
37=head2 TIME REPRESENTATION 37=head2 TIME REPRESENTATION
38 38
39Libeio represents time as a single floating point number, representing the 39Libeio represents time as a single floating point number, representing the
40(fractional) number of seconds since the (POSIX) epoch (somewhere near 40(fractional) number of seconds since the (POSIX) epoch (somewhere near
41the beginning of 1970, details are complicated, don't ask). This type is 41the beginning of 1970, details are complicated, don't ask). This type is
42called C<eio_tstamp>, but it is guarenteed to be of type C<double> (or 42called C<eio_tstamp>, but it is guaranteed to be of type C<double> (or
43better), so you can freely use C<double> yourself. 43better), so you can freely use C<double> yourself.
44 44
45Unlike the name component C<stamp> might indicate, it is also used for 45Unlike the name component C<stamp> might indicate, it is also used for
46time differences throughout libeio. 46time differences throughout libeio.
47 47
48=head2 FORK SUPPORT 48=head2 FORK SUPPORT
49 49
50Calling C<fork ()> is fully supported by this module. It is implemented in these steps: 50Calling C<fork ()> is fully supported by this module - but you must not
51rely on this. It is currently implemented in these steps:
51 52
52 1. wait till all requests in "execute" state have been handled 53 1. wait till all requests in "execute" state have been handled
53 (basically requests that are already handed over to the kernel). 54 (basically requests that are already handed over to the kernel).
54 2. fork 55 2. fork
55 3. in the parent, continue business as usual, done 56 3. in the parent, continue business as usual, done
56 4. in the child, destroy all ready and pending requests and free the 57 4. in the child, destroy all ready and pending requests and free the
57 memory used by the worker threads. This gives you a fully empty 58 memory used by the worker threads. This gives you a fully empty
58 libeio queue. 59 libeio queue.
60
61Note, however, since libeio does use threads, the above guarantee doesn't
62cover your libc, for example, malloc and other libc functions are not
63fork-safe, so there is very little you can do after a fork, and in fact,
64the above might crash, and thus change.
59 65
60=head1 INITIALISATION/INTEGRATION 66=head1 INITIALISATION/INTEGRATION
61 67
62Before you can call any eio functions you first have to initialise the 68Before you can call any eio functions you first have to initialise the
63library. The library integrates into any event loop, but can also be used 69library. The library integrates into any event loop, but can also be used
97handled or C<done_poll> has been called, which signals the same. 103handled or C<done_poll> has been called, which signals the same.
98 104
99Note that C<eio_poll> might return after C<done_poll> and C<want_poll> 105Note that C<eio_poll> might return after C<done_poll> and C<want_poll>
100have been called again, so watch out for races in your code. 106have been called again, so watch out for races in your code.
101 107
102As with C<want_poll>, this callback is called while lcoks are being held, 108As with C<want_poll>, this callback is called while locks are being held,
103so you I<must not call any libeio functions form within this callback>. 109so you I<must not call any libeio functions form within this callback>.
104 110
105=item int eio_poll () 111=item int eio_poll ()
106 112
107This function has to be called whenever there are pending requests that 113This function has to be called whenever there are pending requests that
119=back 125=back
120 126
121For libev, you would typically use an C<ev_async> watcher: the 127For libev, you would typically use an C<ev_async> watcher: the
122C<want_poll> callback would invoke C<ev_async_send> to wake up the event 128C<want_poll> callback would invoke C<ev_async_send> to wake up the event
123loop. Inside the callback set for the watcher, one would call C<eio_poll 129loop. Inside the callback set for the watcher, one would call C<eio_poll
124()> (followed by C<ev_async_send> again if C<eio_poll> indicates that not 130()>.
125all requests have been handled yet). The race is taken care of because 131
126libev resets/rearms the async watcher before calling your callback, 132If C<eio_poll ()> is configured to not handle all results in one go
127and therefore, before calling C<eio_poll>. This might result in (some) 133(i.e. it returns C<-1>) then you should start an idle watcher that calls
128spurious wake-ups, but is generally harmless. 134C<eio_poll> until it returns something C<!= -1>.
135
136A full-featured conenctor between libeio and libev would look as follows
137(if C<eio_poll> is handling all requests, it can of course be simplified a
138lot by removing the idle watcher logic):
139
140 static struct ev_loop *loop;
141 static ev_idle repeat_watcher;
142 static ev_async ready_watcher;
143
144 /* idle watcher callback, only used when eio_poll */
145 /* didn't handle all results in one call */
146 static void
147 repeat (EV_P_ ev_idle *w, int revents)
148 {
149 if (eio_poll () != -1)
150 ev_idle_stop (EV_A_ w);
151 }
152
153 /* eio has some results, process them */
154 static void
155 ready (EV_P_ ev_async *w, int revents)
156 {
157 if (eio_poll () == -1)
158 ev_idle_start (EV_A_ &repeat_watcher);
159 }
160
161 /* wake up the event loop */
162 static void
163 want_poll (void)
164 {
165 ev_async_send (loop, &ready_watcher)
166 }
167
168 void
169 my_init_eio ()
170 {
171 loop = EV_DEFAULT;
172
173 ev_idle_init (&repeat_watcher, repeat);
174 ev_async_init (&ready_watcher, ready);
175 ev_async_start (loop &watcher);
176
177 eio_init (want_poll, 0);
178 }
129 179
130For most other event loops, you would typically use a pipe - the event 180For most other event loops, you would typically use a pipe - the event
131loop should be told to wait for read readyness on the read end. In 181loop should be told to wait for read readiness on the read end. In
132C<want_poll> you would write a single byte, in C<done_poll> you would try 182C<want_poll> you would write a single byte, in C<done_poll> you would try
133to read that byte, and in the callback for the read end, you would call 183to read that byte, and in the callback for the read end, you would call
134C<eio_poll>. The race is avoided here because the event loop should invoke 184C<eio_poll>.
135your callback again and again until the byte has been read (as the pipe 185
136read callback does not read it, only C<done_poll>). 186You don't have to take special care in the case C<eio_poll> doesn't handle
187all requests, as the done callback will not be invoked, so the event loop
188will still signal readyness for the pipe until I<all> results have been
189processed.
190
191
192=head1 HIGH LEVEL REQUEST API
193
194Libeio has both a high-level API, which consists of calling a request
195function with a callback to be called on completion, and a low-level API
196where you fill out request structures and submit them.
197
198This section describes the high-level API.
199
200=head2 REQUEST SUBMISSION AND RESULT PROCESSING
201
202You submit a request by calling the relevant C<eio_TYPE> function with the
203required parameters, a callback of type C<int (*eio_cb)(eio_req *req)>
204(called C<eio_cb> below) and a freely usable C<void *data> argument.
205
206The return value will either be 0, in case something went really wrong
207(which can basically only happen on very fatal errors, such as C<malloc>
208returning 0, which is rather unlikely), or a pointer to the newly-created
209and submitted C<eio_req *>.
210
211The callback will be called with an C<eio_req *> which contains the
212results of the request. The members you can access inside that structure
213vary from request to request, except for:
214
215=over 4
216
217=item C<ssize_t result>
218
219This contains the result value from the call (usually the same as the
220syscall of the same name).
221
222=item C<int errorno>
223
224This contains the value of C<errno> after the call.
225
226=item C<void *data>
227
228The C<void *data> member simply stores the value of the C<data> argument.
229
230=back
231
232The return value of the callback is normally C<0>, which tells libeio to
233continue normally. If a callback returns a nonzero value, libeio will
234stop processing results (in C<eio_poll>) and will return the value to its
235caller.
236
237Memory areas passed to libeio must stay valid as long as a request
238executes, with the exception of paths, which are being copied
239internally. Any memory libeio itself allocates will be freed after the
240finish callback has been called. If you want to manage all memory passed
241to libeio yourself you can use the low-level API.
242
243For example, to open a file, you could do this:
244
245 static int
246 file_open_done (eio_req *req)
247 {
248 if (req->result < 0)
249 {
250 /* open() returned -1 */
251 errno = req->errorno;
252 perror ("open");
253 }
254 else
255 {
256 int fd = req->result;
257 /* now we have the new fd in fd */
258 }
259
260 return 0;
261 }
262
263 /* the first three arguments are passed to open(2) */
264 /* the remaining are priority, callback and data */
265 if (!eio_open ("/etc/passwd", O_RDONLY, 0, 0, file_open_done, 0))
266 abort (); /* something ent wrong, we will all die!!! */
267
268Note that you additionally need to call C<eio_poll> when the C<want_cb>
269indicates that requests are ready to be processed.
270
271=head2 CANCELLING REQUESTS
272
273Sometimes the need for a request goes away before the request is
274finished. In that case, one can cancel the reqiest by a call to
275C<eio_cancel>:
276
277=over 4
278
279=item eio_cancel (eio_req *req)
280
281Cancel the request. If the request is currently executing it might still
282continue to execute, and in other cases it might still take a while till
283the request is cancelled.
284
285Even if cancelled, the finish callback will still be invoked - the
286callbacks of all cancellable requests need to check whether the request
287has been cancelled by calling C<EIO_CANCELLED (req)>:
288
289 static int
290 my_eio_cb (eio_req *req)
291 {
292 if (EIO_CANCELLED (req))
293 return 0;
294 }
295
296In addition, cancelled requests will either have C<< req->result >> set to
297C<-1> and C<errno> to C<ECANCELED>, or otherwise they were successfully
298executed despite being cancelled (e.g. when they have already been
299executed at the time they were cancelled).
300
301=back
302
303=head2 AVAILABLE REQUESTS
304
305The following request functions are available. I<All> of them return the
306C<eio_req *> on success and C<0> on failure, and I<all> of them have the
307same three trailing arguments: C<pri>, C<cb> and C<data>. The C<cb> is
308mandatory, but in most cases, you pass in C<0> as C<pri> and C<0> or some
309custom data value as C<data>.
310
311=head3 POSIX API WRAPPERS
312
313These requests simply wrap the POSIX call of the same name, with the same
314arguments. If a function is not implemented by the OS and cannot be emulated
315in some way, then all of these return C<-1> and set C<errorno> to C<ENOSYS>.
316
317=over 4
318
319=item eio_open (const char *path, int flags, mode_t mode, int pri, eio_cb cb, void *data)
320
321=item eio_truncate (const char *path, off_t offset, int pri, eio_cb cb, void *data)
322
323=item eio_chown (const char *path, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
324
325=item eio_chmod (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
326
327=item eio_mkdir (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
328
329=item eio_rmdir (const char *path, int pri, eio_cb cb, void *data)
330
331=item eio_unlink (const char *path, int pri, eio_cb cb, void *data)
332
333=item eio_utime (const char *path, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
334
335=item eio_mknod (const char *path, mode_t mode, dev_t dev, int pri, eio_cb cb, void *data)
336
337=item eio_link (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
338
339=item eio_symlink (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
340
341=item eio_rename (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
342
343=item eio_mlock (void *addr, size_t length, int pri, eio_cb cb, void *data)
344
345=item eio_close (int fd, int pri, eio_cb cb, void *data)
346
347=item eio_sync (int pri, eio_cb cb, void *data)
348
349=item eio_fsync (int fd, int pri, eio_cb cb, void *data)
350
351=item eio_fdatasync (int fd, int pri, eio_cb cb, void *data)
352
353=item eio_futime (int fd, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
354
355=item eio_ftruncate (int fd, off_t offset, int pri, eio_cb cb, void *data)
356
357=item eio_fchmod (int fd, mode_t mode, int pri, eio_cb cb, void *data)
358
359=item eio_fchown (int fd, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
360
361=item eio_dup2 (int fd, int fd2, int pri, eio_cb cb, void *data)
362
363These have the same semantics as the syscall of the same name, their
364return value is available as C<< req->result >> later.
365
366=item eio_read (int fd, void *buf, size_t length, off_t offset, int pri, eio_cb cb, void *data)
367
368=item eio_write (int fd, void *buf, size_t length, off_t offset, int pri, eio_cb cb, void *data)
369
370These two requests are called C<read> and C<write>, but actually wrap
371C<pread> and C<pwrite>. On systems that lack these calls (such as cygwin),
372libeio uses lseek/read_or_write/lseek and a mutex to serialise the
373requests, so all these requests run serially and do not disturb each
374other. However, they still disturb the file offset while they run, so it's
375not safe to call these functions concurrently with non-libeio functions on
376the same fd on these systems.
377
378Not surprisingly, pread and pwrite are not thread-safe on Darwin (OS/X),
379so it is advised not to submit multiple requests on the same fd on this
380horrible pile of garbage.
381
382=item eio_mlockall (int flags, int pri, eio_cb cb, void *data)
383
384Like C<mlockall>, but the flag value constants are called
385C<EIO_MCL_CURRENT> and C<EIO_MCL_FUTURE>.
386
387=item eio_msync (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
388
389Just like msync, except that the flag values are called C<EIO_MS_ASYNC>,
390C<EIO_MS_INVALIDATE> and C<EIO_MS_SYNC>.
391
392=item eio_readlink (const char *path, int pri, eio_cb cb, void *data)
393
394If successful, the path read by C<readlink(2)> can be accessed via C<<
395req->ptr2 >> and is I<NOT> null-terminated, with the length specified as
396C<< req->result >>.
397
398 if (req->result >= 0)
399 {
400 char *target = strndup ((char *)req->ptr2, req->result);
401
402 free (target);
403 }
404
405=item eio_realpath (const char *path, int pri, eio_cb cb, void *data)
406
407Similar to the realpath libc function, but unlike that one, result is
408C<-1> on failure and the length of the returned path in C<ptr2> (which is
409not 0-terminated) - this is similar to readlink.
410
411=item eio_stat (const char *path, int pri, eio_cb cb, void *data)
412
413=item eio_lstat (const char *path, int pri, eio_cb cb, void *data)
414
415=item eio_fstat (int fd, int pri, eio_cb cb, void *data)
416
417Stats a file - if C<< req->result >> indicates success, then you can
418access the C<struct stat>-like structure via C<< req->ptr2 >>:
419
420 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2;
421
422=item eio_statvfs (const char *path, int pri, eio_cb cb, void *data)
423
424=item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data)
425
426Stats a filesystem - if C<< req->result >> indicates success, then you can
427access the C<struct statvfs>-like structure via C<< req->ptr2 >>:
428
429 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2;
430
431=back
432
433=head3 READING DIRECTORIES
434
435Reading directories sounds simple, but can be rather demanding, especially
436if you want to do stuff such as traversing a diretcory hierarchy or
437processing all files in a directory. Libeio can assist thess complex tasks
438with it's C<eio_readdir> call.
439
440=over 4
441
442=item eio_readdir (const char *path, int flags, int pri, eio_cb cb, void *data)
443
444This is a very complex call. It basically reads through a whole directory
445(via the C<opendir>, C<readdir> and C<closedir> calls) and returns either
446the names or an array of C<struct eio_dirent>, depending on the C<flags>
447argument.
448
449The C<< req->result >> indicates either the number of files found, or
450C<-1> on error. On success, null-terminated names can be found as C<< req->ptr2 >>,
451and C<struct eio_dirents>, if requested by C<flags>, can be found via C<<
452req->ptr1 >>.
453
454Here is an example that prints all the names:
455
456 int i;
457 char *names = (char *)req->ptr2;
458
459 for (i = 0; i < req->result; ++i)
460 {
461 printf ("name #%d: %s\n", i, names);
462
463 /* move to next name */
464 names += strlen (names) + 1;
465 }
466
467Pseudo-entries such as F<.> and F<..> are never returned by C<eio_readdir>.
468
469C<flags> can be any combination of:
470
471=over 4
472
473=item EIO_READDIR_DENTS
474
475If this flag is specified, then, in addition to the names in C<ptr2>,
476also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct
477eio_dirent> looks like this:
478
479 struct eio_dirent
480 {
481 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */
482 unsigned short namelen; /* size of filename without trailing 0 */
483 unsigned char type; /* one of EIO_DT_* */
484 signed char score; /* internal use */
485 ino_t inode; /* the inode number, if available, otherwise unspecified */
486 };
487
488The only members you normally would access are C<nameofs>, which is the
489byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>.
490
491C<type> can be one of:
492
493C<EIO_DT_UNKNOWN> - if the type is not known (very common) and you have to C<stat>
494the name yourself if you need to know,
495one of the "standard" POSIX file types (C<EIO_DT_REG>, C<EIO_DT_DIR>, C<EIO_DT_LNK>,
496C<EIO_DT_FIFO>, C<EIO_DT_SOCK>, C<EIO_DT_CHR>, C<EIO_DT_BLK>)
497or some OS-specific type (currently
498C<EIO_DT_MPC> - multiplexed char device (v7+coherent),
499C<EIO_DT_NAM> - xenix special named file,
500C<EIO_DT_MPB> - multiplexed block device (v7+coherent),
501C<EIO_DT_NWK> - HP-UX network special,
502C<EIO_DT_CMP> - VxFS compressed,
503C<EIO_DT_DOOR> - solaris door, or
504C<EIO_DT_WHT>).
505
506This example prints all names and their type:
507
508 int i;
509 struct eio_dirent *ents = (struct eio_dirent *)req->ptr1;
510 char *names = (char *)req->ptr2;
511
512 for (i = 0; i < req->result; ++i)
513 {
514 struct eio_dirent *ent = ents + i;
515 char *name = names + ent->nameofs;
516
517 printf ("name #%d: %s (type %d)\n", i, name, ent->type);
518 }
519
520=item EIO_READDIR_DIRS_FIRST
521
522When this flag is specified, then the names will be returned in an order
523where likely directories come first, in optimal C<stat> order. This is
524useful when you need to quickly find directories, or you want to find all
525directories while avoiding to stat() each entry.
526
527If the system returns type information in readdir, then this is used
528to find directories directly. Otherwise, likely directories are names
529beginning with ".", or otherwise names with no dots, of which names with
530short names are tried first.
531
532=item EIO_READDIR_STAT_ORDER
533
534When this flag is specified, then the names will be returned in an order
535suitable for stat()'ing each one. That is, when you plan to stat()
536all files in the given directory, then the returned order will likely
537be fastest.
538
539If both this flag and C<EIO_READDIR_DIRS_FIRST> are specified, then
540the likely dirs come first, resulting in a less optimal stat order.
541
542=item EIO_READDIR_FOUND_UNKNOWN
543
544This flag should not be specified when calling C<eio_readdir>. Instead,
545it is being set by C<eio_readdir> (you can access the C<flags> via C<<
546req->int1 >>, when any of the C<type>'s found were C<EIO_DT_UNKNOWN>. The
547absense of this flag therefore indicates that all C<type>'s are known,
548which can be used to speed up some algorithms.
549
550A typical use case would be to identify all subdirectories within a
551directory - you would ask C<eio_readdir> for C<EIO_READDIR_DIRS_FIRST>. If
552then this flag is I<NOT> set, then all the entries at the beginning of the
553returned array of type C<EIO_DT_DIR> are the directories. Otherwise, you
554should start C<stat()>'ing the entries starting at the beginning of the
555array, stopping as soon as you found all directories (the count can be
556deduced by the link count of the directory).
557
558=back
559
560=back
561
562=head3 OS-SPECIFIC CALL WRAPPERS
563
564These wrap OS-specific calls (usually Linux ones), and might or might not
565be emulated on other operating systems. Calls that are not emulated will
566return C<-1> and set C<errno> to C<ENOSYS>.
567
568=over 4
569
570=item eio_sendfile (int out_fd, int in_fd, off_t in_offset, size_t length, int pri, eio_cb cb, void *data)
571
572Wraps the C<sendfile> syscall. The arguments follow the Linux version, but
573libeio supports and will use similar calls on FreeBSD, HP/UX, Solaris and
574Darwin.
575
576If the OS doesn't support some sendfile-like call, or the call fails,
577indicating support for the given file descriptor type (for example,
578Linux's sendfile might not support file to file copies), then libeio will
579emulate the call in userspace, so there are almost no limitations on its
580use.
581
582=item eio_readahead (int fd, off_t offset, size_t length, int pri, eio_cb cb, void *data)
583
584Calls C<readahead(2)>. If the syscall is missing, then the call is
585emulated by simply reading the data (currently in 64kiB chunks).
586
587=item eio_sync_file_range (int fd, off_t offset, size_t nbytes, unsigned int flags, int pri, eio_cb cb, void *data)
588
589Calls C<sync_file_range>. If the syscall is missing, then this is the same
590as calling C<fdatasync>.
591
592Flags can be any combination of C<EIO_SYNC_FILE_RANGE_WAIT_BEFORE>,
593C<EIO_SYNC_FILE_RANGE_WRITE> and C<EIO_SYNC_FILE_RANGE_WAIT_AFTER>.
594
595=back
596
597=head3 LIBEIO-SPECIFIC REQUESTS
598
599These requests are specific to libeio and do not correspond to any OS call.
600
601=over 4
602
603=item eio_mtouch (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
604
605Reads (C<flags == 0>) or modifies (C<flags == EIO_MT_MODIFY) the given
606memory area, page-wise, that is, it reads (or reads and writes back) the
607first octet of every page that spans the memory area.
608
609This can be used to page in some mmapped file, or dirty some pages. Note
610that dirtying is an unlocked read-write access, so races can ensue when
611the some other thread modifies the data stored in that memory area.
612
613=item eio_custom (void (*)(eio_req *) execute, int pri, eio_cb cb, void *data)
614
615Executes a custom request, i.e., a user-specified callback.
616
617The callback gets the C<eio_req *> as parameter and is expected to read
618and modify any request-specific members. Specifically, it should set C<<
619req->result >> to the result value, just like other requests.
620
621Here is an example that simply calls C<open>, like C<eio_open>, but it
622uses the C<data> member as filename and uses a hardcoded C<O_RDONLY>. If
623you want to pass more/other parameters, you either need to pass some
624struct or so via C<data> or provide your own wrapper using the low-level
625API.
626
627 static int
628 my_open_done (eio_req *req)
629 {
630 int fd = req->result;
631
632 return 0;
633 }
634
635 static void
636 my_open (eio_req *req)
637 {
638 req->result = open (req->data, O_RDONLY);
639 }
640
641 eio_custom (my_open, 0, my_open_done, "/etc/passwd");
642
643=item eio_busy (eio_tstamp delay, int pri, eio_cb cb, void *data)
644
645This is a a request that takes C<delay> seconds to execute, but otherwise
646does nothing - it simply puts one of the worker threads to sleep for this
647long.
648
649This request can be used to artificially increase load, e.g. for debugging
650or benchmarking reasons.
651
652=item eio_nop (int pri, eio_cb cb, void *data)
653
654This request does nothing, except go through the whole request cycle. This
655can be used to measure latency or in some cases to simplify code, but is
656not really of much use.
657
658=back
659
660=head3 GROUPING AND LIMITING REQUESTS
661
662There is one more rather special request, C<eio_grp>. It is a very special
663aio request: Instead of doing something, it is a container for other eio
664requests.
665
666There are two primary use cases for this: a) bundle many requests into a
667single, composite, request with a definite callback and the ability to
668cancel the whole request with its subrequests and b) limiting the number
669of "active" requests.
670
671Further below you will find more dicussion of these topics - first follows
672the reference section detailing the request generator and other methods.
673
674=over 4
675
676=item eio_req *grp = eio_grp (eio_cb cb, void *data)
677
678Creates, submits and returns a group request.
679
680=item eio_grp_add (eio_req *grp, eio_req *req)
681
682Adds a request to the request group.
683
684=item eio_grp_cancel (eio_req *grp)
685
686Cancels all requests I<in> the group, but I<not> the group request
687itself. You can cancel the group request via a normal C<eio_cancel> call.
688
689
690
691=back
692
693
694
695#TODO
696
697/*****************************************************************************/
698/* groups */
699
700eio_req *eio_grp (eio_cb cb, void *data);
701void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit);
702void eio_grp_limit (eio_req *grp, int limit);
703void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */
704
705
706=back
707
708
709=head1 LOW LEVEL REQUEST API
710
711#TODO
712
713
714=head1 ANATOMY AND LIFETIME OF AN EIO REQUEST
715
716A request is represented by a structure of type C<eio_req>. To initialise
717it, clear it to all zero bytes:
718
719 eio_req req;
720
721 memset (&req, 0, sizeof (req));
722
723A more common way to initialise a new C<eio_req> is to use C<calloc>:
724
725 eio_req *req = calloc (1, sizeof (*req));
726
727In either case, libeio neither allocates, initialises or frees the
728C<eio_req> structure for you - it merely uses it.
729
730zero
731
732#TODO
137 733
138=head2 CONFIGURATION 734=head2 CONFIGURATION
139 735
140The functions in this section can sometimes be useful, but the default 736The functions in this section can sometimes be useful, but the default
141configuration will do in most case, so you should skip this section on 737configuration will do in most case, so you should skip this section on
185=item eio_set_max_idle (unsigned int nthreads) 781=item eio_set_max_idle (unsigned int nthreads)
186 782
187Libeio uses threads internally to handle most requests, and will start and stop threads on demand. 783Libeio uses threads internally to handle most requests, and will start and stop threads on demand.
188 784
189This call can be used to limit the number of idle threads (threads without 785This call can be used to limit the number of idle threads (threads without
190work to do): libeio will keep some threads idle in preperation for more 786work to do): libeio will keep some threads idle in preparation for more
191requests, but never longer than C<nthreads> threads. 787requests, but never longer than C<nthreads> threads.
192 788
193In addition to this, libeio will also stop threads when they are idle for 789In addition to this, libeio will also stop threads when they are idle for
194a few seconds, regardless of this setting. 790a few seconds, regardless of this setting.
195 791
214executed and have results, but have not been finished yet by a call to 810executed and have results, but have not been finished yet by a call to
215C<eio_poll>). 811C<eio_poll>).
216 812
217=back 813=back
218 814
219
220=head1 ANATOMY OF AN EIO REQUEST
221
222#TODO
223
224
225=head1 HIGH LEVEL REQUEST API
226
227#TODO
228
229=back
230
231
232=head1 LOW LEVEL REQUEST API
233
234#TODO
235
236=head1 EMBEDDING 815=head1 EMBEDDING
237 816
238Libeio can be embedded directly into programs. This functionality is not 817Libeio can be embedded directly into programs. This functionality is not
239documented and not (yet) officially supported. 818documented and not (yet) officially supported.
240 819
241Note that, when including C<libeio.m4>, you are responsible for defining 820Note that, when including C<libeio.m4>, you are responsible for defining
242the compilation environment (C<_LARGEFILE_SOURCE>, C<_GNU_SOURCE> etc.). 821the compilation environment (C<_LARGEFILE_SOURCE>, C<_GNU_SOURCE> etc.).
243 822
244If you need to know how, check the C<IO::AIO> perl module, which does 823If you need to know how, check the C<IO::AIO> perl module, which does
245exactly that. 824exactly that.
825
826
827=head1 COMPILETIME CONFIGURATION
828
829These symbols, if used, must be defined when compiling F<eio.c>.
830
831=over 4
832
833=item EIO_STACKSIZE
834
835This symbol governs the stack size for each eio thread. Libeio itself
836was written to use very little stackspace, but when using C<EIO_CUSTOM>
837requests, you might want to increase this.
838
839If this symbol is undefined (the default) then libeio will use its default
840stack size (C<sizeof (long) * 4096> currently). If it is defined, but
841C<0>, then the default operating system stack size will be used. In all
842other cases, the value must be an expression that evaluates to the desired
843stack size.
844
845=back
246 846
247 847
248=head1 PORTABILITY REQUIREMENTS 848=head1 PORTABILITY REQUIREMENTS
249 849
250In addition to a working ISO-C implementation, libeio relies on a few 850In addition to a working ISO-C implementation, libeio relies on a few

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines