ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libeio/eio.pod
Revision: 1.14
Committed: Tue Jul 5 14:02:15 2011 UTC (12 years, 10 months ago) by root
Branch: MAIN
Changes since 1.13: +2 -2 lines
Log Message:
*** empty log message ***

File Contents

# User Rev Content
1 root 1.1 =head1 NAME
2    
3     libeio - truly asynchronous POSIX I/O
4    
5     =head1 SYNOPSIS
6    
7     #include <eio.h>
8    
9     =head1 DESCRIPTION
10    
11     The newest version of this document is also available as an html-formatted
12     web page you might find easier to navigate when reading it for the first
13     time: L<http://pod.tst.eu/http://cvs.schmorp.de/libeio/eio.pod>.
14    
15     Note that this library is a by-product of the C<IO::AIO> perl
16 sf-exg 1.6 module, and many of the subtler points regarding requests lifetime
17 root 1.1 and so on are only documented in its documentation at the
18     moment: L<http://pod.tst.eu/http://cvs.schmorp.de/IO-AIO/AIO.pm>.
19    
20     =head2 FEATURES
21    
22     This library provides fully asynchronous versions of most POSIX functions
23 sf-exg 1.6 dealing with I/O. Unlike most asynchronous libraries, this not only
24 root 1.1 includes C<read> and C<write>, but also C<open>, C<stat>, C<unlink> and
25     similar functions, as well as less rarely ones such as C<mknod>, C<futime>
26     or C<readlink>.
27    
28     It also offers wrappers around C<sendfile> (Solaris, Linux, HP-UX and
29     FreeBSD, with emulation on other platforms) and C<readahead> (Linux, with
30     emulation elsewhere>).
31    
32 root 1.5 The goal is to enable you to write fully non-blocking programs. For
33 root 1.1 example, in a game server, you would not want to freeze for a few seconds
34     just because the server is running a backup and you happen to call
35     C<readdir>.
36    
37     =head2 TIME REPRESENTATION
38    
39     Libeio represents time as a single floating point number, representing the
40     (fractional) number of seconds since the (POSIX) epoch (somewhere near
41     the beginning of 1970, details are complicated, don't ask). This type is
42 sf-exg 1.6 called C<eio_tstamp>, but it is guaranteed to be of type C<double> (or
43 root 1.1 better), so you can freely use C<double> yourself.
44    
45     Unlike the name component C<stamp> might indicate, it is also used for
46     time differences throughout libeio.
47    
48     =head2 FORK SUPPORT
49    
50     Calling C<fork ()> is fully supported by this module. It is implemented in these steps:
51    
52     1. wait till all requests in "execute" state have been handled
53     (basically requests that are already handed over to the kernel).
54     2. fork
55     3. in the parent, continue business as usual, done
56     4. in the child, destroy all ready and pending requests and free the
57     memory used by the worker threads. This gives you a fully empty
58     libeio queue.
59    
60 root 1.7 Note, however, since libeio does use threads, thr above guarantee doesn't
61     cover your libc, for example, malloc and other libc functions are not
62     fork-safe, so there is very little you can do after a fork, and in fatc,
63     the above might crash, and thus change.
64    
65 root 1.1 =head1 INITIALISATION/INTEGRATION
66    
67     Before you can call any eio functions you first have to initialise the
68     library. The library integrates into any event loop, but can also be used
69     without one, including in polling mode.
70    
71     You have to provide the necessary glue yourself, however.
72    
73     =over 4
74    
75     =item int eio_init (void (*want_poll)(void), void (*done_poll)(void))
76    
77     This function initialises the library. On success it returns C<0>, on
78     failure it returns C<-1> and sets C<errno> appropriately.
79    
80     It accepts two function pointers specifying callbacks as argument, both of
81     which can be C<0>, in which case the callback isn't called.
82    
83     =item want_poll callback
84    
85     The C<want_poll> callback is invoked whenever libeio wants attention (i.e.
86     it wants to be polled by calling C<eio_poll>). It is "edge-triggered",
87     that is, it will only be called once when eio wants attention, until all
88     pending requests have been handled.
89    
90     This callback is called while locks are being held, so I<you must
91     not call any libeio functions inside this callback>. That includes
92     C<eio_poll>. What you should do is notify some other thread, or wake up
93     your event loop, and then call C<eio_poll>.
94    
95     =item done_poll callback
96    
97     This callback is invoked when libeio detects that all pending requests
98     have been handled. It is "edge-triggered", that is, it will only be
99     called once after C<want_poll>. To put it differently, C<want_poll> and
100     C<done_poll> are invoked in pairs: after C<want_poll> you have to call
101     C<eio_poll ()> until either C<eio_poll> indicates that everything has been
102     handled or C<done_poll> has been called, which signals the same.
103    
104     Note that C<eio_poll> might return after C<done_poll> and C<want_poll>
105     have been called again, so watch out for races in your code.
106    
107 sf-exg 1.6 As with C<want_poll>, this callback is called while locks are being held,
108 root 1.1 so you I<must not call any libeio functions form within this callback>.
109    
110     =item int eio_poll ()
111    
112     This function has to be called whenever there are pending requests that
113     need finishing. You usually call this after C<want_poll> has indicated
114     that you should do so, but you can also call this function regularly to
115     poll for new results.
116    
117     If any request invocation returns a non-zero value, then C<eio_poll ()>
118     immediately returns with that value as return value.
119    
120     Otherwise, if all requests could be handled, it returns C<0>. If for some
121     reason not all requests have been handled, i.e. some are still pending, it
122     returns C<-1>.
123    
124     =back
125    
126     For libev, you would typically use an C<ev_async> watcher: the
127     C<want_poll> callback would invoke C<ev_async_send> to wake up the event
128     loop. Inside the callback set for the watcher, one would call C<eio_poll
129     ()> (followed by C<ev_async_send> again if C<eio_poll> indicates that not
130     all requests have been handled yet). The race is taken care of because
131     libev resets/rearms the async watcher before calling your callback,
132     and therefore, before calling C<eio_poll>. This might result in (some)
133     spurious wake-ups, but is generally harmless.
134    
135     For most other event loops, you would typically use a pipe - the event
136 sf-exg 1.6 loop should be told to wait for read readiness on the read end. In
137 root 1.1 C<want_poll> you would write a single byte, in C<done_poll> you would try
138     to read that byte, and in the callback for the read end, you would call
139     C<eio_poll>. The race is avoided here because the event loop should invoke
140     your callback again and again until the byte has been read (as the pipe
141     read callback does not read it, only C<done_poll>).
142    
143    
144 root 1.7 =head1 HIGH LEVEL REQUEST API
145    
146     Libeio has both a high-level API, which consists of calling a request
147     function with a callback to be called on completion, and a low-level API
148     where you fill out request structures and submit them.
149    
150     This section describes the high-level API.
151    
152     =head2 REQUEST SUBMISSION AND RESULT PROCESSING
153    
154     You submit a request by calling the relevant C<eio_TYPE> function with the
155     required parameters, a callback of type C<int (*eio_cb)(eio_req *req)>
156     (called C<eio_cb> below) and a freely usable C<void *data> argument.
157    
158 root 1.12 The return value will either be 0, in case something went really wrong
159     (which can basically only happen on very fatal errors, such as C<malloc>
160     returning 0, which is rather unlikely), or a pointer to the newly-created
161     and submitted C<eio_req *>.
162 root 1.7
163     The callback will be called with an C<eio_req *> which contains the
164     results of the request. The members you can access inside that structure
165     vary from request to request, except for:
166    
167     =over 4
168    
169     =item C<ssize_t result>
170    
171     This contains the result value from the call (usually the same as the
172     syscall of the same name).
173    
174     =item C<int errorno>
175    
176     This contains the value of C<errno> after the call.
177    
178     =item C<void *data>
179    
180     The C<void *data> member simply stores the value of the C<data> argument.
181    
182     =back
183    
184     The return value of the callback is normally C<0>, which tells libeio to
185     continue normally. If a callback returns a nonzero value, libeio will
186     stop processing results (in C<eio_poll>) and will return the value to its
187     caller.
188    
189     Memory areas passed to libeio must stay valid as long as a request
190     executes, with the exception of paths, which are being copied
191     internally. Any memory libeio itself allocates will be freed after the
192     finish callback has been called. If you want to manage all memory passed
193     to libeio yourself you can use the low-level API.
194    
195     For example, to open a file, you could do this:
196    
197     static int
198     file_open_done (eio_req *req)
199     {
200     if (req->result < 0)
201     {
202     /* open() returned -1 */
203     errno = req->errorno;
204     perror ("open");
205     }
206     else
207     {
208     int fd = req->result;
209     /* now we have the new fd in fd */
210     }
211    
212     return 0;
213     }
214    
215     /* the first three arguments are passed to open(2) */
216     /* the remaining are priority, callback and data */
217     if (!eio_open ("/etc/passwd", O_RDONLY, 0, 0, file_open_done, 0))
218     abort (); /* something ent wrong, we will all die!!! */
219    
220     Note that you additionally need to call C<eio_poll> when the C<want_cb>
221     indicates that requests are ready to be processed.
222    
223     =head2 AVAILABLE REQUESTS
224    
225     The following request functions are available. I<All> of them return the
226     C<eio_req *> on success and C<0> on failure, and I<all> of them have the
227     same three trailing arguments: C<pri>, C<cb> and C<data>. The C<cb> is
228     mandatory, but in most cases, you pass in C<0> as C<pri> and C<0> or some
229     custom data value as C<data>.
230    
231     =head3 POSIX API WRAPPERS
232    
233     These requests simply wrap the POSIX call of the same name, with the same
234 root 1.11 arguments. If a function is not implemented by the OS and cannot be emulated
235 root 1.10 in some way, then all of these return C<-1> and set C<errorno> to C<ENOSYS>.
236 root 1.7
237     =over 4
238    
239     =item eio_open (const char *path, int flags, mode_t mode, int pri, eio_cb cb, void *data)
240    
241     =item eio_truncate (const char *path, off_t offset, int pri, eio_cb cb, void *data)
242    
243     =item eio_chown (const char *path, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
244    
245     =item eio_chmod (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
246    
247     =item eio_mkdir (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
248    
249     =item eio_rmdir (const char *path, int pri, eio_cb cb, void *data)
250    
251     =item eio_unlink (const char *path, int pri, eio_cb cb, void *data)
252    
253 root 1.10 =item eio_utime (const char *path, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
254 root 1.7
255     =item eio_mknod (const char *path, mode_t mode, dev_t dev, int pri, eio_cb cb, void *data)
256    
257     =item eio_link (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
258    
259     =item eio_symlink (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
260    
261     =item eio_rename (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
262    
263     =item eio_mlock (void *addr, size_t length, int pri, eio_cb cb, void *data)
264    
265     =item eio_close (int fd, int pri, eio_cb cb, void *data)
266    
267     =item eio_sync (int pri, eio_cb cb, void *data)
268    
269     =item eio_fsync (int fd, int pri, eio_cb cb, void *data)
270    
271     =item eio_fdatasync (int fd, int pri, eio_cb cb, void *data)
272    
273     =item eio_futime (int fd, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
274    
275     =item eio_ftruncate (int fd, off_t offset, int pri, eio_cb cb, void *data)
276    
277     =item eio_fchmod (int fd, mode_t mode, int pri, eio_cb cb, void *data)
278    
279     =item eio_fchown (int fd, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
280    
281     =item eio_dup2 (int fd, int fd2, int pri, eio_cb cb, void *data)
282    
283     These have the same semantics as the syscall of the same name, their
284     return value is available as C<< req->result >> later.
285    
286     =item eio_read (int fd, void *buf, size_t length, off_t offset, int pri, eio_cb cb, void *data)
287    
288     =item eio_write (int fd, void *buf, size_t length, off_t offset, int pri, eio_cb cb, void *data)
289    
290     These two requests are called C<read> and C<write>, but actually wrap
291     C<pread> and C<pwrite>. On systems that lack these calls (such as cygwin),
292     libeio uses lseek/read_or_write/lseek and a mutex to serialise the
293     requests, so all these requests run serially and do not disturb each
294     other. However, they still disturb the file offset while they run, so it's
295     not safe to call these functions concurrently with non-libeio functions on
296     the same fd on these systems.
297    
298     Not surprisingly, pread and pwrite are not thread-safe on Darwin (OS/X),
299     so it is advised not to submit multiple requests on the same fd on this
300     horrible pile of garbage.
301    
302 root 1.10 =item eio_mlockall (int flags, int pri, eio_cb cb, void *data)
303    
304     Like C<mlockall>, but the flag value constants are called
305     C<EIO_MCL_CURRENT> and C<EIO_MCL_FUTURE>.
306    
307     =item eio_msync (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
308    
309     Just like msync, except that the flag values are called C<EIO_MS_ASYNC>,
310     C<EIO_MS_INVALIDATE> and C<EIO_MS_SYNC>.
311    
312     =item eio_readlink (const char *path, int pri, eio_cb cb, void *data)
313    
314     If successful, the path read by C<readlink(2)> can be accessed via C<<
315     req->ptr2 >> and is I<NOT> null-terminated, with the length specified as
316     C<< req->result >>.
317    
318     if (req->result >= 0)
319     {
320     char *target = strndup ((char *)req->ptr2, req->result);
321    
322     free (target);
323     }
324    
325 root 1.13 =item eio_realpath (const char *path, int pri, eio_cb cb, void *data)
326    
327     Similar to the realpath libc function, but unlike that one, result is
328 root 1.14 C<-1> on failure and the length of the returned path in C<ptr2> (which is
329     not 0-terminated) - this is similar to readlink.
330 root 1.13
331 root 1.10 =item eio_stat (const char *path, int pri, eio_cb cb, void *data)
332    
333     =item eio_lstat (const char *path, int pri, eio_cb cb, void *data)
334    
335 root 1.7 =item eio_fstat (int fd, int pri, eio_cb cb, void *data)
336    
337     Stats a file - if C<< req->result >> indicates success, then you can
338     access the C<struct stat>-like structure via C<< req->ptr2 >>:
339    
340     EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2;
341    
342 root 1.10 =item eio_statvfs (const char *path, int pri, eio_cb cb, void *data)
343    
344     =item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data)
345 root 1.7
346     Stats a filesystem - if C<< req->result >> indicates success, then you can
347     access the C<struct statvfs>-like structure via C<< req->ptr2 >>:
348    
349     EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2;
350    
351     =back
352    
353     =head3 READING DIRECTORIES
354    
355     Reading directories sounds simple, but can be rather demanding, especially
356     if you want to do stuff such as traversing a diretcory hierarchy or
357     processing all files in a directory. Libeio can assist thess complex tasks
358     with it's C<eio_readdir> call.
359    
360     =over 4
361    
362     =item eio_readdir (const char *path, int flags, int pri, eio_cb cb, void *data)
363    
364     This is a very complex call. It basically reads through a whole directory
365     (via the C<opendir>, C<readdir> and C<closedir> calls) and returns either
366     the names or an array of C<struct eio_dirent>, depending on the C<flags>
367     argument.
368    
369     The C<< req->result >> indicates either the number of files found, or
370 root 1.10 C<-1> on error. On success, null-terminated names can be found as C<< req->ptr2 >>,
371 root 1.7 and C<struct eio_dirents>, if requested by C<flags>, can be found via C<<
372     req->ptr1 >>.
373    
374     Here is an example that prints all the names:
375    
376     int i;
377     char *names = (char *)req->ptr2;
378    
379     for (i = 0; i < req->result; ++i)
380     {
381     printf ("name #%d: %s\n", i, names);
382    
383     /* move to next name */
384     names += strlen (names) + 1;
385     }
386    
387     Pseudo-entries such as F<.> and F<..> are never returned by C<eio_readdir>.
388    
389     C<flags> can be any combination of:
390    
391     =over 4
392    
393     =item EIO_READDIR_DENTS
394    
395     If this flag is specified, then, in addition to the names in C<ptr2>,
396     also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct
397     eio_dirent> looks like this:
398    
399     struct eio_dirent
400     {
401     int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */
402     unsigned short namelen; /* size of filename without trailing 0 */
403     unsigned char type; /* one of EIO_DT_* */
404     signed char score; /* internal use */
405     ino_t inode; /* the inode number, if available, otherwise unspecified */
406     };
407    
408     The only members you normally would access are C<nameofs>, which is the
409     byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>.
410    
411     C<type> can be one of:
412    
413     C<EIO_DT_UNKNOWN> - if the type is not known (very common) and you have to C<stat>
414     the name yourself if you need to know,
415     one of the "standard" POSIX file types (C<EIO_DT_REG>, C<EIO_DT_DIR>, C<EIO_DT_LNK>,
416     C<EIO_DT_FIFO>, C<EIO_DT_SOCK>, C<EIO_DT_CHR>, C<EIO_DT_BLK>)
417     or some OS-specific type (currently
418     C<EIO_DT_MPC> - multiplexed char device (v7+coherent),
419     C<EIO_DT_NAM> - xenix special named file,
420     C<EIO_DT_MPB> - multiplexed block device (v7+coherent),
421     C<EIO_DT_NWK> - HP-UX network special,
422     C<EIO_DT_CMP> - VxFS compressed,
423     C<EIO_DT_DOOR> - solaris door, or
424     C<EIO_DT_WHT>).
425    
426     This example prints all names and their type:
427    
428     int i;
429     struct eio_dirent *ents = (struct eio_dirent *)req->ptr1;
430     char *names = (char *)req->ptr2;
431    
432     for (i = 0; i < req->result; ++i)
433     {
434     struct eio_dirent *ent = ents + i;
435     char *name = names + ent->nameofs;
436    
437     printf ("name #%d: %s (type %d)\n", i, name, ent->type);
438     }
439    
440     =item EIO_READDIR_DIRS_FIRST
441    
442     When this flag is specified, then the names will be returned in an order
443     where likely directories come first, in optimal C<stat> order. This is
444     useful when you need to quickly find directories, or you want to find all
445     directories while avoiding to stat() each entry.
446    
447     If the system returns type information in readdir, then this is used
448     to find directories directly. Otherwise, likely directories are names
449     beginning with ".", or otherwise names with no dots, of which names with
450     short names are tried first.
451    
452     =item EIO_READDIR_STAT_ORDER
453    
454     When this flag is specified, then the names will be returned in an order
455     suitable for stat()'ing each one. That is, when you plan to stat()
456     all files in the given directory, then the returned order will likely
457     be fastest.
458    
459     If both this flag and C<EIO_READDIR_DIRS_FIRST> are specified, then
460     the likely dirs come first, resulting in a less optimal stat order.
461    
462     =item EIO_READDIR_FOUND_UNKNOWN
463    
464     This flag should not be specified when calling C<eio_readdir>. Instead,
465     it is being set by C<eio_readdir> (you can access the C<flags> via C<<
466     req->int1 >>, when any of the C<type>'s found were C<EIO_DT_UNKNOWN>. The
467     absense of this flag therefore indicates that all C<type>'s are known,
468     which can be used to speed up some algorithms.
469    
470     A typical use case would be to identify all subdirectories within a
471     directory - you would ask C<eio_readdir> for C<EIO_READDIR_DIRS_FIRST>. If
472     then this flag is I<NOT> set, then all the entries at the beginning of the
473     returned array of type C<EIO_DT_DIR> are the directories. Otherwise, you
474     should start C<stat()>'ing the entries starting at the beginning of the
475     array, stopping as soon as you found all directories (the count can be
476     deduced by the link count of the directory).
477    
478     =back
479    
480     =back
481    
482     =head3 OS-SPECIFIC CALL WRAPPERS
483    
484     These wrap OS-specific calls (usually Linux ones), and might or might not
485     be emulated on other operating systems. Calls that are not emulated will
486     return C<-1> and set C<errno> to C<ENOSYS>.
487    
488     =over 4
489    
490     =item eio_sendfile (int out_fd, int in_fd, off_t in_offset, size_t length, int pri, eio_cb cb, void *data)
491    
492     Wraps the C<sendfile> syscall. The arguments follow the Linux version, but
493     libeio supports and will use similar calls on FreeBSD, HP/UX, Solaris and
494     Darwin.
495    
496     If the OS doesn't support some sendfile-like call, or the call fails,
497     indicating support for the given file descriptor type (for example,
498     Linux's sendfile might not support file to file copies), then libeio will
499     emulate the call in userspace, so there are almost no limitations on its
500     use.
501    
502     =item eio_readahead (int fd, off_t offset, size_t length, int pri, eio_cb cb, void *data)
503    
504     Calls C<readahead(2)>. If the syscall is missing, then the call is
505     emulated by simply reading the data (currently in 64kiB chunks).
506    
507     =item eio_sync_file_range (int fd, off_t offset, size_t nbytes, unsigned int flags, int pri, eio_cb cb, void *data)
508    
509     Calls C<sync_file_range>. If the syscall is missing, then this is the same
510     as calling C<fdatasync>.
511    
512 root 1.10 Flags can be any combination of C<EIO_SYNC_FILE_RANGE_WAIT_BEFORE>,
513     C<EIO_SYNC_FILE_RANGE_WRITE> and C<EIO_SYNC_FILE_RANGE_WAIT_AFTER>.
514    
515 root 1.7 =back
516    
517     =head3 LIBEIO-SPECIFIC REQUESTS
518    
519     These requests are specific to libeio and do not correspond to any OS call.
520    
521     =over 4
522    
523 root 1.9 =item eio_mtouch (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
524 root 1.7
525 root 1.9 Reads (C<flags == 0>) or modifies (C<flags == EIO_MT_MODIFY) the given
526     memory area, page-wise, that is, it reads (or reads and writes back) the
527     first octet of every page that spans the memory area.
528    
529     This can be used to page in some mmapped file, or dirty some pages. Note
530     that dirtying is an unlocked read-write access, so races can ensue when
531     the some other thread modifies the data stored in that memory area.
532    
533     =item eio_custom (void (*)(eio_req *) execute, int pri, eio_cb cb, void *data)
534 root 1.7
535     Executes a custom request, i.e., a user-specified callback.
536    
537     The callback gets the C<eio_req *> as parameter and is expected to read
538     and modify any request-specific members. Specifically, it should set C<<
539     req->result >> to the result value, just like other requests.
540    
541     Here is an example that simply calls C<open>, like C<eio_open>, but it
542     uses the C<data> member as filename and uses a hardcoded C<O_RDONLY>. If
543     you want to pass more/other parameters, you either need to pass some
544     struct or so via C<data> or provide your own wrapper using the low-level
545     API.
546    
547     static int
548     my_open_done (eio_req *req)
549     {
550     int fd = req->result;
551    
552     return 0;
553     }
554    
555     static void
556     my_open (eio_req *req)
557     {
558     req->result = open (req->data, O_RDONLY);
559     }
560    
561     eio_custom (my_open, 0, my_open_done, "/etc/passwd");
562    
563 root 1.9 =item eio_busy (eio_tstamp delay, int pri, eio_cb cb, void *data)
564 root 1.7
565     This is a a request that takes C<delay> seconds to execute, but otherwise
566     does nothing - it simply puts one of the worker threads to sleep for this
567     long.
568    
569     This request can be used to artificially increase load, e.g. for debugging
570     or benchmarking reasons.
571    
572 root 1.9 =item eio_nop (int pri, eio_cb cb, void *data)
573 root 1.7
574     This request does nothing, except go through the whole request cycle. This
575     can be used to measure latency or in some cases to simplify code, but is
576     not really of much use.
577    
578     =back
579    
580     =head3 GROUPING AND LIMITING REQUESTS
581 root 1.1
582 root 1.12 There is one more rather special request, C<eio_grp>. It is a very special
583     aio request: Instead of doing something, it is a container for other eio
584     requests.
585    
586     There are two primary use cases for this: a) bundle many requests into a
587     single, composite, request with a definite callback and the ability to
588     cancel the whole request with its subrequests and b) limiting the number
589     of "active" requests.
590    
591     Further below you will find more dicussion of these topics - first follows
592     the reference section detailing the request generator and other methods.
593    
594     =over 4
595    
596     =item eio_grp (eio_cb cb, void *data)
597    
598     Creates and submits a group request.
599    
600     =back
601    
602    
603    
604 root 1.1 #TODO
605    
606 root 1.7 /*****************************************************************************/
607     /* groups */
608 root 1.1
609 root 1.7 eio_req *eio_grp (eio_cb cb, void *data);
610     void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit);
611     void eio_grp_limit (eio_req *grp, int limit);
612     void eio_grp_add (eio_req *grp, eio_req *req);
613     void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */
614 root 1.1
615    
616     =back
617    
618    
619     =head1 LOW LEVEL REQUEST API
620    
621     #TODO
622    
623 root 1.7
624     =head1 ANATOMY AND LIFETIME OF AN EIO REQUEST
625    
626     A request is represented by a structure of type C<eio_req>. To initialise
627     it, clear it to all zero bytes:
628    
629     eio_req req;
630    
631     memset (&req, 0, sizeof (req));
632    
633     A more common way to initialise a new C<eio_req> is to use C<calloc>:
634    
635     eio_req *req = calloc (1, sizeof (*req));
636    
637     In either case, libeio neither allocates, initialises or frees the
638     C<eio_req> structure for you - it merely uses it.
639    
640     zero
641    
642     #TODO
643    
644 root 1.8 =head2 CONFIGURATION
645    
646     The functions in this section can sometimes be useful, but the default
647     configuration will do in most case, so you should skip this section on
648     first reading.
649    
650     =over 4
651    
652     =item eio_set_max_poll_time (eio_tstamp nseconds)
653    
654     This causes C<eio_poll ()> to return after it has detected that it was
655     running for C<nsecond> seconds or longer (this number can be fractional).
656    
657     This can be used to limit the amount of time spent handling eio requests,
658     for example, in interactive programs, you might want to limit this time to
659     C<0.01> seconds or so.
660    
661     Note that:
662    
663     a) libeio doesn't know how long your request callbacks take, so the time
664     spent in C<eio_poll> is up to one callback invocation longer then this
665     interval.
666    
667     b) this is implemented by calling C<gettimeofday> after each request,
668     which can be costly.
669    
670     c) at least one request will be handled.
671    
672     =item eio_set_max_poll_reqs (unsigned int nreqs)
673    
674     When C<nreqs> is non-zero, then C<eio_poll> will not handle more than
675     C<nreqs> requests per invocation. This is a less costly way to limit the
676     amount of work done by C<eio_poll> then setting a time limit.
677    
678     If you know your callbacks are generally fast, you could use this to
679     encourage interactiveness in your programs by setting it to C<10>, C<100>
680     or even C<1000>.
681    
682     =item eio_set_min_parallel (unsigned int nthreads)
683    
684     Make sure libeio can handle at least this many requests in parallel. It
685     might be able handle more.
686    
687     =item eio_set_max_parallel (unsigned int nthreads)
688    
689     Set the maximum number of threads that libeio will spawn.
690    
691     =item eio_set_max_idle (unsigned int nthreads)
692    
693     Libeio uses threads internally to handle most requests, and will start and stop threads on demand.
694    
695     This call can be used to limit the number of idle threads (threads without
696     work to do): libeio will keep some threads idle in preparation for more
697     requests, but never longer than C<nthreads> threads.
698    
699     In addition to this, libeio will also stop threads when they are idle for
700     a few seconds, regardless of this setting.
701    
702     =item unsigned int eio_nthreads ()
703    
704     Return the number of worker threads currently running.
705    
706     =item unsigned int eio_nreqs ()
707    
708     Return the number of requests currently handled by libeio. This is the
709     total number of requests that have been submitted to libeio, but not yet
710     destroyed.
711    
712     =item unsigned int eio_nready ()
713    
714     Returns the number of ready requests, i.e. requests that have been
715     submitted but have not yet entered the execution phase.
716    
717     =item unsigned int eio_npending ()
718    
719     Returns the number of pending requests, i.e. requests that have been
720     executed and have results, but have not been finished yet by a call to
721     C<eio_poll>).
722    
723     =back
724    
725 root 1.1 =head1 EMBEDDING
726    
727     Libeio can be embedded directly into programs. This functionality is not
728     documented and not (yet) officially supported.
729    
730 root 1.3 Note that, when including C<libeio.m4>, you are responsible for defining
731     the compilation environment (C<_LARGEFILE_SOURCE>, C<_GNU_SOURCE> etc.).
732    
733 root 1.2 If you need to know how, check the C<IO::AIO> perl module, which does
734 root 1.1 exactly that.
735    
736    
737 root 1.4 =head1 COMPILETIME CONFIGURATION
738    
739     These symbols, if used, must be defined when compiling F<eio.c>.
740    
741     =over 4
742    
743     =item EIO_STACKSIZE
744    
745     This symbol governs the stack size for each eio thread. Libeio itself
746     was written to use very little stackspace, but when using C<EIO_CUSTOM>
747     requests, you might want to increase this.
748    
749     If this symbol is undefined (the default) then libeio will use its default
750     stack size (C<sizeof (long) * 4096> currently). If it is defined, but
751     C<0>, then the default operating system stack size will be used. In all
752     other cases, the value must be an expression that evaluates to the desired
753     stack size.
754    
755     =back
756    
757    
758 root 1.1 =head1 PORTABILITY REQUIREMENTS
759    
760     In addition to a working ISO-C implementation, libeio relies on a few
761     additional extensions:
762    
763     =over 4
764    
765     =item POSIX threads
766    
767     To be portable, this module uses threads, specifically, the POSIX threads
768     library must be available (and working, which partially excludes many xBSD
769     systems, where C<fork ()> is buggy).
770    
771     =item POSIX-compatible filesystem API
772    
773     This is actually a harder portability requirement: The libeio API is quite
774     demanding regarding POSIX API calls (symlinks, user/group management
775     etc.).
776    
777     =item C<double> must hold a time value in seconds with enough accuracy
778    
779     The type C<double> is used to represent timestamps. It is required to
780     have at least 51 bits of mantissa (and 9 bits of exponent), which is good
781     enough for at least into the year 4000. This requirement is fulfilled by
782     implementations implementing IEEE 754 (basically all existing ones).
783    
784     =back
785    
786     If you know of other additional requirements drop me a note.
787    
788    
789     =head1 AUTHOR
790    
791     Marc Lehmann <libeio@schmorp.de>.
792