ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libeio/eio.pod
Revision: 1.14
Committed: Tue Jul 5 14:02:15 2011 UTC (12 years, 10 months ago) by root
Branch: MAIN
Changes since 1.13: +2 -2 lines
Log Message:
*** empty log message ***

File Contents

# Content
1 =head1 NAME
2
3 libeio - truly asynchronous POSIX I/O
4
5 =head1 SYNOPSIS
6
7 #include <eio.h>
8
9 =head1 DESCRIPTION
10
11 The newest version of this document is also available as an html-formatted
12 web page you might find easier to navigate when reading it for the first
13 time: L<http://pod.tst.eu/http://cvs.schmorp.de/libeio/eio.pod>.
14
15 Note that this library is a by-product of the C<IO::AIO> perl
16 module, and many of the subtler points regarding requests lifetime
17 and so on are only documented in its documentation at the
18 moment: L<http://pod.tst.eu/http://cvs.schmorp.de/IO-AIO/AIO.pm>.
19
20 =head2 FEATURES
21
22 This library provides fully asynchronous versions of most POSIX functions
23 dealing with I/O. Unlike most asynchronous libraries, this not only
24 includes C<read> and C<write>, but also C<open>, C<stat>, C<unlink> and
25 similar functions, as well as less rarely ones such as C<mknod>, C<futime>
26 or C<readlink>.
27
28 It also offers wrappers around C<sendfile> (Solaris, Linux, HP-UX and
29 FreeBSD, with emulation on other platforms) and C<readahead> (Linux, with
30 emulation elsewhere>).
31
32 The goal is to enable you to write fully non-blocking programs. For
33 example, in a game server, you would not want to freeze for a few seconds
34 just because the server is running a backup and you happen to call
35 C<readdir>.
36
37 =head2 TIME REPRESENTATION
38
39 Libeio represents time as a single floating point number, representing the
40 (fractional) number of seconds since the (POSIX) epoch (somewhere near
41 the beginning of 1970, details are complicated, don't ask). This type is
42 called C<eio_tstamp>, but it is guaranteed to be of type C<double> (or
43 better), so you can freely use C<double> yourself.
44
45 Unlike the name component C<stamp> might indicate, it is also used for
46 time differences throughout libeio.
47
48 =head2 FORK SUPPORT
49
50 Calling C<fork ()> is fully supported by this module. It is implemented in these steps:
51
52 1. wait till all requests in "execute" state have been handled
53 (basically requests that are already handed over to the kernel).
54 2. fork
55 3. in the parent, continue business as usual, done
56 4. in the child, destroy all ready and pending requests and free the
57 memory used by the worker threads. This gives you a fully empty
58 libeio queue.
59
60 Note, however, since libeio does use threads, thr above guarantee doesn't
61 cover your libc, for example, malloc and other libc functions are not
62 fork-safe, so there is very little you can do after a fork, and in fatc,
63 the above might crash, and thus change.
64
65 =head1 INITIALISATION/INTEGRATION
66
67 Before you can call any eio functions you first have to initialise the
68 library. The library integrates into any event loop, but can also be used
69 without one, including in polling mode.
70
71 You have to provide the necessary glue yourself, however.
72
73 =over 4
74
75 =item int eio_init (void (*want_poll)(void), void (*done_poll)(void))
76
77 This function initialises the library. On success it returns C<0>, on
78 failure it returns C<-1> and sets C<errno> appropriately.
79
80 It accepts two function pointers specifying callbacks as argument, both of
81 which can be C<0>, in which case the callback isn't called.
82
83 =item want_poll callback
84
85 The C<want_poll> callback is invoked whenever libeio wants attention (i.e.
86 it wants to be polled by calling C<eio_poll>). It is "edge-triggered",
87 that is, it will only be called once when eio wants attention, until all
88 pending requests have been handled.
89
90 This callback is called while locks are being held, so I<you must
91 not call any libeio functions inside this callback>. That includes
92 C<eio_poll>. What you should do is notify some other thread, or wake up
93 your event loop, and then call C<eio_poll>.
94
95 =item done_poll callback
96
97 This callback is invoked when libeio detects that all pending requests
98 have been handled. It is "edge-triggered", that is, it will only be
99 called once after C<want_poll>. To put it differently, C<want_poll> and
100 C<done_poll> are invoked in pairs: after C<want_poll> you have to call
101 C<eio_poll ()> until either C<eio_poll> indicates that everything has been
102 handled or C<done_poll> has been called, which signals the same.
103
104 Note that C<eio_poll> might return after C<done_poll> and C<want_poll>
105 have been called again, so watch out for races in your code.
106
107 As with C<want_poll>, this callback is called while locks are being held,
108 so you I<must not call any libeio functions form within this callback>.
109
110 =item int eio_poll ()
111
112 This function has to be called whenever there are pending requests that
113 need finishing. You usually call this after C<want_poll> has indicated
114 that you should do so, but you can also call this function regularly to
115 poll for new results.
116
117 If any request invocation returns a non-zero value, then C<eio_poll ()>
118 immediately returns with that value as return value.
119
120 Otherwise, if all requests could be handled, it returns C<0>. If for some
121 reason not all requests have been handled, i.e. some are still pending, it
122 returns C<-1>.
123
124 =back
125
126 For libev, you would typically use an C<ev_async> watcher: the
127 C<want_poll> callback would invoke C<ev_async_send> to wake up the event
128 loop. Inside the callback set for the watcher, one would call C<eio_poll
129 ()> (followed by C<ev_async_send> again if C<eio_poll> indicates that not
130 all requests have been handled yet). The race is taken care of because
131 libev resets/rearms the async watcher before calling your callback,
132 and therefore, before calling C<eio_poll>. This might result in (some)
133 spurious wake-ups, but is generally harmless.
134
135 For most other event loops, you would typically use a pipe - the event
136 loop should be told to wait for read readiness on the read end. In
137 C<want_poll> you would write a single byte, in C<done_poll> you would try
138 to read that byte, and in the callback for the read end, you would call
139 C<eio_poll>. The race is avoided here because the event loop should invoke
140 your callback again and again until the byte has been read (as the pipe
141 read callback does not read it, only C<done_poll>).
142
143
144 =head1 HIGH LEVEL REQUEST API
145
146 Libeio has both a high-level API, which consists of calling a request
147 function with a callback to be called on completion, and a low-level API
148 where you fill out request structures and submit them.
149
150 This section describes the high-level API.
151
152 =head2 REQUEST SUBMISSION AND RESULT PROCESSING
153
154 You submit a request by calling the relevant C<eio_TYPE> function with the
155 required parameters, a callback of type C<int (*eio_cb)(eio_req *req)>
156 (called C<eio_cb> below) and a freely usable C<void *data> argument.
157
158 The return value will either be 0, in case something went really wrong
159 (which can basically only happen on very fatal errors, such as C<malloc>
160 returning 0, which is rather unlikely), or a pointer to the newly-created
161 and submitted C<eio_req *>.
162
163 The callback will be called with an C<eio_req *> which contains the
164 results of the request. The members you can access inside that structure
165 vary from request to request, except for:
166
167 =over 4
168
169 =item C<ssize_t result>
170
171 This contains the result value from the call (usually the same as the
172 syscall of the same name).
173
174 =item C<int errorno>
175
176 This contains the value of C<errno> after the call.
177
178 =item C<void *data>
179
180 The C<void *data> member simply stores the value of the C<data> argument.
181
182 =back
183
184 The return value of the callback is normally C<0>, which tells libeio to
185 continue normally. If a callback returns a nonzero value, libeio will
186 stop processing results (in C<eio_poll>) and will return the value to its
187 caller.
188
189 Memory areas passed to libeio must stay valid as long as a request
190 executes, with the exception of paths, which are being copied
191 internally. Any memory libeio itself allocates will be freed after the
192 finish callback has been called. If you want to manage all memory passed
193 to libeio yourself you can use the low-level API.
194
195 For example, to open a file, you could do this:
196
197 static int
198 file_open_done (eio_req *req)
199 {
200 if (req->result < 0)
201 {
202 /* open() returned -1 */
203 errno = req->errorno;
204 perror ("open");
205 }
206 else
207 {
208 int fd = req->result;
209 /* now we have the new fd in fd */
210 }
211
212 return 0;
213 }
214
215 /* the first three arguments are passed to open(2) */
216 /* the remaining are priority, callback and data */
217 if (!eio_open ("/etc/passwd", O_RDONLY, 0, 0, file_open_done, 0))
218 abort (); /* something ent wrong, we will all die!!! */
219
220 Note that you additionally need to call C<eio_poll> when the C<want_cb>
221 indicates that requests are ready to be processed.
222
223 =head2 AVAILABLE REQUESTS
224
225 The following request functions are available. I<All> of them return the
226 C<eio_req *> on success and C<0> on failure, and I<all> of them have the
227 same three trailing arguments: C<pri>, C<cb> and C<data>. The C<cb> is
228 mandatory, but in most cases, you pass in C<0> as C<pri> and C<0> or some
229 custom data value as C<data>.
230
231 =head3 POSIX API WRAPPERS
232
233 These requests simply wrap the POSIX call of the same name, with the same
234 arguments. If a function is not implemented by the OS and cannot be emulated
235 in some way, then all of these return C<-1> and set C<errorno> to C<ENOSYS>.
236
237 =over 4
238
239 =item eio_open (const char *path, int flags, mode_t mode, int pri, eio_cb cb, void *data)
240
241 =item eio_truncate (const char *path, off_t offset, int pri, eio_cb cb, void *data)
242
243 =item eio_chown (const char *path, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
244
245 =item eio_chmod (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
246
247 =item eio_mkdir (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
248
249 =item eio_rmdir (const char *path, int pri, eio_cb cb, void *data)
250
251 =item eio_unlink (const char *path, int pri, eio_cb cb, void *data)
252
253 =item eio_utime (const char *path, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
254
255 =item eio_mknod (const char *path, mode_t mode, dev_t dev, int pri, eio_cb cb, void *data)
256
257 =item eio_link (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
258
259 =item eio_symlink (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
260
261 =item eio_rename (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
262
263 =item eio_mlock (void *addr, size_t length, int pri, eio_cb cb, void *data)
264
265 =item eio_close (int fd, int pri, eio_cb cb, void *data)
266
267 =item eio_sync (int pri, eio_cb cb, void *data)
268
269 =item eio_fsync (int fd, int pri, eio_cb cb, void *data)
270
271 =item eio_fdatasync (int fd, int pri, eio_cb cb, void *data)
272
273 =item eio_futime (int fd, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
274
275 =item eio_ftruncate (int fd, off_t offset, int pri, eio_cb cb, void *data)
276
277 =item eio_fchmod (int fd, mode_t mode, int pri, eio_cb cb, void *data)
278
279 =item eio_fchown (int fd, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
280
281 =item eio_dup2 (int fd, int fd2, int pri, eio_cb cb, void *data)
282
283 These have the same semantics as the syscall of the same name, their
284 return value is available as C<< req->result >> later.
285
286 =item eio_read (int fd, void *buf, size_t length, off_t offset, int pri, eio_cb cb, void *data)
287
288 =item eio_write (int fd, void *buf, size_t length, off_t offset, int pri, eio_cb cb, void *data)
289
290 These two requests are called C<read> and C<write>, but actually wrap
291 C<pread> and C<pwrite>. On systems that lack these calls (such as cygwin),
292 libeio uses lseek/read_or_write/lseek and a mutex to serialise the
293 requests, so all these requests run serially and do not disturb each
294 other. However, they still disturb the file offset while they run, so it's
295 not safe to call these functions concurrently with non-libeio functions on
296 the same fd on these systems.
297
298 Not surprisingly, pread and pwrite are not thread-safe on Darwin (OS/X),
299 so it is advised not to submit multiple requests on the same fd on this
300 horrible pile of garbage.
301
302 =item eio_mlockall (int flags, int pri, eio_cb cb, void *data)
303
304 Like C<mlockall>, but the flag value constants are called
305 C<EIO_MCL_CURRENT> and C<EIO_MCL_FUTURE>.
306
307 =item eio_msync (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
308
309 Just like msync, except that the flag values are called C<EIO_MS_ASYNC>,
310 C<EIO_MS_INVALIDATE> and C<EIO_MS_SYNC>.
311
312 =item eio_readlink (const char *path, int pri, eio_cb cb, void *data)
313
314 If successful, the path read by C<readlink(2)> can be accessed via C<<
315 req->ptr2 >> and is I<NOT> null-terminated, with the length specified as
316 C<< req->result >>.
317
318 if (req->result >= 0)
319 {
320 char *target = strndup ((char *)req->ptr2, req->result);
321
322 free (target);
323 }
324
325 =item eio_realpath (const char *path, int pri, eio_cb cb, void *data)
326
327 Similar to the realpath libc function, but unlike that one, result is
328 C<-1> on failure and the length of the returned path in C<ptr2> (which is
329 not 0-terminated) - this is similar to readlink.
330
331 =item eio_stat (const char *path, int pri, eio_cb cb, void *data)
332
333 =item eio_lstat (const char *path, int pri, eio_cb cb, void *data)
334
335 =item eio_fstat (int fd, int pri, eio_cb cb, void *data)
336
337 Stats a file - if C<< req->result >> indicates success, then you can
338 access the C<struct stat>-like structure via C<< req->ptr2 >>:
339
340 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2;
341
342 =item eio_statvfs (const char *path, int pri, eio_cb cb, void *data)
343
344 =item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data)
345
346 Stats a filesystem - if C<< req->result >> indicates success, then you can
347 access the C<struct statvfs>-like structure via C<< req->ptr2 >>:
348
349 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2;
350
351 =back
352
353 =head3 READING DIRECTORIES
354
355 Reading directories sounds simple, but can be rather demanding, especially
356 if you want to do stuff such as traversing a diretcory hierarchy or
357 processing all files in a directory. Libeio can assist thess complex tasks
358 with it's C<eio_readdir> call.
359
360 =over 4
361
362 =item eio_readdir (const char *path, int flags, int pri, eio_cb cb, void *data)
363
364 This is a very complex call. It basically reads through a whole directory
365 (via the C<opendir>, C<readdir> and C<closedir> calls) and returns either
366 the names or an array of C<struct eio_dirent>, depending on the C<flags>
367 argument.
368
369 The C<< req->result >> indicates either the number of files found, or
370 C<-1> on error. On success, null-terminated names can be found as C<< req->ptr2 >>,
371 and C<struct eio_dirents>, if requested by C<flags>, can be found via C<<
372 req->ptr1 >>.
373
374 Here is an example that prints all the names:
375
376 int i;
377 char *names = (char *)req->ptr2;
378
379 for (i = 0; i < req->result; ++i)
380 {
381 printf ("name #%d: %s\n", i, names);
382
383 /* move to next name */
384 names += strlen (names) + 1;
385 }
386
387 Pseudo-entries such as F<.> and F<..> are never returned by C<eio_readdir>.
388
389 C<flags> can be any combination of:
390
391 =over 4
392
393 =item EIO_READDIR_DENTS
394
395 If this flag is specified, then, in addition to the names in C<ptr2>,
396 also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct
397 eio_dirent> looks like this:
398
399 struct eio_dirent
400 {
401 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */
402 unsigned short namelen; /* size of filename without trailing 0 */
403 unsigned char type; /* one of EIO_DT_* */
404 signed char score; /* internal use */
405 ino_t inode; /* the inode number, if available, otherwise unspecified */
406 };
407
408 The only members you normally would access are C<nameofs>, which is the
409 byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>.
410
411 C<type> can be one of:
412
413 C<EIO_DT_UNKNOWN> - if the type is not known (very common) and you have to C<stat>
414 the name yourself if you need to know,
415 one of the "standard" POSIX file types (C<EIO_DT_REG>, C<EIO_DT_DIR>, C<EIO_DT_LNK>,
416 C<EIO_DT_FIFO>, C<EIO_DT_SOCK>, C<EIO_DT_CHR>, C<EIO_DT_BLK>)
417 or some OS-specific type (currently
418 C<EIO_DT_MPC> - multiplexed char device (v7+coherent),
419 C<EIO_DT_NAM> - xenix special named file,
420 C<EIO_DT_MPB> - multiplexed block device (v7+coherent),
421 C<EIO_DT_NWK> - HP-UX network special,
422 C<EIO_DT_CMP> - VxFS compressed,
423 C<EIO_DT_DOOR> - solaris door, or
424 C<EIO_DT_WHT>).
425
426 This example prints all names and their type:
427
428 int i;
429 struct eio_dirent *ents = (struct eio_dirent *)req->ptr1;
430 char *names = (char *)req->ptr2;
431
432 for (i = 0; i < req->result; ++i)
433 {
434 struct eio_dirent *ent = ents + i;
435 char *name = names + ent->nameofs;
436
437 printf ("name #%d: %s (type %d)\n", i, name, ent->type);
438 }
439
440 =item EIO_READDIR_DIRS_FIRST
441
442 When this flag is specified, then the names will be returned in an order
443 where likely directories come first, in optimal C<stat> order. This is
444 useful when you need to quickly find directories, or you want to find all
445 directories while avoiding to stat() each entry.
446
447 If the system returns type information in readdir, then this is used
448 to find directories directly. Otherwise, likely directories are names
449 beginning with ".", or otherwise names with no dots, of which names with
450 short names are tried first.
451
452 =item EIO_READDIR_STAT_ORDER
453
454 When this flag is specified, then the names will be returned in an order
455 suitable for stat()'ing each one. That is, when you plan to stat()
456 all files in the given directory, then the returned order will likely
457 be fastest.
458
459 If both this flag and C<EIO_READDIR_DIRS_FIRST> are specified, then
460 the likely dirs come first, resulting in a less optimal stat order.
461
462 =item EIO_READDIR_FOUND_UNKNOWN
463
464 This flag should not be specified when calling C<eio_readdir>. Instead,
465 it is being set by C<eio_readdir> (you can access the C<flags> via C<<
466 req->int1 >>, when any of the C<type>'s found were C<EIO_DT_UNKNOWN>. The
467 absense of this flag therefore indicates that all C<type>'s are known,
468 which can be used to speed up some algorithms.
469
470 A typical use case would be to identify all subdirectories within a
471 directory - you would ask C<eio_readdir> for C<EIO_READDIR_DIRS_FIRST>. If
472 then this flag is I<NOT> set, then all the entries at the beginning of the
473 returned array of type C<EIO_DT_DIR> are the directories. Otherwise, you
474 should start C<stat()>'ing the entries starting at the beginning of the
475 array, stopping as soon as you found all directories (the count can be
476 deduced by the link count of the directory).
477
478 =back
479
480 =back
481
482 =head3 OS-SPECIFIC CALL WRAPPERS
483
484 These wrap OS-specific calls (usually Linux ones), and might or might not
485 be emulated on other operating systems. Calls that are not emulated will
486 return C<-1> and set C<errno> to C<ENOSYS>.
487
488 =over 4
489
490 =item eio_sendfile (int out_fd, int in_fd, off_t in_offset, size_t length, int pri, eio_cb cb, void *data)
491
492 Wraps the C<sendfile> syscall. The arguments follow the Linux version, but
493 libeio supports and will use similar calls on FreeBSD, HP/UX, Solaris and
494 Darwin.
495
496 If the OS doesn't support some sendfile-like call, or the call fails,
497 indicating support for the given file descriptor type (for example,
498 Linux's sendfile might not support file to file copies), then libeio will
499 emulate the call in userspace, so there are almost no limitations on its
500 use.
501
502 =item eio_readahead (int fd, off_t offset, size_t length, int pri, eio_cb cb, void *data)
503
504 Calls C<readahead(2)>. If the syscall is missing, then the call is
505 emulated by simply reading the data (currently in 64kiB chunks).
506
507 =item eio_sync_file_range (int fd, off_t offset, size_t nbytes, unsigned int flags, int pri, eio_cb cb, void *data)
508
509 Calls C<sync_file_range>. If the syscall is missing, then this is the same
510 as calling C<fdatasync>.
511
512 Flags can be any combination of C<EIO_SYNC_FILE_RANGE_WAIT_BEFORE>,
513 C<EIO_SYNC_FILE_RANGE_WRITE> and C<EIO_SYNC_FILE_RANGE_WAIT_AFTER>.
514
515 =back
516
517 =head3 LIBEIO-SPECIFIC REQUESTS
518
519 These requests are specific to libeio and do not correspond to any OS call.
520
521 =over 4
522
523 =item eio_mtouch (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
524
525 Reads (C<flags == 0>) or modifies (C<flags == EIO_MT_MODIFY) the given
526 memory area, page-wise, that is, it reads (or reads and writes back) the
527 first octet of every page that spans the memory area.
528
529 This can be used to page in some mmapped file, or dirty some pages. Note
530 that dirtying is an unlocked read-write access, so races can ensue when
531 the some other thread modifies the data stored in that memory area.
532
533 =item eio_custom (void (*)(eio_req *) execute, int pri, eio_cb cb, void *data)
534
535 Executes a custom request, i.e., a user-specified callback.
536
537 The callback gets the C<eio_req *> as parameter and is expected to read
538 and modify any request-specific members. Specifically, it should set C<<
539 req->result >> to the result value, just like other requests.
540
541 Here is an example that simply calls C<open>, like C<eio_open>, but it
542 uses the C<data> member as filename and uses a hardcoded C<O_RDONLY>. If
543 you want to pass more/other parameters, you either need to pass some
544 struct or so via C<data> or provide your own wrapper using the low-level
545 API.
546
547 static int
548 my_open_done (eio_req *req)
549 {
550 int fd = req->result;
551
552 return 0;
553 }
554
555 static void
556 my_open (eio_req *req)
557 {
558 req->result = open (req->data, O_RDONLY);
559 }
560
561 eio_custom (my_open, 0, my_open_done, "/etc/passwd");
562
563 =item eio_busy (eio_tstamp delay, int pri, eio_cb cb, void *data)
564
565 This is a a request that takes C<delay> seconds to execute, but otherwise
566 does nothing - it simply puts one of the worker threads to sleep for this
567 long.
568
569 This request can be used to artificially increase load, e.g. for debugging
570 or benchmarking reasons.
571
572 =item eio_nop (int pri, eio_cb cb, void *data)
573
574 This request does nothing, except go through the whole request cycle. This
575 can be used to measure latency or in some cases to simplify code, but is
576 not really of much use.
577
578 =back
579
580 =head3 GROUPING AND LIMITING REQUESTS
581
582 There is one more rather special request, C<eio_grp>. It is a very special
583 aio request: Instead of doing something, it is a container for other eio
584 requests.
585
586 There are two primary use cases for this: a) bundle many requests into a
587 single, composite, request with a definite callback and the ability to
588 cancel the whole request with its subrequests and b) limiting the number
589 of "active" requests.
590
591 Further below you will find more dicussion of these topics - first follows
592 the reference section detailing the request generator and other methods.
593
594 =over 4
595
596 =item eio_grp (eio_cb cb, void *data)
597
598 Creates and submits a group request.
599
600 =back
601
602
603
604 #TODO
605
606 /*****************************************************************************/
607 /* groups */
608
609 eio_req *eio_grp (eio_cb cb, void *data);
610 void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit);
611 void eio_grp_limit (eio_req *grp, int limit);
612 void eio_grp_add (eio_req *grp, eio_req *req);
613 void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */
614
615
616 =back
617
618
619 =head1 LOW LEVEL REQUEST API
620
621 #TODO
622
623
624 =head1 ANATOMY AND LIFETIME OF AN EIO REQUEST
625
626 A request is represented by a structure of type C<eio_req>. To initialise
627 it, clear it to all zero bytes:
628
629 eio_req req;
630
631 memset (&req, 0, sizeof (req));
632
633 A more common way to initialise a new C<eio_req> is to use C<calloc>:
634
635 eio_req *req = calloc (1, sizeof (*req));
636
637 In either case, libeio neither allocates, initialises or frees the
638 C<eio_req> structure for you - it merely uses it.
639
640 zero
641
642 #TODO
643
644 =head2 CONFIGURATION
645
646 The functions in this section can sometimes be useful, but the default
647 configuration will do in most case, so you should skip this section on
648 first reading.
649
650 =over 4
651
652 =item eio_set_max_poll_time (eio_tstamp nseconds)
653
654 This causes C<eio_poll ()> to return after it has detected that it was
655 running for C<nsecond> seconds or longer (this number can be fractional).
656
657 This can be used to limit the amount of time spent handling eio requests,
658 for example, in interactive programs, you might want to limit this time to
659 C<0.01> seconds or so.
660
661 Note that:
662
663 a) libeio doesn't know how long your request callbacks take, so the time
664 spent in C<eio_poll> is up to one callback invocation longer then this
665 interval.
666
667 b) this is implemented by calling C<gettimeofday> after each request,
668 which can be costly.
669
670 c) at least one request will be handled.
671
672 =item eio_set_max_poll_reqs (unsigned int nreqs)
673
674 When C<nreqs> is non-zero, then C<eio_poll> will not handle more than
675 C<nreqs> requests per invocation. This is a less costly way to limit the
676 amount of work done by C<eio_poll> then setting a time limit.
677
678 If you know your callbacks are generally fast, you could use this to
679 encourage interactiveness in your programs by setting it to C<10>, C<100>
680 or even C<1000>.
681
682 =item eio_set_min_parallel (unsigned int nthreads)
683
684 Make sure libeio can handle at least this many requests in parallel. It
685 might be able handle more.
686
687 =item eio_set_max_parallel (unsigned int nthreads)
688
689 Set the maximum number of threads that libeio will spawn.
690
691 =item eio_set_max_idle (unsigned int nthreads)
692
693 Libeio uses threads internally to handle most requests, and will start and stop threads on demand.
694
695 This call can be used to limit the number of idle threads (threads without
696 work to do): libeio will keep some threads idle in preparation for more
697 requests, but never longer than C<nthreads> threads.
698
699 In addition to this, libeio will also stop threads when they are idle for
700 a few seconds, regardless of this setting.
701
702 =item unsigned int eio_nthreads ()
703
704 Return the number of worker threads currently running.
705
706 =item unsigned int eio_nreqs ()
707
708 Return the number of requests currently handled by libeio. This is the
709 total number of requests that have been submitted to libeio, but not yet
710 destroyed.
711
712 =item unsigned int eio_nready ()
713
714 Returns the number of ready requests, i.e. requests that have been
715 submitted but have not yet entered the execution phase.
716
717 =item unsigned int eio_npending ()
718
719 Returns the number of pending requests, i.e. requests that have been
720 executed and have results, but have not been finished yet by a call to
721 C<eio_poll>).
722
723 =back
724
725 =head1 EMBEDDING
726
727 Libeio can be embedded directly into programs. This functionality is not
728 documented and not (yet) officially supported.
729
730 Note that, when including C<libeio.m4>, you are responsible for defining
731 the compilation environment (C<_LARGEFILE_SOURCE>, C<_GNU_SOURCE> etc.).
732
733 If you need to know how, check the C<IO::AIO> perl module, which does
734 exactly that.
735
736
737 =head1 COMPILETIME CONFIGURATION
738
739 These symbols, if used, must be defined when compiling F<eio.c>.
740
741 =over 4
742
743 =item EIO_STACKSIZE
744
745 This symbol governs the stack size for each eio thread. Libeio itself
746 was written to use very little stackspace, but when using C<EIO_CUSTOM>
747 requests, you might want to increase this.
748
749 If this symbol is undefined (the default) then libeio will use its default
750 stack size (C<sizeof (long) * 4096> currently). If it is defined, but
751 C<0>, then the default operating system stack size will be used. In all
752 other cases, the value must be an expression that evaluates to the desired
753 stack size.
754
755 =back
756
757
758 =head1 PORTABILITY REQUIREMENTS
759
760 In addition to a working ISO-C implementation, libeio relies on a few
761 additional extensions:
762
763 =over 4
764
765 =item POSIX threads
766
767 To be portable, this module uses threads, specifically, the POSIX threads
768 library must be available (and working, which partially excludes many xBSD
769 systems, where C<fork ()> is buggy).
770
771 =item POSIX-compatible filesystem API
772
773 This is actually a harder portability requirement: The libeio API is quite
774 demanding regarding POSIX API calls (symlinks, user/group management
775 etc.).
776
777 =item C<double> must hold a time value in seconds with enough accuracy
778
779 The type C<double> is used to represent timestamps. It is required to
780 have at least 51 bits of mantissa (and 9 bits of exponent), which is good
781 enough for at least into the year 4000. This requirement is fulfilled by
782 implementations implementing IEEE 754 (basically all existing ones).
783
784 =back
785
786 If you know of other additional requirements drop me a note.
787
788
789 =head1 AUTHOR
790
791 Marc Lehmann <libeio@schmorp.de>.
792