ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libeio/eio.pod
(Generate patch)

Comparing libeio/eio.pod (file contents):
Revision 1.4 by root, Wed Apr 22 11:04:49 2009 UTC vs.
Revision 1.21 by root, Thu Jul 7 22:36:18 2011 UTC

11The newest version of this document is also available as an html-formatted 11The newest version of this document is also available as an html-formatted
12web page you might find easier to navigate when reading it for the first 12web page you might find easier to navigate when reading it for the first
13time: L<http://pod.tst.eu/http://cvs.schmorp.de/libeio/eio.pod>. 13time: L<http://pod.tst.eu/http://cvs.schmorp.de/libeio/eio.pod>.
14 14
15Note that this library is a by-product of the C<IO::AIO> perl 15Note that this library is a by-product of the C<IO::AIO> perl
16module, and many of the subtler points regarding requets lifetime 16module, and many of the subtler points regarding requests lifetime
17and so on are only documented in its documentation at the 17and so on are only documented in its documentation at the
18moment: L<http://pod.tst.eu/http://cvs.schmorp.de/IO-AIO/AIO.pm>. 18moment: L<http://pod.tst.eu/http://cvs.schmorp.de/IO-AIO/AIO.pm>.
19 19
20=head2 FEATURES 20=head2 FEATURES
21 21
22This library provides fully asynchronous versions of most POSIX functions 22This library provides fully asynchronous versions of most POSIX functions
23dealign with I/O. Unlike most asynchronous libraries, this not only 23dealing with I/O. Unlike most asynchronous libraries, this not only
24includes C<read> and C<write>, but also C<open>, C<stat>, C<unlink> and 24includes C<read> and C<write>, but also C<open>, C<stat>, C<unlink> and
25similar functions, as well as less rarely ones such as C<mknod>, C<futime> 25similar functions, as well as less rarely ones such as C<mknod>, C<futime>
26or C<readlink>. 26or C<readlink>.
27 27
28It also offers wrappers around C<sendfile> (Solaris, Linux, HP-UX and 28It also offers wrappers around C<sendfile> (Solaris, Linux, HP-UX and
29FreeBSD, with emulation on other platforms) and C<readahead> (Linux, with 29FreeBSD, with emulation on other platforms) and C<readahead> (Linux, with
30emulation elsewhere>). 30emulation elsewhere>).
31 31
32The goal is to enbale you to write fully non-blocking programs. For 32The goal is to enable you to write fully non-blocking programs. For
33example, in a game server, you would not want to freeze for a few seconds 33example, in a game server, you would not want to freeze for a few seconds
34just because the server is running a backup and you happen to call 34just because the server is running a backup and you happen to call
35C<readdir>. 35C<readdir>.
36 36
37=head2 TIME REPRESENTATION 37=head2 TIME REPRESENTATION
38 38
39Libeio represents time as a single floating point number, representing the 39Libeio represents time as a single floating point number, representing the
40(fractional) number of seconds since the (POSIX) epoch (somewhere near 40(fractional) number of seconds since the (POSIX) epoch (somewhere near
41the beginning of 1970, details are complicated, don't ask). This type is 41the beginning of 1970, details are complicated, don't ask). This type is
42called C<eio_tstamp>, but it is guarenteed to be of type C<double> (or 42called C<eio_tstamp>, but it is guaranteed to be of type C<double> (or
43better), so you can freely use C<double> yourself. 43better), so you can freely use C<double> yourself.
44 44
45Unlike the name component C<stamp> might indicate, it is also used for 45Unlike the name component C<stamp> might indicate, it is also used for
46time differences throughout libeio. 46time differences throughout libeio.
47 47
48=head2 FORK SUPPORT 48=head2 FORK SUPPORT
49 49
50Calling C<fork ()> is fully supported by this module. It is implemented in these steps: 50Calling C<fork ()> is fully supported by this module - but you must not
51rely on this. It is currently implemented in these steps:
51 52
52 1. wait till all requests in "execute" state have been handled 53 1. wait till all requests in "execute" state have been handled
53 (basically requests that are already handed over to the kernel). 54 (basically requests that are already handed over to the kernel).
54 2. fork 55 2. fork
55 3. in the parent, continue business as usual, done 56 3. in the parent, continue business as usual, done
56 4. in the child, destroy all ready and pending requests and free the 57 4. in the child, destroy all ready and pending requests and free the
57 memory used by the worker threads. This gives you a fully empty 58 memory used by the worker threads. This gives you a fully empty
58 libeio queue. 59 libeio queue.
60
61Note, however, since libeio does use threads, the above guarantee doesn't
62cover your libc, for example, malloc and other libc functions are not
63fork-safe, so there is very little you can do after a fork, and in fact,
64the above might crash, and thus change.
59 65
60=head1 INITIALISATION/INTEGRATION 66=head1 INITIALISATION/INTEGRATION
61 67
62Before you can call any eio functions you first have to initialise the 68Before you can call any eio functions you first have to initialise the
63library. The library integrates into any event loop, but can also be used 69library. The library integrates into any event loop, but can also be used
97handled or C<done_poll> has been called, which signals the same. 103handled or C<done_poll> has been called, which signals the same.
98 104
99Note that C<eio_poll> might return after C<done_poll> and C<want_poll> 105Note that C<eio_poll> might return after C<done_poll> and C<want_poll>
100have been called again, so watch out for races in your code. 106have been called again, so watch out for races in your code.
101 107
102As with C<want_poll>, this callback is called while lcoks are being held, 108As with C<want_poll>, this callback is called while locks are being held,
103so you I<must not call any libeio functions form within this callback>. 109so you I<must not call any libeio functions form within this callback>.
104 110
105=item int eio_poll () 111=item int eio_poll ()
106 112
107This function has to be called whenever there are pending requests that 113This function has to be called whenever there are pending requests that
119=back 125=back
120 126
121For libev, you would typically use an C<ev_async> watcher: the 127For libev, you would typically use an C<ev_async> watcher: the
122C<want_poll> callback would invoke C<ev_async_send> to wake up the event 128C<want_poll> callback would invoke C<ev_async_send> to wake up the event
123loop. Inside the callback set for the watcher, one would call C<eio_poll 129loop. Inside the callback set for the watcher, one would call C<eio_poll
124()> (followed by C<ev_async_send> again if C<eio_poll> indicates that not 130()>.
125all requests have been handled yet). The race is taken care of because 131
126libev resets/rearms the async watcher before calling your callback, 132If C<eio_poll ()> is configured to not handle all results in one go
127and therefore, before calling C<eio_poll>. This might result in (some) 133(i.e. it returns C<-1>) then you should start an idle watcher that calls
128spurious wake-ups, but is generally harmless. 134C<eio_poll> until it returns something C<!= -1>.
135
136A full-featured connector between libeio and libev would look as follows
137(if C<eio_poll> is handling all requests, it can of course be simplified a
138lot by removing the idle watcher logic):
139
140 static struct ev_loop *loop;
141 static ev_idle repeat_watcher;
142 static ev_async ready_watcher;
143
144 /* idle watcher callback, only used when eio_poll */
145 /* didn't handle all results in one call */
146 static void
147 repeat (EV_P_ ev_idle *w, int revents)
148 {
149 if (eio_poll () != -1)
150 ev_idle_stop (EV_A_ w);
151 }
152
153 /* eio has some results, process them */
154 static void
155 ready (EV_P_ ev_async *w, int revents)
156 {
157 if (eio_poll () == -1)
158 ev_idle_start (EV_A_ &repeat_watcher);
159 }
160
161 /* wake up the event loop */
162 static void
163 want_poll (void)
164 {
165 ev_async_send (loop, &ready_watcher)
166 }
167
168 void
169 my_init_eio ()
170 {
171 loop = EV_DEFAULT;
172
173 ev_idle_init (&repeat_watcher, repeat);
174 ev_async_init (&ready_watcher, ready);
175 ev_async_start (loop &watcher);
176
177 eio_init (want_poll, 0);
178 }
129 179
130For most other event loops, you would typically use a pipe - the event 180For most other event loops, you would typically use a pipe - the event
131loop should be told to wait for read readyness on the read end. In 181loop should be told to wait for read readiness on the read end. In
132C<want_poll> you would write a single byte, in C<done_poll> you would try 182C<want_poll> you would write a single byte, in C<done_poll> you would try
133to read that byte, and in the callback for the read end, you would call 183to read that byte, and in the callback for the read end, you would call
134C<eio_poll>. The race is avoided here because the event loop should invoke 184C<eio_poll>.
135your callback again and again until the byte has been read (as the pipe 185
136read callback does not read it, only C<done_poll>). 186You don't have to take special care in the case C<eio_poll> doesn't handle
187all requests, as the done callback will not be invoked, so the event loop
188will still signal readiness for the pipe until I<all> results have been
189processed.
190
191
192=head1 HIGH LEVEL REQUEST API
193
194Libeio has both a high-level API, which consists of calling a request
195function with a callback to be called on completion, and a low-level API
196where you fill out request structures and submit them.
197
198This section describes the high-level API.
199
200=head2 REQUEST SUBMISSION AND RESULT PROCESSING
201
202You submit a request by calling the relevant C<eio_TYPE> function with the
203required parameters, a callback of type C<int (*eio_cb)(eio_req *req)>
204(called C<eio_cb> below) and a freely usable C<void *data> argument.
205
206The return value will either be 0, in case something went really wrong
207(which can basically only happen on very fatal errors, such as C<malloc>
208returning 0, which is rather unlikely), or a pointer to the newly-created
209and submitted C<eio_req *>.
210
211The callback will be called with an C<eio_req *> which contains the
212results of the request. The members you can access inside that structure
213vary from request to request, except for:
214
215=over 4
216
217=item C<ssize_t result>
218
219This contains the result value from the call (usually the same as the
220syscall of the same name).
221
222=item C<int errorno>
223
224This contains the value of C<errno> after the call.
225
226=item C<void *data>
227
228The C<void *data> member simply stores the value of the C<data> argument.
229
230=back
231
232The return value of the callback is normally C<0>, which tells libeio to
233continue normally. If a callback returns a nonzero value, libeio will
234stop processing results (in C<eio_poll>) and will return the value to its
235caller.
236
237Memory areas passed to libeio must stay valid as long as a request
238executes, with the exception of paths, which are being copied
239internally. Any memory libeio itself allocates will be freed after the
240finish callback has been called. If you want to manage all memory passed
241to libeio yourself you can use the low-level API.
242
243For example, to open a file, you could do this:
244
245 static int
246 file_open_done (eio_req *req)
247 {
248 if (req->result < 0)
249 {
250 /* open() returned -1 */
251 errno = req->errorno;
252 perror ("open");
253 }
254 else
255 {
256 int fd = req->result;
257 /* now we have the new fd in fd */
258 }
259
260 return 0;
261 }
262
263 /* the first three arguments are passed to open(2) */
264 /* the remaining are priority, callback and data */
265 if (!eio_open ("/etc/passwd", O_RDONLY, 0, 0, file_open_done, 0))
266 abort (); /* something went wrong, we will all die!!! */
267
268Note that you additionally need to call C<eio_poll> when the C<want_cb>
269indicates that requests are ready to be processed.
270
271=head2 CANCELLING REQUESTS
272
273Sometimes the need for a request goes away before the request is
274finished. In that case, one can cancel the request by a call to
275C<eio_cancel>:
276
277=over 4
278
279=item eio_cancel (eio_req *req)
280
281Cancel the request (and all its subrequests). If the request is currently
282executing it might still continue to execute, and in other cases it might
283still take a while till the request is cancelled.
284
285Even if cancelled, the finish callback will still be invoked - the
286callbacks of all cancellable requests need to check whether the request
287has been cancelled by calling C<EIO_CANCELLED (req)>:
288
289 static int
290 my_eio_cb (eio_req *req)
291 {
292 if (EIO_CANCELLED (req))
293 return 0;
294 }
295
296In addition, cancelled requests will I<either> have C<< req->result >>
297set to C<-1> and C<errno> to C<ECANCELED>, or I<otherwise> they were
298successfully executed, despite being cancelled (e.g. when they have
299already been executed at the time they were cancelled).
300
301C<EIO_CANCELLED> is still true for requests that have successfully
302executed, as long as C<eio_cancel> was called on them at some point.
303
304=back
305
306=head2 AVAILABLE REQUESTS
307
308The following request functions are available. I<All> of them return the
309C<eio_req *> on success and C<0> on failure, and I<all> of them have the
310same three trailing arguments: C<pri>, C<cb> and C<data>. The C<cb> is
311mandatory, but in most cases, you pass in C<0> as C<pri> and C<0> or some
312custom data value as C<data>.
313
314=head3 POSIX API WRAPPERS
315
316These requests simply wrap the POSIX call of the same name, with the same
317arguments. If a function is not implemented by the OS and cannot be emulated
318in some way, then all of these return C<-1> and set C<errorno> to C<ENOSYS>.
319
320=over 4
321
322=item eio_open (const char *path, int flags, mode_t mode, int pri, eio_cb cb, void *data)
323
324=item eio_truncate (const char *path, off_t offset, int pri, eio_cb cb, void *data)
325
326=item eio_chown (const char *path, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
327
328=item eio_chmod (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
329
330=item eio_mkdir (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
331
332=item eio_rmdir (const char *path, int pri, eio_cb cb, void *data)
333
334=item eio_unlink (const char *path, int pri, eio_cb cb, void *data)
335
336=item eio_utime (const char *path, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
337
338=item eio_mknod (const char *path, mode_t mode, dev_t dev, int pri, eio_cb cb, void *data)
339
340=item eio_link (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
341
342=item eio_symlink (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
343
344=item eio_rename (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
345
346=item eio_mlock (void *addr, size_t length, int pri, eio_cb cb, void *data)
347
348=item eio_close (int fd, int pri, eio_cb cb, void *data)
349
350=item eio_sync (int pri, eio_cb cb, void *data)
351
352=item eio_fsync (int fd, int pri, eio_cb cb, void *data)
353
354=item eio_fdatasync (int fd, int pri, eio_cb cb, void *data)
355
356=item eio_futime (int fd, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
357
358=item eio_ftruncate (int fd, off_t offset, int pri, eio_cb cb, void *data)
359
360=item eio_fchmod (int fd, mode_t mode, int pri, eio_cb cb, void *data)
361
362=item eio_fchown (int fd, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
363
364=item eio_dup2 (int fd, int fd2, int pri, eio_cb cb, void *data)
365
366These have the same semantics as the syscall of the same name, their
367return value is available as C<< req->result >> later.
368
369=item eio_read (int fd, void *buf, size_t length, off_t offset, int pri, eio_cb cb, void *data)
370
371=item eio_write (int fd, void *buf, size_t length, off_t offset, int pri, eio_cb cb, void *data)
372
373These two requests are called C<read> and C<write>, but actually wrap
374C<pread> and C<pwrite>. On systems that lack these calls (such as cygwin),
375libeio uses lseek/read_or_write/lseek and a mutex to serialise the
376requests, so all these requests run serially and do not disturb each
377other. However, they still disturb the file offset while they run, so it's
378not safe to call these functions concurrently with non-libeio functions on
379the same fd on these systems.
380
381Not surprisingly, pread and pwrite are not thread-safe on Darwin (OS/X),
382so it is advised not to submit multiple requests on the same fd on this
383horrible pile of garbage.
384
385=item eio_mlockall (int flags, int pri, eio_cb cb, void *data)
386
387Like C<mlockall>, but the flag value constants are called
388C<EIO_MCL_CURRENT> and C<EIO_MCL_FUTURE>.
389
390=item eio_msync (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
391
392Just like msync, except that the flag values are called C<EIO_MS_ASYNC>,
393C<EIO_MS_INVALIDATE> and C<EIO_MS_SYNC>.
394
395=item eio_readlink (const char *path, int pri, eio_cb cb, void *data)
396
397If successful, the path read by C<readlink(2)> can be accessed via C<<
398req->ptr2 >> and is I<NOT> null-terminated, with the length specified as
399C<< req->result >>.
400
401 if (req->result >= 0)
402 {
403 char *target = strndup ((char *)req->ptr2, req->result);
404
405 free (target);
406 }
407
408=item eio_realpath (const char *path, int pri, eio_cb cb, void *data)
409
410Similar to the realpath libc function, but unlike that one, result is
411C<-1> on failure and the length of the returned path in C<ptr2> (which is
412not 0-terminated) - this is similar to readlink.
413
414=item eio_stat (const char *path, int pri, eio_cb cb, void *data)
415
416=item eio_lstat (const char *path, int pri, eio_cb cb, void *data)
417
418=item eio_fstat (int fd, int pri, eio_cb cb, void *data)
419
420Stats a file - if C<< req->result >> indicates success, then you can
421access the C<struct stat>-like structure via C<< req->ptr2 >>:
422
423 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2;
424
425=item eio_statvfs (const char *path, int pri, eio_cb cb, void *data)
426
427=item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data)
428
429Stats a filesystem - if C<< req->result >> indicates success, then you can
430access the C<struct statvfs>-like structure via C<< req->ptr2 >>:
431
432 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2;
433
434=back
435
436=head3 READING DIRECTORIES
437
438Reading directories sounds simple, but can be rather demanding, especially
439if you want to do stuff such as traversing a directory hierarchy or
440processing all files in a directory. Libeio can assist these complex tasks
441with it's C<eio_readdir> call.
442
443=over 4
444
445=item eio_readdir (const char *path, int flags, int pri, eio_cb cb, void *data)
446
447This is a very complex call. It basically reads through a whole directory
448(via the C<opendir>, C<readdir> and C<closedir> calls) and returns either
449the names or an array of C<struct eio_dirent>, depending on the C<flags>
450argument.
451
452The C<< req->result >> indicates either the number of files found, or
453C<-1> on error. On success, null-terminated names can be found as C<< req->ptr2 >>,
454and C<struct eio_dirents>, if requested by C<flags>, can be found via C<<
455req->ptr1 >>.
456
457Here is an example that prints all the names:
458
459 int i;
460 char *names = (char *)req->ptr2;
461
462 for (i = 0; i < req->result; ++i)
463 {
464 printf ("name #%d: %s\n", i, names);
465
466 /* move to next name */
467 names += strlen (names) + 1;
468 }
469
470Pseudo-entries such as F<.> and F<..> are never returned by C<eio_readdir>.
471
472C<flags> can be any combination of:
473
474=over 4
475
476=item EIO_READDIR_DENTS
477
478If this flag is specified, then, in addition to the names in C<ptr2>,
479also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct
480eio_dirent> looks like this:
481
482 struct eio_dirent
483 {
484 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */
485 unsigned short namelen; /* size of filename without trailing 0 */
486 unsigned char type; /* one of EIO_DT_* */
487 signed char score; /* internal use */
488 ino_t inode; /* the inode number, if available, otherwise unspecified */
489 };
490
491The only members you normally would access are C<nameofs>, which is the
492byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>.
493
494C<type> can be one of:
495
496C<EIO_DT_UNKNOWN> - if the type is not known (very common) and you have to C<stat>
497the name yourself if you need to know,
498one of the "standard" POSIX file types (C<EIO_DT_REG>, C<EIO_DT_DIR>, C<EIO_DT_LNK>,
499C<EIO_DT_FIFO>, C<EIO_DT_SOCK>, C<EIO_DT_CHR>, C<EIO_DT_BLK>)
500or some OS-specific type (currently
501C<EIO_DT_MPC> - multiplexed char device (v7+coherent),
502C<EIO_DT_NAM> - xenix special named file,
503C<EIO_DT_MPB> - multiplexed block device (v7+coherent),
504C<EIO_DT_NWK> - HP-UX network special,
505C<EIO_DT_CMP> - VxFS compressed,
506C<EIO_DT_DOOR> - solaris door, or
507C<EIO_DT_WHT>).
508
509This example prints all names and their type:
510
511 int i;
512 struct eio_dirent *ents = (struct eio_dirent *)req->ptr1;
513 char *names = (char *)req->ptr2;
514
515 for (i = 0; i < req->result; ++i)
516 {
517 struct eio_dirent *ent = ents + i;
518 char *name = names + ent->nameofs;
519
520 printf ("name #%d: %s (type %d)\n", i, name, ent->type);
521 }
522
523=item EIO_READDIR_DIRS_FIRST
524
525When this flag is specified, then the names will be returned in an order
526where likely directories come first, in optimal C<stat> order. This is
527useful when you need to quickly find directories, or you want to find all
528directories while avoiding to stat() each entry.
529
530If the system returns type information in readdir, then this is used
531to find directories directly. Otherwise, likely directories are names
532beginning with ".", or otherwise names with no dots, of which names with
533short names are tried first.
534
535=item EIO_READDIR_STAT_ORDER
536
537When this flag is specified, then the names will be returned in an order
538suitable for stat()'ing each one. That is, when you plan to stat()
539all files in the given directory, then the returned order will likely
540be fastest.
541
542If both this flag and C<EIO_READDIR_DIRS_FIRST> are specified, then the
543likely directories come first, resulting in a less optimal stat order.
544
545=item EIO_READDIR_FOUND_UNKNOWN
546
547This flag should not be specified when calling C<eio_readdir>. Instead,
548it is being set by C<eio_readdir> (you can access the C<flags> via C<<
549req->int1 >>, when any of the C<type>'s found were C<EIO_DT_UNKNOWN>. The
550absence of this flag therefore indicates that all C<type>'s are known,
551which can be used to speed up some algorithms.
552
553A typical use case would be to identify all subdirectories within a
554directory - you would ask C<eio_readdir> for C<EIO_READDIR_DIRS_FIRST>. If
555then this flag is I<NOT> set, then all the entries at the beginning of the
556returned array of type C<EIO_DT_DIR> are the directories. Otherwise, you
557should start C<stat()>'ing the entries starting at the beginning of the
558array, stopping as soon as you found all directories (the count can be
559deduced by the link count of the directory).
560
561=back
562
563=back
564
565=head3 OS-SPECIFIC CALL WRAPPERS
566
567These wrap OS-specific calls (usually Linux ones), and might or might not
568be emulated on other operating systems. Calls that are not emulated will
569return C<-1> and set C<errno> to C<ENOSYS>.
570
571=over 4
572
573=item eio_sendfile (int out_fd, int in_fd, off_t in_offset, size_t length, int pri, eio_cb cb, void *data)
574
575Wraps the C<sendfile> syscall. The arguments follow the Linux version, but
576libeio supports and will use similar calls on FreeBSD, HP/UX, Solaris and
577Darwin.
578
579If the OS doesn't support some sendfile-like call, or the call fails,
580indicating support for the given file descriptor type (for example,
581Linux's sendfile might not support file to file copies), then libeio will
582emulate the call in userspace, so there are almost no limitations on its
583use.
584
585=item eio_readahead (int fd, off_t offset, size_t length, int pri, eio_cb cb, void *data)
586
587Calls C<readahead(2)>. If the syscall is missing, then the call is
588emulated by simply reading the data (currently in 64kiB chunks).
589
590=item eio_sync_file_range (int fd, off_t offset, size_t nbytes, unsigned int flags, int pri, eio_cb cb, void *data)
591
592Calls C<sync_file_range>. If the syscall is missing, then this is the same
593as calling C<fdatasync>.
594
595Flags can be any combination of C<EIO_SYNC_FILE_RANGE_WAIT_BEFORE>,
596C<EIO_SYNC_FILE_RANGE_WRITE> and C<EIO_SYNC_FILE_RANGE_WAIT_AFTER>.
597
598=item eio_fallocate (int fd, int mode, off_t offset, off_t len, int pri, eio_cb cb, void *data)
599
600Calls C<fallocate> (note: I<NOT> C<posix_fallocate>!). If the syscall is
601missing, then it returns failure and sets C<errno> to C<ENOSYS>.
602
603The C<mode> argument can be C<0> (for behaviour similar to
604C<posix_fallocate>), or C<EIO_FALLOC_FL_KEEP_SIZE>, which keeps the size
605of the file unchanged (but still preallocates space beyond end of file).
606
607=back
608
609=head3 LIBEIO-SPECIFIC REQUESTS
610
611These requests are specific to libeio and do not correspond to any OS call.
612
613=over 4
614
615=item eio_mtouch (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
616
617Reads (C<flags == 0>) or modifies (C<flags == EIO_MT_MODIFY) the given
618memory area, page-wise, that is, it reads (or reads and writes back) the
619first octet of every page that spans the memory area.
620
621This can be used to page in some mmapped file, or dirty some pages. Note
622that dirtying is an unlocked read-write access, so races can ensue when
623the some other thread modifies the data stored in that memory area.
624
625=item eio_custom (void (*)(eio_req *) execute, int pri, eio_cb cb, void *data)
626
627Executes a custom request, i.e., a user-specified callback.
628
629The callback gets the C<eio_req *> as parameter and is expected to read
630and modify any request-specific members. Specifically, it should set C<<
631req->result >> to the result value, just like other requests.
632
633Here is an example that simply calls C<open>, like C<eio_open>, but it
634uses the C<data> member as filename and uses a hardcoded C<O_RDONLY>. If
635you want to pass more/other parameters, you either need to pass some
636struct or so via C<data> or provide your own wrapper using the low-level
637API.
638
639 static int
640 my_open_done (eio_req *req)
641 {
642 int fd = req->result;
643
644 return 0;
645 }
646
647 static void
648 my_open (eio_req *req)
649 {
650 req->result = open (req->data, O_RDONLY);
651 }
652
653 eio_custom (my_open, 0, my_open_done, "/etc/passwd");
654
655=item eio_busy (eio_tstamp delay, int pri, eio_cb cb, void *data)
656
657This is a request that takes C<delay> seconds to execute, but otherwise
658does nothing - it simply puts one of the worker threads to sleep for this
659long.
660
661This request can be used to artificially increase load, e.g. for debugging
662or benchmarking reasons.
663
664=item eio_nop (int pri, eio_cb cb, void *data)
665
666This request does nothing, except go through the whole request cycle. This
667can be used to measure latency or in some cases to simplify code, but is
668not really of much use.
669
670=back
671
672=head3 GROUPING AND LIMITING REQUESTS
673
674There is one more rather special request, C<eio_grp>. It is a very special
675aio request: Instead of doing something, it is a container for other eio
676requests.
677
678There are two primary use cases for this: a) bundle many requests into a
679single, composite, request with a definite callback and the ability to
680cancel the whole request with its subrequests and b) limiting the number
681of "active" requests.
682
683Further below you will find more discussion of these topics - first
684follows the reference section detailing the request generator and other
685methods.
686
687=over 4
688
689=item eio_req *grp = eio_grp (eio_cb cb, void *data)
690
691Creates, submits and returns a group request.
692
693=item eio_grp_add (eio_req *grp, eio_req *req)
694
695Adds a request to the request group.
696
697=item eio_grp_cancel (eio_req *grp)
698
699Cancels all requests I<in> the group, but I<not> the group request
700itself. You can cancel the group request via a normal C<eio_cancel> call.
701
702
703
704=back
705
706
707
708#TODO
709
710/*****************************************************************************/
711/* groups */
712
713eio_req *eio_grp (eio_cb cb, void *data);
714void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit);
715void eio_grp_limit (eio_req *grp, int limit);
716void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */
717
718
719=back
720
721
722=head1 LOW LEVEL REQUEST API
723
724#TODO
725
726
727=head1 ANATOMY AND LIFETIME OF AN EIO REQUEST
728
729A request is represented by a structure of type C<eio_req>. To initialise
730it, clear it to all zero bytes:
731
732 eio_req req;
733
734 memset (&req, 0, sizeof (req));
735
736A more common way to initialise a new C<eio_req> is to use C<calloc>:
737
738 eio_req *req = calloc (1, sizeof (*req));
739
740In either case, libeio neither allocates, initialises or frees the
741C<eio_req> structure for you - it merely uses it.
742
743zero
744
745#TODO
137 746
138=head2 CONFIGURATION 747=head2 CONFIGURATION
139 748
140The functions in this section can sometimes be useful, but the default 749The functions in this section can sometimes be useful, but the default
141configuration will do in most case, so you should skip this section on 750configuration will do in most case, so you should skip this section on
152for example, in interactive programs, you might want to limit this time to 761for example, in interactive programs, you might want to limit this time to
153C<0.01> seconds or so. 762C<0.01> seconds or so.
154 763
155Note that: 764Note that:
156 765
766=over 4
767
157a) libeio doesn't know how long your request callbacks take, so the time 768=item a) libeio doesn't know how long your request callbacks take, so the
158spent in C<eio_poll> is up to one callback invocation longer then this 769time spent in C<eio_poll> is up to one callback invocation longer then
159interval. 770this interval.
160 771
161b) this is implemented by calling C<gettimeofday> after each request, 772=item b) this is implemented by calling C<gettimeofday> after each
162which can be costly. 773request, which can be costly.
163 774
164c) at least one request will be handled. 775=item c) at least one request will be handled.
776
777=back
165 778
166=item eio_set_max_poll_reqs (unsigned int nreqs) 779=item eio_set_max_poll_reqs (unsigned int nreqs)
167 780
168When C<nreqs> is non-zero, then C<eio_poll> will not handle more than 781When C<nreqs> is non-zero, then C<eio_poll> will not handle more than
169C<nreqs> requests per invocation. This is a less costly way to limit the 782C<nreqs> requests per invocation. This is a less costly way to limit the
185=item eio_set_max_idle (unsigned int nthreads) 798=item eio_set_max_idle (unsigned int nthreads)
186 799
187Libeio uses threads internally to handle most requests, and will start and stop threads on demand. 800Libeio uses threads internally to handle most requests, and will start and stop threads on demand.
188 801
189This call can be used to limit the number of idle threads (threads without 802This call can be used to limit the number of idle threads (threads without
190work to do): libeio will keep some threads idle in preperation for more 803work to do): libeio will keep some threads idle in preparation for more
191requests, but never longer than C<nthreads> threads. 804requests, but never longer than C<nthreads> threads.
192 805
193In addition to this, libeio will also stop threads when they are idle for 806In addition to this, libeio will also stop threads when they are idle for
194a few seconds, regardless of this setting. 807a few seconds, regardless of this setting.
195 808
213Returns the number of pending requests, i.e. requests that have been 826Returns the number of pending requests, i.e. requests that have been
214executed and have results, but have not been finished yet by a call to 827executed and have results, but have not been finished yet by a call to
215C<eio_poll>). 828C<eio_poll>).
216 829
217=back 830=back
218
219
220=head1 ANATOMY OF AN EIO REQUEST
221
222#TODO
223
224
225=head1 HIGH LEVEL REQUEST API
226
227#TODO
228
229=back
230
231
232=head1 LOW LEVEL REQUEST API
233
234#TODO
235 831
236=head1 EMBEDDING 832=head1 EMBEDDING
237 833
238Libeio can be embedded directly into programs. This functionality is not 834Libeio can be embedded directly into programs. This functionality is not
239documented and not (yet) officially supported. 835documented and not (yet) officially supported.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines