ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libeio/eio.pod
(Generate patch)

Comparing libeio/eio.pod (file contents):
Revision 1.13 by root, Tue Jul 5 09:24:12 2011 UTC vs.
Revision 1.36 by root, Sun Jan 24 16:36:20 2016 UTC

25similar functions, as well as less rarely ones such as C<mknod>, C<futime> 25similar functions, as well as less rarely ones such as C<mknod>, C<futime>
26or C<readlink>. 26or C<readlink>.
27 27
28It also offers wrappers around C<sendfile> (Solaris, Linux, HP-UX and 28It also offers wrappers around C<sendfile> (Solaris, Linux, HP-UX and
29FreeBSD, with emulation on other platforms) and C<readahead> (Linux, with 29FreeBSD, with emulation on other platforms) and C<readahead> (Linux, with
30emulation elsewhere>). 30emulation elsewhere).
31 31
32The goal is to enable you to write fully non-blocking programs. For 32The goal is to enable you to write fully non-blocking programs. For
33example, in a game server, you would not want to freeze for a few seconds 33example, in a game server, you would not want to freeze for a few seconds
34just because the server is running a backup and you happen to call 34just because the server is running a backup and you happen to call
35C<readdir>. 35C<readdir>.
45Unlike the name component C<stamp> might indicate, it is also used for 45Unlike the name component C<stamp> might indicate, it is also used for
46time differences throughout libeio. 46time differences throughout libeio.
47 47
48=head2 FORK SUPPORT 48=head2 FORK SUPPORT
49 49
50Calling C<fork ()> is fully supported by this module. It is implemented in these steps: 50Usage of pthreads in a program changes the semantics of fork
51considerably. Specifically, only async-safe functions can be called after
52fork. Libeio uses pthreads, so this applies, and makes using fork hard for
53anything but relatively fork + exec uses.
51 54
52 1. wait till all requests in "execute" state have been handled 55This library only works in the process that initialised it: Forking is
53 (basically requests that are already handed over to the kernel). 56fully supported, but using libeio in any other process than the one that
54 2. fork 57called C<eio_init> is not.
55 3. in the parent, continue business as usual, done
56 4. in the child, destroy all ready and pending requests and free the
57 memory used by the worker threads. This gives you a fully empty
58 libeio queue.
59 58
60Note, however, since libeio does use threads, thr above guarantee doesn't 59You might get around by not I<using> libeio before (or after) forking in
61cover your libc, for example, malloc and other libc functions are not 60the parent, and using it in the child afterwards. You could also try to
62fork-safe, so there is very little you can do after a fork, and in fatc, 61call the L<eio_init> function again in the child, which will brutally
63the above might crash, and thus change. 62reinitialise all data structures, which isn't POSIX conformant, but
63typically works.
64
65Otherwise, the only recommendation you should follow is: treat fork code
66the same way you treat signal handlers, and only ever call C<eio_init> in
67the process that uses it, and only once ever.
64 68
65=head1 INITIALISATION/INTEGRATION 69=head1 INITIALISATION/INTEGRATION
66 70
67Before you can call any eio functions you first have to initialise the 71Before you can call any eio functions you first have to initialise the
68library. The library integrates into any event loop, but can also be used 72library. The library integrates into any event loop, but can also be used
77This function initialises the library. On success it returns C<0>, on 81This function initialises the library. On success it returns C<0>, on
78failure it returns C<-1> and sets C<errno> appropriately. 82failure it returns C<-1> and sets C<errno> appropriately.
79 83
80It accepts two function pointers specifying callbacks as argument, both of 84It accepts two function pointers specifying callbacks as argument, both of
81which can be C<0>, in which case the callback isn't called. 85which can be C<0>, in which case the callback isn't called.
86
87There is currently no way to change these callbacks later, or to
88"uninitialise" the library again.
82 89
83=item want_poll callback 90=item want_poll callback
84 91
85The C<want_poll> callback is invoked whenever libeio wants attention (i.e. 92The C<want_poll> callback is invoked whenever libeio wants attention (i.e.
86it wants to be polled by calling C<eio_poll>). It is "edge-triggered", 93it wants to be polled by calling C<eio_poll>). It is "edge-triggered",
97This callback is invoked when libeio detects that all pending requests 104This callback is invoked when libeio detects that all pending requests
98have been handled. It is "edge-triggered", that is, it will only be 105have been handled. It is "edge-triggered", that is, it will only be
99called once after C<want_poll>. To put it differently, C<want_poll> and 106called once after C<want_poll>. To put it differently, C<want_poll> and
100C<done_poll> are invoked in pairs: after C<want_poll> you have to call 107C<done_poll> are invoked in pairs: after C<want_poll> you have to call
101C<eio_poll ()> until either C<eio_poll> indicates that everything has been 108C<eio_poll ()> until either C<eio_poll> indicates that everything has been
102handled or C<done_poll> has been called, which signals the same. 109handled or C<done_poll> has been called, which signals the same - only one
110method is needed.
103 111
104Note that C<eio_poll> might return after C<done_poll> and C<want_poll> 112Note that C<eio_poll> might return after C<done_poll> and C<want_poll>
105have been called again, so watch out for races in your code. 113have been called again, so watch out for races in your code.
106 114
115It is quite common to have an empty C<done_call> callback and only use
116the return value from C<eio_poll>, or, when C<eio_poll> is configured to
117handle all outstanding replies, it's enough to call C<eio_poll> once.
118
107As with C<want_poll>, this callback is called while locks are being held, 119As with C<want_poll>, this callback is called while locks are being held,
108so you I<must not call any libeio functions form within this callback>. 120so you I<must not call any libeio functions from within this callback>.
109 121
110=item int eio_poll () 122=item int eio_poll ()
111 123
112This function has to be called whenever there are pending requests that 124This function has to be called whenever there are pending requests that
113need finishing. You usually call this after C<want_poll> has indicated 125need finishing. You usually call this after C<want_poll> has indicated
124=back 136=back
125 137
126For libev, you would typically use an C<ev_async> watcher: the 138For libev, you would typically use an C<ev_async> watcher: the
127C<want_poll> callback would invoke C<ev_async_send> to wake up the event 139C<want_poll> callback would invoke C<ev_async_send> to wake up the event
128loop. Inside the callback set for the watcher, one would call C<eio_poll 140loop. Inside the callback set for the watcher, one would call C<eio_poll
129()> (followed by C<ev_async_send> again if C<eio_poll> indicates that not 141()>.
130all requests have been handled yet). The race is taken care of because 142
131libev resets/rearms the async watcher before calling your callback, 143If C<eio_poll ()> is configured to not handle all results in one go
132and therefore, before calling C<eio_poll>. This might result in (some) 144(i.e. it returns C<-1>) then you should start an idle watcher that calls
133spurious wake-ups, but is generally harmless. 145C<eio_poll> until it returns something C<!= -1>.
146
147A full-featured connector between libeio and libev would look as follows
148(if C<eio_poll> is handling all requests, it can of course be simplified a
149lot by removing the idle watcher logic):
150
151 static struct ev_loop *loop;
152 static ev_idle repeat_watcher;
153 static ev_async ready_watcher;
154
155 /* idle watcher callback, only used when eio_poll */
156 /* didn't handle all results in one call */
157 static void
158 repeat (EV_P_ ev_idle *w, int revents)
159 {
160 if (eio_poll () != -1)
161 ev_idle_stop (EV_A_ w);
162 }
163
164 /* eio has some results, process them */
165 static void
166 ready (EV_P_ ev_async *w, int revents)
167 {
168 if (eio_poll () == -1)
169 ev_idle_start (EV_A_ &repeat_watcher);
170 }
171
172 /* wake up the event loop */
173 static void
174 want_poll (void)
175 {
176 ev_async_send (loop, &ready_watcher)
177 }
178
179 void
180 my_init_eio ()
181 {
182 loop = EV_DEFAULT;
183
184 ev_idle_init (&repeat_watcher, repeat);
185 ev_async_init (&ready_watcher, ready);
186 ev_async_start (loop, &watcher);
187
188 eio_init (want_poll, 0);
189 }
134 190
135For most other event loops, you would typically use a pipe - the event 191For most other event loops, you would typically use a pipe - the event
136loop should be told to wait for read readiness on the read end. In 192loop should be told to wait for read readiness on the read end. In
137C<want_poll> you would write a single byte, in C<done_poll> you would try 193C<want_poll> you would write a single byte, in C<done_poll> you would try
138to read that byte, and in the callback for the read end, you would call 194to read that byte, and in the callback for the read end, you would call
139C<eio_poll>. The race is avoided here because the event loop should invoke 195C<eio_poll>.
140your callback again and again until the byte has been read (as the pipe 196
141read callback does not read it, only C<done_poll>). 197You don't have to take special care in the case C<eio_poll> doesn't handle
198all requests, as the done callback will not be invoked, so the event loop
199will still signal readiness for the pipe until I<all> results have been
200processed.
142 201
143 202
144=head1 HIGH LEVEL REQUEST API 203=head1 HIGH LEVEL REQUEST API
145 204
146Libeio has both a high-level API, which consists of calling a request 205Libeio has both a high-level API, which consists of calling a request
179 238
180The C<void *data> member simply stores the value of the C<data> argument. 239The C<void *data> member simply stores the value of the C<data> argument.
181 240
182=back 241=back
183 242
243Members not explicitly described as accessible must not be
244accessed. Specifically, there is no guarantee that any members will still
245have the value they had when the request was submitted.
246
184The return value of the callback is normally C<0>, which tells libeio to 247The return value of the callback is normally C<0>, which tells libeio to
185continue normally. If a callback returns a nonzero value, libeio will 248continue normally. If a callback returns a nonzero value, libeio will
186stop processing results (in C<eio_poll>) and will return the value to its 249stop processing results (in C<eio_poll>) and will return the value to its
187caller. 250caller.
188 251
189Memory areas passed to libeio must stay valid as long as a request 252Memory areas passed to libeio wrappers must stay valid as long as a
190executes, with the exception of paths, which are being copied 253request executes, with the exception of paths, which are being copied
191internally. Any memory libeio itself allocates will be freed after the 254internally. Any memory libeio itself allocates will be freed after the
192finish callback has been called. If you want to manage all memory passed 255finish callback has been called. If you want to manage all memory passed
193to libeio yourself you can use the low-level API. 256to libeio yourself you can use the low-level API.
194 257
195For example, to open a file, you could do this: 258For example, to open a file, you could do this:
213 } 276 }
214 277
215 /* the first three arguments are passed to open(2) */ 278 /* the first three arguments are passed to open(2) */
216 /* the remaining are priority, callback and data */ 279 /* the remaining are priority, callback and data */
217 if (!eio_open ("/etc/passwd", O_RDONLY, 0, 0, file_open_done, 0)) 280 if (!eio_open ("/etc/passwd", O_RDONLY, 0, 0, file_open_done, 0))
218 abort (); /* something ent wrong, we will all die!!! */ 281 abort (); /* something went wrong, we will all die!!! */
219 282
220Note that you additionally need to call C<eio_poll> when the C<want_cb> 283Note that you additionally need to call C<eio_poll> when the C<want_cb>
221indicates that requests are ready to be processed. 284indicates that requests are ready to be processed.
285
286=head2 CANCELLING REQUESTS
287
288Sometimes the need for a request goes away before the request is
289finished. In that case, one can cancel the request by a call to
290C<eio_cancel>:
291
292=over 4
293
294=item eio_cancel (eio_req *req)
295
296Cancel the request (and all its subrequests). If the request is currently
297executing it might still continue to execute, and in other cases it might
298still take a while till the request is cancelled.
299
300When cancelled, the finish callback will not be invoked.
301
302C<EIO_CANCELLED> is still true for requests that have successfully
303executed, as long as C<eio_cancel> was called on them at some point.
304
305=back
222 306
223=head2 AVAILABLE REQUESTS 307=head2 AVAILABLE REQUESTS
224 308
225The following request functions are available. I<All> of them return the 309The following request functions are available. I<All> of them return the
226C<eio_req *> on success and C<0> on failure, and I<all> of them have the 310C<eio_req *> on success and C<0> on failure, and I<all> of them have the
322 free (target); 406 free (target);
323 } 407 }
324 408
325=item eio_realpath (const char *path, int pri, eio_cb cb, void *data) 409=item eio_realpath (const char *path, int pri, eio_cb cb, void *data)
326 410
327Similar to the realpath libc function, but unlike that one, result is 411Similar to the realpath libc function, but unlike that one, C<<
328C<0> on failure and the length of the returned path in C<ptr2> - this is 412req->result >> is C<-1> on failure. On success, the result is the length
413of the returned path in C<ptr2> (which is I<NOT> 0-terminated) - this is
329similar to readlink. 414similar to readlink.
330 415
331=item eio_stat (const char *path, int pri, eio_cb cb, void *data) 416=item eio_stat (const char *path, int pri, eio_cb cb, void *data)
332 417
333=item eio_lstat (const char *path, int pri, eio_cb cb, void *data) 418=item eio_lstat (const char *path, int pri, eio_cb cb, void *data)
335=item eio_fstat (int fd, int pri, eio_cb cb, void *data) 420=item eio_fstat (int fd, int pri, eio_cb cb, void *data)
336 421
337Stats a file - if C<< req->result >> indicates success, then you can 422Stats a file - if C<< req->result >> indicates success, then you can
338access the C<struct stat>-like structure via C<< req->ptr2 >>: 423access the C<struct stat>-like structure via C<< req->ptr2 >>:
339 424
340 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2; 425 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2;
341 426
342=item eio_statvfs (const char *path, int pri, eio_cb cb, void *data) 427=item eio_statvfs (const char *path, int pri, eio_cb cb, void *data)
343 428
344=item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data) 429=item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data)
345 430
346Stats a filesystem - if C<< req->result >> indicates success, then you can 431Stats a filesystem - if C<< req->result >> indicates success, then you can
347access the C<struct statvfs>-like structure via C<< req->ptr2 >>: 432access the C<struct statvfs>-like structure via C<< req->ptr2 >>:
348 433
349 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2; 434 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2;
350 435
351=back 436=back
352 437
353=head3 READING DIRECTORIES 438=head3 READING DIRECTORIES
354 439
355Reading directories sounds simple, but can be rather demanding, especially 440Reading directories sounds simple, but can be rather demanding, especially
356if you want to do stuff such as traversing a diretcory hierarchy or 441if you want to do stuff such as traversing a directory hierarchy or
357processing all files in a directory. Libeio can assist thess complex tasks 442processing all files in a directory. Libeio can assist these complex tasks
358with it's C<eio_readdir> call. 443with it's C<eio_readdir> call.
359 444
360=over 4 445=over 4
361 446
362=item eio_readdir (const char *path, int flags, int pri, eio_cb cb, void *data) 447=item eio_readdir (const char *path, int flags, int pri, eio_cb cb, void *data)
394 479
395If this flag is specified, then, in addition to the names in C<ptr2>, 480If this flag is specified, then, in addition to the names in C<ptr2>,
396also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct 481also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct
397eio_dirent> looks like this: 482eio_dirent> looks like this:
398 483
399 struct eio_dirent 484 struct eio_dirent
400 { 485 {
401 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */ 486 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */
402 unsigned short namelen; /* size of filename without trailing 0 */ 487 unsigned short namelen; /* size of filename without trailing 0 */
403 unsigned char type; /* one of EIO_DT_* */ 488 unsigned char type; /* one of EIO_DT_* */
404 signed char score; /* internal use */ 489 signed char score; /* internal use */
405 ino_t inode; /* the inode number, if available, otherwise unspecified */ 490 ino_t inode; /* the inode number, if available, otherwise unspecified */
406 }; 491 };
407 492
408The only members you normally would access are C<nameofs>, which is the 493The only members you normally would access are C<nameofs>, which is the
409byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>. 494byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>.
410 495
411C<type> can be one of: 496C<type> can be one of:
454When this flag is specified, then the names will be returned in an order 539When this flag is specified, then the names will be returned in an order
455suitable for stat()'ing each one. That is, when you plan to stat() 540suitable for stat()'ing each one. That is, when you plan to stat()
456all files in the given directory, then the returned order will likely 541all files in the given directory, then the returned order will likely
457be fastest. 542be fastest.
458 543
459If both this flag and C<EIO_READDIR_DIRS_FIRST> are specified, then 544If both this flag and C<EIO_READDIR_DIRS_FIRST> are specified, then the
460the likely dirs come first, resulting in a less optimal stat order. 545likely directories come first, resulting in a less optimal stat order.
461 546
462=item EIO_READDIR_FOUND_UNKNOWN 547=item EIO_READDIR_FOUND_UNKNOWN
463 548
464This flag should not be specified when calling C<eio_readdir>. Instead, 549This flag should not be specified when calling C<eio_readdir>. Instead,
465it is being set by C<eio_readdir> (you can access the C<flags> via C<< 550it is being set by C<eio_readdir> (you can access the C<flags> via C<<
466req->int1 >>, when any of the C<type>'s found were C<EIO_DT_UNKNOWN>. The 551req->int1 >>, when any of the C<type>'s found were C<EIO_DT_UNKNOWN>. The
467absense of this flag therefore indicates that all C<type>'s are known, 552absence of this flag therefore indicates that all C<type>'s are known,
468which can be used to speed up some algorithms. 553which can be used to speed up some algorithms.
469 554
470A typical use case would be to identify all subdirectories within a 555A typical use case would be to identify all subdirectories within a
471directory - you would ask C<eio_readdir> for C<EIO_READDIR_DIRS_FIRST>. If 556directory - you would ask C<eio_readdir> for C<EIO_READDIR_DIRS_FIRST>. If
472then this flag is I<NOT> set, then all the entries at the beginning of the 557then this flag is I<NOT> set, then all the entries at the beginning of the
502=item eio_readahead (int fd, off_t offset, size_t length, int pri, eio_cb cb, void *data) 587=item eio_readahead (int fd, off_t offset, size_t length, int pri, eio_cb cb, void *data)
503 588
504Calls C<readahead(2)>. If the syscall is missing, then the call is 589Calls C<readahead(2)>. If the syscall is missing, then the call is
505emulated by simply reading the data (currently in 64kiB chunks). 590emulated by simply reading the data (currently in 64kiB chunks).
506 591
592=item eio_syncfs (int fd, int pri, eio_cb cb, void *data)
593
594Calls Linux' C<syncfs> syscall, if available. Returns C<-1> and sets
595C<errno> to C<ENOSYS> if the call is missing I<but still calls sync()>,
596if the C<fd> is C<< >= 0 >>, so you can probe for the availability of the
597syscall with a negative C<fd> argument and checking for C<-1/ENOSYS>.
598
507=item eio_sync_file_range (int fd, off_t offset, size_t nbytes, unsigned int flags, int pri, eio_cb cb, void *data) 599=item eio_sync_file_range (int fd, off_t offset, size_t nbytes, unsigned int flags, int pri, eio_cb cb, void *data)
508 600
509Calls C<sync_file_range>. If the syscall is missing, then this is the same 601Calls C<sync_file_range>. If the syscall is missing, then this is the same
510as calling C<fdatasync>. 602as calling C<fdatasync>.
511 603
512Flags can be any combination of C<EIO_SYNC_FILE_RANGE_WAIT_BEFORE>, 604Flags can be any combination of C<EIO_SYNC_FILE_RANGE_WAIT_BEFORE>,
513C<EIO_SYNC_FILE_RANGE_WRITE> and C<EIO_SYNC_FILE_RANGE_WAIT_AFTER>. 605C<EIO_SYNC_FILE_RANGE_WRITE> and C<EIO_SYNC_FILE_RANGE_WAIT_AFTER>.
514 606
607=item eio_fallocate (int fd, int mode, off_t offset, off_t len, int pri, eio_cb cb, void *data)
608
609Calls C<fallocate> (note: I<NOT> C<posix_fallocate>!). If the syscall is
610missing, then it returns failure and sets C<errno> to C<ENOSYS>.
611
612The C<mode> argument can be C<0> (for behaviour similar to
613C<posix_fallocate>), or C<EIO_FALLOC_FL_KEEP_SIZE>, which keeps the size
614of the file unchanged (but still preallocates space beyond end of file).
615
515=back 616=back
516 617
517=head3 LIBEIO-SPECIFIC REQUESTS 618=head3 LIBEIO-SPECIFIC REQUESTS
518 619
519These requests are specific to libeio and do not correspond to any OS call. 620These requests are specific to libeio and do not correspond to any OS call.
520 621
521=over 4 622=over 4
522 623
523=item eio_mtouch (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data) 624=item eio_mtouch (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
524 625
525Reads (C<flags == 0>) or modifies (C<flags == EIO_MT_MODIFY) the given 626Reads (C<flags == 0>) or modifies (C<flags == EIO_MT_MODIFY>) the given
526memory area, page-wise, that is, it reads (or reads and writes back) the 627memory area, page-wise, that is, it reads (or reads and writes back) the
527first octet of every page that spans the memory area. 628first octet of every page that spans the memory area.
528 629
529This can be used to page in some mmapped file, or dirty some pages. Note 630This can be used to page in some mmapped file, or dirty some pages. Note
530that dirtying is an unlocked read-write access, so races can ensue when 631that dirtying is an unlocked read-write access, so races can ensue when
560 661
561 eio_custom (my_open, 0, my_open_done, "/etc/passwd"); 662 eio_custom (my_open, 0, my_open_done, "/etc/passwd");
562 663
563=item eio_busy (eio_tstamp delay, int pri, eio_cb cb, void *data) 664=item eio_busy (eio_tstamp delay, int pri, eio_cb cb, void *data)
564 665
565This is a a request that takes C<delay> seconds to execute, but otherwise 666This is a request that takes C<delay> seconds to execute, but otherwise
566does nothing - it simply puts one of the worker threads to sleep for this 667does nothing - it simply puts one of the worker threads to sleep for this
567long. 668long.
568 669
569This request can be used to artificially increase load, e.g. for debugging 670This request can be used to artificially increase load, e.g. for debugging
570or benchmarking reasons. 671or benchmarking reasons.
586There are two primary use cases for this: a) bundle many requests into a 687There are two primary use cases for this: a) bundle many requests into a
587single, composite, request with a definite callback and the ability to 688single, composite, request with a definite callback and the ability to
588cancel the whole request with its subrequests and b) limiting the number 689cancel the whole request with its subrequests and b) limiting the number
589of "active" requests. 690of "active" requests.
590 691
591Further below you will find more dicussion of these topics - first follows 692Further below you will find more discussion of these topics - first
592the reference section detailing the request generator and other methods. 693follows the reference section detailing the request generator and other
694methods.
593 695
594=over 4 696=over 4
595 697
596=item eio_grp (eio_cb cb, void *data) 698=item eio_req *grp = eio_grp (eio_cb cb, void *data)
597 699
598Creates and submits a group request. 700Creates, submits and returns a group request. Note that it doesn't have a
701priority, unlike all other requests.
599 702
600=back 703=item eio_grp_add (eio_req *grp, eio_req *req)
601 704
705Adds a request to the request group.
706
707=item eio_grp_cancel (eio_req *grp)
708
709Cancels all requests I<in> the group, but I<not> the group request
710itself. You can cancel the group request I<and> all subrequests via a
711normal C<eio_cancel> call.
712
713=back
714
715=head4 GROUP REQUEST LIFETIME
716
717Left alone, a group request will instantly move to the pending state and
718will be finished at the next call of C<eio_poll>.
719
720The usefulness stems from the fact that, if a subrequest is added to a
721group I<before> a call to C<eio_poll>, via C<eio_grp_add>, then the group
722will not finish until all the subrequests have finished.
723
724So the usage cycle of a group request is like this: after it is created,
725you normally instantly add a subrequest. If none is added, the group
726request will finish on it's own. As long as subrequests are added before
727the group request is finished it will be kept from finishing, that is the
728callbacks of any subrequests can, in turn, add more requests to the group,
729and as long as any requests are active, the group request itself will not
730finish.
731
732=head4 CREATING COMPOSITE REQUESTS
733
734Imagine you wanted to create an C<eio_load> request that opens a file,
735reads it and closes it. This means it has to execute at least three eio
736requests, but for various reasons it might be nice if that request looked
737like any other eio request.
738
739This can be done with groups:
740
741=over 4
742
743=item 1) create the request object
744
745Create a group that contains all further requests. This is the request you
746can return as "the load request".
747
748=item 2) open the file, maybe
749
750Next, open the file with C<eio_open> and add the request to the group
751request and you are finished setting up the request.
752
753If, for some reason, you cannot C<eio_open> (path is a null ptr?) you
754can set C<< grp->result >> to C<-1> to signal an error and let the group
755request finish on its own.
756
757=item 3) open callback adds more requests
758
759In the open callback, if the open was not successful, copy C<<
760req->errorno >> to C<< grp->errorno >> and set C<< grp->result >> to
761C<-1> to signal an error.
762
763Otherwise, malloc some memory or so and issue a read request, adding the
764read request to the group.
765
766=item 4) continue issuing requests till finished
767
768In the read callback, check for errors and possibly continue with
769C<eio_close> or any other eio request in the same way.
770
771As soon as no new requests are added, the group request will finish. Make
772sure you I<always> set C<< grp->result >> to some sensible value.
773
774=back
775
776=head4 REQUEST LIMITING
602 777
603 778
604#TODO 779#TODO
605 780
606/*****************************************************************************/
607/* groups */
608
609eio_req *eio_grp (eio_cb cb, void *data);
610void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit);
611void eio_grp_limit (eio_req *grp, int limit); 781void eio_grp_limit (eio_req *grp, int limit);
612void eio_grp_add (eio_req *grp, eio_req *req);
613void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */
614 782
615
616=back
617 783
618 784
619=head1 LOW LEVEL REQUEST API 785=head1 LOW LEVEL REQUEST API
620 786
621#TODO 787#TODO
624=head1 ANATOMY AND LIFETIME OF AN EIO REQUEST 790=head1 ANATOMY AND LIFETIME OF AN EIO REQUEST
625 791
626A request is represented by a structure of type C<eio_req>. To initialise 792A request is represented by a structure of type C<eio_req>. To initialise
627it, clear it to all zero bytes: 793it, clear it to all zero bytes:
628 794
629 eio_req req; 795 eio_req req;
630 796
631 memset (&req, 0, sizeof (req)); 797 memset (&req, 0, sizeof (req));
632 798
633A more common way to initialise a new C<eio_req> is to use C<calloc>: 799A more common way to initialise a new C<eio_req> is to use C<calloc>:
634 800
635 eio_req *req = calloc (1, sizeof (*req)); 801 eio_req *req = calloc (1, sizeof (*req));
636 802
637In either case, libeio neither allocates, initialises or frees the 803In either case, libeio neither allocates, initialises or frees the
638C<eio_req> structure for you - it merely uses it. 804C<eio_req> structure for you - it merely uses it.
639 805
640zero 806zero
658for example, in interactive programs, you might want to limit this time to 824for example, in interactive programs, you might want to limit this time to
659C<0.01> seconds or so. 825C<0.01> seconds or so.
660 826
661Note that: 827Note that:
662 828
829=over 4
830
663a) libeio doesn't know how long your request callbacks take, so the time 831=item a) libeio doesn't know how long your request callbacks take, so the
664spent in C<eio_poll> is up to one callback invocation longer then this 832time spent in C<eio_poll> is up to one callback invocation longer then
665interval. 833this interval.
666 834
667b) this is implemented by calling C<gettimeofday> after each request, 835=item b) this is implemented by calling C<gettimeofday> after each
668which can be costly. 836request, which can be costly.
669 837
670c) at least one request will be handled. 838=item c) at least one request will be handled.
839
840=back
671 841
672=item eio_set_max_poll_reqs (unsigned int nreqs) 842=item eio_set_max_poll_reqs (unsigned int nreqs)
673 843
674When C<nreqs> is non-zero, then C<eio_poll> will not handle more than 844When C<nreqs> is non-zero, then C<eio_poll> will not handle more than
675C<nreqs> requests per invocation. This is a less costly way to limit the 845C<nreqs> requests per invocation. This is a less costly way to limit the
745This symbol governs the stack size for each eio thread. Libeio itself 915This symbol governs the stack size for each eio thread. Libeio itself
746was written to use very little stackspace, but when using C<EIO_CUSTOM> 916was written to use very little stackspace, but when using C<EIO_CUSTOM>
747requests, you might want to increase this. 917requests, you might want to increase this.
748 918
749If this symbol is undefined (the default) then libeio will use its default 919If this symbol is undefined (the default) then libeio will use its default
750stack size (C<sizeof (long) * 4096> currently). If it is defined, but 920stack size (C<sizeof (void *) * 4096> currently). In all other cases, the
751C<0>, then the default operating system stack size will be used. In all
752other cases, the value must be an expression that evaluates to the desired 921value must be an expression that evaluates to the desired stack size.
753stack size.
754 922
755=back 923=back
756 924
757 925
758=head1 PORTABILITY REQUIREMENTS 926=head1 PORTABILITY REQUIREMENTS

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines