ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/libeio/eio.pod
(Generate patch)

Comparing libeio/eio.pod (file contents):
Revision 1.7 by root, Sun Jun 5 22:44:30 2011 UTC vs.
Revision 1.20 by sf-exg, Thu Jul 7 17:35:52 2011 UTC

45Unlike the name component C<stamp> might indicate, it is also used for 45Unlike the name component C<stamp> might indicate, it is also used for
46time differences throughout libeio. 46time differences throughout libeio.
47 47
48=head2 FORK SUPPORT 48=head2 FORK SUPPORT
49 49
50Calling C<fork ()> is fully supported by this module. It is implemented in these steps: 50Calling C<fork ()> is fully supported by this module - but you must not
51rely on this. It is currently implemented in these steps:
51 52
52 1. wait till all requests in "execute" state have been handled 53 1. wait till all requests in "execute" state have been handled
53 (basically requests that are already handed over to the kernel). 54 (basically requests that are already handed over to the kernel).
54 2. fork 55 2. fork
55 3. in the parent, continue business as usual, done 56 3. in the parent, continue business as usual, done
56 4. in the child, destroy all ready and pending requests and free the 57 4. in the child, destroy all ready and pending requests and free the
57 memory used by the worker threads. This gives you a fully empty 58 memory used by the worker threads. This gives you a fully empty
58 libeio queue. 59 libeio queue.
59 60
60Note, however, since libeio does use threads, thr above guarantee doesn't 61Note, however, since libeio does use threads, the above guarantee doesn't
61cover your libc, for example, malloc and other libc functions are not 62cover your libc, for example, malloc and other libc functions are not
62fork-safe, so there is very little you can do after a fork, and in fatc, 63fork-safe, so there is very little you can do after a fork, and in fact,
63the above might crash, and thus change. 64the above might crash, and thus change.
64 65
65=head1 INITIALISATION/INTEGRATION 66=head1 INITIALISATION/INTEGRATION
66 67
67Before you can call any eio functions you first have to initialise the 68Before you can call any eio functions you first have to initialise the
124=back 125=back
125 126
126For libev, you would typically use an C<ev_async> watcher: the 127For libev, you would typically use an C<ev_async> watcher: the
127C<want_poll> callback would invoke C<ev_async_send> to wake up the event 128C<want_poll> callback would invoke C<ev_async_send> to wake up the event
128loop. Inside the callback set for the watcher, one would call C<eio_poll 129loop. Inside the callback set for the watcher, one would call C<eio_poll
129()> (followed by C<ev_async_send> again if C<eio_poll> indicates that not 130()>.
130all requests have been handled yet). The race is taken care of because 131
131libev resets/rearms the async watcher before calling your callback, 132If C<eio_poll ()> is configured to not handle all results in one go
132and therefore, before calling C<eio_poll>. This might result in (some) 133(i.e. it returns C<-1>) then you should start an idle watcher that calls
133spurious wake-ups, but is generally harmless. 134C<eio_poll> until it returns something C<!= -1>.
135
136A full-featured connector between libeio and libev would look as follows
137(if C<eio_poll> is handling all requests, it can of course be simplified a
138lot by removing the idle watcher logic):
139
140 static struct ev_loop *loop;
141 static ev_idle repeat_watcher;
142 static ev_async ready_watcher;
143
144 /* idle watcher callback, only used when eio_poll */
145 /* didn't handle all results in one call */
146 static void
147 repeat (EV_P_ ev_idle *w, int revents)
148 {
149 if (eio_poll () != -1)
150 ev_idle_stop (EV_A_ w);
151 }
152
153 /* eio has some results, process them */
154 static void
155 ready (EV_P_ ev_async *w, int revents)
156 {
157 if (eio_poll () == -1)
158 ev_idle_start (EV_A_ &repeat_watcher);
159 }
160
161 /* wake up the event loop */
162 static void
163 want_poll (void)
164 {
165 ev_async_send (loop, &ready_watcher)
166 }
167
168 void
169 my_init_eio ()
170 {
171 loop = EV_DEFAULT;
172
173 ev_idle_init (&repeat_watcher, repeat);
174 ev_async_init (&ready_watcher, ready);
175 ev_async_start (loop &watcher);
176
177 eio_init (want_poll, 0);
178 }
134 179
135For most other event loops, you would typically use a pipe - the event 180For most other event loops, you would typically use a pipe - the event
136loop should be told to wait for read readiness on the read end. In 181loop should be told to wait for read readiness on the read end. In
137C<want_poll> you would write a single byte, in C<done_poll> you would try 182C<want_poll> you would write a single byte, in C<done_poll> you would try
138to read that byte, and in the callback for the read end, you would call 183to read that byte, and in the callback for the read end, you would call
139C<eio_poll>. The race is avoided here because the event loop should invoke
140your callback again and again until the byte has been read (as the pipe
141read callback does not read it, only C<done_poll>).
142
143=head2 CONFIGURATION
144
145The functions in this section can sometimes be useful, but the default
146configuration will do in most case, so you should skip this section on
147first reading.
148
149=over 4
150
151=item eio_set_max_poll_time (eio_tstamp nseconds)
152
153This causes C<eio_poll ()> to return after it has detected that it was
154running for C<nsecond> seconds or longer (this number can be fractional).
155
156This can be used to limit the amount of time spent handling eio requests,
157for example, in interactive programs, you might want to limit this time to
158C<0.01> seconds or so.
159
160Note that:
161
162a) libeio doesn't know how long your request callbacks take, so the time
163spent in C<eio_poll> is up to one callback invocation longer then this
164interval.
165
166b) this is implemented by calling C<gettimeofday> after each request,
167which can be costly.
168
169c) at least one request will be handled.
170
171=item eio_set_max_poll_reqs (unsigned int nreqs)
172
173When C<nreqs> is non-zero, then C<eio_poll> will not handle more than
174C<nreqs> requests per invocation. This is a less costly way to limit the
175amount of work done by C<eio_poll> then setting a time limit.
176
177If you know your callbacks are generally fast, you could use this to
178encourage interactiveness in your programs by setting it to C<10>, C<100>
179or even C<1000>.
180
181=item eio_set_min_parallel (unsigned int nthreads)
182
183Make sure libeio can handle at least this many requests in parallel. It
184might be able handle more.
185
186=item eio_set_max_parallel (unsigned int nthreads)
187
188Set the maximum number of threads that libeio will spawn.
189
190=item eio_set_max_idle (unsigned int nthreads)
191
192Libeio uses threads internally to handle most requests, and will start and stop threads on demand.
193
194This call can be used to limit the number of idle threads (threads without
195work to do): libeio will keep some threads idle in preparation for more
196requests, but never longer than C<nthreads> threads.
197
198In addition to this, libeio will also stop threads when they are idle for
199a few seconds, regardless of this setting.
200
201=item unsigned int eio_nthreads ()
202
203Return the number of worker threads currently running.
204
205=item unsigned int eio_nreqs ()
206
207Return the number of requests currently handled by libeio. This is the
208total number of requests that have been submitted to libeio, but not yet
209destroyed.
210
211=item unsigned int eio_nready ()
212
213Returns the number of ready requests, i.e. requests that have been
214submitted but have not yet entered the execution phase.
215
216=item unsigned int eio_npending ()
217
218Returns the number of pending requests, i.e. requests that have been
219executed and have results, but have not been finished yet by a call to
220C<eio_poll>). 184C<eio_poll>.
221 185
222=back 186You don't have to take special care in the case C<eio_poll> doesn't handle
187all requests, as the done callback will not be invoked, so the event loop
188will still signal readiness for the pipe until I<all> results have been
189processed.
223 190
224 191
225=head1 HIGH LEVEL REQUEST API 192=head1 HIGH LEVEL REQUEST API
226 193
227Libeio has both a high-level API, which consists of calling a request 194Libeio has both a high-level API, which consists of calling a request
234 201
235You submit a request by calling the relevant C<eio_TYPE> function with the 202You submit a request by calling the relevant C<eio_TYPE> function with the
236required parameters, a callback of type C<int (*eio_cb)(eio_req *req)> 203required parameters, a callback of type C<int (*eio_cb)(eio_req *req)>
237(called C<eio_cb> below) and a freely usable C<void *data> argument. 204(called C<eio_cb> below) and a freely usable C<void *data> argument.
238 205
239The return value will either be 0 206The return value will either be 0, in case something went really wrong
207(which can basically only happen on very fatal errors, such as C<malloc>
208returning 0, which is rather unlikely), or a pointer to the newly-created
209and submitted C<eio_req *>.
240 210
241The callback will be called with an C<eio_req *> which contains the 211The callback will be called with an C<eio_req *> which contains the
242results of the request. The members you can access inside that structure 212results of the request. The members you can access inside that structure
243vary from request to request, except for: 213vary from request to request, except for:
244 214
291 } 261 }
292 262
293 /* the first three arguments are passed to open(2) */ 263 /* the first three arguments are passed to open(2) */
294 /* the remaining are priority, callback and data */ 264 /* the remaining are priority, callback and data */
295 if (!eio_open ("/etc/passwd", O_RDONLY, 0, 0, file_open_done, 0)) 265 if (!eio_open ("/etc/passwd", O_RDONLY, 0, 0, file_open_done, 0))
296 abort (); /* something ent wrong, we will all die!!! */ 266 abort (); /* something went wrong, we will all die!!! */
297 267
298Note that you additionally need to call C<eio_poll> when the C<want_cb> 268Note that you additionally need to call C<eio_poll> when the C<want_cb>
299indicates that requests are ready to be processed. 269indicates that requests are ready to be processed.
270
271=head2 CANCELLING REQUESTS
272
273Sometimes the need for a request goes away before the request is
274finished. In that case, one can cancel the request by a call to
275C<eio_cancel>:
276
277=over 4
278
279=item eio_cancel (eio_req *req)
280
281Cancel the request (and all its subrequests). If the request is currently
282executing it might still continue to execute, and in other cases it might
283still take a while till the request is cancelled.
284
285Even if cancelled, the finish callback will still be invoked - the
286callbacks of all cancellable requests need to check whether the request
287has been cancelled by calling C<EIO_CANCELLED (req)>:
288
289 static int
290 my_eio_cb (eio_req *req)
291 {
292 if (EIO_CANCELLED (req))
293 return 0;
294 }
295
296In addition, cancelled requests will I<either> have C<< req->result >>
297set to C<-1> and C<errno> to C<ECANCELED>, or I<otherwise> they were
298successfully executed, despite being cancelled (e.g. when they have
299already been executed at the time they were cancelled).
300
301C<EIO_CANCELLED> is still true for requests that have successfully
302executed, as long as C<eio_cancel> was called on them at some point.
303
304=back
300 305
301=head2 AVAILABLE REQUESTS 306=head2 AVAILABLE REQUESTS
302 307
303The following request functions are available. I<All> of them return the 308The following request functions are available. I<All> of them return the
304C<eio_req *> on success and C<0> on failure, and I<all> of them have the 309C<eio_req *> on success and C<0> on failure, and I<all> of them have the
307custom data value as C<data>. 312custom data value as C<data>.
308 313
309=head3 POSIX API WRAPPERS 314=head3 POSIX API WRAPPERS
310 315
311These requests simply wrap the POSIX call of the same name, with the same 316These requests simply wrap the POSIX call of the same name, with the same
312arguments: 317arguments. If a function is not implemented by the OS and cannot be emulated
318in some way, then all of these return C<-1> and set C<errorno> to C<ENOSYS>.
313 319
314=over 4 320=over 4
315 321
316=item eio_open (const char *path, int flags, mode_t mode, int pri, eio_cb cb, void *data) 322=item eio_open (const char *path, int flags, mode_t mode, int pri, eio_cb cb, void *data)
317 323
324=item eio_truncate (const char *path, off_t offset, int pri, eio_cb cb, void *data)
325
326=item eio_chown (const char *path, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
327
328=item eio_chmod (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
329
330=item eio_mkdir (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
331
332=item eio_rmdir (const char *path, int pri, eio_cb cb, void *data)
333
334=item eio_unlink (const char *path, int pri, eio_cb cb, void *data)
335
318=item eio_utime (const char *path, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data) 336=item eio_utime (const char *path, eio_tstamp atime, eio_tstamp mtime, int pri, eio_cb cb, void *data)
319 337
320=item eio_truncate (const char *path, off_t offset, int pri, eio_cb cb, void *data)
321
322=item eio_chown (const char *path, uid_t uid, gid_t gid, int pri, eio_cb cb, void *data)
323
324=item eio_chmod (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
325
326=item eio_mkdir (const char *path, mode_t mode, int pri, eio_cb cb, void *data)
327
328=item eio_rmdir (const char *path, int pri, eio_cb cb, void *data)
329
330=item eio_unlink (const char *path, int pri, eio_cb cb, void *data)
331
332=item eio_readlink (const char *path, int pri, eio_cb cb, void *data) /* result=ptr2 allocated dynamically */
333
334=item eio_stat (const char *path, int pri, eio_cb cb, void *data) /* stat buffer=ptr2 allocated dynamically */
335
336=item eio_lstat (const char *path, int pri, eio_cb cb, void *data) /* stat buffer=ptr2 allocated dynamically */
337
338=item eio_statvfs (const char *path, int pri, eio_cb cb, void *data) /* stat buffer=ptr2 allocated dynamically */
339
340=item eio_mknod (const char *path, mode_t mode, dev_t dev, int pri, eio_cb cb, void *data) 338=item eio_mknod (const char *path, mode_t mode, dev_t dev, int pri, eio_cb cb, void *data)
341 339
342=item eio_link (const char *path, const char *new_path, int pri, eio_cb cb, void *data) 340=item eio_link (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
343 341
344=item eio_symlink (const char *path, const char *new_path, int pri, eio_cb cb, void *data) 342=item eio_symlink (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
345 343
346=item eio_rename (const char *path, const char *new_path, int pri, eio_cb cb, void *data) 344=item eio_rename (const char *path, const char *new_path, int pri, eio_cb cb, void *data)
347 345
348=item eio_msync (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
349
350=item eio_mlock (void *addr, size_t length, int pri, eio_cb cb, void *data) 346=item eio_mlock (void *addr, size_t length, int pri, eio_cb cb, void *data)
351
352=item eio_mlockall (int flags, int pri, eio_cb cb, void *data)
353 347
354=item eio_close (int fd, int pri, eio_cb cb, void *data) 348=item eio_close (int fd, int pri, eio_cb cb, void *data)
355 349
356=item eio_sync (int pri, eio_cb cb, void *data) 350=item eio_sync (int pri, eio_cb cb, void *data)
357 351
386 380
387Not surprisingly, pread and pwrite are not thread-safe on Darwin (OS/X), 381Not surprisingly, pread and pwrite are not thread-safe on Darwin (OS/X),
388so it is advised not to submit multiple requests on the same fd on this 382so it is advised not to submit multiple requests on the same fd on this
389horrible pile of garbage. 383horrible pile of garbage.
390 384
385=item eio_mlockall (int flags, int pri, eio_cb cb, void *data)
386
387Like C<mlockall>, but the flag value constants are called
388C<EIO_MCL_CURRENT> and C<EIO_MCL_FUTURE>.
389
390=item eio_msync (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
391
392Just like msync, except that the flag values are called C<EIO_MS_ASYNC>,
393C<EIO_MS_INVALIDATE> and C<EIO_MS_SYNC>.
394
395=item eio_readlink (const char *path, int pri, eio_cb cb, void *data)
396
397If successful, the path read by C<readlink(2)> can be accessed via C<<
398req->ptr2 >> and is I<NOT> null-terminated, with the length specified as
399C<< req->result >>.
400
401 if (req->result >= 0)
402 {
403 char *target = strndup ((char *)req->ptr2, req->result);
404
405 free (target);
406 }
407
408=item eio_realpath (const char *path, int pri, eio_cb cb, void *data)
409
410Similar to the realpath libc function, but unlike that one, result is
411C<-1> on failure and the length of the returned path in C<ptr2> (which is
412not 0-terminated) - this is similar to readlink.
413
414=item eio_stat (const char *path, int pri, eio_cb cb, void *data)
415
416=item eio_lstat (const char *path, int pri, eio_cb cb, void *data)
417
391=item eio_fstat (int fd, int pri, eio_cb cb, void *data) 418=item eio_fstat (int fd, int pri, eio_cb cb, void *data)
392 419
393Stats a file - if C<< req->result >> indicates success, then you can 420Stats a file - if C<< req->result >> indicates success, then you can
394access the C<struct stat>-like structure via C<< req->ptr2 >>: 421access the C<struct stat>-like structure via C<< req->ptr2 >>:
395 422
396 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2; 423 EIO_STRUCT_STAT *statdata = (EIO_STRUCT_STAT *)req->ptr2;
397 424
398=item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data) /* stat buffer=ptr2 allocated dynamically */ 425=item eio_statvfs (const char *path, int pri, eio_cb cb, void *data)
426
427=item eio_fstatvfs (int fd, int pri, eio_cb cb, void *data)
399 428
400Stats a filesystem - if C<< req->result >> indicates success, then you can 429Stats a filesystem - if C<< req->result >> indicates success, then you can
401access the C<struct statvfs>-like structure via C<< req->ptr2 >>: 430access the C<struct statvfs>-like structure via C<< req->ptr2 >>:
402 431
403 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2; 432 EIO_STRUCT_STATVFS *statdata = (EIO_STRUCT_STATVFS *)req->ptr2;
404 433
405=back 434=back
406 435
407=head3 READING DIRECTORIES 436=head3 READING DIRECTORIES
408 437
409Reading directories sounds simple, but can be rather demanding, especially 438Reading directories sounds simple, but can be rather demanding, especially
410if you want to do stuff such as traversing a diretcory hierarchy or 439if you want to do stuff such as traversing a directory hierarchy or
411processing all files in a directory. Libeio can assist thess complex tasks 440processing all files in a directory. Libeio can assist these complex tasks
412with it's C<eio_readdir> call. 441with it's C<eio_readdir> call.
413 442
414=over 4 443=over 4
415 444
416=item eio_readdir (const char *path, int flags, int pri, eio_cb cb, void *data) 445=item eio_readdir (const char *path, int flags, int pri, eio_cb cb, void *data)
419(via the C<opendir>, C<readdir> and C<closedir> calls) and returns either 448(via the C<opendir>, C<readdir> and C<closedir> calls) and returns either
420the names or an array of C<struct eio_dirent>, depending on the C<flags> 449the names or an array of C<struct eio_dirent>, depending on the C<flags>
421argument. 450argument.
422 451
423The C<< req->result >> indicates either the number of files found, or 452The C<< req->result >> indicates either the number of files found, or
424C<-1> on error. On success, zero-terminated names can be found as C<< req->ptr2 >>, 453C<-1> on error. On success, null-terminated names can be found as C<< req->ptr2 >>,
425and C<struct eio_dirents>, if requested by C<flags>, can be found via C<< 454and C<struct eio_dirents>, if requested by C<flags>, can be found via C<<
426req->ptr1 >>. 455req->ptr1 >>.
427 456
428Here is an example that prints all the names: 457Here is an example that prints all the names:
429 458
448 477
449If this flag is specified, then, in addition to the names in C<ptr2>, 478If this flag is specified, then, in addition to the names in C<ptr2>,
450also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct 479also an array of C<struct eio_dirent> is returned, in C<ptr1>. A C<struct
451eio_dirent> looks like this: 480eio_dirent> looks like this:
452 481
453 struct eio_dirent 482 struct eio_dirent
454 { 483 {
455 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */ 484 int nameofs; /* offset of null-terminated name string in (char *)req->ptr2 */
456 unsigned short namelen; /* size of filename without trailing 0 */ 485 unsigned short namelen; /* size of filename without trailing 0 */
457 unsigned char type; /* one of EIO_DT_* */ 486 unsigned char type; /* one of EIO_DT_* */
458 signed char score; /* internal use */ 487 signed char score; /* internal use */
459 ino_t inode; /* the inode number, if available, otherwise unspecified */ 488 ino_t inode; /* the inode number, if available, otherwise unspecified */
460 }; 489 };
461 490
462The only members you normally would access are C<nameofs>, which is the 491The only members you normally would access are C<nameofs>, which is the
463byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>. 492byte-offset from C<ptr2> to the start of the name, C<namelen> and C<type>.
464 493
465C<type> can be one of: 494C<type> can be one of:
508When this flag is specified, then the names will be returned in an order 537When this flag is specified, then the names will be returned in an order
509suitable for stat()'ing each one. That is, when you plan to stat() 538suitable for stat()'ing each one. That is, when you plan to stat()
510all files in the given directory, then the returned order will likely 539all files in the given directory, then the returned order will likely
511be fastest. 540be fastest.
512 541
513If both this flag and C<EIO_READDIR_DIRS_FIRST> are specified, then 542If both this flag and C<EIO_READDIR_DIRS_FIRST> are specified, then the
514the likely dirs come first, resulting in a less optimal stat order. 543likely directories come first, resulting in a less optimal stat order.
515 544
516=item EIO_READDIR_FOUND_UNKNOWN 545=item EIO_READDIR_FOUND_UNKNOWN
517 546
518This flag should not be specified when calling C<eio_readdir>. Instead, 547This flag should not be specified when calling C<eio_readdir>. Instead,
519it is being set by C<eio_readdir> (you can access the C<flags> via C<< 548it is being set by C<eio_readdir> (you can access the C<flags> via C<<
520req->int1 >>, when any of the C<type>'s found were C<EIO_DT_UNKNOWN>. The 549req->int1 >>, when any of the C<type>'s found were C<EIO_DT_UNKNOWN>. The
521absense of this flag therefore indicates that all C<type>'s are known, 550absence of this flag therefore indicates that all C<type>'s are known,
522which can be used to speed up some algorithms. 551which can be used to speed up some algorithms.
523 552
524A typical use case would be to identify all subdirectories within a 553A typical use case would be to identify all subdirectories within a
525directory - you would ask C<eio_readdir> for C<EIO_READDIR_DIRS_FIRST>. If 554directory - you would ask C<eio_readdir> for C<EIO_READDIR_DIRS_FIRST>. If
526then this flag is I<NOT> set, then all the entries at the beginning of the 555then this flag is I<NOT> set, then all the entries at the beginning of the
561=item eio_sync_file_range (int fd, off_t offset, size_t nbytes, unsigned int flags, int pri, eio_cb cb, void *data) 590=item eio_sync_file_range (int fd, off_t offset, size_t nbytes, unsigned int flags, int pri, eio_cb cb, void *data)
562 591
563Calls C<sync_file_range>. If the syscall is missing, then this is the same 592Calls C<sync_file_range>. If the syscall is missing, then this is the same
564as calling C<fdatasync>. 593as calling C<fdatasync>.
565 594
595Flags can be any combination of C<EIO_SYNC_FILE_RANGE_WAIT_BEFORE>,
596C<EIO_SYNC_FILE_RANGE_WRITE> and C<EIO_SYNC_FILE_RANGE_WAIT_AFTER>.
597
566=back 598=back
567 599
568=head3 LIBEIO-SPECIFIC REQUESTS 600=head3 LIBEIO-SPECIFIC REQUESTS
569 601
570These requests are specific to libeio and do not correspond to any OS call. 602These requests are specific to libeio and do not correspond to any OS call.
571 603
572=over 4 604=over 4
573 605
574=item eio_mtouch (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data) 606=item eio_mtouch (void *addr, size_t length, int flags, int pri, eio_cb cb, void *data)
575 607
608Reads (C<flags == 0>) or modifies (C<flags == EIO_MT_MODIFY) the given
609memory area, page-wise, that is, it reads (or reads and writes back) the
610first octet of every page that spans the memory area.
611
612This can be used to page in some mmapped file, or dirty some pages. Note
613that dirtying is an unlocked read-write access, so races can ensue when
614the some other thread modifies the data stored in that memory area.
615
576=item eio_custom (void (*)(eio_req *) execute, int pri, eio_cb cb, void *data) 616=item eio_custom (void (*)(eio_req *) execute, int pri, eio_cb cb, void *data)
577 617
578Executes a custom request, i.e., a user-specified callback. 618Executes a custom request, i.e., a user-specified callback.
579 619
580The callback gets the C<eio_req *> as parameter and is expected to read 620The callback gets the C<eio_req *> as parameter and is expected to read
581and modify any request-specific members. Specifically, it should set C<< 621and modify any request-specific members. Specifically, it should set C<<
601 req->result = open (req->data, O_RDONLY); 641 req->result = open (req->data, O_RDONLY);
602 } 642 }
603 643
604 eio_custom (my_open, 0, my_open_done, "/etc/passwd"); 644 eio_custom (my_open, 0, my_open_done, "/etc/passwd");
605 645
606=item eio_busy (eio_tstamp delay, int pri, eio_cb cb, void *data) 646=item eio_busy (eio_tstamp delay, int pri, eio_cb cb, void *data)
607 647
608This is a a request that takes C<delay> seconds to execute, but otherwise 648This is a request that takes C<delay> seconds to execute, but otherwise
609does nothing - it simply puts one of the worker threads to sleep for this 649does nothing - it simply puts one of the worker threads to sleep for this
610long. 650long.
611 651
612This request can be used to artificially increase load, e.g. for debugging 652This request can be used to artificially increase load, e.g. for debugging
613or benchmarking reasons. 653or benchmarking reasons.
614 654
615=item eio_nop (int pri, eio_cb cb, void *data) 655=item eio_nop (int pri, eio_cb cb, void *data)
616 656
617This request does nothing, except go through the whole request cycle. This 657This request does nothing, except go through the whole request cycle. This
618can be used to measure latency or in some cases to simplify code, but is 658can be used to measure latency or in some cases to simplify code, but is
619not really of much use. 659not really of much use.
620 660
621=back 661=back
622 662
623=head3 GROUPING AND LIMITING REQUESTS 663=head3 GROUPING AND LIMITING REQUESTS
624 664
665There is one more rather special request, C<eio_grp>. It is a very special
666aio request: Instead of doing something, it is a container for other eio
667requests.
668
669There are two primary use cases for this: a) bundle many requests into a
670single, composite, request with a definite callback and the ability to
671cancel the whole request with its subrequests and b) limiting the number
672of "active" requests.
673
674Further below you will find more discussion of these topics - first
675follows the reference section detailing the request generator and other
676methods.
677
678=over 4
679
680=item eio_req *grp = eio_grp (eio_cb cb, void *data)
681
682Creates, submits and returns a group request.
683
684=item eio_grp_add (eio_req *grp, eio_req *req)
685
686Adds a request to the request group.
687
688=item eio_grp_cancel (eio_req *grp)
689
690Cancels all requests I<in> the group, but I<not> the group request
691itself. You can cancel the group request via a normal C<eio_cancel> call.
692
693
694
695=back
696
697
698
625#TODO 699#TODO
626 700
627/*****************************************************************************/ 701/*****************************************************************************/
628/* groups */ 702/* groups */
629 703
630eio_req *eio_grp (eio_cb cb, void *data); 704eio_req *eio_grp (eio_cb cb, void *data);
631void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit); 705void eio_grp_feed (eio_req *grp, void (*feed)(eio_req *req), int limit);
632void eio_grp_limit (eio_req *grp, int limit); 706void eio_grp_limit (eio_req *grp, int limit);
633void eio_grp_add (eio_req *grp, eio_req *req);
634void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */ 707void eio_grp_cancel (eio_req *grp); /* cancels all sub requests but not the group */
635 708
636 709
637=back 710=back
638 711
645=head1 ANATOMY AND LIFETIME OF AN EIO REQUEST 718=head1 ANATOMY AND LIFETIME OF AN EIO REQUEST
646 719
647A request is represented by a structure of type C<eio_req>. To initialise 720A request is represented by a structure of type C<eio_req>. To initialise
648it, clear it to all zero bytes: 721it, clear it to all zero bytes:
649 722
650 eio_req req; 723 eio_req req;
651 724
652 memset (&req, 0, sizeof (req)); 725 memset (&req, 0, sizeof (req));
653 726
654A more common way to initialise a new C<eio_req> is to use C<calloc>: 727A more common way to initialise a new C<eio_req> is to use C<calloc>:
655 728
656 eio_req *req = calloc (1, sizeof (*req)); 729 eio_req *req = calloc (1, sizeof (*req));
657 730
658In either case, libeio neither allocates, initialises or frees the 731In either case, libeio neither allocates, initialises or frees the
659C<eio_req> structure for you - it merely uses it. 732C<eio_req> structure for you - it merely uses it.
660 733
661zero 734zero
662 735
663#TODO 736#TODO
737
738=head2 CONFIGURATION
739
740The functions in this section can sometimes be useful, but the default
741configuration will do in most case, so you should skip this section on
742first reading.
743
744=over 4
745
746=item eio_set_max_poll_time (eio_tstamp nseconds)
747
748This causes C<eio_poll ()> to return after it has detected that it was
749running for C<nsecond> seconds or longer (this number can be fractional).
750
751This can be used to limit the amount of time spent handling eio requests,
752for example, in interactive programs, you might want to limit this time to
753C<0.01> seconds or so.
754
755Note that:
756
757=over 4
758
759=item a) libeio doesn't know how long your request callbacks take, so the
760time spent in C<eio_poll> is up to one callback invocation longer then
761this interval.
762
763=item b) this is implemented by calling C<gettimeofday> after each
764request, which can be costly.
765
766=item c) at least one request will be handled.
767
768=back
769
770=item eio_set_max_poll_reqs (unsigned int nreqs)
771
772When C<nreqs> is non-zero, then C<eio_poll> will not handle more than
773C<nreqs> requests per invocation. This is a less costly way to limit the
774amount of work done by C<eio_poll> then setting a time limit.
775
776If you know your callbacks are generally fast, you could use this to
777encourage interactiveness in your programs by setting it to C<10>, C<100>
778or even C<1000>.
779
780=item eio_set_min_parallel (unsigned int nthreads)
781
782Make sure libeio can handle at least this many requests in parallel. It
783might be able handle more.
784
785=item eio_set_max_parallel (unsigned int nthreads)
786
787Set the maximum number of threads that libeio will spawn.
788
789=item eio_set_max_idle (unsigned int nthreads)
790
791Libeio uses threads internally to handle most requests, and will start and stop threads on demand.
792
793This call can be used to limit the number of idle threads (threads without
794work to do): libeio will keep some threads idle in preparation for more
795requests, but never longer than C<nthreads> threads.
796
797In addition to this, libeio will also stop threads when they are idle for
798a few seconds, regardless of this setting.
799
800=item unsigned int eio_nthreads ()
801
802Return the number of worker threads currently running.
803
804=item unsigned int eio_nreqs ()
805
806Return the number of requests currently handled by libeio. This is the
807total number of requests that have been submitted to libeio, but not yet
808destroyed.
809
810=item unsigned int eio_nready ()
811
812Returns the number of ready requests, i.e. requests that have been
813submitted but have not yet entered the execution phase.
814
815=item unsigned int eio_npending ()
816
817Returns the number of pending requests, i.e. requests that have been
818executed and have results, but have not been finished yet by a call to
819C<eio_poll>).
820
821=back
664 822
665=head1 EMBEDDING 823=head1 EMBEDDING
666 824
667Libeio can be embedded directly into programs. This functionality is not 825Libeio can be embedded directly into programs. This functionality is not
668documented and not (yet) officially supported. 826documented and not (yet) officially supported.

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines