ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/IO-AIO/README
(Generate patch)

Comparing IO-AIO/README (file contents):
Revision 1.25 by root, Mon Sep 24 19:28:50 2007 UTC vs.
Revision 1.33 by root, Sun Oct 12 22:40:52 2008 UTC

24 $req->cancel; # cancel request if still in queue 24 $req->cancel; # cancel request if still in queue
25 25
26 my $grp = aio_group sub { print "all stats done\n" }; 26 my $grp = aio_group sub { print "all stats done\n" };
27 add $grp aio_stat "..." for ...; 27 add $grp aio_stat "..." for ...;
28 28
29 # AnyEvent integration (EV, Event, Glib, Tk, POE, urxvt, pureperl...)
30 use AnyEvent::AIO;
31
29 # AnyEvent integration 32 # EV integration
30 open my $fh, "<&=" . IO::AIO::poll_fileno or die "$!"; 33 my $w = EV::io IO::AIO::poll_fileno, EV::READ, \&IO::AIO::poll_cb;
31 my $w = AnyEvent->io (fh => $fh, poll => 'r', cb => sub { IO::AIO::poll_cb });
32 34
33 # Event integration 35 # Event integration
34 Event->io (fd => IO::AIO::poll_fileno, 36 Event->io (fd => IO::AIO::poll_fileno,
35 poll => 'r', 37 poll => 'r',
36 cb => \&IO::AIO::poll_cb); 38 cb => \&IO::AIO::poll_cb);
173 All the "aio_*" calls are more or less thin wrappers around the syscall 175 All the "aio_*" calls are more or less thin wrappers around the syscall
174 with the same name (sans "aio_"). The arguments are similar or 176 with the same name (sans "aio_"). The arguments are similar or
175 identical, and they all accept an additional (and optional) $callback 177 identical, and they all accept an additional (and optional) $callback
176 argument which must be a code reference. This code reference will get 178 argument which must be a code reference. This code reference will get
177 called with the syscall return code (e.g. most syscalls return -1 on 179 called with the syscall return code (e.g. most syscalls return -1 on
178 error, unlike perl, which usually delivers "false") as it's sole 180 error, unlike perl, which usually delivers "false") as its sole argument
179 argument when the given syscall has been executed asynchronously. 181 after the given syscall has been executed asynchronously.
180 182
181 All functions expecting a filehandle keep a copy of the filehandle 183 All functions expecting a filehandle keep a copy of the filehandle
182 internally until the request has finished. 184 internally until the request has finished.
183 185
184 All functions return request objects of type IO::AIO::REQ that allow 186 All functions return request objects of type IO::AIO::REQ that allow
197 the user environment, d) use Glib::filename_from_unicode on unicode 199 the user environment, d) use Glib::filename_from_unicode on unicode
198 filenames or e) use something else to ensure your scalar has the correct 200 filenames or e) use something else to ensure your scalar has the correct
199 contents. 201 contents.
200 202
201 This works, btw. independent of the internal UTF-8 bit, which IO::AIO 203 This works, btw. independent of the internal UTF-8 bit, which IO::AIO
202 handles correctly wether it is set or not. 204 handles correctly whether it is set or not.
203 205
204 $prev_pri = aioreq_pri [$pri] 206 $prev_pri = aioreq_pri [$pri]
205 Returns the priority value that would be used for the next request 207 Returns the priority value that would be used for the next request
206 and, if $pri is given, sets the priority for the next aio request. 208 and, if $pri is given, sets the priority for the next aio request.
207 209
258 } 260 }
259 }; 261 };
260 262
261 aio_close $fh, $callback->($status) 263 aio_close $fh, $callback->($status)
262 Asynchronously close a file and call the callback with the result 264 Asynchronously close a file and call the callback with the result
263 code. *WARNING:* although accepted, you should not pass in a perl 265 code.
264 filehandle here, as perl will likely close the file descriptor
265 another time when the filehandle is destroyed. Normally, you can
266 safely call perls "close" or just let filehandles go out of scope.
267 266
268 This is supposed to be a bug in the API, so that might change. It's 267 Unfortunately, you can't do this to perl. Perl *insists* very
269 therefore best to avoid this function. 268 strongly on closing the file descriptor associated with the
269 filehandle itself.
270
271 Therefore, "aio_close" will not close the filehandle - instead it
272 will use dup2 to overwrite the file descriptor with the write-end of
273 a pipe (the pipe fd will be created on demand and will be cached).
274
275 Or in other words: the file descriptor will be closed, but it will
276 not be free for reuse until the perl filehandle is closed.
270 277
271 aio_read $fh,$offset,$length, $data,$dataoffset, $callback->($retval) 278 aio_read $fh,$offset,$length, $data,$dataoffset, $callback->($retval)
272 aio_write $fh,$offset,$length, $data,$dataoffset, $callback->($retval) 279 aio_write $fh,$offset,$length, $data,$dataoffset, $callback->($retval)
273 Reads or writes $length bytes from the specified $fh and $offset 280 Reads or writes $length bytes from the specified $fh and $offset
274 into the scalar given by $data and offset $dataoffset and calls the 281 into the scalar given by $data and offset $dataoffset and calls the
444 aio_copy $srcpath, $dstpath, $callback->($status) 451 aio_copy $srcpath, $dstpath, $callback->($status)
445 Try to copy the *file* (directories not supported as either source 452 Try to copy the *file* (directories not supported as either source
446 or destination) from $srcpath to $dstpath and call the callback with 453 or destination) from $srcpath to $dstpath and call the callback with
447 the 0 (error) or -1 ok. 454 the 0 (error) or -1 ok.
448 455
449 This is a composite request that it creates the destination file 456 This is a composite request that creates the destination file with
450 with mode 0200 and copies the contents of the source file into it 457 mode 0200 and copies the contents of the source file into it using
451 using "aio_sendfile", followed by restoring atime, mtime, access 458 "aio_sendfile", followed by restoring atime, mtime, access mode and
452 mode and uid/gid, in that order. 459 uid/gid, in that order.
453 460
454 If an error occurs, the partial destination file will be unlinked, 461 If an error occurs, the partial destination file will be unlinked,
455 if possible, except when setting atime, mtime, access mode and 462 if possible, except when setting atime, mtime, access mode and
456 uid/gid, where errors are being ignored. 463 uid/gid, where errors are being ignored.
457 464
458 aio_move $srcpath, $dstpath, $callback->($status) 465 aio_move $srcpath, $dstpath, $callback->($status)
459 Try to move the *file* (directories not supported as either source 466 Try to move the *file* (directories not supported as either source
460 or destination) from $srcpath to $dstpath and call the callback with 467 or destination) from $srcpath to $dstpath and call the callback with
461 the 0 (error) or -1 ok. 468 the 0 (error) or -1 ok.
462 469
463 This is a composite request that tries to rename(2) the file first. 470 This is a composite request that tries to rename(2) the file first;
464 If rename files with "EXDEV", it copies the file with "aio_copy" 471 if rename fails with "EXDEV", it copies the file with "aio_copy"
465 and, if that is successful, unlinking the $srcpath. 472 and, if that is successful, unlinks the $srcpath.
466 473
467 aio_scandir $path, $maxreq, $callback->($dirs, $nondirs) 474 aio_scandir $path, $maxreq, $callback->($dirs, $nondirs)
468 Scans a directory (similar to "aio_readdir") but additionally tries 475 Scans a directory (similar to "aio_readdir") but additionally tries
469 to efficiently separate the entries of directory $path into two sets 476 to efficiently separate the entries of directory $path into two sets
470 of names, directories you can recurse into (directories), and ones 477 of names, directories you can recurse into (directories), and ones
521 Delete a directory tree starting (and including) $path, return the 528 Delete a directory tree starting (and including) $path, return the
522 status of the final "rmdir" only. This is a composite request that 529 status of the final "rmdir" only. This is a composite request that
523 uses "aio_scandir" to recurse into and rmdir directories, and unlink 530 uses "aio_scandir" to recurse into and rmdir directories, and unlink
524 everything else. 531 everything else.
525 532
533 aio_sync $callback->($status)
534 Asynchronously call sync and call the callback when finished.
535
526 aio_fsync $fh, $callback->($status) 536 aio_fsync $fh, $callback->($status)
527 Asynchronously call fsync on the given filehandle and call the 537 Asynchronously call fsync on the given filehandle and call the
528 callback with the fsync result code. 538 callback with the fsync result code.
529 539
530 aio_fdatasync $fh, $callback->($status) 540 aio_fdatasync $fh, $callback->($status)
531 Asynchronously call fdatasync on the given filehandle and call the 541 Asynchronously call fdatasync on the given filehandle and call the
532 callback with the fdatasync result code. 542 callback with the fdatasync result code.
533 543
534 If this call isn't available because your OS lacks it or it couldn't 544 If this call isn't available because your OS lacks it or it couldn't
535 be detected, it will be emulated by calling "fsync" instead. 545 be detected, it will be emulated by calling "fsync" instead.
546
547 aio_pathsync $path, $callback->($status)
548 This request tries to open, fsync and close the given path. This is
549 a composite request intended to sync directories after directory
550 operations (E.g. rename). This might not work on all operating
551 systems or have any specific effect, but usually it makes sure that
552 directory changes get written to disc. It works for anything that
553 can be opened for read-only, not just directories.
554
555 Passes 0 when everything went ok, and -1 on error.
536 556
537 aio_group $callback->(...) 557 aio_group $callback->(...)
538 This is a very special aio request: Instead of doing something, it 558 This is a very special aio request: Instead of doing something, it
539 is a container for other aio requests, which is useful if you want 559 is a container for other aio requests, which is useful if you want
540 to bundle many requests into a single, composite, request with a 560 to bundle many requests into a single, composite, request with a
622 }; 642 };
623 643
624 This makes it very easy to create composite requests (see the source of 644 This makes it very easy to create composite requests (see the source of
625 "aio_move" for an application) that work and feel like simple requests. 645 "aio_move" for an application) that work and feel like simple requests.
626 646
627 * The IO::AIO::GRP objects will be cleaned up during calls to 647 * The IO::AIO::GRP objects will be cleaned up during calls to
628 "IO::AIO::poll_cb", just like any other request. 648 "IO::AIO::poll_cb", just like any other request.
649
629 * They can be canceled like any other request. Canceling will cancel not 650 * They can be canceled like any other request. Canceling will cancel
630 only the request itself, but also all requests it contains. 651 not only the request itself, but also all requests it contains.
652
631 * They can also can also be added to other IO::AIO::GRP objects. 653 * They can also can also be added to other IO::AIO::GRP objects.
654
632 * You must not add requests to a group from within the group callback 655 * You must not add requests to a group from within the group callback
633 (or any later time). 656 (or any later time).
634 657
635 Their lifetime, simplified, looks like this: when they are empty, they 658 Their lifetime, simplified, looks like this: when they are empty, they
636 will finish very quickly. If they contain only requests that are in the 659 will finish very quickly. If they contain only requests that are in the
637 "done" state, they will also finish. Otherwise they will continue to 660 "done" state, they will also finish. Otherwise they will continue to
638 exist. 661 exist.
639 662
640 That means after creating a group you have some time to add requests. 663 That means after creating a group you have some time to add requests
641 And in the callbacks of those requests, you can add further requests to 664 (precisely before the callback has been invoked, which is only done
642 the group. And only when all those requests have finished will the the 665 within the "poll_cb"). And in the callbacks of those requests, you can
643 group itself finish. 666 add further requests to the group. And only when all those requests have
667 finished will the the group itself finish.
644 668
645 add $grp ... 669 add $grp ...
646 $grp->add (...) 670 $grp->add (...)
647 Add one or more requests to the group. Any type of IO::AIO::REQ can 671 Add one or more requests to the group. Any type of IO::AIO::REQ can
648 be added, including other groups, as long as you do not create 672 be added, including other groups, as long as you do not create
655 request itself. Useful when you queued a lot of events but got a 679 request itself. Useful when you queued a lot of events but got a
656 result early. 680 result early.
657 681
658 $grp->result (...) 682 $grp->result (...)
659 Set the result value(s) that will be passed to the group callback 683 Set the result value(s) that will be passed to the group callback
660 when all subrequests have finished and set thre groups errno to the 684 when all subrequests have finished and set the groups errno to the
661 current value of errno (just like calling "errno" without an error 685 current value of errno (just like calling "errno" without an error
662 number). By default, no argument will be passed and errno is zero. 686 number). By default, no argument will be passed and errno is zero.
663 687
664 $grp->errno ([$errno]) 688 $grp->errno ([$errno])
665 Sets the group errno value to $errno, or the current value of errno 689 Sets the group errno value to $errno, or the current value of errno
691 does not impose any limits). 715 does not impose any limits).
692 716
693 If the feed does not queue more requests when called, it will be 717 If the feed does not queue more requests when called, it will be
694 automatically removed from the group. 718 automatically removed from the group.
695 719
696 If the feed limit is 0, it will be set to 2 automatically. 720 If the feed limit is 0 when this method is called, it will be set to
721 2 automatically.
697 722
698 Example: 723 Example:
699 724
700 # stat all files in @files, but only ever use four aio requests concurrently: 725 # stat all files in @files, but only ever use four aio requests concurrently:
701 726
711 limit $grp $num 736 limit $grp $num
712 Sets the feeder limit for the group: The feeder will be called 737 Sets the feeder limit for the group: The feeder will be called
713 whenever the group contains less than this many requests. 738 whenever the group contains less than this many requests.
714 739
715 Setting the limit to 0 will pause the feeding process. 740 Setting the limit to 0 will pause the feeding process.
741
742 The default value for the limit is 0, but note that setting a feeder
743 automatically bumps it up to 2.
716 744
717 SUPPORT FUNCTIONS 745 SUPPORT FUNCTIONS
718 EVENT PROCESSING AND EVENT LOOP INTEGRATION 746 EVENT PROCESSING AND EVENT LOOP INTEGRATION
719 $fileno = IO::AIO::poll_fileno 747 $fileno = IO::AIO::poll_fileno
720 Return the *request result pipe file descriptor*. This filehandle 748 Return the *request result pipe file descriptor*. This filehandle
724 752
725 See "poll_cb" for an example. 753 See "poll_cb" for an example.
726 754
727 IO::AIO::poll_cb 755 IO::AIO::poll_cb
728 Process some outstanding events on the result pipe. You have to call 756 Process some outstanding events on the result pipe. You have to call
729 this regularly. Returns the number of events processed. Returns 757 this regularly. Returns 0 if all events could be processed, or -1 if
730 immediately when no events are outstanding. The amount of events 758 it returned earlier for whatever reason. Returns immediately when no
759 events are outstanding. The amount of events processed depends on
731 processed depends on the settings of "IO::AIO::max_poll_req" and 760 the settings of "IO::AIO::max_poll_req" and
732 "IO::AIO::max_poll_time". 761 "IO::AIO::max_poll_time".
733 762
734 If not all requests were processed for whatever reason, the 763 If not all requests were processed for whatever reason, the
735 filehandle will still be ready when "poll_cb" returns. 764 filehandle will still be ready when "poll_cb" returns, so normally
765 you don't have to do anything special to have it called later.
736 766
737 Example: Install an Event watcher that automatically calls 767 Example: Install an Event watcher that automatically calls
738 IO::AIO::poll_cb with high priority: 768 IO::AIO::poll_cb with high priority:
739 769
740 Event->io (fd => IO::AIO::poll_fileno, 770 Event->io (fd => IO::AIO::poll_fileno,
846 876
847 The default is probably ok in most situations, especially if thread 877 The default is probably ok in most situations, especially if thread
848 creation is fast. If thread creation is very slow on your system you 878 creation is fast. If thread creation is very slow on your system you
849 might want to use larger values. 879 might want to use larger values.
850 880
851 $oldmaxreqs = IO::AIO::max_outstanding $maxreqs 881 IO::AIO::max_outstanding $maxreqs
852 This is a very bad function to use in interactive programs because 882 This is a very bad function to use in interactive programs because
853 it blocks, and a bad way to reduce concurrency because it is 883 it blocks, and a bad way to reduce concurrency because it is
854 inexact: Better use an "aio_group" together with a feed callback. 884 inexact: Better use an "aio_group" together with a feed callback.
855 885
856 Sets the maximum number of outstanding requests to $nreqs. If you do 886 Sets the maximum number of outstanding requests to $nreqs. If you do
860 890
861 The default value is very large, so there is no practical limit on 891 The default value is very large, so there is no practical limit on
862 the number of outstanding requests. 892 the number of outstanding requests.
863 893
864 You can still queue as many requests as you want. Therefore, 894 You can still queue as many requests as you want. Therefore,
865 "max_oustsanding" is mainly useful in simple scripts (with low 895 "max_outstanding" is mainly useful in simple scripts (with low
866 values) or as a stop gap to shield against fatal memory overflow 896 values) or as a stop gap to shield against fatal memory overflow
867 (with large values). 897 (with large values).
868 898
869 STATISTICAL INFORMATION 899 STATISTICAL INFORMATION
870 IO::AIO::nreqs 900 IO::AIO::nreqs
920 950
921KNOWN BUGS 951KNOWN BUGS
922 Known bugs will be fixed in the next release. 952 Known bugs will be fixed in the next release.
923 953
924SEE ALSO 954SEE ALSO
925 Coro::AIO. 955 AnyEvent::AIO for easy integration into event loops, Coro::AIO for a
956 more natural syntax.
926 957
927AUTHOR 958AUTHOR
928 Marc Lehmann <schmorp@schmorp.de> 959 Marc Lehmann <schmorp@schmorp.de>
929 http://home.schmorp.de/ 960 http://home.schmorp.de/
930 961

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines