ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/IO-AIO/AIO.pm
(Generate patch)

Comparing IO-AIO/AIO.pm (file contents):
Revision 1.156 by root, Tue Jun 16 23:41:59 2009 UTC vs.
Revision 1.173 by root, Thu Jan 7 20:25:57 2010 UTC

186 186
187package IO::AIO; 187package IO::AIO;
188 188
189use Carp (); 189use Carp ();
190 190
191no warnings; 191use common::sense;
192use strict 'vars';
193 192
194use base 'Exporter'; 193use base 'Exporter';
195 194
196BEGIN { 195BEGIN {
197 our $VERSION = '3.23'; 196 our $VERSION = '3.5';
198 197
199 our @AIO_REQ = qw(aio_sendfile aio_read aio_write aio_open aio_close 198 our @AIO_REQ = qw(aio_sendfile aio_read aio_write aio_open aio_close
200 aio_stat aio_lstat aio_unlink aio_rmdir aio_readdir aio_readdirx 199 aio_stat aio_lstat aio_unlink aio_rmdir aio_readdir aio_readdirx
201 aio_scandir aio_symlink aio_readlink aio_sync aio_fsync 200 aio_scandir aio_symlink aio_readlink aio_sync aio_fsync
202 aio_fdatasync aio_sync_file_range aio_pathsync aio_readahead 201 aio_fdatasync aio_sync_file_range aio_pathsync aio_readahead
203 aio_rename aio_link aio_move aio_copy aio_group 202 aio_rename aio_link aio_move aio_copy aio_group
204 aio_nop aio_mknod aio_load aio_rmtree aio_mkdir aio_chown 203 aio_nop aio_mknod aio_load aio_rmtree aio_mkdir aio_chown
205 aio_chmod aio_utime aio_truncate); 204 aio_chmod aio_utime aio_truncate
205 aio_msync aio_mtouch aio_statvfs);
206 206
207 our @EXPORT = (@AIO_REQ, qw(aioreq_pri aioreq_nice)); 207 our @EXPORT = (@AIO_REQ, qw(aioreq_pri aioreq_nice));
208 our @EXPORT_OK = qw(poll_fileno poll_cb poll_wait flush 208 our @EXPORT_OK = qw(poll_fileno poll_cb poll_wait flush
209 min_parallel max_parallel max_idle 209 min_parallel max_parallel max_idle
210 nreqs nready npending nthreads 210 nreqs nready npending nthreads
211 max_poll_time max_poll_reqs); 211 max_poll_time max_poll_reqs
212 sendfile fadvise);
212 213
213 push @AIO_REQ, qw(aio_busy); # not exported 214 push @AIO_REQ, qw(aio_busy); # not exported
214 215
215 @IO::AIO::GRP::ISA = 'IO::AIO::REQ'; 216 @IO::AIO::GRP::ISA = 'IO::AIO::REQ';
216 217
380 381
381This call tries to make use of a native C<sendfile> syscall to provide 382This call tries to make use of a native C<sendfile> syscall to provide
382zero-copy operation. For this to work, C<$out_fh> should refer to a 383zero-copy operation. For this to work, C<$out_fh> should refer to a
383socket, and C<$in_fh> should refer to mmap'able file. 384socket, and C<$in_fh> should refer to mmap'able file.
384 385
385If the native sendfile call fails or is not implemented, it will be 386If a native sendfile cannot be found or it fails with C<ENOSYS>,
387C<ENOTSUP>, C<EOPNOTSUPP>, C<EAFNOSUPPORT>, C<EPROTOTYPE> or C<ENOTSOCK>,
386emulated, so you can call C<aio_sendfile> on any type of filehandle 388it will be emulated, so you can call C<aio_sendfile> on any type of
387regardless of the limitations of the operating system. 389filehandle regardless of the limitations of the operating system.
388 390
389Please note, however, that C<aio_sendfile> can read more bytes from 391Please note, however, that C<aio_sendfile> can read more bytes from
390C<$in_fh> than are written, and there is no way to find out how many 392C<$in_fh> than are written, and there is no way to find out how many
391bytes have been read from C<aio_sendfile> alone, as C<aio_sendfile> only 393bytes have been read from C<aio_sendfile> alone, as C<aio_sendfile> only
392provides the number of bytes written to C<$out_fh>. Only if the result 394provides the number of bytes written to C<$out_fh>. Only if the result
430 $_[0] and die "stat failed: $!"; 432 $_[0] and die "stat failed: $!";
431 print "size is ", -s _, "\n"; 433 print "size is ", -s _, "\n";
432 }; 434 };
433 435
434 436
437=item aio_statvfs $fh_or_path, $callback->($statvfs)
438
439Works like the POSIX C<statvfs> or C<fstatvfs> syscalls, depending on
440whether a file handle or path was passed.
441
442On success, the callback is passed a hash reference with the following
443members: C<bsize>, C<frsize>, C<blocks>, C<bfree>, C<bavail>, C<files>,
444C<ffree>, C<favail>, C<fsid>, C<flag> and C<namemax>. On failure, C<undef>
445is passed.
446
447The following POSIX IO::AIO::ST_* constants are defined: C<ST_RDONLY> and
448C<ST_NOSUID>.
449
450The following non-POSIX IO::AIO::ST_* flag masks are defined to
451their correct value when available, or to C<0> on systems that do
452not support them: C<ST_NODEV>, C<ST_NOEXEC>, C<ST_SYNCHRONOUS>,
453C<ST_MANDLOCK>, C<ST_WRITE>, C<ST_APPEND>, C<ST_IMMUTABLE>, C<ST_NOATIME>,
454C<ST_NODIRATIME> and C<ST_RELATIME>.
455
456Example: stat C</wd> and dump out the data if successful.
457
458 aio_statvfs "/wd", sub {
459 my $f = $_[0]
460 or die "statvfs: $!";
461
462 use Data::Dumper;
463 say Dumper $f;
464 };
465
466 # result:
467 {
468 bsize => 1024,
469 bfree => 4333064312,
470 blocks => 10253828096,
471 files => 2050765568,
472 flag => 4096,
473 favail => 2042092649,
474 bavail => 4333064312,
475 ffree => 2042092649,
476 namemax => 255,
477 frsize => 1024,
478 fsid => 1810
479 }
480
481
435=item aio_utime $fh_or_path, $atime, $mtime, $callback->($status) 482=item aio_utime $fh_or_path, $atime, $mtime, $callback->($status)
436 483
437Works like perl's C<utime> function (including the special case of $atime 484Works like perl's C<utime> function (including the special case of $atime
438and $mtime being undef). Fractional times are supported if the underlying 485and $mtime being undef). Fractional times are supported if the underlying
439syscalls support them. 486syscalls support them.
634 681
635=item aio_copy $srcpath, $dstpath, $callback->($status) 682=item aio_copy $srcpath, $dstpath, $callback->($status)
636 683
637Try to copy the I<file> (directories not supported as either source or 684Try to copy the I<file> (directories not supported as either source or
638destination) from C<$srcpath> to C<$dstpath> and call the callback with 685destination) from C<$srcpath> to C<$dstpath> and call the callback with
639the C<0> (error) or C<-1> ok. 686a status of C<0> (ok) or C<-1> (error, see C<$!>).
640 687
641This is a composite request that creates the destination file with 688This is a composite request that creates the destination file with
642mode 0200 and copies the contents of the source file into it using 689mode 0200 and copies the contents of the source file into it using
643C<aio_sendfile>, followed by restoring atime, mtime, access mode and 690C<aio_sendfile>, followed by restoring atime, mtime, access mode and
644uid/gid, in that order. 691uid/gid, in that order.
656 my $grp = aio_group $cb; 703 my $grp = aio_group $cb;
657 704
658 aioreq_pri $pri; 705 aioreq_pri $pri;
659 add $grp aio_open $src, O_RDONLY, 0, sub { 706 add $grp aio_open $src, O_RDONLY, 0, sub {
660 if (my $src_fh = $_[0]) { 707 if (my $src_fh = $_[0]) {
661 my @stat = stat $src_fh; # hmm, might bock over nfs? 708 my @stat = stat $src_fh; # hmm, might block over nfs?
662 709
663 aioreq_pri $pri; 710 aioreq_pri $pri;
664 add $grp aio_open $dst, O_CREAT | O_WRONLY | O_TRUNC, 0200, sub { 711 add $grp aio_open $dst, O_CREAT | O_WRONLY | O_TRUNC, 0200, sub {
665 if (my $dst_fh = $_[0]) { 712 if (my $dst_fh = $_[0]) {
666 aioreq_pri $pri; 713 aioreq_pri $pri;
713 760
714=item aio_move $srcpath, $dstpath, $callback->($status) 761=item aio_move $srcpath, $dstpath, $callback->($status)
715 762
716Try to move the I<file> (directories not supported as either source or 763Try to move the I<file> (directories not supported as either source or
717destination) from C<$srcpath> to C<$dstpath> and call the callback with 764destination) from C<$srcpath> to C<$dstpath> and call the callback with
718the C<0> (error) or C<-1> ok. 765a status of C<0> (ok) or C<-1> (error, see C<$!>).
719 766
720This is a composite request that tries to rename(2) the file first; if 767This is a composite request that tries to rename(2) the file first; if
721rename fails with C<EXDEV>, it copies the file with C<aio_copy> and, if 768rename fails with C<EXDEV>, it copies the file with C<aio_copy> and, if
722that is successful, unlinks the C<$srcpath>. 769that is successful, unlinks the C<$srcpath>.
723 770
957(E.g. rename). This might not work on all operating systems or have any 1004(E.g. rename). This might not work on all operating systems or have any
958specific effect, but usually it makes sure that directory changes get 1005specific effect, but usually it makes sure that directory changes get
959written to disc. It works for anything that can be opened for read-only, 1006written to disc. It works for anything that can be opened for read-only,
960not just directories. 1007not just directories.
961 1008
1009Future versions of this function might fall back to other methods when
1010C<fsync> on the directory fails (such as calling C<sync>).
1011
962Passes C<0> when everything went ok, and C<-1> on error. 1012Passes C<0> when everything went ok, and C<-1> on error.
963 1013
964=cut 1014=cut
965 1015
966sub aio_pathsync($;$) { 1016sub aio_pathsync($;$) {
986 }; 1036 };
987 1037
988 $grp 1038 $grp
989} 1039}
990 1040
1041=item aio_msync $scalar, $offset = 0, $length = undef, flags = 0, $callback->($status)
1042
1043This is a rather advanced IO::AIO call, which only works on mmap(2)ed
1044scalars (see the L<Sys::Mmap> or L<Mmap> modules for details on this, note
1045that the scalar must only be modified in-place while an aio operation is
1046pending on it).
1047
1048It calls the C<msync> function of your OS, if available, with the memory
1049area starting at C<$offset> in the string and ending C<$length> bytes
1050later. If C<$length> is negative, counts from the end, and if C<$length>
1051is C<undef>, then it goes till the end of the string. The flags can be
1052a combination of C<IO::AIO::MS_ASYNC>, C<IO::AIO::MS_INVALIDATE> and
1053C<IO::AIO::MS_SYNC>.
1054
1055=item aio_mtouch $scalar, $offset = 0, $length = undef, flags = 0, $callback->($status)
1056
1057This is a rather advanced IO::AIO call, which works best on mmap(2)ed
1058scalars.
1059
1060It touches (reads or writes) all memory pages in the specified
1061range inside the scalar. All caveats and parameters are the same
1062as for C<aio_msync>, above, except for flags, which must be either
1063C<0> (which reads all pages and ensures they are instantiated) or
1064C<IO::AIO::MT_MODIFY>, which modifies the memory page s(by reading and
1065writing an octet from it, which dirties the page).
1066
991=item aio_group $callback->(...) 1067=item aio_group $callback->(...)
992 1068
993This is a very special aio request: Instead of doing something, it is a 1069This is a very special aio request: Instead of doing something, it is a
994container for other aio requests, which is useful if you want to bundle 1070container for other aio requests, which is useful if you want to bundle
995many requests into a single, composite, request with a definite callback 1071many requests into a single, composite, request with a definite callback
1130=item $grp->cancel_subs 1206=item $grp->cancel_subs
1131 1207
1132Cancel all subrequests and clears any feeder, but not the group request 1208Cancel all subrequests and clears any feeder, but not the group request
1133itself. Useful when you queued a lot of events but got a result early. 1209itself. Useful when you queued a lot of events but got a result early.
1134 1210
1211The group request will finish normally (you cannot add requests to the
1212group).
1213
1135=item $grp->result (...) 1214=item $grp->result (...)
1136 1215
1137Set the result value(s) that will be passed to the group callback when all 1216Set the result value(s) that will be passed to the group callback when all
1138subrequests have finished and set the groups errno to the current value 1217subrequests have finished and set the groups errno to the current value
1139of errno (just like calling C<errno> without an error number). By default, 1218of errno (just like calling C<errno> without an error number). By default,
1391 1470
1392=item IO::AIO::npending 1471=item IO::AIO::npending
1393 1472
1394Returns the number of requests currently in the pending state (executed, 1473Returns the number of requests currently in the pending state (executed,
1395but not yet processed by poll_cb). 1474but not yet processed by poll_cb).
1475
1476=back
1477
1478=head3 MISCELLANEOUS FUNCTIONS
1479
1480IO::AIO implements some functions that might be useful, but are not
1481asynchronous.
1482
1483=over 4
1484
1485=item IO::AIO::sendfile $ofh, $ifh, $offset, $count
1486
1487Calls the C<eio_sendfile_sync> function, which is like C<aio_sendfile>,
1488but is blocking (this makes most sense if you know the input data is
1489likely cached already and the output filehandle is set to non-blocking
1490operations).
1491
1492Returns the number of bytes copied, or C<-1> on error.
1493
1494=item IO::AIO::fadvise $fh, $offset, $len, $advice
1495
1496Simply calls the C<posix_fadvise> function (see it's
1497manpage for details). The following advice constants are
1498avaiable: C<IO::AIO::FADV_NORMAL>, C<IO::AIO::FADV_SEQUENTIAL>,
1499C<IO::AIO::FADV_RANDOM>, C<IO::AIO::FADV_NOREUSE>,
1500C<IO::AIO::FADV_WILLNEED>, C<IO::AIO::FADV_DONTNEED>.
1501
1502On systems that do not implement C<posix_fadvise>, this function returns
1503ENOSYS, otherwise the return value of C<posix_fadvise>.
1396 1504
1397=back 1505=back
1398 1506
1399=cut 1507=cut
1400 1508

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines