ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/IO-AIO/AIO.pm
(Generate patch)

Comparing IO-AIO/AIO.pm (file contents):
Revision 1.285 by root, Tue Jul 17 23:20:08 2018 UTC vs.
Revision 1.301 by root, Mon Mar 18 23:52:09 2019 UTC

171use common::sense; 171use common::sense;
172 172
173use base 'Exporter'; 173use base 'Exporter';
174 174
175BEGIN { 175BEGIN {
176 our $VERSION = 4.41; 176 our $VERSION = 4.71;
177 177
178 our @AIO_REQ = qw(aio_sendfile aio_seek aio_read aio_write aio_open aio_close 178 our @AIO_REQ = qw(aio_sendfile aio_seek aio_read aio_write aio_open aio_close
179 aio_stat aio_lstat aio_unlink aio_rmdir aio_readdir aio_readdirx 179 aio_stat aio_lstat aio_unlink aio_rmdir aio_readdir aio_readdirx
180 aio_scandir aio_symlink aio_readlink aio_realpath aio_fcntl aio_ioctl 180 aio_scandir aio_symlink aio_readlink aio_realpath aio_fcntl aio_ioctl
181 aio_sync aio_fsync aio_syncfs aio_fdatasync aio_sync_file_range 181 aio_sync aio_fsync aio_syncfs aio_fdatasync aio_sync_file_range
405following POSIX and non-POSIX constants are available (missing ones on 405following POSIX and non-POSIX constants are available (missing ones on
406your system are, as usual, C<0>): 406your system are, as usual, C<0>):
407 407
408C<O_ASYNC>, C<O_DIRECT>, C<O_NOATIME>, C<O_CLOEXEC>, C<O_NOCTTY>, C<O_NOFOLLOW>, 408C<O_ASYNC>, C<O_DIRECT>, C<O_NOATIME>, C<O_CLOEXEC>, C<O_NOCTTY>, C<O_NOFOLLOW>,
409C<O_NONBLOCK>, C<O_EXEC>, C<O_SEARCH>, C<O_DIRECTORY>, C<O_DSYNC>, 409C<O_NONBLOCK>, C<O_EXEC>, C<O_SEARCH>, C<O_DIRECTORY>, C<O_DSYNC>,
410C<O_RSYNC>, C<O_SYNC>, C<O_PATH>, C<O_TMPFILE>, and C<O_TTY_INIT>. 410C<O_RSYNC>, C<O_SYNC>, C<O_PATH>, C<O_TMPFILE>, C<O_TTY_INIT> and C<O_ACCMODE>.
411 411
412 412
413=item aio_close $fh, $callback->($status) 413=item aio_close $fh, $callback->($status)
414 414
415Asynchronously close a file and call the callback with the result 415Asynchronously close a file and call the callback with the result
541 541
542=item aio_stat $fh_or_path, $callback->($status) 542=item aio_stat $fh_or_path, $callback->($status)
543 543
544=item aio_lstat $fh, $callback->($status) 544=item aio_lstat $fh, $callback->($status)
545 545
546Works like perl's C<stat> or C<lstat> in void context. The callback will 546Works almost exactly like perl's C<stat> or C<lstat> in void context. The
547be called after the stat and the results will be available using C<stat _> 547callback will be called after the stat and the results will be available
548or C<-s _> etc... 548using C<stat _> or C<-s _> and other tests (with the exception of C<-B>
549and C<-T>).
549 550
550The pathname passed to C<aio_stat> must be absolute. See API NOTES, above, 551The pathname passed to C<aio_stat> must be absolute. See API NOTES, above,
551for an explanation. 552for an explanation.
552 553
553Currently, the stats are always 64-bit-stats, i.e. instead of returning an 554Currently, the stats are always 64-bit-stats, i.e. instead of returning an
560behaviour). 561behaviour).
561 562
562C<S_IFMT>, C<S_IFIFO>, C<S_IFCHR>, C<S_IFBLK>, C<S_IFLNK>, C<S_IFREG>, 563C<S_IFMT>, C<S_IFIFO>, C<S_IFCHR>, C<S_IFBLK>, C<S_IFLNK>, C<S_IFREG>,
563C<S_IFDIR>, C<S_IFWHT>, C<S_IFSOCK>, C<IO::AIO::major $dev_t>, 564C<S_IFDIR>, C<S_IFWHT>, C<S_IFSOCK>, C<IO::AIO::major $dev_t>,
564C<IO::AIO::minor $dev_t>, C<IO::AIO::makedev $major, $minor>. 565C<IO::AIO::minor $dev_t>, C<IO::AIO::makedev $major, $minor>.
566
567To access higher resolution stat timestamps, see L<SUBSECOND STAT TIME
568ACCESS>.
565 569
566Example: Print the length of F</etc/passwd>: 570Example: Print the length of F</etc/passwd>:
567 571
568 aio_stat "/etc/passwd", sub { 572 aio_stat "/etc/passwd", sub {
569 $_[0] and die "stat failed: $!"; 573 $_[0] and die "stat failed: $!";
619 623
620Works like perl's C<utime> function (including the special case of $atime 624Works like perl's C<utime> function (including the special case of $atime
621and $mtime being undef). Fractional times are supported if the underlying 625and $mtime being undef). Fractional times are supported if the underlying
622syscalls support them. 626syscalls support them.
623 627
624When called with a pathname, uses utimes(2) if available, otherwise 628When called with a pathname, uses utimensat(2) or utimes(2) if available,
625utime(2). If called on a file descriptor, uses futimes(2) if available, 629otherwise utime(2). If called on a file descriptor, uses futimens(2)
626otherwise returns ENOSYS, so this is not portable. 630or futimes(2) if available, otherwise returns ENOSYS, so this is not
631portable.
627 632
628Examples: 633Examples:
629 634
630 # set atime and mtime to current time (basically touch(1)): 635 # set atime and mtime to current time (basically touch(1)):
631 aio_utime "path", undef, undef; 636 aio_utime "path", undef, undef;
1104 aioreq_pri $pri; 1109 aioreq_pri $pri;
1105 add $grp aio_stat $wd, sub { 1110 add $grp aio_stat $wd, sub {
1106 return $grp->result () if $_[0]; 1111 return $grp->result () if $_[0];
1107 my $now = time; 1112 my $now = time;
1108 my $hash1 = join ":", (stat _)[0,1,3,7,9]; 1113 my $hash1 = join ":", (stat _)[0,1,3,7,9];
1114 my $rdxflags = READDIR_DIRS_FIRST;
1115
1116 if ((stat _)[3] < 2) {
1117 # at least one non-POSIX filesystem exists
1118 # that returns useful DT_type values: btrfs,
1119 # so optimise for this here by requesting dents
1120 $rdxflags |= READDIR_DENTS;
1121 }
1109 1122
1110 # read the directory entries 1123 # read the directory entries
1111 aioreq_pri $pri; 1124 aioreq_pri $pri;
1112 add $grp aio_readdirx $wd, READDIR_DIRS_FIRST, sub { 1125 add $grp aio_readdirx $wd, $rdxflags, sub {
1113 my $entries = shift 1126 my ($entries, $flags) = @_
1114 or return $grp->result (); 1127 or return $grp->result ();
1128
1129 if ($rdxflags & READDIR_DENTS) {
1130 # if we requested type values, see if we can use them directly.
1131
1132 # if there were any DT_UNKNOWN entries then we assume we
1133 # don't know. alternatively, we could assume that if we get
1134 # one DT_DIR, then all directories are indeed marked with
1135 # DT_DIR, but this seems not required for btrfs, and this
1136 # is basically the "btrfs can't get it's act together" code
1137 # branch.
1138 unless ($flags & READDIR_FOUND_UNKNOWN) {
1139 # now we have valid DT_ information for all entries,
1140 # so use it as an optimisation without further stat's.
1141 # they must also all be at the beginning of @$entries
1142 # by now.
1143
1144 my $dirs;
1145
1146 if (@$entries) {
1147 for (0 .. $#$entries) {
1148 if ($entries->[$_][1] != DT_DIR) {
1149 # splice out directories
1150 $dirs = [splice @$entries, 0, $_];
1151 last;
1152 }
1153 }
1154
1155 # if we didn't find any non-dir, then all entries are dirs
1156 unless ($dirs) {
1157 ($dirs, $entries) = ($entries, []);
1158 }
1159 } else {
1160 # directory is empty, so there are no sbdirs
1161 $dirs = [];
1162 }
1163
1164 # either splice'd the directories out or the dir was empty.
1165 # convert dents to filenames
1166 $_ = $_->[0] for @$dirs;
1167 $_ = $_->[0] for @$entries;
1168
1169 return $grp->result ($dirs, $entries);
1170 }
1171
1172 # cannot use, so return to our old ways
1173 # by pretending we only scanned for names.
1174 $_ = $_->[0] for @$entries;
1175 }
1115 1176
1116 # stat the dir another time 1177 # stat the dir another time
1117 aioreq_pri $pri; 1178 aioreq_pri $pri;
1118 add $grp aio_stat $wd, sub { 1179 add $grp aio_stat $wd, sub {
1119 my $hash2 = join ":", (stat _)[0,1,3,7,9]; 1180 my $hash2 = join ":", (stat _)[0,1,3,7,9];
1380 IO::AIO::mmap $data, -s $fh, IO::AIO::PROT_READ, IO::AIO::MAP_SHARED, $fh; 1441 IO::AIO::mmap $data, -s $fh, IO::AIO::PROT_READ, IO::AIO::MAP_SHARED, $fh;
1381 aio_mlock $data; # mlock in background 1442 aio_mlock $data; # mlock in background
1382 1443
1383=item aio_mlockall $flags, $callback->($status) 1444=item aio_mlockall $flags, $callback->($status)
1384 1445
1385Calls the C<mlockall> function with the given C<$flags> (a combination of 1446Calls the C<mlockall> function with the given C<$flags> (a
1386C<IO::AIO::MCL_CURRENT> and C<IO::AIO::MCL_FUTURE>). 1447combination of C<IO::AIO::MCL_CURRENT>, C<IO::AIO::MCL_FUTURE> and
1448C<IO::AIO::MCL_ONFAULT>).
1387 1449
1388On systems that do not implement C<mlockall>, this function returns C<-1> 1450On systems that do not implement C<mlockall>, this function returns C<-1>
1389and sets errno to C<ENOSYS>. 1451and sets errno to C<ENOSYS>. Similarly, flag combinations not supported
1452by the system result in a return value of C<-1> with errno being set to
1453C<EINVAL>.
1390 1454
1391Note that the corresponding C<munlockall> is synchronous and is 1455Note that the corresponding C<munlockall> is synchronous and is
1392documented under L<MISCELLANEOUS FUNCTIONS>. 1456documented under L<MISCELLANEOUS FUNCTIONS>.
1393 1457
1394Example: asynchronously lock all current and future pages into memory. 1458Example: asynchronously lock all current and future pages into memory.
1779The default value for the limit is C<0>, but note that setting a feeder 1843The default value for the limit is C<0>, but note that setting a feeder
1780automatically bumps it up to C<2>. 1844automatically bumps it up to C<2>.
1781 1845
1782=back 1846=back
1783 1847
1848
1784=head2 SUPPORT FUNCTIONS 1849=head2 SUPPORT FUNCTIONS
1785 1850
1786=head3 EVENT PROCESSING AND EVENT LOOP INTEGRATION 1851=head3 EVENT PROCESSING AND EVENT LOOP INTEGRATION
1787 1852
1788=over 4 1853=over 4
1853Strictly equivalent to: 1918Strictly equivalent to:
1854 1919
1855 IO::AIO::poll_wait, IO::AIO::poll_cb 1920 IO::AIO::poll_wait, IO::AIO::poll_cb
1856 while IO::AIO::nreqs; 1921 while IO::AIO::nreqs;
1857 1922
1923This function can be useful at program aborts, to make sure outstanding
1924I/O has been done (C<IO::AIO> uses an C<END> block which already calls
1925this function on normal exits), or when you are merely using C<IO::AIO>
1926for its more advanced functions, rather than for async I/O, e.g.:
1927
1928 my ($dirs, $nondirs);
1929 IO::AIO::aio_scandir "/tmp", 0, sub { ($dirs, $nondirs) = @_ };
1930 IO::AIO::flush;
1931 # $dirs, $nondirs are now set
1932
1858=item IO::AIO::max_poll_reqs $nreqs 1933=item IO::AIO::max_poll_reqs $nreqs
1859 1934
1860=item IO::AIO::max_poll_time $seconds 1935=item IO::AIO::max_poll_time $seconds
1861 1936
1862These set the maximum number of requests (default C<0>, meaning infinity) 1937These set the maximum number of requests (default C<0>, meaning infinity)
1888 poll => 'r', nice => 1, 1963 poll => 'r', nice => 1,
1889 cb => &IO::AIO::poll_cb); 1964 cb => &IO::AIO::poll_cb);
1890 1965
1891=back 1966=back
1892 1967
1968
1893=head3 CONTROLLING THE NUMBER OF THREADS 1969=head3 CONTROLLING THE NUMBER OF THREADS
1894 1970
1895=over 1971=over
1896 1972
1897=item IO::AIO::min_parallel $nthreads 1973=item IO::AIO::min_parallel $nthreads
1984The default value for C<max_outstanding> is very large, so there is no 2060The default value for C<max_outstanding> is very large, so there is no
1985practical limit on the number of outstanding requests. 2061practical limit on the number of outstanding requests.
1986 2062
1987=back 2063=back
1988 2064
2065
1989=head3 STATISTICAL INFORMATION 2066=head3 STATISTICAL INFORMATION
1990 2067
1991=over 2068=over
1992 2069
1993=item IO::AIO::nreqs 2070=item IO::AIO::nreqs
2009 2086
2010Returns the number of requests currently in the pending state (executed, 2087Returns the number of requests currently in the pending state (executed,
2011but not yet processed by poll_cb). 2088but not yet processed by poll_cb).
2012 2089
2013=back 2090=back
2091
2092
2093=head3 SUBSECOND STAT TIME ACCESS
2094
2095Both C<aio_stat>/C<aio_lstat> and perl's C<stat>/C<lstat> functions can
2096generally find access/modification and change times with subsecond time
2097accuracy of the system supports it, but perl's built-in functions only
2098return the integer part.
2099
2100The following functions return the timestamps of the most recent
2101stat with subsecond precision on most systems and work both after
2102C<aio_stat>/C<aio_lstat> and perl's C<stat>/C<lstat> calls. Their return
2103value is only meaningful after a successful C<stat>/C<lstat> call, or
2104during/after a successful C<aio_stat>/C<aio_lstat> callback.
2105
2106This is similar to the L<Time::HiRes> C<stat> functions, but can return
2107full resolution without rounding and work with standard perl C<stat>,
2108alleviating the need to call the special C<Time::HiRes> functions, which
2109do not act like their perl counterparts.
2110
2111On operating systems or file systems where subsecond time resolution is
2112not supported or could not be detected, a fractional part of C<0> is
2113returned, so it is always safe to call these functions.
2114
2115=over 4
2116
2117=item $seconds = IO::AIO::st_atime, IO::AIO::st_mtime, IO::AIO::st_ctime, IO::AIO::st_btime
2118
2119Return the access, modication, change or birth time, respectively,
2120including fractional part. Due to the limited precision of floating point,
2121the accuracy on most platforms is only a bit better than milliseconds
2122for times around now - see the I<nsec> function family, below, for full
2123accuracy.
2124
2125File birth time is only available when the OS and perl support it (on
2126FreeBSD and NetBSD at the time of this writing, although support is
2127adaptive, so if your OS/perl gains support, IO::AIO can take advantage of
2128it). On systems where it isn't available, C<0> is currently returned, but
2129this might change to C<undef> in a future version.
2130
2131=item ($atime, $mtime, $ctime, $btime, ...) = IO::AIO::st_xtime
2132
2133Returns access, modification, change and birth time all in one go, and
2134maybe more times in the future version.
2135
2136=item $nanoseconds = IO::AIO::st_atimensec, IO::AIO::st_mtimensec, IO::AIO::st_ctimensec, IO::AIO::st_btimensec
2137
2138Return the fractional access, modifcation, change or birth time, in nanoseconds,
2139as an integer in the range C<0> to C<999999999>.
2140
2141Note that no accessors are provided for access, modification and
2142change times - you need to get those from C<stat _> if required (C<int
2143IO::AIO::st_atime> and so on will I<not> generally give you the correct
2144value).
2145
2146=item $seconds = IO::AIO::st_btimesec
2147
2148The (integral) seconds part of the file birth time, if available.
2149
2150=item ($atime, $mtime, $ctime, $btime, ...) = IO::AIO::st_xtimensec
2151
2152Like the functions above, but returns all four times in one go (and maybe
2153more in future versions).
2154
2155=item $counter = IO::AIO::st_gen
2156
2157Returns the generation counter (in practice this is just a random number)
2158of the file. This is only available on platforms which have this member in
2159their C<struct stat> (most BSDs at the time of this writing) and generally
2160only to the root usert. If unsupported, C<0> is returned, but this might
2161change to C<undef> in a future version.
2162
2163=back
2164
2165Example: print the high resolution modification time of F</etc>, using
2166C<stat>, and C<IO::AIO::aio_stat>.
2167
2168 if (stat "/etc") {
2169 printf "stat(/etc) mtime: %f\n", IO::AIO::st_mtime;
2170 }
2171
2172 IO::AIO::aio_stat "/etc", sub {
2173 $_[0]
2174 and return;
2175
2176 printf "aio_stat(/etc) mtime: %d.%09d\n", (stat _)[9], IO::AIO::st_mtimensec;
2177 };
2178
2179 IO::AIO::flush;
2180
2181Output of the awbove on my system, showing reduced and full accuracy:
2182
2183 stat(/etc) mtime: 1534043702.020808
2184 aio_stat(/etc) mtime: 1534043702.020807792
2185
2014 2186
2015=head3 MISCELLANEOUS FUNCTIONS 2187=head3 MISCELLANEOUS FUNCTIONS
2016 2188
2017IO::AIO implements some functions that are useful when you want to use 2189IO::AIO implements some functions that are useful when you want to use
2018some "Advanced I/O" function not available to in Perl, without going the 2190some "Advanced I/O" function not available to in Perl, without going the
2159 2331
2160=item IO::AIO::munmap $scalar 2332=item IO::AIO::munmap $scalar
2161 2333
2162Removes a previous mmap and undefines the C<$scalar>. 2334Removes a previous mmap and undefines the C<$scalar>.
2163 2335
2164=item IO::AIO::mremap $scalar, $new_length, $flags = 0[, $new_address = 0] 2336=item IO::AIO::mremap $scalar, $new_length, $flags = MREMAP_MAYMOVE[, $new_address = 0]
2165 2337
2166Calls the Linux-specific mremap(2) system call. The C<$scalar> must have 2338Calls the Linux-specific mremap(2) system call. The C<$scalar> must have
2167been mapped by C<IO::AIO::mmap>, and C<$flags> must currently either be 2339been mapped by C<IO::AIO::mmap>, and C<$flags> must currently either be
2168C<0> or C<IO::AIO::MREMAP_MAYMOVE>. 2340C<0> or C<IO::AIO::MREMAP_MAYMOVE>.
2169 2341
2181C<IO::AIO::MREMAP_FIXED> and the C<$new_address> argument are currently 2353C<IO::AIO::MREMAP_FIXED> and the C<$new_address> argument are currently
2182implemented, but not supported and might go away in a future version. 2354implemented, but not supported and might go away in a future version.
2183 2355
2184On systems where this call is not supported or is not emulated, this call 2356On systems where this call is not supported or is not emulated, this call
2185returns falls and sets C<$!> to C<ENOSYS>. 2357returns falls and sets C<$!> to C<ENOSYS>.
2358
2359=item IO::AIO::mlockall $flags
2360
2361Calls the C<eio_mlockall_sync> function, which is like C<aio_mlockall>,
2362but is blocking.
2186 2363
2187=item IO::AIO::munlock $scalar, $offset = 0, $length = undef 2364=item IO::AIO::munlock $scalar, $offset = 0, $length = undef
2188 2365
2189Calls the C<munlock> function, undoing the effects of a previous 2366Calls the C<munlock> function, undoing the effects of a previous
2190C<aio_mlock> call (see its description for details). 2367C<aio_mlock> call (see its description for details).

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines