ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/IO-AIO/AIO.pm
(Generate patch)

Comparing IO-AIO/AIO.pm (file contents):
Revision 1.267 by root, Tue Aug 9 11:39:17 2016 UTC vs.
Revision 1.274 by root, Thu Sep 21 23:43:46 2017 UTC

171use common::sense; 171use common::sense;
172 172
173use base 'Exporter'; 173use base 'Exporter';
174 174
175BEGIN { 175BEGIN {
176 our $VERSION = 4.34; 176 our $VERSION = 4.35;
177 177
178 our @AIO_REQ = qw(aio_sendfile aio_seek aio_read aio_write aio_open aio_close 178 our @AIO_REQ = qw(aio_sendfile aio_seek aio_read aio_write aio_open aio_close
179 aio_stat aio_lstat aio_unlink aio_rmdir aio_readdir aio_readdirx 179 aio_stat aio_lstat aio_unlink aio_rmdir aio_readdir aio_readdirx
180 aio_scandir aio_symlink aio_readlink aio_realpath aio_fcntl aio_ioctl 180 aio_scandir aio_symlink aio_readlink aio_realpath aio_fcntl aio_ioctl
181 aio_sync aio_fsync aio_syncfs aio_fdatasync aio_sync_file_range 181 aio_sync aio_fsync aio_syncfs aio_fdatasync aio_sync_file_range
182 aio_pathsync aio_readahead aio_fiemap aio_allocate 182 aio_pathsync aio_readahead aio_fiemap aio_allocate
183 aio_rename aio_link aio_move aio_copy aio_group 183 aio_rename aio_rename2 aio_link aio_move aio_copy aio_group
184 aio_nop aio_mknod aio_load aio_rmtree aio_mkdir aio_chown 184 aio_nop aio_mknod aio_load aio_rmtree aio_mkdir aio_chown
185 aio_chmod aio_utime aio_truncate 185 aio_chmod aio_utime aio_truncate
186 aio_msync aio_mtouch aio_mlock aio_mlockall 186 aio_msync aio_mtouch aio_mlock aio_mlockall
187 aio_statvfs 187 aio_statvfs
188 aio_wd); 188 aio_wd);
233 aio_link $srcpath, $dstpath, $callback->($status) 233 aio_link $srcpath, $dstpath, $callback->($status)
234 aio_symlink $srcpath, $dstpath, $callback->($status) 234 aio_symlink $srcpath, $dstpath, $callback->($status)
235 aio_readlink $pathname, $callback->($link) 235 aio_readlink $pathname, $callback->($link)
236 aio_realpath $pathname, $callback->($path) 236 aio_realpath $pathname, $callback->($path)
237 aio_rename $srcpath, $dstpath, $callback->($status) 237 aio_rename $srcpath, $dstpath, $callback->($status)
238 aio_rename2 $srcpath, $dstpath, $flags, $callback->($status)
238 aio_mkdir $pathname, $mode, $callback->($status) 239 aio_mkdir $pathname, $mode, $callback->($status)
239 aio_rmdir $pathname, $callback->($status) 240 aio_rmdir $pathname, $callback->($status)
240 aio_readdir $pathname, $callback->($entries) 241 aio_readdir $pathname, $callback->($entries)
241 aio_readdirx $pathname, $flags, $callback->($entries, $flags) 242 aio_readdirx $pathname, $flags, $callback->($entries, $flags)
242 IO::AIO::READDIR_DENTS IO::AIO::READDIR_DIRS_FIRST 243 IO::AIO::READDIR_DENTS IO::AIO::READDIR_DIRS_FIRST
252 aio_syncfs $fh, $callback->($status) 253 aio_syncfs $fh, $callback->($status)
253 aio_fsync $fh, $callback->($status) 254 aio_fsync $fh, $callback->($status)
254 aio_fdatasync $fh, $callback->($status) 255 aio_fdatasync $fh, $callback->($status)
255 aio_sync_file_range $fh, $offset, $nbytes, $flags, $callback->($status) 256 aio_sync_file_range $fh, $offset, $nbytes, $flags, $callback->($status)
256 aio_pathsync $pathname, $callback->($status) 257 aio_pathsync $pathname, $callback->($status)
257 aio_msync $scalar, $offset = 0, $length = undef, flags = 0, $callback->($status) 258 aio_msync $scalar, $offset = 0, $length = undef, flags = MS_SYNC, $callback->($status)
258 aio_mtouch $scalar, $offset = 0, $length = undef, flags = 0, $callback->($status) 259 aio_mtouch $scalar, $offset = 0, $length = undef, flags = 0, $callback->($status)
259 aio_mlock $scalar, $offset = 0, $length = undef, $callback->($status) 260 aio_mlock $scalar, $offset = 0, $length = undef, $callback->($status)
260 aio_mlockall $flags, $callback->($status) 261 aio_mlockall $flags, $callback->($status)
261 aio_group $callback->(...) 262 aio_group $callback->(...)
262 aio_nop $callback->() 263 aio_nop $callback->()
739C<$mode> is usually C<0> or C<IO::AIO::FALLOC_FL_KEEP_SIZE> to allocate 740C<$mode> is usually C<0> or C<IO::AIO::FALLOC_FL_KEEP_SIZE> to allocate
740space, or C<IO::AIO::FALLOC_FL_PUNCH_HOLE | IO::AIO::FALLOC_FL_KEEP_SIZE>, 741space, or C<IO::AIO::FALLOC_FL_PUNCH_HOLE | IO::AIO::FALLOC_FL_KEEP_SIZE>,
741to deallocate a file range. 742to deallocate a file range.
742 743
743IO::AIO also supports C<FALLOC_FL_COLLAPSE_RANGE>, to remove a range 744IO::AIO also supports C<FALLOC_FL_COLLAPSE_RANGE>, to remove a range
744(without leaving a hole) and C<FALLOC_FL_ZERO_RANGE>, to zero a range (see 745(without leaving a hole), C<FALLOC_FL_ZERO_RANGE>, to zero a range,
745your L<fallocate(2)> manpage). 746C<FALLOC_FL_INSERT_RANGE> to insert a range and C<FALLOC_FL_UNSHARE_RANGE>
747to unshare shared blocks (see your L<fallocate(2)> manpage).
746 748
747The file system block size used by C<fallocate> is presumably the 749The file system block size used by C<fallocate> is presumably the
748C<f_bsize> returned by C<statvfs>. 750C<f_bsize> returned by C<statvfs>, but different filesystems and filetypes
751can dictate other limitations.
749 752
750If C<fallocate> isn't available or cannot be emulated (currently no 753If C<fallocate> isn't available or cannot be emulated (currently no
751emulation will be attempted), passes C<-1> and sets C<$!> to C<ENOSYS>. 754emulation will be attempted), passes C<-1> and sets C<$!> to C<ENOSYS>.
752 755
753 756
810rename(2) and call the callback with the result code. 813rename(2) and call the callback with the result code.
811 814
812On systems that support the AIO::WD working directory abstraction 815On systems that support the AIO::WD working directory abstraction
813natively, the case C<[$wd, "."]> as C<$srcpath> is specialcased - instead 816natively, the case C<[$wd, "."]> as C<$srcpath> is specialcased - instead
814of failing, C<rename> is called on the absolute path of C<$wd>. 817of failing, C<rename> is called on the absolute path of C<$wd>.
818
819
820=item aio_rename2 $srcpath, $dstpath, $flags, $callback->($status)
821
822Basically a version of C<aio_rename> with an additional C<$flags>
823argument. Calling this with C<$flags=0> is the same as calling
824C<aio_rename>.
825
826Non-zero flags are currently only supported on GNU/Linux systems that
827support renameat2. Other systems fail with C<ENOSYS> in this case.
828
829The following constants are available (missing ones are, as usual C<0>),
830see renameat2(2) for details:
831
832C<IO::AIO::RENAME_NOREPLACE>, C<IO::AIO::RENAME_EXCHANGE>
833and C<IO::AIO::RENAME_WHITEOUT>.
815 834
816 835
817=item aio_mkdir $pathname, $mode, $callback->($status) 836=item aio_mkdir $pathname, $mode, $callback->($status)
818 837
819Asynchronously mkdir (create) a directory and call the callback with 838Asynchronously mkdir (create) a directory and call the callback with
1254other processes), although if you are careful and know what you are doing, 1273other processes), although if you are careful and know what you are doing,
1255you still can. 1274you still can.
1256 1275
1257The following constants are available (missing ones are, as usual C<0>): 1276The following constants are available (missing ones are, as usual C<0>):
1258 1277
1278C<F_DUPFD_CLOEXEC>,
1279
1280C<F_OFD_GETLK>, C<F_OFD_SETLK>, C<F_OFD_GETLKW>,
1281
1259C<FIFREEZE>, C<FITHAW>, C<FITRIM>, C<FICLONE>, C<FICLONERANGE>, C<FIDEDUPERANGE>. 1282C<FIFREEZE>, C<FITHAW>, C<FITRIM>, C<FICLONE>, C<FICLONERANGE>, C<FIDEDUPERANGE>.
1260 1283
1261C<FS_IOC_GETFLAGS>, C<FS_IOC_SETFLAGS>, C<FS_IOC_GETVERSION>, C<FS_IOC_SETVERSION>, 1284C<FS_IOC_GETFLAGS>, C<FS_IOC_SETFLAGS>, C<FS_IOC_GETVERSION>, C<FS_IOC_SETVERSION>,
1262C<FS_IOC_FIEMAP>. 1285C<FS_IOC_FIEMAP>.
1263 1286
1350 }; 1373 };
1351 1374
1352 $grp 1375 $grp
1353} 1376}
1354 1377
1355=item aio_msync $scalar, $offset = 0, $length = undef, flags = 0, $callback->($status) 1378=item aio_msync $scalar, $offset = 0, $length = undef, flags = MS_SYNC, $callback->($status)
1356 1379
1357This is a rather advanced IO::AIO call, which only works on mmap(2)ed 1380This is a rather advanced IO::AIO call, which only works on mmap(2)ed
1358scalars (see the C<IO::AIO::mmap> function, although it also works on data 1381scalars (see the C<IO::AIO::mmap> function, although it also works on data
1359scalars managed by the L<Sys::Mmap> or L<Mmap> modules, note that the 1382scalars managed by the L<Sys::Mmap> or L<Mmap> modules, note that the
1360scalar must only be modified in-place while an aio operation is pending on 1383scalar must only be modified in-place while an aio operation is pending on
1362 1385
1363It calls the C<msync> function of your OS, if available, with the memory 1386It calls the C<msync> function of your OS, if available, with the memory
1364area starting at C<$offset> in the string and ending C<$length> bytes 1387area starting at C<$offset> in the string and ending C<$length> bytes
1365later. If C<$length> is negative, counts from the end, and if C<$length> 1388later. If C<$length> is negative, counts from the end, and if C<$length>
1366is C<undef>, then it goes till the end of the string. The flags can be 1389is C<undef>, then it goes till the end of the string. The flags can be
1367a combination of C<IO::AIO::MS_ASYNC>, C<IO::AIO::MS_INVALIDATE> and 1390either C<IO::AIO::MS_ASYNC> or C<IO::AIO::MS_SYNC>, plus an optional
1368C<IO::AIO::MS_SYNC>. 1391C<IO::AIO::MS_INVALIDATE>.
1369 1392
1370=item aio_mtouch $scalar, $offset = 0, $length = undef, flags = 0, $callback->($status) 1393=item aio_mtouch $scalar, $offset = 0, $length = undef, flags = 0, $callback->($status)
1371 1394
1372This is a rather advanced IO::AIO call, which works best on mmap(2)ed 1395This is a rather advanced IO::AIO call, which works best on mmap(2)ed
1373scalars. 1396scalars.
1985This is a very bad function to use in interactive programs because it 2008This is a very bad function to use in interactive programs because it
1986blocks, and a bad way to reduce concurrency because it is inexact: Better 2009blocks, and a bad way to reduce concurrency because it is inexact: Better
1987use an C<aio_group> together with a feed callback. 2010use an C<aio_group> together with a feed callback.
1988 2011
1989Its main use is in scripts without an event loop - when you want to stat 2012Its main use is in scripts without an event loop - when you want to stat
1990a lot of files, you can write somehting like this: 2013a lot of files, you can write something like this:
1991 2014
1992 IO::AIO::max_outstanding 32; 2015 IO::AIO::max_outstanding 32;
1993 2016
1994 for my $path (...) { 2017 for my $path (...) {
1995 aio_stat $path , ...; 2018 aio_stat $path , ...;
2066=item IO::AIO::madvise $scalar, $offset, $len, $advice 2089=item IO::AIO::madvise $scalar, $offset, $len, $advice
2067 2090
2068Simply calls the C<posix_madvise> function (see its 2091Simply calls the C<posix_madvise> function (see its
2069manpage for details). The following advice constants are 2092manpage for details). The following advice constants are
2070available: C<IO::AIO::MADV_NORMAL>, C<IO::AIO::MADV_SEQUENTIAL>, 2093available: C<IO::AIO::MADV_NORMAL>, C<IO::AIO::MADV_SEQUENTIAL>,
2071C<IO::AIO::MADV_RANDOM>, C<IO::AIO::MADV_WILLNEED>, C<IO::AIO::MADV_DONTNEED>, 2094C<IO::AIO::MADV_RANDOM>, C<IO::AIO::MADV_WILLNEED>,
2072C<IO::AIO::MADV_FREE>. 2095C<IO::AIO::MADV_DONTNEED>.
2096
2097If C<$offset> is negative, counts from the end. If C<$length> is negative,
2098the remaining length of the C<$scalar> is used. If possible, C<$length>
2099will be reduced to fit into the C<$scalar>.
2073 2100
2074On systems that do not implement C<posix_madvise>, this function returns 2101On systems that do not implement C<posix_madvise>, this function returns
2075ENOSYS, otherwise the return value of C<posix_madvise>. 2102ENOSYS, otherwise the return value of C<posix_madvise>.
2076 2103
2077=item IO::AIO::mprotect $scalar, $offset, $len, $protect 2104=item IO::AIO::mprotect $scalar, $offset, $len, $protect
2079Simply calls the C<mprotect> function on the preferably AIO::mmap'ed 2106Simply calls the C<mprotect> function on the preferably AIO::mmap'ed
2080$scalar (see its manpage for details). The following protect 2107$scalar (see its manpage for details). The following protect
2081constants are available: C<IO::AIO::PROT_NONE>, C<IO::AIO::PROT_READ>, 2108constants are available: C<IO::AIO::PROT_NONE>, C<IO::AIO::PROT_READ>,
2082C<IO::AIO::PROT_WRITE>, C<IO::AIO::PROT_EXEC>. 2109C<IO::AIO::PROT_WRITE>, C<IO::AIO::PROT_EXEC>.
2083 2110
2111If C<$offset> is negative, counts from the end. If C<$length> is negative,
2112the remaining length of the C<$scalar> is used. If possible, C<$length>
2113will be reduced to fit into the C<$scalar>.
2114
2084On systems that do not implement C<mprotect>, this function returns 2115On systems that do not implement C<mprotect>, this function returns
2085ENOSYS, otherwise the return value of C<mprotect>. 2116ENOSYS, otherwise the return value of C<mprotect>.
2086 2117
2087=item IO::AIO::mmap $scalar, $length, $prot, $flags, $fh[, $offset] 2118=item IO::AIO::mmap $scalar, $length, $prot, $flags, $fh[, $offset]
2088 2119
2089Memory-maps a file (or anonymous memory range) and attaches it to the 2120Memory-maps a file (or anonymous memory range) and attaches it to the
2090given C<$scalar>, which will act like a string scalar. Returns true on 2121given C<$scalar>, which will act like a string scalar. Returns true on
2091success, and false otherwise. 2122success, and false otherwise.
2092 2123
2124The scalar must exist, but its contents do not matter - this means you
2125cannot use a nonexistant array or hash element. When in doubt, C<undef>
2126the scalar first.
2127
2093The only operations allowed on the scalar are C<substr>/C<vec> that don't 2128The only operations allowed on the mmapped scalar are C<substr>/C<vec>,
2094change the string length, and most read-only operations such as copying it 2129which don't change the string length, and most read-only operations such
2095or searching it with regexes and so on. 2130as copying it or searching it with regexes and so on.
2096 2131
2097Anything else is unsafe and will, at best, result in memory leaks. 2132Anything else is unsafe and will, at best, result in memory leaks.
2098 2133
2099The memory map associated with the C<$scalar> is automatically removed 2134The memory map associated with the C<$scalar> is automatically removed
2100when the C<$scalar> is destroyed, or when the C<IO::AIO::mmap> or 2135when the C<$scalar> is undef'd or destroyed, or when the C<IO::AIO::mmap>
2101C<IO::AIO::munmap> functions are called. 2136or C<IO::AIO::munmap> functions are called on it.
2102 2137
2103This calls the C<mmap>(2) function internally. See your system's manual 2138This calls the C<mmap>(2) function internally. See your system's manual
2104page for details on the C<$length>, C<$prot> and C<$flags> parameters. 2139page for details on the C<$length>, C<$prot> and C<$flags> parameters.
2105 2140
2106The C<$length> must be larger than zero and smaller than the actual 2141The C<$length> must be larger than zero and smaller than the actual

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines