[ViewVC] Annotation of: cvs/IO-AIO/Changes

Revision history for IO::AIO

TODO: better autoconf.pm that can return LIBS etc.
TODO: aio_cptree/mvtree
TODO: reduce condvar fairness: schedule hot-cache-threads first?
TODO: fix setsig
TODO: splice/tee/vmsplice/sync_file_range? (http://kerneltrap.org/node/6505 http://lwn.net/Articles/178199/)

2.4
        - fix aio_busy w.r.t. fractional delays.
        - add aio_chmod, aio_chown, aio_utime (linux successfully demonstrated
          that you can block on futimes...).
        - allow undef as fileoffset for aio_read/write and use read/write(2)
          internally (useful for sockets or O_APPEND handles).
        - use NV instead of UV for 32 bit perls and file offsets, as NVs
          have a larger range then.
        - shared code between BDB and IO::AIO.
        - correctly set errno to ENOSYS on unimplemented functions
          (should never happen, though).

2.33 Tue Jan 23 23:55:41 CET 2007
        - fix install path (Andreas J. Koenig).

2.32 Mon Jan 22 16:56:23 CET 2007
        - added aio_rmtree.
        - wow, aio_mkdir was missing.
        - aio_load did return undef on error, not -1.
        - use prefixexp not prefix in autoconf.pm
          (suggested by ... rt.cpan.org unreachable).
        - avoid installing autoconf.pm.

2.31 Sat Jan  6 03:46:02 CET 2007
        - added aio_load.

2.3  Sat Dec 23 05:48:07 CET 2006
        - fix off-by-one bug in aio_read, causing memory corruption
          or crashes.

2.21  Fri Dec 22 05:03:38 CET 2006
        - minor doc updates.
        - minor cleanups.
        - IO::AIO::poll returns request count.
        - undocumented and unfinished async-signal-reporting.

2.2  Tue Oct 31 00:31:00 CET 2006
        - minor doc updates.
        - added aio_readlink.
        - properly zero-terminate aio_read buffer.
        - fix aio_read/write with nonzero dataoffset.
        - reduced size of aio request structure.
        - better diagnostics when pathnames etc. are not byte-encoded;
          do not leak request in that case, either.

2.1  Sun Oct 29 02:01:57 CET 2006
        - INCOMPATIBLE CHANGE: replace IO::AIO::poll_some by
          IO::AIO::max_poll_reqs and IO::AIO::max_poll_time.
        - fix a bug in aio_move where it would fail everytime
          it would have to copy files manually.
        - doc updates.
        - start threads only on (very low) demand.
        - end superfluous threads automatically after 10s idling.
        - add IO::AIO::max_idle to control this.
        - some tuning applied to random places.
        - add aio_mknod.

2.0  Thu Oct 26 18:27:58 CEST 2006
        - minor incompatibility: max_outstanding semantics have changed.
        - major rewrite, consider all functionality EXPERIMENTAL.
        - aio requests can be cancelled.
        - callbacks can be (re-)set later.
        - aio requests can choose between 9 priorities.
        - add aio_group: aio requests can be grouped
          into composite requests.
        - generator interface for groups.
        - add IO::AIO::poll_some.
        - major documentation improvements.
        - very minor bugfixes.
        - add aio_nop for dummy requests.
        - add aio_busy mainly for benchmarking and debugging.
        - use "fast" mutexes on linux.
        - use dynamic (and larger) buffers instead of
          putting them onto the stack.
        - optimise x86 and amd64 a bit.
        - better error checking when ENOMEM.
        - hopefully fix mem and dirp leaks on fork.
        - warn about broken perl malloc.
        - compiles on cygwin (but pread is broken on cygwin
          which is not detected by autoconf, so you have to
          edit autoconf/config.h yourself to enable emulation).

1.8  Sat Jun 24 22:20:44 CEST 2006
        - add and/or document aio_rename, aio_link, aio_symlink and aio_move.

1.73 Wed Mar  1 22:49:32 CET 2006
        - codename "jost"
        - AIX/Solaris(?) aren't being helpful again, hardcode a value
          for NAME_MAX and drive with your eyes closed (reported by
          wcooley@nakedape.cc).

1.72 Thu Feb  2 00:40:44 CET 2006
        - another minor bug in aio_scandir, again, the callback was called
          twice when the directory can't be stat'ed.

1.71 Mon Dec 26 20:20:03 CET 2005
        - grr, another minor bug in aio_scandir, this time resulting
          in a runtime error.

1.7  Mon Dec 26 19:29:48 CET 2005
        - aio_scandir errornously called callback twice in some cases.
        - added AnyEvent example.

1.61 Wed Sep  7 19:40:42 CEST 2005
        - no longer include $Config{libs}, as distros include too much
          garbage in there that is not installed on typical systems
          (for example, debian links perl against -lgdbm and many more
          libraries despite perl not needing it, slowing down startup and
          wasting memory).

1.6  Tue Aug 30 17:44:44 CEST 2005
        - added aio_readdir, aio_scandir.
        - added aio_sendfile, including sendfile emulation when sendfile
          isn't available. Linux, FreeBSD and HP-UX might work (sendfilev
          support is unavailable on my solaris 8 machine, but preliminary
          code is there. What's lacking is configury stuff and testing...).

1.5  Sat Aug 20 02:32:19 CEST 2005
        - create the aio threads on demand only (good after forking).
        - somebody nagged about C89 compatibility, so this release should
          be C89 compatible, but no guarantees for future ones.
        - abort when the configure script fails.

1.4  Wed Aug 17 08:07:27 CEST 2005
        - forgot to recreate the pipe after forking, this could cause
          deadlocks.

1.3  Wed Aug 17 07:25:54 CEST 2005
        - properly propagate exceptions from callbacks, instead of silently
          eating them.
        - use a different fork algorithm that avoids recursive callback
          invocations and reduces fork latency in busy processes.
        - fix a bug where the buffer scalar in aio_read got assigned the wrong
          length after reading.
        - fix a bug where the child would process some outstanding requests
          from the parent.
        - make a copy of the callback scalar, to avoid some very uncommon
          (but valid) usages where the callback scalar changes.
        - the callback was never freed in aio_read/aio_write.
        - aio_read/aio_write will now set the readonly flag on the data
          scalar for better error reporting.

1.2  Wed Aug 17 01:22:58 CEST 2005
        - verified on cygwin, linux/amd64+ia32+alpha, solaris.
        - use SvPVbyte for filenames now. You *need* to encode your strings to
          the external filename encoding first.
        - fix the bug where filehandles could leak (again).
        - clarify freebsd situation: make it work and tell me how, or go away
          with your underdocumented, broken and outdated OS.
        - fork'ing should now be officially supported (where linux and
          posix contradict each other, I followed posix).
        - only call read() once per poll, not twice (speedup).
        - new functions: aio_rmdir, aio_symlink.
        - force callback arguments to be undef or a reference, for better
          error catching.

1.1  Sun Aug  7 05:27:23 CEST 2005
        - added configure script to detect availability of some calls.
          (imperfect, as we cannot detect things like -lrt due to missing
          feedback yet).
        - emulate fdatasync via fsync, pread/pwrite via unsafe read/write
          and readahead via manual reading on platforms lacking those.
        - ported t/03_errors.t+framework by Brad Fitzpatrick
          from Linux::AIO.
        - removed XOPEN_SOURCE because stupid solaris 9 doesn't
          compile with it enabled. Probably breaks others. Oh well.
        - try to be more careful with errno on non-threaded perls.
        - cygwins perl insisted on a matching open mode when morphing
          the fd to an fh.
        - convert sv's to "byte" encoding in aio_read/aio_write. Might
          do that for pathnames, too, in the future, so make sure you
          properly encode your pathnames.

1.0  Fri Jul 22 10:43:30 CEST 2005
        - aio_open did not reliably deliver (open) filehandles.
        - all aio_*-functions keep a reference to the filehandle so
          it doesn't go away while the aio requests is working on it.
        - disable warnings in AIO.pm.

0.9  Wed Jul 20 23:55:04 CEST 2005
        - allow recursive calls to poll_cb, use less locking calls, too.
        - fix the Gtk2-example in the SYNOPSIS.
        - use pread/pwrite not pread64/pwrite64. this was simply a leftover
          from Linux::AIO.
          (found by compiling on cygwin. Unfortunately, cygwin declares but
          does not implement pread/pwrite).
        - only include <sys/syscall.h> on linux.

0.5  Tue Jul 12 13:03:09 CEST 2005
        - removed #include <endian.h>, it's not portable, and we don't
          need it anyway.
        - link against -lrt, as it might contain goodies such as fdatasync,
          and often aio_read, which we do not use yet, but it shouldn't hurt.

0.4  Mon Jul 11 05:28:25 CEST 2005
        - added IO::AIO::flush, IO::AIO::poll.
        - make callback argument optional for all calls.

0.3  Mon Jul 11 01:42:37 CEST 2005
        - restructured manpage.
        - added SYNOPSIS with examples for Event, Glib, Tk.
        - remove explicit context support so I don't have to maintain
          it for threaded perls (i.e. it should work now :).

0.2  Sun Jul 10 22:57:12 CEST 2005
        - return immediately from poll_wait if nreqs==0.
        - get rid of the request pipe and use faster thread-thread
          communications for most requests and responses.

0.1
        - cloned from Linux::AIO, which is very similar.

Revision:	1.125
Committed:	Fri Jun 1 14:40:01 2007 UTC (17 years ago) by root
Branch:	MAIN
Changes since 1.124:	+1 -1 lines
Log Message:	* empty log message *
#	User	Rev	Content
1	root	1.31	Revision history for IO::AIO
2	root	1.30
3	root	1.59	TODO: better autoconf.pm that can return LIBS etc.
4	root	1.114	TODO: aio_cptree/mvtree
5	root	1.106	TODO: reduce condvar fairness: schedule hot-cache-threads first?
6	root	1.109	TODO: fix setsig
7	root	1.123	TODO: splice/tee/vmsplice/sync_file_range? (http://kerneltrap.org/node/6505 http://lwn.net/Articles/178199/)
8	root	1.100
9	root	1.121	2.4
10	root	1.122	- fix aio_busy w.r.t. fractional delays.
11			- add aio_chmod, aio_chown, aio_utime (linux successfully demonstrated
12			that you can block on futimes...).
13	root	1.124	- allow undef as fileoffset for aio_read/write and use read/write(2)
14			internally (useful for sockets or O_APPEND handles).
15			- use NV instead of UV for 32 bit perls and file offsets, as NVs
16	root	1.125	have a larger range then.
17	root	1.120	- shared code between BDB and IO::AIO.
18	root	1.121	- correctly set errno to ENOSYS on unimplemented functions
19			(should never happen, though).
20	root	1.120
21	root	1.119	2.33 Tue Jan 23 23:55:41 CET 2007
22			- fix install path (Andreas J. Koenig).
23
24	root	1.118	2.32 Mon Jan 22 16:56:23 CET 2007
25	root	1.114	- added aio_rmtree.
26	root	1.115	- wow, aio_mkdir was missing.
27	root	1.116	- aio_load did return undef on error, not -1.
28	root	1.117	- use prefixexp not prefix in autoconf.pm
29			(suggested by ... rt.cpan.org unreachable).
30	root	1.118	- avoid installing autoconf.pm.
31	root	1.114
32	root	1.113	2.31 Sat Jan 6 03:46:02 CET 2007
33	root	1.112	- added aio_load.
34
35	root	1.111	2.3 Sat Dec 23 05:48:07 CET 2006
36			- fix off-by-one bug in aio_read, causing memory corruption
37			or crashes.
38
39	root	1.110	2.21 Fri Dec 22 05:03:38 CET 2006
40	root	1.108	- minor doc updates.
41	root	1.107	- minor cleanups.
42			- IO::AIO::poll returns request count.
43	root	1.109	- undocumented and unfinished async-signal-reporting.
44	root	1.107
45	root	1.103	2.2 Tue Oct 31 00:31:00 CET 2006
46	root	1.100	- minor doc updates.
47	root	1.101	- added aio_readlink.
48			- properly zero-terminate aio_read buffer.
49			- fix aio_read/write with nonzero dataoffset.
50	root	1.104	- reduced size of aio request structure.
51	root	1.106	- better diagnostics when pathnames etc. are not byte-encoded;
52	root	1.105	do not leak request in that case, either.
53	root	1.94
54	root	1.99	2.1 Sun Oct 29 02:01:57 CET 2006
55	root	1.98	- INCOMPATIBLE CHANGE: replace IO::AIO::poll_some by
56			IO::AIO::max_poll_reqs and IO::AIO::max_poll_time.
57	root	1.95	- fix a bug in aio_move where it would fail everytime
58			it would have to copy files manually.
59	root	1.98	- doc updates.
60	root	1.94	- start threads only on (very low) demand.
61	root	1.97	- end superfluous threads automatically after 10s idling.
62	root	1.98	- add IO::AIO::max_idle to control this.
63	root	1.94	- some tuning applied to random places.
64	root	1.95	- add aio_mknod.
65	root	1.59
66	root	1.92	2.0 Thu Oct 26 18:27:58 CEST 2006
67	root	1.90	- minor incompatibility: max_outstanding semantics have changed.
68	root	1.86	- major rewrite, consider all functionality EXPERIMENTAL.
69	root	1.68	- aio requests can be cancelled.
70	root	1.81	- callbacks can be (re-)set later.
71	root	1.93	- aio requests can choose between 9 priorities.
72	root	1.83	- add aio_group: aio requests can be grouped
73			into composite requests.
74			- generator interface for groups.
75	root	1.89	- add IO::AIO::poll_some.
76	root	1.72	- major documentation improvements.
77			- very minor bugfixes.
78	root	1.76	- add aio_nop for dummy requests.
79	root	1.84	- add aio_busy mainly for benchmarking and debugging.
80	root	1.79	- use "fast" mutexes on linux.
81	root	1.80	- use dynamic (and larger) buffers instead of
82			putting them onto the stack.
83			- optimise x86 and amd64 a bit.
84			- better error checking when ENOMEM.
85	root	1.85	- hopefully fix mem and dirp leaks on fork.
86	root	1.92	- warn about broken perl malloc.
87	root	1.88	- compiles on cygwin (but pread is broken on cygwin
88			which is not detected by autoconf, so you have to
89			edit autoconf/config.h yourself to enable emulation).
90	root	1.68
91	root	1.67	1.8 Sat Jun 24 22:20:44 CEST 2006
92	root	1.66	- add and/or document aio_rename, aio_link, aio_symlink and aio_move.
93
94	root	1.65	1.73 Wed Mar 1 22:49:32 CET 2006
95			- codename "jost"
96			- AIX/Solaris(?) aren't being helpful again, hardcode a value
97			for NAME_MAX and drive with your eyes closed (reported by
98			wcooley@nakedape.cc).
99	root	1.63
100	root	1.62	1.72 Thu Feb 2 00:40:44 CET 2006
101	root	1.61	- another minor bug in aio_scandir, again, the callback was called
102			twice when the directory can't be stat'ed.
103
104	root	1.60	1.71 Mon Dec 26 20:20:03 CET 2005
105			- grr, another minor bug in aio_scandir, this time resulting
106			in a runtime error.
107
108	root	1.59	1.7 Mon Dec 26 19:29:48 CET 2005
109	root	1.58	- aio_scandir errornously called callback twice in some cases.
110	root	1.57	- added AnyEvent example.
111
112	root	1.55	1.61 Wed Sep 7 19:40:42 CEST 2005
113	root	1.54	- no longer include $Config{libs}, as distros include too much
114	root	1.56	garbage in there that is not installed on typical systems
115	root	1.54	(for example, debian links perl against -lgdbm and many more
116			libraries despite perl not needing it, slowing down startup and
117			wasting memory).
118
119	root	1.53	1.6 Tue Aug 30 17:44:44 CEST 2005
120			- added aio_readdir, aio_scandir.
121	root	1.51	- added aio_sendfile, including sendfile emulation when sendfile
122			isn't available. Linux, FreeBSD and HP-UX might work (sendfilev
123			support is unavailable on my solaris 8 machine, but preliminary
124			code is there. What's lacking is configury stuff and testing...).
125	root	1.46
126	root	1.44	1.5 Sat Aug 20 02:32:19 CEST 2005
127	root	1.51	- create the aio threads on demand only (good after forking).
128	root	1.41	- somebody nagged about C89 compatibility, so this release should
129	root	1.42	be C89 compatible, but no guarantees for future ones.
130	root	1.43	- abort when the configure script fails.
131	root	1.41
132	root	1.40	1.4 Wed Aug 17 08:07:27 CEST 2005
133	root	1.93	- forgot to recreate the pipe after forking, this could cause
134	root	1.40	deadlocks.
135
136	root	1.39	1.3 Wed Aug 17 07:25:54 CEST 2005
137	root	1.33	- properly propagate exceptions from callbacks, instead of silently
138			eating them.
139	root	1.38	- use a different fork algorithm that avoids recursive callback
140			invocations and reduces fork latency in busy processes.
141	root	1.37	- fix a bug where the buffer scalar in aio_read got assigned the wrong
142			length after reading.
143			- fix a bug where the child would process some outstanding requests
144			from the parent.
145			- make a copy of the callback scalar, to avoid some very uncommon
146			(but valid) usages where the callback scalar changes.
147			- the callback was never freed in aio_read/aio_write.
148	root	1.38	- aio_read/aio_write will now set the readonly flag on the data
149			scalar for better error reporting.
150	root	1.33
151	root	1.32	1.2 Wed Aug 17 01:22:58 CEST 2005
152			- verified on cygwin, linux/amd64+ia32+alpha, solaris.
153	root	1.31	- use SvPVbyte for filenames now. You need to encode your strings to
154			the external filename encoding first.
155	root	1.32	- fix the bug where filehandles could leak (again).
156	root	1.31	- clarify freebsd situation: make it work and tell me how, or go away
157			with your underdocumented, broken and outdated OS.
158			- fork'ing should now be officially supported (where linux and
159			posix contradict each other, I followed posix).
160	root	1.32	- only call read() once per poll, not twice (speedup).
161			- new functions: aio_rmdir, aio_symlink.
162	root	1.31	- force callback arguments to be undef or a reference, for better
163			error catching.
164	root	1.1
165	root	1.29	1.1 Sun Aug 7 05:27:23 CEST 2005
166	root	1.25	- added configure script to detect availability of some calls.
167	root	1.27	(imperfect, as we cannot detect things like -lrt due to missing
168	root	1.23	feedback yet).
169	root	1.27	- emulate fdatasync via fsync, pread/pwrite via unsafe read/write
170			and readahead via manual reading on platforms lacking those.
171	root	1.19	- ported t/03_errors.t+framework by Brad Fitzpatrick
172			from Linux::AIO.
173	root	1.18	- removed XOPEN_SOURCE because stupid solaris 9 doesn't
174			compile with it enabled. Probably breaks others. Oh well.
175	root	1.24	- try to be more careful with errno on non-threaded perls.
176	root	1.26	- cygwins perl insisted on a matching open mode when morphing
177			the fd to an fh.
178	root	1.28	- convert sv's to "byte" encoding in aio_read/aio_write. Might
179			do that for pathnames, too, in the future, so make sure you
180			properly encode your pathnames.
181	root	1.18
182	root	1.17	1.0 Fri Jul 22 10:43:30 CEST 2005
183			- aio_open did not reliably deliver (open) filehandles.
184	root	1.16	- all aio_*-functions keep a reference to the filehandle so
185			it doesn't go away while the aio requests is working on it.
186			- disable warnings in AIO.pm.
187
188	root	1.15	0.9 Wed Jul 20 23:55:04 CEST 2005
189			- allow recursive calls to poll_cb, use less locking calls, too.
190			- fix the Gtk2-example in the SYNOPSIS.
191	root	1.14	- use pread/pwrite not pread64/pwrite64. this was simply a leftover
192			from Linux::AIO.
193			(found by compiling on cygwin. Unfortunately, cygwin declares but
194			does not implement pread/pwrite).
195			- only include <sys/syscall.h> on linux.
196
197	root	1.13	0.5 Tue Jul 12 13:03:09 CEST 2005
198	root	1.12	- removed #include <endian.h>, it's not portable, and we don't
199			need it anyway.
200			- link against -lrt, as it might contain goodies such as fdatasync,
201			and often aio_read, which we do not use yet, but it shouldn't hurt.
202
203	root	1.11	0.4 Mon Jul 11 05:28:25 CEST 2005
204	root	1.9	- added IO::AIO::flush, IO::AIO::poll.
205	root	1.10	- make callback argument optional for all calls.
206	root	1.8
207	root	1.7	0.3 Mon Jul 11 01:42:37 CEST 2005
208	root	1.5	- restructured manpage.
209	root	1.7	- added SYNOPSIS with examples for Event, Glib, Tk.
210			- remove explicit context support so I don't have to maintain
211			it for threaded perls (i.e. it should work now :).
212	root	1.5
213	root	1.4	0.2 Sun Jul 10 22:57:12 CEST 2005
214	root	1.2	- return immediately from poll_wait if nreqs==0.
215			- get rid of the request pipe and use faster thread-thread
216	root	1.3	communications for most requests and responses.
217	root	1.2
218	root	1.1	0.1
219			- cloned from Linux::AIO, which is very similar.
220