ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/IO-AIO/AIO.pm
(Generate patch)

Comparing IO-AIO/AIO.pm (file contents):
Revision 1.71 by root, Tue Oct 24 11:57:30 2006 UTC vs.
Revision 1.72 by root, Tue Oct 24 14:25:53 2006 UTC

51=head1 DESCRIPTION 51=head1 DESCRIPTION
52 52
53This module implements asynchronous I/O using whatever means your 53This module implements asynchronous I/O using whatever means your
54operating system supports. 54operating system supports.
55 55
56Currently, a number of threads are started that execute your read/writes 56In this version, a number of threads are started that execute your
57and signal their completion. You don't need thread support in perl, and 57requests and signal their completion. You don't need thread support
58the threads created by this module will not be visible to perl. In the 58in perl, and the threads created by this module will not be visible
59future, this module might make use of the native aio functions available 59to perl. In the future, this module might make use of the native aio
60on many operating systems. However, they are often not well-supported 60functions available on many operating systems. However, they are often
61(Linux doesn't allow them on normal files currently, for example), 61not well-supported or restricted (Linux doesn't allow them on normal
62and they would only support aio_read and aio_write, so the remaining 62files currently, for example), and they would only support aio_read and
63functionality would have to be implemented using threads anyway. 63aio_write, so the remaining functionality would have to be implemented
64using threads anyway.
64 65
65Although the module will work with in the presence of other threads, 66Although the module will work with in the presence of other (Perl-)
66it is currently not reentrant in any way, so use appropriate locking 67threads, it is currently not reentrant in any way, so use appropriate
67yourself, always call C<poll_cb> from within the same thread, or never 68locking yourself, always call C<poll_cb> from within the same thread, or
68call C<poll_cb> (or other C<aio_> functions) recursively. 69never call C<poll_cb> (or other C<aio_> functions) recursively.
70
71=head1 REQUEST ANATOMY AND LIFETIME
72
73Every C<aio_*> function creates a request. which is a C data structure not
74directly visible to Perl.
75
76If called in non-void context, every request function returns a Perl
77object representing the request. In void context, nothing is returned,
78which saves a bit of memory.
79
80The perl object is a fairly standard ref-to-hash object. The hash contents
81are not used by IO::AIO so you are free to store anything you like in it.
82
83During their existance, aio requests travel through the following states,
84in order:
85
86=over 4
87
88=item ready
89
90Immediately after a request is created it is put into the ready state,
91waiting for a thread to execute it.
92
93=item execute
94
95A thread has accepted the request for processing and is currently
96executing it (e.g. blocking in read).
97
98=item pending
99
100The request has been executed and is waiting for result processing.
101
102While request submission and execution is fully asynchronous, result
103processing is not and relies on the perl interpreter calling C<poll_cb>
104(or another function with the same effect).
105
106=item result
107
108The request results are processed synchronously by C<poll_cb>.
109
110The C<poll_cb> function will process all outstanding aio requests by
111calling their callbacks, freeing memory associated with them and managing
112any groups they are contained in.
113
114=item done
115
116Request has reached the end of its lifetime and holds no resources anymore
117(except possibly for the Perl object, but its connection to the actual
118aio request is severed and calling its methods will either do nothing or
119result in a runtime error).
69 120
70=cut 121=cut
71 122
72package IO::AIO; 123package IO::AIO;
73 124
591=head2 IO::AIO::REQ CLASS 642=head2 IO::AIO::REQ CLASS
592 643
593All non-aggregate C<aio_*> functions return an object of this class when 644All non-aggregate C<aio_*> functions return an object of this class when
594called in non-void context. 645called in non-void context.
595 646
596A request always moves through the following five states in its lifetime,
597in order: B<ready> (request has been created, but has not been executed
598yet), B<execute> (request is currently being executed), B<pending>
599(request has been executed but callback has not been called yet),
600B<result> (results are being processed synchronously, includes calling the
601callback) and B<done> (request has reached the end of its lifetime and
602holds no resources anymore).
603
604=over 4 647=over 4
605 648
606=item cancel $req 649=item cancel $req
607 650
608Cancels the request, if possible. Has the effect of skipping execution 651Cancels the request, if possible. Has the effect of skipping execution
888This module should do "the right thing" when the process using it forks: 931This module should do "the right thing" when the process using it forks:
889 932
890Before the fork, IO::AIO enters a quiescent state where no requests 933Before the fork, IO::AIO enters a quiescent state where no requests
891can be added in other threads and no results will be processed. After 934can be added in other threads and no results will be processed. After
892the fork the parent simply leaves the quiescent state and continues 935the fork the parent simply leaves the quiescent state and continues
893request/result processing, while the child clears the request/result 936request/result processing, while the child frees the request/result queue
894queue (so the requests started before the fork will only be handled in 937(so that the requests started before the fork will only be handled in the
895the parent). Threads will be started on demand until the limit ste in the 938parent). Threads will be started on demand until the limit set in the
896parent process has been reached again. 939parent process has been reached again.
940
941Temporary memory that was allocated for request processing is not
942reclaimed in the child, however. While this is possible in some cases, it
943is almost impossible in others (threads are evil you know), so you will
944have to live with it. This is around 64k buffer (for sendfile, readahead
945emulation) + the size of the directory being scanned (readdir).
897 946
898In short: the parent will, after a short pause, continue as if fork had 947In short: the parent will, after a short pause, continue as if fork had
899not been called, while the child will act as if IO::AIO has not been used 948not been called, while the child will act as if IO::AIO has not been used
900yet. 949yet.
901 950
902=head2 MEMORY USAGE 951=head2 MEMORY USAGE
903 952
953Per-request usage:
954
904Each aio request uses - depending on your architecture - around 128 bytes 955Each aio request uses - depending on your architecture - around 100-200
905of memory. In addition, stat requests need a stat buffer (possibly a few 956bytes of memory. In addition, stat requests need a stat buffer (possibly
906hundred bytes). Perl scalars and other data passed into aio requests will 957a few hundred bytes), readdir requires a result buffer and so on. Perl
907also be locked. 958scalars and other data passed into aio requests will also be locked and
959will consume memory till the request has entered the done state.
908 960
909This is now awfully much, so queuing lots of requests is not usually a 961This is now awfully much, so queuing lots of requests is not usually a
910problem. 962problem.
911 963
912Each thread needs a stack area which is usually around 16k, sometimes much 964Per-thread usage:
913larger, depending on the OS. 965
966In the execution phase, some aio requests require more memory for
967temporary buffers, and each thread requires a stack and other data
968structures (usually around 16k-128k, depending on the OS).
969
970=head1 KNOWN BUGS
971
972See FORK BEHAVIOUR, above.
914 973
915=head1 SEE ALSO 974=head1 SEE ALSO
916 975
917L<Coro::AIO>. 976L<Coro::AIO>.
918 977

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines