ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/cvsroot/Coro/Coro.pm
(Generate patch)

Comparing cvsroot/Coro/Coro.pm (file contents):
Revision 1.294 by root, Fri May 6 21:15:17 2011 UTC vs.
Revision 1.321 by root, Sun Feb 2 03:26:06 2014 UTC

16 cede; # yield to coro 16 cede; # yield to coro
17 print "3\n"; 17 print "3\n";
18 cede; # and again 18 cede; # and again
19 19
20 # use locking 20 # use locking
21 use Coro::Semaphore;
22 my $lock = new Coro::Semaphore; 21 my $lock = new Coro::Semaphore;
23 my $locked; 22 my $locked;
24 23
25 $lock->down; 24 $lock->down;
26 $locked = 1; 25 $locked = 1;
90 } 1, 2, 3; 89 } 1, 2, 3;
91 90
92This creates a new coro thread and puts it into the ready queue, meaning 91This creates a new coro thread and puts it into the ready queue, meaning
93it will run as soon as the CPU is free for it. 92it will run as soon as the CPU is free for it.
94 93
95C<async> will return a coro object - you can store this for future 94C<async> will return a Coro object - you can store this for future
96reference or ignore it, the thread itself will keep a reference to it's 95reference or ignore it - a thread that is running, ready to run or waiting
97thread object - threads are alive on their own. 96for some event is alive on it's own.
98 97
99Another way to create a thread is to call the C<new> constructor with a 98Another way to create a thread is to call the C<new> constructor with a
100code-reference: 99code-reference:
101 100
102 new Coro sub { 101 new Coro sub {
131A lot can happen after the coro thread has started running. Quite usually, 130A lot can happen after the coro thread has started running. Quite usually,
132it will not run to the end in one go (because you could use a function 131it will not run to the end in one go (because you could use a function
133instead), but it will give up the CPU regularly because it waits for 132instead), but it will give up the CPU regularly because it waits for
134external events. 133external events.
135 134
136As long as a coro thread runs, it's coro object is available in the global 135As long as a coro thread runs, its Coro object is available in the global
137variable C<$Coro::current>. 136variable C<$Coro::current>.
138 137
139The low-level way to give up the CPU is to call the scheduler, which 138The low-level way to give up the CPU is to call the scheduler, which
140selects a new coro thread to run: 139selects a new coro thread to run:
141 140
196 195
197 async { 196 async {
198 Coro::terminate "return value 1", "return value 2"; 197 Coro::terminate "return value 1", "return value 2";
199 }; 198 };
200 199
201And yet another way is to C<< ->cancel >> (or C<< ->safe_cancel >>) the 200Yet another way is to C<< ->cancel >> (or C<< ->safe_cancel >>) the coro
202coro thread from another thread: 201thread from another thread:
203 202
204 my $coro = async { 203 my $coro = async {
205 exit 1; 204 exit 1;
206 }; 205 };
207 206
208 $coro->cancel; # an also accept values for ->join to retrieve 207 $coro->cancel; # also accepts values for ->join to retrieve
209 208
210Cancellation I<can> be dangerous - it's a bit like calling C<exit> 209Cancellation I<can> be dangerous - it's a bit like calling C<exit> without
211without actually exiting, and might leave C libraries and XS modules in 210actually exiting, and might leave C libraries and XS modules in a weird
212a weird state. Unlike other thread implementations, however, Coro is 211state. Unlike other thread implementations, however, Coro is exceptionally
213exceptionally safe with regards to cancellation, as perl will always be 212safe with regards to cancellation, as perl will always be in a consistent
214in a consistent state, and for those cases where you want to do truly 213state, and for those cases where you want to do truly marvellous things
215marvellous things with your coro while it is being cancelled, there is 214with your coro while it is being cancelled - that is, make sure all
215cleanup code is executed from the thread being cancelled - there is even a
216even a C<< ->safe_cancel >> method. 216C<< ->safe_cancel >> method.
217 217
218So, cancelling a thread that runs in an XS event loop might not be the 218So, cancelling a thread that runs in an XS event loop might not be the
219best idea, but any other combination that deals with perl only (cancelling 219best idea, but any other combination that deals with perl only (cancelling
220when a thread is in a C<tie> method or an C<AUTOLOAD> for example) is 220when a thread is in a C<tie> method or an C<AUTOLOAD> for example) is
221safe. 221safe.
222 222
223Last not least, a coro thread object that isn't referenced is C<<
224->cancel >>'ed automatically - just like other objects in Perl. This
225is not such a common case, however - a running thread is referencedy by
226C<$Coro::current>, a thread ready to run is referenced by the ready queue,
227a thread waiting on a lock or semaphore is referenced by being in some
228wait list and so on. But a thread that isn't in any of those queues gets
229cancelled:
230
231 async {
232 schedule; # cede to other coros, don't go into the ready queue
233 };
234
235 cede;
236 # now the async above is destroyed, as it is not referenced by anything.
237
238A slightly embellished example might make it clearer:
239
240 async {
241 my $guard = Guard::guard { print "destroyed\n" };
242 schedule while 1;
243 };
244
245 cede;
246
247Superficially one might not expect any output - since the C<async>
248implements an endless loop, the C<$guard> will not be cleaned up. However,
249since the thread object returned by C<async> is not stored anywhere, the
250thread is initially referenced because it is in the ready queue, when it
251runs it is referenced by C<$Coro::current>, but when it calls C<schedule>,
252it gets C<cancel>ed causing the guard object to be destroyed (see the next
253section), and printing it's message.
254
255If this seems a bit drastic, remember that this only happens when nothing
256references the thread anymore, which means there is no way to further
257execute it, ever. The only options at this point are leaking the thread,
258or cleaning it up, which brings us to...
259
223=item 5. Cleanup 260=item 5. Cleanup
224 261
225Threads will allocate various resources. Most but not all will be returned 262Threads will allocate various resources. Most but not all will be returned
226when a thread terminates, during clean-up. 263when a thread terminates, during clean-up.
227 264
245 282
246 my $sem = new Coro::Semaphore; 283 my $sem = new Coro::Semaphore;
247 284
248 async { 285 async {
249 my $lock_guard = $sem->guard; 286 my $lock_guard = $sem->guard;
250 # if we reutrn, or die or get cancelled, here, 287 # if we return, or die or get cancelled, here,
251 # then the semaphore will be "up"ed. 288 # then the semaphore will be "up"ed.
252 }; 289 };
253 290
254The C<Guard::guard> function comes in handy for any custom cleanup you 291The C<Guard::guard> function comes in handy for any custom cleanup you
255might want to do: 292might want to do (but you cannot switch to other coroutines from those
293code blocks):
256 294
257 async { 295 async {
258 my $window = new Gtk2::Window "toplevel"; 296 my $window = new Gtk2::Window "toplevel";
259 # The window will not be cleaned up automatically, even when $window 297 # The window will not be cleaned up automatically, even when $window
260 # gets freed, so use a guard to ensure it's destruction 298 # gets freed, so use a guard to ensure it's destruction
273 # if we return or die here, the description will be restored 311 # if we return or die here, the description will be restored
274 } 312 }
275 313
276=item 6. Viva La Zombie Muerte 314=item 6. Viva La Zombie Muerte
277 315
278Even after a thread has terminated and cleaned up it's resources, the coro 316Even after a thread has terminated and cleaned up its resources, the Coro
279object still is there and stores the return values of the thread. Only in 317object still is there and stores the return values of the thread.
280this state will the coro object be "reference counted" in the normal perl
281sense: the thread code keeps a reference to it when it is active, but not
282after it has terminated.
283 318
284The means the coro object gets freed automatically when the thread has 319When there are no other references, it will simply be cleaned up and
285terminated and cleaned up and there arenot other references. 320freed.
286 321
287If there are, the coro object will stay around, and you can call C<< 322If there areany references, the Coro object will stay around, and you
288->join >> as many times as you wish to retrieve the result values: 323can call C<< ->join >> as many times as you wish to retrieve the result
324values:
289 325
290 async { 326 async {
291 print "hi\n"; 327 print "hi\n";
292 1 328 1
293 }; 329 };
330 366
331our $idle; # idle handler 367our $idle; # idle handler
332our $main; # main coro 368our $main; # main coro
333our $current; # current coro 369our $current; # current coro
334 370
335our $VERSION = 5.372; 371our $VERSION = 6.33;
336 372
337our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub rouse_cb rouse_wait); 373our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub rouse_cb rouse_wait);
338our %EXPORT_TAGS = ( 374our %EXPORT_TAGS = (
339 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 375 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
340); 376);
345=over 4 381=over 4
346 382
347=item $Coro::main 383=item $Coro::main
348 384
349This variable stores the Coro object that represents the main 385This variable stores the Coro object that represents the main
350program. While you cna C<ready> it and do most other things you can do to 386program. While you can C<ready> it and do most other things you can do to
351coro, it is mainly useful to compare again C<$Coro::current>, to see 387coro, it is mainly useful to compare again C<$Coro::current>, to see
352whether you are running in the main program or not. 388whether you are running in the main program or not.
353 389
354=cut 390=cut
355 391
712To avoid this, it is best to put a suspended coro into the ready queue 748To avoid this, it is best to put a suspended coro into the ready queue
713unconditionally, as every synchronisation mechanism must protect itself 749unconditionally, as every synchronisation mechanism must protect itself
714against spurious wakeups, and the one in the Coro family certainly do 750against spurious wakeups, and the one in the Coro family certainly do
715that. 751that.
716 752
753=item $state->is_new
754
755Returns true iff this Coro object is "new", i.e. has never been run
756yet. Those states basically consist of only the code reference to call and
757the arguments, but consumes very little other resources. New states will
758automatically get assigned a perl interpreter when they are transfered to.
759
760=item $state->is_zombie
761
762Returns true iff the Coro object has been cancelled, i.e.
763it's resources freed because they were C<cancel>'ed, C<terminate>'d,
764C<safe_cancel>'ed or simply went out of scope.
765
766The name "zombie" stems from UNIX culture, where a process that has
767exited and only stores and exit status and no other resources is called a
768"zombie".
769
717=item $is_ready = $coro->is_ready 770=item $is_ready = $coro->is_ready
718 771
719Returns true iff the Coro object is in the ready queue. Unless the Coro 772Returns true iff the Coro object is in the ready queue. Unless the Coro
720object gets destroyed, it will eventually be scheduled by the scheduler. 773object gets destroyed, it will eventually be scheduled by the scheduler.
721 774
737current Coro. 790current Coro.
738 791
739This is a rather brutal way to free a coro, with some limitations - if 792This is a rather brutal way to free a coro, with some limitations - if
740the thread is inside a C callback that doesn't expect to be canceled, 793the thread is inside a C callback that doesn't expect to be canceled,
741bad things can happen, or if the cancelled thread insists on running 794bad things can happen, or if the cancelled thread insists on running
742complicated cleanup handlers that rely on it'S thread context, things will 795complicated cleanup handlers that rely on its thread context, things will
743not work. 796not work.
744 797
745Sometimes it is safer to C<< ->throw >> an exception, or use C<< 798Any cleanup code being run (e.g. from C<guard> blocks) will be run without
746->safe_cancel >>. 799a thread context, and is not allowed to switch to other threads. On the
800plus side, C<< ->cancel >> will always clean up the thread, no matter
801what. If your cleanup code is complex or you want to avoid cancelling a
802C-thread that doesn't know how to clean up itself, it can be better to C<<
803->throw >> an exception, or use C<< ->safe_cancel >>.
747 804
748The arguments are not copied, but instead will be referenced directly 805The arguments to C<< ->cancel >> are not copied, but instead will
749(e.g. if you pass C<$var> and after the call change that variable, then 806be referenced directly (e.g. if you pass C<$var> and after the call
750you might change the return values passed to e.g. C<join>, so don't do 807change that variable, then you might change the return values passed to
751that). 808e.g. C<join>, so don't do that).
752 809
753The resources of the Coro are usually freed (or destructed) before this 810The resources of the Coro are usually freed (or destructed) before this
754call returns, but this can be delayed for an indefinite amount of time, as 811call returns, but this can be delayed for an indefinite amount of time, as
755in some cases the manager thread has to run first to actually destruct the 812in some cases the manager thread has to run first to actually destruct the
756Coro object. 813Coro object.
760Works mostly like C<< ->cancel >>, but is inherently "safer", and 817Works mostly like C<< ->cancel >>, but is inherently "safer", and
761consequently, can fail with an exception in cases the thread is not in a 818consequently, can fail with an exception in cases the thread is not in a
762cancellable state. 819cancellable state.
763 820
764This method works a bit like throwing an exception that cannot be caught 821This method works a bit like throwing an exception that cannot be caught
765- specifically, it will clean up the thread from within itself, so all 822- specifically, it will clean up the thread from within itself, so
766cleanup handlers (e.g. C<guard> blocks) are run with full thread context 823all cleanup handlers (e.g. C<guard> blocks) are run with full thread
767and can block if they wish. 824context and can block if they wish. The downside is that there is no
825guarantee that the thread can be cancelled when you call this method, and
826therefore, it might fail. It is also considerably slower than C<cancel> or
827C<terminate>.
768 828
769A thread is safe-cancellable if it either hasn't been run yet, or 829A thread is in a safe-cancellable state if it either hasn't been run yet,
770it has no C context attached and is inside an SLF function. 830or it has no C context attached and is inside an SLF function.
771 831
772The latter two basically mean that the thread isn't currently inside a 832The latter two basically mean that the thread isn't currently inside a
773perl callback called from some C function (usually XS modules) and isn't 833perl callback called from some C function (usually via some XS modules)
774currently inside some C function itself. 834and isn't currently executing inside some C function itself (via Coro's XS
835API).
775 836
776This call always returns true when it could cancel the thread, or croaks 837This call returns true when it could cancel the thread, or croaks with an
777with an error otherwise, so you can write things like this: 838error otherwise (i.e. it either returns true or doesn't return at all).
839
840Why the weird interface? Well, there are two common models on how and
841when to cancel things. In the first, you have the expectation that your
842coro thread can be cancelled when you want to cancel it - if the thread
843isn't cancellable, this would be a bug somewhere, so C<< ->safe_cancel >>
844croaks to notify of the bug.
845
846In the second model you sometimes want to ask nicely to cancel a thread,
847but if it's not a good time, well, then don't cancel. This can be done
848relatively easy like this:
778 849
779 if (! eval { $coro->safe_cancel }) { 850 if (! eval { $coro->safe_cancel }) {
780 warn "unable to cancel thread: $@"; 851 warn "unable to cancel thread: $@";
781 } 852 }
853
854However, what you never should do is first try to cancel "safely" and
855if that fails, cancel the "hard" way with C<< ->cancel >>. That makes
856no sense: either you rely on being able to execute cleanup code in your
857thread context, or you don't. If you do, then C<< ->safe_cancel >> is the
858only way, and if you don't, then C<< ->cancel >> is always faster and more
859direct.
782 860
783=item $coro->schedule_to 861=item $coro->schedule_to
784 862
785Puts the current coro to sleep (like C<Coro::schedule>), but instead 863Puts the current coro to sleep (like C<Coro::schedule>), but instead
786of continuing with the next coro from the ready queue, always switch to 864of continuing with the next coro from the ready queue, always switch to
805inside the coro at the next convenient point in time. Otherwise 883inside the coro at the next convenient point in time. Otherwise
806clears the exception object. 884clears the exception object.
807 885
808Coro will check for the exception each time a schedule-like-function 886Coro will check for the exception each time a schedule-like-function
809returns, i.e. after each C<schedule>, C<cede>, C<< Coro::Semaphore->down 887returns, i.e. after each C<schedule>, C<cede>, C<< Coro::Semaphore->down
810>>, C<< Coro::Handle->readable >> and so on. Most of these functions 888>>, C<< Coro::Handle->readable >> and so on. Most of those functions (all
811detect this case and return early in case an exception is pending. 889that are part of Coro itself) detect this case and return early in case an
890exception is pending.
812 891
813The exception object will be thrown "as is" with the specified scalar in 892The exception object will be thrown "as is" with the specified scalar in
814C<$@>, i.e. if it is a string, no line number or newline will be appended 893C<$@>, i.e. if it is a string, no line number or newline will be appended
815(unlike with C<die>). 894(unlike with C<die>).
816 895
817This can be used as a softer means than C<cancel> to ask a coro to 896This can be used as a softer means than either C<cancel> or C<safe_cancel
818end itself, although there is no guarantee that the exception will lead to 897>to ask a coro to end itself, although there is no guarantee that the
819termination, and if the exception isn't caught it might well end the whole 898exception will lead to termination, and if the exception isn't caught it
820program. 899might well end the whole program.
821 900
822You might also think of C<throw> as being the moral equivalent of 901You might also think of C<throw> as being the moral equivalent of
823C<kill>ing a coro with a signal (in this case, a scalar). 902C<kill>ing a coro with a signal (in this case, a scalar).
824 903
825=item $coro->join 904=item $coro->join
827Wait until the coro terminates and return any values given to the 906Wait until the coro terminates and return any values given to the
828C<terminate> or C<cancel> functions. C<join> can be called concurrently 907C<terminate> or C<cancel> functions. C<join> can be called concurrently
829from multiple threads, and all will be resumed and given the status 908from multiple threads, and all will be resumed and given the status
830return once the C<$coro> terminates. 909return once the C<$coro> terminates.
831 910
832=cut
833
834sub join {
835 my $self = shift;
836
837 unless ($self->{_status}) {
838 my $current = $current;
839
840 push @{$self->{_on_destroy}}, sub {
841 $current->ready;
842 undef $current;
843 };
844
845 &schedule while $current;
846 }
847
848 wantarray ? @{$self->{_status}} : $self->{_status}[0];
849}
850
851=item $coro->on_destroy (\&cb) 911=item $coro->on_destroy (\&cb)
852 912
853Registers a callback that is called when this coro thread gets destroyed, 913Registers a callback that is called when this coro thread gets destroyed,
854that is, after it's resources have been freed but before it is joined. The 914that is, after it's resources have been freed but before it is joined. The
855callback gets passed the terminate/cancel arguments, if any, and I<must 915callback gets passed the terminate/cancel arguments, if any, and I<must
856not> die, under any circumstances. 916not> die, under any circumstances.
857 917
858There can be any number of C<on_destroy> callbacks per coro, and there is 918There can be any number of C<on_destroy> callbacks per coro, and there is
859no way currently to remove a callback once added. 919currently no way to remove a callback once added.
860
861=cut
862
863sub on_destroy {
864 my ($self, $cb) = @_;
865
866 push @{ $self->{_on_destroy} }, $cb;
867}
868 920
869=item $oldprio = $coro->prio ($newprio) 921=item $oldprio = $coro->prio ($newprio)
870 922
871Sets (or gets, if the argument is missing) the priority of the 923Sets (or gets, if the argument is missing) the priority of the
872coro thread. Higher priority coro get run before lower priority 924coro thread. Higher priority coro get run before lower priority
899coro thread. This is just a free-form string you can associate with a 951coro thread. This is just a free-form string you can associate with a
900coro. 952coro.
901 953
902This method simply sets the C<< $coro->{desc} >> member to the given 954This method simply sets the C<< $coro->{desc} >> member to the given
903string. You can modify this member directly if you wish, and in fact, this 955string. You can modify this member directly if you wish, and in fact, this
904is often preferred to indicate major processing states that cna then be 956is often preferred to indicate major processing states that can then be
905seen for example in a L<Coro::Debug> session: 957seen for example in a L<Coro::Debug> session:
906 958
907 sub my_long_function { 959 sub my_long_function {
908 local $Coro::current->{desc} = "now in my_long_function"; 960 local $Coro::current->{desc} = "now in my_long_function";
909 ... 961 ...
1078But from within a coro, you often just want to write this: 1130But from within a coro, you often just want to write this:
1079 1131
1080 my $status = wait_for_child $pid; 1132 my $status = wait_for_child $pid;
1081 1133
1082Coro offers two functions specifically designed to make this easy, 1134Coro offers two functions specifically designed to make this easy,
1083C<Coro::rouse_cb> and C<Coro::rouse_wait>. 1135C<rouse_cb> and C<rouse_wait>.
1084 1136
1085The first function, C<rouse_cb>, generates and returns a callback that, 1137The first function, C<rouse_cb>, generates and returns a callback that,
1086when invoked, will save its arguments and notify the coro that 1138when invoked, will save its arguments and notify the coro that
1087created the callback. 1139created the callback.
1088 1140
1094function mentioned above: 1146function mentioned above:
1095 1147
1096 sub wait_for_child($) { 1148 sub wait_for_child($) {
1097 my ($pid) = @_; 1149 my ($pid) = @_;
1098 1150
1099 my $watcher = AnyEvent->child (pid => $pid, cb => Coro::rouse_cb); 1151 my $watcher = AnyEvent->child (pid => $pid, cb => rouse_cb);
1100 1152
1101 my ($rpid, $rstatus) = Coro::rouse_wait; 1153 my ($rpid, $rstatus) = rouse_wait;
1102 $rstatus 1154 $rstatus
1103 } 1155 }
1104 1156
1105In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough, 1157In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough,
1106you can roll your own, using C<schedule>: 1158you can roll your own, using C<schedule> and C<ready>:
1107 1159
1108 sub wait_for_child($) { 1160 sub wait_for_child($) {
1109 my ($pid) = @_; 1161 my ($pid) = @_;
1110 1162
1111 # store the current coro in $current, 1163 # store the current coro in $current,
1114 my ($done, $rstatus); 1166 my ($done, $rstatus);
1115 1167
1116 # pass a closure to ->child 1168 # pass a closure to ->child
1117 my $watcher = AnyEvent->child (pid => $pid, cb => sub { 1169 my $watcher = AnyEvent->child (pid => $pid, cb => sub {
1118 $rstatus = $_[1]; # remember rstatus 1170 $rstatus = $_[1]; # remember rstatus
1119 $done = 1; # mark $rstatus as valud 1171 $done = 1; # mark $rstatus as valid
1172 $current->ready; # wake up the waiting thread
1120 }); 1173 });
1121 1174
1122 # wait until the closure has been called 1175 # wait until the closure has been called
1123 schedule while !$done; 1176 schedule while !$done;
1124 1177
1143module from the first thread (this requirement might be removed in the 1196module from the first thread (this requirement might be removed in the
1144future to allow per-thread schedulers, but Coro::State does not yet allow 1197future to allow per-thread schedulers, but Coro::State does not yet allow
1145this). I recommend disabling thread support and using processes, as having 1198this). I recommend disabling thread support and using processes, as having
1146the windows process emulation enabled under unix roughly halves perl 1199the windows process emulation enabled under unix roughly halves perl
1147performance, even when not used. 1200performance, even when not used.
1201
1202Attempts to use threads created in another emulated process will crash
1203("cleanly", with a null pointer exception).
1148 1204
1149=item coro switching is not signal safe 1205=item coro switching is not signal safe
1150 1206
1151You must not switch to another coro from within a signal handler (only 1207You must not switch to another coro from within a signal handler (only
1152relevant with %SIG - most event libraries provide safe signals), I<unless> 1208relevant with %SIG - most event libraries provide safe signals), I<unless>

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines