ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/Coro/Coro.pm
(Generate patch)

Comparing Coro/Coro.pm (file contents):
Revision 1.287 by root, Sat Feb 19 06:51:22 2011 UTC vs.
Revision 1.311 by root, Fri Nov 30 08:12:37 2012 UTC

16 cede; # yield to coro 16 cede; # yield to coro
17 print "3\n"; 17 print "3\n";
18 cede; # and again 18 cede; # and again
19 19
20 # use locking 20 # use locking
21 use Coro::Semaphore;
22 my $lock = new Coro::Semaphore; 21 my $lock = new Coro::Semaphore;
23 my $locked; 22 my $locked;
24 23
25 $lock->down; 24 $lock->down;
26 $locked = 1; 25 $locked = 1;
90 } 1, 2, 3; 89 } 1, 2, 3;
91 90
92This creates a new coro thread and puts it into the ready queue, meaning 91This creates a new coro thread and puts it into the ready queue, meaning
93it will run as soon as the CPU is free for it. 92it will run as soon as the CPU is free for it.
94 93
95C<async> will return a coro object - you can store this for future 94C<async> will return a Coro object - you can store this for future
96reference or ignore it, the thread itself will keep a reference to it's 95reference or ignore it - a thread that is running, ready to run or waiting
97thread object - threads are alive on their own. 96for some event is alive on it's own.
98 97
99Another way to create a thread is to call the C<new> constructor with a 98Another way to create a thread is to call the C<new> constructor with a
100code-reference: 99code-reference:
101 100
102 new Coro sub { 101 new Coro sub {
131A lot can happen after the coro thread has started running. Quite usually, 130A lot can happen after the coro thread has started running. Quite usually,
132it will not run to the end in one go (because you could use a function 131it will not run to the end in one go (because you could use a function
133instead), but it will give up the CPU regularly because it waits for 132instead), but it will give up the CPU regularly because it waits for
134external events. 133external events.
135 134
136As long as a coro thread runs, it's coro object is available in the global 135As long as a coro thread runs, its Coro object is available in the global
137variable C<$Coro::current>. 136variable C<$Coro::current>.
138 137
139The low-level way to give up the CPU is to call the scheduler, which 138The low-level way to give up the CPU is to call the scheduler, which
140selects a new coro thread to run: 139selects a new coro thread to run:
141 140
196 195
197 async { 196 async {
198 Coro::terminate "return value 1", "return value 2"; 197 Coro::terminate "return value 1", "return value 2";
199 }; 198 };
200 199
201And yet another way is to C<< ->cancel >> the coro thread from another 200And yet another way is to C<< ->cancel >> (or C<< ->safe_cancel >>) the
202thread: 201coro thread from another thread:
203 202
204 my $coro = async { 203 my $coro = async {
205 exit 1; 204 exit 1;
206 }; 205 };
207 206
208 $coro->cancel; # an also accept values for ->join to retrieve 207 $coro->cancel; # also accepts values for ->join to retrieve
209 208
210Cancellation I<can> be dangerous - it's a bit like calling C<exit> without 209Cancellation I<can> be dangerous - it's a bit like calling C<exit> without
211actually exiting, and might leave C libraries and XS modules in a weird 210actually exiting, and might leave C libraries and XS modules in a weird
212state. Unlike other thread implementations, however, Coro is exceptionally 211state. Unlike other thread implementations, however, Coro is exceptionally
213safe with regards to cancellation, as perl will always be in a consistent 212safe with regards to cancellation, as perl will always be in a consistent
214state. 213state, and for those cases where you want to do truly marvellous things
214with your coro while it is being cancelled - that is, make sure all
215cleanup code is executed from the thread being cancelled - there is even a
216C<< ->safe_cancel >> method.
215 217
216So, cancelling a thread that runs in an XS event loop might not be the 218So, cancelling a thread that runs in an XS event loop might not be the
217best idea, but any other combination that deals with perl only (cancelling 219best idea, but any other combination that deals with perl only (cancelling
218when a thread is in a C<tie> method or an C<AUTOLOAD> for example) is 220when a thread is in a C<tie> method or an C<AUTOLOAD> for example) is
219safe. 221safe.
220 222
223Lastly, a coro thread object that isn't referenced is C<< ->cancel >>'ed
224automatically - just like other objects in Perl. This is not such a common
225case, however - a running thread is referencedy b C<$Coro::current>, a
226thread ready to run is referenced by the ready queue, a thread waiting
227on a lock or semaphore is referenced by being in some wait list and so
228on. But a thread that isn't in any of those queues gets cancelled:
229
230 async {
231 schedule; # cede to other coros, don't go into the ready queue
232 };
233
234 cede;
235 # now the async above is destroyed, as it is not referenced by anything.
236
221=item 5. Cleanup 237=item 5. Cleanup
222 238
223Threads will allocate various resources. Most but not all will be returned 239Threads will allocate various resources. Most but not all will be returned
224when a thread terminates, during clean-up. 240when a thread terminates, during clean-up.
225 241
248 # if we reutrn, or die or get cancelled, here, 264 # if we reutrn, or die or get cancelled, here,
249 # then the semaphore will be "up"ed. 265 # then the semaphore will be "up"ed.
250 }; 266 };
251 267
252The C<Guard::guard> function comes in handy for any custom cleanup you 268The C<Guard::guard> function comes in handy for any custom cleanup you
253might want to do: 269might want to do (but you cannot switch to other coroutines form those
270code blocks):
254 271
255 async { 272 async {
256 my $window = new Gtk2::Window "toplevel"; 273 my $window = new Gtk2::Window "toplevel";
257 # The window will not be cleaned up automatically, even when $window 274 # The window will not be cleaned up automatically, even when $window
258 # gets freed, so use a guard to ensure it's destruction 275 # gets freed, so use a guard to ensure it's destruction
271 # if we return or die here, the description will be restored 288 # if we return or die here, the description will be restored
272 } 289 }
273 290
274=item 6. Viva La Zombie Muerte 291=item 6. Viva La Zombie Muerte
275 292
276Even after a thread has terminated and cleaned up it's resources, the coro 293Even after a thread has terminated and cleaned up its resources, the Coro
277object still is there and stores the return values of the thread. Only in 294object still is there and stores the return values of the thread.
278this state will the coro object be "reference counted" in the normal perl
279sense: the thread code keeps a reference to it when it is active, but not
280after it has terminated.
281 295
282The means the coro object gets freed automatically when the thread has 296The means the Coro object gets freed automatically when the thread has
283terminated and cleaned up and there arenot other references. 297terminated and cleaned up and there arenot other references.
284 298
285If there are, the coro object will stay around, and you can call C<< 299If there are, the Coro object will stay around, and you can call C<<
286->join >> as many times as you wish to retrieve the result values: 300->join >> as many times as you wish to retrieve the result values:
287 301
288 async { 302 async {
289 print "hi\n"; 303 print "hi\n";
290 1 304 1
328 342
329our $idle; # idle handler 343our $idle; # idle handler
330our $main; # main coro 344our $main; # main coro
331our $current; # current coro 345our $current; # current coro
332 346
333our $VERSION = 5.37; 347our $VERSION = "6.10";
334 348
335our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub rouse_cb rouse_wait); 349our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub rouse_cb rouse_wait);
336our %EXPORT_TAGS = ( 350our %EXPORT_TAGS = (
337 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 351 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
338); 352);
399our @destroy; 413our @destroy;
400our $manager; 414our $manager;
401 415
402$manager = new Coro sub { 416$manager = new Coro sub {
403 while () { 417 while () {
404 Coro::State::cancel shift @destroy 418 _destroy shift @destroy
405 while @destroy; 419 while @destroy;
406 420
407 &schedule; 421 &schedule;
408 } 422 }
409}; 423};
543coro, regardless of priority. This is useful sometimes to ensure 557coro, regardless of priority. This is useful sometimes to ensure
544progress is made. 558progress is made.
545 559
546=item terminate [arg...] 560=item terminate [arg...]
547 561
548Terminates the current coro with the given status values (see L<cancel>). 562Terminates the current coro with the given status values (see
563L<cancel>). The values will not be copied, but referenced directly.
549 564
550=item Coro::on_enter BLOCK, Coro::on_leave BLOCK 565=item Coro::on_enter BLOCK, Coro::on_leave BLOCK
551 566
552These function install enter and leave winders in the current scope. The 567These function install enter and leave winders in the current scope. The
553enter block will be executed when on_enter is called and whenever the 568enter block will be executed when on_enter is called and whenever the
709To avoid this, it is best to put a suspended coro into the ready queue 724To avoid this, it is best to put a suspended coro into the ready queue
710unconditionally, as every synchronisation mechanism must protect itself 725unconditionally, as every synchronisation mechanism must protect itself
711against spurious wakeups, and the one in the Coro family certainly do 726against spurious wakeups, and the one in the Coro family certainly do
712that. 727that.
713 728
729=item $state->is_new
730
731Returns true iff this Coro object is "new", i.e. has never been run
732yet. Those states basically consist of only the code reference to call and
733the arguments, but consumes very little other resources. New states will
734automatically get assigned a perl interpreter when they are transfered to.
735
736=item $state->is_zombie
737
738Returns true iff the Coro object has been cancelled, i.e.
739it's resources freed because they were C<cancel>'ed, C<terminate>'d,
740C<safe_cancel>'ed or simply went out of scope.
741
742The name "zombie" stems from UNIX culture, where a process that has
743exited and only stores and exit status and no other resources is called a
744"zombie".
745
714=item $is_ready = $coro->is_ready 746=item $is_ready = $coro->is_ready
715 747
716Returns true iff the Coro object is in the ready queue. Unless the Coro 748Returns true iff the Coro object is in the ready queue. Unless the Coro
717object gets destroyed, it will eventually be scheduled by the scheduler. 749object gets destroyed, it will eventually be scheduled by the scheduler.
718 750
727Returns true iff this Coro object has been suspended. Suspended Coros will 759Returns true iff this Coro object has been suspended. Suspended Coros will
728not ever be scheduled. 760not ever be scheduled.
729 761
730=item $coro->cancel (arg...) 762=item $coro->cancel (arg...)
731 763
732Terminates the given Coro and makes it return the given arguments as 764Terminates the given Coro thread and makes it return the given arguments as
733status (default: the empty list). Never returns if the Coro is the 765status (default: an empty list). Never returns if the Coro is the
734current Coro. 766current Coro.
735 767
736=cut 768This is a rather brutal way to free a coro, with some limitations - if
769the thread is inside a C callback that doesn't expect to be canceled,
770bad things can happen, or if the cancelled thread insists on running
771complicated cleanup handlers that rely on its thread context, things will
772not work.
737 773
738sub cancel { 774Any cleanup code being run (e.g. from C<guard> blocks) will be run without
739 my $self = shift; 775a thread context, and is not allowed to switch to other threads. On the
776plus side, C<< ->cancel >> will always clean up the thread, no matter
777what. If your cleanup code is complex or you want to avoid cancelling a
778C-thread that doesn't know how to clean up itself, it can be better to C<<
779->throw >> an exception, or use C<< ->safe_cancel >>.
740 780
741 if ($current == $self) { 781The arguments to C<< ->cancel >> are not copied, but instead will
742 terminate @_; 782be referenced directly (e.g. if you pass C<$var> and after the call
743 } else { 783change that variable, then you might change the return values passed to
744 $self->{_status} = [@_]; 784e.g. C<join>, so don't do that).
745 Coro::State::cancel $self; 785
786The resources of the Coro are usually freed (or destructed) before this
787call returns, but this can be delayed for an indefinite amount of time, as
788in some cases the manager thread has to run first to actually destruct the
789Coro object.
790
791=item $coro->safe_cancel ($arg...)
792
793Works mostly like C<< ->cancel >>, but is inherently "safer", and
794consequently, can fail with an exception in cases the thread is not in a
795cancellable state.
796
797This method works a bit like throwing an exception that cannot be caught
798- specifically, it will clean up the thread from within itself, so
799all cleanup handlers (e.g. C<guard> blocks) are run with full thread
800context and can block if they wish. The downside is that there is no
801guarantee that the thread can be cancelled when you call this method, and
802therefore, it might fail. It is also considerably slower than C<cancel> or
803C<terminate>.
804
805A thread is in a safe-cancellable state if it either hasn't been run yet,
806or it has no C context attached and is inside an SLF function.
807
808The latter two basically mean that the thread isn't currently inside a
809perl callback called from some C function (usually via some XS modules)
810and isn't currently executing inside some C function itself (via Coro's XS
811API).
812
813This call returns true when it could cancel the thread, or croaks with an
814error otherwise (i.e. it either returns true or doesn't return at all).
815
816Why the weird interface? Well, there are two common models on how and
817when to cancel things. In the first, you have the expectation that your
818coro thread can be cancelled when you want to cancel it - if the thread
819isn't cancellable, this would be a bug somewhere, so C<< ->safe_cancel >>
820croaks to notify of the bug.
821
822In the second model you sometimes want to ask nicely to cancel a thread,
823but if it's not a good time, well, then don't cancel. This can be done
824relatively easy like this:
825
826 if (! eval { $coro->safe_cancel }) {
827 warn "unable to cancel thread: $@";
746 } 828 }
747} 829
830However, what you never should do is first try to cancel "safely" and
831if that fails, cancel the "hard" way with C<< ->cancel >>. That makes
832no sense: either you rely on being able to execute cleanup code in your
833thread context, or you don't. If you do, then C<< ->safe_cancel >> is the
834only way, and if you don't, then C<< ->cancel >> is always faster and more
835direct.
748 836
749=item $coro->schedule_to 837=item $coro->schedule_to
750 838
751Puts the current coro to sleep (like C<Coro::schedule>), but instead 839Puts the current coro to sleep (like C<Coro::schedule>), but instead
752of continuing with the next coro from the ready queue, always switch to 840of continuing with the next coro from the ready queue, always switch to
771inside the coro at the next convenient point in time. Otherwise 859inside the coro at the next convenient point in time. Otherwise
772clears the exception object. 860clears the exception object.
773 861
774Coro will check for the exception each time a schedule-like-function 862Coro will check for the exception each time a schedule-like-function
775returns, i.e. after each C<schedule>, C<cede>, C<< Coro::Semaphore->down 863returns, i.e. after each C<schedule>, C<cede>, C<< Coro::Semaphore->down
776>>, C<< Coro::Handle->readable >> and so on. Most of these functions 864>>, C<< Coro::Handle->readable >> and so on. Most of those functions (all
777detect this case and return early in case an exception is pending. 865that are part of Coro itself) detect this case and return early in case an
866exception is pending.
778 867
779The exception object will be thrown "as is" with the specified scalar in 868The exception object will be thrown "as is" with the specified scalar in
780C<$@>, i.e. if it is a string, no line number or newline will be appended 869C<$@>, i.e. if it is a string, no line number or newline will be appended
781(unlike with C<die>). 870(unlike with C<die>).
782 871
783This can be used as a softer means than C<cancel> to ask a coro to 872This can be used as a softer means than either C<cancel> or C<safe_cancel
784end itself, although there is no guarantee that the exception will lead to 873>to ask a coro to end itself, although there is no guarantee that the
785termination, and if the exception isn't caught it might well end the whole 874exception will lead to termination, and if the exception isn't caught it
786program. 875might well end the whole program.
787 876
788You might also think of C<throw> as being the moral equivalent of 877You might also think of C<throw> as being the moral equivalent of
789C<kill>ing a coro with a signal (in this case, a scalar). 878C<kill>ing a coro with a signal (in this case, a scalar).
790 879
791=item $coro->join 880=item $coro->join
792 881
793Wait until the coro terminates and return any values given to the 882Wait until the coro terminates and return any values given to the
794C<terminate> or C<cancel> functions. C<join> can be called concurrently 883C<terminate> or C<cancel> functions. C<join> can be called concurrently
795from multiple coro, and all will be resumed and given the status 884from multiple threads, and all will be resumed and given the status
796return once the C<$coro> terminates. 885return once the C<$coro> terminates.
797 886
798=cut
799
800sub join {
801 my $self = shift;
802
803 unless ($self->{_status}) {
804 my $current = $current;
805
806 push @{$self->{_on_destroy}}, sub {
807 $current->ready;
808 undef $current;
809 };
810
811 &schedule while $current;
812 }
813
814 wantarray ? @{$self->{_status}} : $self->{_status}[0];
815}
816
817=item $coro->on_destroy (\&cb) 887=item $coro->on_destroy (\&cb)
818 888
819Registers a callback that is called when this coro thread gets destroyed, 889Registers a callback that is called when this coro thread gets destroyed,
820but before it is joined. The callback gets passed the terminate arguments, 890that is, after it's resources have been freed but before it is joined. The
891callback gets passed the terminate/cancel arguments, if any, and I<must
821if any, and I<must not> die, under any circumstances. 892not> die, under any circumstances.
822 893
823There can be any number of C<on_destroy> callbacks per coro. 894There can be any number of C<on_destroy> callbacks per coro, and there is
824 895no way currently to remove a callback once added.
825=cut
826
827sub on_destroy {
828 my ($self, $cb) = @_;
829
830 push @{ $self->{_on_destroy} }, $cb;
831}
832 896
833=item $oldprio = $coro->prio ($newprio) 897=item $oldprio = $coro->prio ($newprio)
834 898
835Sets (or gets, if the argument is missing) the priority of the 899Sets (or gets, if the argument is missing) the priority of the
836coro thread. Higher priority coro get run before lower priority 900coro thread. Higher priority coro get run before lower priority
1065 my ($rpid, $rstatus) = Coro::rouse_wait; 1129 my ($rpid, $rstatus) = Coro::rouse_wait;
1066 $rstatus 1130 $rstatus
1067 } 1131 }
1068 1132
1069In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough, 1133In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough,
1070you can roll your own, using C<schedule>: 1134you can roll your own, using C<schedule> and C<ready>:
1071 1135
1072 sub wait_for_child($) { 1136 sub wait_for_child($) {
1073 my ($pid) = @_; 1137 my ($pid) = @_;
1074 1138
1075 # store the current coro in $current, 1139 # store the current coro in $current,
1078 my ($done, $rstatus); 1142 my ($done, $rstatus);
1079 1143
1080 # pass a closure to ->child 1144 # pass a closure to ->child
1081 my $watcher = AnyEvent->child (pid => $pid, cb => sub { 1145 my $watcher = AnyEvent->child (pid => $pid, cb => sub {
1082 $rstatus = $_[1]; # remember rstatus 1146 $rstatus = $_[1]; # remember rstatus
1083 $done = 1; # mark $rstatus as valud 1147 $done = 1; # mark $rstatus as valid
1148 $current->ready; # wake up the waiting thread
1084 }); 1149 });
1085 1150
1086 # wait until the closure has been called 1151 # wait until the closure has been called
1087 schedule while !$done; 1152 schedule while !$done;
1088 1153
1107module from the first thread (this requirement might be removed in the 1172module from the first thread (this requirement might be removed in the
1108future to allow per-thread schedulers, but Coro::State does not yet allow 1173future to allow per-thread schedulers, but Coro::State does not yet allow
1109this). I recommend disabling thread support and using processes, as having 1174this). I recommend disabling thread support and using processes, as having
1110the windows process emulation enabled under unix roughly halves perl 1175the windows process emulation enabled under unix roughly halves perl
1111performance, even when not used. 1176performance, even when not used.
1177
1178Attempts to use threads created in another emulated process will crash
1179("cleanly", with a null pointer exception).
1112 1180
1113=item coro switching is not signal safe 1181=item coro switching is not signal safe
1114 1182
1115You must not switch to another coro from within a signal handler (only 1183You must not switch to another coro from within a signal handler (only
1116relevant with %SIG - most event libraries provide safe signals), I<unless> 1184relevant with %SIG - most event libraries provide safe signals), I<unless>

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines