ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/cvsroot/Coro/Coro.pm
(Generate patch)

Comparing cvsroot/Coro/Coro.pm (file contents):
Revision 1.295 by root, Tue May 10 19:55:48 2011 UTC vs.
Revision 1.339 by root, Fri Oct 16 23:42:56 2015 UTC

16 cede; # yield to coro 16 cede; # yield to coro
17 print "3\n"; 17 print "3\n";
18 cede; # and again 18 cede; # and again
19 19
20 # use locking 20 # use locking
21 use Coro::Semaphore;
22 my $lock = new Coro::Semaphore; 21 my $lock = new Coro::Semaphore;
23 my $locked; 22 my $locked;
24 23
25 $lock->down; 24 $lock->down;
26 $locked = 1; 25 $locked = 1;
90 } 1, 2, 3; 89 } 1, 2, 3;
91 90
92This creates a new coro thread and puts it into the ready queue, meaning 91This creates a new coro thread and puts it into the ready queue, meaning
93it will run as soon as the CPU is free for it. 92it will run as soon as the CPU is free for it.
94 93
95C<async> will return a coro object - you can store this for future 94C<async> will return a Coro object - you can store this for future
96reference or ignore it, the thread itself will keep a reference to it's 95reference or ignore it - a thread that is running, ready to run or waiting
97thread object - threads are alive on their own. 96for some event is alive on it's own.
98 97
99Another way to create a thread is to call the C<new> constructor with a 98Another way to create a thread is to call the C<new> constructor with a
100code-reference: 99code-reference:
101 100
102 new Coro sub { 101 new Coro sub {
131A lot can happen after the coro thread has started running. Quite usually, 130A lot can happen after the coro thread has started running. Quite usually,
132it will not run to the end in one go (because you could use a function 131it will not run to the end in one go (because you could use a function
133instead), but it will give up the CPU regularly because it waits for 132instead), but it will give up the CPU regularly because it waits for
134external events. 133external events.
135 134
136As long as a coro thread runs, it's coro object is available in the global 135As long as a coro thread runs, its Coro object is available in the global
137variable C<$Coro::current>. 136variable C<$Coro::current>.
138 137
139The low-level way to give up the CPU is to call the scheduler, which 138The low-level way to give up the CPU is to call the scheduler, which
140selects a new coro thread to run: 139selects a new coro thread to run:
141 140
196 195
197 async { 196 async {
198 Coro::terminate "return value 1", "return value 2"; 197 Coro::terminate "return value 1", "return value 2";
199 }; 198 };
200 199
201And yet another way is to C<< ->cancel >> (or C<< ->safe_cancel >>) the 200Yet another way is to C<< ->cancel >> (or C<< ->safe_cancel >>) the coro
202coro thread from another thread: 201thread from another thread:
203 202
204 my $coro = async { 203 my $coro = async {
205 exit 1; 204 exit 1;
206 }; 205 };
207 206
219So, cancelling a thread that runs in an XS event loop might not be the 218So, cancelling a thread that runs in an XS event loop might not be the
220best idea, but any other combination that deals with perl only (cancelling 219best idea, but any other combination that deals with perl only (cancelling
221when a thread is in a C<tie> method or an C<AUTOLOAD> for example) is 220when a thread is in a C<tie> method or an C<AUTOLOAD> for example) is
222safe. 221safe.
223 222
223Last not least, a coro thread object that isn't referenced is C<<
224->cancel >>'ed automatically - just like other objects in Perl. This
225is not such a common case, however - a running thread is referencedy by
226C<$Coro::current>, a thread ready to run is referenced by the ready queue,
227a thread waiting on a lock or semaphore is referenced by being in some
228wait list and so on. But a thread that isn't in any of those queues gets
229cancelled:
230
231 async {
232 schedule; # cede to other coros, don't go into the ready queue
233 };
234
235 cede;
236 # now the async above is destroyed, as it is not referenced by anything.
237
238A slightly embellished example might make it clearer:
239
240 async {
241 my $guard = Guard::guard { print "destroyed\n" };
242 schedule while 1;
243 };
244
245 cede;
246
247Superficially one might not expect any output - since the C<async>
248implements an endless loop, the C<$guard> will not be cleaned up. However,
249since the thread object returned by C<async> is not stored anywhere, the
250thread is initially referenced because it is in the ready queue, when it
251runs it is referenced by C<$Coro::current>, but when it calls C<schedule>,
252it gets C<cancel>ed causing the guard object to be destroyed (see the next
253section), and printing it's message.
254
255If this seems a bit drastic, remember that this only happens when nothing
256references the thread anymore, which means there is no way to further
257execute it, ever. The only options at this point are leaking the thread,
258or cleaning it up, which brings us to...
259
224=item 5. Cleanup 260=item 5. Cleanup
225 261
226Threads will allocate various resources. Most but not all will be returned 262Threads will allocate various resources. Most but not all will be returned
227when a thread terminates, during clean-up. 263when a thread terminates, during clean-up.
228 264
246 282
247 my $sem = new Coro::Semaphore; 283 my $sem = new Coro::Semaphore;
248 284
249 async { 285 async {
250 my $lock_guard = $sem->guard; 286 my $lock_guard = $sem->guard;
251 # if we reutrn, or die or get cancelled, here, 287 # if we return, or die or get cancelled, here,
252 # then the semaphore will be "up"ed. 288 # then the semaphore will be "up"ed.
253 }; 289 };
254 290
255The C<Guard::guard> function comes in handy for any custom cleanup you 291The C<Guard::guard> function comes in handy for any custom cleanup you
256might want to do: 292might want to do (but you cannot switch to other coroutines from those
293code blocks):
257 294
258 async { 295 async {
259 my $window = new Gtk2::Window "toplevel"; 296 my $window = new Gtk2::Window "toplevel";
260 # The window will not be cleaned up automatically, even when $window 297 # The window will not be cleaned up automatically, even when $window
261 # gets freed, so use a guard to ensure it's destruction 298 # gets freed, so use a guard to ensure it's destruction
274 # if we return or die here, the description will be restored 311 # if we return or die here, the description will be restored
275 } 312 }
276 313
277=item 6. Viva La Zombie Muerte 314=item 6. Viva La Zombie Muerte
278 315
279Even after a thread has terminated and cleaned up it's resources, the coro 316Even after a thread has terminated and cleaned up its resources, the Coro
280object still is there and stores the return values of the thread. Only in 317object still is there and stores the return values of the thread.
281this state will the coro object be "reference counted" in the normal perl
282sense: the thread code keeps a reference to it when it is active, but not
283after it has terminated.
284 318
285The means the coro object gets freed automatically when the thread has 319When there are no other references, it will simply be cleaned up and
286terminated and cleaned up and there arenot other references. 320freed.
287 321
288If there are, the coro object will stay around, and you can call C<< 322If there areany references, the Coro object will stay around, and you
289->join >> as many times as you wish to retrieve the result values: 323can call C<< ->join >> as many times as you wish to retrieve the result
324values:
290 325
291 async { 326 async {
292 print "hi\n"; 327 print "hi\n";
293 1 328 1
294 }; 329 };
331 366
332our $idle; # idle handler 367our $idle; # idle handler
333our $main; # main coro 368our $main; # main coro
334our $current; # current coro 369our $current; # current coro
335 370
336our $VERSION = 5.372; 371our $VERSION = 6.49;
337 372
338our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub rouse_cb rouse_wait); 373our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub rouse_cb rouse_wait);
339our %EXPORT_TAGS = ( 374our %EXPORT_TAGS = (
340 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 375 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
341); 376);
346=over 4 381=over 4
347 382
348=item $Coro::main 383=item $Coro::main
349 384
350This variable stores the Coro object that represents the main 385This variable stores the Coro object that represents the main
351program. While you cna C<ready> it and do most other things you can do to 386program. While you can C<ready> it and do most other things you can do to
352coro, it is mainly useful to compare again C<$Coro::current>, to see 387coro, it is mainly useful to compare again C<$Coro::current>, to see
353whether you are running in the main program or not. 388whether you are running in the main program or not.
354 389
355=cut 390=cut
356 391
617 Coro::on_enter { 652 Coro::on_enter {
618 # on entering the thread, we set an VTALRM handler to cede 653 # on entering the thread, we set an VTALRM handler to cede
619 $SIG{VTALRM} = sub { cede }; 654 $SIG{VTALRM} = sub { cede };
620 # and then start the interval timer 655 # and then start the interval timer
621 Time::HiRes::setitimer &Time::HiRes::ITIMER_VIRTUAL, 0.01, 0.01; 656 Time::HiRes::setitimer &Time::HiRes::ITIMER_VIRTUAL, 0.01, 0.01;
622 }; 657 };
623 Coro::on_leave { 658 Coro::on_leave {
624 # on leaving the thread, we stop the interval timer again 659 # on leaving the thread, we stop the interval timer again
625 Time::HiRes::setitimer &Time::HiRes::ITIMER_VIRTUAL, 0, 0; 660 Time::HiRes::setitimer &Time::HiRes::ITIMER_VIRTUAL, 0, 0;
626 }; 661 };
627 662
628 &{+shift}; 663 &{+shift};
629 } 664 }
630 665
631 # use like this: 666 # use like this:
632 timeslice { 667 timeslice {
633 # The following is an endless loop that would normally 668 # The following is an endless loop that would normally
634 # monopolise the process. Since it runs in a timesliced 669 # monopolise the process. Since it runs in a timesliced
635 # environment, it will regularly cede to other threads. 670 # environment, it will regularly cede to other threads.
636 while () { } 671 while () { }
637 }; 672 };
638 673
639 674
640=item killall 675=item killall
641 676
642Kills/terminates/cancels all coros except the currently running one. 677Kills/terminates/cancels all coros except the currently running one.
713To avoid this, it is best to put a suspended coro into the ready queue 748To avoid this, it is best to put a suspended coro into the ready queue
714unconditionally, as every synchronisation mechanism must protect itself 749unconditionally, as every synchronisation mechanism must protect itself
715against spurious wakeups, and the one in the Coro family certainly do 750against spurious wakeups, and the one in the Coro family certainly do
716that. 751that.
717 752
753=item $state->is_new
754
755Returns true iff this Coro object is "new", i.e. has never been run
756yet. Those states basically consist of only the code reference to call and
757the arguments, but consumes very little other resources. New states will
758automatically get assigned a perl interpreter when they are transfered to.
759
760=item $state->is_zombie
761
762Returns true iff the Coro object has been cancelled, i.e.
763it's resources freed because they were C<cancel>'ed, C<terminate>'d,
764C<safe_cancel>'ed or simply went out of scope.
765
766The name "zombie" stems from UNIX culture, where a process that has
767exited and only stores and exit status and no other resources is called a
768"zombie".
769
718=item $is_ready = $coro->is_ready 770=item $is_ready = $coro->is_ready
719 771
720Returns true iff the Coro object is in the ready queue. Unless the Coro 772Returns true iff the Coro object is in the ready queue. Unless the Coro
721object gets destroyed, it will eventually be scheduled by the scheduler. 773object gets destroyed, it will eventually be scheduled by the scheduler.
722 774
738current Coro. 790current Coro.
739 791
740This is a rather brutal way to free a coro, with some limitations - if 792This is a rather brutal way to free a coro, with some limitations - if
741the thread is inside a C callback that doesn't expect to be canceled, 793the thread is inside a C callback that doesn't expect to be canceled,
742bad things can happen, or if the cancelled thread insists on running 794bad things can happen, or if the cancelled thread insists on running
743complicated cleanup handlers that rely on it'S thread context, things will 795complicated cleanup handlers that rely on its thread context, things will
744not work. 796not work.
745 797
746Any cleanup code being run (e.g. from C<guard> blocks) will be run without 798Any cleanup code being run (e.g. from C<guard> blocks, destructors and so
747a thread context, and is not allowed to switch to other threads. On the 799on) will be run without a thread context, and is not allowed to switch
800to other threads. A common mistake is to call C<< ->cancel >> from a
801destructor called by die'ing inside the thread to be cancelled for
802example.
803
748plus side, C<< ->cancel >> will always clean up the thread, no matter 804On the plus side, C<< ->cancel >> will always clean up the thread, no
749what. If your cleanup code is complex or you want to avoid cancelling a 805matter what. If your cleanup code is complex or you want to avoid
750C-thread that doesn't know how to clean up itself, it can be better to C<< 806cancelling a C-thread that doesn't know how to clean up itself, it can be
751->throw >> an exception, or use C<< ->safe_cancel >>. 807better to C<< ->throw >> an exception, or use C<< ->safe_cancel >>.
752 808
753The arguments to C<< ->cancel >> are not copied, but instead will 809The arguments to C<< ->cancel >> are not copied, but instead will
754be referenced directly (e.g. if you pass C<$var> and after the call 810be referenced directly (e.g. if you pass C<$var> and after the call
755change that variable, then you might change the return values passed to 811change that variable, then you might change the return values passed to
756e.g. C<join>, so don't do that). 812e.g. C<join>, so don't do that).
762 818
763=item $coro->safe_cancel ($arg...) 819=item $coro->safe_cancel ($arg...)
764 820
765Works mostly like C<< ->cancel >>, but is inherently "safer", and 821Works mostly like C<< ->cancel >>, but is inherently "safer", and
766consequently, can fail with an exception in cases the thread is not in a 822consequently, can fail with an exception in cases the thread is not in a
767cancellable state. 823cancellable state. Essentially, C<< ->safe_cancel >> is a C<< ->cancel >>
824with extra checks before canceling.
768 825
769This method works a bit like throwing an exception that cannot be caught 826It works a bit like throwing an exception that cannot be caught -
770- specifically, it will clean up the thread from within itself, so 827specifically, it will clean up the thread from within itself, so all
771all cleanup handlers (e.g. C<guard> blocks) are run with full thread 828cleanup handlers (e.g. C<guard> blocks) are run with full thread
772context and can block if they wish. The downside is that there is no 829context and can block if they wish. The downside is that there is no
773guarantee that the thread can be cancelled when you call this method, and 830guarantee that the thread can be cancelled when you call this method, and
774therefore, it might fail. It is also considerably slower than C<cancel> or 831therefore, it might fail. It is also considerably slower than C<cancel> or
775C<terminate>. 832C<terminate>.
776 833
854Wait until the coro terminates and return any values given to the 911Wait until the coro terminates and return any values given to the
855C<terminate> or C<cancel> functions. C<join> can be called concurrently 912C<terminate> or C<cancel> functions. C<join> can be called concurrently
856from multiple threads, and all will be resumed and given the status 913from multiple threads, and all will be resumed and given the status
857return once the C<$coro> terminates. 914return once the C<$coro> terminates.
858 915
859=cut
860
861sub join {
862 my $self = shift;
863
864 unless ($self->{_status}) {
865 my $current = $current;
866
867 push @{$self->{_on_destroy}}, sub {
868 $current->ready;
869 undef $current;
870 };
871
872 &schedule while $current;
873 }
874
875 wantarray ? @{$self->{_status}} : $self->{_status}[0]
876}
877
878=item $coro->on_destroy (\&cb) 916=item $coro->on_destroy (\&cb)
879 917
880Registers a callback that is called when this coro thread gets destroyed, 918Registers a callback that is called when this coro thread gets destroyed,
881that is, after it's resources have been freed but before it is joined. The 919that is, after it's resources have been freed but before it is joined. The
882callback gets passed the terminate/cancel arguments, if any, and I<must 920callback gets passed the terminate/cancel arguments, if any, and I<must
883not> die, under any circumstances. 921not> die, under any circumstances.
884 922
885There can be any number of C<on_destroy> callbacks per coro, and there is 923There can be any number of C<on_destroy> callbacks per coro, and there is
886no way currently to remove a callback once added. 924currently no way to remove a callback once added.
887
888=cut
889
890sub on_destroy {
891 my ($self, $cb) = @_;
892
893 push @{ $self->{_on_destroy} }, $cb;
894}
895 925
896=item $oldprio = $coro->prio ($newprio) 926=item $oldprio = $coro->prio ($newprio)
897 927
898Sets (or gets, if the argument is missing) the priority of the 928Sets (or gets, if the argument is missing) the priority of the
899coro thread. Higher priority coro get run before lower priority 929coro thread. Higher priority coro get run before lower priority
926coro thread. This is just a free-form string you can associate with a 956coro thread. This is just a free-form string you can associate with a
927coro. 957coro.
928 958
929This method simply sets the C<< $coro->{desc} >> member to the given 959This method simply sets the C<< $coro->{desc} >> member to the given
930string. You can modify this member directly if you wish, and in fact, this 960string. You can modify this member directly if you wish, and in fact, this
931is often preferred to indicate major processing states that cna then be 961is often preferred to indicate major processing states that can then be
932seen for example in a L<Coro::Debug> session: 962seen for example in a L<Coro::Debug> session:
933 963
934 sub my_long_function { 964 sub my_long_function {
935 local $Coro::current->{desc} = "now in my_long_function"; 965 local $Coro::current->{desc} = "now in my_long_function";
936 ... 966 ...
991otherwise you might suffer from crashes or worse. The only event library 1021otherwise you might suffer from crashes or worse. The only event library
992currently known that is safe to use without C<unblock_sub> is L<EV> (but 1022currently known that is safe to use without C<unblock_sub> is L<EV> (but
993you might still run into deadlocks if all event loops are blocked). 1023you might still run into deadlocks if all event loops are blocked).
994 1024
995Coro will try to catch you when you block in the event loop 1025Coro will try to catch you when you block in the event loop
996("FATAL:$Coro::IDLE blocked itself"), but this is just best effort and 1026("FATAL: $Coro::idle blocked itself"), but this is just best effort and
997only works when you do not run your own event loop. 1027only works when you do not run your own event loop.
998 1028
999This function allows your callbacks to block by executing them in another 1029This function allows your callbacks to block by executing them in another
1000coro where it is safe to block. One example where blocking is handy 1030coro where it is safe to block. One example where blocking is handy
1001is when you use the L<Coro::AIO|Coro::AIO> functions to save results to 1031is when you use the L<Coro::AIO|Coro::AIO> functions to save results to
1105But from within a coro, you often just want to write this: 1135But from within a coro, you often just want to write this:
1106 1136
1107 my $status = wait_for_child $pid; 1137 my $status = wait_for_child $pid;
1108 1138
1109Coro offers two functions specifically designed to make this easy, 1139Coro offers two functions specifically designed to make this easy,
1110C<Coro::rouse_cb> and C<Coro::rouse_wait>. 1140C<rouse_cb> and C<rouse_wait>.
1111 1141
1112The first function, C<rouse_cb>, generates and returns a callback that, 1142The first function, C<rouse_cb>, generates and returns a callback that,
1113when invoked, will save its arguments and notify the coro that 1143when invoked, will save its arguments and notify the coro that
1114created the callback. 1144created the callback.
1115 1145
1121function mentioned above: 1151function mentioned above:
1122 1152
1123 sub wait_for_child($) { 1153 sub wait_for_child($) {
1124 my ($pid) = @_; 1154 my ($pid) = @_;
1125 1155
1126 my $watcher = AnyEvent->child (pid => $pid, cb => Coro::rouse_cb); 1156 my $watcher = AnyEvent->child (pid => $pid, cb => rouse_cb);
1127 1157
1128 my ($rpid, $rstatus) = Coro::rouse_wait; 1158 my ($rpid, $rstatus) = rouse_wait;
1129 $rstatus 1159 $rstatus
1130 } 1160 }
1131 1161
1132In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough, 1162In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough,
1133you can roll your own, using C<schedule>: 1163you can roll your own, using C<schedule> and C<ready>:
1134 1164
1135 sub wait_for_child($) { 1165 sub wait_for_child($) {
1136 my ($pid) = @_; 1166 my ($pid) = @_;
1137 1167
1138 # store the current coro in $current, 1168 # store the current coro in $current,
1141 my ($done, $rstatus); 1171 my ($done, $rstatus);
1142 1172
1143 # pass a closure to ->child 1173 # pass a closure to ->child
1144 my $watcher = AnyEvent->child (pid => $pid, cb => sub { 1174 my $watcher = AnyEvent->child (pid => $pid, cb => sub {
1145 $rstatus = $_[1]; # remember rstatus 1175 $rstatus = $_[1]; # remember rstatus
1146 $done = 1; # mark $rstatus as valud 1176 $done = 1; # mark $rstatus as valid
1177 $current->ready; # wake up the waiting thread
1147 }); 1178 });
1148 1179
1149 # wait until the closure has been called 1180 # wait until the closure has been called
1150 schedule while !$done; 1181 schedule while !$done;
1151 1182
1170module from the first thread (this requirement might be removed in the 1201module from the first thread (this requirement might be removed in the
1171future to allow per-thread schedulers, but Coro::State does not yet allow 1202future to allow per-thread schedulers, but Coro::State does not yet allow
1172this). I recommend disabling thread support and using processes, as having 1203this). I recommend disabling thread support and using processes, as having
1173the windows process emulation enabled under unix roughly halves perl 1204the windows process emulation enabled under unix roughly halves perl
1174performance, even when not used. 1205performance, even when not used.
1206
1207Attempts to use threads created in another emulated process will crash
1208("cleanly", with a null pointer exception).
1175 1209
1176=item coro switching is not signal safe 1210=item coro switching is not signal safe
1177 1211
1178You must not switch to another coro from within a signal handler (only 1212You must not switch to another coro from within a signal handler (only
1179relevant with %SIG - most event libraries provide safe signals), I<unless> 1213relevant with %SIG - most event libraries provide safe signals), I<unless>
1267 1301
1268XS API: L<Coro::MakeMaker>. 1302XS API: L<Coro::MakeMaker>.
1269 1303
1270Low level Configuration, Thread Environment, Continuations: L<Coro::State>. 1304Low level Configuration, Thread Environment, Continuations: L<Coro::State>.
1271 1305
1272=head1 AUTHOR 1306=head1 AUTHOR/SUPPORT/CONTACT
1273 1307
1274 Marc Lehmann <schmorp@schmorp.de> 1308 Marc A. Lehmann <schmorp@schmorp.de>
1275 http://home.schmorp.de/ 1309 http://software.schmorp.de/pkg/Coro.html
1276 1310
1277=cut 1311=cut
1278 1312

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines