ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/Coro/README
(Generate patch)

Comparing Coro/README (file contents):
Revision 1.29 by root, Sat Feb 19 06:51:22 2011 UTC vs.
Revision 1.33 by root, Tue Mar 4 06:13:24 2014 UTC

14 cede; # yield to coro 14 cede; # yield to coro
15 print "3\n"; 15 print "3\n";
16 cede; # and again 16 cede; # and again
17 17
18 # use locking 18 # use locking
19 use Coro::Semaphore;
20 my $lock = new Coro::Semaphore; 19 my $lock = new Coro::Semaphore;
21 my $locked; 20 my $locked;
22 21
23 $lock->down; 22 $lock->down;
24 $locked = 1; 23 $locked = 1;
84 } 1, 2, 3; 83 } 1, 2, 3;
85 84
86 This creates a new coro thread and puts it into the ready queue, 85 This creates a new coro thread and puts it into the ready queue,
87 meaning it will run as soon as the CPU is free for it. 86 meaning it will run as soon as the CPU is free for it.
88 87
89 "async" will return a coro object - you can store this for future 88 "async" will return a Coro object - you can store this for future
90 reference or ignore it, the thread itself will keep a reference to 89 reference or ignore it - a thread that is running, ready to run or
91 it's thread object - threads are alive on their own. 90 waiting for some event is alive on it's own.
92 91
93 Another way to create a thread is to call the "new" constructor with 92 Another way to create a thread is to call the "new" constructor with
94 a code-reference: 93 a code-reference:
95 94
96 new Coro sub { 95 new Coro sub {
123 A lot can happen after the coro thread has started running. Quite 122 A lot can happen after the coro thread has started running. Quite
124 usually, it will not run to the end in one go (because you could use 123 usually, it will not run to the end in one go (because you could use
125 a function instead), but it will give up the CPU regularly because 124 a function instead), but it will give up the CPU regularly because
126 it waits for external events. 125 it waits for external events.
127 126
128 As long as a coro thread runs, it's coro object is available in the 127 As long as a coro thread runs, its Coro object is available in the
129 global variable $Coro::current. 128 global variable $Coro::current.
130 129
131 The low-level way to give up the CPU is to call the scheduler, which 130 The low-level way to give up the CPU is to call the scheduler, which
132 selects a new coro thread to run: 131 selects a new coro thread to run:
133 132
187 186
188 async { 187 async {
189 Coro::terminate "return value 1", "return value 2"; 188 Coro::terminate "return value 1", "return value 2";
190 }; 189 };
191 190
192 And yet another way is to "->cancel" the coro thread from another 191 Yet another way is to "->cancel" (or "->safe_cancel") the coro
193 thread: 192 thread from another thread:
194 193
195 my $coro = async { 194 my $coro = async {
196 exit 1; 195 exit 1;
197 }; 196 };
198 197
199 $coro->cancel; # an also accept values for ->join to retrieve 198 $coro->cancel; # also accepts values for ->join to retrieve
200 199
201 Cancellation *can* be dangerous - it's a bit like calling "exit" 200 Cancellation *can* be dangerous - it's a bit like calling "exit"
202 without actually exiting, and might leave C libraries and XS modules 201 without actually exiting, and might leave C libraries and XS modules
203 in a weird state. Unlike other thread implementations, however, Coro 202 in a weird state. Unlike other thread implementations, however, Coro
204 is exceptionally safe with regards to cancellation, as perl will 203 is exceptionally safe with regards to cancellation, as perl will
205 always be in a consistent state. 204 always be in a consistent state, and for those cases where you want
205 to do truly marvellous things with your coro while it is being
206 cancelled - that is, make sure all cleanup code is executed from the
207 thread being cancelled - there is even a "->safe_cancel" method.
206 208
207 So, cancelling a thread that runs in an XS event loop might not be 209 So, cancelling a thread that runs in an XS event loop might not be
208 the best idea, but any other combination that deals with perl only 210 the best idea, but any other combination that deals with perl only
209 (cancelling when a thread is in a "tie" method or an "AUTOLOAD" for 211 (cancelling when a thread is in a "tie" method or an "AUTOLOAD" for
210 example) is safe. 212 example) is safe.
211 213
214 Last not least, a coro thread object that isn't referenced is
215 "->cancel"'ed automatically - just like other objects in Perl. This
216 is not such a common case, however - a running thread is referencedy
217 by $Coro::current, a thread ready to run is referenced by the ready
218 queue, a thread waiting on a lock or semaphore is referenced by
219 being in some wait list and so on. But a thread that isn't in any of
220 those queues gets cancelled:
221
222 async {
223 schedule; # cede to other coros, don't go into the ready queue
224 };
225
226 cede;
227 # now the async above is destroyed, as it is not referenced by anything.
228
229 A slightly embellished example might make it clearer:
230
231 async {
232 my $guard = Guard::guard { print "destroyed\n" };
233 schedule while 1;
234 };
235
236 cede;
237
238 Superficially one might not expect any output - since the "async"
239 implements an endless loop, the $guard will not be cleaned up.
240 However, since the thread object returned by "async" is not stored
241 anywhere, the thread is initially referenced because it is in the
242 ready queue, when it runs it is referenced by $Coro::current, but
243 when it calls "schedule", it gets "cancel"ed causing the guard
244 object to be destroyed (see the next section), and printing it's
245 message.
246
247 If this seems a bit drastic, remember that this only happens when
248 nothing references the thread anymore, which means there is no way
249 to further execute it, ever. The only options at this point are
250 leaking the thread, or cleaning it up, which brings us to...
251
212 5. Cleanup 252 5. Cleanup
213 Threads will allocate various resources. Most but not all will be 253 Threads will allocate various resources. Most but not all will be
214 returned when a thread terminates, during clean-up. 254 returned when a thread terminates, during clean-up.
215 255
216 Cleanup is quite similar to throwing an uncaught exception: perl 256 Cleanup is quite similar to throwing an uncaught exception: perl
233 273
234 my $sem = new Coro::Semaphore; 274 my $sem = new Coro::Semaphore;
235 275
236 async { 276 async {
237 my $lock_guard = $sem->guard; 277 my $lock_guard = $sem->guard;
238 # if we reutrn, or die or get cancelled, here, 278 # if we return, or die or get cancelled, here,
239 # then the semaphore will be "up"ed. 279 # then the semaphore will be "up"ed.
240 }; 280 };
241 281
242 The "Guard::guard" function comes in handy for any custom cleanup 282 The "Guard::guard" function comes in handy for any custom cleanup
243 you might want to do: 283 you might want to do (but you cannot switch to other coroutines from
284 those code blocks):
244 285
245 async { 286 async {
246 my $window = new Gtk2::Window "toplevel"; 287 my $window = new Gtk2::Window "toplevel";
247 # The window will not be cleaned up automatically, even when $window 288 # The window will not be cleaned up automatically, even when $window
248 # gets freed, so use a guard to ensure it's destruction 289 # gets freed, so use a guard to ensure it's destruction
260 301
261 # if we return or die here, the description will be restored 302 # if we return or die here, the description will be restored
262 } 303 }
263 304
264 6. Viva La Zombie Muerte 305 6. Viva La Zombie Muerte
265 Even after a thread has terminated and cleaned up it's resources, 306 Even after a thread has terminated and cleaned up its resources, the
266 the coro object still is there and stores the return values of the 307 Coro object still is there and stores the return values of the
267 thread. Only in this state will the coro object be "reference 308 thread.
268 counted" in the normal perl sense: the thread code keeps a reference
269 to it when it is active, but not after it has terminated.
270 309
271 The means the coro object gets freed automatically when the thread 310 When there are no other references, it will simply be cleaned up and
272 has terminated and cleaned up and there arenot other references. 311 freed.
273 312
274 If there are, the coro object will stay around, and you can call 313 If there areany references, the Coro object will stay around, and
275 "->join" as many times as you wish to retrieve the result values: 314 you can call "->join" as many times as you wish to retrieve the
315 result values:
276 316
277 async { 317 async {
278 print "hi\n"; 318 print "hi\n";
279 1 319 1
280 }; 320 };
300 }; 340 };
301 341
302GLOBAL VARIABLES 342GLOBAL VARIABLES
303 $Coro::main 343 $Coro::main
304 This variable stores the Coro object that represents the main 344 This variable stores the Coro object that represents the main
305 program. While you cna "ready" it and do most other things you can 345 program. While you can "ready" it and do most other things you can
306 do to coro, it is mainly useful to compare again $Coro::current, to 346 do to coro, it is mainly useful to compare again $Coro::current, to
307 see whether you are running in the main program or not. 347 see whether you are running in the main program or not.
308 348
309 $Coro::current 349 $Coro::current
310 The Coro object representing the current coro (the last coro that 350 The Coro object representing the current coro (the last coro that
438 *any* coro, regardless of priority. This is useful sometimes to 478 *any* coro, regardless of priority. This is useful sometimes to
439 ensure progress is made. 479 ensure progress is made.
440 480
441 terminate [arg...] 481 terminate [arg...]
442 Terminates the current coro with the given status values (see 482 Terminates the current coro with the given status values (see
443 cancel). 483 cancel). The values will not be copied, but referenced directly.
444 484
445 Coro::on_enter BLOCK, Coro::on_leave BLOCK 485 Coro::on_enter BLOCK, Coro::on_leave BLOCK
446 These function install enter and leave winders in the current scope. 486 These function install enter and leave winders in the current scope.
447 The enter block will be executed when on_enter is called and 487 The enter block will be executed when on_enter is called and
448 whenever the current coro is re-entered by the scheduler, while the 488 whenever the current coro is re-entered by the scheduler, while the
509 Coro::on_enter { 549 Coro::on_enter {
510 # on entering the thread, we set an VTALRM handler to cede 550 # on entering the thread, we set an VTALRM handler to cede
511 $SIG{VTALRM} = sub { cede }; 551 $SIG{VTALRM} = sub { cede };
512 # and then start the interval timer 552 # and then start the interval timer
513 Time::HiRes::setitimer &Time::HiRes::ITIMER_VIRTUAL, 0.01, 0.01; 553 Time::HiRes::setitimer &Time::HiRes::ITIMER_VIRTUAL, 0.01, 0.01;
514 }; 554 };
515 Coro::on_leave { 555 Coro::on_leave {
516 # on leaving the thread, we stop the interval timer again 556 # on leaving the thread, we stop the interval timer again
517 Time::HiRes::setitimer &Time::HiRes::ITIMER_VIRTUAL, 0, 0; 557 Time::HiRes::setitimer &Time::HiRes::ITIMER_VIRTUAL, 0, 0;
518 }; 558 };
519 559
520 &{+shift}; 560 &{+shift};
521 } 561 }
522 562
523 # use like this: 563 # use like this:
524 timeslice { 564 timeslice {
525 # The following is an endless loop that would normally 565 # The following is an endless loop that would normally
526 # monopolise the process. Since it runs in a timesliced 566 # monopolise the process. Since it runs in a timesliced
580 To avoid this, it is best to put a suspended coro into the ready 620 To avoid this, it is best to put a suspended coro into the ready
581 queue unconditionally, as every synchronisation mechanism must 621 queue unconditionally, as every synchronisation mechanism must
582 protect itself against spurious wakeups, and the one in the Coro 622 protect itself against spurious wakeups, and the one in the Coro
583 family certainly do that. 623 family certainly do that.
584 624
625 $state->is_new
626 Returns true iff this Coro object is "new", i.e. has never been run
627 yet. Those states basically consist of only the code reference to
628 call and the arguments, but consumes very little other resources.
629 New states will automatically get assigned a perl interpreter when
630 they are transfered to.
631
632 $state->is_zombie
633 Returns true iff the Coro object has been cancelled, i.e. it's
634 resources freed because they were "cancel"'ed, "terminate"'d,
635 "safe_cancel"'ed or simply went out of scope.
636
637 The name "zombie" stems from UNIX culture, where a process that has
638 exited and only stores and exit status and no other resources is
639 called a "zombie".
640
585 $is_ready = $coro->is_ready 641 $is_ready = $coro->is_ready
586 Returns true iff the Coro object is in the ready queue. Unless the 642 Returns true iff the Coro object is in the ready queue. Unless the
587 Coro object gets destroyed, it will eventually be scheduled by the 643 Coro object gets destroyed, it will eventually be scheduled by the
588 scheduler. 644 scheduler.
589 645
595 $is_suspended = $coro->is_suspended 651 $is_suspended = $coro->is_suspended
596 Returns true iff this Coro object has been suspended. Suspended 652 Returns true iff this Coro object has been suspended. Suspended
597 Coros will not ever be scheduled. 653 Coros will not ever be scheduled.
598 654
599 $coro->cancel (arg...) 655 $coro->cancel (arg...)
600 Terminates the given Coro and makes it return the given arguments as 656 Terminates the given Coro thread and makes it return the given
601 status (default: the empty list). Never returns if the Coro is the 657 arguments as status (default: an empty list). Never returns if the
602 current Coro. 658 Coro is the current Coro.
659
660 This is a rather brutal way to free a coro, with some limitations -
661 if the thread is inside a C callback that doesn't expect to be
662 canceled, bad things can happen, or if the cancelled thread insists
663 on running complicated cleanup handlers that rely on its thread
664 context, things will not work.
665
666 Any cleanup code being run (e.g. from "guard" blocks) will be run
667 without a thread context, and is not allowed to switch to other
668 threads. On the plus side, "->cancel" will always clean up the
669 thread, no matter what. If your cleanup code is complex or you want
670 to avoid cancelling a C-thread that doesn't know how to clean up
671 itself, it can be better to "->throw" an exception, or use
672 "->safe_cancel".
673
674 The arguments to "->cancel" are not copied, but instead will be
675 referenced directly (e.g. if you pass $var and after the call change
676 that variable, then you might change the return values passed to
677 e.g. "join", so don't do that).
678
679 The resources of the Coro are usually freed (or destructed) before
680 this call returns, but this can be delayed for an indefinite amount
681 of time, as in some cases the manager thread has to run first to
682 actually destruct the Coro object.
683
684 $coro->safe_cancel ($arg...)
685 Works mostly like "->cancel", but is inherently "safer", and
686 consequently, can fail with an exception in cases the thread is not
687 in a cancellable state.
688
689 This method works a bit like throwing an exception that cannot be
690 caught - specifically, it will clean up the thread from within
691 itself, so all cleanup handlers (e.g. "guard" blocks) are run with
692 full thread context and can block if they wish. The downside is that
693 there is no guarantee that the thread can be cancelled when you call
694 this method, and therefore, it might fail. It is also considerably
695 slower than "cancel" or "terminate".
696
697 A thread is in a safe-cancellable state if it either hasn't been run
698 yet, or it has no C context attached and is inside an SLF function.
699
700 The latter two basically mean that the thread isn't currently inside
701 a perl callback called from some C function (usually via some XS
702 modules) and isn't currently executing inside some C function itself
703 (via Coro's XS API).
704
705 This call returns true when it could cancel the thread, or croaks
706 with an error otherwise (i.e. it either returns true or doesn't
707 return at all).
708
709 Why the weird interface? Well, there are two common models on how
710 and when to cancel things. In the first, you have the expectation
711 that your coro thread can be cancelled when you want to cancel it -
712 if the thread isn't cancellable, this would be a bug somewhere, so
713 "->safe_cancel" croaks to notify of the bug.
714
715 In the second model you sometimes want to ask nicely to cancel a
716 thread, but if it's not a good time, well, then don't cancel. This
717 can be done relatively easy like this:
718
719 if (! eval { $coro->safe_cancel }) {
720 warn "unable to cancel thread: $@";
721 }
722
723 However, what you never should do is first try to cancel "safely"
724 and if that fails, cancel the "hard" way with "->cancel". That makes
725 no sense: either you rely on being able to execute cleanup code in
726 your thread context, or you don't. If you do, then "->safe_cancel"
727 is the only way, and if you don't, then "->cancel" is always faster
728 and more direct.
603 729
604 $coro->schedule_to 730 $coro->schedule_to
605 Puts the current coro to sleep (like "Coro::schedule"), but instead 731 Puts the current coro to sleep (like "Coro::schedule"), but instead
606 of continuing with the next coro from the ready queue, always switch 732 of continuing with the next coro from the ready queue, always switch
607 to the given coro object (regardless of priority etc.). The 733 to the given coro object (regardless of priority etc.). The
624 Otherwise clears the exception object. 750 Otherwise clears the exception object.
625 751
626 Coro will check for the exception each time a schedule-like-function 752 Coro will check for the exception each time a schedule-like-function
627 returns, i.e. after each "schedule", "cede", 753 returns, i.e. after each "schedule", "cede",
628 "Coro::Semaphore->down", "Coro::Handle->readable" and so on. Most of 754 "Coro::Semaphore->down", "Coro::Handle->readable" and so on. Most of
629 these functions detect this case and return early in case an 755 those functions (all that are part of Coro itself) detect this case
630 exception is pending. 756 and return early in case an exception is pending.
631 757
632 The exception object will be thrown "as is" with the specified 758 The exception object will be thrown "as is" with the specified
633 scalar in $@, i.e. if it is a string, no line number or newline will 759 scalar in $@, i.e. if it is a string, no line number or newline will
634 be appended (unlike with "die"). 760 be appended (unlike with "die").
635 761
636 This can be used as a softer means than "cancel" to ask a coro to 762 This can be used as a softer means than either "cancel" or
637 end itself, although there is no guarantee that the exception will 763 "safe_cancel "to ask a coro to end itself, although there is no
638 lead to termination, and if the exception isn't caught it might well 764 guarantee that the exception will lead to termination, and if the
639 end the whole program. 765 exception isn't caught it might well end the whole program.
640 766
641 You might also think of "throw" as being the moral equivalent of 767 You might also think of "throw" as being the moral equivalent of
642 "kill"ing a coro with a signal (in this case, a scalar). 768 "kill"ing a coro with a signal (in this case, a scalar).
643 769
644 $coro->join 770 $coro->join
645 Wait until the coro terminates and return any values given to the 771 Wait until the coro terminates and return any values given to the
646 "terminate" or "cancel" functions. "join" can be called concurrently 772 "terminate" or "cancel" functions. "join" can be called concurrently
647 from multiple coro, and all will be resumed and given the status 773 from multiple threads, and all will be resumed and given the status
648 return once the $coro terminates. 774 return once the $coro terminates.
649 775
650 $coro->on_destroy (\&cb) 776 $coro->on_destroy (\&cb)
651 Registers a callback that is called when this coro thread gets 777 Registers a callback that is called when this coro thread gets
652 destroyed, but before it is joined. The callback gets passed the 778 destroyed, that is, after it's resources have been freed but before
779 it is joined. The callback gets passed the terminate/cancel
653 terminate arguments, if any, and *must not* die, under any 780 arguments, if any, and *must not* die, under any circumstances.
654 circumstances.
655 781
656 There can be any number of "on_destroy" callbacks per coro. 782 There can be any number of "on_destroy" callbacks per coro, and
783 there is currently no way to remove a callback once added.
657 784
658 $oldprio = $coro->prio ($newprio) 785 $oldprio = $coro->prio ($newprio)
659 Sets (or gets, if the argument is missing) the priority of the coro 786 Sets (or gets, if the argument is missing) the priority of the coro
660 thread. Higher priority coro get run before lower priority coros. 787 thread. Higher priority coro get run before lower priority coros.
661 Priorities are small signed integers (currently -4 .. +3), that you 788 Priorities are small signed integers (currently -4 .. +3), that you
687 with a coro. 814 with a coro.
688 815
689 This method simply sets the "$coro->{desc}" member to the given 816 This method simply sets the "$coro->{desc}" member to the given
690 string. You can modify this member directly if you wish, and in 817 string. You can modify this member directly if you wish, and in
691 fact, this is often preferred to indicate major processing states 818 fact, this is often preferred to indicate major processing states
692 that cna then be seen for example in a Coro::Debug session: 819 that can then be seen for example in a Coro::Debug session:
693 820
694 sub my_long_function { 821 sub my_long_function {
695 local $Coro::current->{desc} = "now in my_long_function"; 822 local $Coro::current->{desc} = "now in my_long_function";
696 ... 823 ...
697 $Coro::current->{desc} = "my_long_function: phase 1"; 824 $Coro::current->{desc} = "my_long_function: phase 1";
788 But from within a coro, you often just want to write this: 915 But from within a coro, you often just want to write this:
789 916
790 my $status = wait_for_child $pid; 917 my $status = wait_for_child $pid;
791 918
792 Coro offers two functions specifically designed to make this easy, 919 Coro offers two functions specifically designed to make this easy,
793 "Coro::rouse_cb" and "Coro::rouse_wait". 920 "rouse_cb" and "rouse_wait".
794 921
795 The first function, "rouse_cb", generates and returns a callback that, 922 The first function, "rouse_cb", generates and returns a callback that,
796 when invoked, will save its arguments and notify the coro that created 923 when invoked, will save its arguments and notify the coro that created
797 the callback. 924 the callback.
798 925
804 function mentioned above: 931 function mentioned above:
805 932
806 sub wait_for_child($) { 933 sub wait_for_child($) {
807 my ($pid) = @_; 934 my ($pid) = @_;
808 935
809 my $watcher = AnyEvent->child (pid => $pid, cb => Coro::rouse_cb); 936 my $watcher = AnyEvent->child (pid => $pid, cb => rouse_cb);
810 937
811 my ($rpid, $rstatus) = Coro::rouse_wait; 938 my ($rpid, $rstatus) = rouse_wait;
812 $rstatus 939 $rstatus
813 } 940 }
814 941
815 In the case where "rouse_cb" and "rouse_wait" are not flexible enough, 942 In the case where "rouse_cb" and "rouse_wait" are not flexible enough,
816 you can roll your own, using "schedule": 943 you can roll your own, using "schedule" and "ready":
817 944
818 sub wait_for_child($) { 945 sub wait_for_child($) {
819 my ($pid) = @_; 946 my ($pid) = @_;
820 947
821 # store the current coro in $current, 948 # store the current coro in $current,
824 my ($done, $rstatus); 951 my ($done, $rstatus);
825 952
826 # pass a closure to ->child 953 # pass a closure to ->child
827 my $watcher = AnyEvent->child (pid => $pid, cb => sub { 954 my $watcher = AnyEvent->child (pid => $pid, cb => sub {
828 $rstatus = $_[1]; # remember rstatus 955 $rstatus = $_[1]; # remember rstatus
829 $done = 1; # mark $rstatus as valud 956 $done = 1; # mark $rstatus as valid
957 $current->ready; # wake up the waiting thread
830 }); 958 });
831 959
832 # wait until the closure has been called 960 # wait until the closure has been called
833 schedule while !$done; 961 schedule while !$done;
834 962
847 this module from the first thread (this requirement might be removed 975 this module from the first thread (this requirement might be removed
848 in the future to allow per-thread schedulers, but Coro::State does 976 in the future to allow per-thread schedulers, but Coro::State does
849 not yet allow this). I recommend disabling thread support and using 977 not yet allow this). I recommend disabling thread support and using
850 processes, as having the windows process emulation enabled under 978 processes, as having the windows process emulation enabled under
851 unix roughly halves perl performance, even when not used. 979 unix roughly halves perl performance, even when not used.
980
981 Attempts to use threads created in another emulated process will
982 crash ("cleanly", with a null pointer exception).
852 983
853 coro switching is not signal safe 984 coro switching is not signal safe
854 You must not switch to another coro from within a signal handler 985 You must not switch to another coro from within a signal handler
855 (only relevant with %SIG - most event libraries provide safe 986 (only relevant with %SIG - most event libraries provide safe
856 signals), *unless* you are sure you are not interrupting a Coro 987 signals), *unless* you are sure you are not interrupting a Coro

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines