ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/Coro/Coro.pm
(Generate patch)

Comparing Coro/Coro.pm (file contents):
Revision 1.227 by root, Thu Nov 20 03:10:30 2008 UTC vs.
Revision 1.245 by root, Sun Dec 14 19:52:58 2008 UTC

1=head1 NAME 1=head1 NAME
2 2
3Coro - coroutine process abstraction 3Coro - the only real threads in perl
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 use Coro; 7 use Coro;
8 8
26 $locked = 1; 26 $locked = 1;
27 $lock->up; 27 $lock->up;
28 28
29=head1 DESCRIPTION 29=head1 DESCRIPTION
30 30
31This module collection manages coroutines. Coroutines are similar to 31For a tutorial-style introduction, please read the L<Coro::Intro>
32threads but don't (in general) run in parallel at the same time even 32manpage. This manpage mainly contains reference information.
33on SMP machines. The specific flavor of coroutine used in this module
34also guarantees you that it will not switch between coroutines unless
35necessary, at easily-identified points in your program, so locking and
36parallel access are rarely an issue, making coroutine programming much
37safer and easier than threads programming.
38 33
39Unlike a normal perl program, however, coroutines allow you to have 34This module collection manages continuations in general, most often
40multiple running interpreters that share data, which is especially useful 35in the form of cooperative threads (also called coroutines in the
41to code pseudo-parallel processes and for event-based programming, such as 36documentation). They are similar to kernel threads but don't (in general)
42multiple HTTP-GET requests running concurrently. See L<Coro::AnyEvent> to 37run in parallel at the same time even on SMP machines. The specific flavor
43learn more. 38of thread offered by this module also guarantees you that it will not
39switch between threads unless necessary, at easily-identified points in
40your program, so locking and parallel access are rarely an issue, making
41thread programming much safer and easier than using other thread models.
44 42
45Coroutines are also useful because Perl has no support for threads (the so 43Unlike the so-called "Perl threads" (which are not actually real threads
46called "threads" that perl offers are nothing more than the (bad) process 44but only the windows process emulation ported to unix), Coro provides a
47emulation coming from the Windows platform: On standard operating systems 45full shared address space, which makes communication between threads
48they serve no purpose whatsoever, except by making your programs slow and 46very easy. And threads are fast, too: disabling the Windows process
49making them use a lot of memory. Best disable them when building perl, or 47emulation code in your perl and using Coro can easily result in a two to
50aks your software vendor/distributor to do it for you). 48four times speed increase for your programs.
51 49
50Coro achieves that by supporting multiple running interpreters that share
51data, which is especially useful to code pseudo-parallel processes and
52for event-based programming, such as multiple HTTP-GET requests running
53concurrently. See L<Coro::AnyEvent> to learn more on how to integrate Coro
54into an event-based environment.
55
52In this module, coroutines are defined as "callchain + lexical variables + 56In this module, a thread is defined as "callchain + lexical variables +
53@_ + $_ + $@ + $/ + C stack), that is, a coroutine has its own callchain, 57@_ + $_ + $@ + $/ + C stack), that is, a thread has its own callchain,
54its own set of lexicals and its own set of perls most important global 58its own set of lexicals and its own set of perls most important global
55variables (see L<Coro::State> for more configuration). 59variables (see L<Coro::State> for more configuration and background info).
60
61See also the C<SEE ALSO> section at the end of this document - the Coro
62module family is quite large.
56 63
57=cut 64=cut
58 65
59package Coro; 66package Coro;
60 67
67 74
68our $idle; # idle handler 75our $idle; # idle handler
69our $main; # main coroutine 76our $main; # main coroutine
70our $current; # current coroutine 77our $current; # current coroutine
71 78
72our $VERSION = 5.0; 79our $VERSION = 5.13;
73 80
74our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub); 81our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub);
75our %EXPORT_TAGS = ( 82our %EXPORT_TAGS = (
76 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 83 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
77); 84);
78our @EXPORT_OK = (@{$EXPORT_TAGS{prio}}, qw(nready)); 85our @EXPORT_OK = (@{$EXPORT_TAGS{prio}}, qw(nready));
79 86
87=head1 GLOBAL VARIABLES
88
80=over 4 89=over 4
81 90
82=item $Coro::main 91=item $Coro::main
83 92
84This variable stores the coroutine object that represents the main 93This variable stores the coroutine object that represents the main
105sub current() { $current } # [DEPRECATED] 114sub current() { $current } # [DEPRECATED]
106 115
107=item $Coro::idle 116=item $Coro::idle
108 117
109This variable is mainly useful to integrate Coro into event loops. It is 118This variable is mainly useful to integrate Coro into event loops. It is
110usually better to rely on L<Coro::AnyEvent> or LC<Coro::EV>, as this is 119usually better to rely on L<Coro::AnyEvent> or L<Coro::EV>, as this is
111pretty low-level functionality. 120pretty low-level functionality.
112 121
113This variable stores a callback that is called whenever the scheduler 122This variable stores either a coroutine or a callback.
123
124If it is a callback, the it is called whenever the scheduler finds no
114finds no ready coroutines to run. The default implementation prints 125ready coroutines to run. The default implementation prints "FATAL:
115"FATAL: deadlock detected" and exits, because the program has no other way 126deadlock detected" and exits, because the program has no other way to
116to continue. 127continue.
117 128
129If it is a coroutine object, then this object will be readied (without
130invoking any ready hooks, however) when the scheduler finds no other ready
131coroutines to run.
132
118This hook is overwritten by modules such as C<Coro::Timer> and 133This hook is overwritten by modules such as C<Coro::EV> and
119C<Coro::AnyEvent> to wait on an external event that hopefully wake up a 134C<Coro::AnyEvent> to wait on an external event that hopefully wake up a
120coroutine so the scheduler can run it. 135coroutine so the scheduler can run it.
121 136
122Note that the callback I<must not>, under any circumstances, block 137Note that the callback I<must not>, under any circumstances, block
123the current coroutine. Normally, this is achieved by having an "idle 138the current coroutine. Normally, this is achieved by having an "idle
124coroutine" that calls the event loop and then blocks again, and then 139coroutine" that calls the event loop and then blocks again, and then
125readying that coroutine in the idle handler. 140readying that coroutine in the idle handler, or by simply placing the idle
141coroutine in this variable.
126 142
127See L<Coro::Event> or L<Coro::AnyEvent> for examples of using this 143See L<Coro::Event> or L<Coro::AnyEvent> for examples of using this
128technique. 144technique.
129 145
130Please note that if your callback recursively invokes perl (e.g. for event 146Please note that if your callback recursively invokes perl (e.g. for event
135$idle = sub { 151$idle = sub {
136 require Carp; 152 require Carp;
137 Carp::croak ("FATAL: deadlock detected"); 153 Carp::croak ("FATAL: deadlock detected");
138}; 154};
139 155
140sub _cancel {
141 my ($self) = @_;
142
143 # free coroutine data and mark as destructed
144 $self->_destroy
145 or return;
146
147 # call all destruction callbacks
148 $_->(@{$self->{_status}})
149 for @{ delete $self->{_on_destroy} || [] };
150}
151
152# this coroutine is necessary because a coroutine 156# this coroutine is necessary because a coroutine
153# cannot destroy itself. 157# cannot destroy itself.
154our @destroy; 158our @destroy;
155our $manager; 159our $manager;
156 160
157$manager = new Coro sub { 161$manager = new Coro sub {
158 while () { 162 while () {
159 (shift @destroy)->_cancel 163 Coro::_cancel shift @destroy
160 while @destroy; 164 while @destroy;
161 165
162 &schedule; 166 &schedule;
163 } 167 }
164}; 168};
165$manager->{desc} = "[coro manager]"; 169$manager->{desc} = "[coro manager]";
166$manager->prio (PRIO_MAX); 170$manager->prio (PRIO_MAX);
167 171
168=back 172=back
169 173
170=head2 SIMPLE COROUTINE CREATION 174=head1 SIMPLE COROUTINE CREATION
171 175
172=over 4 176=over 4
173 177
174=item async { ... } [@args...] 178=item async { ... } [@args...]
175 179
176Create a new coroutine and return it's coroutine object (usually 180Create a new coroutine and return its coroutine object (usually
177unused). The coroutine will be put into the ready queue, so 181unused). The coroutine will be put into the ready queue, so
178it will start running automatically on the next scheduler run. 182it will start running automatically on the next scheduler run.
179 183
180The first argument is a codeblock/closure that should be executed in the 184The first argument is a codeblock/closure that should be executed in the
181coroutine. When it returns argument returns the coroutine is automatically 185coroutine. When it returns argument returns the coroutine is automatically
212Similar to C<async>, but uses a coroutine pool, so you should not call 216Similar to C<async>, but uses a coroutine pool, so you should not call
213terminate or join on it (although you are allowed to), and you get a 217terminate or join on it (although you are allowed to), and you get a
214coroutine that might have executed other code already (which can be good 218coroutine that might have executed other code already (which can be good
215or bad :). 219or bad :).
216 220
217On the plus side, this function is faster than creating (and destroying) 221On the plus side, this function is about twice as fast as creating (and
218a completly new coroutine, so if you need a lot of generic coroutines in 222destroying) a completely new coroutine, so if you need a lot of generic
219quick successsion, use C<async_pool>, not C<async>. 223coroutines in quick successsion, use C<async_pool>, not C<async>.
220 224
221The code block is executed in an C<eval> context and a warning will be 225The code block is executed in an C<eval> context and a warning will be
222issued in case of an exception instead of terminating the program, as 226issued in case of an exception instead of terminating the program, as
223C<async> does. As the coroutine is being reused, stuff like C<on_destroy> 227C<async> does. As the coroutine is being reused, stuff like C<on_destroy>
224will not work in the expected way, unless you call terminate or cancel, 228will not work in the expected way, unless you call terminate or cancel,
237coros as required. 241coros as required.
238 242
239If you are concerned about pooled coroutines growing a lot because a 243If you are concerned about pooled coroutines growing a lot because a
240single C<async_pool> used a lot of stackspace you can e.g. C<async_pool 244single C<async_pool> used a lot of stackspace you can e.g. C<async_pool
241{ terminate }> once per second or so to slowly replenish the pool. In 245{ terminate }> once per second or so to slowly replenish the pool. In
242addition to that, when the stacks used by a handler grows larger than 16kb 246addition to that, when the stacks used by a handler grows larger than 32kb
243(adjustable via $Coro::POOL_RSS) it will also be destroyed. 247(adjustable via $Coro::POOL_RSS) it will also be destroyed.
244 248
245=cut 249=cut
246 250
247our $POOL_SIZE = 8; 251our $POOL_SIZE = 8;
248our $POOL_RSS = 16 * 1024; 252our $POOL_RSS = 32 * 1024;
249our @async_pool; 253our @async_pool;
250 254
251sub pool_handler { 255sub pool_handler {
252 while () { 256 while () {
253 eval { 257 eval {
258 } 262 }
259} 263}
260 264
261=back 265=back
262 266
263=head2 STATIC METHODS 267=head1 STATIC METHODS
264 268
265Static methods are actually functions that operate on the current coroutine. 269Static methods are actually functions that implicitly operate on the
270current coroutine.
266 271
267=over 4 272=over 4
268 273
269=item schedule 274=item schedule
270 275
310Terminates the current coroutine with the given status values (see L<cancel>). 315Terminates the current coroutine with the given status values (see L<cancel>).
311 316
312=item killall 317=item killall
313 318
314Kills/terminates/cancels all coroutines except the currently running 319Kills/terminates/cancels all coroutines except the currently running
315one. This is useful after a fork, either in the child or the parent, as 320one. This can be useful after a fork, either in the child or the parent,
316usually only one of them should inherit the running coroutines. 321as usually only one of them should inherit the running coroutines.
322
323Note that in the implementation, destructors run as normal, making this
324function not so useful after a fork. Future versions of this function
325might try to free resources without running any code.
317 326
318Note that while this will try to free some of the main programs resources, 327Note that while this will try to free some of the main programs resources,
319you cannot free all of them, so if a coroutine that is not the main 328you cannot free all of them, so if a coroutine that is not the main
320program calls this function, there will be some one-time resource leak. 329program calls this function, there will be some one-time resource leak.
321 330
322=cut 331=cut
323
324sub terminate {
325 $current->{_status} = [@_];
326 push @destroy, $current;
327 $manager->ready;
328 do { &schedule } while 1;
329}
330 332
331sub killall { 333sub killall {
332 for (Coro::State::list) { 334 for (Coro::State::list) {
333 $_->cancel 335 $_->cancel
334 if $_ != $current && UNIVERSAL::isa $_, "Coro"; 336 if $_ != $current && UNIVERSAL::isa $_, "Coro";
335 } 337 }
336} 338}
337 339
338=back 340=back
339 341
340=head2 COROUTINE METHODS 342=head1 COROUTINE OBJECT METHODS
341 343
342These are the methods you can call on coroutine objects (or to create 344These are the methods you can call on coroutine objects (or to create
343them). 345them).
344 346
345=over 4 347=over 4
354See C<async> and C<Coro::State::new> for additional info about the 356See C<async> and C<Coro::State::new> for additional info about the
355coroutine environment. 357coroutine environment.
356 358
357=cut 359=cut
358 360
359sub _terminate { 361sub _coro_run {
360 terminate &{+shift}; 362 terminate &{+shift};
361} 363}
362 364
363=item $success = $coroutine->ready 365=item $success = $coroutine->ready
364 366
391 $self->{_status} = [@_]; 393 $self->{_status} = [@_];
392 $self->_cancel; 394 $self->_cancel;
393 } 395 }
394} 396}
395 397
398=item $coroutine->schedule_to
399
400Puts the current coroutine to sleep (like C<Coro::schedule>), but instead
401of continuing with the next coro from the ready queue, always switch to
402the given coroutine object (regardless of priority etc.). The readyness
403state of that coroutine isn't changed.
404
405This is an advanced method for special cases - I'd love to hear about any
406uses for this one.
407
408=item $coroutine->cede_to
409
410Like C<schedule_to>, but puts the current coroutine into the ready
411queue. This has the effect of temporarily switching to the given
412coroutine, and continuing some time later.
413
414This is an advanced method for special cases - I'd love to hear about any
415uses for this one.
416
396=item $coroutine->throw ([$scalar]) 417=item $coroutine->throw ([$scalar])
397 418
398If C<$throw> is specified and defined, it will be thrown as an exception 419If C<$throw> is specified and defined, it will be thrown as an exception
399inside the coroutine at the next convenient point in time. Otherwise 420inside the coroutine at the next convenient point in time. Otherwise
400clears the exception object. 421clears the exception object.
498 my $old = $_[0]{desc}; 519 my $old = $_[0]{desc};
499 $_[0]{desc} = $_[1] if @_ > 1; 520 $_[0]{desc} = $_[1] if @_ > 1;
500 $old; 521 $old;
501} 522}
502 523
524sub transfer {
525 require Carp;
526 Carp::croak ("You must not call ->transfer on Coro objects. Use Coro::State objects or the ->schedule_to method. Caught");
527}
528
503=back 529=back
504 530
505=head2 GLOBAL FUNCTIONS 531=head1 GLOBAL FUNCTIONS
506 532
507=over 4 533=over 4
508 534
509=item Coro::nready 535=item Coro::nready
510 536
515would cause a deadlock unless there is an idle handler that wakes up some 541would cause a deadlock unless there is an idle handler that wakes up some
516coroutines. 542coroutines.
517 543
518=item my $guard = Coro::guard { ... } 544=item my $guard = Coro::guard { ... }
519 545
520This creates and returns a guard object. Nothing happens until the object 546This function still exists, but is deprecated. Please use the
521gets destroyed, in which case the codeblock given as argument will be 547C<Guard::guard> function instead.
522executed. This is useful to free locks or other resources in case of a
523runtime error or when the coroutine gets canceled, as in both cases the
524guard block will be executed. The guard object supports only one method,
525C<< ->cancel >>, which will keep the codeblock from being executed.
526 548
527Example: set some flag and clear it again when the coroutine gets canceled
528or the function returns:
529
530 sub do_something {
531 my $guard = Coro::guard { $busy = 0 };
532 $busy = 1;
533
534 # do something that requires $busy to be true
535 }
536
537=cut 549=cut
538 550
539sub guard(&) { 551BEGIN { *guard = \&Guard::guard }
540 bless \(my $cb = $_[0]), "Coro::guard"
541}
542
543sub Coro::guard::cancel {
544 ${$_[0]} = sub { };
545}
546
547sub Coro::guard::DESTROY {
548 ${$_[0]}->();
549}
550
551 552
552=item unblock_sub { ... } 553=item unblock_sub { ... }
553 554
554This utility function takes a BLOCK or code reference and "unblocks" it, 555This utility function takes a BLOCK or code reference and "unblocks" it,
555returning a new coderef. Unblocking means that calling the new coderef 556returning a new coderef. Unblocking means that calling the new coderef
557original code ref will be called (with parameters) from within another 558original code ref will be called (with parameters) from within another
558coroutine. 559coroutine.
559 560
560The reason this function exists is that many event libraries (such as the 561The reason this function exists is that many event libraries (such as the
561venerable L<Event|Event> module) are not coroutine-safe (a weaker form 562venerable L<Event|Event> module) are not coroutine-safe (a weaker form
562of thread-safety). This means you must not block within event callbacks, 563of reentrancy). This means you must not block within event callbacks,
563otherwise you might suffer from crashes or worse. The only event library 564otherwise you might suffer from crashes or worse. The only event library
564currently known that is safe to use without C<unblock_sub> is L<EV>. 565currently known that is safe to use without C<unblock_sub> is L<EV>.
565 566
566This function allows your callbacks to block by executing them in another 567This function allows your callbacks to block by executing them in another
567coroutine where it is safe to block. One example where blocking is handy 568coroutine where it is safe to block. One example where blocking is handy
613 } 614 }
614} 615}
615 616
616=item $cb = Coro::rouse_cb 617=item $cb = Coro::rouse_cb
617 618
618Create and return a "rouse callback". That's a code reference that, when 619Create and return a "rouse callback". That's a code reference that,
619called, will save its arguments and notify the owner coroutine of the 620when called, will remember a copy of its arguments and notify the owner
620callback. 621coroutine of the callback.
621 622
622See the next function. 623See the next function.
623 624
624=item @args = Coro::rouse_wait [$cb] 625=item @args = Coro::rouse_wait [$cb]
625 626
626Wait for the specified rouse callback (or the last one tht was created in 627Wait for the specified rouse callback (or the last one that was created in
627this coroutine). 628this coroutine).
628 629
629As soon as the callback is invoked (or when the calback was invoked before 630As soon as the callback is invoked (or when the callback was invoked
630C<rouse_wait>), it will return a copy of the arguments originally passed 631before C<rouse_wait>), it will return the arguments originally passed to
631to the rouse callback. 632the rouse callback.
632 633
633See the section B<HOW TO WAIT FOR A CALLBACK> for an actual usage example. 634See the section B<HOW TO WAIT FOR A CALLBACK> for an actual usage example.
634 635
635=back 636=back
636 637
659 660
660Coro offers two functions specifically designed to make this easy, 661Coro offers two functions specifically designed to make this easy,
661C<Coro::rouse_cb> and C<Coro::rouse_wait>. 662C<Coro::rouse_cb> and C<Coro::rouse_wait>.
662 663
663The first function, C<rouse_cb>, generates and returns a callback that, 664The first function, C<rouse_cb>, generates and returns a callback that,
664when invoked, will save it's arguments and notify the coroutine that 665when invoked, will save its arguments and notify the coroutine that
665created the callback. 666created the callback.
666 667
667The second function, C<rouse_wait>, waits for the callback to be called 668The second function, C<rouse_wait>, waits for the callback to be called
668(by calling C<schedule> to go to sleep) and returns the arguments 669(by calling C<schedule> to go to sleep) and returns the arguments
669originally passed to the callback. 670originally passed to the callback.
716fix your libc and use a saner backend. 717fix your libc and use a saner backend.
717 718
718=item perl process emulation ("threads") 719=item perl process emulation ("threads")
719 720
720This module is not perl-pseudo-thread-safe. You should only ever use this 721This module is not perl-pseudo-thread-safe. You should only ever use this
721module from the same thread (this requirement might be removed in the 722module from the first thread (this requirement might be removed in the
722future to allow per-thread schedulers, but Coro::State does not yet allow 723future to allow per-thread schedulers, but Coro::State does not yet allow
723this). I recommend disabling thread support and using processes, as having 724this). I recommend disabling thread support and using processes, as having
724the windows process emulation enabled under unix roughly halves perl 725the windows process emulation enabled under unix roughly halves perl
725performance, even when not used. 726performance, even when not used.
726 727
743 744
744Debugging: L<Coro::Debug>. 745Debugging: L<Coro::Debug>.
745 746
746Support/Utility: L<Coro::Specific>, L<Coro::Util>. 747Support/Utility: L<Coro::Specific>, L<Coro::Util>.
747 748
748Locking/IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>, L<Coro::SemaphoreSet>, L<Coro::RWLock>. 749Locking and IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>,
750L<Coro::SemaphoreSet>, L<Coro::RWLock>.
749 751
750IO/Timers: L<Coro::Timer>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::AIO>. 752I/O and Timers: L<Coro::Timer>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::AIO>.
751 753
752Compatibility: L<Coro::LWP>, L<Coro::BDB>, L<Coro::Storable>, L<Coro::Select>. 754Compatibility with other modules: L<Coro::LWP> (but see also L<AnyEvent::HTTP> for
755a better-working alternative), L<Coro::BDB>, L<Coro::Storable>,
756L<Coro::Select>.
753 757
754XS API: L<Coro::MakeMaker>. 758XS API: L<Coro::MakeMaker>.
755 759
756Low level Configuration, Coroutine Environment: L<Coro::State>. 760Low level Configuration, Thread Environment, Continuations: L<Coro::State>.
757 761
758=head1 AUTHOR 762=head1 AUTHOR
759 763
760 Marc Lehmann <schmorp@schmorp.de> 764 Marc Lehmann <schmorp@schmorp.de>
761 http://home.schmorp.de/ 765 http://home.schmorp.de/

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines