ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/cvsroot/Coro/Coro.pm
(Generate patch)

Comparing cvsroot/Coro/Coro.pm (file contents):
Revision 1.229 by root, Thu Nov 20 06:32:55 2008 UTC vs.
Revision 1.247 by root, Mon Dec 15 02:07:11 2008 UTC

1=head1 NAME 1=head1 NAME
2 2
3Coro - coroutine process abstraction 3Coro - the only real threads in perl
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 use Coro; 7 use Coro;
8 8
26 $locked = 1; 26 $locked = 1;
27 $lock->up; 27 $lock->up;
28 28
29=head1 DESCRIPTION 29=head1 DESCRIPTION
30 30
31This module collection manages coroutines. Coroutines are similar to 31For a tutorial-style introduction, please read the L<Coro::Intro>
32threads but don't (in general) run in parallel at the same time even 32manpage. This manpage mainly contains reference information.
33on SMP machines. The specific flavor of coroutine used in this module
34also guarantees you that it will not switch between coroutines unless
35necessary, at easily-identified points in your program, so locking and
36parallel access are rarely an issue, making coroutine programming much
37safer and easier than threads programming.
38 33
39Unlike a normal perl program, however, coroutines allow you to have 34This module collection manages continuations in general, most often
40multiple running interpreters that share data, which is especially useful 35in the form of cooperative threads (also called coroutines in the
41to code pseudo-parallel processes and for event-based programming, such as 36documentation). They are similar to kernel threads but don't (in general)
42multiple HTTP-GET requests running concurrently. See L<Coro::AnyEvent> to 37run in parallel at the same time even on SMP machines. The specific flavor
43learn more. 38of thread offered by this module also guarantees you that it will not
39switch between threads unless necessary, at easily-identified points in
40your program, so locking and parallel access are rarely an issue, making
41thread programming much safer and easier than using other thread models.
44 42
45Coroutines are also useful because Perl has no support for threads (the so 43Unlike the so-called "Perl threads" (which are not actually real threads
46called "threads" that perl offers are nothing more than the (bad) process 44but only the windows process emulation ported to unix), Coro provides a
47emulation coming from the Windows platform: On standard operating systems 45full shared address space, which makes communication between threads
48they serve no purpose whatsoever, except by making your programs slow and 46very easy. And threads are fast, too: disabling the Windows process
49making them use a lot of memory. Best disable them when building perl, or 47emulation code in your perl and using Coro can easily result in a two to
50aks your software vendor/distributor to do it for you). 48four times speed increase for your programs.
51 49
50Coro achieves that by supporting multiple running interpreters that share
51data, which is especially useful to code pseudo-parallel processes and
52for event-based programming, such as multiple HTTP-GET requests running
53concurrently. See L<Coro::AnyEvent> to learn more on how to integrate Coro
54into an event-based environment.
55
52In this module, coroutines are defined as "callchain + lexical variables + 56In this module, a thread is defined as "callchain + lexical variables +
53@_ + $_ + $@ + $/ + C stack), that is, a coroutine has its own callchain, 57@_ + $_ + $@ + $/ + C stack), that is, a thread has its own callchain,
54its own set of lexicals and its own set of perls most important global 58its own set of lexicals and its own set of perls most important global
55variables (see L<Coro::State> for more configuration). 59variables (see L<Coro::State> for more configuration and background info).
60
61See also the C<SEE ALSO> section at the end of this document - the Coro
62module family is quite large.
56 63
57=cut 64=cut
58 65
59package Coro; 66package Coro;
60 67
61use strict qw(vars subs); 68use strict qw(vars subs);
62no warnings "uninitialized"; 69no warnings "uninitialized";
70
71use Guard ();
63 72
64use Coro::State; 73use Coro::State;
65 74
66use base qw(Coro::State Exporter); 75use base qw(Coro::State Exporter);
67 76
68our $idle; # idle handler 77our $idle; # idle handler
69our $main; # main coroutine 78our $main; # main coroutine
70our $current; # current coroutine 79our $current; # current coroutine
71 80
72our $VERSION = 5.0; 81our $VERSION = 5.13;
73 82
74our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub); 83our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub);
75our %EXPORT_TAGS = ( 84our %EXPORT_TAGS = (
76 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 85 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
77); 86);
78our @EXPORT_OK = (@{$EXPORT_TAGS{prio}}, qw(nready)); 87our @EXPORT_OK = (@{$EXPORT_TAGS{prio}}, qw(nready));
79 88
89=head1 GLOBAL VARIABLES
90
80=over 4 91=over 4
81 92
82=item $Coro::main 93=item $Coro::main
83 94
84This variable stores the coroutine object that represents the main 95This variable stores the coroutine object that represents the main
105sub current() { $current } # [DEPRECATED] 116sub current() { $current } # [DEPRECATED]
106 117
107=item $Coro::idle 118=item $Coro::idle
108 119
109This variable is mainly useful to integrate Coro into event loops. It is 120This variable is mainly useful to integrate Coro into event loops. It is
110usually better to rely on L<Coro::AnyEvent> or LC<Coro::EV>, as this is 121usually better to rely on L<Coro::AnyEvent> or L<Coro::EV>, as this is
111pretty low-level functionality. 122pretty low-level functionality.
112 123
113This variable stores a callback that is called whenever the scheduler 124This variable stores either a coroutine or a callback.
125
126If it is a callback, the it is called whenever the scheduler finds no
114finds no ready coroutines to run. The default implementation prints 127ready coroutines to run. The default implementation prints "FATAL:
115"FATAL: deadlock detected" and exits, because the program has no other way 128deadlock detected" and exits, because the program has no other way to
116to continue. 129continue.
117 130
131If it is a coroutine object, then this object will be readied (without
132invoking any ready hooks, however) when the scheduler finds no other ready
133coroutines to run.
134
118This hook is overwritten by modules such as C<Coro::Timer> and 135This hook is overwritten by modules such as C<Coro::EV> and
119C<Coro::AnyEvent> to wait on an external event that hopefully wake up a 136C<Coro::AnyEvent> to wait on an external event that hopefully wake up a
120coroutine so the scheduler can run it. 137coroutine so the scheduler can run it.
121 138
122Note that the callback I<must not>, under any circumstances, block 139Note that the callback I<must not>, under any circumstances, block
123the current coroutine. Normally, this is achieved by having an "idle 140the current coroutine. Normally, this is achieved by having an "idle
124coroutine" that calls the event loop and then blocks again, and then 141coroutine" that calls the event loop and then blocks again, and then
125readying that coroutine in the idle handler. 142readying that coroutine in the idle handler, or by simply placing the idle
143coroutine in this variable.
126 144
127See L<Coro::Event> or L<Coro::AnyEvent> for examples of using this 145See L<Coro::Event> or L<Coro::AnyEvent> for examples of using this
128technique. 146technique.
129 147
130Please note that if your callback recursively invokes perl (e.g. for event 148Please note that if your callback recursively invokes perl (e.g. for event
135$idle = sub { 153$idle = sub {
136 require Carp; 154 require Carp;
137 Carp::croak ("FATAL: deadlock detected"); 155 Carp::croak ("FATAL: deadlock detected");
138}; 156};
139 157
140sub _cancel {
141 my ($self) = @_;
142
143 # free coroutine data and mark as destructed
144 $self->_destroy
145 or return;
146
147 # call all destruction callbacks
148 $_->(@{$self->{_status}})
149 for @{ delete $self->{_on_destroy} || [] };
150}
151
152# this coroutine is necessary because a coroutine 158# this coroutine is necessary because a coroutine
153# cannot destroy itself. 159# cannot destroy itself.
154our @destroy; 160our @destroy;
155our $manager; 161our $manager;
156 162
157$manager = new Coro sub { 163$manager = new Coro sub {
158 while () { 164 while () {
159 (shift @destroy)->_cancel 165 Coro::_cancel shift @destroy
160 while @destroy; 166 while @destroy;
161 167
162 &schedule; 168 &schedule;
163 } 169 }
164}; 170};
165$manager->{desc} = "[coro manager]"; 171$manager->{desc} = "[coro manager]";
166$manager->prio (PRIO_MAX); 172$manager->prio (PRIO_MAX);
167 173
168=back 174=back
169 175
170=head2 SIMPLE COROUTINE CREATION 176=head1 SIMPLE COROUTINE CREATION
171 177
172=over 4 178=over 4
173 179
174=item async { ... } [@args...] 180=item async { ... } [@args...]
175 181
176Create a new coroutine and return it's coroutine object (usually 182Create a new coroutine and return its coroutine object (usually
177unused). The coroutine will be put into the ready queue, so 183unused). The coroutine will be put into the ready queue, so
178it will start running automatically on the next scheduler run. 184it will start running automatically on the next scheduler run.
179 185
180The first argument is a codeblock/closure that should be executed in the 186The first argument is a codeblock/closure that should be executed in the
181coroutine. When it returns argument returns the coroutine is automatically 187coroutine. When it returns argument returns the coroutine is automatically
237coros as required. 243coros as required.
238 244
239If you are concerned about pooled coroutines growing a lot because a 245If you are concerned about pooled coroutines growing a lot because a
240single C<async_pool> used a lot of stackspace you can e.g. C<async_pool 246single C<async_pool> used a lot of stackspace you can e.g. C<async_pool
241{ terminate }> once per second or so to slowly replenish the pool. In 247{ terminate }> once per second or so to slowly replenish the pool. In
242addition to that, when the stacks used by a handler grows larger than 16kb 248addition to that, when the stacks used by a handler grows larger than 32kb
243(adjustable via $Coro::POOL_RSS) it will also be destroyed. 249(adjustable via $Coro::POOL_RSS) it will also be destroyed.
244 250
245=cut 251=cut
246 252
247our $POOL_SIZE = 8; 253our $POOL_SIZE = 8;
248our $POOL_RSS = 16 * 1024; 254our $POOL_RSS = 32 * 1024;
249our @async_pool; 255our @async_pool;
250 256
251sub pool_handler { 257sub pool_handler {
252 while () { 258 while () {
253 eval { 259 eval {
258 } 264 }
259} 265}
260 266
261=back 267=back
262 268
263=head2 STATIC METHODS 269=head1 STATIC METHODS
264 270
265Static methods are actually functions that operate on the current coroutine. 271Static methods are actually functions that implicitly operate on the
272current coroutine.
266 273
267=over 4 274=over 4
268 275
269=item schedule 276=item schedule
270 277
307 314
308=item terminate [arg...] 315=item terminate [arg...]
309 316
310Terminates the current coroutine with the given status values (see L<cancel>). 317Terminates the current coroutine with the given status values (see L<cancel>).
311 318
319=item Coro::on_enter BLOCK, Coro::on_leave BLOCK
320
321These function install enter and leave winders in the current scope. The
322enter block will be executed when on_enter is called and whenever the
323current coroutine is re-entered by the scheduler, while the leave block is
324executed whenever the current coroutine is blocked by the scheduler, and
325also when the containing scope is exited (by whatever means, be it exit,
326die, last etc.).
327
328I<Neither invoking the scheduler, nor exceptions, are allowed within those
329BLOCKs>. That means: do not even think about calling C<die> without an
330eval, and do not even think of entering the scheduler in any way.
331
332Since both BLOCKs are tied to the current scope, they will automatically
333be removed when the current scope exits.
334
335These functions implement the same concept as C<dynamic-wind> in scheme
336does, and are useful when you want to localise some resource to a specific
337coroutine.
338
339They slow down coroutine switching considerably for coroutines that use
340them (But coroutine switching is still reasonably fast if the handlers are
341fast).
342
343These functions are best understood by an example: The following function
344will change the current timezone to "Antarctica/South_Pole", which
345requires a call to C<tzset>, but by using C<on_enter> and C<on_leave>,
346which remember/change the current timezone and restore the previous
347value, respectively, the timezone is only changes for the coroutine that
348installed those handlers.
349
350 use POSIX qw(tzset);
351
352 async {
353 my $old_tz; # store outside TZ value here
354
355 Coro::on_enter {
356 $old_tz = $ENV{TZ}; # remember the old value
357
358 $ENV{TZ} = "Antarctica/South_Pole";
359 tzset; # enable new value
360 };
361
362 Coro::on_leave {
363 $ENV{TZ} = $old_tz;
364 tzset; # restore old value
365 };
366
367 # at this place, the timezone is Antarctica/South_Pole,
368 # without disturbing the TZ of any other coroutine.
369 };
370
371This can be used to localise about any resource (locale, uid, current
372working directory etc.) to a block, despite the existance of other
373coroutines.
374
312=item killall 375=item killall
313 376
314Kills/terminates/cancels all coroutines except the currently running 377Kills/terminates/cancels all coroutines except the currently running one.
315one. This is useful after a fork, either in the child or the parent, as
316usually only one of them should inherit the running coroutines.
317 378
318Note that while this will try to free some of the main programs resources, 379Note that while this will try to free some of the main interpreter
380resources if the calling coroutine isn't the main coroutine, but one
319you cannot free all of them, so if a coroutine that is not the main 381cannot free all of them, so if a coroutine that is not the main coroutine
320program calls this function, there will be some one-time resource leak. 382calls this function, there will be some one-time resource leak.
321 383
322=cut 384=cut
323
324sub terminate {
325 $current->{_status} = [@_];
326 push @destroy, $current;
327 $manager->ready;
328 do { &schedule } while 1;
329}
330 385
331sub killall { 386sub killall {
332 for (Coro::State::list) { 387 for (Coro::State::list) {
333 $_->cancel 388 $_->cancel
334 if $_ != $current && UNIVERSAL::isa $_, "Coro"; 389 if $_ != $current && UNIVERSAL::isa $_, "Coro";
335 } 390 }
336} 391}
337 392
338=back 393=back
339 394
340=head2 COROUTINE METHODS 395=head1 COROUTINE OBJECT METHODS
341 396
342These are the methods you can call on coroutine objects (or to create 397These are the methods you can call on coroutine objects (or to create
343them). 398them).
344 399
345=over 4 400=over 4
354See C<async> and C<Coro::State::new> for additional info about the 409See C<async> and C<Coro::State::new> for additional info about the
355coroutine environment. 410coroutine environment.
356 411
357=cut 412=cut
358 413
359sub _terminate { 414sub _coro_run {
360 terminate &{+shift}; 415 terminate &{+shift};
361} 416}
362 417
363=item $success = $coroutine->ready 418=item $success = $coroutine->ready
364 419
517 my $old = $_[0]{desc}; 572 my $old = $_[0]{desc};
518 $_[0]{desc} = $_[1] if @_ > 1; 573 $_[0]{desc} = $_[1] if @_ > 1;
519 $old; 574 $old;
520} 575}
521 576
577sub transfer {
578 require Carp;
579 Carp::croak ("You must not call ->transfer on Coro objects. Use Coro::State objects or the ->schedule_to method. Caught");
580}
581
522=back 582=back
523 583
524=head2 GLOBAL FUNCTIONS 584=head1 GLOBAL FUNCTIONS
525 585
526=over 4 586=over 4
527 587
528=item Coro::nready 588=item Coro::nready
529 589
534would cause a deadlock unless there is an idle handler that wakes up some 594would cause a deadlock unless there is an idle handler that wakes up some
535coroutines. 595coroutines.
536 596
537=item my $guard = Coro::guard { ... } 597=item my $guard = Coro::guard { ... }
538 598
539This creates and returns a guard object. Nothing happens until the object 599This function still exists, but is deprecated. Please use the
540gets destroyed, in which case the codeblock given as argument will be 600C<Guard::guard> function instead.
541executed. This is useful to free locks or other resources in case of a
542runtime error or when the coroutine gets canceled, as in both cases the
543guard block will be executed. The guard object supports only one method,
544C<< ->cancel >>, which will keep the codeblock from being executed.
545 601
546Example: set some flag and clear it again when the coroutine gets canceled
547or the function returns:
548
549 sub do_something {
550 my $guard = Coro::guard { $busy = 0 };
551 $busy = 1;
552
553 # do something that requires $busy to be true
554 }
555
556=cut 602=cut
557 603
558sub guard(&) { 604BEGIN { *guard = \&Guard::guard }
559 bless \(my $cb = $_[0]), "Coro::guard"
560}
561
562sub Coro::guard::cancel {
563 ${$_[0]} = sub { };
564}
565
566sub Coro::guard::DESTROY {
567 ${$_[0]}->();
568}
569
570 605
571=item unblock_sub { ... } 606=item unblock_sub { ... }
572 607
573This utility function takes a BLOCK or code reference and "unblocks" it, 608This utility function takes a BLOCK or code reference and "unblocks" it,
574returning a new coderef. Unblocking means that calling the new coderef 609returning a new coderef. Unblocking means that calling the new coderef
576original code ref will be called (with parameters) from within another 611original code ref will be called (with parameters) from within another
577coroutine. 612coroutine.
578 613
579The reason this function exists is that many event libraries (such as the 614The reason this function exists is that many event libraries (such as the
580venerable L<Event|Event> module) are not coroutine-safe (a weaker form 615venerable L<Event|Event> module) are not coroutine-safe (a weaker form
581of thread-safety). This means you must not block within event callbacks, 616of reentrancy). This means you must not block within event callbacks,
582otherwise you might suffer from crashes or worse. The only event library 617otherwise you might suffer from crashes or worse. The only event library
583currently known that is safe to use without C<unblock_sub> is L<EV>. 618currently known that is safe to use without C<unblock_sub> is L<EV>.
584 619
585This function allows your callbacks to block by executing them in another 620This function allows your callbacks to block by executing them in another
586coroutine where it is safe to block. One example where blocking is handy 621coroutine where it is safe to block. One example where blocking is handy
632 } 667 }
633} 668}
634 669
635=item $cb = Coro::rouse_cb 670=item $cb = Coro::rouse_cb
636 671
637Create and return a "rouse callback". That's a code reference that, when 672Create and return a "rouse callback". That's a code reference that,
638called, will save its arguments and notify the owner coroutine of the 673when called, will remember a copy of its arguments and notify the owner
639callback. 674coroutine of the callback.
640 675
641See the next function. 676See the next function.
642 677
643=item @args = Coro::rouse_wait [$cb] 678=item @args = Coro::rouse_wait [$cb]
644 679
645Wait for the specified rouse callback (or the last one tht was created in 680Wait for the specified rouse callback (or the last one that was created in
646this coroutine). 681this coroutine).
647 682
648As soon as the callback is invoked (or when the calback was invoked before 683As soon as the callback is invoked (or when the callback was invoked
649C<rouse_wait>), it will return a copy of the arguments originally passed 684before C<rouse_wait>), it will return the arguments originally passed to
650to the rouse callback. 685the rouse callback.
651 686
652See the section B<HOW TO WAIT FOR A CALLBACK> for an actual usage example. 687See the section B<HOW TO WAIT FOR A CALLBACK> for an actual usage example.
653 688
654=back 689=back
655 690
678 713
679Coro offers two functions specifically designed to make this easy, 714Coro offers two functions specifically designed to make this easy,
680C<Coro::rouse_cb> and C<Coro::rouse_wait>. 715C<Coro::rouse_cb> and C<Coro::rouse_wait>.
681 716
682The first function, C<rouse_cb>, generates and returns a callback that, 717The first function, C<rouse_cb>, generates and returns a callback that,
683when invoked, will save it's arguments and notify the coroutine that 718when invoked, will save its arguments and notify the coroutine that
684created the callback. 719created the callback.
685 720
686The second function, C<rouse_wait>, waits for the callback to be called 721The second function, C<rouse_wait>, waits for the callback to be called
687(by calling C<schedule> to go to sleep) and returns the arguments 722(by calling C<schedule> to go to sleep) and returns the arguments
688originally passed to the callback. 723originally passed to the callback.
735fix your libc and use a saner backend. 770fix your libc and use a saner backend.
736 771
737=item perl process emulation ("threads") 772=item perl process emulation ("threads")
738 773
739This module is not perl-pseudo-thread-safe. You should only ever use this 774This module is not perl-pseudo-thread-safe. You should only ever use this
740module from the same thread (this requirement might be removed in the 775module from the first thread (this requirement might be removed in the
741future to allow per-thread schedulers, but Coro::State does not yet allow 776future to allow per-thread schedulers, but Coro::State does not yet allow
742this). I recommend disabling thread support and using processes, as having 777this). I recommend disabling thread support and using processes, as having
743the windows process emulation enabled under unix roughly halves perl 778the windows process emulation enabled under unix roughly halves perl
744performance, even when not used. 779performance, even when not used.
745 780
762 797
763Debugging: L<Coro::Debug>. 798Debugging: L<Coro::Debug>.
764 799
765Support/Utility: L<Coro::Specific>, L<Coro::Util>. 800Support/Utility: L<Coro::Specific>, L<Coro::Util>.
766 801
767Locking/IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>, L<Coro::SemaphoreSet>, L<Coro::RWLock>. 802Locking and IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>,
803L<Coro::SemaphoreSet>, L<Coro::RWLock>.
768 804
769IO/Timers: L<Coro::Timer>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::AIO>. 805I/O and Timers: L<Coro::Timer>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::AIO>.
770 806
771Compatibility: L<Coro::LWP>, L<Coro::BDB>, L<Coro::Storable>, L<Coro::Select>. 807Compatibility with other modules: L<Coro::LWP> (but see also L<AnyEvent::HTTP> for
808a better-working alternative), L<Coro::BDB>, L<Coro::Storable>,
809L<Coro::Select>.
772 810
773XS API: L<Coro::MakeMaker>. 811XS API: L<Coro::MakeMaker>.
774 812
775Low level Configuration, Coroutine Environment: L<Coro::State>. 813Low level Configuration, Thread Environment, Continuations: L<Coro::State>.
776 814
777=head1 AUTHOR 815=head1 AUTHOR
778 816
779 Marc Lehmann <schmorp@schmorp.de> 817 Marc Lehmann <schmorp@schmorp.de>
780 http://home.schmorp.de/ 818 http://home.schmorp.de/

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines