ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/Coro/Coro.pm
(Generate patch)

Comparing Coro/Coro.pm (file contents):
Revision 1.128 by root, Wed Sep 19 21:39:15 2007 UTC vs.
Revision 1.245 by root, Sun Dec 14 19:52:58 2008 UTC

1=head1 NAME 1=head1 NAME
2 2
3Coro - coroutine process abstraction 3Coro - the only real threads in perl
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 use Coro; 7 use Coro;
8 8
9 async { 9 async {
10 # some asynchronous thread of execution 10 # some asynchronous thread of execution
11 print "2\n";
12 cede; # yield back to main
13 print "4\n";
11 }; 14 };
12 15 print "1\n";
13 # alternatively create an async coroutine like this: 16 cede; # yield to coroutine
14 17 print "3\n";
15 sub some_func : Coro { 18 cede; # and again
16 # some more async code 19
17 } 20 # use locking
18 21 use Coro::Semaphore;
19 cede; 22 my $lock = new Coro::Semaphore;
23 my $locked;
24
25 $lock->down;
26 $locked = 1;
27 $lock->up;
20 28
21=head1 DESCRIPTION 29=head1 DESCRIPTION
22 30
23This module collection manages coroutines. Coroutines are similar 31For a tutorial-style introduction, please read the L<Coro::Intro>
24to threads but don't run in parallel at the same time even on SMP 32manpage. This manpage mainly contains reference information.
25machines. The specific flavor of coroutine used in this module also
26guarantees you that it will not switch between coroutines unless
27necessary, at easily-identified points in your program, so locking and
28parallel access are rarely an issue, making coroutine programming much
29safer than threads programming.
30 33
31(Perl, however, does not natively support real threads but instead does a 34This module collection manages continuations in general, most often
32very slow and memory-intensive emulation of processes using threads. This 35in the form of cooperative threads (also called coroutines in the
33is a performance win on Windows machines, and a loss everywhere else). 36documentation). They are similar to kernel threads but don't (in general)
37run in parallel at the same time even on SMP machines. The specific flavor
38of thread offered by this module also guarantees you that it will not
39switch between threads unless necessary, at easily-identified points in
40your program, so locking and parallel access are rarely an issue, making
41thread programming much safer and easier than using other thread models.
34 42
43Unlike the so-called "Perl threads" (which are not actually real threads
44but only the windows process emulation ported to unix), Coro provides a
45full shared address space, which makes communication between threads
46very easy. And threads are fast, too: disabling the Windows process
47emulation code in your perl and using Coro can easily result in a two to
48four times speed increase for your programs.
49
50Coro achieves that by supporting multiple running interpreters that share
51data, which is especially useful to code pseudo-parallel processes and
52for event-based programming, such as multiple HTTP-GET requests running
53concurrently. See L<Coro::AnyEvent> to learn more on how to integrate Coro
54into an event-based environment.
55
35In this module, coroutines are defined as "callchain + lexical variables + 56In this module, a thread is defined as "callchain + lexical variables +
36@_ + $_ + $@ + $/ + C stack), that is, a coroutine has its own callchain, 57@_ + $_ + $@ + $/ + C stack), that is, a thread has its own callchain,
37its own set of lexicals and its own set of perls most important global 58its own set of lexicals and its own set of perls most important global
38variables. 59variables (see L<Coro::State> for more configuration and background info).
60
61See also the C<SEE ALSO> section at the end of this document - the Coro
62module family is quite large.
39 63
40=cut 64=cut
41 65
42package Coro; 66package Coro;
43 67
44use strict; 68use strict qw(vars subs);
45no warnings "uninitialized"; 69no warnings "uninitialized";
46 70
47use Coro::State; 71use Coro::State;
48 72
49use base qw(Coro::State Exporter); 73use base qw(Coro::State Exporter);
50 74
51our $idle; # idle handler 75our $idle; # idle handler
52our $main; # main coroutine 76our $main; # main coroutine
53our $current; # current coroutine 77our $current; # current coroutine
54 78
55our $VERSION = '3.7'; 79our $VERSION = 5.13;
56 80
57our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub); 81our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub);
58our %EXPORT_TAGS = ( 82our %EXPORT_TAGS = (
59 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 83 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
60); 84);
61our @EXPORT_OK = (@{$EXPORT_TAGS{prio}}, qw(nready)); 85our @EXPORT_OK = (@{$EXPORT_TAGS{prio}}, qw(nready));
62 86
63{ 87=head1 GLOBAL VARIABLES
64 my @async;
65 my $init;
66
67 # this way of handling attributes simply is NOT scalable ;()
68 sub import {
69 no strict 'refs';
70
71 Coro->export_to_level (1, @_);
72
73 my $old = *{(caller)[0]."::MODIFY_CODE_ATTRIBUTES"}{CODE};
74 *{(caller)[0]."::MODIFY_CODE_ATTRIBUTES"} = sub {
75 my ($package, $ref) = (shift, shift);
76 my @attrs;
77 for (@_) {
78 if ($_ eq "Coro") {
79 push @async, $ref;
80 unless ($init++) {
81 eval q{
82 sub INIT {
83 &async(pop @async) while @async;
84 }
85 };
86 }
87 } else {
88 push @attrs, $_;
89 }
90 }
91 return $old ? $old->($package, $ref, @attrs) : @attrs;
92 };
93 }
94
95}
96 88
97=over 4 89=over 4
98 90
99=item $main 91=item $Coro::main
100 92
101This coroutine represents the main program. 93This variable stores the coroutine object that represents the main
94program. While you cna C<ready> it and do most other things you can do to
95coroutines, it is mainly useful to compare again C<$Coro::current>, to see
96whether you are running in the main program or not.
102 97
103=cut 98=cut
104 99
105$main = new Coro; 100# $main is now being initialised by Coro::State
106 101
107=item $current (or as function: current) 102=item $Coro::current
108 103
109The current coroutine (the last coroutine switched to). The initial value 104The coroutine object representing the current coroutine (the last
105coroutine that the Coro scheduler switched to). The initial value is
110is C<$main> (of course). 106C<$Coro::main> (of course).
111 107
112This variable is B<strictly> I<read-only>. It is provided for performance 108This variable is B<strictly> I<read-only>. You can take copies of the
113reasons. If performance is not essential you are encouraged to use the 109value stored in it and use it as any other coroutine object, but you must
114C<Coro::current> function instead. 110not otherwise modify the variable itself.
115 111
116=cut 112=cut
117 113
118# maybe some other module used Coro::Specific before...
119$main->{specific} = $current->{specific}
120 if $current;
121
122_set_current $main;
123
124sub current() { $current } 114sub current() { $current } # [DEPRECATED]
125 115
126=item $idle 116=item $Coro::idle
127 117
118This variable is mainly useful to integrate Coro into event loops. It is
119usually better to rely on L<Coro::AnyEvent> or L<Coro::EV>, as this is
120pretty low-level functionality.
121
122This variable stores either a coroutine or a callback.
123
128A callback that is called whenever the scheduler finds no ready coroutines 124If it is a callback, the it is called whenever the scheduler finds no
129to run. The default implementation prints "FATAL: deadlock detected" and 125ready coroutines to run. The default implementation prints "FATAL:
130exits, because the program has no other way to continue. 126deadlock detected" and exits, because the program has no other way to
127continue.
131 128
129If it is a coroutine object, then this object will be readied (without
130invoking any ready hooks, however) when the scheduler finds no other ready
131coroutines to run.
132
132This hook is overwritten by modules such as C<Coro::Timer> and 133This hook is overwritten by modules such as C<Coro::EV> and
133C<Coro::Event> to wait on an external event that hopefully wake up a 134C<Coro::AnyEvent> to wait on an external event that hopefully wake up a
134coroutine so the scheduler can run it. 135coroutine so the scheduler can run it.
135 136
137Note that the callback I<must not>, under any circumstances, block
138the current coroutine. Normally, this is achieved by having an "idle
139coroutine" that calls the event loop and then blocks again, and then
140readying that coroutine in the idle handler, or by simply placing the idle
141coroutine in this variable.
142
143See L<Coro::Event> or L<Coro::AnyEvent> for examples of using this
144technique.
145
136Please note that if your callback recursively invokes perl (e.g. for event 146Please note that if your callback recursively invokes perl (e.g. for event
137handlers), then it must be prepared to be called recursively. 147handlers), then it must be prepared to be called recursively itself.
138 148
139=cut 149=cut
140 150
141$idle = sub { 151$idle = sub {
142 require Carp; 152 require Carp;
143 Carp::croak ("FATAL: deadlock detected"); 153 Carp::croak ("FATAL: deadlock detected");
144}; 154};
145 155
146sub _cancel {
147 my ($self) = @_;
148
149 # free coroutine data and mark as destructed
150 $self->_destroy
151 or return;
152
153 # call all destruction callbacks
154 $_->(@{$self->{status}})
155 for @{(delete $self->{destroy_cb}) || []};
156}
157
158# this coroutine is necessary because a coroutine 156# this coroutine is necessary because a coroutine
159# cannot destroy itself. 157# cannot destroy itself.
160my @destroy; 158our @destroy;
161my $manager; 159our $manager;
162 160
163$manager = new Coro sub { 161$manager = new Coro sub {
164 while () { 162 while () {
165 (shift @destroy)->_cancel 163 Coro::_cancel shift @destroy
166 while @destroy; 164 while @destroy;
167 165
168 &schedule; 166 &schedule;
169 } 167 }
170}; 168};
171 169$manager->{desc} = "[coro manager]";
172$manager->prio (PRIO_MAX); 170$manager->prio (PRIO_MAX);
173 171
174# static methods. not really.
175
176=back 172=back
177 173
178=head2 STATIC METHODS 174=head1 SIMPLE COROUTINE CREATION
179
180Static methods are actually functions that operate on the current coroutine only.
181 175
182=over 4 176=over 4
183 177
184=item async { ... } [@args...] 178=item async { ... } [@args...]
185 179
186Create a new asynchronous coroutine and return it's coroutine object 180Create a new coroutine and return its coroutine object (usually
187(usually unused). When the sub returns the new coroutine is automatically 181unused). The coroutine will be put into the ready queue, so
182it will start running automatically on the next scheduler run.
183
184The first argument is a codeblock/closure that should be executed in the
185coroutine. When it returns argument returns the coroutine is automatically
188terminated. 186terminated.
187
188The remaining arguments are passed as arguments to the closure.
189
190See the C<Coro::State::new> constructor for info about the coroutine
191environment in which coroutines are executed.
189 192
190Calling C<exit> in a coroutine will do the same as calling exit outside 193Calling C<exit> in a coroutine will do the same as calling exit outside
191the coroutine. Likewise, when the coroutine dies, the program will exit, 194the coroutine. Likewise, when the coroutine dies, the program will exit,
192just as it would in the main program. 195just as it would in the main program.
193 196
197If you do not want that, you can provide a default C<die> handler, or
198simply avoid dieing (by use of C<eval>).
199
194 # create a new coroutine that just prints its arguments 200Example: Create a new coroutine that just prints its arguments.
201
195 async { 202 async {
196 print "@_\n"; 203 print "@_\n";
197 } 1,2,3,4; 204 } 1,2,3,4;
198 205
199=cut 206=cut
205} 212}
206 213
207=item async_pool { ... } [@args...] 214=item async_pool { ... } [@args...]
208 215
209Similar to C<async>, but uses a coroutine pool, so you should not call 216Similar to C<async>, but uses a coroutine pool, so you should not call
210terminate or join (although you are allowed to), and you get a coroutine 217terminate or join on it (although you are allowed to), and you get a
211that might have executed other code already (which can be good or bad :). 218coroutine that might have executed other code already (which can be good
219or bad :).
212 220
221On the plus side, this function is about twice as fast as creating (and
222destroying) a completely new coroutine, so if you need a lot of generic
223coroutines in quick successsion, use C<async_pool>, not C<async>.
224
213Also, the block is executed in an C<eval> context and a warning will be 225The code block is executed in an C<eval> context and a warning will be
214issued in case of an exception instead of terminating the program, as 226issued in case of an exception instead of terminating the program, as
215C<async> does. As the coroutine is being reused, stuff like C<on_destroy> 227C<async> does. As the coroutine is being reused, stuff like C<on_destroy>
216will not work in the expected way, unless you call terminate or cancel, 228will not work in the expected way, unless you call terminate or cancel,
217which somehow defeats the purpose of pooling. 229which somehow defeats the purpose of pooling (but is fine in the
230exceptional case).
218 231
219The priority will be reset to C<0> after each job, otherwise the coroutine 232The priority will be reset to C<0> after each run, tracing will be
220will be re-used "as-is". 233disabled, the description will be reset and the default output filehandle
234gets restored, so you can change all these. Otherwise the coroutine will
235be re-used "as-is": most notably if you change other per-coroutine global
236stuff such as C<$/> you I<must needs> revert that change, which is most
237simply done by using local as in: C<< local $/ >>.
221 238
222The pool size is limited to 8 idle coroutines (this can be adjusted by 239The idle pool size is limited to C<8> idle coroutines (this can be
223changing $Coro::POOL_SIZE), and there can be as many non-idle coros as 240adjusted by changing $Coro::POOL_SIZE), but there can be as many non-idle
224required. 241coros as required.
225 242
226If you are concerned about pooled coroutines growing a lot because a 243If you are concerned about pooled coroutines growing a lot because a
227single C<async_pool> used a lot of stackspace you can e.g. C<async_pool { 244single C<async_pool> used a lot of stackspace you can e.g. C<async_pool
228terminate }> once per second or so to slowly replenish the pool. 245{ terminate }> once per second or so to slowly replenish the pool. In
246addition to that, when the stacks used by a handler grows larger than 32kb
247(adjustable via $Coro::POOL_RSS) it will also be destroyed.
229 248
230=cut 249=cut
231 250
232our $POOL_SIZE = 8; 251our $POOL_SIZE = 8;
252our $POOL_RSS = 32 * 1024;
233our @pool; 253our @async_pool;
234 254
235sub pool_handler { 255sub pool_handler {
236 while () { 256 while () {
237 eval { 257 eval {
238 my ($cb, @arg) = @{ delete $current->{_invoke} or return }; 258 &{&_pool_handler} while 1;
239 $cb->(@arg);
240 }; 259 };
260
241 warn $@ if $@; 261 warn $@ if $@;
242
243 last if @pool >= $POOL_SIZE;
244 push @pool, $current;
245
246 $current->save (Coro::State::SAVE_DEF);
247 $current->prio (0);
248 schedule;
249 }
250}
251
252sub async_pool(&@) {
253 # this is also inlined into the unlock_scheduler
254 my $coro = (pop @pool) || do {
255 my $coro = new Coro \&pool_handler;
256 $coro->{desc} = "async_pool";
257 $coro
258 }; 262 }
259
260 $coro->{_invoke} = [@_];
261 $coro->ready;
262
263 $coro
264} 263}
264
265=back
266
267=head1 STATIC METHODS
268
269Static methods are actually functions that implicitly operate on the
270current coroutine.
271
272=over 4
265 273
266=item schedule 274=item schedule
267 275
268Calls the scheduler. Please note that the current coroutine will not be put 276Calls the scheduler. The scheduler will find the next coroutine that is
277to be run from the ready queue and switches to it. The next coroutine
278to be run is simply the one with the highest priority that is longest
279in its ready queue. If there is no coroutine ready, it will clal the
280C<$Coro::idle> hook.
281
282Please note that the current coroutine will I<not> be put into the ready
269into the ready queue, so calling this function usually means you will 283queue, so calling this function usually means you will never be called
270never be called again unless something else (e.g. an event handler) calls 284again unless something else (e.g. an event handler) calls C<< ->ready >>,
271ready. 285thus waking you up.
272 286
273The canonical way to wait on external events is this: 287This makes C<schedule> I<the> generic method to use to block the current
288coroutine and wait for events: first you remember the current coroutine in
289a variable, then arrange for some callback of yours to call C<< ->ready
290>> on that once some event happens, and last you call C<schedule> to put
291yourself to sleep. Note that a lot of things can wake your coroutine up,
292so you need to check whether the event indeed happened, e.g. by storing the
293status in a variable.
274 294
295See B<HOW TO WAIT FOR A CALLBACK>, below, for some ways to wait for callbacks.
296
297=item cede
298
299"Cede" to other coroutines. This function puts the current coroutine into
300the ready queue and calls C<schedule>, which has the effect of giving
301up the current "timeslice" to other coroutines of the same or higher
302priority. Once your coroutine gets its turn again it will automatically be
303resumed.
304
305This function is often called C<yield> in other languages.
306
307=item Coro::cede_notself
308
309Works like cede, but is not exported by default and will cede to I<any>
310coroutine, regardless of priority. This is useful sometimes to ensure
311progress is made.
312
313=item terminate [arg...]
314
315Terminates the current coroutine with the given status values (see L<cancel>).
316
317=item killall
318
319Kills/terminates/cancels all coroutines except the currently running
320one. This can be useful after a fork, either in the child or the parent,
321as usually only one of them should inherit the running coroutines.
322
323Note that in the implementation, destructors run as normal, making this
324function not so useful after a fork. Future versions of this function
325might try to free resources without running any code.
326
327Note that while this will try to free some of the main programs resources,
328you cannot free all of them, so if a coroutine that is not the main
329program calls this function, there will be some one-time resource leak.
330
331=cut
332
333sub killall {
334 for (Coro::State::list) {
335 $_->cancel
336 if $_ != $current && UNIVERSAL::isa $_, "Coro";
275 { 337 }
276 # remember current coroutine 338}
339
340=back
341
342=head1 COROUTINE OBJECT METHODS
343
344These are the methods you can call on coroutine objects (or to create
345them).
346
347=over 4
348
349=item new Coro \&sub [, @args...]
350
351Create a new coroutine and return it. When the sub returns, the coroutine
352automatically terminates as if C<terminate> with the returned values were
353called. To make the coroutine run you must first put it into the ready
354queue by calling the ready method.
355
356See C<async> and C<Coro::State::new> for additional info about the
357coroutine environment.
358
359=cut
360
361sub _coro_run {
362 terminate &{+shift};
363}
364
365=item $success = $coroutine->ready
366
367Put the given coroutine into the end of its ready queue (there is one
368queue for each priority) and return true. If the coroutine is already in
369the ready queue, do nothing and return false.
370
371This ensures that the scheduler will resume this coroutine automatically
372once all the coroutines of higher priority and all coroutines of the same
373priority that were put into the ready queue earlier have been resumed.
374
375=item $is_ready = $coroutine->is_ready
376
377Return whether the coroutine is currently the ready queue or not,
378
379=item $coroutine->cancel (arg...)
380
381Terminates the given coroutine and makes it return the given arguments as
382status (default: the empty list). Never returns if the coroutine is the
383current coroutine.
384
385=cut
386
387sub cancel {
388 my $self = shift;
389
390 if ($current == $self) {
391 terminate @_;
392 } else {
393 $self->{_status} = [@_];
394 $self->_cancel;
395 }
396}
397
398=item $coroutine->schedule_to
399
400Puts the current coroutine to sleep (like C<Coro::schedule>), but instead
401of continuing with the next coro from the ready queue, always switch to
402the given coroutine object (regardless of priority etc.). The readyness
403state of that coroutine isn't changed.
404
405This is an advanced method for special cases - I'd love to hear about any
406uses for this one.
407
408=item $coroutine->cede_to
409
410Like C<schedule_to>, but puts the current coroutine into the ready
411queue. This has the effect of temporarily switching to the given
412coroutine, and continuing some time later.
413
414This is an advanced method for special cases - I'd love to hear about any
415uses for this one.
416
417=item $coroutine->throw ([$scalar])
418
419If C<$throw> is specified and defined, it will be thrown as an exception
420inside the coroutine at the next convenient point in time. Otherwise
421clears the exception object.
422
423Coro will check for the exception each time a schedule-like-function
424returns, i.e. after each C<schedule>, C<cede>, C<< Coro::Semaphore->down
425>>, C<< Coro::Handle->readable >> and so on. Most of these functions
426detect this case and return early in case an exception is pending.
427
428The exception object will be thrown "as is" with the specified scalar in
429C<$@>, i.e. if it is a string, no line number or newline will be appended
430(unlike with C<die>).
431
432This can be used as a softer means than C<cancel> to ask a coroutine to
433end itself, although there is no guarantee that the exception will lead to
434termination, and if the exception isn't caught it might well end the whole
435program.
436
437You might also think of C<throw> as being the moral equivalent of
438C<kill>ing a coroutine with a signal (in this case, a scalar).
439
440=item $coroutine->join
441
442Wait until the coroutine terminates and return any values given to the
443C<terminate> or C<cancel> functions. C<join> can be called concurrently
444from multiple coroutines, and all will be resumed and given the status
445return once the C<$coroutine> terminates.
446
447=cut
448
449sub join {
450 my $self = shift;
451
452 unless ($self->{_status}) {
277 my $current = $Coro::current; 453 my $current = $current;
278 454
279 # register a hypothetical event handler 455 push @{$self->{_on_destroy}}, sub {
280 on_event_invoke sub {
281 # wake up sleeping coroutine
282 $current->ready; 456 $current->ready;
283 undef $current; 457 undef $current;
284 }; 458 };
285 459
286 # call schedule until event occurred.
287 # in case we are woken up for other reasons
288 # (current still defined), loop.
289 Coro::schedule while $current;
290 }
291
292=item cede
293
294"Cede" to other coroutines. This function puts the current coroutine into the
295ready queue and calls C<schedule>, which has the effect of giving up the
296current "timeslice" to other coroutines of the same or higher priority.
297
298Returns true if at least one coroutine switch has happened.
299
300=item Coro::cede_notself
301
302Works like cede, but is not exported by default and will cede to any
303coroutine, regardless of priority, once.
304
305Returns true if at least one coroutine switch has happened.
306
307=item terminate [arg...]
308
309Terminates the current coroutine with the given status values (see L<cancel>).
310
311=cut
312
313sub terminate {
314 $current->cancel (@_);
315}
316
317=back
318
319# dynamic methods
320
321=head2 COROUTINE METHODS
322
323These are the methods you can call on coroutine objects.
324
325=over 4
326
327=item new Coro \&sub [, @args...]
328
329Create a new coroutine and return it. When the sub returns the coroutine
330automatically terminates as if C<terminate> with the returned values were
331called. To make the coroutine run you must first put it into the ready queue
332by calling the ready method.
333
334See C<async> for additional discussion.
335
336=cut
337
338sub _run_coro {
339 terminate &{+shift};
340}
341
342sub new {
343 my $class = shift;
344
345 $class->SUPER::new (\&_run_coro, @_)
346}
347
348=item $success = $coroutine->ready
349
350Put the given coroutine into the ready queue (according to it's priority)
351and return true. If the coroutine is already in the ready queue, do nothing
352and return false.
353
354=item $is_ready = $coroutine->is_ready
355
356Return wether the coroutine is currently the ready queue or not,
357
358=item $coroutine->cancel (arg...)
359
360Terminates the given coroutine and makes it return the given arguments as
361status (default: the empty list). Never returns if the coroutine is the
362current coroutine.
363
364=cut
365
366sub cancel {
367 my $self = shift;
368 $self->{status} = [@_];
369
370 if ($current == $self) {
371 push @destroy, $self;
372 $manager->ready;
373 &schedule while 1;
374 } else {
375 $self->_cancel;
376 }
377}
378
379=item $coroutine->join
380
381Wait until the coroutine terminates and return any values given to the
382C<terminate> or C<cancel> functions. C<join> can be called multiple times
383from multiple coroutine.
384
385=cut
386
387sub join {
388 my $self = shift;
389
390 unless ($self->{status}) {
391 my $current = $current;
392
393 push @{$self->{destroy_cb}}, sub {
394 $current->ready;
395 undef $current;
396 };
397
398 &schedule while $current; 460 &schedule while $current;
399 } 461 }
400 462
401 wantarray ? @{$self->{status}} : $self->{status}[0]; 463 wantarray ? @{$self->{_status}} : $self->{_status}[0];
402} 464}
403 465
404=item $coroutine->on_destroy (\&cb) 466=item $coroutine->on_destroy (\&cb)
405 467
406Registers a callback that is called when this coroutine gets destroyed, 468Registers a callback that is called when this coroutine gets destroyed,
407but before it is joined. The callback gets passed the terminate arguments, 469but before it is joined. The callback gets passed the terminate arguments,
408if any. 470if any, and I<must not> die, under any circumstances.
409 471
410=cut 472=cut
411 473
412sub on_destroy { 474sub on_destroy {
413 my ($self, $cb) = @_; 475 my ($self, $cb) = @_;
414 476
415 push @{ $self->{destroy_cb} }, $cb; 477 push @{ $self->{_on_destroy} }, $cb;
416} 478}
417 479
418=item $oldprio = $coroutine->prio ($newprio) 480=item $oldprio = $coroutine->prio ($newprio)
419 481
420Sets (or gets, if the argument is missing) the priority of the 482Sets (or gets, if the argument is missing) the priority of the
443higher values mean lower priority, just as in unix). 505higher values mean lower priority, just as in unix).
444 506
445=item $olddesc = $coroutine->desc ($newdesc) 507=item $olddesc = $coroutine->desc ($newdesc)
446 508
447Sets (or gets in case the argument is missing) the description for this 509Sets (or gets in case the argument is missing) the description for this
448coroutine. This is just a free-form string you can associate with a coroutine. 510coroutine. This is just a free-form string you can associate with a
511coroutine.
512
513This method simply sets the C<< $coroutine->{desc} >> member to the given
514string. You can modify this member directly if you wish.
449 515
450=cut 516=cut
451 517
452sub desc { 518sub desc {
453 my $old = $_[0]{desc}; 519 my $old = $_[0]{desc};
454 $_[0]{desc} = $_[1] if @_ > 1; 520 $_[0]{desc} = $_[1] if @_ > 1;
455 $old; 521 $old;
456} 522}
457 523
524sub transfer {
525 require Carp;
526 Carp::croak ("You must not call ->transfer on Coro objects. Use Coro::State objects or the ->schedule_to method. Caught");
527}
528
458=back 529=back
459 530
460=head2 GLOBAL FUNCTIONS 531=head1 GLOBAL FUNCTIONS
461 532
462=over 4 533=over 4
463 534
464=item Coro::nready 535=item Coro::nready
465 536
466Returns the number of coroutines that are currently in the ready state, 537Returns the number of coroutines that are currently in the ready state,
467i.e. that can be switched to. The value C<0> means that the only runnable 538i.e. that can be switched to by calling C<schedule> directory or
539indirectly. The value C<0> means that the only runnable coroutine is the
468coroutine is the currently running one, so C<cede> would have no effect, 540currently running one, so C<cede> would have no effect, and C<schedule>
469and C<schedule> would cause a deadlock unless there is an idle handler 541would cause a deadlock unless there is an idle handler that wakes up some
470that wakes up some coroutines. 542coroutines.
471 543
472=item my $guard = Coro::guard { ... } 544=item my $guard = Coro::guard { ... }
473 545
474This creates and returns a guard object. Nothing happens until the object 546This function still exists, but is deprecated. Please use the
475gets destroyed, in which case the codeblock given as argument will be 547C<Guard::guard> function instead.
476executed. This is useful to free locks or other resources in case of a
477runtime error or when the coroutine gets canceled, as in both cases the
478guard block will be executed. The guard object supports only one method,
479C<< ->cancel >>, which will keep the codeblock from being executed.
480 548
481Example: set some flag and clear it again when the coroutine gets canceled
482or the function returns:
483
484 sub do_something {
485 my $guard = Coro::guard { $busy = 0 };
486 $busy = 1;
487
488 # do something that requires $busy to be true
489 }
490
491=cut 549=cut
492 550
493sub guard(&) { 551BEGIN { *guard = \&Guard::guard }
494 bless \(my $cb = $_[0]), "Coro::guard"
495}
496
497sub Coro::guard::cancel {
498 ${$_[0]} = sub { };
499}
500
501sub Coro::guard::DESTROY {
502 ${$_[0]}->();
503}
504
505 552
506=item unblock_sub { ... } 553=item unblock_sub { ... }
507 554
508This utility function takes a BLOCK or code reference and "unblocks" it, 555This utility function takes a BLOCK or code reference and "unblocks" it,
509returning the new coderef. This means that the new coderef will return 556returning a new coderef. Unblocking means that calling the new coderef
510immediately without blocking, returning nothing, while the original code 557will return immediately without blocking, returning nothing, while the
511ref will be called (with parameters) from within its own coroutine. 558original code ref will be called (with parameters) from within another
559coroutine.
512 560
513The reason this function exists is that many event libraries (such as the 561The reason this function exists is that many event libraries (such as the
514venerable L<Event|Event> module) are not coroutine-safe (a weaker form 562venerable L<Event|Event> module) are not coroutine-safe (a weaker form
515of thread-safety). This means you must not block within event callbacks, 563of reentrancy). This means you must not block within event callbacks,
516otherwise you might suffer from crashes or worse. 564otherwise you might suffer from crashes or worse. The only event library
565currently known that is safe to use without C<unblock_sub> is L<EV>.
517 566
518This function allows your callbacks to block by executing them in another 567This function allows your callbacks to block by executing them in another
519coroutine where it is safe to block. One example where blocking is handy 568coroutine where it is safe to block. One example where blocking is handy
520is when you use the L<Coro::AIO|Coro::AIO> functions to save results to 569is when you use the L<Coro::AIO|Coro::AIO> functions to save results to
521disk. 570disk, for example.
522 571
523In short: simply use C<unblock_sub { ... }> instead of C<sub { ... }> when 572In short: simply use C<unblock_sub { ... }> instead of C<sub { ... }> when
524creating event callbacks that want to block. 573creating event callbacks that want to block.
574
575If your handler does not plan to block (e.g. simply sends a message to
576another coroutine, or puts some other coroutine into the ready queue),
577there is no reason to use C<unblock_sub>.
578
579Note that you also need to use C<unblock_sub> for any other callbacks that
580are indirectly executed by any C-based event loop. For example, when you
581use a module that uses L<AnyEvent> (and you use L<Coro::AnyEvent>) and it
582provides callbacks that are the result of some event callback, then you
583must not block either, or use C<unblock_sub>.
525 584
526=cut 585=cut
527 586
528our @unblock_queue; 587our @unblock_queue;
529 588
530# we create a special coro because we want to cede, 589# we create a special coro because we want to cede,
531# to reduce pressure on the coro pool (because most callbacks 590# to reduce pressure on the coro pool (because most callbacks
532# return immediately and can be reused) and because we cannot cede 591# return immediately and can be reused) and because we cannot cede
533# inside an event callback. 592# inside an event callback.
534our $unblock_scheduler = async { 593our $unblock_scheduler = new Coro sub {
535 while () { 594 while () {
536 while (my $cb = pop @unblock_queue) { 595 while (my $cb = pop @unblock_queue) {
537 # this is an inlined copy of async_pool 596 &async_pool (@$cb);
538 my $coro = (pop @pool or new Coro \&pool_handler);
539 597
540 $coro->{_invoke} = $cb;
541 $coro->ready;
542 cede; # for short-lived callbacks, this reduces pressure on the coro pool 598 # for short-lived callbacks, this reduces pressure on the coro pool
599 # as the chance is very high that the async_poll coro will be back
600 # in the idle state when cede returns
601 cede;
543 } 602 }
544 schedule; # sleep well 603 schedule; # sleep well
545 } 604 }
546}; 605};
606$unblock_scheduler->{desc} = "[unblock_sub scheduler]";
547 607
548sub unblock_sub(&) { 608sub unblock_sub(&) {
549 my $cb = shift; 609 my $cb = shift;
550 610
551 sub { 611 sub {
552 unshift @unblock_queue, [$cb, @_]; 612 unshift @unblock_queue, [$cb, @_];
553 $unblock_scheduler->ready; 613 $unblock_scheduler->ready;
554 } 614 }
555} 615}
556 616
617=item $cb = Coro::rouse_cb
618
619Create and return a "rouse callback". That's a code reference that,
620when called, will remember a copy of its arguments and notify the owner
621coroutine of the callback.
622
623See the next function.
624
625=item @args = Coro::rouse_wait [$cb]
626
627Wait for the specified rouse callback (or the last one that was created in
628this coroutine).
629
630As soon as the callback is invoked (or when the callback was invoked
631before C<rouse_wait>), it will return the arguments originally passed to
632the rouse callback.
633
634See the section B<HOW TO WAIT FOR A CALLBACK> for an actual usage example.
635
557=back 636=back
558 637
559=cut 638=cut
560 639
5611; 6401;
562 641
642=head1 HOW TO WAIT FOR A CALLBACK
643
644It is very common for a coroutine to wait for some callback to be
645called. This occurs naturally when you use coroutines in an otherwise
646event-based program, or when you use event-based libraries.
647
648These typically register a callback for some event, and call that callback
649when the event occured. In a coroutine, however, you typically want to
650just wait for the event, simplyifying things.
651
652For example C<< AnyEvent->child >> registers a callback to be called when
653a specific child has exited:
654
655 my $child_watcher = AnyEvent->child (pid => $pid, cb => sub { ... });
656
657But from withina coroutine, you often just want to write this:
658
659 my $status = wait_for_child $pid;
660
661Coro offers two functions specifically designed to make this easy,
662C<Coro::rouse_cb> and C<Coro::rouse_wait>.
663
664The first function, C<rouse_cb>, generates and returns a callback that,
665when invoked, will save its arguments and notify the coroutine that
666created the callback.
667
668The second function, C<rouse_wait>, waits for the callback to be called
669(by calling C<schedule> to go to sleep) and returns the arguments
670originally passed to the callback.
671
672Using these functions, it becomes easy to write the C<wait_for_child>
673function mentioned above:
674
675 sub wait_for_child($) {
676 my ($pid) = @_;
677
678 my $watcher = AnyEvent->child (pid => $pid, cb => Coro::rouse_cb);
679
680 my ($rpid, $rstatus) = Coro::rouse_wait;
681 $rstatus
682 }
683
684In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough,
685you can roll your own, using C<schedule>:
686
687 sub wait_for_child($) {
688 my ($pid) = @_;
689
690 # store the current coroutine in $current,
691 # and provide result variables for the closure passed to ->child
692 my $current = $Coro::current;
693 my ($done, $rstatus);
694
695 # pass a closure to ->child
696 my $watcher = AnyEvent->child (pid => $pid, cb => sub {
697 $rstatus = $_[1]; # remember rstatus
698 $done = 1; # mark $rstatus as valud
699 });
700
701 # wait until the closure has been called
702 schedule while !$done;
703
704 $rstatus
705 }
706
707
563=head1 BUGS/LIMITATIONS 708=head1 BUGS/LIMITATIONS
564 709
565 - you must make very sure that no coro is still active on global 710=over 4
566 destruction. very bad things might happen otherwise (usually segfaults).
567 711
712=item fork with pthread backend
713
714When Coro is compiled using the pthread backend (which isn't recommended
715but required on many BSDs as their libcs are completely broken), then
716coroutines will not survive a fork. There is no known workaround except to
717fix your libc and use a saner backend.
718
719=item perl process emulation ("threads")
720
568 - this module is not thread-safe. You should only ever use this module 721This module is not perl-pseudo-thread-safe. You should only ever use this
569 from the same thread (this requirement might be loosened in the future 722module from the first thread (this requirement might be removed in the
570 to allow per-thread schedulers, but Coro::State does not yet allow 723future to allow per-thread schedulers, but Coro::State does not yet allow
571 this). 724this). I recommend disabling thread support and using processes, as having
725the windows process emulation enabled under unix roughly halves perl
726performance, even when not used.
727
728=item coroutine switching not signal safe
729
730You must not switch to another coroutine from within a signal handler
731(only relevant with %SIG - most event libraries provide safe signals).
732
733That means you I<MUST NOT> call any function that might "block" the
734current coroutine - C<cede>, C<schedule> C<< Coro::Semaphore->down >> or
735anything that calls those. Everything else, including calling C<ready>,
736works.
737
738=back
739
572 740
573=head1 SEE ALSO 741=head1 SEE ALSO
574 742
743Event-Loop integration: L<Coro::AnyEvent>, L<Coro::EV>, L<Coro::Event>.
744
745Debugging: L<Coro::Debug>.
746
575Support/Utility: L<Coro::Cont>, L<Coro::Specific>, L<Coro::State>, L<Coro::Util>. 747Support/Utility: L<Coro::Specific>, L<Coro::Util>.
576 748
577Locking/IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>, L<Coro::SemaphoreSet>, L<Coro::RWLock>. 749Locking and IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>,
750L<Coro::SemaphoreSet>, L<Coro::RWLock>.
578 751
579Event/IO: L<Coro::Timer>, L<Coro::Event>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::Select>. 752I/O and Timers: L<Coro::Timer>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::AIO>.
580 753
581Embedding: L<Coro:MakeMaker> 754Compatibility with other modules: L<Coro::LWP> (but see also L<AnyEvent::HTTP> for
755a better-working alternative), L<Coro::BDB>, L<Coro::Storable>,
756L<Coro::Select>.
757
758XS API: L<Coro::MakeMaker>.
759
760Low level Configuration, Thread Environment, Continuations: L<Coro::State>.
582 761
583=head1 AUTHOR 762=head1 AUTHOR
584 763
585 Marc Lehmann <schmorp@schmorp.de> 764 Marc Lehmann <schmorp@schmorp.de>
586 http://home.schmorp.de/ 765 http://home.schmorp.de/

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines