ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/Coro/Coro.pm
(Generate patch)

Comparing Coro/Coro.pm (file contents):
Revision 1.94 by root, Sat Dec 2 18:01:30 2006 UTC vs.
Revision 1.244 by root, Sat Dec 13 22:08:13 2008 UTC

1=head1 NAME 1=head1 NAME
2 2
3Coro - coroutine process abstraction 3Coro - the only real threads in perl
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 use Coro; 7 use Coro;
8 8
9 async { 9 async {
10 # some asynchronous thread of execution 10 # some asynchronous thread of execution
11 print "2\n";
12 cede; # yield back to main
13 print "4\n";
11 }; 14 };
12 15 print "1\n";
13 # alternatively create an async coroutine like this: 16 cede; # yield to coroutine
14 17 print "3\n";
15 sub some_func : Coro { 18 cede; # and again
16 # some more async code 19
17 } 20 # use locking
18 21 use Coro::Semaphore;
19 cede; 22 my $lock = new Coro::Semaphore;
23 my $locked;
24
25 $lock->down;
26 $locked = 1;
27 $lock->up;
20 28
21=head1 DESCRIPTION 29=head1 DESCRIPTION
22 30
23This module collection manages coroutines. Coroutines are similar to 31For a tutorial-style introduction, please read the L<Coro::Intro>
24threads but don't run in parallel. 32manpage. This manpage mainly contains reference information.
25 33
34This module collection manages continuations in general, most often
35in the form of cooperative threads (also called coroutines in the
36documentation). They are similar to kernel threads but don't (in general)
37run in parallel at the same time even on SMP machines. The specific flavor
38of thread offered by this module also guarantees you that it will not
39switch between threads unless necessary, at easily-identified points in
40your program, so locking and parallel access are rarely an issue, making
41thread programming much safer and easier than using other thread models.
42
43Unlike the so-called "Perl threads" (which are not actually real threads
44but only the windows process emulation ported to unix), Coro provides a
45full shared address space, which makes communication between threads
46very easy. And threads are fast, too: disabling the Windows process
47emulation code in your perl and using Coro can easily result in a two to
48four times speed increase for your programs.
49
50Coro achieves that by supporting multiple running interpreters that share
51data, which is especially useful to code pseudo-parallel processes and
52for event-based programming, such as multiple HTTP-GET requests running
53concurrently. See L<Coro::AnyEvent> to learn more on how to integrate Coro
54into an event-based environment.
55
26In this module, coroutines are defined as "callchain + lexical variables 56In this module, a thread is defined as "callchain + lexical variables +
27+ @_ + $_ + $@ + $^W + C stack), that is, a coroutine has it's own 57@_ + $_ + $@ + $/ + C stack), that is, a thread has its own callchain,
28callchain, it's own set of lexicals and it's own set of perl's most 58its own set of lexicals and its own set of perls most important global
29important global variables. 59variables (see L<Coro::State> for more configuration and background info).
60
61See also the C<SEE ALSO> section at the end of this document - the Coro
62module family is quite large.
30 63
31=cut 64=cut
32 65
33package Coro; 66package Coro;
34 67
35use strict; 68use strict qw(vars subs);
36no warnings "uninitialized"; 69no warnings "uninitialized";
37 70
38use Coro::State; 71use Coro::State;
39 72
40use base qw(Coro::State Exporter); 73use base qw(Coro::State Exporter);
41 74
42our $idle; # idle handler 75our $idle; # idle handler
43our $main; # main coroutine 76our $main; # main coroutine
44our $current; # current coroutine 77our $current; # current coroutine
45 78
46our $VERSION = '3.0'; 79our $VERSION = 5.13;
47 80
48our @EXPORT = qw(async cede schedule terminate current unblock_sub); 81our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub);
49our %EXPORT_TAGS = ( 82our %EXPORT_TAGS = (
50 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 83 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
51); 84);
52our @EXPORT_OK = @{$EXPORT_TAGS{prio}}; 85our @EXPORT_OK = (@{$EXPORT_TAGS{prio}}, qw(nready));
53 86
54{ 87=head1 GLOBAL VARIABLES
55 my @async;
56 my $init;
57
58 # this way of handling attributes simply is NOT scalable ;()
59 sub import {
60 no strict 'refs';
61
62 Coro->export_to_level (1, @_);
63
64 my $old = *{(caller)[0]."::MODIFY_CODE_ATTRIBUTES"}{CODE};
65 *{(caller)[0]."::MODIFY_CODE_ATTRIBUTES"} = sub {
66 my ($package, $ref) = (shift, shift);
67 my @attrs;
68 for (@_) {
69 if ($_ eq "Coro") {
70 push @async, $ref;
71 unless ($init++) {
72 eval q{
73 sub INIT {
74 &async(pop @async) while @async;
75 }
76 };
77 }
78 } else {
79 push @attrs, $_;
80 }
81 }
82 return $old ? $old->($package, $ref, @attrs) : @attrs;
83 };
84 }
85
86}
87 88
88=over 4 89=over 4
89 90
90=item $main 91=item $Coro::main
91 92
92This coroutine represents the main program. 93This variable stores the coroutine object that represents the main
94program. While you cna C<ready> it and do most other things you can do to
95coroutines, it is mainly useful to compare again C<$Coro::current>, to see
96whether you are running in the main program or not.
93 97
94=cut 98=cut
95 99
96$main = new Coro; 100# $main is now being initialised by Coro::State
97 101
98=item $current (or as function: current) 102=item $Coro::current
99 103
100The current coroutine (the last coroutine switched to). The initial value 104The coroutine object representing the current coroutine (the last
105coroutine that the Coro scheduler switched to). The initial value is
101is C<$main> (of course). 106C<$Coro::main> (of course).
102 107
103This variable is B<strictly> I<read-only>. It is provided for performance 108This variable is B<strictly> I<read-only>. You can take copies of the
104reasons. If performance is not essentiel you are encouraged to use the 109value stored in it and use it as any other coroutine object, but you must
105C<Coro::current> function instead. 110not otherwise modify the variable itself.
106 111
107=cut 112=cut
108 113
109# maybe some other module used Coro::Specific before...
110$main->{specific} = $current->{specific}
111 if $current;
112
113_set_current $main;
114
115sub current() { $current } 114sub current() { $current } # [DEPRECATED]
116 115
117=item $idle 116=item $Coro::idle
118 117
118This variable is mainly useful to integrate Coro into event loops. It is
119usually better to rely on L<Coro::AnyEvent> or L<Coro::EV>, as this is
120pretty low-level functionality.
121
122This variable stores either a coroutine or a callback.
123
119A callback that is called whenever the scheduler finds no ready coroutines 124If it is a callback, the it is called whenever the scheduler finds no
120to run. The default implementation prints "FATAL: deadlock detected" and 125ready coroutines to run. The default implementation prints "FATAL:
121exits, because the program has no other way to continue. 126deadlock detected" and exits, because the program has no other way to
127continue.
122 128
129If it is a coroutine object, then this object will be readied (without
130invoking any ready hooks, however) when the scheduler finds no other ready
131coroutines to run.
132
123This hook is overwritten by modules such as C<Coro::Timer> and 133This hook is overwritten by modules such as C<Coro::EV> and
124C<Coro::Event> to wait on an external event that hopefully wake up a 134C<Coro::AnyEvent> to wait on an external event that hopefully wake up a
125coroutine so the scheduler can run it. 135coroutine so the scheduler can run it.
126 136
137Note that the callback I<must not>, under any circumstances, block
138the current coroutine. Normally, this is achieved by having an "idle
139coroutine" that calls the event loop and then blocks again, and then
140readying that coroutine in the idle handler, or by simply placing the idle
141coroutine in this variable.
142
143See L<Coro::Event> or L<Coro::AnyEvent> for examples of using this
144technique.
145
127Please note that if your callback recursively invokes perl (e.g. for event 146Please note that if your callback recursively invokes perl (e.g. for event
128handlers), then it must be prepared to be called recursively. 147handlers), then it must be prepared to be called recursively itself.
129 148
130=cut 149=cut
131 150
132$idle = sub { 151$idle = sub {
133 print STDERR "FATAL: deadlock detected\n"; 152 require Carp;
134 exit (51); 153 Carp::croak ("FATAL: deadlock detected");
135}; 154};
136 155
137# this coroutine is necessary because a coroutine 156# this coroutine is necessary because a coroutine
138# cannot destroy itself. 157# cannot destroy itself.
139my @destroy; 158our @destroy;
159our $manager;
160
140my $manager; $manager = new Coro sub { 161$manager = new Coro sub {
141 while () { 162 while () {
142 # by overwriting the state object with the manager we destroy it 163 Coro::_cancel shift @destroy
143 # while still being able to schedule this coroutine (in case it has
144 # been readied multiple times. this is harmless since the manager
145 # can be called as many times as neccessary and will always
146 # remove itself from the runqueue
147 while (@destroy) { 164 while @destroy;
148 my $coro = pop @destroy;
149 $coro->{status} ||= [];
150 $_->ready for @{delete $coro->{join} || []};
151 165
152 # the next line destroys the coro state, but keeps the
153 # coroutine itself intact (we basically make it a zombie
154 # coroutine that always runs the manager thread, so it's possible
155 # to transfer() to this coroutine).
156 $coro->_clone_state_from ($manager);
157 }
158 &schedule; 166 &schedule;
159 } 167 }
160}; 168};
161 169$manager->{desc} = "[coro manager]";
162# static methods. not really. 170$manager->prio (PRIO_MAX);
163 171
164=back 172=back
165 173
166=head2 STATIC METHODS 174=head1 SIMPLE COROUTINE CREATION
167
168Static methods are actually functions that operate on the current coroutine only.
169 175
170=over 4 176=over 4
171 177
172=item async { ... } [@args...] 178=item async { ... } [@args...]
173 179
174Create a new asynchronous coroutine and return it's coroutine object 180Create a new coroutine and return its coroutine object (usually
175(usually unused). When the sub returns the new coroutine is automatically 181unused). The coroutine will be put into the ready queue, so
182it will start running automatically on the next scheduler run.
183
184The first argument is a codeblock/closure that should be executed in the
185coroutine. When it returns argument returns the coroutine is automatically
176terminated. 186terminated.
177 187
178Calling C<exit> in a coroutine will not work correctly, so do not do that. 188The remaining arguments are passed as arguments to the closure.
179 189
180When the coroutine dies, the program will exit, just as in the main 190See the C<Coro::State::new> constructor for info about the coroutine
181program. 191environment in which coroutines are executed.
182 192
193Calling C<exit> in a coroutine will do the same as calling exit outside
194the coroutine. Likewise, when the coroutine dies, the program will exit,
195just as it would in the main program.
196
197If you do not want that, you can provide a default C<die> handler, or
198simply avoid dieing (by use of C<eval>).
199
183 # create a new coroutine that just prints its arguments 200Example: Create a new coroutine that just prints its arguments.
201
184 async { 202 async {
185 print "@_\n"; 203 print "@_\n";
186 } 1,2,3,4; 204 } 1,2,3,4;
187 205
188=cut 206=cut
189 207
190sub async(&@) { 208sub async(&@) {
191 my $pid = new Coro @_; 209 my $coro = new Coro @_;
192 $pid->ready; 210 $coro->ready;
193 $pid 211 $coro
194} 212}
213
214=item async_pool { ... } [@args...]
215
216Similar to C<async>, but uses a coroutine pool, so you should not call
217terminate or join on it (although you are allowed to), and you get a
218coroutine that might have executed other code already (which can be good
219or bad :).
220
221On the plus side, this function is about twice as fast as creating (and
222destroying) a completely new coroutine, so if you need a lot of generic
223coroutines in quick successsion, use C<async_pool>, not C<async>.
224
225The code block is executed in an C<eval> context and a warning will be
226issued in case of an exception instead of terminating the program, as
227C<async> does. As the coroutine is being reused, stuff like C<on_destroy>
228will not work in the expected way, unless you call terminate or cancel,
229which somehow defeats the purpose of pooling (but is fine in the
230exceptional case).
231
232The priority will be reset to C<0> after each run, tracing will be
233disabled, the description will be reset and the default output filehandle
234gets restored, so you can change all these. Otherwise the coroutine will
235be re-used "as-is": most notably if you change other per-coroutine global
236stuff such as C<$/> you I<must needs> revert that change, which is most
237simply done by using local as in: C<< local $/ >>.
238
239The idle pool size is limited to C<8> idle coroutines (this can be
240adjusted by changing $Coro::POOL_SIZE), but there can be as many non-idle
241coros as required.
242
243If you are concerned about pooled coroutines growing a lot because a
244single C<async_pool> used a lot of stackspace you can e.g. C<async_pool
245{ terminate }> once per second or so to slowly replenish the pool. In
246addition to that, when the stacks used by a handler grows larger than 32kb
247(adjustable via $Coro::POOL_RSS) it will also be destroyed.
248
249=cut
250
251our $POOL_SIZE = 8;
252our $POOL_RSS = 32 * 1024;
253our @async_pool;
254
255sub pool_handler {
256 while () {
257 eval {
258 &{&_pool_handler} while 1;
259 };
260
261 warn $@ if $@;
262 }
263}
264
265=back
266
267=head1 STATIC METHODS
268
269Static methods are actually functions that implicitly operate on the
270current coroutine.
271
272=over 4
195 273
196=item schedule 274=item schedule
197 275
198Calls the scheduler. Please note that the current coroutine will not be put 276Calls the scheduler. The scheduler will find the next coroutine that is
277to be run from the ready queue and switches to it. The next coroutine
278to be run is simply the one with the highest priority that is longest
279in its ready queue. If there is no coroutine ready, it will clal the
280C<$Coro::idle> hook.
281
282Please note that the current coroutine will I<not> be put into the ready
199into the ready queue, so calling this function usually means you will 283queue, so calling this function usually means you will never be called
200never be called again unless something else (e.g. an event handler) calls 284again unless something else (e.g. an event handler) calls C<< ->ready >>,
201ready. 285thus waking you up.
202 286
203The canonical way to wait on external events is this: 287This makes C<schedule> I<the> generic method to use to block the current
288coroutine and wait for events: first you remember the current coroutine in
289a variable, then arrange for some callback of yours to call C<< ->ready
290>> on that once some event happens, and last you call C<schedule> to put
291yourself to sleep. Note that a lot of things can wake your coroutine up,
292so you need to check whether the event indeed happened, e.g. by storing the
293status in a variable.
204 294
295See B<HOW TO WAIT FOR A CALLBACK>, below, for some ways to wait for callbacks.
296
297=item cede
298
299"Cede" to other coroutines. This function puts the current coroutine into
300the ready queue and calls C<schedule>, which has the effect of giving
301up the current "timeslice" to other coroutines of the same or higher
302priority. Once your coroutine gets its turn again it will automatically be
303resumed.
304
305This function is often called C<yield> in other languages.
306
307=item Coro::cede_notself
308
309Works like cede, but is not exported by default and will cede to I<any>
310coroutine, regardless of priority. This is useful sometimes to ensure
311progress is made.
312
313=item terminate [arg...]
314
315Terminates the current coroutine with the given status values (see L<cancel>).
316
317=item killall
318
319Kills/terminates/cancels all coroutines except the currently running
320one. This is useful after a fork, either in the child or the parent, as
321usually only one of them should inherit the running coroutines.
322
323Note that while this will try to free some of the main programs resources,
324you cannot free all of them, so if a coroutine that is not the main
325program calls this function, there will be some one-time resource leak.
326
327=cut
328
329sub killall {
330 for (Coro::State::list) {
331 $_->cancel
332 if $_ != $current && UNIVERSAL::isa $_, "Coro";
205 { 333 }
206 # remember current coroutine 334}
335
336=back
337
338=head1 COROUTINE OBJECT METHODS
339
340These are the methods you can call on coroutine objects (or to create
341them).
342
343=over 4
344
345=item new Coro \&sub [, @args...]
346
347Create a new coroutine and return it. When the sub returns, the coroutine
348automatically terminates as if C<terminate> with the returned values were
349called. To make the coroutine run you must first put it into the ready
350queue by calling the ready method.
351
352See C<async> and C<Coro::State::new> for additional info about the
353coroutine environment.
354
355=cut
356
357sub _coro_run {
358 terminate &{+shift};
359}
360
361=item $success = $coroutine->ready
362
363Put the given coroutine into the end of its ready queue (there is one
364queue for each priority) and return true. If the coroutine is already in
365the ready queue, do nothing and return false.
366
367This ensures that the scheduler will resume this coroutine automatically
368once all the coroutines of higher priority and all coroutines of the same
369priority that were put into the ready queue earlier have been resumed.
370
371=item $is_ready = $coroutine->is_ready
372
373Return whether the coroutine is currently the ready queue or not,
374
375=item $coroutine->cancel (arg...)
376
377Terminates the given coroutine and makes it return the given arguments as
378status (default: the empty list). Never returns if the coroutine is the
379current coroutine.
380
381=cut
382
383sub cancel {
384 my $self = shift;
385
386 if ($current == $self) {
387 terminate @_;
388 } else {
389 $self->{_status} = [@_];
390 $self->_cancel;
391 }
392}
393
394=item $coroutine->schedule_to
395
396Puts the current coroutine to sleep (like C<Coro::schedule>), but instead
397of continuing with the next coro from the ready queue, always switch to
398the given coroutine object (regardless of priority etc.). The readyness
399state of that coroutine isn't changed.
400
401This is an advanced method for special cases - I'd love to hear about any
402uses for this one.
403
404=item $coroutine->cede_to
405
406Like C<schedule_to>, but puts the current coroutine into the ready
407queue. This has the effect of temporarily switching to the given
408coroutine, and continuing some time later.
409
410This is an advanced method for special cases - I'd love to hear about any
411uses for this one.
412
413=item $coroutine->throw ([$scalar])
414
415If C<$throw> is specified and defined, it will be thrown as an exception
416inside the coroutine at the next convenient point in time. Otherwise
417clears the exception object.
418
419Coro will check for the exception each time a schedule-like-function
420returns, i.e. after each C<schedule>, C<cede>, C<< Coro::Semaphore->down
421>>, C<< Coro::Handle->readable >> and so on. Most of these functions
422detect this case and return early in case an exception is pending.
423
424The exception object will be thrown "as is" with the specified scalar in
425C<$@>, i.e. if it is a string, no line number or newline will be appended
426(unlike with C<die>).
427
428This can be used as a softer means than C<cancel> to ask a coroutine to
429end itself, although there is no guarantee that the exception will lead to
430termination, and if the exception isn't caught it might well end the whole
431program.
432
433You might also think of C<throw> as being the moral equivalent of
434C<kill>ing a coroutine with a signal (in this case, a scalar).
435
436=item $coroutine->join
437
438Wait until the coroutine terminates and return any values given to the
439C<terminate> or C<cancel> functions. C<join> can be called concurrently
440from multiple coroutines, and all will be resumed and given the status
441return once the C<$coroutine> terminates.
442
443=cut
444
445sub join {
446 my $self = shift;
447
448 unless ($self->{_status}) {
207 my $current = $Coro::current; 449 my $current = $current;
208 450
209 # register a hypothetical event handler 451 push @{$self->{_on_destroy}}, sub {
210 on_event_invoke sub {
211 # wake up sleeping coroutine
212 $current->ready; 452 $current->ready;
213 undef $current; 453 undef $current;
214 }; 454 };
215 455
216 # call schedule until event occured.
217 # in case we are woken up for other reasons
218 # (current still defined), loop.
219 Coro::schedule while $current; 456 &schedule while $current;
220 } 457 }
221 458
222=item cede
223
224"Cede" to other coroutines. This function puts the current coroutine into the
225ready queue and calls C<schedule>, which has the effect of giving up the
226current "timeslice" to other coroutines of the same or higher priority.
227
228=item terminate [arg...]
229
230Terminates the current coroutine with the given status values (see L<cancel>).
231
232=cut
233
234sub terminate {
235 $current->cancel (@_);
236}
237
238=back
239
240# dynamic methods
241
242=head2 COROUTINE METHODS
243
244These are the methods you can call on coroutine objects.
245
246=over 4
247
248=item new Coro \&sub [, @args...]
249
250Create a new coroutine and return it. When the sub returns the coroutine
251automatically terminates as if C<terminate> with the returned values were
252called. To make the coroutine run you must first put it into the ready queue
253by calling the ready method.
254
255Calling C<exit> in a coroutine will not work correctly, so do not do that.
256
257=cut
258
259sub _run_coro {
260 terminate &{+shift};
261}
262
263sub new {
264 my $class = shift;
265
266 $class->SUPER::new (\&_run_coro, @_)
267}
268
269=item $success = $coroutine->ready
270
271Put the given coroutine into the ready queue (according to it's priority)
272and return true. If the coroutine is already in the ready queue, do nothing
273and return false.
274
275=item $is_ready = $coroutine->is_ready
276
277Return wether the coroutine is currently the ready queue or not,
278
279=item $coroutine->cancel (arg...)
280
281Terminates the given coroutine and makes it return the given arguments as
282status (default: the empty list).
283
284=cut
285
286sub cancel {
287 my $self = shift;
288 $self->{status} = [@_];
289 push @destroy, $self;
290 $manager->ready;
291 &schedule if $current == $self;
292}
293
294=item $coroutine->join
295
296Wait until the coroutine terminates and return any values given to the
297C<terminate> or C<cancel> functions. C<join> can be called multiple times
298from multiple coroutine.
299
300=cut
301
302sub join {
303 my $self = shift;
304 unless ($self->{status}) {
305 push @{$self->{join}}, $current;
306 &schedule;
307 }
308 wantarray ? @{$self->{status}} : $self->{status}[0]; 459 wantarray ? @{$self->{_status}} : $self->{_status}[0];
460}
461
462=item $coroutine->on_destroy (\&cb)
463
464Registers a callback that is called when this coroutine gets destroyed,
465but before it is joined. The callback gets passed the terminate arguments,
466if any, and I<must not> die, under any circumstances.
467
468=cut
469
470sub on_destroy {
471 my ($self, $cb) = @_;
472
473 push @{ $self->{_on_destroy} }, $cb;
309} 474}
310 475
311=item $oldprio = $coroutine->prio ($newprio) 476=item $oldprio = $coroutine->prio ($newprio)
312 477
313Sets (or gets, if the argument is missing) the priority of the 478Sets (or gets, if the argument is missing) the priority of the
336higher values mean lower priority, just as in unix). 501higher values mean lower priority, just as in unix).
337 502
338=item $olddesc = $coroutine->desc ($newdesc) 503=item $olddesc = $coroutine->desc ($newdesc)
339 504
340Sets (or gets in case the argument is missing) the description for this 505Sets (or gets in case the argument is missing) the description for this
341coroutine. This is just a free-form string you can associate with a coroutine. 506coroutine. This is just a free-form string you can associate with a
507coroutine.
508
509This method simply sets the C<< $coroutine->{desc} >> member to the given
510string. You can modify this member directly if you wish.
342 511
343=cut 512=cut
344 513
345sub desc { 514sub desc {
346 my $old = $_[0]{desc}; 515 my $old = $_[0]{desc};
347 $_[0]{desc} = $_[1] if @_ > 1; 516 $_[0]{desc} = $_[1] if @_ > 1;
348 $old; 517 $old;
349} 518}
350 519
520sub transfer {
521 require Carp;
522 Carp::croak ("You must not call ->transfer on Coro objects. Use Coro::State objects or the ->schedule_to method. Caught");
523}
524
351=back 525=back
352 526
353=head2 UTILITY FUNCTIONS 527=head1 GLOBAL FUNCTIONS
354 528
355=over 4 529=over 4
356 530
531=item Coro::nready
532
533Returns the number of coroutines that are currently in the ready state,
534i.e. that can be switched to by calling C<schedule> directory or
535indirectly. The value C<0> means that the only runnable coroutine is the
536currently running one, so C<cede> would have no effect, and C<schedule>
537would cause a deadlock unless there is an idle handler that wakes up some
538coroutines.
539
540=item my $guard = Coro::guard { ... }
541
542This function still exists, but is deprecated. Please use the
543C<Guard::guard> function instead.
544
545=cut
546
547BEGIN { *guard = \&Guard::guard }
548
357=item unblock_sub { ... } 549=item unblock_sub { ... }
358 550
359This utility function takes a BLOCK or code reference and "unblocks" it, 551This utility function takes a BLOCK or code reference and "unblocks" it,
360returning the new coderef. This means that the new coderef will return 552returning a new coderef. Unblocking means that calling the new coderef
361immediately without blocking, returning nothing, while the original code 553will return immediately without blocking, returning nothing, while the
362ref will be called (with parameters) from within its own coroutine. 554original code ref will be called (with parameters) from within another
555coroutine.
363 556
364The reason this fucntion exists is that many event libraries (such as the 557The reason this function exists is that many event libraries (such as the
365venerable L<Event|Event> module) are not coroutine-safe (a weaker form 558venerable L<Event|Event> module) are not coroutine-safe (a weaker form
366of thread-safety). This means you must not block within event callbacks, 559of reentrancy). This means you must not block within event callbacks,
367otherwise you might suffer from crashes or worse. 560otherwise you might suffer from crashes or worse. The only event library
561currently known that is safe to use without C<unblock_sub> is L<EV>.
368 562
369This function allows your callbacks to block by executing them in another 563This function allows your callbacks to block by executing them in another
370coroutine where it is safe to block. One example where blocking is handy 564coroutine where it is safe to block. One example where blocking is handy
371is when you use the L<Coro::AIO|Coro::AIO> functions to save results to 565is when you use the L<Coro::AIO|Coro::AIO> functions to save results to
372disk. 566disk, for example.
373 567
374In short: simply use C<unblock_sub { ... }> instead of C<sub { ... }> when 568In short: simply use C<unblock_sub { ... }> instead of C<sub { ... }> when
375creating event callbacks that want to block. 569creating event callbacks that want to block.
376 570
377=cut 571If your handler does not plan to block (e.g. simply sends a message to
572another coroutine, or puts some other coroutine into the ready queue),
573there is no reason to use C<unblock_sub>.
378 574
379our @unblock_pool; 575Note that you also need to use C<unblock_sub> for any other callbacks that
576are indirectly executed by any C-based event loop. For example, when you
577use a module that uses L<AnyEvent> (and you use L<Coro::AnyEvent>) and it
578provides callbacks that are the result of some event callback, then you
579must not block either, or use C<unblock_sub>.
580
581=cut
582
380our @unblock_queue; 583our @unblock_queue;
381our $UNBLOCK_POOL_SIZE = 2;
382 584
383sub unblock_handler_ { 585# we create a special coro because we want to cede,
384 while () { 586# to reduce pressure on the coro pool (because most callbacks
385 my ($cb, @arg) = @{ delete $Coro::current->{arg} }; 587# return immediately and can be reused) and because we cannot cede
386 $cb->(@arg); 588# inside an event callback.
387
388 last if @unblock_pool >= $UNBLOCK_POOL_SIZE;
389 push @unblock_pool, $Coro::current;
390 schedule;
391 }
392}
393
394our $unblock_scheduler = async { 589our $unblock_scheduler = new Coro sub {
395 while () { 590 while () {
396 while (my $cb = pop @unblock_queue) { 591 while (my $cb = pop @unblock_queue) {
397 my $handler = (pop @unblock_pool or new Coro \&unblock_handler_); 592 &async_pool (@$cb);
398 $handler->{arg} = $cb; 593
399 $handler->ready; 594 # for short-lived callbacks, this reduces pressure on the coro pool
595 # as the chance is very high that the async_poll coro will be back
596 # in the idle state when cede returns
400 cede; 597 cede;
401 } 598 }
402 599 schedule; # sleep well
403 schedule;
404 } 600 }
405}; 601};
602$unblock_scheduler->{desc} = "[unblock_sub scheduler]";
406 603
407sub unblock_sub(&) { 604sub unblock_sub(&) {
408 my $cb = shift; 605 my $cb = shift;
409 606
410 sub { 607 sub {
411 push @unblock_queue, [$cb, @_]; 608 unshift @unblock_queue, [$cb, @_];
412 $unblock_scheduler->ready; 609 $unblock_scheduler->ready;
413 } 610 }
414} 611}
415 612
613=item $cb = Coro::rouse_cb
614
615Create and return a "rouse callback". That's a code reference that,
616when called, will remember a copy of its arguments and notify the owner
617coroutine of the callback.
618
619See the next function.
620
621=item @args = Coro::rouse_wait [$cb]
622
623Wait for the specified rouse callback (or the last one that was created in
624this coroutine).
625
626As soon as the callback is invoked (or when the callback was invoked
627before C<rouse_wait>), it will return the arguments originally passed to
628the rouse callback.
629
630See the section B<HOW TO WAIT FOR A CALLBACK> for an actual usage example.
631
416=back 632=back
417 633
418=cut 634=cut
419 635
4201; 6361;
421 637
638=head1 HOW TO WAIT FOR A CALLBACK
639
640It is very common for a coroutine to wait for some callback to be
641called. This occurs naturally when you use coroutines in an otherwise
642event-based program, or when you use event-based libraries.
643
644These typically register a callback for some event, and call that callback
645when the event occured. In a coroutine, however, you typically want to
646just wait for the event, simplyifying things.
647
648For example C<< AnyEvent->child >> registers a callback to be called when
649a specific child has exited:
650
651 my $child_watcher = AnyEvent->child (pid => $pid, cb => sub { ... });
652
653But from withina coroutine, you often just want to write this:
654
655 my $status = wait_for_child $pid;
656
657Coro offers two functions specifically designed to make this easy,
658C<Coro::rouse_cb> and C<Coro::rouse_wait>.
659
660The first function, C<rouse_cb>, generates and returns a callback that,
661when invoked, will save its arguments and notify the coroutine that
662created the callback.
663
664The second function, C<rouse_wait>, waits for the callback to be called
665(by calling C<schedule> to go to sleep) and returns the arguments
666originally passed to the callback.
667
668Using these functions, it becomes easy to write the C<wait_for_child>
669function mentioned above:
670
671 sub wait_for_child($) {
672 my ($pid) = @_;
673
674 my $watcher = AnyEvent->child (pid => $pid, cb => Coro::rouse_cb);
675
676 my ($rpid, $rstatus) = Coro::rouse_wait;
677 $rstatus
678 }
679
680In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough,
681you can roll your own, using C<schedule>:
682
683 sub wait_for_child($) {
684 my ($pid) = @_;
685
686 # store the current coroutine in $current,
687 # and provide result variables for the closure passed to ->child
688 my $current = $Coro::current;
689 my ($done, $rstatus);
690
691 # pass a closure to ->child
692 my $watcher = AnyEvent->child (pid => $pid, cb => sub {
693 $rstatus = $_[1]; # remember rstatus
694 $done = 1; # mark $rstatus as valud
695 });
696
697 # wait until the closure has been called
698 schedule while !$done;
699
700 $rstatus
701 }
702
703
422=head1 BUGS/LIMITATIONS 704=head1 BUGS/LIMITATIONS
423 705
424 - you must make very sure that no coro is still active on global 706=over 4
425 destruction. very bad things might happen otherwise (usually segfaults).
426 707
708=item fork with pthread backend
709
710When Coro is compiled using the pthread backend (which isn't recommended
711but required on many BSDs as their libcs are completely broken), then
712coroutines will not survive a fork. There is no known workaround except to
713fix your libc and use a saner backend.
714
715=item perl process emulation ("threads")
716
427 - this module is not thread-safe. You should only ever use this module 717This module is not perl-pseudo-thread-safe. You should only ever use this
428 from the same thread (this requirement might be losened in the future 718module from the first thread (this requirement might be removed in the
429 to allow per-thread schedulers, but Coro::State does not yet allow 719future to allow per-thread schedulers, but Coro::State does not yet allow
430 this). 720this). I recommend disabling thread support and using processes, as having
721the windows process emulation enabled under unix roughly halves perl
722performance, even when not used.
723
724=item coroutine switching not signal safe
725
726You must not switch to another coroutine from within a signal handler
727(only relevant with %SIG - most event libraries provide safe signals).
728
729That means you I<MUST NOT> call any function that might "block" the
730current coroutine - C<cede>, C<schedule> C<< Coro::Semaphore->down >> or
731anything that calls those. Everything else, including calling C<ready>,
732works.
733
734=back
735
431 736
432=head1 SEE ALSO 737=head1 SEE ALSO
433 738
739Event-Loop integration: L<Coro::AnyEvent>, L<Coro::EV>, L<Coro::Event>.
740
741Debugging: L<Coro::Debug>.
742
434Support/Utility: L<Coro::Cont>, L<Coro::Specific>, L<Coro::State>, L<Coro::Util>. 743Support/Utility: L<Coro::Specific>, L<Coro::Util>.
435 744
436Locking/IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>, L<Coro::SemaphoreSet>, L<Coro::RWLock>. 745Locking and IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>,
746L<Coro::SemaphoreSet>, L<Coro::RWLock>.
437 747
438Event/IO: L<Coro::Timer>, L<Coro::Event>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::Select>. 748I/O and Timers: L<Coro::Timer>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::AIO>.
439 749
440Embedding: L<Coro:MakeMaker> 750Compatibility with other modules: L<Coro::LWP> (but see also L<AnyEvent::HTTP> for
751a better-working alternative), L<Coro::BDB>, L<Coro::Storable>,
752L<Coro::Select>.
753
754XS API: L<Coro::MakeMaker>.
755
756Low level Configuration, Thread Environment, Continuations: L<Coro::State>.
441 757
442=head1 AUTHOR 758=head1 AUTHOR
443 759
444 Marc Lehmann <schmorp@schmorp.de> 760 Marc Lehmann <schmorp@schmorp.de>
445 http://home.schmorp.de/ 761 http://home.schmorp.de/

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines