ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/cvsroot/Coro/Coro.pm
(Generate patch)

Comparing cvsroot/Coro/Coro.pm (file contents):
Revision 1.92 by root, Fri Dec 1 03:47:55 2006 UTC vs.
Revision 1.245 by root, Sun Dec 14 19:52:58 2008 UTC

1=head1 NAME 1=head1 NAME
2 2
3Coro - coroutine process abstraction 3Coro - the only real threads in perl
4 4
5=head1 SYNOPSIS 5=head1 SYNOPSIS
6 6
7 use Coro; 7 use Coro;
8 8
9 async { 9 async {
10 # some asynchronous thread of execution 10 # some asynchronous thread of execution
11 print "2\n";
12 cede; # yield back to main
13 print "4\n";
11 }; 14 };
12 15 print "1\n";
13 # alternatively create an async coroutine like this: 16 cede; # yield to coroutine
14 17 print "3\n";
15 sub some_func : Coro { 18 cede; # and again
16 # some more async code 19
17 } 20 # use locking
18 21 use Coro::Semaphore;
19 cede; 22 my $lock = new Coro::Semaphore;
23 my $locked;
24
25 $lock->down;
26 $locked = 1;
27 $lock->up;
20 28
21=head1 DESCRIPTION 29=head1 DESCRIPTION
22 30
23This module collection manages coroutines. Coroutines are similar to 31For a tutorial-style introduction, please read the L<Coro::Intro>
24threads but don't run in parallel. 32manpage. This manpage mainly contains reference information.
25 33
34This module collection manages continuations in general, most often
35in the form of cooperative threads (also called coroutines in the
36documentation). They are similar to kernel threads but don't (in general)
37run in parallel at the same time even on SMP machines. The specific flavor
38of thread offered by this module also guarantees you that it will not
39switch between threads unless necessary, at easily-identified points in
40your program, so locking and parallel access are rarely an issue, making
41thread programming much safer and easier than using other thread models.
42
43Unlike the so-called "Perl threads" (which are not actually real threads
44but only the windows process emulation ported to unix), Coro provides a
45full shared address space, which makes communication between threads
46very easy. And threads are fast, too: disabling the Windows process
47emulation code in your perl and using Coro can easily result in a two to
48four times speed increase for your programs.
49
50Coro achieves that by supporting multiple running interpreters that share
51data, which is especially useful to code pseudo-parallel processes and
52for event-based programming, such as multiple HTTP-GET requests running
53concurrently. See L<Coro::AnyEvent> to learn more on how to integrate Coro
54into an event-based environment.
55
26In this module, coroutines are defined as "callchain + lexical variables 56In this module, a thread is defined as "callchain + lexical variables +
27+ @_ + $_ + $@ + $^W + C stack), that is, a coroutine has it's own 57@_ + $_ + $@ + $/ + C stack), that is, a thread has its own callchain,
28callchain, it's own set of lexicals and it's own set of perl's most 58its own set of lexicals and its own set of perls most important global
29important global variables. 59variables (see L<Coro::State> for more configuration and background info).
60
61See also the C<SEE ALSO> section at the end of this document - the Coro
62module family is quite large.
30 63
31=cut 64=cut
32 65
33package Coro; 66package Coro;
34 67
35use strict; 68use strict qw(vars subs);
36no warnings "uninitialized"; 69no warnings "uninitialized";
37 70
38use Coro::State; 71use Coro::State;
39 72
40use base qw(Coro::State Exporter); 73use base qw(Coro::State Exporter);
41 74
42our $idle; # idle handler 75our $idle; # idle handler
43our $main; # main coroutine 76our $main; # main coroutine
44our $current; # current coroutine 77our $current; # current coroutine
45 78
46our $VERSION = '3.0'; 79our $VERSION = 5.13;
47 80
48our @EXPORT = qw(async cede schedule terminate current unblock_sub); 81our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub);
49our %EXPORT_TAGS = ( 82our %EXPORT_TAGS = (
50 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 83 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
51); 84);
52our @EXPORT_OK = @{$EXPORT_TAGS{prio}}; 85our @EXPORT_OK = (@{$EXPORT_TAGS{prio}}, qw(nready));
53 86
54{ 87=head1 GLOBAL VARIABLES
55 my @async;
56 my $init;
57
58 # this way of handling attributes simply is NOT scalable ;()
59 sub import {
60 no strict 'refs';
61
62 Coro->export_to_level(1, @_);
63
64 my $old = *{(caller)[0]."::MODIFY_CODE_ATTRIBUTES"}{CODE};
65 *{(caller)[0]."::MODIFY_CODE_ATTRIBUTES"} = sub {
66 my ($package, $ref) = (shift, shift);
67 my @attrs;
68 for (@_) {
69 if ($_ eq "Coro") {
70 push @async, $ref;
71 unless ($init++) {
72 eval q{
73 sub INIT {
74 &async(pop @async) while @async;
75 }
76 };
77 }
78 } else {
79 push @attrs, $_;
80 }
81 }
82 return $old ? $old->($package, $ref, @attrs) : @attrs;
83 };
84 }
85
86}
87 88
88=over 4 89=over 4
89 90
90=item $main 91=item $Coro::main
91 92
92This coroutine represents the main program. 93This variable stores the coroutine object that represents the main
94program. While you cna C<ready> it and do most other things you can do to
95coroutines, it is mainly useful to compare again C<$Coro::current>, to see
96whether you are running in the main program or not.
93 97
94=cut 98=cut
95 99
96$main = new Coro; 100# $main is now being initialised by Coro::State
97 101
98=item $current (or as function: current) 102=item $Coro::current
99 103
100The current coroutine (the last coroutine switched to). The initial value 104The coroutine object representing the current coroutine (the last
105coroutine that the Coro scheduler switched to). The initial value is
101is C<$main> (of course). 106C<$Coro::main> (of course).
102 107
103This variable is B<strictly> I<read-only>. It is provided for performance 108This variable is B<strictly> I<read-only>. You can take copies of the
104reasons. If performance is not essentiel you are encouraged to use the 109value stored in it and use it as any other coroutine object, but you must
105C<Coro::current> function instead. 110not otherwise modify the variable itself.
106 111
107=cut 112=cut
108 113
109# maybe some other module used Coro::Specific before...
110if ($current) {
111 $main->{specific} = $current->{specific};
112}
113
114$current = $main;
115
116sub current() { $current } 114sub current() { $current } # [DEPRECATED]
117 115
118=item $idle 116=item $Coro::idle
119 117
118This variable is mainly useful to integrate Coro into event loops. It is
119usually better to rely on L<Coro::AnyEvent> or L<Coro::EV>, as this is
120pretty low-level functionality.
121
122This variable stores either a coroutine or a callback.
123
120A callback that is called whenever the scheduler finds no ready coroutines 124If it is a callback, the it is called whenever the scheduler finds no
121to run. The default implementation prints "FATAL: deadlock detected" and 125ready coroutines to run. The default implementation prints "FATAL:
122exits, because the program has no other way to continue. 126deadlock detected" and exits, because the program has no other way to
127continue.
123 128
129If it is a coroutine object, then this object will be readied (without
130invoking any ready hooks, however) when the scheduler finds no other ready
131coroutines to run.
132
124This hook is overwritten by modules such as C<Coro::Timer> and 133This hook is overwritten by modules such as C<Coro::EV> and
125C<Coro::Event> to wait on an external event that hopefully wake up a 134C<Coro::AnyEvent> to wait on an external event that hopefully wake up a
126coroutine so the scheduler can run it. 135coroutine so the scheduler can run it.
127 136
137Note that the callback I<must not>, under any circumstances, block
138the current coroutine. Normally, this is achieved by having an "idle
139coroutine" that calls the event loop and then blocks again, and then
140readying that coroutine in the idle handler, or by simply placing the idle
141coroutine in this variable.
142
143See L<Coro::Event> or L<Coro::AnyEvent> for examples of using this
144technique.
145
128Please note that if your callback recursively invokes perl (e.g. for event 146Please note that if your callback recursively invokes perl (e.g. for event
129handlers), then it must be prepared to be called recursively. 147handlers), then it must be prepared to be called recursively itself.
130 148
131=cut 149=cut
132 150
133$idle = sub { 151$idle = sub {
134 print STDERR "FATAL: deadlock detected\n"; 152 require Carp;
135 exit (51); 153 Carp::croak ("FATAL: deadlock detected");
136}; 154};
137 155
138# this coroutine is necessary because a coroutine 156# this coroutine is necessary because a coroutine
139# cannot destroy itself. 157# cannot destroy itself.
140my @destroy; 158our @destroy;
159our $manager;
160
141my $manager; $manager = new Coro sub { 161$manager = new Coro sub {
142 while () { 162 while () {
143 # by overwriting the state object with the manager we destroy it 163 Coro::_cancel shift @destroy
144 # while still being able to schedule this coroutine (in case it has
145 # been readied multiple times. this is harmless since the manager
146 # can be called as many times as neccessary and will always
147 # remove itself from the runqueue
148 while (@destroy) { 164 while @destroy;
149 my $coro = pop @destroy;
150 $coro->{status} ||= [];
151 $_->ready for @{delete $coro->{join} || []};
152 165
153 # the next line destroys the coro state, but keeps the
154 # coroutine itself intact (we basically make it a zombie
155 # coroutine that always runs the manager thread, so it's possible
156 # to transfer() to this coroutine).
157 $coro->_clone_state_from ($manager);
158 }
159 &schedule; 166 &schedule;
160 } 167 }
161}; 168};
162 169$manager->{desc} = "[coro manager]";
163# static methods. not really. 170$manager->prio (PRIO_MAX);
164 171
165=back 172=back
166 173
167=head2 STATIC METHODS 174=head1 SIMPLE COROUTINE CREATION
168
169Static methods are actually functions that operate on the current coroutine only.
170 175
171=over 4 176=over 4
172 177
173=item async { ... } [@args...] 178=item async { ... } [@args...]
174 179
175Create a new asynchronous coroutine and return it's coroutine object 180Create a new coroutine and return its coroutine object (usually
176(usually unused). When the sub returns the new coroutine is automatically 181unused). The coroutine will be put into the ready queue, so
182it will start running automatically on the next scheduler run.
183
184The first argument is a codeblock/closure that should be executed in the
185coroutine. When it returns argument returns the coroutine is automatically
177terminated. 186terminated.
178 187
179Calling C<exit> in a coroutine will not work correctly, so do not do that. 188The remaining arguments are passed as arguments to the closure.
180 189
181When the coroutine dies, the program will exit, just as in the main 190See the C<Coro::State::new> constructor for info about the coroutine
182program. 191environment in which coroutines are executed.
183 192
193Calling C<exit> in a coroutine will do the same as calling exit outside
194the coroutine. Likewise, when the coroutine dies, the program will exit,
195just as it would in the main program.
196
197If you do not want that, you can provide a default C<die> handler, or
198simply avoid dieing (by use of C<eval>).
199
184 # create a new coroutine that just prints its arguments 200Example: Create a new coroutine that just prints its arguments.
201
185 async { 202 async {
186 print "@_\n"; 203 print "@_\n";
187 } 1,2,3,4; 204 } 1,2,3,4;
188 205
189=cut 206=cut
190 207
191sub async(&@) { 208sub async(&@) {
192 my $pid = new Coro @_; 209 my $coro = new Coro @_;
193 $pid->ready; 210 $coro->ready;
194 $pid 211 $coro
195} 212}
213
214=item async_pool { ... } [@args...]
215
216Similar to C<async>, but uses a coroutine pool, so you should not call
217terminate or join on it (although you are allowed to), and you get a
218coroutine that might have executed other code already (which can be good
219or bad :).
220
221On the plus side, this function is about twice as fast as creating (and
222destroying) a completely new coroutine, so if you need a lot of generic
223coroutines in quick successsion, use C<async_pool>, not C<async>.
224
225The code block is executed in an C<eval> context and a warning will be
226issued in case of an exception instead of terminating the program, as
227C<async> does. As the coroutine is being reused, stuff like C<on_destroy>
228will not work in the expected way, unless you call terminate or cancel,
229which somehow defeats the purpose of pooling (but is fine in the
230exceptional case).
231
232The priority will be reset to C<0> after each run, tracing will be
233disabled, the description will be reset and the default output filehandle
234gets restored, so you can change all these. Otherwise the coroutine will
235be re-used "as-is": most notably if you change other per-coroutine global
236stuff such as C<$/> you I<must needs> revert that change, which is most
237simply done by using local as in: C<< local $/ >>.
238
239The idle pool size is limited to C<8> idle coroutines (this can be
240adjusted by changing $Coro::POOL_SIZE), but there can be as many non-idle
241coros as required.
242
243If you are concerned about pooled coroutines growing a lot because a
244single C<async_pool> used a lot of stackspace you can e.g. C<async_pool
245{ terminate }> once per second or so to slowly replenish the pool. In
246addition to that, when the stacks used by a handler grows larger than 32kb
247(adjustable via $Coro::POOL_RSS) it will also be destroyed.
248
249=cut
250
251our $POOL_SIZE = 8;
252our $POOL_RSS = 32 * 1024;
253our @async_pool;
254
255sub pool_handler {
256 while () {
257 eval {
258 &{&_pool_handler} while 1;
259 };
260
261 warn $@ if $@;
262 }
263}
264
265=back
266
267=head1 STATIC METHODS
268
269Static methods are actually functions that implicitly operate on the
270current coroutine.
271
272=over 4
196 273
197=item schedule 274=item schedule
198 275
199Calls the scheduler. Please note that the current coroutine will not be put 276Calls the scheduler. The scheduler will find the next coroutine that is
277to be run from the ready queue and switches to it. The next coroutine
278to be run is simply the one with the highest priority that is longest
279in its ready queue. If there is no coroutine ready, it will clal the
280C<$Coro::idle> hook.
281
282Please note that the current coroutine will I<not> be put into the ready
200into the ready queue, so calling this function usually means you will 283queue, so calling this function usually means you will never be called
201never be called again unless something else (e.g. an event handler) calls 284again unless something else (e.g. an event handler) calls C<< ->ready >>,
202ready. 285thus waking you up.
203 286
204The canonical way to wait on external events is this: 287This makes C<schedule> I<the> generic method to use to block the current
288coroutine and wait for events: first you remember the current coroutine in
289a variable, then arrange for some callback of yours to call C<< ->ready
290>> on that once some event happens, and last you call C<schedule> to put
291yourself to sleep. Note that a lot of things can wake your coroutine up,
292so you need to check whether the event indeed happened, e.g. by storing the
293status in a variable.
205 294
295See B<HOW TO WAIT FOR A CALLBACK>, below, for some ways to wait for callbacks.
296
297=item cede
298
299"Cede" to other coroutines. This function puts the current coroutine into
300the ready queue and calls C<schedule>, which has the effect of giving
301up the current "timeslice" to other coroutines of the same or higher
302priority. Once your coroutine gets its turn again it will automatically be
303resumed.
304
305This function is often called C<yield> in other languages.
306
307=item Coro::cede_notself
308
309Works like cede, but is not exported by default and will cede to I<any>
310coroutine, regardless of priority. This is useful sometimes to ensure
311progress is made.
312
313=item terminate [arg...]
314
315Terminates the current coroutine with the given status values (see L<cancel>).
316
317=item killall
318
319Kills/terminates/cancels all coroutines except the currently running
320one. This can be useful after a fork, either in the child or the parent,
321as usually only one of them should inherit the running coroutines.
322
323Note that in the implementation, destructors run as normal, making this
324function not so useful after a fork. Future versions of this function
325might try to free resources without running any code.
326
327Note that while this will try to free some of the main programs resources,
328you cannot free all of them, so if a coroutine that is not the main
329program calls this function, there will be some one-time resource leak.
330
331=cut
332
333sub killall {
334 for (Coro::State::list) {
335 $_->cancel
336 if $_ != $current && UNIVERSAL::isa $_, "Coro";
206 { 337 }
207 # remember current coroutine 338}
339
340=back
341
342=head1 COROUTINE OBJECT METHODS
343
344These are the methods you can call on coroutine objects (or to create
345them).
346
347=over 4
348
349=item new Coro \&sub [, @args...]
350
351Create a new coroutine and return it. When the sub returns, the coroutine
352automatically terminates as if C<terminate> with the returned values were
353called. To make the coroutine run you must first put it into the ready
354queue by calling the ready method.
355
356See C<async> and C<Coro::State::new> for additional info about the
357coroutine environment.
358
359=cut
360
361sub _coro_run {
362 terminate &{+shift};
363}
364
365=item $success = $coroutine->ready
366
367Put the given coroutine into the end of its ready queue (there is one
368queue for each priority) and return true. If the coroutine is already in
369the ready queue, do nothing and return false.
370
371This ensures that the scheduler will resume this coroutine automatically
372once all the coroutines of higher priority and all coroutines of the same
373priority that were put into the ready queue earlier have been resumed.
374
375=item $is_ready = $coroutine->is_ready
376
377Return whether the coroutine is currently the ready queue or not,
378
379=item $coroutine->cancel (arg...)
380
381Terminates the given coroutine and makes it return the given arguments as
382status (default: the empty list). Never returns if the coroutine is the
383current coroutine.
384
385=cut
386
387sub cancel {
388 my $self = shift;
389
390 if ($current == $self) {
391 terminate @_;
392 } else {
393 $self->{_status} = [@_];
394 $self->_cancel;
395 }
396}
397
398=item $coroutine->schedule_to
399
400Puts the current coroutine to sleep (like C<Coro::schedule>), but instead
401of continuing with the next coro from the ready queue, always switch to
402the given coroutine object (regardless of priority etc.). The readyness
403state of that coroutine isn't changed.
404
405This is an advanced method for special cases - I'd love to hear about any
406uses for this one.
407
408=item $coroutine->cede_to
409
410Like C<schedule_to>, but puts the current coroutine into the ready
411queue. This has the effect of temporarily switching to the given
412coroutine, and continuing some time later.
413
414This is an advanced method for special cases - I'd love to hear about any
415uses for this one.
416
417=item $coroutine->throw ([$scalar])
418
419If C<$throw> is specified and defined, it will be thrown as an exception
420inside the coroutine at the next convenient point in time. Otherwise
421clears the exception object.
422
423Coro will check for the exception each time a schedule-like-function
424returns, i.e. after each C<schedule>, C<cede>, C<< Coro::Semaphore->down
425>>, C<< Coro::Handle->readable >> and so on. Most of these functions
426detect this case and return early in case an exception is pending.
427
428The exception object will be thrown "as is" with the specified scalar in
429C<$@>, i.e. if it is a string, no line number or newline will be appended
430(unlike with C<die>).
431
432This can be used as a softer means than C<cancel> to ask a coroutine to
433end itself, although there is no guarantee that the exception will lead to
434termination, and if the exception isn't caught it might well end the whole
435program.
436
437You might also think of C<throw> as being the moral equivalent of
438C<kill>ing a coroutine with a signal (in this case, a scalar).
439
440=item $coroutine->join
441
442Wait until the coroutine terminates and return any values given to the
443C<terminate> or C<cancel> functions. C<join> can be called concurrently
444from multiple coroutines, and all will be resumed and given the status
445return once the C<$coroutine> terminates.
446
447=cut
448
449sub join {
450 my $self = shift;
451
452 unless ($self->{_status}) {
208 my $current = $Coro::current; 453 my $current = $current;
209 454
210 # register a hypothetical event handler 455 push @{$self->{_on_destroy}}, sub {
211 on_event_invoke sub {
212 # wake up sleeping coroutine
213 $current->ready; 456 $current->ready;
214 undef $current; 457 undef $current;
215 }; 458 };
216 459
217 # call schedule until event occured.
218 # in case we are woken up for other reasons
219 # (current still defined), loop.
220 Coro::schedule while $current; 460 &schedule while $current;
221 } 461 }
222 462
223=item cede
224
225"Cede" to other coroutines. This function puts the current coroutine into the
226ready queue and calls C<schedule>, which has the effect of giving up the
227current "timeslice" to other coroutines of the same or higher priority.
228
229=item terminate [arg...]
230
231Terminates the current coroutine with the given status values (see L<cancel>).
232
233=cut
234
235sub terminate {
236 $current->cancel (@_);
237}
238
239=back
240
241# dynamic methods
242
243=head2 COROUTINE METHODS
244
245These are the methods you can call on coroutine objects.
246
247=over 4
248
249=item new Coro \&sub [, @args...]
250
251Create a new coroutine and return it. When the sub returns the coroutine
252automatically terminates as if C<terminate> with the returned values were
253called. To make the coroutine run you must first put it into the ready queue
254by calling the ready method.
255
256Calling C<exit> in a coroutine will not work correctly, so do not do that.
257
258=cut
259
260sub _new_coro {
261 terminate &{+shift};
262}
263
264sub new {
265 my $class = shift;
266
267 $class->SUPER::new (\&_new_coro, @_)
268}
269
270=item $success = $coroutine->ready
271
272Put the given coroutine into the ready queue (according to it's priority)
273and return true. If the coroutine is already in the ready queue, do nothing
274and return false.
275
276=item $is_ready = $coroutine->is_ready
277
278Return wether the coroutine is currently the ready queue or not,
279
280=item $coroutine->cancel (arg...)
281
282Terminates the given coroutine and makes it return the given arguments as
283status (default: the empty list).
284
285=cut
286
287sub cancel {
288 my $self = shift;
289 $self->{status} = [@_];
290 push @destroy, $self;
291 $manager->ready;
292 &schedule if $current == $self;
293}
294
295=item $coroutine->join
296
297Wait until the coroutine terminates and return any values given to the
298C<terminate> or C<cancel> functions. C<join> can be called multiple times
299from multiple coroutine.
300
301=cut
302
303sub join {
304 my $self = shift;
305 unless ($self->{status}) {
306 push @{$self->{join}}, $current;
307 &schedule;
308 }
309 wantarray ? @{$self->{status}} : $self->{status}[0]; 463 wantarray ? @{$self->{_status}} : $self->{_status}[0];
464}
465
466=item $coroutine->on_destroy (\&cb)
467
468Registers a callback that is called when this coroutine gets destroyed,
469but before it is joined. The callback gets passed the terminate arguments,
470if any, and I<must not> die, under any circumstances.
471
472=cut
473
474sub on_destroy {
475 my ($self, $cb) = @_;
476
477 push @{ $self->{_on_destroy} }, $cb;
310} 478}
311 479
312=item $oldprio = $coroutine->prio ($newprio) 480=item $oldprio = $coroutine->prio ($newprio)
313 481
314Sets (or gets, if the argument is missing) the priority of the 482Sets (or gets, if the argument is missing) the priority of the
337higher values mean lower priority, just as in unix). 505higher values mean lower priority, just as in unix).
338 506
339=item $olddesc = $coroutine->desc ($newdesc) 507=item $olddesc = $coroutine->desc ($newdesc)
340 508
341Sets (or gets in case the argument is missing) the description for this 509Sets (or gets in case the argument is missing) the description for this
342coroutine. This is just a free-form string you can associate with a coroutine. 510coroutine. This is just a free-form string you can associate with a
511coroutine.
512
513This method simply sets the C<< $coroutine->{desc} >> member to the given
514string. You can modify this member directly if you wish.
343 515
344=cut 516=cut
345 517
346sub desc { 518sub desc {
347 my $old = $_[0]{desc}; 519 my $old = $_[0]{desc};
348 $_[0]{desc} = $_[1] if @_ > 1; 520 $_[0]{desc} = $_[1] if @_ > 1;
349 $old; 521 $old;
350} 522}
351 523
524sub transfer {
525 require Carp;
526 Carp::croak ("You must not call ->transfer on Coro objects. Use Coro::State objects or the ->schedule_to method. Caught");
527}
528
352=back 529=back
353 530
354=head2 UTILITY FUNCTIONS 531=head1 GLOBAL FUNCTIONS
355 532
356=over 4 533=over 4
357 534
535=item Coro::nready
536
537Returns the number of coroutines that are currently in the ready state,
538i.e. that can be switched to by calling C<schedule> directory or
539indirectly. The value C<0> means that the only runnable coroutine is the
540currently running one, so C<cede> would have no effect, and C<schedule>
541would cause a deadlock unless there is an idle handler that wakes up some
542coroutines.
543
544=item my $guard = Coro::guard { ... }
545
546This function still exists, but is deprecated. Please use the
547C<Guard::guard> function instead.
548
549=cut
550
551BEGIN { *guard = \&Guard::guard }
552
358=item unblock_sub { ... } 553=item unblock_sub { ... }
359 554
360This utility function takes a BLOCK or code reference and "unblocks" it, 555This utility function takes a BLOCK or code reference and "unblocks" it,
361returning the new coderef. This means that the new coderef will return 556returning a new coderef. Unblocking means that calling the new coderef
362immediately without blocking, returning nothing, while the original code 557will return immediately without blocking, returning nothing, while the
363ref will be called (with parameters) from within its own coroutine. 558original code ref will be called (with parameters) from within another
559coroutine.
364 560
365The reason this fucntion exists is that many event libraries (such as the 561The reason this function exists is that many event libraries (such as the
366venerable L<Event|Event> module) are not coroutine-safe (a weaker form 562venerable L<Event|Event> module) are not coroutine-safe (a weaker form
367of thread-safety). This means you must not block within event callbacks, 563of reentrancy). This means you must not block within event callbacks,
368otherwise you might suffer from crashes or worse. 564otherwise you might suffer from crashes or worse. The only event library
565currently known that is safe to use without C<unblock_sub> is L<EV>.
369 566
370This function allows your callbacks to block by executing them in another 567This function allows your callbacks to block by executing them in another
371coroutine where it is safe to block. One example where blocking is handy 568coroutine where it is safe to block. One example where blocking is handy
372is when you use the L<Coro::AIO|Coro::AIO> functions to save results to 569is when you use the L<Coro::AIO|Coro::AIO> functions to save results to
373disk. 570disk, for example.
374 571
375In short: simply use C<unblock_sub { ... }> instead of C<sub { ... }> when 572In short: simply use C<unblock_sub { ... }> instead of C<sub { ... }> when
376creating event callbacks that want to block. 573creating event callbacks that want to block.
377 574
378=cut 575If your handler does not plan to block (e.g. simply sends a message to
576another coroutine, or puts some other coroutine into the ready queue),
577there is no reason to use C<unblock_sub>.
379 578
380our @unblock_pool; 579Note that you also need to use C<unblock_sub> for any other callbacks that
580are indirectly executed by any C-based event loop. For example, when you
581use a module that uses L<AnyEvent> (and you use L<Coro::AnyEvent>) and it
582provides callbacks that are the result of some event callback, then you
583must not block either, or use C<unblock_sub>.
584
585=cut
586
381our @unblock_queue; 587our @unblock_queue;
382our $UNBLOCK_POOL_SIZE = 2;
383 588
384sub unblock_handler_ { 589# we create a special coro because we want to cede,
385 while () { 590# to reduce pressure on the coro pool (because most callbacks
386 my ($cb, @arg) = @{ delete $Coro::current->{arg} }; 591# return immediately and can be reused) and because we cannot cede
387 $cb->(@arg); 592# inside an event callback.
388
389 last if @unblock_pool >= $UNBLOCK_POOL_SIZE;
390 push @unblock_pool, $Coro::current;
391 schedule;
392 }
393}
394
395our $unblock_scheduler = async { 593our $unblock_scheduler = new Coro sub {
396 while () { 594 while () {
397 while (my $cb = pop @unblock_queue) { 595 while (my $cb = pop @unblock_queue) {
398 my $handler = (pop @unblock_pool or new Coro \&unblock_handler_); 596 &async_pool (@$cb);
399 $handler->{arg} = $cb; 597
400 $handler->ready; 598 # for short-lived callbacks, this reduces pressure on the coro pool
599 # as the chance is very high that the async_poll coro will be back
600 # in the idle state when cede returns
401 cede; 601 cede;
402 } 602 }
403 603 schedule; # sleep well
404 schedule;
405 } 604 }
406}; 605};
606$unblock_scheduler->{desc} = "[unblock_sub scheduler]";
407 607
408sub unblock_sub(&) { 608sub unblock_sub(&) {
409 my $cb = shift; 609 my $cb = shift;
410 610
411 sub { 611 sub {
412 push @unblock_queue, [$cb, @_]; 612 unshift @unblock_queue, [$cb, @_];
413 $unblock_scheduler->ready; 613 $unblock_scheduler->ready;
414 } 614 }
415} 615}
416 616
617=item $cb = Coro::rouse_cb
618
619Create and return a "rouse callback". That's a code reference that,
620when called, will remember a copy of its arguments and notify the owner
621coroutine of the callback.
622
623See the next function.
624
625=item @args = Coro::rouse_wait [$cb]
626
627Wait for the specified rouse callback (or the last one that was created in
628this coroutine).
629
630As soon as the callback is invoked (or when the callback was invoked
631before C<rouse_wait>), it will return the arguments originally passed to
632the rouse callback.
633
634See the section B<HOW TO WAIT FOR A CALLBACK> for an actual usage example.
635
417=back 636=back
418 637
419=cut 638=cut
420 639
4211; 6401;
422 641
642=head1 HOW TO WAIT FOR A CALLBACK
643
644It is very common for a coroutine to wait for some callback to be
645called. This occurs naturally when you use coroutines in an otherwise
646event-based program, or when you use event-based libraries.
647
648These typically register a callback for some event, and call that callback
649when the event occured. In a coroutine, however, you typically want to
650just wait for the event, simplyifying things.
651
652For example C<< AnyEvent->child >> registers a callback to be called when
653a specific child has exited:
654
655 my $child_watcher = AnyEvent->child (pid => $pid, cb => sub { ... });
656
657But from withina coroutine, you often just want to write this:
658
659 my $status = wait_for_child $pid;
660
661Coro offers two functions specifically designed to make this easy,
662C<Coro::rouse_cb> and C<Coro::rouse_wait>.
663
664The first function, C<rouse_cb>, generates and returns a callback that,
665when invoked, will save its arguments and notify the coroutine that
666created the callback.
667
668The second function, C<rouse_wait>, waits for the callback to be called
669(by calling C<schedule> to go to sleep) and returns the arguments
670originally passed to the callback.
671
672Using these functions, it becomes easy to write the C<wait_for_child>
673function mentioned above:
674
675 sub wait_for_child($) {
676 my ($pid) = @_;
677
678 my $watcher = AnyEvent->child (pid => $pid, cb => Coro::rouse_cb);
679
680 my ($rpid, $rstatus) = Coro::rouse_wait;
681 $rstatus
682 }
683
684In the case where C<rouse_cb> and C<rouse_wait> are not flexible enough,
685you can roll your own, using C<schedule>:
686
687 sub wait_for_child($) {
688 my ($pid) = @_;
689
690 # store the current coroutine in $current,
691 # and provide result variables for the closure passed to ->child
692 my $current = $Coro::current;
693 my ($done, $rstatus);
694
695 # pass a closure to ->child
696 my $watcher = AnyEvent->child (pid => $pid, cb => sub {
697 $rstatus = $_[1]; # remember rstatus
698 $done = 1; # mark $rstatus as valud
699 });
700
701 # wait until the closure has been called
702 schedule while !$done;
703
704 $rstatus
705 }
706
707
423=head1 BUGS/LIMITATIONS 708=head1 BUGS/LIMITATIONS
424 709
425 - you must make very sure that no coro is still active on global 710=over 4
426 destruction. very bad things might happen otherwise (usually segfaults).
427 711
712=item fork with pthread backend
713
714When Coro is compiled using the pthread backend (which isn't recommended
715but required on many BSDs as their libcs are completely broken), then
716coroutines will not survive a fork. There is no known workaround except to
717fix your libc and use a saner backend.
718
719=item perl process emulation ("threads")
720
428 - this module is not thread-safe. You should only ever use this module 721This module is not perl-pseudo-thread-safe. You should only ever use this
429 from the same thread (this requirement might be losened in the future 722module from the first thread (this requirement might be removed in the
430 to allow per-thread schedulers, but Coro::State does not yet allow 723future to allow per-thread schedulers, but Coro::State does not yet allow
431 this). 724this). I recommend disabling thread support and using processes, as having
725the windows process emulation enabled under unix roughly halves perl
726performance, even when not used.
727
728=item coroutine switching not signal safe
729
730You must not switch to another coroutine from within a signal handler
731(only relevant with %SIG - most event libraries provide safe signals).
732
733That means you I<MUST NOT> call any function that might "block" the
734current coroutine - C<cede>, C<schedule> C<< Coro::Semaphore->down >> or
735anything that calls those. Everything else, including calling C<ready>,
736works.
737
738=back
739
432 740
433=head1 SEE ALSO 741=head1 SEE ALSO
434 742
743Event-Loop integration: L<Coro::AnyEvent>, L<Coro::EV>, L<Coro::Event>.
744
745Debugging: L<Coro::Debug>.
746
435Support/Utility: L<Coro::Cont>, L<Coro::Specific>, L<Coro::State>, L<Coro::Util>. 747Support/Utility: L<Coro::Specific>, L<Coro::Util>.
436 748
437Locking/IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>, L<Coro::SemaphoreSet>, L<Coro::RWLock>. 749Locking and IPC: L<Coro::Signal>, L<Coro::Channel>, L<Coro::Semaphore>,
750L<Coro::SemaphoreSet>, L<Coro::RWLock>.
438 751
439Event/IO: L<Coro::Timer>, L<Coro::Event>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::Select>. 752I/O and Timers: L<Coro::Timer>, L<Coro::Handle>, L<Coro::Socket>, L<Coro::AIO>.
440 753
441Embedding: L<Coro:MakeMaker> 754Compatibility with other modules: L<Coro::LWP> (but see also L<AnyEvent::HTTP> for
755a better-working alternative), L<Coro::BDB>, L<Coro::Storable>,
756L<Coro::Select>.
757
758XS API: L<Coro::MakeMaker>.
759
760Low level Configuration, Thread Environment, Continuations: L<Coro::State>.
442 761
443=head1 AUTHOR 762=head1 AUTHOR
444 763
445 Marc Lehmann <schmorp@schmorp.de> 764 Marc Lehmann <schmorp@schmorp.de>
446 http://home.schmorp.de/ 765 http://home.schmorp.de/

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines