ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/Coro/Coro.pm
(Generate patch)

Comparing Coro/Coro.pm (file contents):
Revision 1.129 by root, Wed Sep 19 22:33:08 2007 UTC vs.
Revision 1.146 by root, Wed Oct 3 17:37:33 2007 UTC

50 50
51our $idle; # idle handler 51our $idle; # idle handler
52our $main; # main coroutine 52our $main; # main coroutine
53our $current; # current coroutine 53our $current; # current coroutine
54 54
55our $VERSION = '3.7'; 55our $VERSION = '4.0';
56 56
57our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub); 57our @EXPORT = qw(async async_pool cede schedule terminate current unblock_sub);
58our %EXPORT_TAGS = ( 58our %EXPORT_TAGS = (
59 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)], 59 prio => [qw(PRIO_MAX PRIO_HIGH PRIO_NORMAL PRIO_LOW PRIO_IDLE PRIO_MIN)],
60); 60);
113reasons. If performance is not essential you are encouraged to use the 113reasons. If performance is not essential you are encouraged to use the
114C<Coro::current> function instead. 114C<Coro::current> function instead.
115 115
116=cut 116=cut
117 117
118$main->{desc} = "[main::]";
119
118# maybe some other module used Coro::Specific before... 120# maybe some other module used Coro::Specific before...
119$main->{specific} = $current->{specific} 121$main->{_specific} = $current->{_specific}
120 if $current; 122 if $current;
121 123
122_set_current $main; 124_set_current $main;
123 125
124sub current() { $current } 126sub current() { $current }
149 # free coroutine data and mark as destructed 151 # free coroutine data and mark as destructed
150 $self->_destroy 152 $self->_destroy
151 or return; 153 or return;
152 154
153 # call all destruction callbacks 155 # call all destruction callbacks
154 $_->(@{$self->{status}}) 156 $_->(@{$self->{_status}})
155 for @{(delete $self->{destroy_cb}) || []}; 157 for @{(delete $self->{_on_destroy}) || []};
156} 158}
157 159
158# this coroutine is necessary because a coroutine 160# this coroutine is necessary because a coroutine
159# cannot destroy itself. 161# cannot destroy itself.
160my @destroy; 162my @destroy;
161my $manager; 163my $manager;
162 164
163$manager = new Coro sub { 165$manager = new Coro sub {
164 $current->desc ("[coro manager]");
165
166 while () { 166 while () {
167 (shift @destroy)->_cancel 167 (shift @destroy)->_cancel
168 while @destroy; 168 while @destroy;
169 169
170 &schedule; 170 &schedule;
171 } 171 }
172}; 172};
173 173$manager->desc ("[coro manager]");
174$manager->prio (PRIO_MAX); 174$manager->prio (PRIO_MAX);
175 175
176# static methods. not really. 176# static methods. not really.
177 177
178=back 178=back
186=item async { ... } [@args...] 186=item async { ... } [@args...]
187 187
188Create a new asynchronous coroutine and return it's coroutine object 188Create a new asynchronous coroutine and return it's coroutine object
189(usually unused). When the sub returns the new coroutine is automatically 189(usually unused). When the sub returns the new coroutine is automatically
190terminated. 190terminated.
191
192See the C<Coro::State::new> constructor for info about the coroutine
193environment.
191 194
192Calling C<exit> in a coroutine will do the same as calling exit outside 195Calling C<exit> in a coroutine will do the same as calling exit outside
193the coroutine. Likewise, when the coroutine dies, the program will exit, 196the coroutine. Likewise, when the coroutine dies, the program will exit,
194just as it would in the main program. 197just as it would in the main program.
195 198
216issued in case of an exception instead of terminating the program, as 219issued in case of an exception instead of terminating the program, as
217C<async> does. As the coroutine is being reused, stuff like C<on_destroy> 220C<async> does. As the coroutine is being reused, stuff like C<on_destroy>
218will not work in the expected way, unless you call terminate or cancel, 221will not work in the expected way, unless you call terminate or cancel,
219which somehow defeats the purpose of pooling. 222which somehow defeats the purpose of pooling.
220 223
221The priority will be reset to C<0> after each job, otherwise the coroutine 224The priority will be reset to C<0> after each job, tracing will be
222will be re-used "as-is". 225disabled, the description will be reset and the default output filehandle
226gets restored, so you can change alkl these. Otherwise the coroutine will
227be re-used "as-is": most notably if you change other per-coroutine global
228stuff such as C<$/> you need to revert that change, which is most simply
229done by using local as in C< local $/ >.
223 230
224The pool size is limited to 8 idle coroutines (this can be adjusted by 231The pool size is limited to 8 idle coroutines (this can be adjusted by
225changing $Coro::POOL_SIZE), and there can be as many non-idle coros as 232changing $Coro::POOL_SIZE), and there can be as many non-idle coros as
226required. 233required.
227 234
228If you are concerned about pooled coroutines growing a lot because a 235If you are concerned about pooled coroutines growing a lot because a
229single C<async_pool> used a lot of stackspace you can e.g. C<async_pool { 236single C<async_pool> used a lot of stackspace you can e.g. C<async_pool
230terminate }> once per second or so to slowly replenish the pool. 237{ terminate }> once per second or so to slowly replenish the pool. In
238addition to that, when the stacks used by a handler grows larger than 16kb
239(adjustable with $Coro::POOL_RSS) it will also exit.
231 240
232=cut 241=cut
233 242
234our $POOL_SIZE = 8; 243our $POOL_SIZE = 8;
244our $POOL_RSS = 16 * 1024;
235our @pool; 245our @async_pool;
236 246
237sub pool_handler { 247sub pool_handler {
248 my $cb;
249
238 while () { 250 while () {
239 $current->{desc} = "[async_pool]";
240
241 eval { 251 eval {
242 my ($cb, @arg) = @{ delete $current->{_invoke} or return }; 252 while () {
243 $cb->(@arg); 253 _pool_1 $cb;
254 &$cb;
255 _pool_2 $cb;
256 &schedule;
257 }
244 }; 258 };
259
260 last if $@ eq "\3terminate\2\n";
245 warn $@ if $@; 261 warn $@ if $@;
246
247 last if @pool >= $POOL_SIZE;
248
249 push @pool, $current;
250 $current->{desc} = "[async_pool idle]";
251 $current->save (Coro::State::SAVE_DEF);
252 $current->prio (0);
253 schedule;
254 } 262 }
255} 263}
256 264
257sub async_pool(&@) { 265sub async_pool(&@) {
258 # this is also inlined into the unlock_scheduler 266 # this is also inlined into the unlock_scheduler
259 my $coro = (pop @pool) || new Coro \&pool_handler;; 267 my $coro = (pop @async_pool) || new Coro \&pool_handler;
260 268
261 $coro->{_invoke} = [@_]; 269 $coro->{_invoke} = [@_];
262 $coro->ready; 270 $coro->ready;
263 271
264 $coro 272 $coro
307 315
308=item terminate [arg...] 316=item terminate [arg...]
309 317
310Terminates the current coroutine with the given status values (see L<cancel>). 318Terminates the current coroutine with the given status values (see L<cancel>).
311 319
320=item killall
321
322Kills/terminates/cancels all coroutines except the currently running
323one. This is useful after a fork, either in the child or the parent, as
324usually only one of them should inherit the running coroutines.
325
312=cut 326=cut
313 327
314sub terminate { 328sub terminate {
315 $current->cancel (@_); 329 $current->cancel (@_);
330}
331
332sub killall {
333 for (Coro::State::list) {
334 $_->cancel
335 if $_ != $current && UNIVERSAL::isa $_, "Coro";
336 }
316} 337}
317 338
318=back 339=back
319 340
320# dynamic methods 341# dynamic methods
330Create a new coroutine and return it. When the sub returns the coroutine 351Create a new coroutine and return it. When the sub returns the coroutine
331automatically terminates as if C<terminate> with the returned values were 352automatically terminates as if C<terminate> with the returned values were
332called. To make the coroutine run you must first put it into the ready queue 353called. To make the coroutine run you must first put it into the ready queue
333by calling the ready method. 354by calling the ready method.
334 355
335See C<async> for additional discussion. 356See C<async> and C<Coro::State::new> for additional info about the
357coroutine environment.
336 358
337=cut 359=cut
338 360
339sub _run_coro { 361sub _run_coro {
340 terminate &{+shift}; 362 terminate &{+shift};
364 386
365=cut 387=cut
366 388
367sub cancel { 389sub cancel {
368 my $self = shift; 390 my $self = shift;
369 $self->{status} = [@_]; 391 $self->{_status} = [@_];
370 392
371 if ($current == $self) { 393 if ($current == $self) {
372 push @destroy, $self; 394 push @destroy, $self;
373 $manager->ready; 395 $manager->ready;
374 &schedule while 1; 396 &schedule while 1;
378} 400}
379 401
380=item $coroutine->join 402=item $coroutine->join
381 403
382Wait until the coroutine terminates and return any values given to the 404Wait until the coroutine terminates and return any values given to the
383C<terminate> or C<cancel> functions. C<join> can be called multiple times 405C<terminate> or C<cancel> functions. C<join> can be called concurrently
384from multiple coroutine. 406from multiple coroutines.
385 407
386=cut 408=cut
387 409
388sub join { 410sub join {
389 my $self = shift; 411 my $self = shift;
390 412
391 unless ($self->{status}) { 413 unless ($self->{_status}) {
392 my $current = $current; 414 my $current = $current;
393 415
394 push @{$self->{destroy_cb}}, sub { 416 push @{$self->{_on_destroy}}, sub {
395 $current->ready; 417 $current->ready;
396 undef $current; 418 undef $current;
397 }; 419 };
398 420
399 &schedule while $current; 421 &schedule while $current;
400 } 422 }
401 423
402 wantarray ? @{$self->{status}} : $self->{status}[0]; 424 wantarray ? @{$self->{_status}} : $self->{_status}[0];
403} 425}
404 426
405=item $coroutine->on_destroy (\&cb) 427=item $coroutine->on_destroy (\&cb)
406 428
407Registers a callback that is called when this coroutine gets destroyed, 429Registers a callback that is called when this coroutine gets destroyed,
411=cut 433=cut
412 434
413sub on_destroy { 435sub on_destroy {
414 my ($self, $cb) = @_; 436 my ($self, $cb) = @_;
415 437
416 push @{ $self->{destroy_cb} }, $cb; 438 push @{ $self->{_on_destroy} }, $cb;
417} 439}
418 440
419=item $oldprio = $coroutine->prio ($newprio) 441=item $oldprio = $coroutine->prio ($newprio)
420 442
421Sets (or gets, if the argument is missing) the priority of the 443Sets (or gets, if the argument is missing) the priority of the
445 467
446=item $olddesc = $coroutine->desc ($newdesc) 468=item $olddesc = $coroutine->desc ($newdesc)
447 469
448Sets (or gets in case the argument is missing) the description for this 470Sets (or gets in case the argument is missing) the description for this
449coroutine. This is just a free-form string you can associate with a coroutine. 471coroutine. This is just a free-form string you can associate with a coroutine.
472
473This method simply sets the C<< $coroutine->{desc} >> member to the given string. You
474can modify this member directly if you wish.
450 475
451=cut 476=cut
452 477
453sub desc { 478sub desc {
454 my $old = $_[0]{desc}; 479 my $old = $_[0]{desc};
530 555
531# we create a special coro because we want to cede, 556# we create a special coro because we want to cede,
532# to reduce pressure on the coro pool (because most callbacks 557# to reduce pressure on the coro pool (because most callbacks
533# return immediately and can be reused) and because we cannot cede 558# return immediately and can be reused) and because we cannot cede
534# inside an event callback. 559# inside an event callback.
535our $unblock_scheduler = async { 560our $unblock_scheduler = new Coro sub {
536 $current->desc ("[unblock_sub scheduler]");
537 while () { 561 while () {
538 while (my $cb = pop @unblock_queue) { 562 while (my $cb = pop @unblock_queue) {
539 # this is an inlined copy of async_pool 563 # this is an inlined copy of async_pool
540 my $coro = (pop @pool or new Coro \&pool_handler); 564 my $coro = (pop @async_pool) || new Coro \&pool_handler;
541 565
542 $coro->{_invoke} = $cb; 566 $coro->{_invoke} = $cb;
543 $coro->ready; 567 $coro->ready;
544 cede; # for short-lived callbacks, this reduces pressure on the coro pool 568 cede; # for short-lived callbacks, this reduces pressure on the coro pool
545 } 569 }
546 schedule; # sleep well 570 schedule; # sleep well
547 } 571 }
548}; 572};
573$unblock_scheduler->desc ("[unblock_sub scheduler]");
549 574
550sub unblock_sub(&) { 575sub unblock_sub(&) {
551 my $cb = shift; 576 my $cb = shift;
552 577
553 sub { 578 sub {

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines