ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent/Handle.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent/Handle.pm (file contents):
Revision 1.20 by elmex, Sat May 24 08:16:50 2008 UTC vs.
Revision 1.48 by root, Thu May 29 00:27:06 2008 UTC

2 2
3no warnings; 3no warnings;
4use strict; 4use strict;
5 5
6use AnyEvent (); 6use AnyEvent ();
7use AnyEvent::Util (); 7use AnyEvent::Util qw(WSAEWOULDBLOCK);
8use Scalar::Util (); 8use Scalar::Util ();
9use Carp (); 9use Carp ();
10use Fcntl (); 10use Fcntl ();
11use Errno qw/EAGAIN EINTR/; 11use Errno qw(EAGAIN EINTR);
12 12
13=head1 NAME 13=head1 NAME
14 14
15AnyEvent::Handle - non-blocking I/O on filehandles via AnyEvent 15AnyEvent::Handle - non-blocking I/O on file handles via AnyEvent
16
17This module is experimental.
18 16
19=cut 17=cut
20 18
21our $VERSION = '0.04'; 19our $VERSION = '0.04';
22 20
25 use AnyEvent; 23 use AnyEvent;
26 use AnyEvent::Handle; 24 use AnyEvent::Handle;
27 25
28 my $cv = AnyEvent->condvar; 26 my $cv = AnyEvent->condvar;
29 27
30 my $ae_fh = AnyEvent::Handle->new (fh => \*STDIN); 28 my $handle =
31
32 #TODO
33
34 # or use the constructor to pass the callback:
35
36 my $ae_fh2 =
37 AnyEvent::Handle->new ( 29 AnyEvent::Handle->new (
38 fh => \*STDIN, 30 fh => \*STDIN,
39 on_eof => sub { 31 on_eof => sub {
40 $cv->broadcast; 32 $cv->broadcast;
41 }, 33 },
42 #TODO
43 ); 34 );
44 35
45 $cv->wait; 36 # send some request line
37 $handle->push_write ("getinfo\015\012");
38
39 # read the response line
40 $handle->push_read (line => sub {
41 my ($handle, $line) = @_;
42 warn "read line <$line>\n";
43 $cv->send;
44 });
45
46 $cv->recv;
46 47
47=head1 DESCRIPTION 48=head1 DESCRIPTION
48 49
49This module is a helper module to make it easier to do event-based I/O on 50This module is a helper module to make it easier to do event-based I/O on
50filehandles. For utility functions for doing non-blocking connects and accepts 51filehandles. For utility functions for doing non-blocking connects and accepts
72The filehandle this L<AnyEvent::Handle> object will operate on. 73The filehandle this L<AnyEvent::Handle> object will operate on.
73 74
74NOTE: The filehandle will be set to non-blocking (using 75NOTE: The filehandle will be set to non-blocking (using
75AnyEvent::Util::fh_nonblocking). 76AnyEvent::Util::fh_nonblocking).
76 77
77=item on_eof => $cb->($self) 78=item on_eof => $cb->($handle)
78 79
79Set the callback to be called on EOF. 80Set the callback to be called on EOF.
80 81
81While not mandatory, it is highly recommended to set an eof callback, 82While not mandatory, it is highly recommended to set an eof callback,
82otherwise you might end up with a closed socket while you are still 83otherwise you might end up with a closed socket while you are still
83waiting for data. 84waiting for data.
84 85
85=item on_error => $cb->($self) 86=item on_error => $cb->($handle)
86 87
87This is the fatal error callback, that is called when, well, a fatal error 88This is the fatal error callback, that is called when, well, a fatal error
88occurs, such as not being able to resolve the hostname, failure to connect 89occurs, such as not being able to resolve the hostname, failure to connect
89or a read error. 90or a read error.
90 91
91The object will not be in a usable state when this callback has been 92The object will not be in a usable state when this callback has been
92called. 93called.
93 94
94On callback entrance, the value of C<$!> contains the operating system 95On callback entrance, the value of C<$!> contains the operating system
95error (or C<ENOSPC> or C<EPIPE>). 96error (or C<ENOSPC>, C<EPIPE>, C<ETIMEDOUT> or C<EBADMSG>).
97
98The callback should throw an exception. If it returns, then
99AnyEvent::Handle will C<croak> for you.
96 100
97While not mandatory, it is I<highly> recommended to set this callback, as 101While not mandatory, it is I<highly> recommended to set this callback, as
98you will not be notified of errors otherwise. The default simply calls 102you will not be notified of errors otherwise. The default simply calls
99die. 103die.
100 104
101=item on_read => $cb->($self) 105=item on_read => $cb->($handle)
102 106
103This sets the default read callback, which is called when data arrives 107This sets the default read callback, which is called when data arrives
104and no read request is in the queue. 108and no read request is in the queue.
105 109
106To access (and remove data from) the read buffer, use the C<< ->rbuf >> 110To access (and remove data from) the read buffer, use the C<< ->rbuf >>
107method or access the C<$self->{rbuf}> member directly. 111method or access the C<$handle->{rbuf}> member directly.
108 112
109When an EOF condition is detected then AnyEvent::Handle will first try to 113When an EOF condition is detected then AnyEvent::Handle will first try to
110feed all the remaining data to the queued callbacks and C<on_read> before 114feed all the remaining data to the queued callbacks and C<on_read> before
111calling the C<on_eof> callback. If no progress can be made, then a fatal 115calling the C<on_eof> callback. If no progress can be made, then a fatal
112error will be raised (with C<$!> set to C<EPIPE>). 116error will be raised (with C<$!> set to C<EPIPE>).
113 117
114=item on_drain => $cb->() 118=item on_drain => $cb->($handle)
115 119
116This sets the callback that is called when the write buffer becomes empty 120This sets the callback that is called when the write buffer becomes empty
117(or when the callback is set and the buffer is empty already). 121(or when the callback is set and the buffer is empty already).
118 122
119To append to the write buffer, use the C<< ->push_write >> method. 123To append to the write buffer, use the C<< ->push_write >> method.
124
125=item timeout => $fractional_seconds
126
127If non-zero, then this enables an "inactivity" timeout: whenever this many
128seconds pass without a successful read or write on the underlying file
129handle, the C<on_timeout> callback will be invoked (and if that one is
130missing, an C<ETIMEDOUT> error will be raised).
131
132Note that timeout processing is also active when you currently do not have
133any outstanding read or write requests: If you plan to keep the connection
134idle then you should disable the timout temporarily or ignore the timeout
135in the C<on_timeout> callback.
136
137Zero (the default) disables this timeout.
138
139=item on_timeout => $cb->($handle)
140
141Called whenever the inactivity timeout passes. If you return from this
142callback, then the timeout will be reset as if some activity had happened,
143so this condition is not fatal in any way.
120 144
121=item rbuf_max => <bytes> 145=item rbuf_max => <bytes>
122 146
123If defined, then a fatal error will be raised (with C<$!> set to C<ENOSPC>) 147If defined, then a fatal error will be raised (with C<$!> set to C<ENOSPC>)
124when the read buffer ever (strictly) exceeds this size. This is useful to 148when the read buffer ever (strictly) exceeds this size. This is useful to
131isn't finished). 155isn't finished).
132 156
133=item read_size => <bytes> 157=item read_size => <bytes>
134 158
135The default read block size (the amount of bytes this module will try to read 159The default read block size (the amount of bytes this module will try to read
136on each [loop iteration). Default: C<4096>. 160during each (loop iteration). Default: C<8192>.
137 161
138=item low_water_mark => <bytes> 162=item low_water_mark => <bytes>
139 163
140Sets the amount of bytes (default: C<0>) that make up an "empty" write 164Sets the amount of bytes (default: C<0>) that make up an "empty" write
141buffer: If the write reaches this size or gets even samller it is 165buffer: If the write reaches this size or gets even samller it is
144=item tls => "accept" | "connect" | Net::SSLeay::SSL object 168=item tls => "accept" | "connect" | Net::SSLeay::SSL object
145 169
146When this parameter is given, it enables TLS (SSL) mode, that means it 170When this parameter is given, it enables TLS (SSL) mode, that means it
147will start making tls handshake and will transparently encrypt/decrypt 171will start making tls handshake and will transparently encrypt/decrypt
148data. 172data.
173
174TLS mode requires Net::SSLeay to be installed (it will be loaded
175automatically when you try to create a TLS handle).
149 176
150For the TLS server side, use C<accept>, and for the TLS client side of a 177For the TLS server side, use C<accept>, and for the TLS client side of a
151connection, use C<connect> mode. 178connection, use C<connect> mode.
152 179
153You can also provide your own TLS connection object, but you have 180You can also provide your own TLS connection object, but you have
154to make sure that you call either C<Net::SSLeay::set_connect_state> 181to make sure that you call either C<Net::SSLeay::set_connect_state>
155or C<Net::SSLeay::set_accept_state> on it before you pass it to 182or C<Net::SSLeay::set_accept_state> on it before you pass it to
156AnyEvent::Handle. 183AnyEvent::Handle.
157 184
185See the C<starttls> method if you need to start TLs negotiation later.
186
158=item tls_ctx => $ssl_ctx 187=item tls_ctx => $ssl_ctx
159 188
160Use the given Net::SSLeay::CTX object to create the new TLS connection 189Use the given Net::SSLeay::CTX object to create the new TLS connection
161(unless a connection object was specified directly). If this parameter is 190(unless a connection object was specified directly). If this parameter is
162missing, then AnyEvent::Handle will use C<AnyEvent::Handle::TLS_CTX>. 191missing, then AnyEvent::Handle will use C<AnyEvent::Handle::TLS_CTX>.
163 192
193=item json => JSON or JSON::XS object
194
195This is the json coder object used by the C<json> read and write types.
196
197If you don't supply it, then AnyEvent::Handle will create and use a
198suitable one, which will write and expect UTF-8 encoded JSON texts.
199
200Note that you are responsible to depend on the JSON module if you want to
201use this functionality, as AnyEvent does not have a dependency itself.
202
203=item filter_r => $cb
204
205=item filter_w => $cb
206
207These exist, but are undocumented at this time.
208
164=back 209=back
165 210
166=cut 211=cut
167 212
168sub new { 213sub new {
177 if ($self->{tls}) { 222 if ($self->{tls}) {
178 require Net::SSLeay; 223 require Net::SSLeay;
179 $self->starttls (delete $self->{tls}, delete $self->{tls_ctx}); 224 $self->starttls (delete $self->{tls}, delete $self->{tls_ctx});
180 } 225 }
181 226
182 $self->on_eof (delete $self->{on_eof} ) if $self->{on_eof}; 227# $self->on_eof (delete $self->{on_eof} ) if $self->{on_eof}; # nop
183 $self->on_error (delete $self->{on_error}) if $self->{on_error}; 228# $self->on_error (delete $self->{on_error}) if $self->{on_error}; # nop
229# $self->on_read (delete $self->{on_read} ) if $self->{on_read}; # nop
184 $self->on_drain (delete $self->{on_drain}) if $self->{on_drain}; 230 $self->on_drain (delete $self->{on_drain}) if $self->{on_drain};
185 $self->on_read (delete $self->{on_read} ) if $self->{on_read}; 231
232 $self->{_activity} = AnyEvent->now;
233 $self->_timeout;
186 234
187 $self->start_read; 235 $self->start_read;
188 236
189 $self 237 $self
190} 238}
191 239
192sub _shutdown { 240sub _shutdown {
193 my ($self) = @_; 241 my ($self) = @_;
194 242
243 delete $self->{_tw};
195 delete $self->{rw}; 244 delete $self->{_rw};
196 delete $self->{ww}; 245 delete $self->{_ww};
197 delete $self->{fh}; 246 delete $self->{fh};
198} 247}
199 248
200sub error { 249sub error {
201 my ($self) = @_; 250 my ($self) = @_;
203 { 252 {
204 local $!; 253 local $!;
205 $self->_shutdown; 254 $self->_shutdown;
206 } 255 }
207 256
208 if ($self->{on_error}) {
209 $self->{on_error}($self); 257 $self->{on_error}($self)
210 } else { 258 if $self->{on_error};
259
211 die "AnyEvent::Handle uncaught fatal error: $!"; 260 Carp::croak "AnyEvent::Handle uncaught fatal error: $!";
212 }
213} 261}
214 262
215=item $fh = $handle->fh 263=item $fh = $handle->fh
216 264
217This method returns the filehandle of the L<AnyEvent::Handle> object. 265This method returns the file handle of the L<AnyEvent::Handle> object.
218 266
219=cut 267=cut
220 268
221sub fh { $_[0]->{fh} } 269sub fh { $_[0]{fh} }
222 270
223=item $handle->on_error ($cb) 271=item $handle->on_error ($cb)
224 272
225Replace the current C<on_error> callback (see the C<on_error> constructor argument). 273Replace the current C<on_error> callback (see the C<on_error> constructor argument).
226 274
236 284
237=cut 285=cut
238 286
239sub on_eof { 287sub on_eof {
240 $_[0]{on_eof} = $_[1]; 288 $_[0]{on_eof} = $_[1];
289}
290
291=item $handle->on_timeout ($cb)
292
293Replace the current C<on_timeout> callback, or disables the callback
294(but not the timeout) if C<$cb> = C<undef>. See C<timeout> constructor
295argument.
296
297=cut
298
299sub on_timeout {
300 $_[0]{on_timeout} = $_[1];
301}
302
303#############################################################################
304
305=item $handle->timeout ($seconds)
306
307Configures (or disables) the inactivity timeout.
308
309=cut
310
311sub timeout {
312 my ($self, $timeout) = @_;
313
314 $self->{timeout} = $timeout;
315 $self->_timeout;
316}
317
318# reset the timeout watcher, as neccessary
319# also check for time-outs
320sub _timeout {
321 my ($self) = @_;
322
323 if ($self->{timeout}) {
324 my $NOW = AnyEvent->now;
325
326 # when would the timeout trigger?
327 my $after = $self->{_activity} + $self->{timeout} - $NOW;
328
329 # now or in the past already?
330 if ($after <= 0) {
331 $self->{_activity} = $NOW;
332
333 if ($self->{on_timeout}) {
334 $self->{on_timeout}($self);
335 } else {
336 $! = Errno::ETIMEDOUT;
337 $self->error;
338 }
339
340 # callbakx could have changed timeout value, optimise
341 return unless $self->{timeout};
342
343 # calculate new after
344 $after = $self->{timeout};
345 }
346
347 Scalar::Util::weaken $self;
348
349 $self->{_tw} ||= AnyEvent->timer (after => $after, cb => sub {
350 delete $self->{_tw};
351 $self->_timeout;
352 });
353 } else {
354 delete $self->{_tw};
355 }
241} 356}
242 357
243############################################################################# 358#############################################################################
244 359
245=back 360=back
282=cut 397=cut
283 398
284sub _drain_wbuf { 399sub _drain_wbuf {
285 my ($self) = @_; 400 my ($self) = @_;
286 401
287 unless ($self->{ww}) { 402 if (!$self->{_ww} && length $self->{wbuf}) {
403
288 Scalar::Util::weaken $self; 404 Scalar::Util::weaken $self;
405
289 my $cb = sub { 406 my $cb = sub {
290 my $len = syswrite $self->{fh}, $self->{wbuf}; 407 my $len = syswrite $self->{fh}, $self->{wbuf};
291 408
292 if ($len > 0) { 409 if ($len >= 0) {
293 substr $self->{wbuf}, 0, $len, ""; 410 substr $self->{wbuf}, 0, $len, "";
411
412 $self->{_activity} = AnyEvent->now;
294 413
295 $self->{on_drain}($self) 414 $self->{on_drain}($self)
296 if $self->{low_water_mark} >= length $self->{wbuf} 415 if $self->{low_water_mark} >= length $self->{wbuf}
297 && $self->{on_drain}; 416 && $self->{on_drain};
298 417
299 delete $self->{ww} unless length $self->{wbuf}; 418 delete $self->{_ww} unless length $self->{wbuf};
300 } elsif ($! != EAGAIN && $! != EINTR) { 419 } elsif ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK) {
301 $self->error; 420 $self->error;
302 } 421 }
303 }; 422 };
304 423
424 # try to write data immediately
425 $cb->();
426
427 # if still data left in wbuf, we need to poll
305 $self->{ww} = AnyEvent->io (fh => $self->{fh}, poll => "w", cb => $cb); 428 $self->{_ww} = AnyEvent->io (fh => $self->{fh}, poll => "w", cb => $cb)
306 429 if length $self->{wbuf};
307 $cb->($self);
308 }; 430 };
431}
432
433our %WH;
434
435sub register_write_type($$) {
436 $WH{$_[0]} = $_[1];
309} 437}
310 438
311sub push_write { 439sub push_write {
312 my $self = shift; 440 my $self = shift;
313 441
442 if (@_ > 1) {
443 my $type = shift;
444
445 @_ = ($WH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::push_write")
446 ->($self, @_);
447 }
448
314 if ($self->{filter_w}) { 449 if ($self->{filter_w}) {
315 $self->{filter_w}->($self, \$_[0]); 450 $self->{filter_w}($self, \$_[0]);
316 } else { 451 } else {
317 $self->{wbuf} .= $_[0]; 452 $self->{wbuf} .= $_[0];
318 $self->_drain_wbuf; 453 $self->_drain_wbuf;
319 } 454 }
320} 455}
456
457=item $handle->push_write (type => @args)
458
459=item $handle->unshift_write (type => @args)
460
461Instead of formatting your data yourself, you can also let this module do
462the job by specifying a type and type-specific arguments.
463
464Predefined types are (if you have ideas for additional types, feel free to
465drop by and tell us):
466
467=over 4
468
469=item netstring => $string
470
471Formats the given value as netstring
472(http://cr.yp.to/proto/netstrings.txt, this is not a recommendation to use them).
473
474=back
475
476=cut
477
478register_write_type netstring => sub {
479 my ($self, $string) = @_;
480
481 sprintf "%d:%s,", (length $string), $string
482};
483
484=item json => $array_or_hashref
485
486Encodes the given hash or array reference into a JSON object. Unless you
487provide your own JSON object, this means it will be encoded to JSON text
488in UTF-8.
489
490JSON objects (and arrays) are self-delimiting, so you can write JSON at
491one end of a handle and read them at the other end without using any
492additional framing.
493
494The generated JSON text is guaranteed not to contain any newlines: While
495this module doesn't need delimiters after or between JSON texts to be
496able to read them, many other languages depend on that.
497
498A simple RPC protocol that interoperates easily with others is to send
499JSON arrays (or objects, although arrays are usually the better choice as
500they mimic how function argument passing works) and a newline after each
501JSON text:
502
503 $handle->push_write (json => ["method", "arg1", "arg2"]); # whatever
504 $handle->push_write ("\012");
505
506An AnyEvent::Handle receiver would simply use the C<json> read type and
507rely on the fact that the newline will be skipped as leading whitespace:
508
509 $handle->push_read (json => sub { my $array = $_[1]; ... });
510
511Other languages could read single lines terminated by a newline and pass
512this line into their JSON decoder of choice.
513
514=cut
515
516register_write_type json => sub {
517 my ($self, $ref) = @_;
518
519 require JSON;
520
521 $self->{json} ? $self->{json}->encode ($ref)
522 : JSON::encode_json ($ref)
523};
524
525=item AnyEvent::Handle::register_write_type type => $coderef->($handle, @args)
526
527This function (not method) lets you add your own types to C<push_write>.
528Whenever the given C<type> is used, C<push_write> will invoke the code
529reference with the handle object and the remaining arguments.
530
531The code reference is supposed to return a single octet string that will
532be appended to the write buffer.
533
534Note that this is a function, and all types registered this way will be
535global, so try to use unique names.
536
537=cut
321 538
322############################################################################# 539#############################################################################
323 540
324=back 541=back
325 542
404 621
405 if ( 622 if (
406 defined $self->{rbuf_max} 623 defined $self->{rbuf_max}
407 && $self->{rbuf_max} < length $self->{rbuf} 624 && $self->{rbuf_max} < length $self->{rbuf}
408 ) { 625 ) {
409 $! = &Errno::ENOSPC; return $self->error; 626 $! = &Errno::ENOSPC;
627 $self->error;
410 } 628 }
411 629
412 return if $self->{in_drain}; 630 return if $self->{in_drain};
413 local $self->{in_drain} = 1; 631 local $self->{in_drain} = 1;
414 632
415 while (my $len = length $self->{rbuf}) { 633 while (my $len = length $self->{rbuf}) {
416 no strict 'refs'; 634 no strict 'refs';
417 if (my $cb = shift @{ $self->{queue} }) { 635 if (my $cb = shift @{ $self->{_queue} }) {
418 if (!$cb->($self)) { 636 unless ($cb->($self)) {
419 if ($self->{eof}) { 637 if ($self->{_eof}) {
420 # no progress can be made (not enough data and no data forthcoming) 638 # no progress can be made (not enough data and no data forthcoming)
421 $! = &Errno::EPIPE; return $self->error; 639 $! = &Errno::EPIPE;
640 $self->error;
422 } 641 }
423 642
424 unshift @{ $self->{queue} }, $cb; 643 unshift @{ $self->{_queue} }, $cb;
425 return; 644 return;
426 } 645 }
427 } elsif ($self->{on_read}) { 646 } elsif ($self->{on_read}) {
428 $self->{on_read}($self); 647 $self->{on_read}($self);
429 648
430 if ( 649 if (
431 $self->{eof} # if no further data will arrive 650 $self->{_eof} # if no further data will arrive
432 && $len == length $self->{rbuf} # and no data has been consumed 651 && $len == length $self->{rbuf} # and no data has been consumed
433 && !@{ $self->{queue} } # and the queue is still empty 652 && !@{ $self->{_queue} } # and the queue is still empty
434 && $self->{on_read} # and we still want to read data 653 && $self->{on_read} # and we still want to read data
435 ) { 654 ) {
436 # then no progress can be made 655 # then no progress can be made
437 $! = &Errno::EPIPE; return $self->error; 656 $! = &Errno::EPIPE;
657 $self->error;
438 } 658 }
439 } else { 659 } else {
440 # read side becomes idle 660 # read side becomes idle
441 delete $self->{rw}; 661 delete $self->{_rw};
442 return; 662 return;
443 } 663 }
444 } 664 }
445 665
446 if ($self->{eof}) {
447 $self->_shutdown;
448 $self->{on_eof}($self) 666 $self->{on_eof}($self)
449 if $self->{on_eof}; 667 if $self->{_eof} && $self->{on_eof};
450 }
451} 668}
452 669
453=item $handle->on_read ($cb) 670=item $handle->on_read ($cb)
454 671
455This replaces the currently set C<on_read> callback, or clears it (when 672This replaces the currently set C<on_read> callback, or clears it (when
500interested in (which can be none at all) and return a true value. After returning 717interested in (which can be none at all) and return a true value. After returning
501true, it will be removed from the queue. 718true, it will be removed from the queue.
502 719
503=cut 720=cut
504 721
722our %RH;
723
724sub register_read_type($$) {
725 $RH{$_[0]} = $_[1];
726}
727
505sub push_read { 728sub push_read {
506 my ($self, $cb) = @_; 729 my $self = shift;
730 my $cb = pop;
507 731
732 if (@_) {
733 my $type = shift;
734
735 $cb = ($RH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::push_read")
736 ->($self, $cb, @_);
737 }
738
508 push @{ $self->{queue} }, $cb; 739 push @{ $self->{_queue} }, $cb;
509 $self->_drain_rbuf; 740 $self->_drain_rbuf;
510} 741}
511 742
512sub unshift_read { 743sub unshift_read {
513 my ($self, $cb) = @_; 744 my $self = shift;
745 my $cb = pop;
514 746
747 if (@_) {
748 my $type = shift;
749
750 $cb = ($RH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::unshift_read")
751 ->($self, $cb, @_);
752 }
753
754
515 push @{ $self->{queue} }, $cb; 755 unshift @{ $self->{_queue} }, $cb;
516 $self->_drain_rbuf; 756 $self->_drain_rbuf;
517} 757}
518 758
519=item $handle->push_read_chunk ($len, $cb->($self, $data)) 759=item $handle->push_read (type => @args, $cb)
520 760
521=item $handle->unshift_read_chunk ($len, $cb->($self, $data)) 761=item $handle->unshift_read (type => @args, $cb)
522 762
523Append the given callback to the end of the queue (C<push_read_chunk>) or 763Instead of providing a callback that parses the data itself you can chose
524prepend it (C<unshift_read_chunk>). 764between a number of predefined parsing formats, for chunks of data, lines
765etc.
525 766
526The callback will be called only once C<$len> bytes have been read, and 767Predefined types are (if you have ideas for additional types, feel free to
527these C<$len> bytes will be passed to the callback. 768drop by and tell us):
528 769
529=cut 770=over 4
530 771
531sub _read_chunk($$) { 772=item chunk => $octets, $cb->($handle, $data)
773
774Invoke the callback only once C<$octets> bytes have been read. Pass the
775data read to the callback. The callback will never be called with less
776data.
777
778Example: read 2 bytes.
779
780 $handle->push_read (chunk => 2, sub {
781 warn "yay ", unpack "H*", $_[1];
782 });
783
784=cut
785
786register_read_type chunk => sub {
532 my ($self, $len, $cb) = @_; 787 my ($self, $cb, $len) = @_;
533 788
534 sub { 789 sub {
535 $len <= length $_[0]{rbuf} or return; 790 $len <= length $_[0]{rbuf} or return;
536 $cb->($_[0], substr $_[0]{rbuf}, 0, $len, ""); 791 $cb->($_[0], substr $_[0]{rbuf}, 0, $len, "");
537 1 792 1
538 } 793 }
539} 794};
540 795
796# compatibility with older API
541sub push_read_chunk { 797sub push_read_chunk {
542 $_[0]->push_read (&_read_chunk); 798 $_[0]->push_read (chunk => $_[1], $_[2]);
543} 799}
544
545 800
546sub unshift_read_chunk { 801sub unshift_read_chunk {
547 $_[0]->unshift_read (&_read_chunk); 802 $_[0]->unshift_read (chunk => $_[1], $_[2]);
548} 803}
549 804
550=item $handle->push_read_line ([$eol, ]$cb->($self, $line, $eol)) 805=item line => [$eol, ]$cb->($handle, $line, $eol)
551
552=item $handle->unshift_read_line ([$eol, ]$cb->($self, $line, $eol))
553
554Append the given callback to the end of the queue (C<push_read_line>) or
555prepend it (C<unshift_read_line>).
556 806
557The callback will be called only once a full line (including the end of 807The callback will be called only once a full line (including the end of
558line marker, C<$eol>) has been read. This line (excluding the end of line 808line marker, C<$eol>) has been read. This line (excluding the end of line
559marker) will be passed to the callback as second argument (C<$line>), and 809marker) will be passed to the callback as second argument (C<$line>), and
560the end of line marker as the third argument (C<$eol>). 810the end of line marker as the third argument (C<$eol>).
571Partial lines at the end of the stream will never be returned, as they are 821Partial lines at the end of the stream will never be returned, as they are
572not marked by the end of line marker. 822not marked by the end of line marker.
573 823
574=cut 824=cut
575 825
576sub _read_line($$) { 826register_read_type line => sub {
577 my $self = shift; 827 my ($self, $cb, $eol) = @_;
578 my $cb = pop;
579 my $eol = @_ ? shift : qr|(\015?\012)|;
580 my $pos;
581 828
829 $eol = qr|(\015?\012)| if @_ < 3;
582 $eol = quotemeta $eol unless ref $eol; 830 $eol = quotemeta $eol unless ref $eol;
583 $eol = qr|^(.*?)($eol)|s; 831 $eol = qr|^(.*?)($eol)|s;
584 832
585 sub { 833 sub {
586 $_[0]{rbuf} =~ s/$eol// or return; 834 $_[0]{rbuf} =~ s/$eol// or return;
587 835
588 $cb->($_[0], $1, $2); 836 $cb->($_[0], $1, $2);
589 1 837 1
590 } 838 }
591} 839};
592 840
841# compatibility with older API
593sub push_read_line { 842sub push_read_line {
594 $_[0]->push_read (&_read_line); 843 my $self = shift;
844 $self->push_read (line => @_);
595} 845}
596 846
597sub unshift_read_line { 847sub unshift_read_line {
598 $_[0]->unshift_read (&_read_line); 848 my $self = shift;
849 $self->unshift_read (line => @_);
599} 850}
851
852=item netstring => $cb->($handle, $string)
853
854A netstring (http://cr.yp.to/proto/netstrings.txt, this is not an endorsement).
855
856Throws an error with C<$!> set to EBADMSG on format violations.
857
858=cut
859
860register_read_type netstring => sub {
861 my ($self, $cb) = @_;
862
863 sub {
864 unless ($_[0]{rbuf} =~ s/^(0|[1-9][0-9]*)://) {
865 if ($_[0]{rbuf} =~ /[^0-9]/) {
866 $! = &Errno::EBADMSG;
867 $self->error;
868 }
869 return;
870 }
871
872 my $len = $1;
873
874 $self->unshift_read (chunk => $len, sub {
875 my $string = $_[1];
876 $_[0]->unshift_read (chunk => 1, sub {
877 if ($_[1] eq ",") {
878 $cb->($_[0], $string);
879 } else {
880 $! = &Errno::EBADMSG;
881 $self->error;
882 }
883 });
884 });
885
886 1
887 }
888};
889
890=item regex => $accept[, $reject[, $skip], $cb->($handle, $data)
891
892Makes a regex match against the regex object C<$accept> and returns
893everything up to and including the match.
894
895Example: read a single line terminated by '\n'.
896
897 $handle->push_read (regex => qr<\n>, sub { ... });
898
899If C<$reject> is given and not undef, then it determines when the data is
900to be rejected: it is matched against the data when the C<$accept> regex
901does not match and generates an C<EBADMSG> error when it matches. This is
902useful to quickly reject wrong data (to avoid waiting for a timeout or a
903receive buffer overflow).
904
905Example: expect a single decimal number followed by whitespace, reject
906anything else (not the use of an anchor).
907
908 $handle->push_read (regex => qr<^[0-9]+\s>, qr<[^0-9]>, sub { ... });
909
910If C<$skip> is given and not C<undef>, then it will be matched against
911the receive buffer when neither C<$accept> nor C<$reject> match,
912and everything preceding and including the match will be accepted
913unconditionally. This is useful to skip large amounts of data that you
914know cannot be matched, so that the C<$accept> or C<$reject> regex do not
915have to start matching from the beginning. This is purely an optimisation
916and is usually worth only when you expect more than a few kilobytes.
917
918Example: expect a http header, which ends at C<\015\012\015\012>. Since we
919expect the header to be very large (it isn't in practise, but...), we use
920a skip regex to skip initial portions. The skip regex is tricky in that
921it only accepts something not ending in either \015 or \012, as these are
922required for the accept regex.
923
924 $handle->push_read (regex =>
925 qr<\015\012\015\012>,
926 undef, # no reject
927 qr<^.*[^\015\012]>,
928 sub { ... });
929
930=cut
931
932register_read_type regex => sub {
933 my ($self, $cb, $accept, $reject, $skip) = @_;
934
935 my $data;
936 my $rbuf = \$self->{rbuf};
937
938 sub {
939 # accept
940 if ($$rbuf =~ $accept) {
941 $data .= substr $$rbuf, 0, $+[0], "";
942 $cb->($self, $data);
943 return 1;
944 }
945
946 # reject
947 if ($reject && $$rbuf =~ $reject) {
948 $! = &Errno::EBADMSG;
949 $self->error;
950 }
951
952 # skip
953 if ($skip && $$rbuf =~ $skip) {
954 $data .= substr $$rbuf, 0, $+[0], "";
955 }
956
957 ()
958 }
959};
960
961=item json => $cb->($handle, $hash_or_arrayref)
962
963Reads a JSON object or array, decodes it and passes it to the callback.
964
965If a C<json> object was passed to the constructor, then that will be used
966for the final decode, otherwise it will create a JSON coder expecting UTF-8.
967
968This read type uses the incremental parser available with JSON version
9692.09 (and JSON::XS version 2.2) and above. You have to provide a
970dependency on your own: this module will load the JSON module, but
971AnyEvent does not depend on it itself.
972
973Since JSON texts are fully self-delimiting, the C<json> read and write
974types are an ideal simple RPC protocol: just exchange JSON datagrams. See
975the C<json> write type description, above, for an actual example.
976
977=cut
978
979register_read_type json => sub {
980 my ($self, $cb, $accept, $reject, $skip) = @_;
981
982 require JSON;
983
984 my $data;
985 my $rbuf = \$self->{rbuf};
986
987 my $json = $self->{json} ||= JSON->new->utf8;
988
989 sub {
990 my $ref = $json->incr_parse ($self->{rbuf});
991
992 if ($ref) {
993 $self->{rbuf} = $json->incr_text;
994 $json->incr_text = "";
995 $cb->($self, $ref);
996
997 1
998 } else {
999 $self->{rbuf} = "";
1000 ()
1001 }
1002 }
1003};
1004
1005=back
1006
1007=item AnyEvent::Handle::register_read_type type => $coderef->($handle, $cb, @args)
1008
1009This function (not method) lets you add your own types to C<push_read>.
1010
1011Whenever the given C<type> is used, C<push_read> will invoke the code
1012reference with the handle object, the callback and the remaining
1013arguments.
1014
1015The code reference is supposed to return a callback (usually a closure)
1016that works as a plain read callback (see C<< ->push_read ($cb) >>).
1017
1018It should invoke the passed callback when it is done reading (remember to
1019pass C<$handle> as first argument as all other callbacks do that).
1020
1021Note that this is a function, and all types registered this way will be
1022global, so try to use unique names.
1023
1024For examples, see the source of this module (F<perldoc -m AnyEvent::Handle>,
1025search for C<register_read_type>)).
600 1026
601=item $handle->stop_read 1027=item $handle->stop_read
602 1028
603=item $handle->start_read 1029=item $handle->start_read
604 1030
605In rare cases you actually do not want to read anything from the 1031In rare cases you actually do not want to read anything from the
606socket. In this case you can call C<stop_read>. Neither C<on_read> no 1032socket. In this case you can call C<stop_read>. Neither C<on_read> no
607any queued callbacks will be executed then. To start readign again, call 1033any queued callbacks will be executed then. To start reading again, call
608C<start_read>. 1034C<start_read>.
609 1035
610=cut 1036=cut
611 1037
612sub stop_read { 1038sub stop_read {
613 my ($self) = @_; 1039 my ($self) = @_;
614 1040
615 delete $self->{rw}; 1041 delete $self->{_rw};
616} 1042}
617 1043
618sub start_read { 1044sub start_read {
619 my ($self) = @_; 1045 my ($self) = @_;
620 1046
621 unless ($self->{rw} || $self->{eof}) { 1047 unless ($self->{_rw} || $self->{_eof}) {
622 Scalar::Util::weaken $self; 1048 Scalar::Util::weaken $self;
623 1049
624 $self->{rw} = AnyEvent->io (fh => $self->{fh}, poll => "r", cb => sub { 1050 $self->{_rw} = AnyEvent->io (fh => $self->{fh}, poll => "r", cb => sub {
625 my $rbuf = $self->{filter_r} ? \my $buf : \$self->{rbuf}; 1051 my $rbuf = $self->{filter_r} ? \my $buf : \$self->{rbuf};
626 my $len = sysread $self->{fh}, $$rbuf, $self->{read_size} || 8192, length $$rbuf; 1052 my $len = sysread $self->{fh}, $$rbuf, $self->{read_size} || 8192, length $$rbuf;
627 1053
628 if ($len > 0) { 1054 if ($len > 0) {
1055 $self->{_activity} = AnyEvent->now;
1056
629 $self->{filter_r} 1057 $self->{filter_r}
630 ? $self->{filter_r}->($self, $rbuf) 1058 ? $self->{filter_r}($self, $rbuf)
631 : $self->_drain_rbuf; 1059 : $self->_drain_rbuf;
632 1060
633 } elsif (defined $len) { 1061 } elsif (defined $len) {
634 delete $self->{rw}; 1062 delete $self->{_rw};
635 $self->{eof} = 1; 1063 $self->{_eof} = 1;
636 $self->_drain_rbuf; 1064 $self->_drain_rbuf;
637 1065
638 } elsif ($! != EAGAIN && $! != EINTR) { 1066 } elsif ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK) {
639 return $self->error; 1067 return $self->error;
640 } 1068 }
641 }); 1069 });
642 } 1070 }
643} 1071}
644 1072
645sub _dotls { 1073sub _dotls {
646 my ($self) = @_; 1074 my ($self) = @_;
647 1075
648 if (length $self->{tls_wbuf}) { 1076 if (length $self->{_tls_wbuf}) {
649 my $len = Net::SSLeay::write ($self->{tls}, $self->{tls_wbuf}); 1077 while ((my $len = Net::SSLeay::write ($self->{tls}, $self->{_tls_wbuf})) > 0) {
650 substr $self->{tls_wbuf}, 0, $len, "" if $len > 0; 1078 substr $self->{_tls_wbuf}, 0, $len, "";
1079 }
651 } 1080 }
652 1081
653 if (defined (my $buf = Net::SSLeay::BIO_read ($self->{tls_wbio}))) { 1082 if (defined (my $buf = Net::SSLeay::BIO_read ($self->{_wbio}))) {
654 $self->{wbuf} .= $buf; 1083 $self->{wbuf} .= $buf;
655 $self->_drain_wbuf; 1084 $self->_drain_wbuf;
656 } 1085 }
657 1086
658 if (defined (my $buf = Net::SSLeay::read ($self->{tls}))) { 1087 while (defined (my $buf = Net::SSLeay::read ($self->{tls}))) {
659 $self->{rbuf} .= $buf; 1088 $self->{rbuf} .= $buf;
660 $self->_drain_rbuf; 1089 $self->_drain_rbuf;
661 } elsif ( 1090 }
1091
662 (my $err = Net::SSLeay::get_error ($self->{tls}, -1)) 1092 my $err = Net::SSLeay::get_error ($self->{tls}, -1);
1093
663 != Net::SSLeay::ERROR_WANT_READ () 1094 if ($err!= Net::SSLeay::ERROR_WANT_READ ()) {
664 ) {
665 if ($err == Net::SSLeay::ERROR_SYSCALL ()) { 1095 if ($err == Net::SSLeay::ERROR_SYSCALL ()) {
666 $self->error; 1096 $self->error;
667 } elsif ($err == Net::SSLeay::ERROR_SSL ()) { 1097 } elsif ($err == Net::SSLeay::ERROR_SSL ()) {
668 $! = &Errno::EIO; 1098 $! = &Errno::EIO;
669 $self->error; 1099 $self->error;
671 1101
672 # all others are fine for our purposes 1102 # all others are fine for our purposes
673 } 1103 }
674} 1104}
675 1105
1106=item $handle->starttls ($tls[, $tls_ctx])
1107
1108Instead of starting TLS negotiation immediately when the AnyEvent::Handle
1109object is created, you can also do that at a later time by calling
1110C<starttls>.
1111
1112The first argument is the same as the C<tls> constructor argument (either
1113C<"connect">, C<"accept"> or an existing Net::SSLeay object).
1114
1115The second argument is the optional C<Net::SSLeay::CTX> object that is
1116used when AnyEvent::Handle has to create its own TLS connection object.
1117
1118The TLS connection object will end up in C<< $handle->{tls} >> after this
1119call and can be used or changed to your liking. Note that the handshake
1120might have already started when this function returns.
1121
1122=cut
1123
676# TODO: maybe document... 1124# TODO: maybe document...
677sub starttls { 1125sub starttls {
678 my ($self, $ssl, $ctx) = @_; 1126 my ($self, $ssl, $ctx) = @_;
1127
1128 $self->stoptls;
679 1129
680 if ($ssl eq "accept") { 1130 if ($ssl eq "accept") {
681 $ssl = Net::SSLeay::new ($ctx || TLS_CTX ()); 1131 $ssl = Net::SSLeay::new ($ctx || TLS_CTX ());
682 Net::SSLeay::set_accept_state ($ssl); 1132 Net::SSLeay::set_accept_state ($ssl);
683 } elsif ($ssl eq "connect") { 1133 } elsif ($ssl eq "connect") {
685 Net::SSLeay::set_connect_state ($ssl); 1135 Net::SSLeay::set_connect_state ($ssl);
686 } 1136 }
687 1137
688 $self->{tls} = $ssl; 1138 $self->{tls} = $ssl;
689 1139
1140 # basically, this is deep magic (because SSL_read should have the same issues)
1141 # but the openssl maintainers basically said: "trust us, it just works".
1142 # (unfortunately, we have to hardcode constants because the abysmally misdesigned
1143 # and mismaintained ssleay-module doesn't even offer them).
1144 # http://www.mail-archive.com/openssl-dev@openssl.org/msg22420.html
1145 Net::SSLeay::CTX_set_mode ($self->{tls},
1146 (eval { local $SIG{__DIE__}; Net::SSLeay::MODE_ENABLE_PARTIAL_WRITE () } || 1)
1147 | (eval { local $SIG{__DIE__}; Net::SSLeay::MODE_ACCEPT_MOVING_WRITE_BUFFER () } || 2));
1148
690 $self->{tls_rbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ()); 1149 $self->{_rbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ());
691 $self->{tls_wbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ()); 1150 $self->{_wbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ());
692 1151
693 Net::SSLeay::set_bio ($ssl, $self->{tls_rbio}, $self->{tls_wbio}); 1152 Net::SSLeay::set_bio ($ssl, $self->{_rbio}, $self->{_wbio});
694 1153
695 $self->{filter_w} = sub { 1154 $self->{filter_w} = sub {
696 $_[0]{tls_wbuf} .= ${$_[1]}; 1155 $_[0]{_tls_wbuf} .= ${$_[1]};
697 &_dotls; 1156 &_dotls;
698 }; 1157 };
699 $self->{filter_r} = sub { 1158 $self->{filter_r} = sub {
700 Net::SSLeay::BIO_write ($_[0]{tls_rbio}, ${$_[1]}); 1159 Net::SSLeay::BIO_write ($_[0]{_rbio}, ${$_[1]});
701 &_dotls; 1160 &_dotls;
702 }; 1161 };
703} 1162}
704 1163
1164=item $handle->stoptls
1165
1166Destroys the SSL connection, if any. Partial read or write data will be
1167lost.
1168
1169=cut
1170
1171sub stoptls {
1172 my ($self) = @_;
1173
1174 Net::SSLeay::free (delete $self->{tls}) if $self->{tls};
1175
1176 delete $self->{_rbio};
1177 delete $self->{_wbio};
1178 delete $self->{_tls_wbuf};
1179 delete $self->{filter_r};
1180 delete $self->{filter_w};
1181}
1182
705sub DESTROY { 1183sub DESTROY {
706 my $self = shift; 1184 my $self = shift;
707 1185
708 Net::SSLeay::free (delete $self->{tls}) if $self->{tls}; 1186 $self->stoptls;
709} 1187}
710 1188
711=item AnyEvent::Handle::TLS_CTX 1189=item AnyEvent::Handle::TLS_CTX
712 1190
713This function creates and returns the Net::SSLeay::CTX object used by 1191This function creates and returns the Net::SSLeay::CTX object used by
743 } 1221 }
744} 1222}
745 1223
746=back 1224=back
747 1225
1226=head1 SUBCLASSING AnyEvent::Handle
1227
1228In many cases, you might want to subclass AnyEvent::Handle.
1229
1230To make this easier, a given version of AnyEvent::Handle uses these
1231conventions:
1232
1233=over 4
1234
1235=item * all constructor arguments become object members.
1236
1237At least initially, when you pass a C<tls>-argument to the constructor it
1238will end up in C<< $handle->{tls} >>. Those members might be changes or
1239mutated later on (for example C<tls> will hold the TLS connection object).
1240
1241=item * other object member names are prefixed with an C<_>.
1242
1243All object members not explicitly documented (internal use) are prefixed
1244with an underscore character, so the remaining non-C<_>-namespace is free
1245for use for subclasses.
1246
1247=item * all members not documented here and not prefixed with an underscore
1248are free to use in subclasses.
1249
1250Of course, new versions of AnyEvent::Handle may introduce more "public"
1251member variables, but thats just life, at least it is documented.
1252
1253=back
1254
748=head1 AUTHOR 1255=head1 AUTHOR
749 1256
750Robin Redeker C<< <elmex at ta-sa.org> >>, Marc Lehmann <schmorp@schmorp.de>. 1257Robin Redeker C<< <elmex at ta-sa.org> >>, Marc Lehmann <schmorp@schmorp.de>.
751 1258
752=cut 1259=cut

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines