ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent/Handle.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent/Handle.pm (file contents):
Revision 1.9 by root, Fri May 2 16:07:46 2008 UTC vs.
Revision 1.51 by root, Sat May 31 13:38:01 2008 UTC

2 2
3no warnings; 3no warnings;
4use strict; 4use strict;
5 5
6use AnyEvent (); 6use AnyEvent ();
7use AnyEvent::Util (); 7use AnyEvent::Util qw(WSAEWOULDBLOCK);
8use Scalar::Util (); 8use Scalar::Util ();
9use Carp (); 9use Carp ();
10use Fcntl (); 10use Fcntl ();
11use Errno qw/EAGAIN EINTR/; 11use Errno qw(EAGAIN EINTR);
12 12
13=head1 NAME 13=head1 NAME
14 14
15AnyEvent::Handle - non-blocking I/O on filehandles via AnyEvent 15AnyEvent::Handle - non-blocking I/O on file handles via AnyEvent
16 16
17=cut 17=cut
18 18
19our $VERSION = '0.02'; 19our $VERSION = 4.1;
20 20
21=head1 SYNOPSIS 21=head1 SYNOPSIS
22 22
23 use AnyEvent; 23 use AnyEvent;
24 use AnyEvent::Handle; 24 use AnyEvent::Handle;
25 25
26 my $cv = AnyEvent->condvar; 26 my $cv = AnyEvent->condvar;
27 27
28 my $ae_fh = AnyEvent::Handle->new (fh => \*STDIN); 28 my $handle =
29
30 #TODO
31
32 # or use the constructor to pass the callback:
33
34 my $ae_fh2 =
35 AnyEvent::Handle->new ( 29 AnyEvent::Handle->new (
36 fh => \*STDIN, 30 fh => \*STDIN,
37 on_eof => sub { 31 on_eof => sub {
38 $cv->broadcast; 32 $cv->broadcast;
39 }, 33 },
40 #TODO
41 ); 34 );
42 35
43 $cv->wait; 36 # send some request line
37 $handle->push_write ("getinfo\015\012");
38
39 # read the response line
40 $handle->push_read (line => sub {
41 my ($handle, $line) = @_;
42 warn "read line <$line>\n";
43 $cv->send;
44 });
45
46 $cv->recv;
44 47
45=head1 DESCRIPTION 48=head1 DESCRIPTION
46 49
47This module is a helper module to make it easier to do event-based I/O on 50This module is a helper module to make it easier to do event-based I/O on
48filehandles (and sockets, see L<AnyEvent::Socket> for an easy way to make 51filehandles. For utility functions for doing non-blocking connects and accepts
49non-blocking resolves and connects). 52on sockets see L<AnyEvent::Util>.
50 53
51In the following, when the documentation refers to of "bytes" then this 54In the following, when the documentation refers to of "bytes" then this
52means characters. As sysread and syswrite are used for all I/O, their 55means characters. As sysread and syswrite are used for all I/O, their
53treatment of characters applies to this module as well. 56treatment of characters applies to this module as well.
54 57
70The filehandle this L<AnyEvent::Handle> object will operate on. 73The filehandle this L<AnyEvent::Handle> object will operate on.
71 74
72NOTE: The filehandle will be set to non-blocking (using 75NOTE: The filehandle will be set to non-blocking (using
73AnyEvent::Util::fh_nonblocking). 76AnyEvent::Util::fh_nonblocking).
74 77
75=item on_error => $cb->($self) [MANDATORY] 78=item on_eof => $cb->($handle)
76 79
80Set the callback to be called on EOF.
81
82While not mandatory, it is highly recommended to set an eof callback,
83otherwise you might end up with a closed socket while you are still
84waiting for data.
85
86=item on_error => $cb->($handle)
87
77This is the fatal error callback, that is called when a fatal error ocurs, 88This is the fatal error callback, that is called when, well, a fatal error
78such as not being able to resolve the hostname, failure to connect or a 89occurs, such as not being able to resolve the hostname, failure to connect
79read error. 90or a read error.
80 91
81The object will not be in a usable state when this callback has been 92The object will not be in a usable state when this callback has been
82called. 93called.
83 94
84On callback entrance, the value of C<$!> contains the opertaing system 95On callback entrance, the value of C<$!> contains the operating system
85error (or C<ENOSPC> or C<EPIPE>). 96error (or C<ENOSPC>, C<EPIPE>, C<ETIMEDOUT> or C<EBADMSG>).
86 97
87=item on_eof => $cb->($self) [MANDATORY] 98The callback should throw an exception. If it returns, then
99AnyEvent::Handle will C<croak> for you.
88 100
89Set the callback to be called on EOF. 101While not mandatory, it is I<highly> recommended to set this callback, as
102you will not be notified of errors otherwise. The default simply calls
103die.
90 104
91=item on_read => $cb->($self) 105=item on_read => $cb->($handle)
92 106
93This sets the default read callback, which is called when data arrives 107This sets the default read callback, which is called when data arrives
94and no read request is in the queue. If the read callback is C<undef> 108and no read request is in the queue.
95or has never been set, than AnyEvent::Handle will cease reading from the
96filehandle.
97 109
98To access (and remove data from) the read buffer, use the C<< ->rbuf >> 110To access (and remove data from) the read buffer, use the C<< ->rbuf >>
99method or acces sthe C<$self->{rbuf}> member directly. 111method or access the C<$handle->{rbuf}> member directly.
100 112
101When an EOF condition is detected then AnyEvent::Handle will first try to 113When an EOF condition is detected then AnyEvent::Handle will first try to
102feed all the remaining data to the queued callbacks and C<on_read> before 114feed all the remaining data to the queued callbacks and C<on_read> before
103calling the C<on_eof> callback. If no progress can be made, then a fatal 115calling the C<on_eof> callback. If no progress can be made, then a fatal
104error will be raised (with C<$!> set to C<EPIPE>). 116error will be raised (with C<$!> set to C<EPIPE>).
105 117
106=item on_drain => $cb->() 118=item on_drain => $cb->($handle)
107 119
108This sets the callback that is called when the write buffer becomes empty 120This sets the callback that is called when the write buffer becomes empty
109(or when the callback is set and the buffer is empty already). 121(or when the callback is set and the buffer is empty already).
110 122
111To append to the write buffer, use the C<< ->push_write >> method. 123To append to the write buffer, use the C<< ->push_write >> method.
124
125=item timeout => $fractional_seconds
126
127If non-zero, then this enables an "inactivity" timeout: whenever this many
128seconds pass without a successful read or write on the underlying file
129handle, the C<on_timeout> callback will be invoked (and if that one is
130missing, an C<ETIMEDOUT> error will be raised).
131
132Note that timeout processing is also active when you currently do not have
133any outstanding read or write requests: If you plan to keep the connection
134idle then you should disable the timout temporarily or ignore the timeout
135in the C<on_timeout> callback.
136
137Zero (the default) disables this timeout.
138
139=item on_timeout => $cb->($handle)
140
141Called whenever the inactivity timeout passes. If you return from this
142callback, then the timeout will be reset as if some activity had happened,
143so this condition is not fatal in any way.
112 144
113=item rbuf_max => <bytes> 145=item rbuf_max => <bytes>
114 146
115If defined, then a fatal error will be raised (with C<$!> set to C<ENOSPC>) 147If defined, then a fatal error will be raised (with C<$!> set to C<ENOSPC>)
116when the read buffer ever (strictly) exceeds this size. This is useful to 148when the read buffer ever (strictly) exceeds this size. This is useful to
123isn't finished). 155isn't finished).
124 156
125=item read_size => <bytes> 157=item read_size => <bytes>
126 158
127The default read block size (the amount of bytes this module will try to read 159The default read block size (the amount of bytes this module will try to read
128on each [loop iteration). Default: C<4096>. 160during each (loop iteration). Default: C<8192>.
129 161
130=item low_water_mark => <bytes> 162=item low_water_mark => <bytes>
131 163
132Sets the amount of bytes (default: C<0>) that make up an "empty" write 164Sets the amount of bytes (default: C<0>) that make up an "empty" write
133buffer: If the write reaches this size or gets even samller it is 165buffer: If the write reaches this size or gets even samller it is
134considered empty. 166considered empty.
135 167
168=item tls => "accept" | "connect" | Net::SSLeay::SSL object
169
170When this parameter is given, it enables TLS (SSL) mode, that means it
171will start making tls handshake and will transparently encrypt/decrypt
172data.
173
174TLS mode requires Net::SSLeay to be installed (it will be loaded
175automatically when you try to create a TLS handle).
176
177For the TLS server side, use C<accept>, and for the TLS client side of a
178connection, use C<connect> mode.
179
180You can also provide your own TLS connection object, but you have
181to make sure that you call either C<Net::SSLeay::set_connect_state>
182or C<Net::SSLeay::set_accept_state> on it before you pass it to
183AnyEvent::Handle.
184
185See the C<starttls> method if you need to start TLs negotiation later.
186
187=item tls_ctx => $ssl_ctx
188
189Use the given Net::SSLeay::CTX object to create the new TLS connection
190(unless a connection object was specified directly). If this parameter is
191missing, then AnyEvent::Handle will use C<AnyEvent::Handle::TLS_CTX>.
192
193=item json => JSON or JSON::XS object
194
195This is the json coder object used by the C<json> read and write types.
196
197If you don't supply it, then AnyEvent::Handle will create and use a
198suitable one, which will write and expect UTF-8 encoded JSON texts.
199
200Note that you are responsible to depend on the JSON module if you want to
201use this functionality, as AnyEvent does not have a dependency itself.
202
203=item filter_r => $cb
204
205=item filter_w => $cb
206
207These exist, but are undocumented at this time.
208
136=back 209=back
137 210
138=cut 211=cut
139 212
140sub new { 213sub new {
144 217
145 $self->{fh} or Carp::croak "mandatory argument fh is missing"; 218 $self->{fh} or Carp::croak "mandatory argument fh is missing";
146 219
147 AnyEvent::Util::fh_nonblocking $self->{fh}, 1; 220 AnyEvent::Util::fh_nonblocking $self->{fh}, 1;
148 221
149 $self->on_error ((delete $self->{on_error}) or Carp::croak "mandatory argument on_error is missing"); 222 if ($self->{tls}) {
150 $self->on_eof ((delete $self->{on_eof} ) or Carp::croak "mandatory argument on_eof is missing"); 223 require Net::SSLeay;
224 $self->starttls (delete $self->{tls}, delete $self->{tls_ctx});
225 }
151 226
227# $self->on_eof (delete $self->{on_eof} ) if $self->{on_eof}; # nop
228# $self->on_error (delete $self->{on_error}) if $self->{on_error}; # nop
229# $self->on_read (delete $self->{on_read} ) if $self->{on_read}; # nop
152 $self->on_drain (delete $self->{on_drain}) if $self->{on_drain}; 230 $self->on_drain (delete $self->{on_drain}) if $self->{on_drain};
153 $self->on_read (delete $self->{on_read} ) if $self->{on_read}; 231
232 $self->{_activity} = AnyEvent->now;
233 $self->_timeout;
234
235 $self->start_read;
154 236
155 $self 237 $self
156} 238}
157 239
158sub _shutdown { 240sub _shutdown {
159 my ($self) = @_; 241 my ($self) = @_;
160 242
243 delete $self->{_tw};
161 delete $self->{rw}; 244 delete $self->{_rw};
162 delete $self->{ww}; 245 delete $self->{_ww};
163 delete $self->{fh}; 246 delete $self->{fh};
164} 247}
165 248
166sub error { 249sub error {
167 my ($self) = @_; 250 my ($self) = @_;
169 { 252 {
170 local $!; 253 local $!;
171 $self->_shutdown; 254 $self->_shutdown;
172 } 255 }
173 256
174 $self->{on_error}($self); 257 $self->{on_error}($self)
258 if $self->{on_error};
259
260 Carp::croak "AnyEvent::Handle uncaught fatal error: $!";
175} 261}
176 262
177=item $fh = $handle->fh 263=item $fh = $handle->fh
178 264
179This method returns the filehandle of the L<AnyEvent::Handle> object. 265This method returns the file handle of the L<AnyEvent::Handle> object.
180 266
181=cut 267=cut
182 268
183sub fh { $_[0]->{fh} } 269sub fh { $_[0]{fh} }
184 270
185=item $handle->on_error ($cb) 271=item $handle->on_error ($cb)
186 272
187Replace the current C<on_error> callback (see the C<on_error> constructor argument). 273Replace the current C<on_error> callback (see the C<on_error> constructor argument).
188 274
200 286
201sub on_eof { 287sub on_eof {
202 $_[0]{on_eof} = $_[1]; 288 $_[0]{on_eof} = $_[1];
203} 289}
204 290
291=item $handle->on_timeout ($cb)
292
293Replace the current C<on_timeout> callback, or disables the callback
294(but not the timeout) if C<$cb> = C<undef>. See C<timeout> constructor
295argument.
296
297=cut
298
299sub on_timeout {
300 $_[0]{on_timeout} = $_[1];
301}
302
303#############################################################################
304
305=item $handle->timeout ($seconds)
306
307Configures (or disables) the inactivity timeout.
308
309=cut
310
311sub timeout {
312 my ($self, $timeout) = @_;
313
314 $self->{timeout} = $timeout;
315 $self->_timeout;
316}
317
318# reset the timeout watcher, as neccessary
319# also check for time-outs
320sub _timeout {
321 my ($self) = @_;
322
323 if ($self->{timeout}) {
324 my $NOW = AnyEvent->now;
325
326 # when would the timeout trigger?
327 my $after = $self->{_activity} + $self->{timeout} - $NOW;
328
329 # now or in the past already?
330 if ($after <= 0) {
331 $self->{_activity} = $NOW;
332
333 if ($self->{on_timeout}) {
334 $self->{on_timeout}($self);
335 } else {
336 $! = Errno::ETIMEDOUT;
337 $self->error;
338 }
339
340 # callbakx could have changed timeout value, optimise
341 return unless $self->{timeout};
342
343 # calculate new after
344 $after = $self->{timeout};
345 }
346
347 Scalar::Util::weaken $self;
348
349 $self->{_tw} ||= AnyEvent->timer (after => $after, cb => sub {
350 delete $self->{_tw};
351 $self->_timeout;
352 });
353 } else {
354 delete $self->{_tw};
355 }
356}
357
205############################################################################# 358#############################################################################
206 359
207=back 360=back
208 361
209=head2 WRITE QUEUE 362=head2 WRITE QUEUE
212for reading. 365for reading.
213 366
214The write queue is very simple: you can add data to its end, and 367The write queue is very simple: you can add data to its end, and
215AnyEvent::Handle will automatically try to get rid of it for you. 368AnyEvent::Handle will automatically try to get rid of it for you.
216 369
217When data could be writtena nd the write buffer is shorter then the low 370When data could be written and the write buffer is shorter then the low
218water mark, the C<on_drain> callback will be invoked. 371water mark, the C<on_drain> callback will be invoked.
219 372
220=over 4 373=over 4
221 374
222=item $handle->on_drain ($cb) 375=item $handle->on_drain ($cb)
241want (only limited by the available memory), as C<AnyEvent::Handle> 394want (only limited by the available memory), as C<AnyEvent::Handle>
242buffers it independently of the kernel. 395buffers it independently of the kernel.
243 396
244=cut 397=cut
245 398
246sub push_write { 399sub _drain_wbuf {
247 my ($self, $data) = @_; 400 my ($self) = @_;
248 401
249 $self->{wbuf} .= $data; 402 if (!$self->{_ww} && length $self->{wbuf}) {
250 403
251 unless ($self->{ww}) {
252 Scalar::Util::weaken $self; 404 Scalar::Util::weaken $self;
405
253 my $cb = sub { 406 my $cb = sub {
254 my $len = syswrite $self->{fh}, $self->{wbuf}; 407 my $len = syswrite $self->{fh}, $self->{wbuf};
255 408
256 if ($len > 0) { 409 if ($len >= 0) {
257 substr $self->{wbuf}, 0, $len, ""; 410 substr $self->{wbuf}, 0, $len, "";
258 411
412 $self->{_activity} = AnyEvent->now;
259 413
260 $self->{on_drain}($self) 414 $self->{on_drain}($self)
261 if $self->{low_water_mark} >= length $self->{wbuf} 415 if $self->{low_water_mark} >= length $self->{wbuf}
262 && $self->{on_drain}; 416 && $self->{on_drain};
263 417
264 delete $self->{ww} unless length $self->{wbuf}; 418 delete $self->{_ww} unless length $self->{wbuf};
265 } elsif ($! != EAGAIN && $! != EINTR) { 419 } elsif ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK) {
266 $self->error; 420 $self->error;
267 } 421 }
268 }; 422 };
269 423
424 # try to write data immediately
425 $cb->();
426
427 # if still data left in wbuf, we need to poll
270 $self->{ww} = AnyEvent->io (fh => $self->{fh}, poll => "w", cb => $cb); 428 $self->{_ww} = AnyEvent->io (fh => $self->{fh}, poll => "w", cb => $cb)
271 429 if length $self->{wbuf};
272 $cb->($self);
273 }; 430 };
274} 431}
432
433our %WH;
434
435sub register_write_type($$) {
436 $WH{$_[0]} = $_[1];
437}
438
439sub push_write {
440 my $self = shift;
441
442 if (@_ > 1) {
443 my $type = shift;
444
445 @_ = ($WH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::push_write")
446 ->($self, @_);
447 }
448
449 if ($self->{filter_w}) {
450 $self->{filter_w}($self, \$_[0]);
451 } else {
452 $self->{wbuf} .= $_[0];
453 $self->_drain_wbuf;
454 }
455}
456
457=item $handle->push_write (type => @args)
458
459=item $handle->unshift_write (type => @args)
460
461Instead of formatting your data yourself, you can also let this module do
462the job by specifying a type and type-specific arguments.
463
464Predefined types are (if you have ideas for additional types, feel free to
465drop by and tell us):
466
467=over 4
468
469=item netstring => $string
470
471Formats the given value as netstring
472(http://cr.yp.to/proto/netstrings.txt, this is not a recommendation to use them).
473
474=back
475
476=cut
477
478register_write_type netstring => sub {
479 my ($self, $string) = @_;
480
481 sprintf "%d:%s,", (length $string), $string
482};
483
484=item json => $array_or_hashref
485
486Encodes the given hash or array reference into a JSON object. Unless you
487provide your own JSON object, this means it will be encoded to JSON text
488in UTF-8.
489
490JSON objects (and arrays) are self-delimiting, so you can write JSON at
491one end of a handle and read them at the other end without using any
492additional framing.
493
494The generated JSON text is guaranteed not to contain any newlines: While
495this module doesn't need delimiters after or between JSON texts to be
496able to read them, many other languages depend on that.
497
498A simple RPC protocol that interoperates easily with others is to send
499JSON arrays (or objects, although arrays are usually the better choice as
500they mimic how function argument passing works) and a newline after each
501JSON text:
502
503 $handle->push_write (json => ["method", "arg1", "arg2"]); # whatever
504 $handle->push_write ("\012");
505
506An AnyEvent::Handle receiver would simply use the C<json> read type and
507rely on the fact that the newline will be skipped as leading whitespace:
508
509 $handle->push_read (json => sub { my $array = $_[1]; ... });
510
511Other languages could read single lines terminated by a newline and pass
512this line into their JSON decoder of choice.
513
514=cut
515
516register_write_type json => sub {
517 my ($self, $ref) = @_;
518
519 require JSON;
520
521 $self->{json} ? $self->{json}->encode ($ref)
522 : JSON::encode_json ($ref)
523};
524
525=item AnyEvent::Handle::register_write_type type => $coderef->($handle, @args)
526
527This function (not method) lets you add your own types to C<push_write>.
528Whenever the given C<type> is used, C<push_write> will invoke the code
529reference with the handle object and the remaining arguments.
530
531The code reference is supposed to return a single octet string that will
532be appended to the write buffer.
533
534Note that this is a function, and all types registered this way will be
535global, so try to use unique names.
536
537=cut
275 538
276############################################################################# 539#############################################################################
277 540
278=back 541=back
279 542
349 ... 612 ...
350 }); 613 });
351 614
352=over 4 615=over 4
353 616
617=cut
618
354sub _drain_rbuf { 619sub _drain_rbuf {
355 my ($self) = @_; 620 my ($self) = @_;
356 621
622 if (
623 defined $self->{rbuf_max}
624 && $self->{rbuf_max} < length $self->{rbuf}
625 ) {
626 $! = &Errno::ENOSPC;
627 $self->error;
628 }
629
357 return if exists $self->{in_drain}; 630 return if $self->{in_drain};
358 local $self->{in_drain} = 1; 631 local $self->{in_drain} = 1;
359 632
360 while (my $len = length $self->{rbuf}) { 633 while (my $len = length $self->{rbuf}) {
361 no strict 'refs'; 634 no strict 'refs';
362 if (@{ $self->{queue} }) { 635 if (my $cb = shift @{ $self->{_queue} }) {
363 if ($self->{queue}[0]($self)) { 636 unless ($cb->($self)) {
364 shift @{ $self->{queue} };
365 } elsif ($self->{eof}) { 637 if ($self->{_eof}) {
366 # no progress can be made (not enough data and no data forthcoming) 638 # no progress can be made (not enough data and no data forthcoming)
367 $! = &Errno::EPIPE; return $self->error; 639 $! = &Errno::EPIPE;
368 } else { 640 $self->error;
641 }
642
643 unshift @{ $self->{_queue} }, $cb;
369 return; 644 return;
370 } 645 }
371 } elsif ($self->{on_read}) { 646 } elsif ($self->{on_read}) {
372 $self->{on_read}($self); 647 $self->{on_read}($self);
373 648
374 if ( 649 if (
375 $self->{eof} # if no further data will arrive 650 $self->{_eof} # if no further data will arrive
376 && $len == length $self->{rbuf} # and no data has been consumed 651 && $len == length $self->{rbuf} # and no data has been consumed
377 && !@{ $self->{queue} } # and the queue is still empty 652 && !@{ $self->{_queue} } # and the queue is still empty
378 && $self->{on_read} # and we still want to read data 653 && $self->{on_read} # and we still want to read data
379 ) { 654 ) {
380 # then no progress can be made 655 # then no progress can be made
381 $! = &Errno::EPIPE; return $self->error; 656 $! = &Errno::EPIPE;
657 $self->error;
382 } 658 }
383 } else { 659 } else {
384 # read side becomes idle 660 # read side becomes idle
385 delete $self->{rw}; 661 delete $self->{_rw};
386 return; 662 return;
387 } 663 }
388 } 664 }
389 665
390 if ($self->{eof}) {
391 $self->_shutdown;
392 $self->{on_eof}($self); 666 $self->{on_eof}($self)
393 } 667 if $self->{_eof} && $self->{on_eof};
394} 668}
395 669
396=item $handle->on_read ($cb) 670=item $handle->on_read ($cb)
397 671
398This replaces the currently set C<on_read> callback, or clears it (when 672This replaces the currently set C<on_read> callback, or clears it (when
403 677
404sub on_read { 678sub on_read {
405 my ($self, $cb) = @_; 679 my ($self, $cb) = @_;
406 680
407 $self->{on_read} = $cb; 681 $self->{on_read} = $cb;
408
409 unless ($self->{rw} || $self->{eof}) {
410 Scalar::Util::weaken $self;
411
412 $self->{rw} = AnyEvent->io (fh => $self->{fh}, poll => "r", cb => sub {
413 my $len = sysread $self->{fh}, $self->{rbuf}, $self->{read_size} || 8192, length $self->{rbuf};
414
415 if ($len > 0) {
416 if (exists $self->{rbuf_max}) {
417 if ($self->{rbuf_max} < length $self->{rbuf}) {
418 $! = &Errno::ENOSPC; return $self->error;
419 }
420 }
421
422 } elsif (defined $len) {
423 $self->{eof} = 1;
424 delete $self->{rw};
425
426 } elsif ($! != EAGAIN && $! != EINTR) {
427 return $self->error;
428 }
429
430 $self->_drain_rbuf;
431 });
432 }
433} 682}
434 683
435=item $handle->rbuf 684=item $handle->rbuf
436 685
437Returns the read buffer (as a modifiable lvalue). 686Returns the read buffer (as a modifiable lvalue).
456Append the given callback to the end of the queue (C<push_read>) or 705Append the given callback to the end of the queue (C<push_read>) or
457prepend it (C<unshift_read>). 706prepend it (C<unshift_read>).
458 707
459The callback is called each time some additional read data arrives. 708The callback is called each time some additional read data arrives.
460 709
461It must check wether enough data is in the read buffer already. 710It must check whether enough data is in the read buffer already.
462 711
463If not enough data is available, it must return the empty list or a false 712If not enough data is available, it must return the empty list or a false
464value, in which case it will be called repeatedly until enough data is 713value, in which case it will be called repeatedly until enough data is
465available (or an error condition is detected). 714available (or an error condition is detected).
466 715
468interested in (which can be none at all) and return a true value. After returning 717interested in (which can be none at all) and return a true value. After returning
469true, it will be removed from the queue. 718true, it will be removed from the queue.
470 719
471=cut 720=cut
472 721
722our %RH;
723
724sub register_read_type($$) {
725 $RH{$_[0]} = $_[1];
726}
727
473sub push_read { 728sub push_read {
474 my ($self, $cb) = @_; 729 my $self = shift;
730 my $cb = pop;
475 731
732 if (@_) {
733 my $type = shift;
734
735 $cb = ($RH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::push_read")
736 ->($self, $cb, @_);
737 }
738
476 push @{ $self->{queue} }, $cb; 739 push @{ $self->{_queue} }, $cb;
477 $self->_drain_rbuf; 740 $self->_drain_rbuf;
478} 741}
479 742
480sub unshift_read { 743sub unshift_read {
481 my ($self, $cb) = @_; 744 my $self = shift;
745 my $cb = pop;
482 746
747 if (@_) {
748 my $type = shift;
749
750 $cb = ($RH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::unshift_read")
751 ->($self, $cb, @_);
752 }
753
754
483 push @{ $self->{queue} }, $cb; 755 unshift @{ $self->{_queue} }, $cb;
484 $self->_drain_rbuf; 756 $self->_drain_rbuf;
485} 757}
486 758
487=item $handle->push_read_chunk ($len, $cb->($self, $data)) 759=item $handle->push_read (type => @args, $cb)
488 760
489=item $handle->unshift_read_chunk ($len, $cb->($self, $data)) 761=item $handle->unshift_read (type => @args, $cb)
490 762
491Append the given callback to the end of the queue (C<push_read_chunk>) or 763Instead of providing a callback that parses the data itself you can chose
492prepend it (C<unshift_read_chunk>). 764between a number of predefined parsing formats, for chunks of data, lines
765etc.
493 766
494The callback will be called only once C<$len> bytes have been read, and 767Predefined types are (if you have ideas for additional types, feel free to
495these C<$len> bytes will be passed to the callback. 768drop by and tell us):
496 769
497=cut 770=over 4
498 771
499sub _read_chunk($$) { 772=item chunk => $octets, $cb->($handle, $data)
500 my ($len, $cb) = @_; 773
774Invoke the callback only once C<$octets> bytes have been read. Pass the
775data read to the callback. The callback will never be called with less
776data.
777
778Example: read 2 bytes.
779
780 $handle->push_read (chunk => 2, sub {
781 warn "yay ", unpack "H*", $_[1];
782 });
783
784=cut
785
786register_read_type chunk => sub {
787 my ($self, $cb, $len) = @_;
501 788
502 sub { 789 sub {
503 $len <= length $_[0]{rbuf} or return; 790 $len <= length $_[0]{rbuf} or return;
504 $cb->($_[0], substr $_[0]{rbuf}, 0, $len, ""); 791 $cb->($_[0], substr $_[0]{rbuf}, 0, $len, "");
505 1 792 1
506 } 793 }
507} 794};
508 795
796# compatibility with older API
509sub push_read_chunk { 797sub push_read_chunk {
510 my ($self, $len, $cb) = @_; 798 $_[0]->push_read (chunk => $_[1], $_[2]);
511
512 $self->push_read (_read_chunk $len, $cb);
513} 799}
514
515 800
516sub unshift_read_chunk { 801sub unshift_read_chunk {
517 my ($self, $len, $cb) = @_; 802 $_[0]->unshift_read (chunk => $_[1], $_[2]);
518
519 $self->unshift_read (_read_chunk $len, $cb);
520} 803}
521 804
522=item $handle->push_read_line ([$eol, ]$cb->($self, $line, $eol)) 805=item line => [$eol, ]$cb->($handle, $line, $eol)
523
524=item $handle->unshift_read_line ([$eol, ]$cb->($self, $line, $eol))
525
526Append the given callback to the end of the queue (C<push_read_line>) or
527prepend it (C<unshift_read_line>).
528 806
529The callback will be called only once a full line (including the end of 807The callback will be called only once a full line (including the end of
530line marker, C<$eol>) has been read. This line (excluding the end of line 808line marker, C<$eol>) has been read. This line (excluding the end of line
531marker) will be passed to the callback as second argument (C<$line>), and 809marker) will be passed to the callback as second argument (C<$line>), and
532the end of line marker as the third argument (C<$eol>). 810the end of line marker as the third argument (C<$eol>).
543Partial lines at the end of the stream will never be returned, as they are 821Partial lines at the end of the stream will never be returned, as they are
544not marked by the end of line marker. 822not marked by the end of line marker.
545 823
546=cut 824=cut
547 825
548sub _read_line($$) { 826register_read_type line => sub {
549 my $cb = pop; 827 my ($self, $cb, $eol) = @_;
550 my $eol = @_ ? shift : qr|(\015?\012)|;
551 my $pos;
552 828
829 $eol = qr|(\015?\012)| if @_ < 3;
553 $eol = qr|(\Q$eol\E)| unless ref $eol; 830 $eol = quotemeta $eol unless ref $eol;
554 $eol = qr|^(.*?)($eol)|; 831 $eol = qr|^(.*?)($eol)|s;
555 832
556 sub { 833 sub {
557 $_[0]{rbuf} =~ s/$eol// or return; 834 $_[0]{rbuf} =~ s/$eol// or return;
558 835
559 $cb->($1, $2); 836 $cb->($_[0], $1, $2);
560 1 837 1
561 } 838 }
562} 839};
563 840
841# compatibility with older API
564sub push_read_line { 842sub push_read_line {
565 my $self = shift; 843 my $self = shift;
566
567 $self->push_read (&_read_line); 844 $self->push_read (line => @_);
568} 845}
569 846
570sub unshift_read_line { 847sub unshift_read_line {
571 my $self = shift; 848 my $self = shift;
572
573 $self->unshift_read (&_read_line); 849 $self->unshift_read (line => @_);
574} 850}
851
852=item netstring => $cb->($handle, $string)
853
854A netstring (http://cr.yp.to/proto/netstrings.txt, this is not an endorsement).
855
856Throws an error with C<$!> set to EBADMSG on format violations.
857
858=cut
859
860register_read_type netstring => sub {
861 my ($self, $cb) = @_;
862
863 sub {
864 unless ($_[0]{rbuf} =~ s/^(0|[1-9][0-9]*)://) {
865 if ($_[0]{rbuf} =~ /[^0-9]/) {
866 $! = &Errno::EBADMSG;
867 $self->error;
868 }
869 return;
870 }
871
872 my $len = $1;
873
874 $self->unshift_read (chunk => $len, sub {
875 my $string = $_[1];
876 $_[0]->unshift_read (chunk => 1, sub {
877 if ($_[1] eq ",") {
878 $cb->($_[0], $string);
879 } else {
880 $! = &Errno::EBADMSG;
881 $self->error;
882 }
883 });
884 });
885
886 1
887 }
888};
889
890=item regex => $accept[, $reject[, $skip], $cb->($handle, $data)
891
892Makes a regex match against the regex object C<$accept> and returns
893everything up to and including the match.
894
895Example: read a single line terminated by '\n'.
896
897 $handle->push_read (regex => qr<\n>, sub { ... });
898
899If C<$reject> is given and not undef, then it determines when the data is
900to be rejected: it is matched against the data when the C<$accept> regex
901does not match and generates an C<EBADMSG> error when it matches. This is
902useful to quickly reject wrong data (to avoid waiting for a timeout or a
903receive buffer overflow).
904
905Example: expect a single decimal number followed by whitespace, reject
906anything else (not the use of an anchor).
907
908 $handle->push_read (regex => qr<^[0-9]+\s>, qr<[^0-9]>, sub { ... });
909
910If C<$skip> is given and not C<undef>, then it will be matched against
911the receive buffer when neither C<$accept> nor C<$reject> match,
912and everything preceding and including the match will be accepted
913unconditionally. This is useful to skip large amounts of data that you
914know cannot be matched, so that the C<$accept> or C<$reject> regex do not
915have to start matching from the beginning. This is purely an optimisation
916and is usually worth only when you expect more than a few kilobytes.
917
918Example: expect a http header, which ends at C<\015\012\015\012>. Since we
919expect the header to be very large (it isn't in practise, but...), we use
920a skip regex to skip initial portions. The skip regex is tricky in that
921it only accepts something not ending in either \015 or \012, as these are
922required for the accept regex.
923
924 $handle->push_read (regex =>
925 qr<\015\012\015\012>,
926 undef, # no reject
927 qr<^.*[^\015\012]>,
928 sub { ... });
929
930=cut
931
932register_read_type regex => sub {
933 my ($self, $cb, $accept, $reject, $skip) = @_;
934
935 my $data;
936 my $rbuf = \$self->{rbuf};
937
938 sub {
939 # accept
940 if ($$rbuf =~ $accept) {
941 $data .= substr $$rbuf, 0, $+[0], "";
942 $cb->($self, $data);
943 return 1;
944 }
945
946 # reject
947 if ($reject && $$rbuf =~ $reject) {
948 $! = &Errno::EBADMSG;
949 $self->error;
950 }
951
952 # skip
953 if ($skip && $$rbuf =~ $skip) {
954 $data .= substr $$rbuf, 0, $+[0], "";
955 }
956
957 ()
958 }
959};
960
961=item json => $cb->($handle, $hash_or_arrayref)
962
963Reads a JSON object or array, decodes it and passes it to the callback.
964
965If a C<json> object was passed to the constructor, then that will be used
966for the final decode, otherwise it will create a JSON coder expecting UTF-8.
967
968This read type uses the incremental parser available with JSON version
9692.09 (and JSON::XS version 2.2) and above. You have to provide a
970dependency on your own: this module will load the JSON module, but
971AnyEvent does not depend on it itself.
972
973Since JSON texts are fully self-delimiting, the C<json> read and write
974types are an ideal simple RPC protocol: just exchange JSON datagrams. See
975the C<json> write type description, above, for an actual example.
976
977=cut
978
979register_read_type json => sub {
980 my ($self, $cb, $accept, $reject, $skip) = @_;
981
982 require JSON;
983
984 my $data;
985 my $rbuf = \$self->{rbuf};
986
987 my $json = $self->{json} ||= JSON->new->utf8;
988
989 sub {
990 my $ref = $json->incr_parse ($self->{rbuf});
991
992 if ($ref) {
993 $self->{rbuf} = $json->incr_text;
994 $json->incr_text = "";
995 $cb->($self, $ref);
996
997 1
998 } else {
999 $self->{rbuf} = "";
1000 ()
1001 }
1002 }
1003};
575 1004
576=back 1005=back
577 1006
1007=item AnyEvent::Handle::register_read_type type => $coderef->($handle, $cb, @args)
1008
1009This function (not method) lets you add your own types to C<push_read>.
1010
1011Whenever the given C<type> is used, C<push_read> will invoke the code
1012reference with the handle object, the callback and the remaining
1013arguments.
1014
1015The code reference is supposed to return a callback (usually a closure)
1016that works as a plain read callback (see C<< ->push_read ($cb) >>).
1017
1018It should invoke the passed callback when it is done reading (remember to
1019pass C<$handle> as first argument as all other callbacks do that).
1020
1021Note that this is a function, and all types registered this way will be
1022global, so try to use unique names.
1023
1024For examples, see the source of this module (F<perldoc -m AnyEvent::Handle>,
1025search for C<register_read_type>)).
1026
1027=item $handle->stop_read
1028
1029=item $handle->start_read
1030
1031In rare cases you actually do not want to read anything from the
1032socket. In this case you can call C<stop_read>. Neither C<on_read> no
1033any queued callbacks will be executed then. To start reading again, call
1034C<start_read>.
1035
1036=cut
1037
1038sub stop_read {
1039 my ($self) = @_;
1040
1041 delete $self->{_rw};
1042}
1043
1044sub start_read {
1045 my ($self) = @_;
1046
1047 unless ($self->{_rw} || $self->{_eof}) {
1048 Scalar::Util::weaken $self;
1049
1050 $self->{_rw} = AnyEvent->io (fh => $self->{fh}, poll => "r", cb => sub {
1051 my $rbuf = $self->{filter_r} ? \my $buf : \$self->{rbuf};
1052 my $len = sysread $self->{fh}, $$rbuf, $self->{read_size} || 8192, length $$rbuf;
1053
1054 if ($len > 0) {
1055 $self->{_activity} = AnyEvent->now;
1056
1057 $self->{filter_r}
1058 ? $self->{filter_r}($self, $rbuf)
1059 : $self->_drain_rbuf;
1060
1061 } elsif (defined $len) {
1062 delete $self->{_rw};
1063 $self->{_eof} = 1;
1064 $self->_drain_rbuf;
1065
1066 } elsif ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK) {
1067 return $self->error;
1068 }
1069 });
1070 }
1071}
1072
1073sub _dotls {
1074 my ($self) = @_;
1075
1076 if (length $self->{_tls_wbuf}) {
1077 while ((my $len = Net::SSLeay::write ($self->{tls}, $self->{_tls_wbuf})) > 0) {
1078 substr $self->{_tls_wbuf}, 0, $len, "";
1079 }
1080 }
1081
1082 if (defined (my $buf = Net::SSLeay::BIO_read ($self->{_wbio}))) {
1083 $self->{wbuf} .= $buf;
1084 $self->_drain_wbuf;
1085 }
1086
1087 while (defined (my $buf = Net::SSLeay::read ($self->{tls}))) {
1088 $self->{rbuf} .= $buf;
1089 $self->_drain_rbuf;
1090 }
1091
1092 my $err = Net::SSLeay::get_error ($self->{tls}, -1);
1093
1094 if ($err!= Net::SSLeay::ERROR_WANT_READ ()) {
1095 if ($err == Net::SSLeay::ERROR_SYSCALL ()) {
1096 $self->error;
1097 } elsif ($err == Net::SSLeay::ERROR_SSL ()) {
1098 $! = &Errno::EIO;
1099 $self->error;
1100 }
1101
1102 # all others are fine for our purposes
1103 }
1104}
1105
1106=item $handle->starttls ($tls[, $tls_ctx])
1107
1108Instead of starting TLS negotiation immediately when the AnyEvent::Handle
1109object is created, you can also do that at a later time by calling
1110C<starttls>.
1111
1112The first argument is the same as the C<tls> constructor argument (either
1113C<"connect">, C<"accept"> or an existing Net::SSLeay object).
1114
1115The second argument is the optional C<Net::SSLeay::CTX> object that is
1116used when AnyEvent::Handle has to create its own TLS connection object.
1117
1118The TLS connection object will end up in C<< $handle->{tls} >> after this
1119call and can be used or changed to your liking. Note that the handshake
1120might have already started when this function returns.
1121
1122=cut
1123
1124sub starttls {
1125 my ($self, $ssl, $ctx) = @_;
1126
1127 $self->stoptls;
1128
1129 if ($ssl eq "accept") {
1130 $ssl = Net::SSLeay::new ($ctx || TLS_CTX ());
1131 Net::SSLeay::set_accept_state ($ssl);
1132 } elsif ($ssl eq "connect") {
1133 $ssl = Net::SSLeay::new ($ctx || TLS_CTX ());
1134 Net::SSLeay::set_connect_state ($ssl);
1135 }
1136
1137 $self->{tls} = $ssl;
1138
1139 # basically, this is deep magic (because SSL_read should have the same issues)
1140 # but the openssl maintainers basically said: "trust us, it just works".
1141 # (unfortunately, we have to hardcode constants because the abysmally misdesigned
1142 # and mismaintained ssleay-module doesn't even offer them).
1143 # http://www.mail-archive.com/openssl-dev@openssl.org/msg22420.html
1144 Net::SSLeay::CTX_set_mode ($self->{tls},
1145 (eval { local $SIG{__DIE__}; Net::SSLeay::MODE_ENABLE_PARTIAL_WRITE () } || 1)
1146 | (eval { local $SIG{__DIE__}; Net::SSLeay::MODE_ACCEPT_MOVING_WRITE_BUFFER () } || 2));
1147
1148 $self->{_rbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ());
1149 $self->{_wbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ());
1150
1151 Net::SSLeay::set_bio ($ssl, $self->{_rbio}, $self->{_wbio});
1152
1153 $self->{filter_w} = sub {
1154 $_[0]{_tls_wbuf} .= ${$_[1]};
1155 &_dotls;
1156 };
1157 $self->{filter_r} = sub {
1158 Net::SSLeay::BIO_write ($_[0]{_rbio}, ${$_[1]});
1159 &_dotls;
1160 };
1161}
1162
1163=item $handle->stoptls
1164
1165Destroys the SSL connection, if any. Partial read or write data will be
1166lost.
1167
1168=cut
1169
1170sub stoptls {
1171 my ($self) = @_;
1172
1173 Net::SSLeay::free (delete $self->{tls}) if $self->{tls};
1174
1175 delete $self->{_rbio};
1176 delete $self->{_wbio};
1177 delete $self->{_tls_wbuf};
1178 delete $self->{filter_r};
1179 delete $self->{filter_w};
1180}
1181
1182sub DESTROY {
1183 my $self = shift;
1184
1185 $self->stoptls;
1186}
1187
1188=item AnyEvent::Handle::TLS_CTX
1189
1190This function creates and returns the Net::SSLeay::CTX object used by
1191default for TLS mode.
1192
1193The context is created like this:
1194
1195 Net::SSLeay::load_error_strings;
1196 Net::SSLeay::SSLeay_add_ssl_algorithms;
1197 Net::SSLeay::randomize;
1198
1199 my $CTX = Net::SSLeay::CTX_new;
1200
1201 Net::SSLeay::CTX_set_options $CTX, Net::SSLeay::OP_ALL
1202
1203=cut
1204
1205our $TLS_CTX;
1206
1207sub TLS_CTX() {
1208 $TLS_CTX || do {
1209 require Net::SSLeay;
1210
1211 Net::SSLeay::load_error_strings ();
1212 Net::SSLeay::SSLeay_add_ssl_algorithms ();
1213 Net::SSLeay::randomize ();
1214
1215 $TLS_CTX = Net::SSLeay::CTX_new ();
1216
1217 Net::SSLeay::CTX_set_options ($TLS_CTX, Net::SSLeay::OP_ALL ());
1218
1219 $TLS_CTX
1220 }
1221}
1222
1223=back
1224
1225=head1 SUBCLASSING AnyEvent::Handle
1226
1227In many cases, you might want to subclass AnyEvent::Handle.
1228
1229To make this easier, a given version of AnyEvent::Handle uses these
1230conventions:
1231
1232=over 4
1233
1234=item * all constructor arguments become object members.
1235
1236At least initially, when you pass a C<tls>-argument to the constructor it
1237will end up in C<< $handle->{tls} >>. Those members might be changes or
1238mutated later on (for example C<tls> will hold the TLS connection object).
1239
1240=item * other object member names are prefixed with an C<_>.
1241
1242All object members not explicitly documented (internal use) are prefixed
1243with an underscore character, so the remaining non-C<_>-namespace is free
1244for use for subclasses.
1245
1246=item * all members not documented here and not prefixed with an underscore
1247are free to use in subclasses.
1248
1249Of course, new versions of AnyEvent::Handle may introduce more "public"
1250member variables, but thats just life, at least it is documented.
1251
1252=back
1253
578=head1 AUTHOR 1254=head1 AUTHOR
579 1255
580Robin Redeker C<< <elmex at ta-sa.org> >>, Marc Lehmann <schmorp@schmorp.de>. 1256Robin Redeker C<< <elmex at ta-sa.org> >>, Marc Lehmann <schmorp@schmorp.de>.
581 1257
582=cut 1258=cut

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines