ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent/Handle.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent/Handle.pm (file contents):
Revision 1.84 by root, Thu Aug 21 19:13:05 2008 UTC vs.
Revision 1.159 by root, Fri Jul 24 12:35:58 2009 UTC

1package AnyEvent::Handle; 1package AnyEvent::Handle;
2 2
3no warnings;
4use strict qw(subs vars);
5
6use AnyEvent ();
7use AnyEvent::Util qw(WSAEWOULDBLOCK);
8use Scalar::Util (); 3use Scalar::Util ();
9use Carp (); 4use Carp ();
10use Fcntl ();
11use Errno qw(EAGAIN EINTR); 5use Errno qw(EAGAIN EINTR);
12 6
7use AnyEvent (); BEGIN { AnyEvent::common_sense }
8use AnyEvent::Util qw(WSAEWOULDBLOCK);
9
13=head1 NAME 10=head1 NAME
14 11
15AnyEvent::Handle - non-blocking I/O on file handles via AnyEvent 12AnyEvent::Handle - non-blocking I/O on file handles via AnyEvent
16 13
17=cut 14=cut
18 15
19our $VERSION = 4.232; 16our $VERSION = 4.86;
20 17
21=head1 SYNOPSIS 18=head1 SYNOPSIS
22 19
23 use AnyEvent; 20 use AnyEvent;
24 use AnyEvent::Handle; 21 use AnyEvent::Handle;
25 22
26 my $cv = AnyEvent->condvar; 23 my $cv = AnyEvent->condvar;
27 24
28 my $handle = 25 my $hdl; $hdl = new AnyEvent::Handle
29 AnyEvent::Handle->new (
30 fh => \*STDIN, 26 fh => \*STDIN,
31 on_eof => sub { 27 on_error => sub {
32 $cv->broadcast; 28 my ($hdl, $fatal, $msg) = @_;
33 }, 29 warn "got error $msg\n";
30 $hdl->destroy;
31 $cv->send;
34 ); 32 );
35 33
36 # send some request line 34 # send some request line
37 $handle->push_write ("getinfo\015\012"); 35 $hdl->push_write ("getinfo\015\012");
38 36
39 # read the response line 37 # read the response line
40 $handle->push_read (line => sub { 38 $hdl->push_read (line => sub {
41 my ($handle, $line) = @_; 39 my ($hdl, $line) = @_;
42 warn "read line <$line>\n"; 40 warn "got line <$line>\n";
43 $cv->send; 41 $cv->send;
44 }); 42 });
45 43
46 $cv->recv; 44 $cv->recv;
47 45
48=head1 DESCRIPTION 46=head1 DESCRIPTION
49 47
50This module is a helper module to make it easier to do event-based I/O on 48This module is a helper module to make it easier to do event-based I/O on
51filehandles. For utility functions for doing non-blocking connects and accepts 49filehandles.
52on sockets see L<AnyEvent::Util>.
53 50
54The L<AnyEvent::Intro> tutorial contains some well-documented 51The L<AnyEvent::Intro> tutorial contains some well-documented
55AnyEvent::Handle examples. 52AnyEvent::Handle examples.
56 53
57In the following, when the documentation refers to of "bytes" then this 54In the following, when the documentation refers to of "bytes" then this
58means characters. As sysread and syswrite are used for all I/O, their 55means characters. As sysread and syswrite are used for all I/O, their
59treatment of characters applies to this module as well. 56treatment of characters applies to this module as well.
60 57
58At the very minimum, you should specify C<fh> or C<connect>, and the
59C<on_error> callback.
60
61All callbacks will be invoked with the handle object as their first 61All callbacks will be invoked with the handle object as their first
62argument. 62argument.
63 63
64=head1 METHODS 64=head1 METHODS
65 65
66=over 4 66=over 4
67 67
68=item B<new (%args)> 68=item $handle = B<new> AnyEvent::TLS fh => $filehandle, key => value...
69 69
70The constructor supports these arguments (all as key => value pairs). 70The constructor supports these arguments (all as C<< key => value >> pairs).
71 71
72=over 4 72=over 4
73 73
74=item fh => $filehandle [MANDATORY] 74=item fh => $filehandle [C<fh> or C<connect> MANDATORY]
75 75
76The filehandle this L<AnyEvent::Handle> object will operate on. 76The filehandle this L<AnyEvent::Handle> object will operate on.
77
78NOTE: The filehandle will be set to non-blocking mode (using 77NOTE: The filehandle will be set to non-blocking mode (using
79C<AnyEvent::Util::fh_nonblocking>) by the constructor and needs to stay in 78C<AnyEvent::Util::fh_nonblocking>) by the constructor and needs to stay in
80that mode. 79that mode.
81 80
81=item connect => [$host, $service] [C<fh> or C<connect> MANDATORY]
82
83Try to connect to the specified host and service (port), using
84C<AnyEvent::Socket::tcp_connect>. The C<$host> additionally becomes the
85default C<peername>.
86
87You have to specify either this parameter, or C<fh>, above.
88
89When this parameter is specified, then the C<on_prepare>,
90C<on_connect_error> and C<on_connect> callbacks will be called under the
91appropriate circumstances:
92
93=over 4
94
82=item on_eof => $cb->($handle) 95=item on_prepare => $cb->($handle)
83 96
84Set the callback to be called when an end-of-file condition is detected, 97This (rarely used) callback is called before a new connection is
85i.e. in the case of a socket, when the other side has closed the 98attempted, but after the file handle has been created. It could be used to
86connection cleanly. 99prepare the file handle with parameters required for the actual connect
100(as opposed to settings that can be changed when the connection is already
101established).
87 102
88For sockets, this just means that the other side has stopped sending data, 103=item on_connect => $cb->($handle, $host, $port, $retry->())
89you can still try to write data, and, in fact, one can return from the eof
90callback and continue writing data, as only the read part has been shut
91down.
92 104
93While not mandatory, it is I<highly> recommended to set an eof callback, 105This callback is called when a connection has been successfully established.
94otherwise you might end up with a closed socket while you are still
95waiting for data.
96 106
97If an EOF condition has been detected but no C<on_eof> callback has been 107The actual numeric host and port (the socket peername) are passed as
98set, then a fatal error will be raised with C<$!> set to <0>. 108parameters, together with a retry callback.
99 109
110When, for some reason, the handle is not acceptable, then calling
111C<$retry> will continue with the next conenction target (in case of
112multi-homed hosts or SRV records there can be multiple connection
113endpoints). When it is called then the read and write queues, eof status,
114tls status and similar properties of the handle are being reset.
115
116In most cases, ignoring the C<$retry> parameter is the way to go.
117
118=item on_connect_error => $cb->($handle, $message)
119
120This callback is called when the conenction could not be
121established. C<$!> will contain the relevant error code, and C<$message> a
122message describing it (usually the same as C<"$!">).
123
124If this callback isn't specified, then C<on_error> will be called with a
125fatal error instead.
126
127=back
128
100=item on_error => $cb->($handle, $fatal) 129=item on_error => $cb->($handle, $fatal, $message)
101 130
102This is the error callback, which is called when, well, some error 131This is the error callback, which is called when, well, some error
103occured, such as not being able to resolve the hostname, failure to 132occured, such as not being able to resolve the hostname, failure to
104connect or a read error. 133connect or a read error.
105 134
106Some errors are fatal (which is indicated by C<$fatal> being true). On 135Some errors are fatal (which is indicated by C<$fatal> being true). On
107fatal errors the handle object will be shut down and will not be usable 136fatal errors the handle object will be destroyed (by a call to C<< ->
108(but you are free to look at the current C< ->rbuf >). Examples of fatal 137destroy >>) after invoking the error callback (which means you are free to
109errors are an EOF condition with active (but unsatisifable) read watchers 138examine the handle object). Examples of fatal errors are an EOF condition
110(C<EPIPE>) or I/O errors. 139with active (but unsatisifable) read watchers (C<EPIPE>) or I/O errors. In
140cases where the other side can close the connection at their will it is
141often easiest to not report C<EPIPE> errors in this callback.
142
143AnyEvent::Handle tries to find an appropriate error code for you to check
144against, but in some cases (TLS errors), this does not work well. It is
145recommended to always output the C<$message> argument in human-readable
146error messages (it's usually the same as C<"$!">).
111 147
112Non-fatal errors can be retried by simply returning, but it is recommended 148Non-fatal errors can be retried by simply returning, but it is recommended
113to simply ignore this parameter and instead abondon the handle object 149to simply ignore this parameter and instead abondon the handle object
114when this callback is invoked. Examples of non-fatal errors are timeouts 150when this callback is invoked. Examples of non-fatal errors are timeouts
115C<ETIMEDOUT>) or badly-formatted data (C<EBADMSG>). 151C<ETIMEDOUT>) or badly-formatted data (C<EBADMSG>).
116 152
117On callback entrance, the value of C<$!> contains the operating system 153On callback entrance, the value of C<$!> contains the operating system
118error (or C<ENOSPC>, C<EPIPE>, C<ETIMEDOUT> or C<EBADMSG>). 154error code (or C<ENOSPC>, C<EPIPE>, C<ETIMEDOUT>, C<EBADMSG> or
155C<EPROTO>).
119 156
120While not mandatory, it is I<highly> recommended to set this callback, as 157While not mandatory, it is I<highly> recommended to set this callback, as
121you will not be notified of errors otherwise. The default simply calls 158you will not be notified of errors otherwise. The default simply calls
122C<croak>. 159C<croak>.
123 160
127and no read request is in the queue (unlike read queue callbacks, this 164and no read request is in the queue (unlike read queue callbacks, this
128callback will only be called when at least one octet of data is in the 165callback will only be called when at least one octet of data is in the
129read buffer). 166read buffer).
130 167
131To access (and remove data from) the read buffer, use the C<< ->rbuf >> 168To access (and remove data from) the read buffer, use the C<< ->rbuf >>
132method or access the C<$handle->{rbuf}> member directly. 169method or access the C<< $handle->{rbuf} >> member directly. Note that you
170must not enlarge or modify the read buffer, you can only remove data at
171the beginning from it.
133 172
134When an EOF condition is detected then AnyEvent::Handle will first try to 173When an EOF condition is detected then AnyEvent::Handle will first try to
135feed all the remaining data to the queued callbacks and C<on_read> before 174feed all the remaining data to the queued callbacks and C<on_read> before
136calling the C<on_eof> callback. If no progress can be made, then a fatal 175calling the C<on_eof> callback. If no progress can be made, then a fatal
137error will be raised (with C<$!> set to C<EPIPE>). 176error will be raised (with C<$!> set to C<EPIPE>).
177
178Note that, unlike requests in the read queue, an C<on_read> callback
179doesn't mean you I<require> some data: if there is an EOF and there
180are outstanding read requests then an error will be flagged. With an
181C<on_read> callback, the C<on_eof> callback will be invoked.
182
183=item on_eof => $cb->($handle)
184
185Set the callback to be called when an end-of-file condition is detected,
186i.e. in the case of a socket, when the other side has closed the
187connection cleanly, and there are no outstanding read requests in the
188queue (if there are read requests, then an EOF counts as an unexpected
189connection close and will be flagged as an error).
190
191For sockets, this just means that the other side has stopped sending data,
192you can still try to write data, and, in fact, one can return from the EOF
193callback and continue writing data, as only the read part has been shut
194down.
195
196If an EOF condition has been detected but no C<on_eof> callback has been
197set, then a fatal error will be raised with C<$!> set to <0>.
138 198
139=item on_drain => $cb->($handle) 199=item on_drain => $cb->($handle)
140 200
141This sets the callback that is called when the write buffer becomes empty 201This sets the callback that is called when the write buffer becomes empty
142(or when the callback is set and the buffer is empty already). 202(or when the callback is set and the buffer is empty already).
152=item timeout => $fractional_seconds 212=item timeout => $fractional_seconds
153 213
154If non-zero, then this enables an "inactivity" timeout: whenever this many 214If non-zero, then this enables an "inactivity" timeout: whenever this many
155seconds pass without a successful read or write on the underlying file 215seconds pass without a successful read or write on the underlying file
156handle, the C<on_timeout> callback will be invoked (and if that one is 216handle, the C<on_timeout> callback will be invoked (and if that one is
157missing, an C<ETIMEDOUT> error will be raised). 217missing, a non-fatal C<ETIMEDOUT> error will be raised).
158 218
159Note that timeout processing is also active when you currently do not have 219Note that timeout processing is also active when you currently do not have
160any outstanding read or write requests: If you plan to keep the connection 220any outstanding read or write requests: If you plan to keep the connection
161idle then you should disable the timout temporarily or ignore the timeout 221idle then you should disable the timout temporarily or ignore the timeout
162in the C<on_timeout> callback. 222in the C<on_timeout> callback, in which case AnyEvent::Handle will simply
223restart the timeout.
163 224
164Zero (the default) disables this timeout. 225Zero (the default) disables this timeout.
165 226
166=item on_timeout => $cb->($handle) 227=item on_timeout => $cb->($handle)
167 228
171 232
172=item rbuf_max => <bytes> 233=item rbuf_max => <bytes>
173 234
174If defined, then a fatal error will be raised (with C<$!> set to C<ENOSPC>) 235If defined, then a fatal error will be raised (with C<$!> set to C<ENOSPC>)
175when the read buffer ever (strictly) exceeds this size. This is useful to 236when the read buffer ever (strictly) exceeds this size. This is useful to
176avoid denial-of-service attacks. 237avoid some forms of denial-of-service attacks.
177 238
178For example, a server accepting connections from untrusted sources should 239For example, a server accepting connections from untrusted sources should
179be configured to accept only so-and-so much data that it cannot act on 240be configured to accept only so-and-so much data that it cannot act on
180(for example, when expecting a line, an attacker could send an unlimited 241(for example, when expecting a line, an attacker could send an unlimited
181amount of data without a callback ever being called as long as the line 242amount of data without a callback ever being called as long as the line
182isn't finished). 243isn't finished).
183 244
184=item autocork => <boolean> 245=item autocork => <boolean>
185 246
186When disabled (the default), then C<push_write> will try to immediately 247When disabled (the default), then C<push_write> will try to immediately
187write the data to the handle if possible. This avoids having to register 248write the data to the handle, if possible. This avoids having to register
188a write watcher and wait for the next event loop iteration, but can be 249a write watcher and wait for the next event loop iteration, but can
189inefficient if you write multiple small chunks (this disadvantage is 250be inefficient if you write multiple small chunks (on the wire, this
190usually avoided by your kernel's nagle algorithm, see C<low_delay>). 251disadvantage is usually avoided by your kernel's nagle algorithm, see
252C<no_delay>, but this option can save costly syscalls).
191 253
192When enabled, then writes will always be queued till the next event loop 254When enabled, then writes will always be queued till the next event loop
193iteration. This is efficient when you do many small writes per iteration, 255iteration. This is efficient when you do many small writes per iteration,
194but less efficient when you do a single write only. 256but less efficient when you do a single write only per iteration (or when
257the write buffer often is full). It also increases write latency.
195 258
196=item no_delay => <boolean> 259=item no_delay => <boolean>
197 260
198When doing small writes on sockets, your operating system kernel might 261When doing small writes on sockets, your operating system kernel might
199wait a bit for more data before actually sending it out. This is called 262wait a bit for more data before actually sending it out. This is called
200the Nagle algorithm, and usually it is beneficial. 263the Nagle algorithm, and usually it is beneficial.
201 264
202In some situations you want as low a delay as possible, which cna be 265In some situations you want as low a delay as possible, which can be
203accomplishd by setting this option to true. 266accomplishd by setting this option to a true value.
204 267
205The default is your opertaing system's default behaviour, this option 268The default is your opertaing system's default behaviour (most likely
206explicitly enables or disables it, if possible. 269enabled), this option explicitly enables or disables it, if possible.
207 270
208=item read_size => <bytes> 271=item read_size => <bytes>
209 272
210The default read block size (the amount of bytes this module will try to read 273The default read block size (the amount of bytes this module will
211during each (loop iteration). Default: C<8192>. 274try to read during each loop iteration, which affects memory
275requirements). Default: C<8192>.
212 276
213=item low_water_mark => <bytes> 277=item low_water_mark => <bytes>
214 278
215Sets the amount of bytes (default: C<0>) that make up an "empty" write 279Sets the amount of bytes (default: C<0>) that make up an "empty" write
216buffer: If the write reaches this size or gets even samller it is 280buffer: If the write reaches this size or gets even samller it is
217considered empty. 281considered empty.
218 282
283Sometimes it can be beneficial (for performance reasons) to add data to
284the write buffer before it is fully drained, but this is a rare case, as
285the operating system kernel usually buffers data as well, so the default
286is good in almost all cases.
287
219=item linger => <seconds> 288=item linger => <seconds>
220 289
221If non-zero (default: C<3600>), then the destructor of the 290If non-zero (default: C<3600>), then the destructor of the
222AnyEvent::Handle object will check wether there is still outstanding write 291AnyEvent::Handle object will check whether there is still outstanding
223data and will install a watcher that will write out this data. No errors 292write data and will install a watcher that will write this data to the
224will be reported (this mostly matches how the operating system treats 293socket. No errors will be reported (this mostly matches how the operating
225outstanding data at socket close time). 294system treats outstanding data at socket close time).
226 295
227This will not work for partial TLS data that could not yet been 296This will not work for partial TLS data that could not be encoded
228encoded. This data will be lost. 297yet. This data will be lost. Calling the C<stoptls> method in time might
298help.
299
300=item peername => $string
301
302A string used to identify the remote site - usually the DNS hostname
303(I<not> IDN!) used to create the connection, rarely the IP address.
304
305Apart from being useful in error messages, this string is also used in TLS
306peername verification (see C<verify_peername> in L<AnyEvent::TLS>). This
307verification will be skipped when C<peername> is not specified or
308C<undef>.
229 309
230=item tls => "accept" | "connect" | Net::SSLeay::SSL object 310=item tls => "accept" | "connect" | Net::SSLeay::SSL object
231 311
232When this parameter is given, it enables TLS (SSL) mode, that means it 312When this parameter is given, it enables TLS (SSL) mode, that means
233will start making tls handshake and will transparently encrypt/decrypt 313AnyEvent will start a TLS handshake as soon as the conenction has been
234data. 314established and will transparently encrypt/decrypt data afterwards.
315
316All TLS protocol errors will be signalled as C<EPROTO>, with an
317appropriate error message.
235 318
236TLS mode requires Net::SSLeay to be installed (it will be loaded 319TLS mode requires Net::SSLeay to be installed (it will be loaded
237automatically when you try to create a TLS handle). 320automatically when you try to create a TLS handle): this module doesn't
321have a dependency on that module, so if your module requires it, you have
322to add the dependency yourself.
238 323
239For the TLS server side, use C<accept>, and for the TLS client side of a 324Unlike TCP, TLS has a server and client side: for the TLS server side, use
240connection, use C<connect> mode. 325C<accept>, and for the TLS client side of a connection, use C<connect>
326mode.
241 327
242You can also provide your own TLS connection object, but you have 328You can also provide your own TLS connection object, but you have
243to make sure that you call either C<Net::SSLeay::set_connect_state> 329to make sure that you call either C<Net::SSLeay::set_connect_state>
244or C<Net::SSLeay::set_accept_state> on it before you pass it to 330or C<Net::SSLeay::set_accept_state> on it before you pass it to
245AnyEvent::Handle. 331AnyEvent::Handle. Also, this module will take ownership of this connection
332object.
246 333
334At some future point, AnyEvent::Handle might switch to another TLS
335implementation, then the option to use your own session object will go
336away.
337
338B<IMPORTANT:> since Net::SSLeay "objects" are really only integers,
339passing in the wrong integer will lead to certain crash. This most often
340happens when one uses a stylish C<< tls => 1 >> and is surprised about the
341segmentation fault.
342
247See the C<starttls> method if you need to start TLS negotiation later. 343See the C<< ->starttls >> method for when need to start TLS negotiation later.
248 344
249=item tls_ctx => $ssl_ctx 345=item tls_ctx => $anyevent_tls
250 346
251Use the given Net::SSLeay::CTX object to create the new TLS connection 347Use the given C<AnyEvent::TLS> object to create the new TLS connection
252(unless a connection object was specified directly). If this parameter is 348(unless a connection object was specified directly). If this parameter is
253missing, then AnyEvent::Handle will use C<AnyEvent::Handle::TLS_CTX>. 349missing, then AnyEvent::Handle will use C<AnyEvent::Handle::TLS_CTX>.
254 350
351Instead of an object, you can also specify a hash reference with C<< key
352=> value >> pairs. Those will be passed to L<AnyEvent::TLS> to create a
353new TLS context object.
354
355=item on_starttls => $cb->($handle, $success[, $error_message])
356
357This callback will be invoked when the TLS/SSL handshake has finished. If
358C<$success> is true, then the TLS handshake succeeded, otherwise it failed
359(C<on_stoptls> will not be called in this case).
360
361The session in C<< $handle->{tls} >> can still be examined in this
362callback, even when the handshake was not successful.
363
364TLS handshake failures will not cause C<on_error> to be invoked when this
365callback is in effect, instead, the error message will be passed to C<on_starttls>.
366
367Without this callback, handshake failures lead to C<on_error> being
368called, as normal.
369
370Note that you cannot call C<starttls> right again in this callback. If you
371need to do that, start an zero-second timer instead whose callback can
372then call C<< ->starttls >> again.
373
374=item on_stoptls => $cb->($handle)
375
376When a SSLv3/TLS shutdown/close notify/EOF is detected and this callback is
377set, then it will be invoked after freeing the TLS session. If it is not,
378then a TLS shutdown condition will be treated like a normal EOF condition
379on the handle.
380
381The session in C<< $handle->{tls} >> can still be examined in this
382callback.
383
384This callback will only be called on TLS shutdowns, not when the
385underlying handle signals EOF.
386
255=item json => JSON or JSON::XS object 387=item json => JSON or JSON::XS object
256 388
257This is the json coder object used by the C<json> read and write types. 389This is the json coder object used by the C<json> read and write types.
258 390
259If you don't supply it, then AnyEvent::Handle will create and use a 391If you don't supply it, then AnyEvent::Handle will create and use a
260suitable one, which will write and expect UTF-8 encoded JSON texts. 392suitable one (on demand), which will write and expect UTF-8 encoded JSON
393texts.
261 394
262Note that you are responsible to depend on the JSON module if you want to 395Note that you are responsible to depend on the JSON module if you want to
263use this functionality, as AnyEvent does not have a dependency itself. 396use this functionality, as AnyEvent does not have a dependency itself.
264 397
265=item filter_r => $cb
266
267=item filter_w => $cb
268
269These exist, but are undocumented at this time.
270
271=back 398=back
272 399
273=cut 400=cut
274 401
275sub new { 402sub new {
276 my $class = shift; 403 my $class = shift;
277
278 my $self = bless { @_ }, $class; 404 my $self = bless { @_ }, $class;
279 405
280 $self->{fh} or Carp::croak "mandatory argument fh is missing"; 406 if ($self->{fh}) {
407 $self->_start;
408 return unless $self->{fh}; # could be gone by now
409
410 } elsif ($self->{connect}) {
411 require AnyEvent::Socket;
412
413 $self->{peername} = $self->{connect}[0]
414 unless exists $self->{peername};
415
416 $self->{_skip_drain_rbuf} = 1;
417
418 {
419 Scalar::Util::weaken (my $self = $self);
420
421 $self->{_connect} =
422 AnyEvent::Socket::tcp_connect (
423 $self->{connect}[0],
424 $self->{connect}[1],
425 sub {
426 my ($fh, $host, $port, $retry) = @_;
427
428 if ($fh) {
429 $self->{fh} = $fh;
430
431 delete $self->{_skip_drain_rbuf};
432 $self->_start;
433
434 $self->{on_connect}
435 and $self->{on_connect}($self, $host, $port, sub {
436 delete @$self{qw(fh _tw _ww _rw _eof _queue rbuf _wbuf tls _tls_rbuf _tls_wbuf)};
437 $self->{_skip_drain_rbuf} = 1;
438 &$retry;
439 });
440
441 } else {
442 if ($self->{on_connect_error}) {
443 $self->{on_connect_error}($self, "$!");
444 $self->destroy;
445 } else {
446 $self->fatal ($!, 1);
447 }
448 }
449 },
450 sub {
451 local $self->{fh} = $_[0];
452
453 $self->{on_prepare}->($self)
454 if $self->{on_prepare};
455 }
456 );
457 }
458
459 } else {
460 Carp::croak "AnyEvent::Handle: either an existing fh or the connect parameter must be specified";
461 }
462
463 $self
464}
465
466sub _start {
467 my ($self) = @_;
281 468
282 AnyEvent::Util::fh_nonblocking $self->{fh}, 1; 469 AnyEvent::Util::fh_nonblocking $self->{fh}, 1;
283
284 if ($self->{tls}) {
285 require Net::SSLeay;
286 $self->starttls (delete $self->{tls}, delete $self->{tls_ctx});
287 }
288 470
289 $self->{_activity} = AnyEvent->now; 471 $self->{_activity} = AnyEvent->now;
290 $self->_timeout; 472 $self->_timeout;
291 473
292 $self->on_drain (delete $self->{on_drain}) if exists $self->{on_drain};
293 $self->no_delay (delete $self->{no_delay}) if exists $self->{no_delay}; 474 $self->no_delay (delete $self->{no_delay}) if exists $self->{no_delay};
294 475
476 $self->starttls (delete $self->{tls}, delete $self->{tls_ctx})
477 if $self->{tls};
478
479 $self->on_drain (delete $self->{on_drain}) if $self->{on_drain};
480
295 $self->start_read 481 $self->start_read
296 if $self->{on_read}; 482 if $self->{on_read} || @{ $self->{_queue} };
297
298 $self
299} 483}
300 484
301sub _shutdown { 485#sub _shutdown {
302 my ($self) = @_; 486# my ($self) = @_;
303 487#
304 delete $self->{_tw}; 488# delete @$self{qw(_tw _rw _ww fh wbuf on_read _queue)};
305 delete $self->{_rw}; 489# $self->{_eof} = 1; # tell starttls et. al to stop trying
306 delete $self->{_ww}; 490#
307 delete $self->{fh}; 491# &_freetls;
308 492#}
309 $self->stoptls;
310
311 delete $self->{on_read};
312 delete $self->{_queue};
313}
314 493
315sub _error { 494sub _error {
316 my ($self, $errno, $fatal) = @_; 495 my ($self, $errno, $fatal, $message) = @_;
317
318 $self->_shutdown
319 if $fatal;
320 496
321 $! = $errno; 497 $! = $errno;
498 $message ||= "$!";
322 499
323 if ($self->{on_error}) { 500 if ($self->{on_error}) {
324 $self->{on_error}($self, $fatal); 501 $self->{on_error}($self, $fatal, $message);
325 } else { 502 $self->destroy if $fatal;
503 } elsif ($self->{fh}) {
504 $self->destroy;
326 Carp::croak "AnyEvent::Handle uncaught error: $!"; 505 Carp::croak "AnyEvent::Handle uncaught error: $message";
327 } 506 }
328} 507}
329 508
330=item $fh = $handle->fh 509=item $fh = $handle->fh
331 510
332This method returns the file handle of the L<AnyEvent::Handle> object. 511This method returns the file handle used to create the L<AnyEvent::Handle> object.
333 512
334=cut 513=cut
335 514
336sub fh { $_[0]{fh} } 515sub fh { $_[0]{fh} }
337 516
355 $_[0]{on_eof} = $_[1]; 534 $_[0]{on_eof} = $_[1];
356} 535}
357 536
358=item $handle->on_timeout ($cb) 537=item $handle->on_timeout ($cb)
359 538
360Replace the current C<on_timeout> callback, or disables the callback 539Replace the current C<on_timeout> callback, or disables the callback (but
361(but not the timeout) if C<$cb> = C<undef>. See C<timeout> constructor 540not the timeout) if C<$cb> = C<undef>. See the C<timeout> constructor
362argument. 541argument and method.
363 542
364=cut 543=cut
365 544
366sub on_timeout { 545sub on_timeout {
367 $_[0]{on_timeout} = $_[1]; 546 $_[0]{on_timeout} = $_[1];
368} 547}
369 548
370=item $handle->autocork ($boolean) 549=item $handle->autocork ($boolean)
371 550
372Enables or disables the current autocork behaviour (see C<autocork> 551Enables or disables the current autocork behaviour (see C<autocork>
373constructor argument). 552constructor argument). Changes will only take effect on the next write.
374 553
375=cut 554=cut
555
556sub autocork {
557 $_[0]{autocork} = $_[1];
558}
376 559
377=item $handle->no_delay ($boolean) 560=item $handle->no_delay ($boolean)
378 561
379Enables or disables the C<no_delay> setting (see constructor argument of 562Enables or disables the C<no_delay> setting (see constructor argument of
380the same name for details). 563the same name for details).
384sub no_delay { 567sub no_delay {
385 $_[0]{no_delay} = $_[1]; 568 $_[0]{no_delay} = $_[1];
386 569
387 eval { 570 eval {
388 local $SIG{__DIE__}; 571 local $SIG{__DIE__};
389 setsockopt $_[0]{fh}, &Socket::IPPROTO_TCP, &Socket::TCP_NODELAY, int $_[1]; 572 setsockopt $_[0]{fh}, &Socket::IPPROTO_TCP, &Socket::TCP_NODELAY, int $_[1]
573 if $_[0]{fh};
390 }; 574 };
575}
576
577=item $handle->on_starttls ($cb)
578
579Replace the current C<on_starttls> callback (see the C<on_starttls> constructor argument).
580
581=cut
582
583sub on_starttls {
584 $_[0]{on_starttls} = $_[1];
585}
586
587=item $handle->on_stoptls ($cb)
588
589Replace the current C<on_stoptls> callback (see the C<on_stoptls> constructor argument).
590
591=cut
592
593sub on_starttls {
594 $_[0]{on_stoptls} = $_[1];
391} 595}
392 596
393############################################################################# 597#############################################################################
394 598
395=item $handle->timeout ($seconds) 599=item $handle->timeout ($seconds)
408# reset the timeout watcher, as neccessary 612# reset the timeout watcher, as neccessary
409# also check for time-outs 613# also check for time-outs
410sub _timeout { 614sub _timeout {
411 my ($self) = @_; 615 my ($self) = @_;
412 616
413 if ($self->{timeout}) { 617 if ($self->{timeout} && $self->{fh}) {
414 my $NOW = AnyEvent->now; 618 my $NOW = AnyEvent->now;
415 619
416 # when would the timeout trigger? 620 # when would the timeout trigger?
417 my $after = $self->{_activity} + $self->{timeout} - $NOW; 621 my $after = $self->{_activity} + $self->{timeout} - $NOW;
418 622
421 $self->{_activity} = $NOW; 625 $self->{_activity} = $NOW;
422 626
423 if ($self->{on_timeout}) { 627 if ($self->{on_timeout}) {
424 $self->{on_timeout}($self); 628 $self->{on_timeout}($self);
425 } else { 629 } else {
426 $self->_error (&Errno::ETIMEDOUT); 630 $self->_error (Errno::ETIMEDOUT);
427 } 631 }
428 632
429 # callback could have changed timeout value, optimise 633 # callback could have changed timeout value, optimise
430 return unless $self->{timeout}; 634 return unless $self->{timeout};
431 635
473 my ($self, $cb) = @_; 677 my ($self, $cb) = @_;
474 678
475 $self->{on_drain} = $cb; 679 $self->{on_drain} = $cb;
476 680
477 $cb->($self) 681 $cb->($self)
478 if $cb && $self->{low_water_mark} >= length $self->{wbuf}; 682 if $cb && $self->{low_water_mark} >= (length $self->{wbuf}) + (length $self->{_tls_wbuf});
479} 683}
480 684
481=item $handle->push_write ($data) 685=item $handle->push_write ($data)
482 686
483Queues the given scalar to be written. You can push as much data as you 687Queues the given scalar to be written. You can push as much data as you
494 Scalar::Util::weaken $self; 698 Scalar::Util::weaken $self;
495 699
496 my $cb = sub { 700 my $cb = sub {
497 my $len = syswrite $self->{fh}, $self->{wbuf}; 701 my $len = syswrite $self->{fh}, $self->{wbuf};
498 702
499 if ($len >= 0) { 703 if (defined $len) {
500 substr $self->{wbuf}, 0, $len, ""; 704 substr $self->{wbuf}, 0, $len, "";
501 705
502 $self->{_activity} = AnyEvent->now; 706 $self->{_activity} = AnyEvent->now;
503 707
504 $self->{on_drain}($self) 708 $self->{on_drain}($self)
505 if $self->{low_water_mark} >= length $self->{wbuf} 709 if $self->{low_water_mark} >= (length $self->{wbuf}) + (length $self->{_tls_wbuf})
506 && $self->{on_drain}; 710 && $self->{on_drain};
507 711
508 delete $self->{_ww} unless length $self->{wbuf}; 712 delete $self->{_ww} unless length $self->{wbuf};
509 } elsif ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK) { 713 } elsif ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK) {
510 $self->_error ($!, 1); 714 $self->_error ($!, 1);
534 738
535 @_ = ($WH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::push_write") 739 @_ = ($WH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::push_write")
536 ->($self, @_); 740 ->($self, @_);
537 } 741 }
538 742
539 if ($self->{filter_w}) { 743 if ($self->{tls}) {
540 $self->{filter_w}($self, \$_[0]); 744 $self->{_tls_wbuf} .= $_[0];
745
746 &_dotls ($self);
541 } else { 747 } else {
542 $self->{wbuf} .= $_[0]; 748 $self->{wbuf} .= $_[0];
543 $self->_drain_wbuf; 749 $self->_drain_wbuf if $self->{fh};
544 } 750 }
545} 751}
546 752
547=item $handle->push_write (type => @args) 753=item $handle->push_write (type => @args)
548 754
562=cut 768=cut
563 769
564register_write_type netstring => sub { 770register_write_type netstring => sub {
565 my ($self, $string) = @_; 771 my ($self, $string) = @_;
566 772
567 sprintf "%d:%s,", (length $string), $string 773 (length $string) . ":$string,"
568}; 774};
569 775
570=item packstring => $format, $data 776=item packstring => $format, $data
571 777
572An octet string prefixed with an encoded length. The encoding C<$format> 778An octet string prefixed with an encoded length. The encoding C<$format>
637 843
638 pack "w/a*", Storable::nfreeze ($ref) 844 pack "w/a*", Storable::nfreeze ($ref)
639}; 845};
640 846
641=back 847=back
848
849=item $handle->push_shutdown
850
851Sometimes you know you want to close the socket after writing your data
852before it was actually written. One way to do that is to replace your
853C<on_drain> handler by a callback that shuts down the socket (and set
854C<low_water_mark> to C<0>). This method is a shorthand for just that, and
855replaces the C<on_drain> callback with:
856
857 sub { shutdown $_[0]{fh}, 1 } # for push_shutdown
858
859This simply shuts down the write side and signals an EOF condition to the
860the peer.
861
862You can rely on the normal read queue and C<on_eof> handling
863afterwards. This is the cleanest way to close a connection.
864
865=cut
866
867sub push_shutdown {
868 my ($self) = @_;
869
870 delete $self->{low_water_mark};
871 $self->on_drain (sub { shutdown $_[0]{fh}, 1 });
872}
642 873
643=item AnyEvent::Handle::register_write_type type => $coderef->($handle, @args) 874=item AnyEvent::Handle::register_write_type type => $coderef->($handle, @args)
644 875
645This function (not method) lets you add your own types to C<push_write>. 876This function (not method) lets you add your own types to C<push_write>.
646Whenever the given C<type> is used, C<push_write> will invoke the code 877Whenever the given C<type> is used, C<push_write> will invoke the code
740=cut 971=cut
741 972
742sub _drain_rbuf { 973sub _drain_rbuf {
743 my ($self) = @_; 974 my ($self) = @_;
744 975
976 # avoid recursion
977 return if exists $self->{_skip_drain_rbuf};
745 local $self->{_in_drain} = 1; 978 local $self->{_skip_drain_rbuf} = 1;
746 979
747 if ( 980 if (
748 defined $self->{rbuf_max} 981 defined $self->{rbuf_max}
749 && $self->{rbuf_max} < length $self->{rbuf} 982 && $self->{rbuf_max} < length $self->{rbuf}
750 ) { 983 ) {
751 $self->_error (&Errno::ENOSPC, 1), return; 984 $self->_error (Errno::ENOSPC, 1), return;
752 } 985 }
753 986
754 while () { 987 while () {
988 # we need to use a separate tls read buffer, as we must not receive data while
989 # we are draining the buffer, and this can only happen with TLS.
990 $self->{rbuf} .= delete $self->{_tls_rbuf} if exists $self->{_tls_rbuf};
991
755 my $len = length $self->{rbuf}; 992 my $len = length $self->{rbuf};
756 993
757 if (my $cb = shift @{ $self->{_queue} }) { 994 if (my $cb = shift @{ $self->{_queue} }) {
758 unless ($cb->($self)) { 995 unless ($cb->($self)) {
759 if ($self->{_eof}) { 996 if ($self->{_eof}) {
760 # no progress can be made (not enough data and no data forthcoming) 997 # no progress can be made (not enough data and no data forthcoming)
761 $self->_error (&Errno::EPIPE, 1), return; 998 $self->_error (Errno::EPIPE, 1), return;
762 } 999 }
763 1000
764 unshift @{ $self->{_queue} }, $cb; 1001 unshift @{ $self->{_queue} }, $cb;
765 last; 1002 last;
766 } 1003 }
774 && !@{ $self->{_queue} } # and the queue is still empty 1011 && !@{ $self->{_queue} } # and the queue is still empty
775 && $self->{on_read} # but we still have on_read 1012 && $self->{on_read} # but we still have on_read
776 ) { 1013 ) {
777 # no further data will arrive 1014 # no further data will arrive
778 # so no progress can be made 1015 # so no progress can be made
779 $self->_error (&Errno::EPIPE, 1), return 1016 $self->_error (Errno::EPIPE, 1), return
780 if $self->{_eof}; 1017 if $self->{_eof};
781 1018
782 last; # more data might arrive 1019 last; # more data might arrive
783 } 1020 }
784 } else { 1021 } else {
785 # read side becomes idle 1022 # read side becomes idle
786 delete $self->{_rw}; 1023 delete $self->{_rw} unless $self->{tls};
787 last; 1024 last;
788 } 1025 }
789 } 1026 }
790 1027
791 if ($self->{_eof}) { 1028 if ($self->{_eof}) {
792 if ($self->{on_eof}) { 1029 if ($self->{on_eof}) {
793 $self->{on_eof}($self) 1030 $self->{on_eof}($self)
794 } else { 1031 } else {
795 $self->_error (0, 1); 1032 $self->_error (0, 1, "Unexpected end-of-file");
796 } 1033 }
797 } 1034 }
798 1035
799 # may need to restart read watcher 1036 # may need to restart read watcher
800 unless ($self->{_rw}) { 1037 unless ($self->{_rw}) {
813 1050
814sub on_read { 1051sub on_read {
815 my ($self, $cb) = @_; 1052 my ($self, $cb) = @_;
816 1053
817 $self->{on_read} = $cb; 1054 $self->{on_read} = $cb;
818 $self->_drain_rbuf if $cb && !$self->{_in_drain}; 1055 $self->_drain_rbuf if $cb;
819} 1056}
820 1057
821=item $handle->rbuf 1058=item $handle->rbuf
822 1059
823Returns the read buffer (as a modifiable lvalue). 1060Returns the read buffer (as a modifiable lvalue).
824 1061
825You can access the read buffer directly as the C<< ->{rbuf} >> member, if 1062You can access the read buffer directly as the C<< ->{rbuf} >>
826you want. 1063member, if you want. However, the only operation allowed on the
1064read buffer (apart from looking at it) is removing data from its
1065beginning. Otherwise modifying or appending to it is not allowed and will
1066lead to hard-to-track-down bugs.
827 1067
828NOTE: The read buffer should only be used or modified if the C<on_read>, 1068NOTE: The read buffer should only be used or modified if the C<on_read>,
829C<push_read> or C<unshift_read> methods are used. The other read methods 1069C<push_read> or C<unshift_read> methods are used. The other read methods
830automatically manage the read buffer. 1070automatically manage the read buffer.
831 1071
872 $cb = ($RH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::push_read") 1112 $cb = ($RH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::push_read")
873 ->($self, $cb, @_); 1113 ->($self, $cb, @_);
874 } 1114 }
875 1115
876 push @{ $self->{_queue} }, $cb; 1116 push @{ $self->{_queue} }, $cb;
877 $self->_drain_rbuf unless $self->{_in_drain}; 1117 $self->_drain_rbuf;
878} 1118}
879 1119
880sub unshift_read { 1120sub unshift_read {
881 my $self = shift; 1121 my $self = shift;
882 my $cb = pop; 1122 my $cb = pop;
888 ->($self, $cb, @_); 1128 ->($self, $cb, @_);
889 } 1129 }
890 1130
891 1131
892 unshift @{ $self->{_queue} }, $cb; 1132 unshift @{ $self->{_queue} }, $cb;
893 $self->_drain_rbuf unless $self->{_in_drain}; 1133 $self->_drain_rbuf;
894} 1134}
895 1135
896=item $handle->push_read (type => @args, $cb) 1136=item $handle->push_read (type => @args, $cb)
897 1137
898=item $handle->unshift_read (type => @args, $cb) 1138=item $handle->unshift_read (type => @args, $cb)
1031 return 1; 1271 return 1;
1032 } 1272 }
1033 1273
1034 # reject 1274 # reject
1035 if ($reject && $$rbuf =~ $reject) { 1275 if ($reject && $$rbuf =~ $reject) {
1036 $self->_error (&Errno::EBADMSG); 1276 $self->_error (Errno::EBADMSG);
1037 } 1277 }
1038 1278
1039 # skip 1279 # skip
1040 if ($skip && $$rbuf =~ $skip) { 1280 if ($skip && $$rbuf =~ $skip) {
1041 $data .= substr $$rbuf, 0, $+[0], ""; 1281 $data .= substr $$rbuf, 0, $+[0], "";
1057 my ($self, $cb) = @_; 1297 my ($self, $cb) = @_;
1058 1298
1059 sub { 1299 sub {
1060 unless ($_[0]{rbuf} =~ s/^(0|[1-9][0-9]*)://) { 1300 unless ($_[0]{rbuf} =~ s/^(0|[1-9][0-9]*)://) {
1061 if ($_[0]{rbuf} =~ /[^0-9]/) { 1301 if ($_[0]{rbuf} =~ /[^0-9]/) {
1062 $self->_error (&Errno::EBADMSG); 1302 $self->_error (Errno::EBADMSG);
1063 } 1303 }
1064 return; 1304 return;
1065 } 1305 }
1066 1306
1067 my $len = $1; 1307 my $len = $1;
1070 my $string = $_[1]; 1310 my $string = $_[1];
1071 $_[0]->unshift_read (chunk => 1, sub { 1311 $_[0]->unshift_read (chunk => 1, sub {
1072 if ($_[1] eq ",") { 1312 if ($_[1] eq ",") {
1073 $cb->($_[0], $string); 1313 $cb->($_[0], $string);
1074 } else { 1314 } else {
1075 $self->_error (&Errno::EBADMSG); 1315 $self->_error (Errno::EBADMSG);
1076 } 1316 }
1077 }); 1317 });
1078 }); 1318 });
1079 1319
1080 1 1320 1
1086An octet string prefixed with an encoded length. The encoding C<$format> 1326An octet string prefixed with an encoded length. The encoding C<$format>
1087uses the same format as a Perl C<pack> format, but must specify a single 1327uses the same format as a Perl C<pack> format, but must specify a single
1088integer only (only one of C<cCsSlLqQiInNvVjJw> is allowed, plus an 1328integer only (only one of C<cCsSlLqQiInNvVjJw> is allowed, plus an
1089optional C<!>, C<< < >> or C<< > >> modifier). 1329optional C<!>, C<< < >> or C<< > >> modifier).
1090 1330
1091DNS over TCP uses a prefix of C<n>, EPP uses a prefix of C<N>. 1331For example, DNS over TCP uses a prefix of C<n> (2 octet network order),
1332EPP uses a prefix of C<N> (4 octtes).
1092 1333
1093Example: read a block of data prefixed by its length in BER-encoded 1334Example: read a block of data prefixed by its length in BER-encoded
1094format (very efficient). 1335format (very efficient).
1095 1336
1096 $handle->push_read (packstring => "w", sub { 1337 $handle->push_read (packstring => "w", sub {
1126 } 1367 }
1127}; 1368};
1128 1369
1129=item json => $cb->($handle, $hash_or_arrayref) 1370=item json => $cb->($handle, $hash_or_arrayref)
1130 1371
1131Reads a JSON object or array, decodes it and passes it to the callback. 1372Reads a JSON object or array, decodes it and passes it to the
1373callback. When a parse error occurs, an C<EBADMSG> error will be raised.
1132 1374
1133If a C<json> object was passed to the constructor, then that will be used 1375If a C<json> object was passed to the constructor, then that will be used
1134for the final decode, otherwise it will create a JSON coder expecting UTF-8. 1376for the final decode, otherwise it will create a JSON coder expecting UTF-8.
1135 1377
1136This read type uses the incremental parser available with JSON version 1378This read type uses the incremental parser available with JSON version
1145=cut 1387=cut
1146 1388
1147register_read_type json => sub { 1389register_read_type json => sub {
1148 my ($self, $cb) = @_; 1390 my ($self, $cb) = @_;
1149 1391
1150 require JSON; 1392 my $json = $self->{json} ||=
1393 eval { require JSON::XS; JSON::XS->new->utf8 }
1394 || do { require JSON; JSON->new->utf8 };
1151 1395
1152 my $data; 1396 my $data;
1153 my $rbuf = \$self->{rbuf}; 1397 my $rbuf = \$self->{rbuf};
1154 1398
1155 my $json = $self->{json} ||= JSON->new->utf8;
1156
1157 sub { 1399 sub {
1158 my $ref = $json->incr_parse ($self->{rbuf}); 1400 my $ref = eval { $json->incr_parse ($self->{rbuf}) };
1159 1401
1160 if ($ref) { 1402 if ($ref) {
1161 $self->{rbuf} = $json->incr_text; 1403 $self->{rbuf} = $json->incr_text;
1162 $json->incr_text = ""; 1404 $json->incr_text = "";
1163 $cb->($self, $ref); 1405 $cb->($self, $ref);
1164 1406
1165 1 1407 1
1408 } elsif ($@) {
1409 # error case
1410 $json->incr_skip;
1411
1412 $self->{rbuf} = $json->incr_text;
1413 $json->incr_text = "";
1414
1415 $self->_error (Errno::EBADMSG);
1416
1417 ()
1166 } else { 1418 } else {
1167 $self->{rbuf} = ""; 1419 $self->{rbuf} = "";
1420
1168 () 1421 ()
1169 } 1422 }
1170 } 1423 }
1171}; 1424};
1172 1425
1204 # read remaining chunk 1457 # read remaining chunk
1205 $_[0]->unshift_read (chunk => $len, sub { 1458 $_[0]->unshift_read (chunk => $len, sub {
1206 if (my $ref = eval { Storable::thaw ($_[1]) }) { 1459 if (my $ref = eval { Storable::thaw ($_[1]) }) {
1207 $cb->($_[0], $ref); 1460 $cb->($_[0], $ref);
1208 } else { 1461 } else {
1209 $self->_error (&Errno::EBADMSG); 1462 $self->_error (Errno::EBADMSG);
1210 } 1463 }
1211 }); 1464 });
1212 } 1465 }
1213 1466
1214 1 1467 1
1249Note that AnyEvent::Handle will automatically C<start_read> for you when 1502Note that AnyEvent::Handle will automatically C<start_read> for you when
1250you change the C<on_read> callback or push/unshift a read callback, and it 1503you change the C<on_read> callback or push/unshift a read callback, and it
1251will automatically C<stop_read> for you when neither C<on_read> is set nor 1504will automatically C<stop_read> for you when neither C<on_read> is set nor
1252there are any read requests in the queue. 1505there are any read requests in the queue.
1253 1506
1507These methods will have no effect when in TLS mode (as TLS doesn't support
1508half-duplex connections).
1509
1254=cut 1510=cut
1255 1511
1256sub stop_read { 1512sub stop_read {
1257 my ($self) = @_; 1513 my ($self) = @_;
1258 1514
1259 delete $self->{_rw}; 1515 delete $self->{_rw} unless $self->{tls};
1260} 1516}
1261 1517
1262sub start_read { 1518sub start_read {
1263 my ($self) = @_; 1519 my ($self) = @_;
1264 1520
1265 unless ($self->{_rw} || $self->{_eof}) { 1521 unless ($self->{_rw} || $self->{_eof}) {
1266 Scalar::Util::weaken $self; 1522 Scalar::Util::weaken $self;
1267 1523
1268 $self->{_rw} = AnyEvent->io (fh => $self->{fh}, poll => "r", cb => sub { 1524 $self->{_rw} = AnyEvent->io (fh => $self->{fh}, poll => "r", cb => sub {
1269 my $rbuf = $self->{filter_r} ? \my $buf : \$self->{rbuf}; 1525 my $rbuf = \($self->{tls} ? my $buf : $self->{rbuf});
1270 my $len = sysread $self->{fh}, $$rbuf, $self->{read_size} || 8192, length $$rbuf; 1526 my $len = sysread $self->{fh}, $$rbuf, $self->{read_size} || 8192, length $$rbuf;
1271 1527
1272 if ($len > 0) { 1528 if ($len > 0) {
1273 $self->{_activity} = AnyEvent->now; 1529 $self->{_activity} = AnyEvent->now;
1274 1530
1275 $self->{filter_r} 1531 if ($self->{tls}) {
1276 ? $self->{filter_r}($self, $rbuf) 1532 Net::SSLeay::BIO_write ($self->{_rbio}, $$rbuf);
1277 : $self->{_in_drain} || $self->_drain_rbuf; 1533
1534 &_dotls ($self);
1535 } else {
1536 $self->_drain_rbuf;
1537 }
1278 1538
1279 } elsif (defined $len) { 1539 } elsif (defined $len) {
1280 delete $self->{_rw}; 1540 delete $self->{_rw};
1281 $self->{_eof} = 1; 1541 $self->{_eof} = 1;
1282 $self->_drain_rbuf unless $self->{_in_drain}; 1542 $self->_drain_rbuf;
1283 1543
1284 } elsif ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK) { 1544 } elsif ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK) {
1285 return $self->_error ($!, 1); 1545 return $self->_error ($!, 1);
1286 } 1546 }
1287 }); 1547 });
1288 } 1548 }
1289} 1549}
1290 1550
1551our $ERROR_SYSCALL;
1552our $ERROR_WANT_READ;
1553
1554sub _tls_error {
1555 my ($self, $err) = @_;
1556
1557 return $self->_error ($!, 1)
1558 if $err == Net::SSLeay::ERROR_SYSCALL ();
1559
1560 my $err =Net::SSLeay::ERR_error_string (Net::SSLeay::ERR_get_error ());
1561
1562 # reduce error string to look less scary
1563 $err =~ s/^error:[0-9a-fA-F]{8}:[^:]+:([^:]+):/\L$1: /;
1564
1565 if ($self->{_on_starttls}) {
1566 (delete $self->{_on_starttls})->($self, undef, $err);
1567 &_freetls;
1568 } else {
1569 &_freetls;
1570 $self->_error (Errno::EPROTO, 1, $err);
1571 }
1572}
1573
1574# poll the write BIO and send the data if applicable
1575# also decode read data if possible
1576# this is basiclaly our TLS state machine
1577# more efficient implementations are possible with openssl,
1578# but not with the buggy and incomplete Net::SSLeay.
1291sub _dotls { 1579sub _dotls {
1292 my ($self) = @_; 1580 my ($self) = @_;
1293 1581
1294 my $buf; 1582 my $tmp;
1295 1583
1296 if (length $self->{_tls_wbuf}) { 1584 if (length $self->{_tls_wbuf}) {
1297 while ((my $len = Net::SSLeay::write ($self->{tls}, $self->{_tls_wbuf})) > 0) { 1585 while (($tmp = Net::SSLeay::write ($self->{tls}, $self->{_tls_wbuf})) > 0) {
1298 substr $self->{_tls_wbuf}, 0, $len, ""; 1586 substr $self->{_tls_wbuf}, 0, $tmp, "";
1299 } 1587 }
1300 }
1301 1588
1589 $tmp = Net::SSLeay::get_error ($self->{tls}, $tmp);
1590 return $self->_tls_error ($tmp)
1591 if $tmp != $ERROR_WANT_READ
1592 && ($tmp != $ERROR_SYSCALL || $!);
1593 }
1594
1595 while (defined ($tmp = Net::SSLeay::read ($self->{tls}))) {
1596 unless (length $tmp) {
1597 $self->{_on_starttls}
1598 and (delete $self->{_on_starttls})->($self, undef, "EOF during handshake"); # ???
1599 &_freetls;
1600
1601 if ($self->{on_stoptls}) {
1602 $self->{on_stoptls}($self);
1603 return;
1604 } else {
1605 # let's treat SSL-eof as we treat normal EOF
1606 delete $self->{_rw};
1607 $self->{_eof} = 1;
1608 }
1609 }
1610
1611 $self->{_tls_rbuf} .= $tmp;
1612 $self->_drain_rbuf;
1613 $self->{tls} or return; # tls session might have gone away in callback
1614 }
1615
1616 $tmp = Net::SSLeay::get_error ($self->{tls}, -1);
1617 return $self->_tls_error ($tmp)
1618 if $tmp != $ERROR_WANT_READ
1619 && ($tmp != $ERROR_SYSCALL || $!);
1620
1302 if (length ($buf = Net::SSLeay::BIO_read ($self->{_wbio}))) { 1621 while (length ($tmp = Net::SSLeay::BIO_read ($self->{_wbio}))) {
1303 $self->{wbuf} .= $buf; 1622 $self->{wbuf} .= $tmp;
1304 $self->_drain_wbuf; 1623 $self->_drain_wbuf;
1305 } 1624 }
1306 1625
1307 while (defined ($buf = Net::SSLeay::read ($self->{tls}))) { 1626 $self->{_on_starttls}
1308 if (length $buf) { 1627 and Net::SSLeay::state ($self->{tls}) == Net::SSLeay::ST_OK ()
1309 $self->{rbuf} .= $buf; 1628 and (delete $self->{_on_starttls})->($self, 1, "TLS/SSL connection established");
1310 $self->_drain_rbuf unless $self->{_in_drain};
1311 } else {
1312 # let's treat SSL-eof as we treat normal EOF
1313 $self->{_eof} = 1;
1314 $self->_shutdown;
1315 return;
1316 }
1317 }
1318
1319 my $err = Net::SSLeay::get_error ($self->{tls}, -1);
1320
1321 if ($err!= Net::SSLeay::ERROR_WANT_READ ()) {
1322 if ($err == Net::SSLeay::ERROR_SYSCALL ()) {
1323 return $self->_error ($!, 1);
1324 } elsif ($err == Net::SSLeay::ERROR_SSL ()) {
1325 return $self->_error (&Errno::EIO, 1);
1326 }
1327
1328 # all others are fine for our purposes
1329 }
1330} 1629}
1331 1630
1332=item $handle->starttls ($tls[, $tls_ctx]) 1631=item $handle->starttls ($tls[, $tls_ctx])
1333 1632
1334Instead of starting TLS negotiation immediately when the AnyEvent::Handle 1633Instead of starting TLS negotiation immediately when the AnyEvent::Handle
1335object is created, you can also do that at a later time by calling 1634object is created, you can also do that at a later time by calling
1336C<starttls>. 1635C<starttls>.
1337 1636
1637Starting TLS is currently an asynchronous operation - when you push some
1638write data and then call C<< ->starttls >> then TLS negotiation will start
1639immediately, after which the queued write data is then sent.
1640
1338The first argument is the same as the C<tls> constructor argument (either 1641The first argument is the same as the C<tls> constructor argument (either
1339C<"connect">, C<"accept"> or an existing Net::SSLeay object). 1642C<"connect">, C<"accept"> or an existing Net::SSLeay object).
1340 1643
1341The second argument is the optional C<Net::SSLeay::CTX> object that is 1644The second argument is the optional C<AnyEvent::TLS> object that is used
1342used when AnyEvent::Handle has to create its own TLS connection object. 1645when AnyEvent::Handle has to create its own TLS connection object, or
1646a hash reference with C<< key => value >> pairs that will be used to
1647construct a new context.
1343 1648
1344The TLS connection object will end up in C<< $handle->{tls} >> after this 1649The TLS connection object will end up in C<< $handle->{tls} >>, the TLS
1345call and can be used or changed to your liking. Note that the handshake 1650context in C<< $handle->{tls_ctx} >> after this call and can be used or
1346might have already started when this function returns. 1651changed to your liking. Note that the handshake might have already started
1652when this function returns.
1347 1653
1654If it an error to start a TLS handshake more than once per
1655AnyEvent::Handle object (this is due to bugs in OpenSSL).
1656
1348=cut 1657=cut
1658
1659our %TLS_CACHE; #TODO not yet documented, should we?
1349 1660
1350sub starttls { 1661sub starttls {
1351 my ($self, $ssl, $ctx) = @_; 1662 my ($self, $ssl, $ctx) = @_;
1352 1663
1353 $self->stoptls; 1664 require Net::SSLeay;
1354 1665
1355 if ($ssl eq "accept") { 1666 Carp::croak "it is an error to call starttls more than once on an AnyEvent::Handle object"
1356 $ssl = Net::SSLeay::new ($ctx || TLS_CTX ()); 1667 if $self->{tls};
1357 Net::SSLeay::set_accept_state ($ssl); 1668
1358 } elsif ($ssl eq "connect") { 1669 $ERROR_SYSCALL = Net::SSLeay::ERROR_SYSCALL ();
1359 $ssl = Net::SSLeay::new ($ctx || TLS_CTX ()); 1670 $ERROR_WANT_READ = Net::SSLeay::ERROR_WANT_READ ();
1360 Net::SSLeay::set_connect_state ($ssl); 1671
1672 $ctx ||= $self->{tls_ctx};
1673
1674 local $Carp::CarpLevel = 1; # skip ourselves when creating a new context or session
1675
1676 if ("HASH" eq ref $ctx) {
1677 require AnyEvent::TLS;
1678
1679 if ($ctx->{cache}) {
1680 my $key = $ctx+0;
1681 $ctx = $TLS_CACHE{$key} ||= new AnyEvent::TLS %$ctx;
1682 } else {
1683 $ctx = new AnyEvent::TLS %$ctx;
1684 }
1685 }
1361 } 1686
1362 1687 $self->{tls_ctx} = $ctx || TLS_CTX ();
1363 $self->{tls} = $ssl; 1688 $self->{tls} = $ssl = $self->{tls_ctx}->_get_session ($ssl, $self, $self->{peername});
1364 1689
1365 # basically, this is deep magic (because SSL_read should have the same issues) 1690 # basically, this is deep magic (because SSL_read should have the same issues)
1366 # but the openssl maintainers basically said: "trust us, it just works". 1691 # but the openssl maintainers basically said: "trust us, it just works".
1367 # (unfortunately, we have to hardcode constants because the abysmally misdesigned 1692 # (unfortunately, we have to hardcode constants because the abysmally misdesigned
1368 # and mismaintained ssleay-module doesn't even offer them). 1693 # and mismaintained ssleay-module doesn't even offer them).
1369 # http://www.mail-archive.com/openssl-dev@openssl.org/msg22420.html 1694 # http://www.mail-archive.com/openssl-dev@openssl.org/msg22420.html
1695 #
1696 # in short: this is a mess.
1697 #
1698 # note that we do not try to keep the length constant between writes as we are required to do.
1699 # we assume that most (but not all) of this insanity only applies to non-blocking cases,
1700 # and we drive openssl fully in blocking mode here. Or maybe we don't - openssl seems to
1701 # have identity issues in that area.
1370 Net::SSLeay::CTX_set_mode ($self->{tls}, 1702# Net::SSLeay::CTX_set_mode ($ssl,
1371 (eval { local $SIG{__DIE__}; Net::SSLeay::MODE_ENABLE_PARTIAL_WRITE () } || 1) 1703# (eval { local $SIG{__DIE__}; Net::SSLeay::MODE_ENABLE_PARTIAL_WRITE () } || 1)
1372 | (eval { local $SIG{__DIE__}; Net::SSLeay::MODE_ACCEPT_MOVING_WRITE_BUFFER () } || 2)); 1704# | (eval { local $SIG{__DIE__}; Net::SSLeay::MODE_ACCEPT_MOVING_WRITE_BUFFER () } || 2));
1705 Net::SSLeay::CTX_set_mode ($ssl, 1|2);
1373 1706
1374 $self->{_rbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ()); 1707 $self->{_rbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ());
1375 $self->{_wbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ()); 1708 $self->{_wbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ());
1376 1709
1377 Net::SSLeay::set_bio ($ssl, $self->{_rbio}, $self->{_wbio}); 1710 Net::SSLeay::set_bio ($ssl, $self->{_rbio}, $self->{_wbio});
1378 1711
1379 $self->{filter_w} = sub { 1712 $self->{_on_starttls} = sub { $_[0]{on_starttls}(@_) }
1380 $_[0]{_tls_wbuf} .= ${$_[1]}; 1713 if $self->{on_starttls};
1381 &_dotls; 1714
1382 }; 1715 &_dotls; # need to trigger the initial handshake
1383 $self->{filter_r} = sub { 1716 $self->start_read; # make sure we actually do read
1384 Net::SSLeay::BIO_write ($_[0]{_rbio}, ${$_[1]});
1385 &_dotls;
1386 };
1387} 1717}
1388 1718
1389=item $handle->stoptls 1719=item $handle->stoptls
1390 1720
1391Destroys the SSL connection, if any. Partial read or write data will be 1721Shuts down the SSL connection - this makes a proper EOF handshake by
1392lost. 1722sending a close notify to the other side, but since OpenSSL doesn't
1723support non-blocking shut downs, it is not possible to re-use the stream
1724afterwards.
1393 1725
1394=cut 1726=cut
1395 1727
1396sub stoptls { 1728sub stoptls {
1397 my ($self) = @_; 1729 my ($self) = @_;
1398 1730
1399 Net::SSLeay::free (delete $self->{tls}) if $self->{tls}; 1731 if ($self->{tls}) {
1732 Net::SSLeay::shutdown ($self->{tls});
1400 1733
1401 delete $self->{_rbio}; 1734 &_dotls;
1402 delete $self->{_wbio}; 1735
1403 delete $self->{_tls_wbuf}; 1736# # we don't give a shit. no, we do, but we can't. no...#d#
1404 delete $self->{filter_r}; 1737# # we, we... have to use openssl :/#d#
1405 delete $self->{filter_w}; 1738# &_freetls;#d#
1739 }
1740}
1741
1742sub _freetls {
1743 my ($self) = @_;
1744
1745 return unless $self->{tls};
1746
1747 $self->{tls_ctx}->_put_session (delete $self->{tls});
1748
1749 delete @$self{qw(_rbio _wbio _tls_wbuf _on_starttls)};
1406} 1750}
1407 1751
1408sub DESTROY { 1752sub DESTROY {
1409 my $self = shift; 1753 my ($self) = @_;
1410 1754
1411 $self->stoptls; 1755 &_freetls;
1412 1756
1413 my $linger = exists $self->{linger} ? $self->{linger} : 3600; 1757 my $linger = exists $self->{linger} ? $self->{linger} : 3600;
1414 1758
1415 if ($linger && length $self->{wbuf}) { 1759 if ($linger && length $self->{wbuf} && $self->{fh}) {
1416 my $fh = delete $self->{fh}; 1760 my $fh = delete $self->{fh};
1417 my $wbuf = delete $self->{wbuf}; 1761 my $wbuf = delete $self->{wbuf};
1418 1762
1419 my @linger; 1763 my @linger;
1420 1764
1431 @linger = (); 1775 @linger = ();
1432 }); 1776 });
1433 } 1777 }
1434} 1778}
1435 1779
1780=item $handle->destroy
1781
1782Shuts down the handle object as much as possible - this call ensures that
1783no further callbacks will be invoked and as many resources as possible
1784will be freed. You must not call any methods on the object afterwards.
1785
1786Normally, you can just "forget" any references to an AnyEvent::Handle
1787object and it will simply shut down. This works in fatal error and EOF
1788callbacks, as well as code outside. It does I<NOT> work in a read or write
1789callback, so when you want to destroy the AnyEvent::Handle object from
1790within such an callback. You I<MUST> call C<< ->destroy >> explicitly in
1791that case.
1792
1793Destroying the handle object in this way has the advantage that callbacks
1794will be removed as well, so if those are the only reference holders (as
1795is common), then one doesn't need to do anything special to break any
1796reference cycles.
1797
1798The handle might still linger in the background and write out remaining
1799data, as specified by the C<linger> option, however.
1800
1801=cut
1802
1803sub destroy {
1804 my ($self) = @_;
1805
1806 $self->DESTROY;
1807 %$self = ();
1808}
1809
1436=item AnyEvent::Handle::TLS_CTX 1810=item AnyEvent::Handle::TLS_CTX
1437 1811
1438This function creates and returns the Net::SSLeay::CTX object used by 1812This function creates and returns the AnyEvent::TLS object used by default
1439default for TLS mode. 1813for TLS mode.
1440 1814
1441The context is created like this: 1815The context is created by calling L<AnyEvent::TLS> without any arguments.
1442
1443 Net::SSLeay::load_error_strings;
1444 Net::SSLeay::SSLeay_add_ssl_algorithms;
1445 Net::SSLeay::randomize;
1446
1447 my $CTX = Net::SSLeay::CTX_new;
1448
1449 Net::SSLeay::CTX_set_options $CTX, Net::SSLeay::OP_ALL
1450 1816
1451=cut 1817=cut
1452 1818
1453our $TLS_CTX; 1819our $TLS_CTX;
1454 1820
1455sub TLS_CTX() { 1821sub TLS_CTX() {
1456 $TLS_CTX || do { 1822 $TLS_CTX ||= do {
1457 require Net::SSLeay; 1823 require AnyEvent::TLS;
1458 1824
1459 Net::SSLeay::load_error_strings (); 1825 new AnyEvent::TLS
1460 Net::SSLeay::SSLeay_add_ssl_algorithms ();
1461 Net::SSLeay::randomize ();
1462
1463 $TLS_CTX = Net::SSLeay::CTX_new ();
1464
1465 Net::SSLeay::CTX_set_options ($TLS_CTX, Net::SSLeay::OP_ALL ());
1466
1467 $TLS_CTX
1468 } 1826 }
1469} 1827}
1470 1828
1471=back 1829=back
1830
1831
1832=head1 NONFREQUENTLY ASKED QUESTIONS
1833
1834=over 4
1835
1836=item I C<undef> the AnyEvent::Handle reference inside my callback and
1837still get further invocations!
1838
1839That's because AnyEvent::Handle keeps a reference to itself when handling
1840read or write callbacks.
1841
1842It is only safe to "forget" the reference inside EOF or error callbacks,
1843from within all other callbacks, you need to explicitly call the C<<
1844->destroy >> method.
1845
1846=item I get different callback invocations in TLS mode/Why can't I pause
1847reading?
1848
1849Unlike, say, TCP, TLS connections do not consist of two independent
1850communication channels, one for each direction. Or put differently. The
1851read and write directions are not independent of each other: you cannot
1852write data unless you are also prepared to read, and vice versa.
1853
1854This can mean than, in TLS mode, you might get C<on_error> or C<on_eof>
1855callback invocations when you are not expecting any read data - the reason
1856is that AnyEvent::Handle always reads in TLS mode.
1857
1858During the connection, you have to make sure that you always have a
1859non-empty read-queue, or an C<on_read> watcher. At the end of the
1860connection (or when you no longer want to use it) you can call the
1861C<destroy> method.
1862
1863=item How do I read data until the other side closes the connection?
1864
1865If you just want to read your data into a perl scalar, the easiest way
1866to achieve this is by setting an C<on_read> callback that does nothing,
1867clearing the C<on_eof> callback and in the C<on_error> callback, the data
1868will be in C<$_[0]{rbuf}>:
1869
1870 $handle->on_read (sub { });
1871 $handle->on_eof (undef);
1872 $handle->on_error (sub {
1873 my $data = delete $_[0]{rbuf};
1874 });
1875
1876The reason to use C<on_error> is that TCP connections, due to latencies
1877and packets loss, might get closed quite violently with an error, when in
1878fact, all data has been received.
1879
1880It is usually better to use acknowledgements when transferring data,
1881to make sure the other side hasn't just died and you got the data
1882intact. This is also one reason why so many internet protocols have an
1883explicit QUIT command.
1884
1885=item I don't want to destroy the handle too early - how do I wait until
1886all data has been written?
1887
1888After writing your last bits of data, set the C<on_drain> callback
1889and destroy the handle in there - with the default setting of
1890C<low_water_mark> this will be called precisely when all data has been
1891written to the socket:
1892
1893 $handle->push_write (...);
1894 $handle->on_drain (sub {
1895 warn "all data submitted to the kernel\n";
1896 undef $handle;
1897 });
1898
1899If you just want to queue some data and then signal EOF to the other side,
1900consider using C<< ->push_shutdown >> instead.
1901
1902=item I want to contact a TLS/SSL server, I don't care about security.
1903
1904If your TLS server is a pure TLS server (e.g. HTTPS) that only speaks TLS,
1905simply connect to it and then create the AnyEvent::Handle with the C<tls>
1906parameter:
1907
1908 tcp_connect $host, $port, sub {
1909 my ($fh) = @_;
1910
1911 my $handle = new AnyEvent::Handle
1912 fh => $fh,
1913 tls => "connect",
1914 on_error => sub { ... };
1915
1916 $handle->push_write (...);
1917 };
1918
1919=item I want to contact a TLS/SSL server, I do care about security.
1920
1921Then you should additionally enable certificate verification, including
1922peername verification, if the protocol you use supports it (see
1923L<AnyEvent::TLS>, C<verify_peername>).
1924
1925E.g. for HTTPS:
1926
1927 tcp_connect $host, $port, sub {
1928 my ($fh) = @_;
1929
1930 my $handle = new AnyEvent::Handle
1931 fh => $fh,
1932 peername => $host,
1933 tls => "connect",
1934 tls_ctx => { verify => 1, verify_peername => "https" },
1935 ...
1936
1937Note that you must specify the hostname you connected to (or whatever
1938"peername" the protocol needs) as the C<peername> argument, otherwise no
1939peername verification will be done.
1940
1941The above will use the system-dependent default set of trusted CA
1942certificates. If you want to check against a specific CA, add the
1943C<ca_file> (or C<ca_cert>) arguments to C<tls_ctx>:
1944
1945 tls_ctx => {
1946 verify => 1,
1947 verify_peername => "https",
1948 ca_file => "my-ca-cert.pem",
1949 },
1950
1951=item I want to create a TLS/SSL server, how do I do that?
1952
1953Well, you first need to get a server certificate and key. You have
1954three options: a) ask a CA (buy one, use cacert.org etc.) b) create a
1955self-signed certificate (cheap. check the search engine of your choice,
1956there are many tutorials on the net) or c) make your own CA (tinyca2 is a
1957nice program for that purpose).
1958
1959Then create a file with your private key (in PEM format, see
1960L<AnyEvent::TLS>), followed by the certificate (also in PEM format). The
1961file should then look like this:
1962
1963 -----BEGIN RSA PRIVATE KEY-----
1964 ...header data
1965 ... lots of base64'y-stuff
1966 -----END RSA PRIVATE KEY-----
1967
1968 -----BEGIN CERTIFICATE-----
1969 ... lots of base64'y-stuff
1970 -----END CERTIFICATE-----
1971
1972The important bits are the "PRIVATE KEY" and "CERTIFICATE" parts. Then
1973specify this file as C<cert_file>:
1974
1975 tcp_server undef, $port, sub {
1976 my ($fh) = @_;
1977
1978 my $handle = new AnyEvent::Handle
1979 fh => $fh,
1980 tls => "accept",
1981 tls_ctx => { cert_file => "my-server-keycert.pem" },
1982 ...
1983
1984When you have intermediate CA certificates that your clients might not
1985know about, just append them to the C<cert_file>.
1986
1987=back
1988
1472 1989
1473=head1 SUBCLASSING AnyEvent::Handle 1990=head1 SUBCLASSING AnyEvent::Handle
1474 1991
1475In many cases, you might want to subclass AnyEvent::Handle. 1992In many cases, you might want to subclass AnyEvent::Handle.
1476 1993

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines