ViewVC Help
View File | Revision Log | Show Annotations | Download File
/cvs/AnyEvent/lib/AnyEvent/Handle.pm
(Generate patch)

Comparing AnyEvent/lib/AnyEvent/Handle.pm (file contents):
Revision 1.198 by root, Tue Aug 31 01:03:37 2010 UTC vs.
Revision 1.231 by root, Tue Mar 27 23:47:57 2012 UTC

11 11
12 my $hdl; $hdl = new AnyEvent::Handle 12 my $hdl; $hdl = new AnyEvent::Handle
13 fh => \*STDIN, 13 fh => \*STDIN,
14 on_error => sub { 14 on_error => sub {
15 my ($hdl, $fatal, $msg) = @_; 15 my ($hdl, $fatal, $msg) = @_;
16 warn "got error $msg\n"; 16 AE::log error => "Got error $msg!";
17 $hdl->destroy; 17 $hdl->destroy;
18 $cv->send; 18 $cv->send;
19 }; 19 };
20 20
21 # send some request line 21 # send some request line
22 $hdl->push_write ("getinfo\015\012"); 22 $hdl->push_write ("getinfo\015\012");
23 23
24 # read the response line 24 # read the response line
25 $hdl->push_read (line => sub { 25 $hdl->push_read (line => sub {
26 my ($hdl, $line) = @_; 26 my ($hdl, $line) = @_;
27 warn "got line <$line>\n"; 27 say "got line <$line>";
28 $cv->send; 28 $cv->send;
29 }); 29 });
30 30
31 $cv->recv; 31 $cv->recv;
32 32
75 } 75 }
76 76
77 \&$func 77 \&$func
78} 78}
79 79
80sub MAX_READ_SIZE() { 131072 }
81
80=head1 METHODS 82=head1 METHODS
81 83
82=over 4 84=over 4
83 85
84=item $handle = B<new> AnyEvent::Handle fh => $filehandle, key => value... 86=item $handle = B<new> AnyEvent::Handle fh => $filehandle, key => value...
112=over 4 114=over 4
113 115
114=item on_prepare => $cb->($handle) 116=item on_prepare => $cb->($handle)
115 117
116This (rarely used) callback is called before a new connection is 118This (rarely used) callback is called before a new connection is
117attempted, but after the file handle has been created. It could be used to 119attempted, but after the file handle has been created (you can access that
120file handle via C<< $handle->{fh} >>). It could be used to prepare the
118prepare the file handle with parameters required for the actual connect 121file handle with parameters required for the actual connect (as opposed to
119(as opposed to settings that can be changed when the connection is already 122settings that can be changed when the connection is already established).
120established).
121 123
122The return value of this callback should be the connect timeout value in 124The return value of this callback should be the connect timeout value in
123seconds (or C<0>, or C<undef>, or the empty list, to indicate that the 125seconds (or C<0>, or C<undef>, or the empty list, to indicate that the
124default timeout is to be used). 126default timeout is to be used).
125 127
126=item on_connect => $cb->($handle, $host, $port, $retry->()) 128=item on_connect => $cb->($handle, $host, $port, $retry->())
127 129
128This callback is called when a connection has been successfully established. 130This callback is called when a connection has been successfully established.
129 131
130The peer's numeric host and port (the socket peername) are passed as 132The peer's numeric host and port (the socket peername) are passed as
131parameters, together with a retry callback. 133parameters, together with a retry callback. At the time it is called the
134read and write queues, EOF status, TLS status and similar properties of
135the handle will have been reset.
132 136
137It is not allowed to use the read or write queues while the handle object
138is connecting.
139
133If, for some reason, the handle is not acceptable, calling C<$retry> 140If, for some reason, the handle is not acceptable, calling C<$retry> will
134will continue with the next connection target (in case of multi-homed 141continue with the next connection target (in case of multi-homed hosts or
135hosts or SRV records there can be multiple connection endpoints). At the 142SRV records there can be multiple connection endpoints). The C<$retry>
136time it is called the read and write queues, eof status, tls status and 143callback can be invoked after the connect callback returns, i.e. one can
137similar properties of the handle will have been reset. 144start a handshake and then decide to retry with the next host if the
145handshake fails.
138 146
139In most cases, you should ignore the C<$retry> parameter. 147In most cases, you should ignore the C<$retry> parameter.
140 148
141=item on_connect_error => $cb->($handle, $message) 149=item on_connect_error => $cb->($handle, $message)
142 150
157 165
158Some errors are fatal (which is indicated by C<$fatal> being true). On 166Some errors are fatal (which is indicated by C<$fatal> being true). On
159fatal errors the handle object will be destroyed (by a call to C<< -> 167fatal errors the handle object will be destroyed (by a call to C<< ->
160destroy >>) after invoking the error callback (which means you are free to 168destroy >>) after invoking the error callback (which means you are free to
161examine the handle object). Examples of fatal errors are an EOF condition 169examine the handle object). Examples of fatal errors are an EOF condition
162with active (but unsatisifable) read watchers (C<EPIPE>) or I/O errors. In 170with active (but unsatisfiable) read watchers (C<EPIPE>) or I/O errors. In
163cases where the other side can close the connection at will, it is 171cases where the other side can close the connection at will, it is
164often easiest to not report C<EPIPE> errors in this callback. 172often easiest to not report C<EPIPE> errors in this callback.
165 173
166AnyEvent::Handle tries to find an appropriate error code for you to check 174AnyEvent::Handle tries to find an appropriate error code for you to check
167against, but in some cases (TLS errors), this does not work well. It is 175against, but in some cases (TLS errors), this does not work well. It is
222If an EOF condition has been detected but no C<on_eof> callback has been 230If an EOF condition has been detected but no C<on_eof> callback has been
223set, then a fatal error will be raised with C<$!> set to <0>. 231set, then a fatal error will be raised with C<$!> set to <0>.
224 232
225=item on_drain => $cb->($handle) 233=item on_drain => $cb->($handle)
226 234
227This sets the callback that is called when the write buffer becomes empty 235This sets the callback that is called once when the write buffer becomes
228(or immediately if the buffer is empty already). 236empty (and immediately when the handle object is created).
229 237
230To append to the write buffer, use the C<< ->push_write >> method. 238To append to the write buffer, use the C<< ->push_write >> method.
231 239
232This callback is useful when you don't want to put all of your write data 240This callback is useful when you don't want to put all of your write data
233into the queue at once, for example, when you want to write the contents 241into the queue at once, for example, when you want to write the contents
245many seconds pass without a successful read or write on the underlying 253many seconds pass without a successful read or write on the underlying
246file handle (or a call to C<timeout_reset>), the C<on_timeout> callback 254file handle (or a call to C<timeout_reset>), the C<on_timeout> callback
247will be invoked (and if that one is missing, a non-fatal C<ETIMEDOUT> 255will be invoked (and if that one is missing, a non-fatal C<ETIMEDOUT>
248error will be raised). 256error will be raised).
249 257
250There are three variants of the timeouts that work independently 258There are three variants of the timeouts that work independently of each
251of each other, for both read and write, just read, and just write: 259other, for both read and write (triggered when nothing was read I<OR>
260written), just read (triggered when nothing was read), and just write:
252C<timeout>, C<rtimeout> and C<wtimeout>, with corresponding callbacks 261C<timeout>, C<rtimeout> and C<wtimeout>, with corresponding callbacks
253C<on_timeout>, C<on_rtimeout> and C<on_wtimeout>, and reset functions 262C<on_timeout>, C<on_rtimeout> and C<on_wtimeout>, and reset functions
254C<timeout_reset>, C<rtimeout_reset>, and C<wtimeout_reset>. 263C<timeout_reset>, C<rtimeout_reset>, and C<wtimeout_reset>.
255 264
256Note that timeout processing is active even when you do not have 265Note that timeout processing is active even when you do not have any
257any outstanding read or write requests: If you plan to keep the connection 266outstanding read or write requests: If you plan to keep the connection
258idle then you should disable the timeout temporarily or ignore the timeout 267idle then you should disable the timeout temporarily or ignore the
259in the C<on_timeout> callback, in which case AnyEvent::Handle will simply 268timeout in the corresponding C<on_timeout> callback, in which case
260restart the timeout. 269AnyEvent::Handle will simply restart the timeout.
261 270
262Zero (the default) disables this timeout. 271Zero (the default) disables the corresponding timeout.
263 272
264=item on_timeout => $cb->($handle) 273=item on_timeout => $cb->($handle)
274
275=item on_rtimeout => $cb->($handle)
276
277=item on_wtimeout => $cb->($handle)
265 278
266Called whenever the inactivity timeout passes. If you return from this 279Called whenever the inactivity timeout passes. If you return from this
267callback, then the timeout will be reset as if some activity had happened, 280callback, then the timeout will be reset as if some activity had happened,
268so this condition is not fatal in any way. 281so this condition is not fatal in any way.
269 282
276For example, a server accepting connections from untrusted sources should 289For example, a server accepting connections from untrusted sources should
277be configured to accept only so-and-so much data that it cannot act on 290be configured to accept only so-and-so much data that it cannot act on
278(for example, when expecting a line, an attacker could send an unlimited 291(for example, when expecting a line, an attacker could send an unlimited
279amount of data without a callback ever being called as long as the line 292amount of data without a callback ever being called as long as the line
280isn't finished). 293isn't finished).
294
295=item wbuf_max => <bytes>
296
297If defined, then a fatal error will be raised (with C<$!> set to C<ENOSPC>)
298when the write buffer ever (strictly) exceeds this size. This is useful to
299avoid some forms of denial-of-service attacks.
300
301Although the units of this parameter is bytes, this is the I<raw> number
302of bytes not yet accepted by the kernel. This can make a difference when
303you e.g. use TLS, as TLS typically makes your write data larger (but it
304can also make it smaller due to compression).
305
306As an example of when this limit is useful, take a chat server that sends
307chat messages to a client. If the client does not read those in a timely
308manner then the send buffer in the server would grow unbounded.
281 309
282=item autocork => <boolean> 310=item autocork => <boolean>
283 311
284When disabled (the default), C<push_write> will try to immediately 312When disabled (the default), C<push_write> will try to immediately
285write the data to the handle if possible. This avoids having to register 313write the data to the handle if possible. This avoids having to register
337already have occured on BSD systems), but at least it will protect you 365already have occured on BSD systems), but at least it will protect you
338from most attacks. 366from most attacks.
339 367
340=item read_size => <bytes> 368=item read_size => <bytes>
341 369
342The default read block size (the number of bytes this module will 370The initial read block size, the number of bytes this module will try
343try to read during each loop iteration, which affects memory 371to read during each loop iteration. Each handle object will consume
344requirements). Default: C<8192>. 372at least this amount of memory for the read buffer as well, so when
373handling many connections watch out for memory requirements). See also
374C<max_read_size>. Default: C<2048>.
375
376=item max_read_size => <bytes>
377
378The maximum read buffer size used by the dynamic adjustment
379algorithm: Each time AnyEvent::Handle can read C<read_size> bytes in
380one go it will double C<read_size> up to the maximum given by this
381option. Default: C<131072> or C<read_size>, whichever is higher.
345 382
346=item low_water_mark => <bytes> 383=item low_water_mark => <bytes>
347 384
348Sets the number of bytes (default: C<0>) that make up an "empty" write 385Sets the number of bytes (default: C<0>) that make up an "empty" write
349buffer: If the buffer reaches this size or gets even samller it is 386buffer: If the buffer reaches this size or gets even samller it is
412Use the C<< ->starttls >> method if you need to start TLS negotiation later. 449Use the C<< ->starttls >> method if you need to start TLS negotiation later.
413 450
414=item tls_ctx => $anyevent_tls 451=item tls_ctx => $anyevent_tls
415 452
416Use the given C<AnyEvent::TLS> object to create the new TLS connection 453Use the given C<AnyEvent::TLS> object to create the new TLS connection
417(unless a connection object was specified directly). If this parameter is 454(unless a connection object was specified directly). If this
418missing, then AnyEvent::Handle will use C<AnyEvent::Handle::TLS_CTX>. 455parameter is missing (or C<undef>), then AnyEvent::Handle will use
456C<AnyEvent::Handle::TLS_CTX>.
419 457
420Instead of an object, you can also specify a hash reference with C<< key 458Instead of an object, you can also specify a hash reference with C<< key
421=> value >> pairs. Those will be passed to L<AnyEvent::TLS> to create a 459=> value >> pairs. Those will be passed to L<AnyEvent::TLS> to create a
422new TLS context object. 460new TLS context object.
423 461
492 $self->{connect}[0], 530 $self->{connect}[0],
493 $self->{connect}[1], 531 $self->{connect}[1],
494 sub { 532 sub {
495 my ($fh, $host, $port, $retry) = @_; 533 my ($fh, $host, $port, $retry) = @_;
496 534
535 delete $self->{_connect}; # no longer needed
536
497 if ($fh) { 537 if ($fh) {
498 $self->{fh} = $fh; 538 $self->{fh} = $fh;
499 539
500 delete $self->{_skip_drain_rbuf}; 540 delete $self->{_skip_drain_rbuf};
501 $self->_start; 541 $self->_start;
508 }); 548 });
509 549
510 } else { 550 } else {
511 if ($self->{on_connect_error}) { 551 if ($self->{on_connect_error}) {
512 $self->{on_connect_error}($self, "$!"); 552 $self->{on_connect_error}($self, "$!");
513 $self->destroy; 553 $self->destroy if $self;
514 } else { 554 } else {
515 $self->_error ($!, 1); 555 $self->_error ($!, 1);
516 } 556 }
517 } 557 }
518 }, 558 },
519 sub { 559 sub {
520 local $self->{fh} = $_[0]; 560 local $self->{fh} = $_[0];
521 561
522 $self->{on_prepare} 562 $self->{on_prepare}
523 ? $self->{on_prepare}->($self) 563 ? $self->{on_prepare}->($self)
524 : () 564 : ()
525 } 565 }
526 ); 566 );
527 } 567 }
528 568
546 586
547 $self->{_activity} = 587 $self->{_activity} =
548 $self->{_ractivity} = 588 $self->{_ractivity} =
549 $self->{_wactivity} = AE::now; 589 $self->{_wactivity} = AE::now;
550 590
591 $self->{read_size} ||= 2048;
592 $self->{max_read_size} = $self->{read_size}
593 if $self->{read_size} > ($self->{max_read_size} || MAX_READ_SIZE);
594
551 $self->timeout (delete $self->{timeout} ) if $self->{timeout}; 595 $self->timeout (delete $self->{timeout} ) if $self->{timeout};
552 $self->rtimeout (delete $self->{rtimeout} ) if $self->{rtimeout}; 596 $self->rtimeout (delete $self->{rtimeout} ) if $self->{rtimeout};
553 $self->wtimeout (delete $self->{wtimeout} ) if $self->{wtimeout}; 597 $self->wtimeout (delete $self->{wtimeout} ) if $self->{wtimeout};
554 598
555 $self->no_delay (delete $self->{no_delay} ) if exists $self->{no_delay} && $self->{no_delay}; 599 $self->no_delay (delete $self->{no_delay} ) if exists $self->{no_delay} && $self->{no_delay};
558 $self->oobinline (exists $self->{oobinline} ? delete $self->{oobinline} : 1); 602 $self->oobinline (exists $self->{oobinline} ? delete $self->{oobinline} : 1);
559 603
560 $self->starttls (delete $self->{tls}, delete $self->{tls_ctx}) 604 $self->starttls (delete $self->{tls}, delete $self->{tls_ctx})
561 if $self->{tls}; 605 if $self->{tls};
562 606
563 $self->on_drain (delete $self->{on_drain}) if $self->{on_drain}; 607 $self->on_drain (delete $self->{on_drain} ) if $self->{on_drain};
564 608
565 $self->start_read 609 $self->start_read
566 if $self->{on_read} || @{ $self->{_queue} }; 610 if $self->{on_read} || @{ $self->{_queue} };
567 611
568 $self->_drain_wbuf; 612 $self->_drain_wbuf;
644=cut 688=cut
645 689
646sub no_delay { 690sub no_delay {
647 $_[0]{no_delay} = $_[1]; 691 $_[0]{no_delay} = $_[1];
648 692
649 eval {
650 local $SIG{__DIE__};
651 setsockopt $_[0]{fh}, Socket::IPPROTO_TCP (), Socket::TCP_NODELAY (), int $_[1] 693 setsockopt $_[0]{fh}, Socket::IPPROTO_TCP (), Socket::TCP_NODELAY (), int $_[1]
652 if $_[0]{fh}; 694 if $_[0]{fh};
653 };
654} 695}
655 696
656=item $handle->keepalive ($boolean) 697=item $handle->keepalive ($boolean)
657 698
658Enables or disables the C<keepalive> setting (see constructor argument of 699Enables or disables the C<keepalive> setting (see constructor argument of
726 767
727=item $handle->rbuf_max ($max_octets) 768=item $handle->rbuf_max ($max_octets)
728 769
729Configures the C<rbuf_max> setting (C<undef> disables it). 770Configures the C<rbuf_max> setting (C<undef> disables it).
730 771
772=item $handle->wbuf_max ($max_octets)
773
774Configures the C<wbuf_max> setting (C<undef> disables it).
775
731=cut 776=cut
732 777
733sub rbuf_max { 778sub rbuf_max {
734 $_[0]{rbuf_max} = $_[1]; 779 $_[0]{rbuf_max} = $_[1];
735} 780}
736 781
782sub wbuf_max {
783 $_[0]{wbuf_max} = $_[1];
784}
785
737############################################################################# 786#############################################################################
738 787
739=item $handle->timeout ($seconds) 788=item $handle->timeout ($seconds)
740 789
741=item $handle->rtimeout ($seconds) 790=item $handle->rtimeout ($seconds)
742 791
743=item $handle->wtimeout ($seconds) 792=item $handle->wtimeout ($seconds)
744 793
745Configures (or disables) the inactivity timeout. 794Configures (or disables) the inactivity timeout.
795
796The timeout will be checked instantly, so this method might destroy the
797handle before it returns.
746 798
747=item $handle->timeout_reset 799=item $handle->timeout_reset
748 800
749=item $handle->rtimeout_reset 801=item $handle->rtimeout_reset
750 802
767 $_[0]{$on_timeout} = $_[1]; 819 $_[0]{$on_timeout} = $_[1];
768 }; 820 };
769 821
770 *$timeout = sub { 822 *$timeout = sub {
771 my ($self, $new_value) = @_; 823 my ($self, $new_value) = @_;
824
825 $new_value >= 0
826 or Carp::croak "AnyEvent::Handle->$timeout called with negative timeout ($new_value), caught";
772 827
773 $self->{$timeout} = $new_value; 828 $self->{$timeout} = $new_value;
774 delete $self->{$tw}; &$cb; 829 delete $self->{$tw}; &$cb;
775 }; 830 };
776 831
831 886
832The write queue is very simple: you can add data to its end, and 887The write queue is very simple: you can add data to its end, and
833AnyEvent::Handle will automatically try to get rid of it for you. 888AnyEvent::Handle will automatically try to get rid of it for you.
834 889
835When data could be written and the write buffer is shorter then the low 890When data could be written and the write buffer is shorter then the low
836water mark, the C<on_drain> callback will be invoked. 891water mark, the C<on_drain> callback will be invoked once.
837 892
838=over 4 893=over 4
839 894
840=item $handle->on_drain ($cb) 895=item $handle->on_drain ($cb)
841 896
856 if $cb && $self->{low_water_mark} >= (length $self->{wbuf}) + (length $self->{_tls_wbuf}); 911 if $cb && $self->{low_water_mark} >= (length $self->{wbuf}) + (length $self->{_tls_wbuf});
857} 912}
858 913
859=item $handle->push_write ($data) 914=item $handle->push_write ($data)
860 915
861Queues the given scalar to be written. You can push as much data as you 916Queues the given scalar to be written. You can push as much data as
862want (only limited by the available memory), as C<AnyEvent::Handle> 917you want (only limited by the available memory and C<wbuf_max>), as
863buffers it independently of the kernel. 918C<AnyEvent::Handle> buffers it independently of the kernel.
864 919
865This method may invoke callbacks (and therefore the handle might be 920This method may invoke callbacks (and therefore the handle might be
866destroyed after it returns). 921destroyed after it returns).
867 922
868=cut 923=cut
896 $cb->() unless $self->{autocork}; 951 $cb->() unless $self->{autocork};
897 952
898 # if still data left in wbuf, we need to poll 953 # if still data left in wbuf, we need to poll
899 $self->{_ww} = AE::io $self->{fh}, 1, $cb 954 $self->{_ww} = AE::io $self->{fh}, 1, $cb
900 if length $self->{wbuf}; 955 if length $self->{wbuf};
956
957 if (
958 defined $self->{wbuf_max}
959 && $self->{wbuf_max} < length $self->{wbuf}
960 ) {
961 $self->_error (Errno::ENOSPC, 1), return;
962 }
901 }; 963 };
902} 964}
903 965
904our %WH; 966our %WH;
905 967
1025=cut 1087=cut
1026 1088
1027register_write_type storable => sub { 1089register_write_type storable => sub {
1028 my ($self, $ref) = @_; 1090 my ($self, $ref) = @_;
1029 1091
1030 require Storable; 1092 require Storable unless $Storable::VERSION;
1031 1093
1032 pack "w/a*", Storable::nfreeze ($ref) 1094 pack "w/a*", Storable::nfreeze ($ref)
1033}; 1095};
1034 1096
1035=back 1097=back
1040before it was actually written. One way to do that is to replace your 1102before it was actually written. One way to do that is to replace your
1041C<on_drain> handler by a callback that shuts down the socket (and set 1103C<on_drain> handler by a callback that shuts down the socket (and set
1042C<low_water_mark> to C<0>). This method is a shorthand for just that, and 1104C<low_water_mark> to C<0>). This method is a shorthand for just that, and
1043replaces the C<on_drain> callback with: 1105replaces the C<on_drain> callback with:
1044 1106
1045 sub { shutdown $_[0]{fh}, 1 } # for push_shutdown 1107 sub { shutdown $_[0]{fh}, 1 }
1046 1108
1047This simply shuts down the write side and signals an EOF condition to the 1109This simply shuts down the write side and signals an EOF condition to the
1048the peer. 1110the peer.
1049 1111
1050You can rely on the normal read queue and C<on_eof> handling 1112You can rely on the normal read queue and C<on_eof> handling
1072 1134
1073Whenever the given C<type> is used, C<push_write> will the function with 1135Whenever the given C<type> is used, C<push_write> will the function with
1074the handle object and the remaining arguments. 1136the handle object and the remaining arguments.
1075 1137
1076The function is supposed to return a single octet string that will be 1138The function is supposed to return a single octet string that will be
1077appended to the write buffer, so you cna mentally treat this function as a 1139appended to the write buffer, so you can mentally treat this function as a
1078"arguments to on-the-wire-format" converter. 1140"arguments to on-the-wire-format" converter.
1079 1141
1080Example: implement a custom write type C<join> that joins the remaining 1142Example: implement a custom write type C<join> that joins the remaining
1081arguments using the first one. 1143arguments using the first one.
1082 1144
1271 $self->_drain_rbuf if $cb; 1333 $self->_drain_rbuf if $cb;
1272} 1334}
1273 1335
1274=item $handle->rbuf 1336=item $handle->rbuf
1275 1337
1276Returns the read buffer (as a modifiable lvalue). 1338Returns the read buffer (as a modifiable lvalue). You can also access the
1339read buffer directly as the C<< ->{rbuf} >> member, if you want (this is
1340much faster, and no less clean).
1277 1341
1278You can access the read buffer directly as the C<< ->{rbuf} >> 1342The only operation allowed on the read buffer (apart from looking at it)
1279member, if you want. However, the only operation allowed on the 1343is removing data from its beginning. Otherwise modifying or appending to
1280read buffer (apart from looking at it) is removing data from its 1344it is not allowed and will lead to hard-to-track-down bugs.
1281beginning. Otherwise modifying or appending to it is not allowed and will
1282lead to hard-to-track-down bugs.
1283 1345
1284NOTE: The read buffer should only be used or modified if the C<on_read>, 1346NOTE: The read buffer should only be used or modified in the C<on_read>
1285C<push_read> or C<unshift_read> methods are used. The other read methods 1347callback or when C<push_read> or C<unshift_read> are used with a single
1286automatically manage the read buffer. 1348callback (i.e. untyped). Typed C<push_read> and C<unshift_read> methods
1349will manage the read buffer on their own.
1287 1350
1288=cut 1351=cut
1289 1352
1290sub rbuf : lvalue { 1353sub rbuf : lvalue {
1291 $_[0]{rbuf} 1354 $_[0]{rbuf}
1342 my $cb = pop; 1405 my $cb = pop;
1343 1406
1344 if (@_) { 1407 if (@_) {
1345 my $type = shift; 1408 my $type = shift;
1346 1409
1410 $cb = ($RH{$type} ||= _load_func "$type\::anyevent_read_type"
1347 $cb = ($RH{$type} or Carp::croak "unsupported type passed to AnyEvent::Handle::unshift_read") 1411 or Carp::croak "unsupported/unloadable type '$type' passed to AnyEvent::Handle::unshift_read")
1348 ->($self, $cb, @_); 1412 ->($self, $cb, @_);
1349 } 1413 }
1350 1414
1351 unshift @{ $self->{_queue} }, $cb; 1415 unshift @{ $self->{_queue} }, $cb;
1352 $self->_drain_rbuf; 1416 $self->_drain_rbuf;
1374data. 1438data.
1375 1439
1376Example: read 2 bytes. 1440Example: read 2 bytes.
1377 1441
1378 $handle->push_read (chunk => 2, sub { 1442 $handle->push_read (chunk => 2, sub {
1379 warn "yay ", unpack "H*", $_[1]; 1443 say "yay " . unpack "H*", $_[1];
1380 }); 1444 });
1381 1445
1382=cut 1446=cut
1383 1447
1384register_read_type chunk => sub { 1448register_read_type chunk => sub {
1418 if (@_ < 3) { 1482 if (@_ < 3) {
1419 # this is more than twice as fast as the generic code below 1483 # this is more than twice as fast as the generic code below
1420 sub { 1484 sub {
1421 $_[0]{rbuf} =~ s/^([^\015\012]*)(\015?\012)// or return; 1485 $_[0]{rbuf} =~ s/^([^\015\012]*)(\015?\012)// or return;
1422 1486
1423 $cb->($_[0], $1, $2); 1487 $cb->($_[0], "$1", "$2");
1424 1 1488 1
1425 } 1489 }
1426 } else { 1490 } else {
1427 $eol = quotemeta $eol unless ref $eol; 1491 $eol = quotemeta $eol unless ref $eol;
1428 $eol = qr|^(.*?)($eol)|s; 1492 $eol = qr|^(.*?)($eol)|s;
1429 1493
1430 sub { 1494 sub {
1431 $_[0]{rbuf} =~ s/$eol// or return; 1495 $_[0]{rbuf} =~ s/$eol// or return;
1432 1496
1433 $cb->($_[0], $1, $2); 1497 $cb->($_[0], "$1", "$2");
1434 1 1498 1
1435 } 1499 }
1436 } 1500 }
1437}; 1501};
1438 1502
1486 1550
1487 sub { 1551 sub {
1488 # accept 1552 # accept
1489 if ($$rbuf =~ $accept) { 1553 if ($$rbuf =~ $accept) {
1490 $data .= substr $$rbuf, 0, $+[0], ""; 1554 $data .= substr $$rbuf, 0, $+[0], "";
1491 $cb->($self, $data); 1555 $cb->($_[0], $data);
1492 return 1; 1556 return 1;
1493 } 1557 }
1494 1558
1495 # reject 1559 # reject
1496 if ($reject && $$rbuf =~ $reject) { 1560 if ($reject && $$rbuf =~ $reject) {
1497 $self->_error (Errno::EBADMSG); 1561 $_[0]->_error (Errno::EBADMSG);
1498 } 1562 }
1499 1563
1500 # skip 1564 # skip
1501 if ($skip && $$rbuf =~ $skip) { 1565 if ($skip && $$rbuf =~ $skip) {
1502 $data .= substr $$rbuf, 0, $+[0], ""; 1566 $data .= substr $$rbuf, 0, $+[0], "";
1518 my ($self, $cb) = @_; 1582 my ($self, $cb) = @_;
1519 1583
1520 sub { 1584 sub {
1521 unless ($_[0]{rbuf} =~ s/^(0|[1-9][0-9]*)://) { 1585 unless ($_[0]{rbuf} =~ s/^(0|[1-9][0-9]*)://) {
1522 if ($_[0]{rbuf} =~ /[^0-9]/) { 1586 if ($_[0]{rbuf} =~ /[^0-9]/) {
1523 $self->_error (Errno::EBADMSG); 1587 $_[0]->_error (Errno::EBADMSG);
1524 } 1588 }
1525 return; 1589 return;
1526 } 1590 }
1527 1591
1528 my $len = $1; 1592 my $len = $1;
1529 1593
1530 $self->unshift_read (chunk => $len, sub { 1594 $_[0]->unshift_read (chunk => $len, sub {
1531 my $string = $_[1]; 1595 my $string = $_[1];
1532 $_[0]->unshift_read (chunk => 1, sub { 1596 $_[0]->unshift_read (chunk => 1, sub {
1533 if ($_[1] eq ",") { 1597 if ($_[1] eq ",") {
1534 $cb->($_[0], $string); 1598 $cb->($_[0], $string);
1535 } else { 1599 } else {
1536 $self->_error (Errno::EBADMSG); 1600 $_[0]->_error (Errno::EBADMSG);
1537 } 1601 }
1538 }); 1602 });
1539 }); 1603 });
1540 1604
1541 1 1605 1
1614 1678
1615 my $data; 1679 my $data;
1616 my $rbuf = \$self->{rbuf}; 1680 my $rbuf = \$self->{rbuf};
1617 1681
1618 sub { 1682 sub {
1619 my $ref = eval { $json->incr_parse ($self->{rbuf}) }; 1683 my $ref = eval { $json->incr_parse ($_[0]{rbuf}) };
1620 1684
1621 if ($ref) { 1685 if ($ref) {
1622 $self->{rbuf} = $json->incr_text; 1686 $_[0]{rbuf} = $json->incr_text;
1623 $json->incr_text = ""; 1687 $json->incr_text = "";
1624 $cb->($self, $ref); 1688 $cb->($_[0], $ref);
1625 1689
1626 1 1690 1
1627 } elsif ($@) { 1691 } elsif ($@) {
1628 # error case 1692 # error case
1629 $json->incr_skip; 1693 $json->incr_skip;
1630 1694
1631 $self->{rbuf} = $json->incr_text; 1695 $_[0]{rbuf} = $json->incr_text;
1632 $json->incr_text = ""; 1696 $json->incr_text = "";
1633 1697
1634 $self->_error (Errno::EBADMSG); 1698 $_[0]->_error (Errno::EBADMSG);
1635 1699
1636 () 1700 ()
1637 } else { 1701 } else {
1638 $self->{rbuf} = ""; 1702 $_[0]{rbuf} = "";
1639 1703
1640 () 1704 ()
1641 } 1705 }
1642 } 1706 }
1643}; 1707};
1653=cut 1717=cut
1654 1718
1655register_read_type storable => sub { 1719register_read_type storable => sub {
1656 my ($self, $cb) = @_; 1720 my ($self, $cb) = @_;
1657 1721
1658 require Storable; 1722 require Storable unless $Storable::VERSION;
1659 1723
1660 sub { 1724 sub {
1661 # when we can use 5.10 we can use ".", but for 5.8 we use the re-pack method 1725 # when we can use 5.10 we can use ".", but for 5.8 we use the re-pack method
1662 defined (my $len = eval { unpack "w", $_[0]{rbuf} }) 1726 defined (my $len = eval { unpack "w", $_[0]{rbuf} })
1663 or return; 1727 or return;
1676 # read remaining chunk 1740 # read remaining chunk
1677 $_[0]->unshift_read (chunk => $len, sub { 1741 $_[0]->unshift_read (chunk => $len, sub {
1678 if (my $ref = eval { Storable::thaw ($_[1]) }) { 1742 if (my $ref = eval { Storable::thaw ($_[1]) }) {
1679 $cb->($_[0], $ref); 1743 $cb->($_[0], $ref);
1680 } else { 1744 } else {
1681 $self->_error (Errno::EBADMSG); 1745 $_[0]->_error (Errno::EBADMSG);
1682 } 1746 }
1683 }); 1747 });
1684 } 1748 }
1685 1749
1686 1 1750 1
1724Note that AnyEvent::Handle will automatically C<start_read> for you when 1788Note that AnyEvent::Handle will automatically C<start_read> for you when
1725you change the C<on_read> callback or push/unshift a read callback, and it 1789you change the C<on_read> callback or push/unshift a read callback, and it
1726will automatically C<stop_read> for you when neither C<on_read> is set nor 1790will automatically C<stop_read> for you when neither C<on_read> is set nor
1727there are any read requests in the queue. 1791there are any read requests in the queue.
1728 1792
1729These methods will have no effect when in TLS mode (as TLS doesn't support 1793In older versions of this module (<= 5.3), these methods had no effect,
1730half-duplex connections). 1794as TLS does not support half-duplex connections. In current versions they
1795work as expected, as this behaviour is required to avoid certain resource
1796attacks, where the program would be forced to read (and buffer) arbitrary
1797amounts of data before being able to send some data. The drawback is that
1798some readings of the the SSL/TLS specifications basically require this
1799attack to be working, as SSL/TLS implementations might stall sending data
1800during a rehandshake.
1801
1802As a guideline, during the initial handshake, you should not stop reading,
1803and as a client, it might cause problems, depending on your application.
1731 1804
1732=cut 1805=cut
1733 1806
1734sub stop_read { 1807sub stop_read {
1735 my ($self) = @_; 1808 my ($self) = @_;
1736 1809
1737 delete $self->{_rw} unless $self->{tls}; 1810 delete $self->{_rw};
1738} 1811}
1739 1812
1740sub start_read { 1813sub start_read {
1741 my ($self) = @_; 1814 my ($self) = @_;
1742 1815
1743 unless ($self->{_rw} || $self->{_eof} || !$self->{fh}) { 1816 unless ($self->{_rw} || $self->{_eof} || !$self->{fh}) {
1744 Scalar::Util::weaken $self; 1817 Scalar::Util::weaken $self;
1745 1818
1746 $self->{_rw} = AE::io $self->{fh}, 0, sub { 1819 $self->{_rw} = AE::io $self->{fh}, 0, sub {
1747 my $rbuf = \($self->{tls} ? my $buf : $self->{rbuf}); 1820 my $rbuf = \($self->{tls} ? my $buf : $self->{rbuf});
1748 my $len = sysread $self->{fh}, $$rbuf, $self->{read_size} || 8192, length $$rbuf; 1821 my $len = sysread $self->{fh}, $$rbuf, $self->{read_size}, length $$rbuf;
1749 1822
1750 if ($len > 0) { 1823 if ($len > 0) {
1751 $self->{_activity} = $self->{_ractivity} = AE::now; 1824 $self->{_activity} = $self->{_ractivity} = AE::now;
1752 1825
1753 if ($self->{tls}) { 1826 if ($self->{tls}) {
1754 Net::SSLeay::BIO_write ($self->{_rbio}, $$rbuf); 1827 Net::SSLeay::BIO_write ($self->{_rbio}, $$rbuf);
1755 1828
1756 &_dotls ($self); 1829 &_dotls ($self);
1757 } else { 1830 } else {
1758 $self->_drain_rbuf; 1831 $self->_drain_rbuf;
1832 }
1833
1834 if ($len == $self->{read_size}) {
1835 $self->{read_size} *= 2;
1836 $self->{read_size} = $self->{max_read_size} || MAX_READ_SIZE
1837 if $self->{read_size} > ($self->{max_read_size} || MAX_READ_SIZE);
1759 } 1838 }
1760 1839
1761 } elsif (defined $len) { 1840 } elsif (defined $len) {
1762 delete $self->{_rw}; 1841 delete $self->{_rw};
1763 $self->{_eof} = 1; 1842 $self->{_eof} = 1;
1938 Net::SSLeay::CTX_set_mode ($tls, 1|2); 2017 Net::SSLeay::CTX_set_mode ($tls, 1|2);
1939 2018
1940 $self->{_rbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ()); 2019 $self->{_rbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ());
1941 $self->{_wbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ()); 2020 $self->{_wbio} = Net::SSLeay::BIO_new (Net::SSLeay::BIO_s_mem ());
1942 2021
1943 Net::SSLeay::BIO_write ($self->{_rbio}, delete $self->{rbuf}); 2022 Net::SSLeay::BIO_write ($self->{_rbio}, $self->{rbuf});
2023 $self->{rbuf} = "";
1944 2024
1945 Net::SSLeay::set_bio ($tls, $self->{_rbio}, $self->{_wbio}); 2025 Net::SSLeay::set_bio ($tls, $self->{_rbio}, $self->{_wbio});
1946 2026
1947 $self->{_on_starttls} = sub { $_[0]{on_starttls}(@_) } 2027 $self->{_on_starttls} = sub { $_[0]{on_starttls}(@_) }
1948 if $self->{on_starttls}; 2028 if $self->{on_starttls};
1986 if $self->{tls} > 0; 2066 if $self->{tls} > 0;
1987 2067
1988 delete @$self{qw(_rbio _wbio _tls_wbuf _on_starttls)}; 2068 delete @$self{qw(_rbio _wbio _tls_wbuf _on_starttls)};
1989} 2069}
1990 2070
2071=item $handle->resettls
2072
2073This rarely-used method simply resets and TLS state on the handle, usually
2074causing data loss.
2075
2076One case where it may be useful is when you want to skip over the data in
2077the stream but you are not interested in interpreting it, so data loss is
2078no concern.
2079
2080=cut
2081
2082*resettls = \&_freetls;
2083
1991sub DESTROY { 2084sub DESTROY {
1992 my ($self) = @_; 2085 my ($self) = @_;
1993 2086
1994 &_freetls; 2087 &_freetls;
1995 2088
2004 push @linger, AE::io $fh, 1, sub { 2097 push @linger, AE::io $fh, 1, sub {
2005 my $len = syswrite $fh, $wbuf, length $wbuf; 2098 my $len = syswrite $fh, $wbuf, length $wbuf;
2006 2099
2007 if ($len > 0) { 2100 if ($len > 0) {
2008 substr $wbuf, 0, $len, ""; 2101 substr $wbuf, 0, $len, "";
2009 } else { 2102 } elsif (defined $len || ($! != EAGAIN && $! != EINTR && $! != WSAEWOULDBLOCK)) {
2010 @linger = (); # end 2103 @linger = (); # end
2011 } 2104 }
2012 }; 2105 };
2013 push @linger, AE::timer $linger, 0, sub { 2106 push @linger, AE::timer $linger, 0, sub {
2014 @linger = (); 2107 @linger = ();
2110 2203
2111It is only safe to "forget" the reference inside EOF or error callbacks, 2204It is only safe to "forget" the reference inside EOF or error callbacks,
2112from within all other callbacks, you need to explicitly call the C<< 2205from within all other callbacks, you need to explicitly call the C<<
2113->destroy >> method. 2206->destroy >> method.
2114 2207
2208=item Why is my C<on_eof> callback never called?
2209
2210Probably because your C<on_error> callback is being called instead: When
2211you have outstanding requests in your read queue, then an EOF is
2212considered an error as you clearly expected some data.
2213
2214To avoid this, make sure you have an empty read queue whenever your handle
2215is supposed to be "idle" (i.e. connection closes are O.K.). You can set
2216an C<on_read> handler that simply pushes the first read requests in the
2217queue.
2218
2219See also the next question, which explains this in a bit more detail.
2220
2221=item How can I serve requests in a loop?
2222
2223Most protocols consist of some setup phase (authentication for example)
2224followed by a request handling phase, where the server waits for requests
2225and handles them, in a loop.
2226
2227There are two important variants: The first (traditional, better) variant
2228handles requests until the server gets some QUIT command, causing it to
2229close the connection first (highly desirable for a busy TCP server). A
2230client dropping the connection is an error, which means this variant can
2231detect an unexpected detection close.
2232
2233To handle this case, always make sure you have a on-empty read queue, by
2234pushing the "read request start" handler on it:
2235
2236 # we assume a request starts with a single line
2237 my @start_request; @start_request = (line => sub {
2238 my ($hdl, $line) = @_;
2239
2240 ... handle request
2241
2242 # push next request read, possibly from a nested callback
2243 $hdl->push_read (@start_request);
2244 });
2245
2246 # auth done, now go into request handling loop
2247 # now push the first @start_request
2248 $hdl->push_read (@start_request);
2249
2250By always having an outstanding C<push_read>, the handle always expects
2251some data and raises the C<EPIPE> error when the connction is dropped
2252unexpectedly.
2253
2254The second variant is a protocol where the client can drop the connection
2255at any time. For TCP, this means that the server machine may run out of
2256sockets easier, and in general, it means you cannot distinguish a protocl
2257failure/client crash from a normal connection close. Nevertheless, these
2258kinds of protocols are common (and sometimes even the best solution to the
2259problem).
2260
2261Having an outstanding read request at all times is possible if you ignore
2262C<EPIPE> errors, but this doesn't help with when the client drops the
2263connection during a request, which would still be an error.
2264
2265A better solution is to push the initial request read in an C<on_read>
2266callback. This avoids an error, as when the server doesn't expect data
2267(i.e. is idly waiting for the next request, an EOF will not raise an
2268error, but simply result in an C<on_eof> callback. It is also a bit slower
2269and simpler:
2270
2271 # auth done, now go into request handling loop
2272 $hdl->on_read (sub {
2273 my ($hdl) = @_;
2274
2275 # called each time we receive data but the read queue is empty
2276 # simply start read the request
2277
2278 $hdl->push_read (line => sub {
2279 my ($hdl, $line) = @_;
2280
2281 ... handle request
2282
2283 # do nothing special when the request has been handled, just
2284 # let the request queue go empty.
2285 });
2286 });
2287
2115=item I get different callback invocations in TLS mode/Why can't I pause 2288=item I get different callback invocations in TLS mode/Why can't I pause
2116reading? 2289reading?
2117 2290
2118Unlike, say, TCP, TLS connections do not consist of two independent 2291Unlike, say, TCP, TLS connections do not consist of two independent
2119communication channels, one for each direction. Or put differently, the 2292communication channels, one for each direction. Or put differently, the
2140 $handle->on_eof (undef); 2313 $handle->on_eof (undef);
2141 $handle->on_error (sub { 2314 $handle->on_error (sub {
2142 my $data = delete $_[0]{rbuf}; 2315 my $data = delete $_[0]{rbuf};
2143 }); 2316 });
2144 2317
2318Note that this example removes the C<rbuf> member from the handle object,
2319which is not normally allowed by the API. It is expressly permitted in
2320this case only, as the handle object needs to be destroyed afterwards.
2321
2145The reason to use C<on_error> is that TCP connections, due to latencies 2322The reason to use C<on_error> is that TCP connections, due to latencies
2146and packets loss, might get closed quite violently with an error, when in 2323and packets loss, might get closed quite violently with an error, when in
2147fact all data has been received. 2324fact all data has been received.
2148 2325
2149It is usually better to use acknowledgements when transferring data, 2326It is usually better to use acknowledgements when transferring data,
2159C<low_water_mark> this will be called precisely when all data has been 2336C<low_water_mark> this will be called precisely when all data has been
2160written to the socket: 2337written to the socket:
2161 2338
2162 $handle->push_write (...); 2339 $handle->push_write (...);
2163 $handle->on_drain (sub { 2340 $handle->on_drain (sub {
2164 warn "all data submitted to the kernel\n"; 2341 AE::log debug => "All data submitted to the kernel.";
2165 undef $handle; 2342 undef $handle;
2166 }); 2343 });
2167 2344
2168If you just want to queue some data and then signal EOF to the other side, 2345If you just want to queue some data and then signal EOF to the other side,
2169consider using C<< ->push_shutdown >> instead. 2346consider using C<< ->push_shutdown >> instead.
2253When you have intermediate CA certificates that your clients might not 2430When you have intermediate CA certificates that your clients might not
2254know about, just append them to the C<cert_file>. 2431know about, just append them to the C<cert_file>.
2255 2432
2256=back 2433=back
2257 2434
2258
2259=head1 SUBCLASSING AnyEvent::Handle 2435=head1 SUBCLASSING AnyEvent::Handle
2260 2436
2261In many cases, you might want to subclass AnyEvent::Handle. 2437In many cases, you might want to subclass AnyEvent::Handle.
2262 2438
2263To make this easier, a given version of AnyEvent::Handle uses these 2439To make this easier, a given version of AnyEvent::Handle uses these
2289 2465
2290Robin Redeker C<< <elmex at ta-sa.org> >>, Marc Lehmann <schmorp@schmorp.de>. 2466Robin Redeker C<< <elmex at ta-sa.org> >>, Marc Lehmann <schmorp@schmorp.de>.
2291 2467
2292=cut 2468=cut
2293 2469
22941; # End of AnyEvent::Handle 24701
2471

Diff Legend

Removed lines
+ Added lines
< Changed lines
> Changed lines