[ViewVC] Annotation of: cvs/AnyEvent-HTTP/Changes

Revision history for AnyEvent::HTTP

TODO: provide lwp_request function that takes an lwp http requets and returns a http response.
TODO: set_proxy hook
TODO: use proxy hook
TODO: on_upgrade, for 101 responses?
TODO: document session vs. sessionid correctly.
TODO: support proxy username:password in both proxy switch and set_proxy string (dzagashev@gmail.com)
TODO: remove "unexpectedly got a destructed handle"

TODO: maybe read big chunks in smaller portions for chunked-encoding + on_body.
TODO: callback as body (Kostirya)
TODO: infinite recursion(?) (Kostirya)
TODO: default rbuf_max value maybe? how about reading large chunks in small parts?
TODO: servers send empty reason, which then gets mangled with linear whitespace CRLF - maybe workaround?

TODO: look into http 0.9 support (Kostirya <kostirya@gmail.com>)
TODO: http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO1&Sect2=HITOFF&%23038;d=PG01&%23038;p=1&%23038;u=/netahtml/PTO/srchnum.html&%23038;r=1&%23038;f=G&%23038;l=50&%23038;s1="20110298798".PGNR.&%23038;OS=DN/20110298798&%23038;RS=DN/20110298798

2.25
        - further improve relative redirection code.
        - comment out code that tried to detect possible bugs with persistent
          connection caching, but since it never triggered, it's probably
          working fine :)

2.24
        - do not call on_body callback on a response that AE::HTTP will recurse
          on internally (reported by Антон Онуфриев and Ruslan Zakirov).

2.23 Sun Aug 28 11:30:33 CEST 2016
        - relative redirects used the proxy schema instead of the request
          url schema to generate the new url, which is wrong (analyzed by Felix
          Ostmann).
        - fix download example (reported by Felix Ostmann).

2.22 Thu May 14 04:04:03 CEST 2015
        - ipv6 literals were not correctly parsed (analyzed by Raphael Geissert).
        - delete the body when mutating request to GET request when
          redirecting (reported by joe trader).
        - send proxy-authorization header to proxy when using CONNECT
          (reported by dzagashev@gmail.com).
        - do not send Proxy-Authroization header when not using a proxy.
        - when retrying a persistent request, switch persistency off.
        - added t/02_ip_literals.t.

2.21 Mon Jun  9 01:35:54 CEST 2014
        - correctly keep body when redirecting POSTs, instead of
          deleting them.

2.2  Mon Jun  9 01:31:46 CEST 2014
        - connection header was malformed (patch by Raphael Geissert).
        - add lots of known idempotent methods from httpbis.
        - implement relative location headers (rfc 7231), with fallback on URI.
        - add support for status code 308 from rfc 7238.
        - recommend URI.

2.15 Wed Nov 14 23:22:07 CET 2012
        - use the recurse parameter to also limit the number of retries to be
          done, avodiing endless loops with broken servers, as reported
          by Carl Chambers.

2.14 Sun Apr 22 14:57:51 CEST 2012
        - Time::Local::timegm croaks on out-of-range values. Don't let
          this disturb AnyEvent::HTTP (reported by: tell me, I forgot...).

2.13 Wed Jul 27 17:53:58 CEST 2011
        - garbled chunked responses caused AnyEvent::HTTP to malfunction
          (patch by Dmitri Melikyan).
        - fix GET => HEAD in one case in the documentation (James Bromberger).

2.12 Tue Jun 14 07:22:54 CEST 2011
        - fix a possible 'Can't call method "destroyed"' error (which would
          have been reported by Carl Chambers).

2.11 Tue May 10 14:33:28 CEST 2011
        - the keepalive session cache wouldn't take port and scheme into account
          when reusing connection - potentially causing information leaks
          (reported by Nick Kostirya).
        - bump AnyEvent dependency version (reported by Richard Harris).

2.1  Thu Feb 24 13:11:51 CET 2011
        - the keepalive and persistent parameters were actually named
          differently in the code - they now work as documented.
        - fix a bug where callbacks would sometimes never be called when
          the request timeout is near or below the persistent connection
          timeout (testcase by Cindy Wang).
        - destroying the guard would have no effect when a request was
          recursing or being retired.

2.04 Sat Feb 19 07:45:24 CET 2011
        - "proxy => undef" now overrides any global proxy when specified.
        - require scheme in urls, also use a stricter match to match urls,
          leading or trailing garbage is no longer tolerated.
        - EXPERIMENTAL: allow '=' in cookie values.

2.03 Tue Jan 18 18:49:35 CET 2011
        - dummy reupload, file gone from cpan somehow.

2.02 Wed Jan 12 04:29:37 CET 2011
        - do not lowercase cookie names, only parameter names.

2.01 Tue Jan 11 07:38:15 CET 2011
        - add missing dependency on common::sense.
        - add a resume download example.

2.0  Tue Jan  4 09:16:56 CET 2011
        - hopefully fully upgraded to HTTP/1.1.
        - support HTTP/1.1 persistent and HTTP/1.0 keep-alive connections.
        - drop https-proxy-connection support. seems unused and ill-specified.
        - use more differentiated 59x status codes.
        - properly use url (not proxy) hostname to verify server certificate.
        - much improved cookie implementation:
           - properly implement cookie expiry (for new cookies).
           - new function to expire cookies and sessions: cookie_jar_expire.
           - add special exception to parse broken expires= keys in
             set-cookie headers.
           - do not quote cookie values when not strictly necessary, to
             improve compatibility with broken servers.
           - accept and send lots of invalid cookie values exactly as
             they were received - this should not impact valid values.
           - lowercase cookie parameter names for improved compatibility.
           - support the max-age cookie parameter, overrides expires.
           - support cookie dates (and a few others) in parse_date.
           - properly support value-less parameters (e.g. secure, httponly).
        - do not send Host: header in a proxy CONNECT request.
        - use common::sense.
        - lowercase hostnames and schemes.
        - ignore leading zeroes in http version.
        - handle spaces in content-length headers more gracefully.

1.5  Fri Dec 31 04:47:08 CET 2010
        - bugfix: after headers were received, if any error occured the wrong
          (server-sent) Status and Reason fields would be passed to the callback.
        - when an error occurs during transfer, preserve status/reason.
        - add socks4a connect example.
        - new "tcp_connect" parameter.
        - new format_date and parse_date functions.
        - diagnose unexpected eof as such when the length is known.
        - add 205 to the responses without body.

1.46 Mon Sep  6 08:29:34 CEST 2010
        - some (broken) servers differentiate between empty search parts
          and nonexistant search parts, work around this (problem
          analyzed by Sergey Zasenko).
        - possibly increase robustness by always setting an on_error
          callback on the AnyEvent::Handle object (especially in case
          of user errors, such as nehative timeouts).
        - we now always follow 301/302/303 redirects and mutate POST to GET.
        - we now always follow 307 redirects, even for POST.
        - header-less responses are not parsed correctly (at a negative
          speed penatly :).

1.45 Wed Jun 16 21:15:26 CEST 2010
        - fix a bug where the handle would go away directly after a successful
          connect (analyzed and patch by Maxim Dounin).
        - due to popular demand, introduce the Redirect pseudo response header.
        - document URL pseudo-header better.
        - explain how to implement DNS caching.

1.44 Sat Dec  5 16:36:20 CET 2009
        - do not generate content-length on get requests (if the body is empty),
          as there are even more broken servers out there.
        - allow set_proxy to clear the proxy again.
        - set_proxy will now croak on invalid urls.
        - support overriding the Host-header (requested by Tatsuhiko Miyagawa).

1.43 Fri Aug 14 17:02:02 CEST 2009
        - provide on_prepare callback on common request.

1.42 Wed Aug  5 18:43:01 CEST 2009
        - allow suppression of auto-supplied header fields by specifying undef
          (requested by Mr Guest).
        - allow proxy scheme to be missing, as documented
          (reported by Mr Guest).
        - do not follow redirects if we do not have a location header
          (requested by Mr Guest).

1.41 Sat Jul 25 03:27:05 CEST 2009
        - correctly parse completely headerless responses (e.g. by gatling).
          (analysed by Robin Redeker).

1.4  Tue Jul  7 02:14:53 CEST 2009
        - http_request would not instantly clear the connection slot on
          tcp_connect failures, potentially leading to deadlocks.
        - fix a bug where a connection error is wrongly reported
          as EINPROGRESS.
        - new parameters: on_header, on_body, want_body_handle.
        - redirects will be followed when recurse is enabled whether or not
          the body dowload was successful or not.
        - include :port in Host header when given in the url (many sites break
          when it's always there, and many break if it's missing...).
        - pass the empty string, not undef, when there is no body but
          no error occured.
        - allow passing of tls_ctx, predefine two https security profiles.
        - ucfirst all error messages generated internally.
        - include "U" token in User-Agent.
        - document $AnyEvent::HTTP::MAX_PER_HOST.
        - allow empty field names in response headers (microsoft hits. microsoft
          hits. microsoft hits. you die).

1.12 Thu Jun 11 14:45:18 CEST 2009
        - $scheme wasn't optional in the proxy specification (reported by
          Felix Antonius Wilhelm Ostmann).

1.11 Fri Nov 21 09:18:11 CET 2008
        - work around a perl core bug not properly refcounting function arguments,
          causing "200 OK" with random body results (reported by Дмитрий Шалашов).

1.1  Thu Oct 30 04:46:27 CET 2008
        - work around different behaviour of AnyEvent::Handle in TLS mode.
        - cleanup cookie implementation, many examples and comments were
          provided by Дмитрий Шалашов.
        - document the return values of http_* functions better.
        - separate multiple header values by "," not "\x00" (this does not
          break correctly written users of the old API).
        - improve Set-Cookie: parsing.
        - add experimental https-over-http-proxy support.
        - downgrade https-over-https proxy to https-over-http.
        - ignore spurious CR characters in headers, they show up
          in the weirdest of places.
        - ucfirst the request headers, for a slightly less weird look.
        - work around (some) memleaks in perl regarding qr.

1.05 Mon Sep 29 15:49:58 CEST 2008
        - fix a regex when parsing cookie domains
          (patch by Дмитрий Шалашов).

1.04 Thu Jul 24 08:00:46 CEST 2008
        - parse reason-less http status responses.
        - parse more forms of broken location headers.

1.03 Thu Jul  3 03:47:58 CEST 2008
        - fix http_post, which was totally broken (patch by Pedro Melo).
        - do not recurse on POST requests, as per HTTP/1.[01] (this might
          change as the recommendation isn't followed by anybody else).
        - implement preliminary support for 303/307 redirects.

1.02 Thu Jun 12 13:50:08 CEST 2008
        - make the request URL available in the callback of http_request.
        - export http_post, http_head.

1.01 Fri Jun  6 14:56:37 CEST 2008
        - fixed prototypes for http_* functions

1.0  Thu Jun  5 20:41:43 CEST 2008
        - original version, an AnyEvent::AIO clone.
Revision:	1.90
Committed:	Thu Aug 30 00:08:16 2018 UTC (5 years, 8 months ago) by root
Branch:	MAIN
Changes since 1.89:	+11 -1 lines
Log Message:	* empty log message *
#	User	Rev	Content
1	root	1.2	Revision history for AnyEvent::HTTP
2	root	1.1
3	root	1.18	TODO: provide lwp_request function that takes an lwp http requets and returns a http response.
4	root	1.73	TODO: set_proxy hook
5			TODO: use proxy hook
6	root	1.86	TODO: on_upgrade, for 101 responses?
7	root	1.80	TODO: document session vs. sessionid correctly.
8	root	1.84	TODO: support proxy username:password in both proxy switch and set_proxy string (dzagashev@gmail.com)
9	root	1.85	TODO: remove "unexpectedly got a destructed handle"
10	root	1.76
11	root	1.90	TODO: maybe read big chunks in smaller portions for chunked-encoding + on_body.
12	root	1.85	TODO: callback as body (Kostirya)
13	root	1.86	TODO: infinite recursion(?) (Kostirya)
14	root	1.87	TODO: default rbuf_max value maybe? how about reading large chunks in small parts?
15	root	1.90	TODO: servers send empty reason, which then gets mangled with linear whitespace CRLF - maybe workaround?
16
17			TODO: look into http 0.9 support (Kostirya <kostirya@gmail.com>)
18			TODO: http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO1&Sect2=HITOFF&%23038;d=PG01&%23038;p=1&%23038;u=/netahtml/PTO/srchnum.html&%23038;r=1&%23038;f=G&%23038;l=50&%23038;s1="20110298798".PGNR.&%23038;OS=DN/20110298798&%23038;RS=DN/20110298798
19
20			2.25
21			- further improve relative redirection code.
22			- comment out code that tried to detect possible bugs with persistent
23			connection caching, but since it never triggered, it's probably
24			working fine :)
25	root	1.83
26	root	1.89	2.24
27			- do not call on_body callback on a response that AE::HTTP will recurse
28			on internally (reported by Антон Онуфриев and Ruslan Zakirov).
29
30	root	1.88	2.23 Sun Aug 28 11:30:33 CEST 2016
31			- relative redirects used the proxy schema instead of the request
32			url schema to generate the new url, which is wrong (analyzed by Felix
33			Ostmann).
34			- fix download example (reported by Felix Ostmann).
35
36	root	1.86	2.22 Thu May 14 04:04:03 CEST 2015
37	root	1.85	- ipv6 literals were not correctly parsed (analyzed by Raphael Geissert).
38	root	1.83	- delete the body when mutating request to GET request when
39			redirecting (reported by joe trader).
40			- send proxy-authorization header to proxy when using CONNECT
41			(reported by dzagashev@gmail.com).
42			- do not send Proxy-Authroization header when not using a proxy.
43	root	1.85	- when retrying a persistent request, switch persistency off.
44			- added t/02_ip_literals.t.
45	root	1.83
46	root	1.81	2.21 Mon Jun 9 01:35:54 CEST 2014
47			- correctly keep body when redirecting POSTs, instead of
48			deleting them.
49
50	root	1.80	2.2 Mon Jun 9 01:31:46 CEST 2014
51	root	1.79	- connection header was malformed (patch by Raphael Geissert).
52	root	1.77	- add lots of known idempotent methods from httpbis.
53	root	1.80	- implement relative location headers (rfc 7231), with fallback on URI.
54			- add support for status code 308 from rfc 7238.
55			- recommend URI.
56	root	1.77
57	root	1.76	2.15 Wed Nov 14 23:22:07 CET 2012
58			- use the recurse parameter to also limit the number of retries to be
59			done, avodiing endless loops with broken servers, as reported
60			by Carl Chambers.
61	root	1.74
62	root	1.75	2.14 Sun Apr 22 14:57:51 CEST 2012
63			- Time::Local::timegm croaks on out-of-range values. Don't let
64			this disturb AnyEvent::HTTP (reported by: tell me, I forgot...).
65
66	root	1.74	2.13 Wed Jul 27 17:53:58 CEST 2011
67	root	1.73	- garbled chunked responses caused AnyEvent::HTTP to malfunction
68			(patch by Dmitri Melikyan).
69	root	1.74	- fix GET => HEAD in one case in the documentation (James Bromberger).
70	root	1.73
71	root	1.72	2.12 Tue Jun 14 07:22:54 CEST 2011
72			- fix a possible 'Can't call method "destroyed"' error (which would
73			have been reported by Carl Chambers).
74
75	root	1.71	2.11 Tue May 10 14:33:28 CEST 2011
76			- the keepalive session cache wouldn't take port and scheme into account
77			when reusing connection - potentially causing information leaks
78			(reported by Nick Kostirya).
79			- bump AnyEvent dependency version (reported by Richard Harris).
80
81	root	1.69	2.1 Thu Feb 24 13:11:51 CET 2011
82			- the keepalive and persistent parameters were actually named
83			differently in the code - they now work as documented.
84			- fix a bug where callbacks would sometimes never be called when
85	root	1.70	the request timeout is near or below the persistent connection
86	root	1.69	timeout (testcase by Cindy Wang).
87			- destroying the guard would have no effect when a request was
88			recursing or being retired.
89
90	root	1.68	2.04 Sat Feb 19 07:45:24 CET 2011
91			- "proxy => undef" now overrides any global proxy when specified.
92	root	1.66	- require scheme in urls, also use a stricter match to match urls,
93			leading or trailing garbage is no longer tolerated.
94	root	1.68	- EXPERIMENTAL: allow '=' in cookie values.
95	root	1.66
96	root	1.65	2.03 Tue Jan 18 18:49:35 CET 2011
97			- dummy reupload, file gone from cpan somehow.
98
99	root	1.64	2.02 Wed Jan 12 04:29:37 CET 2011
100			- do not lowercase cookie names, only parameter names.
101
102	root	1.63	2.01 Tue Jan 11 07:38:15 CET 2011
103	root	1.62	- add missing dependency on common::sense.
104	root	1.63	- add a resume download example.
105	root	1.62
106	root	1.59	2.0 Tue Jan 4 09:16:56 CET 2011
107	root	1.48	- hopefully fully upgraded to HTTP/1.1.
108	root	1.59	- support HTTP/1.1 persistent and HTTP/1.0 keep-alive connections.
109			- drop https-proxy-connection support. seems unused and ill-specified.
110	root	1.60	- use more differentiated 59x status codes.
111			- properly use url (not proxy) hostname to verify server certificate.
112	root	1.48	- much improved cookie implementation:
113	root	1.53	- properly implement cookie expiry (for new cookies).
114			- new function to expire cookies and sessions: cookie_jar_expire.
115	root	1.48	- add special exception to parse broken expires= keys in
116			set-cookie headers.
117	root	1.49	- do not quote cookie values when not strictly necessary, to
118			improve compatibility with broken servers.
119	root	1.50	- accept and send lots of invalid cookie values exactly as
120			they were received - this should not impact valid values.
121	root	1.48	- lowercase cookie parameter names for improved compatibility.
122	root	1.60	- support the max-age cookie parameter, overrides expires.
123	root	1.53	- support cookie dates (and a few others) in parse_date.
124	root	1.60	- properly support value-less parameters (e.g. secure, httponly).
125	root	1.57	- do not send Host: header in a proxy CONNECT request.
126			- use common::sense.
127			- lowercase hostnames and schemes.
128			- ignore leading zeroes in http version.
129			- handle spaces in content-length headers more gracefully.
130	root	1.47
131	root	1.46	1.5 Fri Dec 31 04:47:08 CET 2010
132	root	1.45	- bugfix: after headers were received, if any error occured the wrong
133			(server-sent) Status and Reason fields would be passed to the callback.
134			- when an error occurs during transfer, preserve status/reason.
135	root	1.41	- add socks4a connect example.
136	root	1.40	- new "tcp_connect" parameter.
137	root	1.42	- new format_date and parse_date functions.
138	root	1.45	- diagnose unexpected eof as such when the length is known.
139			- add 205 to the responses without body.
140	root	1.37
141	root	1.39	1.46 Mon Sep 6 08:29:34 CEST 2010
142	root	1.38	- some (broken) servers differentiate between empty search parts
143			and nonexistant search parts, work around this (problem
144			analyzed by Sergey Zasenko).
145			- possibly increase robustness by always setting an on_error
146	root	1.39	callback on the AnyEvent::Handle object (especially in case
147			of user errors, such as nehative timeouts).
148			- we now always follow 301/302/303 redirects and mutate POST to GET.
149			- we now always follow 307 redirects, even for POST.
150			- header-less responses are not parsed correctly (at a negative
151			speed penatly :).
152	root	1.38
153	root	1.37	1.45 Wed Jun 16 21:15:26 CEST 2010
154	root	1.38	- fix a bug where the handle would go away directly after a successful
155	root	1.37	connect (analyzed and patch by Maxim Dounin).
156			- due to popular demand, introduce the Redirect pseudo response header.
157			- document URL pseudo-header better.
158			- explain how to implement DNS caching.
159	root	1.30
160	root	1.35	1.44 Sat Dec 5 16:36:20 CET 2009
161			- do not generate content-length on get requests (if the body is empty),
162			as there are even more broken servers out there.
163	root	1.34	- allow set_proxy to clear the proxy again.
164			- set_proxy will now croak on invalid urls.
165	root	1.35	- support overriding the Host-header (requested by Tatsuhiko Miyagawa).
166	root	1.34
167	root	1.33	1.43 Fri Aug 14 17:02:02 CEST 2009
168			- provide on_prepare callback on common request.
169
170	root	1.31	1.42 Wed Aug 5 18:43:01 CEST 2009
171	root	1.61	- allow suppression of auto-supplied header fields by specifying undef
172	root	1.30	(requested by Mr Guest).
173			- allow proxy scheme to be missing, as documented
174			(reported by Mr Guest).
175			- do not follow redirects if we do not have a location header
176			(requested by Mr Guest).
177
178	root	1.29	1.41 Sat Jul 25 03:27:05 CEST 2009
179			- correctly parse completely headerless responses (e.g. by gatling).
180			(analysed by Robin Redeker).
181
182	root	1.28	1.4 Tue Jul 7 02:14:53 CEST 2009
183	root	1.25	- http_request would not instantly clear the connection slot on
184			tcp_connect failures, potentially leading to deadlocks.
185	root	1.28	- fix a bug where a connection error is wrongly reported
186			as EINPROGRESS.
187	root	1.26	- new parameters: on_header, on_body, want_body_handle.
188			- redirects will be followed when recurse is enabled whether or not
189			the body dowload was successful or not.
190	root	1.27	- include :port in Host header when given in the url (many sites break
191			when it's always there, and many break if it's missing...).
192	root	1.26	- pass the empty string, not undef, when there is no body but
193			no error occured.
194			- allow passing of tls_ctx, predefine two https security profiles.
195	root	1.25	- ucfirst all error messages generated internally.
196			- include "U" token in User-Agent.
197	root	1.27	- document $AnyEvent::HTTP::MAX_PER_HOST.
198			- allow empty field names in response headers (microsoft hits. microsoft
199			hits. microsoft hits. you die).
200	root	1.25
201	root	1.24	1.12 Thu Jun 11 14:45:18 CEST 2009
202	root	1.23	- $scheme wasn't optional in the proxy specification (reported by
203			Felix Antonius Wilhelm Ostmann).
204
205	root	1.22	1.11 Fri Nov 21 09:18:11 CET 2008
206			- work around a perl core bug not properly refcounting function arguments,
207			causing "200 OK" with random body results (reported by Дмитрий Шалашов).
208
209	root	1.21	1.1 Thu Oct 30 04:46:27 CET 2008
210	root	1.18	- work around different behaviour of AnyEvent::Handle in TLS mode.
211	root	1.17	- cleanup cookie implementation, many examples and comments were
212			provided by Дмитрий Шалашов.
213			- document the return values of http_* functions better.
214	root	1.19	- separate multiple header values by "," not "\x00" (this does not
215			break correctly written users of the old API).
216			- improve Set-Cookie: parsing.
217			- add experimental https-over-http-proxy support.
218			- downgrade https-over-https proxy to https-over-http.
219			- ignore spurious CR characters in headers, they show up
220			in the weirdest of places.
221			- ucfirst the request headers, for a slightly less weird look.
222	root	1.20	- work around (some) memleaks in perl regarding qr.
223	root	1.17
224	root	1.16	1.05 Mon Sep 29 15:49:58 CEST 2008
225			- fix a regex when parsing cookie domains
226			(patch by Дмитрий Шалашов).
227
228	root	1.15	1.04 Thu Jul 24 08:00:46 CEST 2008
229	root	1.14	- parse reason-less http status responses.
230			- parse more forms of broken location headers.
231
232	root	1.13	1.03 Thu Jul 3 03:47:58 CEST 2008
233	root	1.10	- fix http_post, which was totally broken (patch by Pedro Melo).
234	root	1.13	- do not recurse on POST requests, as per HTTP/1.[01] (this might
235			change as the recommendation isn't followed by anybody else).
236			- implement preliminary support for 303/307 redirects.
237	root	1.10
238	root	1.9	1.02 Thu Jun 12 13:50:08 CEST 2008
239			- make the request URL available in the callback of http_request.
240	root	1.7	- export http_post, http_head.
241
242	root	1.6	1.01 Fri Jun 6 14:56:37 CEST 2008
243	elmex	1.5	- fixed prototypes for http_* functions
244
245	root	1.4	1.0 Thu Jun 5 20:41:43 CEST 2008
246	root	1.3	- original version, an AnyEvent::AIO clone.