aboutsummaryrefslogtreecommitdiff
path: root/src/utils/http.py
Commit message (Expand)AuthorAgeFilesLines
* support utf8 hostnames by punycode (idna) encodingGravatar jesopo2019-10-181-4/+12
* parse out content_type in Response ctorGravatar jesopo2019-10-051-5/+3
* parse content-type out in utils.http.request, put it on Response objectGravatar jesopo2019-10-041-9/+13
* 'is_localhost()' -> 'host_permitted()'Gravatar jesopo2019-09-301-4/+4
* use ipaddress is_loopback etc to do better forbidden ranges•••closes #87 Gravatar jesopo2019-09-301-0/+9
* assume http fallback_encoding by content-type (utf8 for json)Gravatar jesopo2019-09-251-1/+8
* only BeautifulSoup for finding encoding when it's a html-ish typeGravatar jesopo2019-09-201-1/+1
* log call was replaced with Exception but [] on args remainedGravatar jesopo2019-09-191-1/+1
* give Requests, use them in utils.http.request_many()Gravatar jesopo2019-09-191-12/+25
* utils.http.request_() has no self, let alone self.logGravatar jesopo2019-09-191-3/+4
* should be using pair_start/pair_end throughout `for`Gravatar jesopo2019-09-191-2/+2
* also show "bad" data in HTTPParsingException when a message is providedGravatar jesopo2019-09-181-1/+1
* show "bad" data in HTTPParsingException messageGravatar jesopo2019-09-181-2/+3
* don't check already-read data when checking for too-large requests•••this check was here because the first read will return empty if it was an invalid byte sequence for e.g. gzip because we needed to receive more data. the second read will always return data (not decoded) so regardless of what the already-read data is, the second read is the only criteria we need. Gravatar jesopo2019-09-171-1/+1
* log which URL caused an error in request_manyGravatar jesopo2019-09-171-1/+6
* only decode content-types in DECODE_CONTENT_TYPESGravatar jesopo2019-09-171-1/+1
* Response.__init__() needs `encoding` nowGravatar jesopo2019-09-171-1/+1
* restore 5 second (instead of default 10) deadline for http.requestGravatar jesopo2019-09-171-1/+1
* use utils.deadline_process() in utils.http._request() so background threads can•••call _request() Gravatar jesopo2019-09-171-30/+37
* add `json_body` arg to Request to json-encode body, only return from `body` if•••not null Gravatar jesopo2019-09-161-4/+8
* allow Requests to specify a useragentGravatar jesopo2019-09-121-3/+4
* add a helper utils.http.Client static objectGravatar jesopo2019-09-111-0/+4
* add `proxy` to Request objectsGravatar jesopo2019-09-111-1/+2
* refactor utils.http.requests to support a Request objectGravatar jesopo2019-09-111-27/+77
* automatically decode certain http content typesGravatar jesopo2019-09-111-1/+6
* Don't try to .decode non-html things, default iso-lat-1 for non-html tooGravatar jesopo2019-09-091-5/+5
* add flag to disable encoding detectionGravatar jesopo2019-09-091-5/+4
* 'str.split' -> 's.split'Gravatar jesopo2019-09-091-1/+1
* still default to iso-latin-1 if no on-page or in-header content-type is presentGravatar jesopo2019-09-091-1/+1
* only look for <meta>-related tags when there are meta tagsGravatar jesopo2019-09-091-9/+11
* add explicit None return for _find_encoding (mypy)Gravatar jesopo2019-09-091-0/+1
* change utils.http.request to best-effort detect on-page encoding•••closes #113 Gravatar jesopo2019-09-091-2/+34
* correctly qualify DeadlineExceededException namespaceGravatar jesopo2019-09-031-1/+1
* use utils.deadline() in utils.http.request, not raw sigalrmGravatar jesopo2019-09-021-18/+15
* Pass the content of a webpage to HTTPParsingExceptionGravatar jesopo2019-09-021-2/+2
* use \S+ for url regex (for non-ascii chars), use url_sanitize to catch <>Gravatar jesopo2019-09-021-9/+12
* Allow bypass of content-type check in utils.http.requestGravatar jesopo2019-08-051-3/+3
* not all HTTP responses have content-typeGravatar jesopo2019-08-021-1/+1
* asyncio.gather -> asyncio.wait (with timeout)Gravatar jesopo2019-07-081-1/+1
* tell asyncio.gather which loop to useGravatar jesopo2019-07-081-1/+1
* close event loop when we're done with it (request_many())Gravatar jesopo2019-07-081-1/+2
* Don't try/except async http exceptionsGravatar jesopo2019-07-081-5/+1
* switch request_many() to use asyncio.gatherGravatar jesopo2019-07-081-14/+18
* catch async exceptions in utils.http.request_many()Gravatar jesopo2019-07-081-1/+6
* add missing schema in utils.http.sanitise_url, use in rss.pyGravatar jesopo2019-07-081-0/+3
* switch to using asyncio's event loopGravatar jesopo2019-07-081-6/+7
* implement utils.http.request_many as a tonado ioloop yieldGravatar jesopo2019-07-081-1/+19
* url_validate() -> url_sanitise()Gravatar jesopo2019-07-021-1/+1
* Add utils.http.url_validate() for best-effort url tidyingGravatar jesopo2019-07-021-0/+16
* message arg for HTTPWrongContentTypeException/HTTPParsingExceptionGravatar jesopo2019-06-281-5/+5
generated by cgit v1.3.1-10-gc9f91 (git 2.54.0) at 2026-06-11 23:15:35 +0000