aboutsummaryrefslogtreecommitdiff
path: root/src/utils/http.py
Commit message (Expand)AuthorAgeFilesLines
* also detect encoding for http.request_many()Gravatar jesopo2020-01-311-5/+12
* also Accept-Language "en" in HTTP requests (0.5 weight)Gravatar jesopo2020-01-111-1/+1
* Revert "explicitly .close() task in http.request_many()"•••This reverts commit 7478d62b77a7c7637000670d1c2ed22b1b403745. Gravatar jesopo2020-01-061-1/+0
* explicitly .close() task in http.request_many()Gravatar jesopo2020-01-061-0/+1
* add missing closing paren to bitbot's User AgentGravatar jesopo2019-12-291-1/+1
* we no longer use DECODE_CONTENT_TYPESGravatar jesopo2019-12-181-1/+0
* allow Request objects to specify their timeoutGravatar jesopo2019-12-111-1/+3
* add utils.http.Session object, to preserve cookies across requestsGravatar jesopo2019-12-031-0/+14
* utils.http.Response.decode() should default to detected encodingGravatar jesopo2019-11-281-2/+2
* explicitly use "lxml" for finding page encodingGravatar jesopo2019-11-261-1/+1
* _find_encoding takes `bytes` and soupifies nowGravatar jesopo2019-11-261-1/+2
* utils.http.request_many() shouldn't decode data for ResponseGravatar jesopo2019-11-261-3/+2
* utils.http.Response.data should always be `bytes` - add .decode and .soupGravatar jesopo2019-11-261-25/+7
* remove `parser` from utils.http.Request, add Request.soup()Gravatar jesopo2019-11-261-15/+6
* add `cookies` and `.json()` to utils.http.Response objectsGravatar jesopo2019-11-251-7/+13
* change utils.http.Request to be a dataclassGravatar jesopo2019-11-251-38/+30
* give bitbot a unique User-Agent•••closes #206 Gravatar jesopo2019-11-201-6/+5
* Fix type errors detected by 'mypy --ignore-missing-imports src'.Gravatar Valentin Lorentz2019-10-301-2/+2
* support utf8 hostnames by punycode (idna) encodingGravatar jesopo2019-10-181-4/+12
* parse out content_type in Response ctorGravatar jesopo2019-10-051-5/+3
* parse content-type out in utils.http.request, put it on Response objectGravatar jesopo2019-10-041-9/+13
* 'is_localhost()' -> 'host_permitted()'Gravatar jesopo2019-09-301-4/+4
* use ipaddress is_loopback etc to do better forbidden ranges•••closes #87 Gravatar jesopo2019-09-301-0/+9
* assume http fallback_encoding by content-type (utf8 for json)Gravatar jesopo2019-09-251-1/+8
* only BeautifulSoup for finding encoding when it's a html-ish typeGravatar jesopo2019-09-201-1/+1
* log call was replaced with Exception but [] on args remainedGravatar jesopo2019-09-191-1/+1
* give Requests, use them in utils.http.request_many()Gravatar jesopo2019-09-191-12/+25
* utils.http.request_() has no self, let alone self.logGravatar jesopo2019-09-191-3/+4
* should be using pair_start/pair_end throughout `for`Gravatar jesopo2019-09-191-2/+2
* also show "bad" data in HTTPParsingException when a message is providedGravatar jesopo2019-09-181-1/+1
* show "bad" data in HTTPParsingException messageGravatar jesopo2019-09-181-2/+3
* don't check already-read data when checking for too-large requests•••this check was here because the first read will return empty if it was an invalid byte sequence for e.g. gzip because we needed to receive more data. the second read will always return data (not decoded) so regardless of what the already-read data is, the second read is the only criteria we need. Gravatar jesopo2019-09-171-1/+1
* log which URL caused an error in request_manyGravatar jesopo2019-09-171-1/+6
* only decode content-types in DECODE_CONTENT_TYPESGravatar jesopo2019-09-171-1/+1
* Response.__init__() needs `encoding` nowGravatar jesopo2019-09-171-1/+1
* restore 5 second (instead of default 10) deadline for http.requestGravatar jesopo2019-09-171-1/+1
* use utils.deadline_process() in utils.http._request() so background threads can•••call _request() Gravatar jesopo2019-09-171-30/+37
* add `json_body` arg to Request to json-encode body, only return from `body` if•••not null Gravatar jesopo2019-09-161-4/+8
* allow Requests to specify a useragentGravatar jesopo2019-09-121-3/+4
* add a helper utils.http.Client static objectGravatar jesopo2019-09-111-0/+4
* add `proxy` to Request objectsGravatar jesopo2019-09-111-1/+2
* refactor utils.http.requests to support a Request objectGravatar jesopo2019-09-111-27/+77
* automatically decode certain http content typesGravatar jesopo2019-09-111-1/+6
* Don't try to .decode non-html things, default iso-lat-1 for non-html tooGravatar jesopo2019-09-091-5/+5
* add flag to disable encoding detectionGravatar jesopo2019-09-091-5/+4
* 'str.split' -> 's.split'Gravatar jesopo2019-09-091-1/+1
* still default to iso-latin-1 if no on-page or in-header content-type is presentGravatar jesopo2019-09-091-1/+1
* only look for <meta>-related tags when there are meta tagsGravatar jesopo2019-09-091-9/+11
* add explicit None return for _find_encoding (mypy)Gravatar jesopo2019-09-091-0/+1
* change utils.http.request to best-effort detect on-page encoding•••closes #113 Gravatar jesopo2019-09-091-2/+34
generated by cgit v1.3.1-10-gc9f91 (git 2.54.0) at 2026-06-11 16:59:08 +0000