aboutsummaryrefslogtreecommitdiff
path: root/src/utils/http.py
Commit message (Collapse)AuthorAgeFilesLines
* log which URL caused an error in request_manyGravatar jesopo2019-09-171-1/+6
|
* only decode content-types in DECODE_CONTENT_TYPESGravatar jesopo2019-09-171-1/+1
|
* Response.__init__() needs `encoding` nowGravatar jesopo2019-09-171-1/+1
|
* restore 5 second (instead of default 10) deadline for http.requestGravatar jesopo2019-09-171-1/+1
|
* use utils.deadline_process() in utils.http._request() so background threads canGravatar jesopo2019-09-171-30/+37
| | | | call _request()
* add `json_body` arg to Request to json-encode body, only return from `body` ifGravatar jesopo2019-09-161-4/+8
| | | | not null
* allow Requests to specify a useragentGravatar jesopo2019-09-121-3/+4
|
* add a helper utils.http.Client static objectGravatar jesopo2019-09-111-0/+4
|
* add `proxy` to Request objectsGravatar jesopo2019-09-111-1/+2
|
* refactor utils.http.requests to support a Request objectGravatar jesopo2019-09-111-27/+77
|
* automatically decode certain http content typesGravatar jesopo2019-09-111-1/+6
|
* Don't try to .decode non-html things, default iso-lat-1 for non-html tooGravatar jesopo2019-09-091-5/+5
|
* add flag to disable encoding detectionGravatar jesopo2019-09-091-5/+4
|
* 'str.split' -> 's.split'Gravatar jesopo2019-09-091-1/+1
|
* still default to iso-latin-1 if no on-page or in-header content-type is presentGravatar jesopo2019-09-091-1/+1
|
* only look for <meta>-related tags when there are meta tagsGravatar jesopo2019-09-091-9/+11
|
* add explicit None return for _find_encoding (mypy)Gravatar jesopo2019-09-091-0/+1
|
* change utils.http.request to best-effort detect on-page encodingGravatar jesopo2019-09-091-2/+34
| | | | closes #113
* correctly qualify DeadlineExceededException namespaceGravatar jesopo2019-09-031-1/+1
|
* use utils.deadline() in utils.http.request, not raw sigalrmGravatar jesopo2019-09-021-18/+15
|
* Pass the content of a webpage to HTTPParsingExceptionGravatar jesopo2019-09-021-2/+2
|
* use \S+ for url regex (for non-ascii chars), use url_sanitize to catch <>Gravatar jesopo2019-09-021-9/+12
|
* Allow bypass of content-type check in utils.http.requestGravatar jesopo2019-08-051-3/+3
|
* not all HTTP responses have content-typeGravatar jesopo2019-08-021-1/+1
|
* asyncio.gather -> asyncio.wait (with timeout)Gravatar jesopo2019-07-081-1/+1
|
* tell asyncio.gather which loop to useGravatar jesopo2019-07-081-1/+1
|
* close event loop when we're done with it (request_many())Gravatar jesopo2019-07-081-1/+2
|
* Don't try/except async http exceptionsGravatar jesopo2019-07-081-5/+1
|
* switch request_many() to use asyncio.gatherGravatar jesopo2019-07-081-14/+18
|
* catch async exceptions in utils.http.request_many()Gravatar jesopo2019-07-081-1/+6
|
* add missing schema in utils.http.sanitise_url, use in rss.pyGravatar jesopo2019-07-081-0/+3
|
* switch to using asyncio's event loopGravatar jesopo2019-07-081-6/+7
|
* implement utils.http.request_many as a tonado ioloop yieldGravatar jesopo2019-07-081-1/+19
|
* url_validate() -> url_sanitise()Gravatar jesopo2019-07-021-1/+1
|
* Add utils.http.url_validate() for best-effort url tidyingGravatar jesopo2019-07-021-0/+16
|
* message arg for HTTPWrongContentTypeException/HTTPParsingExceptionGravatar jesopo2019-06-281-5/+5
|
* Give descriptions to utils.http.HTTPException subclassesGravatar jesopo2019-06-271-2/+6
|
* add `allow_redirects` kwarg to utils.http.request()Gravatar jesopo2019-06-261-0/+2
|
* Defer decoding http payload bytestring until after checking ContentTypeGravatar jesopo2019-06-041-2/+5
|
* Pass str object to BeautifulSoup, not bytes. closes #56Gravatar jesopo2019-05-281-4/+3
|
* forgot the beautiful %Gravatar Patrick Nappa2019-05-031-1/+1
|
* ensure that non-url characters not separated by whitespace aren't consumedGravatar Patrick Nappa2019-05-031-1/+1
|
* Add missing ":"Gravatar jesopo2019-04-251-1/+1
|
* Support interfaces that don't have AF_INET and/or AF_INET6Gravatar jesopo2019-04-251-1/+4
|
* Refuse to get the title for any url that points locallGravatar jesopo2019-04-251-2/+30
|
* Move REGEX_URL out of isgd.py and title.py in to utils.httpGravatar jesopo2019-04-241-1/+2
|
* Raise a specific exception in utils.http.request for "wrong content type"Gravatar jesopo2019-02-281-1/+4
|
* Throw ValueError when utils.http.request tries to soup non-html/xml dataGravatar jesopo2019-02-271-3/+6
|
* Don't try to parse non-html/xml stuff with BeautifulSoupGravatar jesopo2019-02-261-1/+4
|
* Typo in utils.http.request, 'response_heders' -> 'response_headers'Gravatar jesopo2018-12-111-1/+1
|
generated by cgit v1.3.1-10-gc9f91 (git 2.54.0) at 2026-06-11 22:52:04 +0000