aboutsummaryrefslogtreecommitdiff
path: root/src/utils/http.py
Commit message (Collapse)AuthorAgeFilesLines
...
* still default to iso-latin-1 if no on-page or in-header content-type is presentGravatar jesopo2019-09-091-1/+1
|
* only look for <meta>-related tags when there are meta tagsGravatar jesopo2019-09-091-9/+11
|
* add explicit None return for _find_encoding (mypy)Gravatar jesopo2019-09-091-0/+1
|
* change utils.http.request to best-effort detect on-page encodingGravatar jesopo2019-09-091-2/+34
| | | | closes #113
* correctly qualify DeadlineExceededException namespaceGravatar jesopo2019-09-031-1/+1
|
* use utils.deadline() in utils.http.request, not raw sigalrmGravatar jesopo2019-09-021-18/+15
|
* Pass the content of a webpage to HTTPParsingExceptionGravatar jesopo2019-09-021-2/+2
|
* use \S+ for url regex (for non-ascii chars), use url_sanitize to catch <>Gravatar jesopo2019-09-021-9/+12
|
* Allow bypass of content-type check in utils.http.requestGravatar jesopo2019-08-051-3/+3
|
* not all HTTP responses have content-typeGravatar jesopo2019-08-021-1/+1
|
* asyncio.gather -> asyncio.wait (with timeout)Gravatar jesopo2019-07-081-1/+1
|
* tell asyncio.gather which loop to useGravatar jesopo2019-07-081-1/+1
|
* close event loop when we're done with it (request_many())Gravatar jesopo2019-07-081-1/+2
|
* Don't try/except async http exceptionsGravatar jesopo2019-07-081-5/+1
|
* switch request_many() to use asyncio.gatherGravatar jesopo2019-07-081-14/+18
|
* catch async exceptions in utils.http.request_many()Gravatar jesopo2019-07-081-1/+6
|
* add missing schema in utils.http.sanitise_url, use in rss.pyGravatar jesopo2019-07-081-0/+3
|
* switch to using asyncio's event loopGravatar jesopo2019-07-081-6/+7
|
* implement utils.http.request_many as a tonado ioloop yieldGravatar jesopo2019-07-081-1/+19
|
* url_validate() -> url_sanitise()Gravatar jesopo2019-07-021-1/+1
|
* Add utils.http.url_validate() for best-effort url tidyingGravatar jesopo2019-07-021-0/+16
|
* message arg for HTTPWrongContentTypeException/HTTPParsingExceptionGravatar jesopo2019-06-281-5/+5
|
* Give descriptions to utils.http.HTTPException subclassesGravatar jesopo2019-06-271-2/+6
|
* add `allow_redirects` kwarg to utils.http.request()Gravatar jesopo2019-06-261-0/+2
|
* Defer decoding http payload bytestring until after checking ContentTypeGravatar jesopo2019-06-041-2/+5
|
* Pass str object to BeautifulSoup, not bytes. closes #56Gravatar jesopo2019-05-281-4/+3
|
* forgot the beautiful %Gravatar Patrick Nappa2019-05-031-1/+1
|
* ensure that non-url characters not separated by whitespace aren't consumedGravatar Patrick Nappa2019-05-031-1/+1
|
* Add missing ":"Gravatar jesopo2019-04-251-1/+1
|
* Support interfaces that don't have AF_INET and/or AF_INET6Gravatar jesopo2019-04-251-1/+4
|
* Refuse to get the title for any url that points locallGravatar jesopo2019-04-251-2/+30
|
* Move REGEX_URL out of isgd.py and title.py in to utils.httpGravatar jesopo2019-04-241-1/+2
|
* Raise a specific exception in utils.http.request for "wrong content type"Gravatar jesopo2019-02-281-1/+4
|
* Throw ValueError when utils.http.request tries to soup non-html/xml dataGravatar jesopo2019-02-271-3/+6
|
* Don't try to parse non-html/xml stuff with BeautifulSoupGravatar jesopo2019-02-261-1/+4
|
* Typo in utils.http.request, 'response_heders' -> 'response_headers'Gravatar jesopo2018-12-111-1/+1
|
* Pass a `dict` to utils.CaseInsensitiveDict, not a MutableMappingGravatar jesopo2018-12-111-1/+1
|
* Add missing `utils` import in utils.httpGravatar jesopo2018-12-111-0/+1
|
* 'utils.http.get_url' -> 'utils.http.request', return a Response object fromGravatar jesopo2018-12-111-10/+16
| | | | utils.http.request
* Fix/refactor issues brought up by type hint lintingGravatar jesopo2018-10-301-2/+2
|
* Add type/return hints throughout src/ and, in doing so, fix some cyclicalGravatar jesopo2018-10-301-5/+6
| | | | references.
* signal.signal timer callback takes 2 argsGravatar jesopo2018-10-251-1/+1
|
* Add fallback_encoding to utils.http.get_url, in case a page has no implicitGravatar jesopo2018-10-101-2/+3
| | | | encoding
* .decode data prior to json.loads in utils.http.get_urlGravatar jesopo2018-10-101-2/+1
|
* Fix syntax error for throwing a timeout when signal.alarm firesGravatar jesopo2018-10-101-1/+3
|
* .decode plaintext returns from utils.http.get_urlGravatar jesopo2018-10-101-0/+1
|
* Use signal.alarm to Deadline utils.http.get_url and throw useful exceptionsGravatar jesopo2018-10-101-16/+28
|
* Set a max size of 100mb for utils.http.get_urlGravatar jesopo2018-10-101-3/+7
|
* Change utils.http to use requestsGravatar jesopo2018-10-101-83/+30
|
* Remove debug print in src.utils.httpGravatar jesopo2018-10-091-1/+0
|
generated by cgit v1.3.1-10-gc9f91 (git 2.54.0) at 2026-06-13 05:55:57 +0000