aboutsummaryrefslogtreecommitdiff
path: root/src/utils/http.py
Commit message (Collapse)AuthorAgeFilesLines
* Allow bypass of content-type check in utils.http.requestGravatar jesopo2019-08-051-3/+3
|
* not all HTTP responses have content-typeGravatar jesopo2019-08-021-1/+1
|
* asyncio.gather -> asyncio.wait (with timeout)Gravatar jesopo2019-07-081-1/+1
|
* tell asyncio.gather which loop to useGravatar jesopo2019-07-081-1/+1
|
* close event loop when we're done with it (request_many())Gravatar jesopo2019-07-081-1/+2
|
* Don't try/except async http exceptionsGravatar jesopo2019-07-081-5/+1
|
* switch request_many() to use asyncio.gatherGravatar jesopo2019-07-081-14/+18
|
* catch async exceptions in utils.http.request_many()Gravatar jesopo2019-07-081-1/+6
|
* add missing schema in utils.http.sanitise_url, use in rss.pyGravatar jesopo2019-07-081-0/+3
|
* switch to using asyncio's event loopGravatar jesopo2019-07-081-6/+7
|
* implement utils.http.request_many as a tonado ioloop yieldGravatar jesopo2019-07-081-1/+19
|
* url_validate() -> url_sanitise()Gravatar jesopo2019-07-021-1/+1
|
* Add utils.http.url_validate() for best-effort url tidyingGravatar jesopo2019-07-021-0/+16
|
* message arg for HTTPWrongContentTypeException/HTTPParsingExceptionGravatar jesopo2019-06-281-5/+5
|
* Give descriptions to utils.http.HTTPException subclassesGravatar jesopo2019-06-271-2/+6
|
* add `allow_redirects` kwarg to utils.http.request()Gravatar jesopo2019-06-261-0/+2
|
* Defer decoding http payload bytestring until after checking ContentTypeGravatar jesopo2019-06-041-2/+5
|
* Pass str object to BeautifulSoup, not bytes. closes #56Gravatar jesopo2019-05-281-4/+3
|
* forgot the beautiful %Gravatar Patrick Nappa2019-05-031-1/+1
|
* ensure that non-url characters not separated by whitespace aren't consumedGravatar Patrick Nappa2019-05-031-1/+1
|
* Add missing ":"Gravatar jesopo2019-04-251-1/+1
|
* Support interfaces that don't have AF_INET and/or AF_INET6Gravatar jesopo2019-04-251-1/+4
|
* Refuse to get the title for any url that points locallGravatar jesopo2019-04-251-2/+30
|
* Move REGEX_URL out of isgd.py and title.py in to utils.httpGravatar jesopo2019-04-241-1/+2
|
* Raise a specific exception in utils.http.request for "wrong content type"Gravatar jesopo2019-02-281-1/+4
|
* Throw ValueError when utils.http.request tries to soup non-html/xml dataGravatar jesopo2019-02-271-3/+6
|
* Don't try to parse non-html/xml stuff with BeautifulSoupGravatar jesopo2019-02-261-1/+4
|
* Typo in utils.http.request, 'response_heders' -> 'response_headers'Gravatar jesopo2018-12-111-1/+1
|
* Pass a `dict` to utils.CaseInsensitiveDict, not a MutableMappingGravatar jesopo2018-12-111-1/+1
|
* Add missing `utils` import in utils.httpGravatar jesopo2018-12-111-0/+1
|
* 'utils.http.get_url' -> 'utils.http.request', return a Response object fromGravatar jesopo2018-12-111-10/+16
| | | | utils.http.request
* Fix/refactor issues brought up by type hint lintingGravatar jesopo2018-10-301-2/+2
|
* Add type/return hints throughout src/ and, in doing so, fix some cyclicalGravatar jesopo2018-10-301-5/+6
| | | | references.
* signal.signal timer callback takes 2 argsGravatar jesopo2018-10-251-1/+1
|
* Add fallback_encoding to utils.http.get_url, in case a page has no implicitGravatar jesopo2018-10-101-2/+3
| | | | encoding
* .decode data prior to json.loads in utils.http.get_urlGravatar jesopo2018-10-101-2/+1
|
* Fix syntax error for throwing a timeout when signal.alarm firesGravatar jesopo2018-10-101-1/+3
|
* .decode plaintext returns from utils.http.get_urlGravatar jesopo2018-10-101-0/+1
|
* Use signal.alarm to Deadline utils.http.get_url and throw useful exceptionsGravatar jesopo2018-10-101-16/+28
|
* Set a max size of 100mb for utils.http.get_urlGravatar jesopo2018-10-101-3/+7
|
* Change utils.http to use requestsGravatar jesopo2018-10-101-83/+30
|
* Remove debug print in src.utils.httpGravatar jesopo2018-10-091-1/+0
|
* Return response code from utils.http.get_url when code=True and soup=TrueGravatar jesopo2018-10-091-4/+11
|
* Support post_data in utils.http.get_urlGravatar jesopo2018-10-081-2/+7
|
* Move src/Utils.py in to src/utils/, splitting functionality out in to modules ofGravatar jesopo2018-10-031-0/+94
related functionality