aboutsummaryrefslogtreecommitdiff
path: root/src/utils/http.py
Commit message (Expand)AuthorAgeFilesLines
...
* add explicit None return for _find_encoding (mypy)Gravatar jesopo2019-09-091-0/+1
* change utils.http.request to best-effort detect on-page encoding•••closes #113 Gravatar jesopo2019-09-091-2/+34
* correctly qualify DeadlineExceededException namespaceGravatar jesopo2019-09-031-1/+1
* use utils.deadline() in utils.http.request, not raw sigalrmGravatar jesopo2019-09-021-18/+15
* Pass the content of a webpage to HTTPParsingExceptionGravatar jesopo2019-09-021-2/+2
* use \S+ for url regex (for non-ascii chars), use url_sanitize to catch <>Gravatar jesopo2019-09-021-9/+12
* Allow bypass of content-type check in utils.http.requestGravatar jesopo2019-08-051-3/+3
* not all HTTP responses have content-typeGravatar jesopo2019-08-021-1/+1
* asyncio.gather -> asyncio.wait (with timeout)Gravatar jesopo2019-07-081-1/+1
* tell asyncio.gather which loop to useGravatar jesopo2019-07-081-1/+1
* close event loop when we're done with it (request_many())Gravatar jesopo2019-07-081-1/+2
* Don't try/except async http exceptionsGravatar jesopo2019-07-081-5/+1
* switch request_many() to use asyncio.gatherGravatar jesopo2019-07-081-14/+18
* catch async exceptions in utils.http.request_many()Gravatar jesopo2019-07-081-1/+6
* add missing schema in utils.http.sanitise_url, use in rss.pyGravatar jesopo2019-07-081-0/+3
* switch to using asyncio's event loopGravatar jesopo2019-07-081-6/+7
* implement utils.http.request_many as a tonado ioloop yieldGravatar jesopo2019-07-081-1/+19
* url_validate() -> url_sanitise()Gravatar jesopo2019-07-021-1/+1
* Add utils.http.url_validate() for best-effort url tidyingGravatar jesopo2019-07-021-0/+16
* message arg for HTTPWrongContentTypeException/HTTPParsingExceptionGravatar jesopo2019-06-281-5/+5
* Give descriptions to utils.http.HTTPException subclassesGravatar jesopo2019-06-271-2/+6
* add `allow_redirects` kwarg to utils.http.request()Gravatar jesopo2019-06-261-0/+2
* Defer decoding http payload bytestring until after checking ContentTypeGravatar jesopo2019-06-041-2/+5
* Pass str object to BeautifulSoup, not bytes. closes #56Gravatar jesopo2019-05-281-4/+3
* forgot the beautiful %Gravatar Patrick Nappa2019-05-031-1/+1
* ensure that non-url characters not separated by whitespace aren't consumedGravatar Patrick Nappa2019-05-031-1/+1
* Add missing ":"Gravatar jesopo2019-04-251-1/+1
* Support interfaces that don't have AF_INET and/or AF_INET6Gravatar jesopo2019-04-251-1/+4
* Refuse to get the title for any url that points locallGravatar jesopo2019-04-251-2/+30
* Move REGEX_URL out of isgd.py and title.py in to utils.httpGravatar jesopo2019-04-241-1/+2
* Raise a specific exception in utils.http.request for "wrong content type"Gravatar jesopo2019-02-281-1/+4
* Throw ValueError when utils.http.request tries to soup non-html/xml dataGravatar jesopo2019-02-271-3/+6
* Don't try to parse non-html/xml stuff with BeautifulSoupGravatar jesopo2019-02-261-1/+4
* Typo in utils.http.request, 'response_heders' -> 'response_headers'Gravatar jesopo2018-12-111-1/+1
* Pass a `dict` to utils.CaseInsensitiveDict, not a MutableMappingGravatar jesopo2018-12-111-1/+1
* Add missing `utils` import in utils.httpGravatar jesopo2018-12-111-0/+1
* 'utils.http.get_url' -> 'utils.http.request', return a Response object from•••utils.http.request Gravatar jesopo2018-12-111-10/+16
* Fix/refactor issues brought up by type hint lintingGravatar jesopo2018-10-301-2/+2
* Add type/return hints throughout src/ and, in doing so, fix some cyclical•••references. Gravatar jesopo2018-10-301-5/+6
* signal.signal timer callback takes 2 argsGravatar jesopo2018-10-251-1/+1
* Add fallback_encoding to utils.http.get_url, in case a page has no implicit•••encoding Gravatar jesopo2018-10-101-2/+3
* .decode data prior to json.loads in utils.http.get_urlGravatar jesopo2018-10-101-2/+1
* Fix syntax error for throwing a timeout when signal.alarm firesGravatar jesopo2018-10-101-1/+3
* .decode plaintext returns from utils.http.get_urlGravatar jesopo2018-10-101-0/+1
* Use signal.alarm to Deadline utils.http.get_url and throw useful exceptionsGravatar jesopo2018-10-101-16/+28
* Set a max size of 100mb for utils.http.get_urlGravatar jesopo2018-10-101-3/+7
* Change utils.http to use requestsGravatar jesopo2018-10-101-83/+30
* Remove debug print in src.utils.httpGravatar jesopo2018-10-091-1/+0
* Return response code from utils.http.get_url when code=True and soup=TrueGravatar jesopo2018-10-091-4/+11
* Support post_data in utils.http.get_urlGravatar jesopo2018-10-081-2/+7