aboutsummaryrefslogtreecommitdiff
path: root/src/utils/http.py
Commit message (Expand)AuthorAgeFilesLines
* log which URL caused an error in request_manyGravatar jesopo2019-09-171-1/+6
* only decode content-types in DECODE_CONTENT_TYPESGravatar jesopo2019-09-171-1/+1
* Response.__init__() needs `encoding` nowGravatar jesopo2019-09-171-1/+1
* restore 5 second (instead of default 10) deadline for http.requestGravatar jesopo2019-09-171-1/+1
* use utils.deadline_process() in utils.http._request() so background threads can•••call _request() Gravatar jesopo2019-09-171-30/+37
* add `json_body` arg to Request to json-encode body, only return from `body` if•••not null Gravatar jesopo2019-09-161-4/+8
* allow Requests to specify a useragentGravatar jesopo2019-09-121-3/+4
* add a helper utils.http.Client static objectGravatar jesopo2019-09-111-0/+4
* add `proxy` to Request objectsGravatar jesopo2019-09-111-1/+2
* refactor utils.http.requests to support a Request objectGravatar jesopo2019-09-111-27/+77
* automatically decode certain http content typesGravatar jesopo2019-09-111-1/+6
* Don't try to .decode non-html things, default iso-lat-1 for non-html tooGravatar jesopo2019-09-091-5/+5
* add flag to disable encoding detectionGravatar jesopo2019-09-091-5/+4
* 'str.split' -> 's.split'Gravatar jesopo2019-09-091-1/+1
* still default to iso-latin-1 if no on-page or in-header content-type is presentGravatar jesopo2019-09-091-1/+1
* only look for <meta>-related tags when there are meta tagsGravatar jesopo2019-09-091-9/+11
* add explicit None return for _find_encoding (mypy)Gravatar jesopo2019-09-091-0/+1
* change utils.http.request to best-effort detect on-page encoding•••closes #113 Gravatar jesopo2019-09-091-2/+34
* correctly qualify DeadlineExceededException namespaceGravatar jesopo2019-09-031-1/+1
* use utils.deadline() in utils.http.request, not raw sigalrmGravatar jesopo2019-09-021-18/+15
* Pass the content of a webpage to HTTPParsingExceptionGravatar jesopo2019-09-021-2/+2
* use \S+ for url regex (for non-ascii chars), use url_sanitize to catch <>Gravatar jesopo2019-09-021-9/+12
* Allow bypass of content-type check in utils.http.requestGravatar jesopo2019-08-051-3/+3
* not all HTTP responses have content-typeGravatar jesopo2019-08-021-1/+1
* asyncio.gather -> asyncio.wait (with timeout)Gravatar jesopo2019-07-081-1/+1
* tell asyncio.gather which loop to useGravatar jesopo2019-07-081-1/+1
* close event loop when we're done with it (request_many())Gravatar jesopo2019-07-081-1/+2
* Don't try/except async http exceptionsGravatar jesopo2019-07-081-5/+1
* switch request_many() to use asyncio.gatherGravatar jesopo2019-07-081-14/+18
* catch async exceptions in utils.http.request_many()Gravatar jesopo2019-07-081-1/+6
* add missing schema in utils.http.sanitise_url, use in rss.pyGravatar jesopo2019-07-081-0/+3
* switch to using asyncio's event loopGravatar jesopo2019-07-081-6/+7
* implement utils.http.request_many as a tonado ioloop yieldGravatar jesopo2019-07-081-1/+19
* url_validate() -> url_sanitise()Gravatar jesopo2019-07-021-1/+1
* Add utils.http.url_validate() for best-effort url tidyingGravatar jesopo2019-07-021-0/+16
* message arg for HTTPWrongContentTypeException/HTTPParsingExceptionGravatar jesopo2019-06-281-5/+5
* Give descriptions to utils.http.HTTPException subclassesGravatar jesopo2019-06-271-2/+6
* add `allow_redirects` kwarg to utils.http.request()Gravatar jesopo2019-06-261-0/+2
* Defer decoding http payload bytestring until after checking ContentTypeGravatar jesopo2019-06-041-2/+5
* Pass str object to BeautifulSoup, not bytes. closes #56Gravatar jesopo2019-05-281-4/+3
* forgot the beautiful %Gravatar Patrick Nappa2019-05-031-1/+1
* ensure that non-url characters not separated by whitespace aren't consumedGravatar Patrick Nappa2019-05-031-1/+1
* Add missing ":"Gravatar jesopo2019-04-251-1/+1
* Support interfaces that don't have AF_INET and/or AF_INET6Gravatar jesopo2019-04-251-1/+4
* Refuse to get the title for any url that points locallGravatar jesopo2019-04-251-2/+30
* Move REGEX_URL out of isgd.py and title.py in to utils.httpGravatar jesopo2019-04-241-1/+2
* Raise a specific exception in utils.http.request for "wrong content type"Gravatar jesopo2019-02-281-1/+4
* Throw ValueError when utils.http.request tries to soup non-html/xml dataGravatar jesopo2019-02-271-3/+6
* Don't try to parse non-html/xml stuff with BeautifulSoupGravatar jesopo2019-02-261-1/+4
* Typo in utils.http.request, 'response_heders' -> 'response_headers'Gravatar jesopo2018-12-111-1/+1