Marius Gedminas
6f55f446ae
Load cookies from the --cookiefile correctly
...
requests.cookies.merge_cookies() requires a dict or a CookieJar as the second argument.
We've been passing lists of Cookie objects instead.
Fixes #62 , harder this time.
2018-03-16 13:23:26 +02:00
Marius Gedminas
6becc08284
Fix internal error when using cookies
...
There was some kind of confusion between a module and a function argument,
introduced in commit 90257a1b5e .
Fixes #62 .
2018-03-15 23:30:41 +02:00
Petr Dlouhý
a1b300c892
Python3: fix imports
2018-01-19 09:52:43 +01:00
Bastian Kleineidam
0ef00eea56
Move GUI files to separate project
2016-01-23 13:28:15 +01:00
Bastian Kleineidam
228bce1ba2
Add to instead of replace the HTTP client headers.
2014-09-20 12:17:42 +02:00
Bastian Kleineidam
35eb30432e
Added some Python3 fixes.
2014-09-12 19:36:30 +02:00
Bastian Kleineidam
29193bbcc9
Fix login URL cookies and don't sanitize after config reading.
2014-07-15 22:23:38 +02:00
Bastian Kleineidam
90257a1b5e
Replace twill with custom code.
2014-07-15 18:37:05 +02:00
Bastian Kleineidam
a665d35feb
Use proxies and checker session in robots.txt.
2014-07-14 20:28:28 +02:00
Bastian Kleineidam
27702ddbac
Catch log output start errors.
2014-07-09 21:54:47 +02:00
Bastian Kleineidam
ad8eb424f3
Merge Mark-Hetherington-xml-parse-warn with slight modifications.
2014-06-13 20:50:37 +02:00
Bastian Kleineidam
9b794b936c
Print interrupt note in text output.
2014-04-30 20:17:33 +02:00
Bastian Kleineidam
43c2e6641b
Logging refactor, interrupt and abort flags added.
2014-04-30 19:59:43 +02:00
Bastian Kleineidam
f180592cc4
Increase thread poll intervall to reduce CPU usage.
2014-03-27 17:43:14 +01:00
Bastian Kleineidam
fc73c6ca6e
Log number of checked unique URLs.
2014-03-14 23:46:17 +01:00
Bastian Kleineidam
91c6e1d29f
Don't log bytes in status.
2014-03-14 22:25:19 +01:00
Bastian Kleineidam
34bdf5c75a
Updated copyright and docs.
2014-03-14 22:09:05 +01:00
Bastian Kleineidam
6437f08277
Display downloaded bytes.
2014-03-14 21:06:10 +01:00
Bastian Kleineidam
cc401923ac
Improve wording of status message.
2014-03-14 20:25:37 +01:00
Bastian Kleineidam
ac78c6d5b8
Internal errors do not stop the checking thread any more.
2014-03-14 20:23:04 +01:00
Bastian Kleineidam
b18854649d
Count unique URLs for url queue limit.
2014-03-14 20:21:46 +01:00
Bastian Kleineidam
6b334dc79b
Fix URL result caching.
2014-03-08 19:35:10 +01:00
Bastian Kleineidam
102837b875
Set maximum redirects
2014-03-06 21:58:35 +01:00
Bastian Kleineidam
82f81241fd
Check all links and add better caching.
2014-03-03 23:29:45 +01:00
Bastian Kleineidam
510af337c1
Improved --version output.
2014-03-01 21:00:16 +01:00
Bastian Kleineidam
74d804ac82
Print release date on --version and internal errors.
2014-03-01 20:59:00 +01:00
Bastian Kleineidam
39c39b1d9f
Disable twill page refresh.
2014-03-01 18:19:29 +01:00
Bastian Kleineidam
0211529d79
Use twill form field number if all else fails.
2014-03-01 18:12:06 +01:00
Bastian Kleineidam
7b34be590b
Introduce check plugins, use Python requests for http/s connections, and some code cleanups and improvements.
2014-03-01 00:12:34 +01:00
Bastian Kleineidam
c806be5c15
Updated copyright
2014-01-08 22:33:04 +01:00
Bastian Kleineidam
e0a2558b2b
Updated copyright.
2013-12-24 07:13:16 +01:00
Bastian Kleineidam
0ca63797bf
Remove content cache.
2013-12-10 23:41:52 +01:00
Bastian Kleineidam
123578a4cd
Make per-host connection limits configurable.
2013-02-27 19:37:28 +01:00
Bastian Kleineidam
35bc79dd90
Updated copyright.
2013-01-25 21:14:27 +01:00
Bastian Kleineidam
faa743e876
Increase per-host connection limits.
2013-01-22 18:18:48 +01:00
Bastian Kleineidam
0e50834f9a
Rename external module to exclude it from some style checks.
2013-01-06 18:17:29 +01:00
Bastian Kleineidam
9820530313
Use better_exchook to print more internal error info.
2012-12-18 23:06:48 +01:00
Bastian Kleineidam
42a17cbb98
Prepare py3 port and display sys.argv on internal errors.
2012-11-26 18:49:07 +01:00
Bastian Kleineidam
eabaa41bd2
Do not check duplicate URLs.
2012-11-06 21:34:22 +01:00
Bastian Kleineidam
ae5f9e8801
Print active threads in debug level.
2012-11-06 21:33:43 +01:00
Bastian Kleineidam
8750d55a73
Add configuration entry for maximum number of URLs.
2012-10-14 11:13:55 +02:00
Bastian Kleineidam
e1e80b7dd5
Remove addrinfo cache.
2012-10-10 10:54:58 +02:00
Bastian Kleineidam
3e1d51b8bf
Use RLock to simplify internal locking.
2012-10-09 21:11:35 +02:00
Bastian Kleineidam
bff217c58b
Never log ignored warnings.
2012-09-20 12:44:40 +02:00
Bastian Kleineidam
4e59056ee7
Warn about duplicate URL contents.
2012-09-17 19:49:50 +02:00
Bastian Kleineidam
6e1841cf1f
Print download and cache statistics.
2012-09-17 15:23:25 +02:00
Bastian Kleineidam
e98f15933f
Stop checking of all output loggers have been deactivated.
2012-09-14 22:36:59 +02:00
Bastian Kleineidam
81d2c4dbd9
Improved documentation.
2012-09-14 22:26:45 +02:00
Bastian Kleineidam
6730fb51ee
Allow maximum check time specification.
2012-09-03 20:17:49 +02:00
Bastian Kleineidam
36b1bb01e0
Fix variable name typo.
2012-08-22 22:00:11 +02:00