Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-14 17:43:11 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
6895 commits 1 branch 0 tags 24 MiB
Commit graph

3273 commits

Author SHA1 Message Date
Bastian Kleineidam
ad8525c483 Improve BadStatusline error message. 2012-10-05 08:32:24 +02:00
Bastian Kleineidam
d15fafb1f7 Code cleanup. 2012-10-05 08:10:44 +02:00
Bastian Kleineidam
5ebd754cdb Improved duplicate url check. 2012-10-01 16:11:45 +02:00
Bastian Kleineidam
ed7c60e491 Do not warn about duplicate URLs which can point to the same content. 2012-10-01 13:42:46 +02:00
Bastian Kleineidam
148846be67 Add flag to log lock contentions. 2012-10-01 13:32:30 +02:00
Bastian Kleineidam
b56c054932 Use finer-grained robots.txt locks to improve lock contention. 2012-10-01 13:29:29 +02:00
Bastian Kleineidam
27b61c3bfa Fix gzip handling in http content decoder. 2012-09-30 14:00:49 +02:00
Bastian Kleineidam
cbc3bcb0d3 Sitemap logger fixes. 2012-09-23 23:20:21 +02:00
Bastian Kleineidam
60305d8877 Code cleanup. 2012-09-23 21:20:12 +02:00
Bastian Kleineidam
e21187b275 Put in-progress URLs back near the front of URL queue, not at end. 2012-09-23 21:00:01 +02:00
Bastian Kleineidam
1f3034b5f5 Sitemap logger fixes. 2012-09-23 20:59:38 +02:00
Bastian Kleineidam
38dd63f055 Code cleanup. 2012-09-23 16:19:42 +02:00
Bastian Kleineidam
7f8fd01b22 Add Accept-Encoding and Accept-Charset headers. 2012-09-23 15:06:44 +02:00
Bastian Kleineidam
03ecff22bb Fix endless loop in http authentication. 2012-09-22 22:21:10 +02:00
Bastian Kleineidam
653b5f27dd Updated ignored schemes. 2012-09-22 16:18:37 +02:00
Bastian Kleineidam
1c59cb4d4c Use GET in case a HEAD method does not succeed, even if robots.txt content checkes denied the page. This way proper check results are achieved (but the content is still not checked, so it's ok). 2012-09-22 07:53:11 +02:00
Bastian Kleineidam
fba465e8e8 Fix robotstxt cache miss stats. 2012-09-21 21:12:28 +02:00
Bastian Kleineidam
f6b007f757 Fix useragent matching in robots.txt parser. 2012-09-21 21:12:13 +02:00
Bastian Kleineidam
bbf25106fa Fix double result setting on http checks. 2012-09-21 20:33:15 +02:00
Bastian Kleineidam
3e464e509c Do not allow empty configuration string values. 2012-09-21 16:05:34 +02:00
Bastian Kleineidam
ecf8753a19 Improved user-agent string similar to Google and Bing search bots. 2012-09-21 15:46:14 +02:00
Bastian Kleineidam
c274b50c50 Store lowercase URL scheme in checker class. 2012-09-21 14:35:25 +02:00
Bastian Kleineidam
0941f6ff02 Improve exception handling by using unicode. 2012-09-21 14:29:20 +02:00
Bastian Kleineidam
f46889a4af Log timestamps in debug output. 2012-09-21 13:05:36 +02:00
Bastian Kleineidam
049882e4fe Remove accept-encoding since some sites have wrong compression. 2012-09-20 22:39:15 +02:00
Bastian Kleineidam
7c6dce6136 Only warn non-empty site duplicates. 2012-09-20 20:39:36 +02:00
Bastian Kleineidam
a03090c20f Optimize intern/extern pattern parsing. 2012-09-20 20:19:13 +02:00
Bastian Kleineidam
c385c35b1a Fix ansicolor again. 2012-09-20 16:39:40 +02:00
Bastian Kleineidam
b9d234c78a Fix wrong method name in SSL certificate check. 2012-09-20 16:28:01 +02:00
Bastian Kleineidam
bff217c58b Never log ignored warnings. 2012-09-20 12:44:40 +02:00
Bastian Kleineidam
600b7c0e69 Fix duplicate content warning when self.size is not set yet. 2012-09-20 12:44:23 +02:00
Bastian Kleineidam
9cfee5eb5b Improved color detection with curses. 2012-09-20 12:13:15 +02:00
Bastian Kleineidam
bc0a17c1c4 Display last modified date in the GUI. 2012-09-19 21:23:39 +02:00
Bastian Kleineidam
d37347cab0 Remove unused variable. 2012-09-19 11:08:06 +02:00
Bastian Kleineidam
18a200d85f Fix tests. 2012-09-19 11:05:26 +02:00
Bastian Kleineidam
b8f8bdf5fc Fix last modified formatting. 2012-09-19 10:09:19 +02:00
Bastian Kleineidam
f5fbd7666f Remove unused import. 2012-09-19 09:39:32 +02:00
Bastian Kleineidam
75719b34f6 Updated copyright. 2012-09-19 09:17:25 +02:00
Bastian Kleineidam
71fba0f8b7 Log all valid URLs in sitemap loggers. 2012-09-19 09:17:08 +02:00
Bastian Kleineidam
9d1c90f96c Write extra script to analyse a memory dump. 2012-09-18 16:08:31 +02:00
Bastian Kleineidam
3a352631ba Add modified field to loggers. 2012-09-18 12:12:00 +02:00
Bastian Kleineidam
1db63227f6 Memoize file operations to minimize disk I/O. 2012-09-18 09:37:21 +02:00
Bastian Kleineidam
932a07a9cf Added XML sitemap logger. 2012-09-18 09:16:34 +02:00
Bastian Kleineidam
4e59056ee7 Warn about duplicate URL contents. 2012-09-17 19:49:50 +02:00
Bastian Kleineidam
02a09dbb28 Add documentation. 2012-09-17 16:30:32 +02:00
Bastian Kleineidam
99bf8aa940 Updated copyright. 2012-09-17 16:09:55 +02:00
Bastian Kleineidam
cb71f483a5 Warn about too long URLs. 2012-09-17 16:00:23 +02:00
Bastian Kleineidam
03667a4ec9 Print warning tags in text output. 2012-09-17 15:29:04 +02:00
Bastian Kleineidam
1f9ee987f9 Improved terminal color detection with curses. 2012-09-17 15:24:04 +02:00
Bastian Kleineidam
6e1841cf1f Print download and cache statistics. 2012-09-17 15:23:25 +02:00
Bastian Kleineidam
0b5b6ab37b Automatically set --complete for graph output. 2012-09-15 15:06:29 +02:00
Bastian Kleineidam
273230d98b Send HTTP Do-Not-Track header. 2012-09-14 22:41:38 +02:00
Bastian Kleineidam
e98f15933f Stop checking of all output loggers have been deactivated. 2012-09-14 22:36:59 +02:00
Bastian Kleineidam
81d2c4dbd9 Improved documentation. 2012-09-14 22:26:45 +02:00
Bastian Kleineidam
86f1c74006 Close loggers properly on I/O errors. 2012-09-14 22:09:18 +02:00
Bastian Kleineidam
6730fb51ee Allow maximum check time specification. 2012-09-03 20:17:49 +02:00
Bastian Kleineidam
a1dfaf2f91 Add missing docstring. 2012-09-02 23:37:43 +02:00
Bastian Kleineidam
21db38546c Updated copyright. 2012-09-02 23:36:31 +02:00
Bastian Kleineidam
3baaca47a0 Add maximum number of allowed puts on URL queue. 2012-09-02 22:44:29 +02:00
Bastian Kleineidam
d8fce1ceeb Do not sort URL queue anymore. 2012-09-02 22:32:14 +02:00
Bastian Kleineidam
7a6436f08f Increase checked cache in URL queue. 2012-09-02 22:21:49 +02:00
Bastian Kleineidam
4c16d3e702 Make 401 unauthorized GET response a warning. 2012-08-26 11:32:17 +02:00
Bastian Kleineidam
b6d45eabe5 Code cleanup. 2012-08-24 09:46:38 +02:00
Bastian Kleineidam
ac6591a009 Recognize WML files on Windows. 2012-08-24 09:46:26 +02:00
Bastian Kleineidam
7334a9863e Make URL properties in GUI selectable with the mouse. 2012-08-24 00:10:59 +02:00
Bastian Kleineidam
ae15d51b30 Translate more result strings. 2012-08-23 23:59:33 +02:00
Bastian Kleineidam
ce4253263c Do not special case http->ftp redirects. 2012-08-23 23:56:36 +02:00
Bastian Kleineidam
7374068941 Remove unused import. 2012-08-23 16:46:14 +02:00
Bastian Kleineidam
73d64e50ab Fix redirection to new scheme. 2012-08-23 16:45:24 +02:00
Bastian Kleineidam
99ab68908c Increase the default number of checker threads. 2012-08-23 16:11:47 +02:00
Bastian Kleineidam
bc287d7710 Make unauthorized access responses with missing www-authenticate headers an error. 2012-08-23 15:52:11 +02:00
Bastian Kleineidam
e252bbf623 Remove Amazon quirk because the default behaviour handles this now. 2012-08-23 05:36:51 +02:00
Bastian Kleineidam
02a9f0bacb Add utility method to read string options. 2012-08-23 04:52:25 +02:00
Bastian Kleineidam
ecef16b2c9 Support WML sites. 2012-08-22 22:43:14 +02:00
Bastian Kleineidam
36b1bb01e0 Fix variable name typo. 2012-08-22 22:00:11 +02:00
Bastian Kleineidam
8d36bf4e3d Show URLs in status bar. 2012-08-14 23:00:50 +02:00
Bastian Kleineidam
76f57dc4ad Updated copyright. 2012-08-14 20:37:24 +02:00
Bastian Kleineidam
6915e2f989 Detect sites not supporting HEAD requests. 2012-08-14 18:43:39 +02:00
Bastian Kleineidam
db76f01d48 Stop application when aborting timed out. Only used on the command line. 2012-08-14 17:41:26 +02:00
Bastian Kleineidam
29a5c1a44a Display the real url name in gui property field. 2012-08-13 18:55:25 +02:00
Bastian Kleineidam
f3b66b102d Fallback to GET when method HEAD is not allowed. 2012-08-13 07:07:21 +02:00
Bastian Kleineidam
e65b5c72ce Correct list of schemes requiring host name. 2012-08-12 14:21:56 +02:00
Bastian Kleineidam
7b567cc378 Make scheme and domain for internal url pattern case insensitive. 2012-08-12 14:19:42 +02:00
Bastian Kleineidam
afc0ecd7a6 --ignore-url now really ignores URLs. 2012-08-12 11:16:29 +02:00
Bastian Kleineidam
b86be09d9e Recalculate extern settings after changing intern patterns. 2012-08-12 11:15:18 +02:00
Bastian Kleineidam
6be3e9ddff Cleanup code and improve redirect anchor handling. 2012-08-12 11:14:56 +02:00
Bastian Kleineidam
10cc59c654 Use colorama only on Windows systems. 2012-08-12 10:23:44 +02:00
Bastian Kleineidam
cf53b33c94 Remove unused functions. 2012-08-11 19:34:27 +02:00
Bastian Kleineidam
aa22dc2702 Fix windows console output. 2012-08-11 07:52:04 +02:00
Bastian Kleineidam
d9acc97f9f Use colorama instead of wconio. 2012-08-10 22:24:00 +02:00
Bastian Kleineidam
c74690a79a Do not check SSl certificates on HTTPS -> HTTP redirects. 2012-08-10 19:43:57 +02:00
Bastian Kleineidam
451a520943 Prevent double color stream proxying. 2012-08-10 19:43:33 +02:00
Bastian Kleineidam
580ab74f0e Updated german translation. 2012-08-09 20:43:31 +02:00
Bastian Kleineidam
82b4dea4fe Updated copyright 2012-08-09 20:43:22 +02:00
Bastian Kleineidam
1c739aed81 Use urlparse.uses_relative instead of unofficial urlparse.non_hierarchical (which has been removed in the current CPython 2.7.x trunk). 2012-08-04 20:40:31 +02:00
Bastian Kleineidam
b0e5c7fc59 Ignore feed: URLs. 2012-06-27 21:32:03 +02:00
Bastian Kleineidam
0fd1a78378 Always compare encoded anchor names. 2012-06-27 20:59:53 +02:00
Bastian Kleineidam
e0d6aecad9 Add cancel button to show memory dialog. 2012-06-25 20:25:02 +02:00
Bastian Kleineidam
103fb12987 Display debug output with fixed width font; allow showing of memory dump. 2012-06-25 20:21:45 +02:00
Bastian Kleineidam
bfe79e478f Detect when all checker threads are dead and the queue is not empty. 2012-06-24 22:51:43 +02:00
Bastian Kleineidam
5c045fef44 Fix UNC path handling on Windows. 2012-06-24 10:30:54 +02:00
Bastian Kleineidam
b550a9dcb5 Updated copyright. 2012-06-23 14:31:11 +02:00
Bastian Kleineidam
31519f6a01 Fix handling of UNC pathnames. 2012-06-23 14:30:58 +02:00
Bastian Kleineidam
3f063a5e9f Remove unused import. 2012-06-23 14:29:16 +02:00
Bastian Kleineidam
363ccc0121 Check <object codebase=...> as normal URL. 2012-06-23 14:28:32 +02:00
Bastian Kleineidam
73b176d7c9 Fix URL joining: properly detect absolute URL. 2012-06-23 13:33:27 +02:00
Bastian Kleineidam
cdf6b91b39 Don't use <object codebase=...> attribute as parent url. 2012-06-23 13:32:08 +02:00
Bastian Kleineidam
8d23e2a3c6 Add debugging for checker class name. 2012-06-23 13:30:13 +02:00
Bastian Kleineidam
6d9a8859d3 Require and use Python 2.7.2. 2012-06-22 23:58:20 +02:00
Bastian Kleineidam
dbe57c0f9b Treat Windows UNC paths as absolute paths. 2012-06-22 23:42:37 +02:00
Bastian Kleineidam
713b9ebada Only assume local file links for URLs given on the command line. 2012-06-22 23:42:05 +02:00
Bastian Kleineidam
9d0cced73c Fix SSL check errors. 2012-06-22 07:37:37 +02:00
Bastian Kleineidam
f10b38c13e Fix saving of the debugmemory option. 2012-06-21 22:13:09 +02:00
Bastian Kleineidam
22a4d48d68 Ignore broken locale configuration. 2012-06-20 21:44:57 +02:00
Bastian Kleineidam
979d7f13d3 Updated copyright. 2012-06-20 21:40:21 +02:00
Bastian Kleineidam
5c18a7f8b2 Catch errors getting the default locale. 2012-06-20 21:35:52 +02:00
Bastian Kleineidam
addbcfc54f Updated translation. 2012-06-20 20:18:39 +02:00
Bastian Kleineidam
2888528a13 Code cleanup. 2012-06-20 20:11:13 +02:00
Bastian Kleineidam
4cce99a77d Test SSL certificate expiration. 2012-06-20 20:10:40 +02:00
Bastian Kleineidam
da7c68981b Add missing imports. 2012-06-20 19:23:52 +02:00
Bastian Kleineidam
e903a2a13c Add constants for number of seconds per minute, hour and day. 2012-06-20 19:23:35 +02:00
Bastian Kleineidam
727281a7fc The notimplemented decorator reports now the filename and linenumber of the function. 2012-06-20 19:23:13 +02:00
Bastian Kleineidam
1e13a4f8fc Add donation url to info blurb. 2012-06-20 00:37:39 +02:00
Bastian Kleineidam
eb30191bb0 Add copyright and missing docs. 2012-06-20 00:30:52 +02:00
Bastian Kleineidam
2f730f4e13 Add Nagios plugin. 2012-06-20 00:29:46 +02:00
Bastian Kleineidam
a6eaae2c38 Implement abstract method for logger. 2012-06-20 00:15:45 +02:00
Bastian Kleineidam
2dfe9d4b4f Use abstract base class for loggers. 2012-06-19 23:27:26 +02:00
Bastian Kleineidam
a50bf226d7 Print Python environment variables for internal errors. 2012-06-19 22:47:26 +02:00
Bastian Kleineidam
cbb13a8983 Add SSL certificate verification. 2012-06-18 23:05:44 +02:00
Bastian Kleineidam
b0694ddfa7 Add meliae to optional module list. 2012-06-18 22:39:07 +02:00
Bastian Kleineidam
d26b6e707c Fix function name typo. 2012-06-10 22:54:32 +02:00
Bastian Kleineidam
f107092a8a Fix handling of user/password info in URLs. 2012-06-10 22:07:42 +02:00
Bastian Kleineidam
838095cbd5 Updated copyright. 2012-06-10 14:58:38 +02:00
Bastian Kleineidam
00aa631267 Add localwebroot configuration option. 2012-06-10 14:47:27 +02:00
Bastian Kleineidam
98537eea2f Code cleanup: use add_url() function in UrlBase. 2012-06-10 14:24:17 +02:00
Bastian Kleineidam
db95fce77e Ignore PHP processing instructions in local files. 2012-06-10 14:02:01 +02:00
Bastian Kleineidam
2dee223555 Allow memory dumps to be written. 2012-06-10 13:18:35 +02:00
Bastian Kleineidam
837ab22d01 Syntax cleanup. 2012-06-10 11:46:05 +02:00
Bastian Kleineidam
3ebe5708db Code cleanup: add function for boolean option settings. 2012-06-10 11:22:54 +02:00
Bastian Kleineidam
77b8ec0fcd Fix writing temporary Word files. 2012-06-10 11:07:35 +02:00
Bastian Kleineidam
b12c1e40fb Allow specifying the file mode when opening temp files. 2012-06-10 11:03:43 +02:00
Bastian Kleineidam
54ffb102d8 Code cleanup: add function for GET fallback. 2012-06-10 09:52:12 +02:00
Bastian Kleineidam
5c94c47901 Remove old Squid proxy workaround. 2012-06-10 09:45:07 +02:00
Bastian Kleineidam
b83d3b53fc Added missing documentation. 2012-06-02 00:31:02 +02:00
Bastian Kleineidam
6aa0249ea7 Updated httplib2.py from upstream. 2012-06-02 00:28:12 +02:00
Bastian Kleineidam
9273b9e8af Fix configdata attribute name. 2012-05-23 21:15:30 +02:00
Bastian Kleineidam
e13a479362 Fix error logging. 2012-05-23 06:55:02 +02:00
Bastian Kleineidam
fa92d59448 Catch mimedb init errors. 2012-05-23 06:02:23 +02:00
Bastian Kleineidam
f6f43ffba8 Improve warning about missing twill module. 2012-05-10 21:29:18 +02:00
Bastian Kleineidam
bcbacec79a Code cleanup. 2012-05-10 21:05:33 +02:00
Bastian Kleineidam
90a0f4b51e Detect pygeoip library on Windows. 2012-05-10 06:45:29 +02:00
Bastian Kleineidam
61138744e6 Always use GET for Zope servers. 2012-05-08 20:47:47 +02:00
Bastian Kleineidam
cd6ee8a1bc Fix checker test cases for non-english locales. 2012-04-23 20:56:33 +02:00
Bastian Kleineidam
4cc19f4e9c Fix strformat tests on non-english locales. 2012-04-23 20:35:32 +02:00
Bastian Kleineidam
1cc3ac5f80 Updated copyright. 2012-04-22 20:45:24 +02:00
Bastian Kleineidam
1ab2e2c1a9 Use mkdir() instead of makedirs() for user configuration directory. Also fix logging on errors copying the user configuration. 2012-04-22 20:42:39 +02:00
Bastian Kleineidam
52dcf101e0 Remove rest of deprecated options. 2012-04-22 17:55:12 +02:00
Bastian Kleineidam
c7ced2445b Ensure correct encoding when writing non-ascii CSV output. 2012-04-22 17:52:47 +02:00
Bastian Kleineidam
c12d44d092 Catch and report locale errors in WSGI script. 2012-04-22 13:10:03 +02:00
Bastian Kleineidam
c2221e1a18 Ensure proper encoding in WSGI script. 2012-04-22 12:48:21 +02:00
Bastian Kleineidam
d423a8b1af Document web interface request timeout. 2012-04-21 12:34:34 +02:00
Bastian Kleineidam
0fdaf00154 Use Python threads in stead of Qt threads. The WSGI script works now. 2012-04-21 12:08:17 +02:00
Bastian Kleineidam
dab01b00d6 Add 5 minute timeout for WSGI script. 2012-04-20 19:25:27 +02:00
Bastian Kleineidam
ad09bc50b3 Improved logging in CGI script. 2012-04-19 20:56:51 +02:00
Bastian Kleineidam
1ef9a022ca Make WSGI script more responsive by using threads. 2012-04-18 21:52:36 +02:00
Bastian Kleineidam
3d831c1adb Updated copyright. 2012-04-11 22:23:43 +02:00
Bastian Kleineidam
f9290932b8 Fix bookmark menu entries in GUI. 2012-04-11 22:23:06 +02:00
Bastian Kleineidam
67b751f1c7 Write correct statistics when saving data in the GUI client. 2012-04-11 21:53:15 +02:00
Bastian Kleineidam
ae0bd406d4 Do not encode CSV outro output comment. 2012-04-11 20:43:46 +02:00
Bastian Kleineidam
bf1d9b1fad Fix locale file lookup. 2012-04-11 20:34:55 +02:00
Bastian Kleineidam
192a560258 Code cleanup. 2012-04-11 20:33:32 +02:00
Bastian Kleineidam
7a019aac51 Fix update check when content could not be downloaded. 2012-04-09 13:36:18 +02:00
Bastian Kleineidam
a76824043c Ignore any errors from bookmark file finders. 2012-04-06 08:24:30 +02:00
Bastian Kleineidam
d3d3529c23 Added a WSGI script. 2012-04-06 08:23:41 +02:00
Bastian Kleineidam
797024c69b Fix URL connection cache key. 2012-04-04 22:58:09 +02:00
Bastian Kleineidam
1a28c2e334 Detect invalid empty cookies. 2012-04-03 08:03:54 +02:00
Bastian Kleineidam
e9420d77db Updated copyright. 2012-03-31 09:24:08 +02:00
Bastian Kleineidam
b48812f612 Encode comments in CSV logger. 2012-03-31 09:17:49 +02:00
Bastian Kleineidam
4feea986b4 Fix concatenation of multiple cookie values. 2012-03-31 08:51:58 +02:00
Bastian Kleineidam
da6d7b0eca Store cookies on redirect. 2012-03-31 08:37:18 +02:00
Bastian Kleineidam
8afc11e546 Upstream update. 2012-03-30 22:32:46 +02:00
Bastian Kleineidam
6d5e5f9efb Updated copyright. 2012-03-30 22:24:10 +02:00
Bastian Kleineidam
9ee9abcf0f Parse invalid comments <! bla > 2012-03-23 07:41:03 +01:00
Bastian Kleineidam
b9b8e3f5b2 Honor the charset encoding of the Content-Type HTTP 
header when parsing HTML.
 2012-03-22 22:45:11 +01:00
Bastian Kleineidam
d6d82b96f1 Add cookiefile config option. 2012-03-22 22:29:56 +01:00
Bastian Kleineidam
98b4768419 Use timeout when checking email addresses with SMTP. 2012-03-16 21:44:18 +01:00
Bastian Kleineidam
3b818d99c0 Allow --pause to be set in configuration file. 2012-03-16 21:28:30 +01:00
Bastian Kleineidam
67974386f6 Remove donate menu entry, it's already displayed in the about dialog. 2012-03-16 21:23:40 +01:00
Bastian Kleineidam
fb845ec813 Replace configuration filename in options dialog. 2012-03-16 06:19:02 +01:00
Bastian Kleineidam
64a7713f8f Set option dialog title. 2012-03-15 21:41:49 +01:00
Bastian Kleineidam
4c9fd8d488 Cache real url. 2012-03-14 21:12:13 +01:00
Bastian Kleineidam
5c542277af Improved error message for connect error to clamav daemon. 2012-03-12 21:13:22 +01:00
Bastian Kleineidam
5e13a78f66 Fix non-ascii HTTP header debugging. 2012-03-09 11:54:18 +01:00
Bastian Kleineidam
187a94312b Updated copyright. 2012-03-09 11:16:18 +01:00
Bastian Kleineidam
3fcff8a4e5 Fix non-ascii HTTP header handling. 2012-03-09 11:14:18 +01:00
Bastian Kleineidam
24811ac7b0 Recheck extern status on HTTP redirects even if domain did not change. 2012-03-08 10:07:31 +01:00
Bastian Kleineidam
0f0c1a22b8 Added missing python function docs. 2012-01-29 17:21:24 +01:00
Bastian Kleineidam
71f5ee42c8 Updated copyright. 2012-01-29 17:18:28 +01:00
Bastian Kleineidam
c3423b3d6a Add drag-n-drop support for project files. 2012-01-26 20:57:03 +01:00
Bastian Kleineidam
1deeb88e16 Add project support. 2012-01-26 20:23:15 +01:00
Bastian Kleineidam
b5852683ab Do not write userconfig in portable mode. 2012-01-23 22:24:51 +01:00
Bastian Kleineidam
042b0569ec Fall back to W3C checkers. 2012-01-22 08:13:27 +01:00
Bastian Kleineidam
51cf55b7a6 Remove warning: prefix from warning messages. 2012-01-21 00:25:02 +01:00
Bastian Kleineidam
053ea33b06 Updated GUI icons from oxygen upstream. 2012-01-19 16:59:14 +01:00
Bastian Kleineidam
6e1e9148d8 Work around a squid bug resulting in not detecting broken links 2012-01-17 08:36:11 +01:00
Bastian Kleineidam
e99c55f6c4 Proper proxy type check. 2012-01-16 21:15:53 +01:00
Bastian Kleineidam
4c15fc6a8b Properly handle non-ASCII HTTP header values. 2012-01-14 11:01:09 +01:00
Bastian Kleineidam
a0581cc2a1 Ignore steam:// URIs. 2012-01-10 19:37:19 +01:00
Bastian Kleineidam
19f0bbe7ce Add Ctrl-L shortcut to highlight URL. 2012-01-09 20:52:24 +01:00
Bastian Kleineidam
886bacb2ac Updated copyright. 2012-01-06 20:33:49 +01:00
Bastian Kleineidam
ee5ba648be Determine width of current console for help output. 2012-01-06 13:05:30 +01:00
Bastian Kleineidam
f1eb51d885 Updated copyright 2012-01-06 09:21:30 +01:00
Bastian Kleineidam
9b437fd1e4 Use dictionary-based logging config. 2012-01-04 21:07:35 +01:00
Bastian Kleineidam
033280cfb9 Remove workarounds for old Python versions. 2012-01-04 20:17:53 +01:00
Bastian Kleineidam
d36c46a27f Require Python 2.7 2012-01-04 20:17:13 +01:00
Bastian Kleineidam
e316f5be68 Remove unneeded comment. 2012-01-04 20:04:36 +01:00
Bastian Kleineidam
6409651f55 Remove unused function. 2012-01-04 20:04:14 +01:00
Bastian Kleineidam
28c58519d9 Update httplib.py from upstream. 2012-01-04 19:55:47 +01:00
Bastian Kleineidam
fb979b4f3c Add test for archive attribute support. 2011-12-30 12:36:22 +01:00
Bastian Kleineidam
d06c43d470 Split comma-separated archive attribute values. 2011-12-30 08:58:45 +01:00
Bastian Kleineidam
4a4985a960 Add HTML5 link elements and attributes. 2011-12-30 08:55:38 +01:00
Bastian Kleineidam
422d4e9c6c Fix saving of GUI results. 2011-12-29 06:52:48 +01:00
Bastian Kleineidam
dff425710d More Freshmeat/Freecode replacements. 2011-12-25 09:06:18 +01:00
Bastian Kleineidam
1c26c14b64 Set copyright year and add missing docstrings. 2011-12-25 08:45:27 +01:00
Bastian Kleineidam
10b9c12ce9 Fix GUI check result saving. 2011-12-20 20:53:49 +01:00
Bastian Kleineidam
61f9f31de2 Make copy from loggerclass dict. 2011-12-17 20:54:30 +01:00
Bastian Kleineidam
de652d8138 Minor code cleanups. 2011-12-17 19:13:54 +01:00
Bastian Kleineidam
3d9958dfbb Parse Safari bookmark files. 2011-12-17 16:38:25 +01:00
Bastian Kleineidam
925a7166b6 Remove separator in edit menu. 2011-12-17 12:38:14 +01:00
Bastian Kleineidam
aeb6df05bd Fix application config directory for Darwin platforms. 2011-12-17 07:33:21 +01:00
Bastian Kleineidam
351cc72aa4 Make GUI options a little wider; add separator in edit menu. 2011-12-16 21:49:31 +01:00
Bastian Kleineidam
21532a70ec Return with non-zero return value when internal program errors occurred. 2011-12-14 22:54:26 +01:00
Bastian Kleineidam
433cf029d9 Replace copy.copy() with simple list copying when backing up configuration values. 2011-12-14 19:55:06 +01:00
Bastian Kleineidam
5f0853be87 Display GUI options in one dialog; support warning strings in GUI options; support ignore patterns in GUI options. 2011-12-13 21:25:09 +01:00
Bastian Kleineidam
9367e3166c Recreate UI files. 2011-12-12 19:01:40 +01:00
Bastian Kleineidam
1b5cad3b3e Only remove whitespace at start and end of URL. 2011-12-10 11:49:44 +01:00
Bastian Kleineidam
5576dfe10d Fix LFUCache: delete 5% of least frequently used entries on shrink, not 95%. 2011-12-08 22:10:53 +01:00
Bastian Kleineidam
9956f3712e Properly detect too-long Unicode hostnames. 2011-12-05 20:51:42 +01:00
Bastian Kleineidam
76eddb62a8 Properly detect home directory on OS X systems. 2011-11-05 12:03:55 +01:00
Bastian Kleineidam
5c496df9ed Regenerate HTML parser with new Bison 2.5 version. 2011-10-31 06:41:45 +01:00
Bastian Kleineidam
a7f3b43bab Remove unused file. 2011-10-28 00:49:46 +02:00
Bastian Kleineidam
c8c3470255 Use new warningregex option in GUI. 2011-10-20 09:12:28 +02:00
Bastian Kleineidam
fb237041d1 Updated copyright 2011-10-20 08:14:16 +02:00
Bastian Kleineidam
91e296b7ae Add warning-regex GUI option. 2011-10-19 22:43:51 +02:00
Bastian Kleineidam
3461b96729 Fix adding bookmark context menu entries. 2011-10-19 20:54:34 +02:00
Bastian Kleineidam
c7afb3f1a1 Add actions to find bookmark files to edit menu. 2011-10-19 20:44:09 +02:00
Bastian Kleineidam
8f93245c26 Refactor and create a menu action adding function for the bookmark actions. 2011-10-19 20:42:24 +02:00
Bastian Kleineidam
91dce84c59 Fix sqlify for multiline contents. 2011-10-18 14:40:33 +02:00
Bastian Kleineidam
a2978209e6 Ignore errors trying to get FTP feature set. 2011-10-18 13:10:49 +02:00
Bastian Kleineidam
74ea444a9a Parse logger and logging part names case insensitive. 2011-10-10 20:32:58 +02:00
Bastian Kleineidam
bf426c3956 Fix GUI startup on configuration errors. 2011-10-09 21:46:39 +02:00
Bastian Kleineidam
e71d441ce6 Raise correct error messages for configuration errors. 2011-10-09 21:45:56 +02:00
Bastian Kleineidam
27b7b1cb49 Fix W3C HTML validation. 2011-10-09 21:16:45 +02:00
Bastian Kleineidam
6e69f8f3b1 Fix sql logging output. 2011-10-09 19:02:23 +02:00
Bastian Kleineidam
89ec0ee6a1 Check multiple matches of warning regex. 2011-10-09 19:00:35 +02:00
Bastian Kleineidam
d2ae6bf71c Properly detect HTML character encoding. 2011-08-14 12:49:31 +02:00
Bastian Kleineidam
689ab9f073 Add debugging for charset encoding parameter setting. 2011-08-14 12:45:08 +02:00
Bastian Kleineidam
09d9264470 Updated copyright. 2011-08-04 20:40:49 +02:00
Bastian Kleineidam
cf1d4d9259 Rename Status: in Info: 2011-08-04 20:34:30 +02:00
Bastian Kleineidam
5c8dda3cd6 Properly reset active url count when checking stops. 2011-08-04 20:32:15 +02:00
Bastian Kleineidam
cdf91a0321 Improve cookie info message and fix cookie test cases. 2011-08-04 18:34:56 +02:00
Bastian Kleineidam
6b52b28425 Send all domain-matching cookies that apply. 2011-08-03 21:21:44 +02:00
Bastian Kleineidam
48413de418 Display warning message for each cookie parsing error. 2011-08-03 19:27:36 +02:00
Bastian Kleineidam
ef6a3b99af Strip newline at end of cookie string. 2011-08-03 19:26:59 +02:00
Bastian Kleineidam
ee7e04c6c6 Remove unused function client_header_name() 2011-08-02 21:57:37 +02:00
Bastian Kleineidam
c99b75899d Send multiple cookie values in one header. 2011-08-02 21:57:16 +02:00
Bastian Kleineidam
8779158b2f Sent cookies with more specific paths first. 2011-08-02 21:56:26 +02:00
Bastian Kleineidam
c70bd68ef1 Refactor sending of cookie data in client into separate function. 2011-08-02 20:45:26 +02:00
Bastian Kleineidam
977d9e9ae6 Update cookie values instead of adding duplicate entries. 2011-08-01 20:26:31 +02:00
Bastian Kleineidam
210b45d1e4 Removed FastCGI script. 2011-07-25 21:37:35 +02:00
Bastian Kleineidam
7ebe67d7f6 Default to last URL checked in GUI. 2011-07-25 21:31:33 +02:00
Bastian Kleineidam
752941e029 Ignore AttributeError when printing the Qt version. 2011-07-25 21:15:52 +02:00
Bastian Kleineidam
51bcccfdfe Added new option --user-agent to set the User-Agent header. 2011-07-25 21:09:49 +02:00
Bastian Kleineidam
552c71a3ca Do not append a stray newline character when encoding authentication information to base64. 2011-07-25 20:02:01 +02:00
Bastian Kleineidam
2550e16040 Remove query part from file links. 2011-05-29 17:49:01 +02:00
Bastian Kleineidam
5515645af6 Reset content type setting after loading HTTP headers. 2011-05-28 17:59:44 +02:00
Bastian Kleineidam
c9707ee735 Handle stray < before end tags. 2011-05-28 13:39:04 +02:00
Bastian Kleineidam
0f70438a87 Updated copyright. 2011-05-28 08:44:21 +02:00
Bastian Kleineidam
b71d8444a9 Add missing imports after using fileutils.has_module. 2011-05-28 07:50:02 +02:00
Bastian Kleineidam
d956e62308 Move busy indicator next to the status label. 2011-05-28 07:43:36 +02:00
Bastian Kleineidam
6d284e220b Use has_module and is_tty utility functions. 2011-05-26 07:28:29 +02:00
Bastian Kleineidam
53f34d6b2e Add is_tty utility function. 2011-05-26 07:28:14 +02:00
Bastian Kleineidam
684a9b5bf6 Add includes to dns.rdtypes.IN/ANY in setup.py, not in mailtourl.py module. 2011-05-25 21:03:10 +02:00
Bastian Kleineidam
e1f724908d Move dnspython module into third_party directory. 2011-05-24 20:18:58 +02:00
Bastian Kleineidam
72b65d94df Only check anchors in HTML pages. 2011-05-22 17:33:16 +02:00
Bastian Kleineidam
e5c2271533 Only check warning patterns in parseable contents. 2011-05-22 17:32:26 +02:00
Bastian Kleineidam
68ea03ee16 Support both Chromium and Google Chrome profile dirs to find bookmark files. 2011-05-21 11:47:54 +02:00
Bastian Kleineidam
e3bb574997 Remove support for system configuration file. 2011-05-20 21:10:31 +02:00
Bastian Kleineidam
7d04c3ee81 Handle stray < characters in HTML. 2011-05-20 06:50:08 +02:00
Bastian Kleineidam
78790d7c8d Improved anchor warning message display. 2011-05-20 06:48:06 +02:00
Bastian Kleineidam
720cadc41a Add more padding to option dialog. 2011-05-19 20:12:05 +02:00
Bastian Kleineidam
ba30ca2d18 Improved option dialog layout. 2011-05-19 20:05:55 +02:00
Bastian Kleineidam
4ef750a66d Adjust option window. 2011-05-18 22:41:06 +02:00
Bastian Kleineidam
3ca470ba60 Increase size of option window. 2011-05-18 21:15:18 +02:00
Bastian Kleineidam
b7774a93f6 Fix wrong QSize module reference. 2011-05-18 21:02:33 +02:00
Bastian Kleineidam
cf51f4ab83 Remove unused variables. 2011-05-18 20:57:14 +02:00
Bastian Kleineidam
03feaeca91 Correct warning about unparsable cookies. 2011-05-18 20:56:31 +02:00
Bastian Kleineidam
343cf9703d Code cleanup: indentation, unused variables etc. 2011-05-15 18:36:30 +02:00
Bastian Kleineidam
581da4a9c6 Fix misnamed variable. 2011-05-14 20:21:39 +02:00
Bastian Kleineidam
0dd5cfd12d Display warnings in result column. 2011-05-14 20:15:37 +02:00
Bastian Kleineidam
deead957ae Display number of selected rows in status. 2011-05-14 14:31:03 +02:00
Bastian Kleineidam
4c71b5ba68 Use httplib cookie parsing; fix docs. 2011-05-14 13:56:38 +02:00
Bastian Kleineidam
50fc4ab566 Colorize result in text logger. 2011-05-14 09:36:21 +02:00
Bastian Kleineidam
a8fbd05f48 Remember last 10 documents. 2011-05-11 22:15:04 +02:00
Bastian Kleineidam
3423dbe9be Add dropdown button to select from list of text strings. 2011-05-11 22:14:22 +02:00
Bastian Kleineidam
506cb9991b Added limit to number of recent documents. 2011-05-11 22:13:18 +02:00
Bastian Kleineidam
40b83b9dd4 Updated down arrow button with transparent background. 2011-05-11 19:03:42 +02:00
Bastian Kleineidam
e2656b5b98 Return list of unicode strings for recent documents. 2011-05-11 00:24:17 +02:00
Bastian Kleineidam
b357ec2b6c Added model for storing list of recent documents. 2011-05-10 23:49:54 +02:00
Bastian Kleineidam
5401413f05 Only remove copied icons in clean. 2011-05-10 23:48:43 +02:00
Bastian Kleineidam
d7b528acdf Added KDE down arrow as resource. 2011-05-10 23:48:22 +02:00
Bastian Kleineidam
c9dca19011 Read and save recent documents in settings. 2011-05-10 23:45:44 +02:00
Bastian Kleineidam
e54f7a93c2 Disable URL input while checking. 2011-05-10 06:56:41 +02:00
Bastian Kleineidam
f3bb106ec2 Display status info in main window. 2011-05-09 20:49:07 +02:00
Bastian Kleineidam
1b9576437d Put progress window in main window. 2011-05-07 21:14:08 +02:00
Bastian Kleineidam
a1f0867c74 Updated copyright 2011-05-06 20:27:36 +02:00
Bastian Kleineidam
10bbb696e8 Limit download file size to 5MB. 2011-05-05 21:10:55 +02:00
Bastian Kleineidam
3cee705a4a Warn user before closing changed editor window. 2011-05-05 20:09:45 +02:00
Bastian Kleineidam
1703e6c942 Debug geoip errors. 2011-05-05 19:42:19 +02:00
Bastian Kleineidam
b3e692ea79 Catch socket errors when resolving GeoIP country data. 2011-05-05 19:37:58 +02:00
Bastian Kleineidam
f8cba79875 Display release date in about dialog. 2011-05-05 18:30:58 +02:00
Bastian Kleineidam
ecc598bd03 Do not use configuration file options for GUI defaults. 2011-04-30 19:57:14 +02:00
Bastian Kleineidam
02a6f31c4c Ensure file handles are closed before emitting signals. 2011-04-30 19:56:43 +02:00
Bastian Kleineidam
929fd8d4aa Scroll down for new URLs added to the treeview. 2011-04-30 11:11:45 +02:00
Bastian Kleineidam
0470f6dbf0 Fixed saving of URL parent source in the GUI editor. 2011-04-30 08:39:49 +02:00
Bastian Kleineidam
7cd67d29cf Reload text file configuration after GUI changed it. 2011-04-30 08:38:44 +02:00
Bastian Kleineidam
10d6e81af3 Highlight check results. 2011-04-30 07:35:25 +02:00
Bastian Kleineidam
dacc7e7ae4 Consolidate the stop messages. 2011-04-29 19:49:24 +02:00
Bastian Kleineidam
d7186bc904 Remove unused QThread.__del__ method. 2011-04-28 20:41:44 +02:00
Bastian Kleineidam
7d4a03aff2 Replace QString methods with Python str methods. 2011-04-28 18:43:27 +02:00
Bastian Kleineidam
15d62e49e6 Replace deprecated methods of PyQt (also makes it easier to port to PySide). 2011-04-28 18:41:47 +02:00
Bastian Kleineidam
4dc16708a7 Add rebuild target for all UI and resource files. 2011-04-28 18:41:11 +02:00
Bastian Kleineidam
0fc3355066 Colorize statistic output in GUI. 2011-04-28 15:32:53 +02:00
Bastian Kleineidam
6ca10152c5 Don't override start_output() function in GUI logger to correctly reset statistics. 2011-04-28 15:30:51 +02:00
Bastian Kleineidam
1f9cd2f67f Redirection refactoring part 2 of 2. 2011-04-27 13:33:01 +02:00
Bastian Kleineidam
dd53c78096 Redirection refactoring part 1. 2011-04-27 12:02:30 +02:00
Bastian Kleineidam
f566f98fe5 Allow redirections for URLs given by the user. 2011-04-27 11:21:58 +02:00
Bastian Kleineidam
db7ea6872a Refactor internal URL pattern matcher into function. 2011-04-27 08:34:15 +02:00
Bastian Kleineidam
a3568e456b Add missing file header. 2011-04-26 21:32:57 +02:00
Bastian Kleineidam
d7d563bf6e Add Qt syntax highlighting. 2011-04-26 21:31:45 +02:00
Bastian Kleineidam
66079549ef Use fixed-width font for Qt editor. 2011-04-26 18:58:08 +02:00
Bastian Kleineidam
ff5d0b27e3 Updated documentation. 2011-04-26 15:06:22 +02:00
Bastian Kleineidam
74c132c90b Updated copyright. 2011-04-26 14:57:57 +02:00
Bastian Kleineidam
f61de7902a Report QScintilla as extra module. 2011-04-26 14:57:32 +02:00
Bastian Kleineidam
65721e2b3b Updated application icon. 2011-04-26 14:04:24 +02:00
Bastian Kleineidam
199deff1f0 Remove debug code. 2011-04-26 13:58:22 +02:00
Bastian Kleineidam
8ea2d147fc Show line numbers in Qt editor. 2011-04-26 13:55:42 +02:00
Bastian Kleineidam
b249150d9a Fix OS X ifconfig call. 2011-04-26 11:42:04 +02:00
Bastian Kleineidam
040e6b49e0 Use ifconfig(8) network info on Mac OS X. 2011-04-26 11:32:58 +02:00
Bastian Kleineidam
4ae0566f95 Parse IPv4 values from ifconfig(8). 2011-04-26 11:30:26 +02:00
Bastian Kleineidam
d3d0892927 Handle error for getting address of an interface. 2011-04-26 11:16:15 +02:00
Bastian Kleineidam
241205e5b0 Only get network interfaces that are up. 2011-04-26 10:53:58 +02:00
Bastian Kleineidam
6a135dd79c Use ifconfig on Mac OS X to get interface list. 2011-04-26 10:52:19 +02:00
Bastian Kleineidam
d16fe3cac1 Make QScintilla optional. 2011-04-26 10:48:44 +02:00
Bastian Kleineidam
54a14d0f91 Use Python 2.7 for local build. 2011-04-22 08:39:45 +02:00
Bastian Kleineidam
719441cca5 Make module detection more robust and use it when possible. 2011-04-20 09:08:11 +02:00
Bastian Kleineidam
c0957a20df Make strlen variables type size_t. 2011-04-19 16:07:10 +02:00
Bastian Kleineidam
6a544f2d69 Only allow redirections to FTP, HTTP and HTTPS URLs. 2011-04-19 07:01:55 +02:00
Bastian Kleineidam
4c98c463dc Correctly declare all variables at beginning of block. 2011-04-16 15:25:51 +02:00
Bastian Kleineidam
836e8a700d Print detected modules information. 2011-04-14 12:20:56 +02:00
Bastian Kleineidam
d74523500a Add version info of used modules to GUI about page. 2011-04-14 10:03:59 +02:00
Bastian Kleineidam
7365170564 Updated copyright. 2011-04-12 09:13:39 +02:00
Bastian Kleineidam
42ed4350de Use Qt Macintosh widgte style on OS X systems. 2011-04-12 08:55:25 +02:00
Bastian Kleineidam
e3fb40f753 Fix internal error handling in non-main threads. 2011-04-12 08:31:10 +02:00
Bastian Kleineidam
2493684604 Also send Cache-Control header to prevent caching. 2011-04-10 11:03:20 +02:00
Bastian Kleineidam
d915b17498 Prevent getting cached answers for version update check. 2011-04-10 10:57:56 +02:00
Bastian Kleineidam
02b54d804c Allow additional headers for url.get_content(). 2011-04-10 10:57:28 +02:00
Bastian Kleineidam
84f6d56a49 Print level in loggers xml, csv and sql. 2011-04-09 10:51:03 +02:00
Bastian Kleineidam
c0732e3d37 Do not print empty country information. 2011-04-06 17:22:48 +02:00
Bastian Kleineidam
ef499d5cf2 Write statistics when saving result files in the GUI. 2011-04-06 14:31:58 +02:00
Bastian Kleineidam
b9c9dda9b3 Correctly encode CSV output. 2011-04-06 12:54:58 +02:00
Bastian Kleineidam
40cad4e468 Add detailed locale info to internal error output. 2011-04-06 11:56:55 +02:00
Bastian Kleineidam
c3b3027c6d Only output configured parts in CSV logger. 2011-04-06 11:12:05 +02:00
Bastian Kleineidam
520b417855 Added CSV output type in the GUI for results. 2011-04-04 18:58:20 +02:00
Bastian Kleineidam
b465542388 Fix display of warnings in GUI pane. 2011-04-02 14:07:57 +02:00
Bastian Kleineidam
8b2fa88f18 Print gconf errors only in debug mode. 2011-03-25 13:34:48 +01:00
Bastian Kleineidam
53205cbe20 Added documentation to getText() function. 2011-03-21 16:48:09 +01:00
Bastian Kleineidam
cdb00e9ef8 Do not write empty tag attributes. 2011-03-21 16:07:45 +01:00
Bastian Kleineidam
3e6de5213c Updated copyright 2011-03-21 15:23:40 +01:00
Bastian Kleineidam
ec8e529406 Cleanup new get_encoded_writer() function. 2011-03-21 13:17:12 +01:00
Bastian Kleineidam
c1eb8d85e9 Use new get_encoded_writer() function. 2011-03-21 13:16:43 +01:00
Bastian Kleineidam
847d740e37 Move get_stdout_writer() to i18n module and allow the make sys.stdout a function argument. 2011-03-21 13:11:32 +01:00
Bastian Kleineidam
e7bd7ab667 Reword the internal error message for other clients than commandline. 2011-03-21 12:35:36 +01:00
Bastian Kleineidam
7770153b55 Remove send button. 2011-03-21 12:32:20 +01:00
Bastian Kleineidam
e8274ef4ab Add getText() method. 2011-03-21 12:32:00 +01:00
Bastian Kleineidam
48c3343e8b Make sure all internal error output is printed to given output stream. Also add ability to pass traceback information directly. 2011-03-21 11:34:46 +01:00
Bastian Kleineidam
2c61e8db49 Fix File->Save results command. 2011-03-19 17:02:15 +01:00
Bastian Kleineidam
da58546e6d Really read user and system configuration file. 2011-03-17 17:02:51 +01:00
Bastian Kleineidam
671de9774e Fix for previous commit adding warnings tags. 2011-03-17 16:47:39 +01:00
Bastian Kleineidam
d60ae7911b Regenerate GUI dialogs with newer Qt. 2011-03-16 18:07:18 +01:00
Bastian Kleineidam
a427bc10c1 Added send button to debug dialog. 2011-03-16 18:06:47 +01:00
Bastian Kleineidam
82e5ba8ce6 Add warning tag attribute in XML loggers. 2011-03-15 13:42:21 +01:00
Bastian Kleineidam
f4f921384e Updated copyright 2011-03-13 07:52:18 +01:00
Bastian Kleineidam
502430489a Add url2pathname workaround for Windows. 2011-03-12 16:33:48 +01:00
Bastian Kleineidam
77f207b69a Use sys.stdout wrapper for CGI output. 2011-03-12 09:02:29 +01:00
Bastian Kleineidam
8da37a32ee Refactor sys.stdout wrapping into a function. 2011-03-11 20:05:27 +01:00
Bastian Kleineidam
64a488aaf3 Added copyright and license information. 2011-03-11 18:03:14 +01:00
Bastian Kleineidam
415c87e6cf Work around a urlsplit() regression in Python >2.6 2011-03-11 15:18:21 +01:00
Bastian Kleineidam
7b33cfac7b Use stripped URL base constructing absolute URL. 2011-03-11 15:17:36 +01:00
Bastian Kleineidam
4ee62863e5 Recognize PHP files as HTML files on Windows. 2011-03-11 13:30:34 +01:00
Bastian Kleineidam
78ea8d5594 Remove unnecessary call to url2pathname(). 2011-03-11 12:28:33 +01:00
Bastian Kleineidam
ae109ed994 Correct conversion between URL and filename paths. 2011-03-11 10:38:17 +01:00
Bastian Kleineidam
c6d2eab46c Prevent false positives when detecting file type of certain archive files. 2011-03-10 13:13:25 +01:00
Bastian Kleineidam
c3bc16cde7 Added blank line before each URL output. 2011-03-10 10:51:44 +01:00
Bastian Kleineidam
8e0fe33edb Improved error handling for proxy configuration functions. 2011-03-10 09:34:42 +01:00
Bastian Kleineidam
2c53507097 Improved logging documentation. 2011-03-09 12:08:03 +01:00
Bastian Kleineidam
31d4f04fd2 Support reading GNOME and KDE proxy settings. 2011-03-09 10:49:18 +01:00
Bastian Kleineidam
a06f354837 Add distutils find_executable to fileutils. 2011-03-09 10:47:38 +01:00
Bastian Kleineidam
f2f05af3dc Strip embedded whitespace from URLs given at the commandline or the GUI. 2011-03-07 12:54:35 +01:00
Bastian Kleineidam
420c21c2de Strip leading and trailing whitespace from URLs. 2011-03-07 12:33:09 +01:00
Bastian Kleineidam
21e4824f65 Fix typo calling get_temp_file() function. 2011-03-07 09:57:40 +01:00
Bastian Kleineidam
de5d1757f0 Add workaround for buggy IIS HEAD support. 2011-02-24 11:12:59 +01:00
Bastian Kleineidam
2227812b24 Documentation update. 2011-02-20 11:12:14 +01:00
Bastian Kleineidam
68a8de58d1 Deprecate the --interactive commandline option. 2011-02-20 11:05:29 +01:00
Bastian Kleineidam
c89bd05651 Remove unused variables and imports. 2011-02-19 11:46:20 +01:00
Bastian Kleineidam
8ced5582aa Fix cancelation in GUI. 2011-02-19 09:02:52 +01:00
Bastian Kleineidam
2ec312301e Fix linkcheck.dns py2exe packaging. 2011-02-18 17:26:00 +01:00
Bastian Kleineidam
97ef8ed204 Deprecated --allow-root and always drop privileges. 2011-02-18 15:32:21 +01:00
Bastian Kleineidam
a493a3ded1 Deprecate the --priority option. 2011-02-18 14:53:32 +01:00
Bastian Kleineidam
982e13d193 Improved thread lock handling. 2011-02-18 14:49:53 +01:00
Bastian Kleineidam
2d55c87429 Make sure ignore URL patterns take precedence over nofollow URL patterns. 2011-02-18 07:47:22 +01:00
Bastian Kleineidam
eaa2b79bc3 Updated documentation. 2011-02-17 19:59:02 +01:00
Bastian Kleineidam
e638a2fe6d Updated copyright and translations. Added some missing docstrings. 2011-02-17 07:38:02 +01:00
Bastian Kleineidam
644c72605e Disable bookmark menu entries if file not found. 2011-02-16 07:36:57 +01:00
Bastian Kleineidam
ea6ad52139 Fix Google Chrome profile dir. 2011-02-15 19:49:52 +01:00
Bastian Kleineidam
8ba5f51e8c Fix Google Chrome profile dir. 2011-02-15 19:39:14 +01:00
Bastian Kleineidam
cbe6089b4e Added ShellFolder registry utility function. 2011-02-15 19:38:42 +01:00
Bastian Kleineidam
743e4a9d5d Fix Opera profile directory. 2011-02-15 19:38:26 +01:00
Bastian Kleineidam
3dc513a88d Added context menu entry for Opera bookmark files. 2011-02-15 18:52:41 +01:00
Bastian Kleineidam
6906c2b136 Add Google Chrome bookmark context menu entry. 2011-02-15 18:37:44 +01:00
Bastian Kleineidam
0d4377d1ba Support Google Chrome Bookmark files. 2011-02-15 18:26:00 +01:00
Bastian Kleineidam
25b6dc2e57 Refactor bookmark parsing code into own package. 2011-02-15 17:31:42 +01:00
Bastian Kleineidam
2dfe62afa2 Updated copyright. 2011-02-14 21:07:07 +01:00
Bastian Kleineidam
c5884b8d87 Add function documentation. 2011-02-14 21:06:34 +01:00
Bastian Kleineidam
0589933b97 Reuse connections more than once. 2011-02-14 20:28:38 +01:00
Bastian Kleineidam
85f3690068 Updated copyright. 2011-02-11 14:00:31 +01:00
Bastian Kleineidam
1fada7f316 Do not view parent source of FTP directories. 2011-02-11 12:43:15 +01:00
Bastian Kleineidam
db6a3669b3 Correctly detect empty FTP paths as directories. 2011-02-11 12:35:53 +01:00
Bastian Kleineidam
37b09d7e15 Disable view of parent source if it is a parent directory. 2011-02-11 10:28:48 +01:00
Bastian Kleineidam
042a77d79e Remove old context menu action. 2011-02-11 10:18:36 +01:00
Bastian Kleineidam
1817f9da3e Add donation menu entry. 2011-02-10 12:40:38 +01:00
Bastian Kleineidam
a24ced8b9a Check for existance of local files, including directories. 2011-02-09 08:50:36 +01:00
Bastian Kleineidam
362c7a1d9d Preselect filename on save dialog when editing file:// URLs. 2011-02-09 08:46:09 +01:00
Bastian Kleineidam
8fc3856782 Use Alt-key shortcuts for menu entries. 2011-02-09 07:42:47 +01:00
Bastian Kleineidam
dc405a43d1 Code cleanup. 2011-02-09 07:42:36 +01:00
Bastian Kleineidam
2b2187d660 Use Alt-key shortcuts for menu entries. 2011-02-09 07:32:28 +01:00
Bastian Kleineidam
4a0c63aa56 Fix joining of URLs when parent URL has CGI parameter. 2011-02-08 21:25:55 +01:00
Bastian Kleineidam
48e4bd8bfd Updated copyright 2011-02-06 09:50:48 +01:00
Bastian Kleineidam
e8a011c538 Improved GUI labels for URL statistics. 2011-02-01 07:36:01 +01:00
Bastian Kleineidam
6f33956860 Detect local or development version in update check. 2011-01-31 09:57:22 +01:00
Bastian Kleineidam
8473bfee96 Properly detect missing IPv6 protocol support. 2011-01-29 11:35:06 +01:00
Bastian Kleineidam
3303a3697d Fix Geoip error message when only country DB is installed. 2011-01-11 10:16:57 -06:00
Bastian Kleineidam
eaf3ca0d89 Set codec error policy on StreamWriter for stdout. 2011-01-09 13:57:14 -06:00
Bastian Kleineidam
815f8ce29e Remove unused import. 2011-01-09 09:55:30 -06:00
Bastian Kleineidam
71b15b70f4 Updated copyright 2011-01-06 09:59:57 +01:00
Bastian Kleineidam
5f70b7210f Add tempfile utility function. 2011-01-06 09:52:11 +01:00
Bastian Kleineidam
3c48c04b1c Updated copyright and remove unused imports. 2011-01-06 09:38:32 +01:00
Bastian Kleineidam
689624ec16 Fix update check. 2011-01-04 23:34:34 +01:00
Bastian Kleineidam
066c57ffe3 Update copyright and german translation. 2011-01-04 20:44:07 +01:00
Bastian Kleineidam
aa7de751a6 Make update check in background thread. 2011-01-04 20:33:47 +01:00
Bastian Kleineidam
25ee6d0980 Added update check to GUI. 2011-01-04 19:45:43 +01:00
Bastian Kleineidam
74ccd2838b Added update detection functions. 2011-01-04 19:15:56 +01:00
Bastian Kleineidam
13e1a522ed Remove reset button from options dialog. 2011-01-01 10:39:44 +01:00
Bastian Kleineidam
d011d1524c Parse PHP files recursively. 2010-12-28 17:11:29 +01:00
Bastian Kleineidam
5a50b024d5 Updated copyright 2010-12-23 19:48:54 +01:00
Bastian Kleineidam
0aa15a3e83 Rename Ok button to Close. 2010-12-23 19:47:54 +01:00
Bastian Kleineidam
fd3fe8dcaa Fix missing content types for cached URLs. 2010-12-23 07:37:36 +01:00
Bastian Kleineidam
2a4b60de4d Remove unused imports. 2010-12-22 13:06:24 +01:00
Bastian Kleineidam
84e4e3b28a Fix regression from last commit in this file. 2010-12-22 13:06:10 +01:00
Bastian Kleineidam
e6ccd71ae1 Improved statistics output. 2010-12-22 13:05:32 +01:00
Bastian Kleineidam
0d8a583e39 Fix internal pattern for file URLs (regression from commit 90e0f4e) 2010-12-21 21:10:31 +01:00
Bastian Kleineidam
6090e1a66c Print anchor in __str__() 2010-12-21 20:55:49 +01:00
Bastian Kleineidam
1ebd4d1fc4 Simplify code. 2010-12-21 20:55:35 +01:00
Bastian Kleineidam
90e0f4e5cc Detect filenames with spaces as internal links. 2010-12-21 07:05:12 +01:00
Bastian Kleineidam
9ea35241c0 Set correct scheme on file links. 2010-12-21 01:23:50 +01:00
Bastian Kleineidam
06ec8e6389 Reset GUI statistics before each check run. 2010-12-21 00:35:07 +01:00
Bastian Kleineidam
128f8eb6e4 Move firefox routines to firefox module. 2010-12-21 00:02:12 +01:00
Bastian Kleineidam
1db239cb06 Add missing variable. 2010-12-20 23:55:29 +01:00
Bastian Kleineidam
5855312e2d Find Firefox bookmark file. 2010-12-20 23:52:57 +01:00
Bastian Kleineidam
fad1a110c4 Generalize the unicode_safe function encoding. 2010-12-20 23:44:28 +01:00
Bastian Kleineidam
67df470127 Write different text parts in single write() calls. 2010-12-20 23:44:13 +01:00
Bastian Kleineidam
a9b6c10cd5 Fix unicode errors when writing to sys.stdout. 2010-12-20 23:43:37 +01:00
Bastian Kleineidam
7c08290c44 Fix broken anchor checking. 2010-12-20 19:55:26 +01:00
Bastian Kleineidam
ed75de6005 Apply patch against denial-of-service attack from Python 2.7 upstream branch. 2010-12-19 16:55:22 +01:00
Bastian Kleineidam
6931f665b2 Fix clearing of URL name property. 2010-12-19 15:05:52 +01:00
Bastian Kleineidam
427b878834 Updated translation and copyright 2010-12-18 21:00:29 +01:00
Bastian Kleineidam
0b8f8d52b2 Check for empty URL before determining content type. 2010-12-18 08:26:59 +01:00
Bastian Kleineidam
55cad24b7d Improved layout. 2010-12-18 08:04:43 +01:00
Bastian Kleineidam
b05ca0e345 Clear properties and statistics before check. 2010-12-17 20:25:06 +01:00
Bastian Kleineidam
eee28b9af2 Layout the statistics widgets. 2010-12-17 19:50:52 +01:00
Bastian Kleineidam
88ae8a83b0 Display clear button in URL input field. 2010-12-17 07:50:56 +01:00
Bastian Kleineidam
7a2c89b7fe Display URL properties and statistics in the main window. 2010-12-16 21:52:26 +01:00
Bastian Kleineidam
b485594dfb Print statistics information in HTML output. 2010-12-15 14:36:19 +01:00
Bastian Kleineidam
a94269fd5b Remove unused ID part of loggers. 2010-12-15 13:24:31 +01:00
Bastian Kleineidam
224061e284 Fix to_wire by looking of URL parts have been initialized. 2010-12-15 13:24:12 +01:00
Bastian Kleineidam
f2b8c742fc Gather URL length statistics. 2010-12-15 07:55:00 +01:00
Bastian Kleineidam
7c55351511 Add get_content_type methods to subclasses. 2010-12-15 07:54:44 +01:00
Bastian Kleineidam
870bd2147a Output statistics in text logger. 2010-12-14 20:52:42 +01:00
Bastian Kleineidam
2b2121b9ed Added content type and domain to URL logging info. 2010-12-14 20:30:53 +01:00
Bastian Kleineidam
01184784ef Remove warning about Unicode domains which are more widely supported now. 2010-12-11 07:58:15 +01:00
Bastian Kleineidam
e48acc08af Remove old comments and set line and column number on flush. 2010-12-11 07:57:50 +01:00
Bastian Kleineidam
c809007579 Expand help index tree. 2010-12-07 22:24:30 +01:00
Bastian Kleineidam
09e29f4758 Improve about dialog. 2010-12-03 22:49:32 +01:00
Bastian Kleineidam
d51999c1e6 Rename Debug menu option and disable it according to options. 2010-12-03 20:54:14 +01:00
Bastian Kleineidam
4a9b05dbfd Only prepend http:// to non-empty URLs. 2010-12-03 20:46:57 +01:00
Bastian Kleineidam
6d38a4e296 Rename Save menu option and disable it initially. 2010-12-03 20:46:31 +01:00
Bastian Kleineidam
7807be517b Assume URL starts with http:// if its not a local file. 2010-12-03 18:25:18 +01:00
Bastian Kleineidam
033812fc4e Updated module copies to Python 2.7 2010-12-02 19:38:27 +01:00
Bastian Kleineidam
97ac26ee26 Set minimum size for Option dialog. 2010-11-28 11:05:04 +01:00
Bastian Kleineidam
fcc7977e72 Set minimum width for URL property labels. 2010-11-28 10:36:57 +01:00
Bastian Kleineidam
500c64e758 Remove unused ID URL property. 2010-11-28 10:32:51 +01:00
Bastian Kleineidam
73afed2092 Remove the unused and hidden ID column in the GUI QTreeView. 2010-11-26 21:41:24 +01:00
Bastian Kleineidam
9e88377584 Remove stray raise statement from previous commit. 2010-11-26 21:35:49 +01:00
Bastian Kleineidam
e57456ccdb Use correct charset encoding in XML output. 2010-11-26 21:24:36 +01:00
Bastian Kleineidam
22ed9011b7 Merge branch 'guisave' 2010-11-26 21:23:48 +01:00
Bastian Kleineidam
9be3e8626d Add save action for URL results. 2010-11-26 21:23:27 +01:00
Bastian Kleineidam
431953a6d9 Fix typos. 2010-11-26 21:23:13 +01:00
Bastian Kleineidam
4f9727710a Log URL data directly in the model. 2010-11-26 20:29:33 +01:00
Bastian Kleineidam
69ca5c1110 Reuse an empty QVariant object. 2010-11-26 20:26:31 +01:00
Bastian Kleineidam
c5676f0297 Catch socket errors when closing SMTP connections. 2010-11-26 19:51:26 +01:00
Bastian Kleineidam
8cfc7bfa48 Add save menu action. 2010-11-26 18:11:23 +01:00
Bastian Kleineidam
96de427112 Revert "Added save menu action." Wrong branch. 
This reverts commit 1e4146c78d.
 2010-11-26 18:08:59 +01:00
Bastian Kleineidam
1e4146c78d Added save menu action. 2010-11-26 18:07:20 +01:00
Bastian Kleineidam
3111ae0269 Revert previous commit: re-add Timeout exception. 2010-11-26 17:25:49 +01:00
Bastian Kleineidam
5f06f1b194 Fix wrong call to __init__ of URL proxy handler. 2010-11-26 12:23:41 +01:00
Bastian Kleineidam
5c9c15071a Limit FTP download file size. 2010-11-25 20:44:41 +01:00
Bastian Kleineidam
0cf22e5242 Limit FTP download file size. 2010-11-25 20:44:14 +01:00
Bastian Kleineidam
9e1178df5c Programming style fixes. 2010-11-24 21:35:50 +01:00
Bastian Kleineidam
2efe3073c5 Fix sorting of URLs in result list. 2010-11-23 23:56:03 +01:00
Bastian Kleineidam
d9dbcb5407 Optimize GUI by disabling sorting while a check is running. 2010-11-23 23:23:14 +01:00
Bastian Kleineidam
a644aada2e Activate links in property dialogs. 2010-11-23 00:25:32 +01:00
Bastian Kleineidam
b2bdbed3c4 Move encode() method to base class. 2010-11-22 07:43:33 +01:00
Bastian Kleineidam
d97b7a4e4e Force UTF-8 for CSV logger. 2010-11-21 20:48:50 +01:00
Bastian Kleineidam
f0b911b608 Use codecs module for proper output encoding. 2010-11-21 20:19:27 +01:00
Bastian Kleineidam
6fac69cddb Fall back to GET when connection is reset. 2010-11-21 19:50:51 +01:00
Bastian Kleineidam
729a4fffc6 Adjust spacer width. 2010-11-21 14:23:01 +01:00
Bastian Kleineidam
57d0f961d9 Merge Python 2.6 branch. 2010-11-21 11:37:17 +01:00
Bastian Kleineidam
5058161e40 Remove deprecated options and backward compatibility parts. 2010-11-21 11:35:56 +01:00
Bastian Kleineidam
03034ddc1c Updated copyright 2010-11-21 11:25:07 +01:00
Bastian Kleineidam
fb44f6b775 Updated httplib. 2010-11-21 11:24:53 +01:00
Bastian Kleineidam
7302f4bc22 Use the builtin set type. 2010-11-21 10:55:10 +01:00
Bastian Kleineidam
350c952a1f Use new textwrap feature to not break on hyphens. 2010-11-21 10:48:40 +01:00
Bastian Kleineidam
017a1087ba Remove unneeded __future__ import 2010-11-21 10:45:30 +01:00
Bastian Kleineidam
b24086f1a0 Remove tests for old Python versions. 2010-11-21 10:44:27 +01:00
Bastian Kleineidam
fcc3e6dc03 Remove copy of namedtuple implementation. 2010-11-21 10:44:11 +01:00
Bastian Kleineidam
04f9c1b854 Use urlparse.parse_qs() instead of cgi.parse_qs() 2010-11-21 10:43:47 +01:00
Bastian Kleineidam
6dcb0e10de Require Python 2.6 2010-11-21 10:42:44 +01:00
Bastian Kleineidam
ffcb6017ba Store column widths in registry settings. 2010-11-20 20:25:27 +01:00
Bastian Kleineidam
c0c8f83827 Start checking when return is pressed in the URL label. 2010-11-20 19:58:17 +01:00
Bastian Kleineidam
167f2bf5a9 Add name for option dialog. 2010-11-20 19:53:05 +01:00
Bastian Kleineidam
d51ee5e61e Updated copyright. 2010-11-20 12:02:35 +01:00
Bastian Kleineidam
d246b8718f Use new style signals. 2010-11-18 23:30:50 +01:00
Bastian Kleineidam
8f20ea94fb Remove unnecessary variable setting. 2010-11-18 21:10:14 +01:00
Bastian Kleineidam
cf7be13776 Save GUI options in QSettings. 2010-11-17 21:25:13 +01:00
Bastian Kleineidam
2a1658a1d3 Refactor QSettings 2010-11-17 20:28:43 +01:00
Bastian Kleineidam
147bf31e1e Check for allowed HTTP GET method before parsing anchors in HTML file contents. 2010-11-17 19:13:26 +01:00
Bastian Kleineidam
17ce930611 Ignore irc:// URLs. 2010-11-10 19:56:31 +01:00
Bastian Kleineidam
59ac6ffb5c Set maximum length of URL textinput. 2010-11-06 20:29:36 +01:00
Bastian Kleineidam
45ff41c6c5 Minor layout changes. 2010-11-06 20:13:15 +01:00
Bastian Kleineidam
4fa2452d34 Do not override status text. 2010-11-06 20:03:26 +01:00
Bastian Kleineidam
2fde5bea8c Updated copyright 2010-11-06 18:02:56 +01:00
Bastian Kleineidam
4f5c957e43 Fix check of external domain after HTTP redirect. 2010-11-06 18:00:49 +01:00
Bastian Kleineidam
57ffa6bf97 Allow both redirection www.example.com -> example.com and vice versa. 2010-11-06 17:55:49 +01:00
Bastian Kleineidam
280b7892ef Remove unused NNTP warning. 2010-11-06 17:39:22 +01:00
Bastian Kleineidam
1188e0be2e Retry NNTP connections on temporary errors. 2010-11-06 17:26:40 +01:00
Bastian Kleineidam
3ecfb4a67b Updated support URL. 2010-11-06 17:00:09 +01:00
Bastian Kleineidam
51086eadac Updated translation strings. 2010-11-06 16:46:22 +01:00
Bastian Kleineidam
411f3f340a Fix copying to clipboard. 2010-11-06 16:44:49 +01:00
Bastian Kleineidam
dd5ff4706a Remove timeout and threads GUI options. 2010-11-06 16:41:14 +01:00
Bastian Kleineidam
dd18c11cd1 Do not write node ID to label 2010-11-06 16:08:05 +01:00
Bastian Kleineidam
9d88a7117d Fix GML comment format. 2010-11-06 15:47:00 +01:00
Bastian Kleineidam
e7dff74cf9 Quote quote edge labels and strip leading and trailing whitespace from node and egde labels. 2010-11-06 15:36:21 +01:00
Bastian Kleineidam
2c93319a8e Improved options layout and main window layout. 2010-11-06 14:02:52 +01:00
Bastian Kleineidam
bee72b712b Regenerate GUI files. 2010-11-06 13:45:49 +01:00
Bastian Kleineidam
0e5d76617e Added some more icons. 2010-11-06 13:43:34 +01:00
Bastian Kleineidam
c5e6d9f6eb Fix text result color and calls to index.isValid() 2010-11-06 13:42:30 +01:00
Bastian Kleineidam
5b518264fe Let properties use the URL data model. 2010-11-06 11:34:44 +01:00
Bastian Kleineidam
df9022a459 Merge urlproperties branch 2010-11-06 10:05:39 +01:00
Bastian Kleineidam
d0c357d007 Fix context menu 2010-11-06 08:40:46 +01:00
Bastian Kleineidam
45226cc652 Merge branch 'master' into uimvc 2010-11-06 07:10:48 +01:00
Bastian Kleineidam
cd1984a25f Fix debug setting. 2010-11-06 07:10:40 +01:00
Bastian Kleineidam
7b6f0e78ca Use TreeView and a custom model to display data. 2010-11-06 07:04:35 +01:00
Bastian Kleineidam
f3037b2fa3 Added property dialog. 2010-11-05 15:21:19 +01:00
Bastian Kleineidam
885ce223a4 Modified logger output strings. 2010-11-05 12:53:57 +01:00
Bastian Kleineidam
06dcf13629 Updated copyright. 2010-11-05 12:27:29 +01:00
Bastian Kleineidam
add1838dc6 Add readonly marker to editor dialog title if the file is readonly. 2010-11-05 12:26:43 +01:00
Bastian Kleineidam
b264ff8742 Check files before loading and saving in editor. 2010-11-05 01:39:04 +01:00
Bastian Kleineidam
46757777fd Allow editing of config files in GUI. 2010-11-05 01:13:37 +01:00
Bastian Kleineidam
cc3eea535f Save parent URL source in local file. 2010-11-05 01:11:28 +01:00
Bastian Kleineidam
d47aa6335f Refactor standard configuration file generation. 2010-11-05 01:09:13 +01:00
Bastian Kleineidam
ca395e7d82 Avoid error when intro or outro logging fields are configured. 2010-11-03 20:35:45 +01:00
Bastian Kleineidam
166969f3a4 Remove duplicate logger code. 2010-11-01 09:58:03 +01:00
Bastian Kleineidam
23b20306e9 Remove duplicate HTTP response codes. 2010-11-01 09:27:53 +01:00
Bastian Kleineidam
c5f93a561d Fix debug message formatting. 2010-11-01 05:59:04 +01:00
Bastian Kleineidam
e429dbcc13 Do not parse URL CGI part recursively. 2010-10-27 20:55:21 +02:00
Bastian Kleineidam
f14340a0a8 Do not check content of already cached URLs. 2010-10-27 19:52:48 +02:00
Bastian Kleineidam
1f81124dfa Fix typo. 2010-10-27 19:23:14 +02:00
Bastian Kleineidam
23403f09bb Do not print warning for HTTP to HTTPS or HTTPS to HTTP redirects. 2010-10-27 14:44:05 +02:00
Bastian Kleineidam
b2cf40151f Improved redirection warning text. 2010-10-27 09:15:46 +02:00
Bastian Kleineidam
d9e981e497 Don't log a warning if commandline URL has been redirected. 2010-10-26 16:24:27 +02:00
Bastian Kleineidam
4375d35328 Add warning about unsupported HTTP authentication, and revert the realm changes. 2010-10-25 22:41:31 +02:00
Bastian Kleineidam
332fa4f8f9 Prepare multi-realm auth configuration. 2010-10-25 22:07:16 +02:00
Bastian Kleineidam
a8c1c28066 Prevent off-screen GUI window position. 2010-10-25 21:06:13 +02:00
Bastian Kleineidam
3121cc6617 Reset debug log window on startup. 2010-10-25 19:02:21 +02:00
Bastian Kleineidam
8e7d7a23c2 Search CGI formname for login. 2010-10-25 18:11:07 +02:00
Bastian Kleineidam
a74f8371e6 Updated copyright 2010-10-25 18:10:32 +02:00
Bastian Kleineidam
90c2cbc6da Remove old checkloginresult config. 2010-10-25 17:47:31 +02:00
Bastian Kleineidam
1d07ff3350 Add console encoding function to encode Unicode strings in the preferred encoding for the console. 2010-10-25 17:33:47 +02:00
Bastian Kleineidam
b6ec28c68e Make password entries in authentication configuration optional. 2010-10-25 17:33:13 +02:00
Bastian Kleineidam
5f9c11b794 Tune timeout values to close threads faster on exit. 2010-10-24 01:47:57 +02:00
Bastian Kleineidam
5bb222b1df Updated copyright 2010-10-24 01:02:39 +02:00
Bastian Kleineidam
3834e56496 Updated dnspython. 2010-10-24 01:02:26 +02:00
Bastian Kleineidam
cb724616c0 Remove registered log handler when the main window closes. 2010-10-24 00:25:57 +02:00
Bastian Kleineidam
3305e5c92c Add functions to add and remove a root log handler. 2010-10-24 00:25:27 +02:00
Bastian Kleineidam
e8c4304ab7 Remove some old commented out code. 2010-10-23 23:22:12 +02:00
Bastian Kleineidam
ced1b42124 Use separate debug log window. 2010-10-16 19:26:46 +02:00
Bastian Kleineidam
dcff139d04 Add debuglevel setter function. 2010-10-14 22:14:25 +02:00
Bastian Kleineidam
85c44d1478 Added extra debug dialog. 2010-10-14 21:13:28 +02:00
Bastian Kleineidam
25d75bd4a2 Added login URL posting. 2010-10-14 18:36:11 +02:00
Bastian Kleineidam
4483635552 Add debuglevel, log errors and remove default handlers that are added by urllib2 for get_opener(). 2010-10-14 07:51:29 +02:00
Bastian Kleineidam
e6a1c2faf9 Added some documentation about exception handling. 2010-10-13 22:42:43 +02:00
Bastian Kleineidam
fb4689dbe1 Fix previous commit. 2010-10-13 22:40:55 +02:00
Bastian Kleineidam
415efe262e Added equality check for Cookies, and use that to augment the retrieved cookies. 2010-10-13 22:35:36 +02:00
Bastian Kleineidam
2a7292845c Improved info message about sent cookies; do not report the retrieved cookie information. 2010-10-13 22:32:50 +02:00
Bastian Kleineidam
1ce1521a9f Improved debug message and cleaned up some syntax. 2010-10-13 22:29:44 +02:00
Bastian Kleineidam
c03111475c Remove unused import. 2010-10-13 22:27:11 +02:00
Bastian Kleineidam
a8aa3bdb00 Another fix to ensure get_content() is only called when allowed. 2010-10-13 22:14:43 +02:00
Bastian Kleineidam
4acf79c641 Add configuration file option for the --cookies commandline option. 2010-10-12 00:41:14 +02:00
Bastian Kleineidam
61e611e4bf Prevent unallowed content read when checking for robots.txt allowance in HTML files. 2010-10-12 00:40:34 +02:00
Bastian Kleineidam
25cde6775b Sanitize cookie configuration. 2010-10-11 23:55:58 +02:00
Bastian Kleineidam
8ef2979905 Refactor configuration.sanitize() function. 2010-10-11 23:50:59 +02:00
Bastian Kleineidam
1d0db02192 Refactor getting user and password for an URL. 2010-10-11 20:11:15 +02:00
Bastian Kleineidam
388ea0e7ff Add ability to pass POST data to url content function. 2010-10-11 19:54:06 +02:00
Bastian Kleineidam
3775f18621 Fix Linkchecker URL list detection. 2010-10-03 17:58:56 +02:00
Bastian Kleineidam
133b4f53fd Fix typos and remove unneeded functions. 2010-10-03 12:57:42 +02:00
Bastian Kleineidam
d71ee990d3 Use Consolas as debug font 2010-10-03 12:46:29 +02:00
Bastian Kleineidam
1d5482c3bd Added parent URL source viewer 2010-10-03 12:12:57 +02:00
Bastian Kleineidam
dfc4e97371 Fix content reading function. 2010-10-03 12:11:59 +02:00
Bastian Kleineidam
a68329329f Fix get_content() function. 2010-10-03 12:11:25 +02:00
Bastian Kleineidam
59b54730de Make the Start button the default button. 2010-10-03 10:27:53 +02:00
Bastian Kleineidam
e494d6bbb6 Move MIME type detection into fileutil.py module, and use mimetools for detection. 2010-10-03 08:47:48 +02:00
Bastian Kleineidam
61bb42174d Updated copyright 2010-10-03 08:47:07 +02:00
Bastian Kleineidam
9e54bbfa57 Move URL retreiving functions into url.py module. 2010-10-03 08:46:49 +02:00
Bastian Kleineidam
d079cd07c2 Read GUI default options from configuration file. 2010-09-30 19:08:20 +02:00
Bastian Kleineidam
3b9be3fece Check if geoip DB is a real file. 2010-09-30 18:44:30 +02:00
Bastian Kleineidam
782b8adfc6 Added patches from Python2.6 httplib.py 2010-09-30 17:43:18 +02:00
Bastian Kleineidam
a4b6d48d90 Fix printing of active URLs on Ctrl-C. 2010-09-30 17:42:52 +02:00
Bastian Kleineidam
46a3cbf47d Enable cancel button in the next run after it has been clicked and disabled. 2010-09-30 07:36:50 +02:00
Bastian Kleineidam
b06638c769 Add more GUI context menu actions. 2010-09-30 07:32:39 +02:00
Bastian Kleineidam
2bae9e8679 Updated copyright 2010-09-29 19:26:16 +02:00
Bastian Kleineidam
e0f4097eb0 Ensure HttpUrl.set_title_from_content() is only called when the content is allowed to be retrieved. 2010-09-29 19:26:03 +02:00
Bastian Kleineidam
840538d12a Remove uneeded check for HTML content. 2010-09-29 19:25:14 +02:00
Bastian Kleineidam
279a1eae70 Only add geoip info for non-empty hostnames. 2010-09-29 15:59:57 +02:00
Bastian Kleineidam
cc848cdb33 Fix import for moved geoip module. 2010-09-29 15:17:27 +02:00
Bastian Kleineidam
c59bbae587 Remove unused import and move geoip module from the cache module into base linkcheck module. 2010-09-29 15:15:21 +02:00
Bastian Kleineidam
6292ec54fa Catch GeoIP lookup errors; ensure GeoIP information is Unicode. 2010-09-29 15:04:37 +02:00
Bastian Kleineidam
3795a91a99 Fix compatibility problem with logging.StreamHandler in Python 2.7 2010-09-29 14:41:38 +02:00
Bastian Kleineidam
473c834f0c Do not crash when geoip information is None. 2010-09-29 14:19:28 +02:00
Bastian Kleineidam
8995be1739 Support city-level geoip lookup; remove the geoip cache since lookup is fast enough; remove the duplicated geoip country name map. 2010-09-29 14:10:36 +02:00
Bastian Kleineidam
5a32bf4a21 Updated copyright 2010-09-29 08:25:00 +02:00
Bastian Kleineidam
1446797020 Support pygeoip 2010-09-29 08:24:30 +02:00
Bastian Kleineidam
5576440f10 Add context menu item to copy URL to system clipboard. 2010-09-28 20:34:20 +02:00
Bastian Kleineidam
d202661ff7 Give example binary path for QT designer. 2010-09-28 20:20:33 +02:00
Bastian Kleineidam
b90c832ab1 Clarify documentation. 2010-09-28 20:20:08 +02:00
Bastian Kleineidam
5fd8ea1d92 Use explicit variable for URL string. 2010-09-28 20:19:19 +02:00
Bastian Kleineidam
e996f0d98e Enable list widget items, making them selectable. 2010-09-28 20:18:39 +02:00
Bastian Kleineidam
d5707ef205 Change registry base string to avoid false spyware alarms. 2010-09-12 18:49:57 +02:00
Bastian Kleineidam
ffcd274087 Updated copyright 2010-09-05 21:02:51 +02:00
Bastian Kleineidam
8a1ac26c85 Warn about obfuscated IP numbers. 2010-09-05 20:11:02 +02:00
Bastian Kleineidam
5284017d67 Only fallback to HTTP GET when robots.txt sallows it. 2010-09-04 18:09:59 +02:00
Bastian Kleineidam
fb67df662c Use repr() for robotparser debug. 2010-09-04 18:01:12 +02:00
Bastian Kleineidam
8a074aeea9 Work around Python 2.6+ urljoin bug. 2010-08-31 09:16:24 +02:00
Bastian Kleineidam
c3b8ff00b3 Check content and recursion in one try/except to avoid multiple errors when getting page content. 2010-08-31 06:52:08 +02:00
Bastian Kleineidam
60f7af4598 Allow redirections to external URLs with same domain. 2010-08-13 01:22:18 +02:00
Bastian Kleineidam
1faedafb33 Fix data size for HTTP requests. 2010-08-04 00:06:25 +02:00
Bastian Kleineidam
851e1121e9 Use semicolon as default CSV separator. 2010-07-31 22:30:11 +02:00
Bastian Kleineidam
76f7f6b6a3 Prefer anchor element content as name instead of title attribute. 2010-07-30 21:03:04 +02:00
Bastian Kleineidam
c086f49cea Catch KeyError when quoting URLs of index.html. 2010-07-30 20:12:52 +02:00
Bastian Kleineidam
4678802a81 Do not truncate UNC filepaths 2010-07-30 20:07:11 +02:00
Bastian Kleineidam
761b292e37 Added skype: to list of recognized but ignored URL schemes. 2010-07-29 20:26:04 +02:00
Bastian Kleineidam
0f92b76290 Remove the unnormed URL warning. 2010-07-29 20:20:59 +02:00
Bastian Kleineidam
7ad4f7c220 Compare size from meta info and content data. 2010-07-29 19:53:41 +02:00
Bastian Kleineidam
8413b427e9 Rename some warnings, and add size unequality warning. 2010-07-29 19:53:15 +02:00
Bastian Kleineidam
7d076e7129 Add get_size() method for local files. 2010-07-29 19:52:26 +02:00
Bastian Kleineidam
7536472797 Send correct host header when using http proxy. 2010-07-29 06:50:35 +02:00
Bastian Kleineidam
41e2e1a448 Add new warning to warning list. 2010-07-28 13:47:58 +02:00
Bastian Kleineidam
d9bfd25a68 Add warning if content size is zero 2010-07-28 08:19:55 +02:00
Bastian Kleineidam
7802bbbbc4 Use _WIN32 instead of WIN32 to detect Windows systems. 2010-03-31 08:45:21 +02:00
Bluebird75
28f4514b67 Use object with __slots__ for wire-format of UrlBase objects. 
Saves memory since UrlBase wire-format objects are used for
logging and thus often created.

Signed-off-by: Bastian Kleineidam <calvin@debian.org>
 2010-03-27 00:07:19 +01:00
Bastian Kleineidam
4e1b6d667e Set copyright. 2010-03-26 20:51:59 +01:00
Bastian Kleineidam
7457128e64 Add some but still imcomplete regexes for obfuscated IP addresses. 2010-03-26 20:51:44 +01:00
Bastian Kleineidam
3370ea1562 Reflect changes in httplib2.py: use buffered read in httplib response object and use bad status line exception attribute. 2010-03-26 20:50:38 +01:00
Bastian Kleineidam
c4c098bd83 pep8-ify the source a little more 2010-03-13 08:47:12 +01:00
Bastian Kleineidam
c83a79c0ef Added buffering for http responses from upstream. 2010-03-13 02:29:01 +01:00
Bastian Kleineidam
86ca7d0dba Do not break long words when text wrapping. 2010-03-11 21:50:23 +01:00
Bastian Kleineidam
0b7badc238 Do not quote slashes in query values. 2010-03-11 20:19:31 +01:00
Bastian Kleineidam
bf1dc2a585 Remove unused import. 2010-03-10 01:28:39 +01:00
Bastian Kleineidam
5b5a62f6d5 Updated copyright 2010-03-10 00:05:05 +01:00
Bastian Kleineidam
37b4e97012 Revert "Only parse anchors if both --anchors option is given and the current link has an anchor." 
This reverts commit b238527d54.
 2010-03-10 00:04:02 +01:00
Bastian Kleineidam
55f476b0dd Merge branch 'master' of ssh://linkchecker.git.sourceforge.net/gitroot/linkchecker/linkchecker 2010-03-10 00:03:09 +01:00
Bastian Kleineidam
57e3b05c88 limit cache sizes 2010-03-10 00:00:12 +01:00
Bastian Kleineidam
b238527d54 Only parse anchors if both --anchors option is given and the current link has an anchor. 2010-03-09 11:45:50 +01:00
Bastian Kleineidam
57397e938b Improved linkname parsing by adding a new peek() HTML parser function. 2010-03-09 11:31:12 +01:00
Bastian Kleineidam
074b5ded32 Support UTF-8 encoded filenames in FTP servers. 2010-03-09 08:15:29 +01:00
Bastian Kleineidam
c88791b815 Fix support for non-standard FTP ports. 2010-03-09 07:49:05 +01:00
Bastian Kleineidam
72f880e918 Fix the win32com cache generation. 2010-03-08 12:27:55 +01:00
Bastian Kleineidam
e1482b3eab Add detection for py2exe 2010-03-08 12:12:28 +01:00
Bastian Kleineidam
51a0ef0ad4 Speed up HTML parsing by stopping early and adding callbacks. 2010-03-08 09:04:33 +01:00
Bastian Kleineidam
e5599cce26 Fixed DNS changelog name. 2010-03-08 08:05:55 +01:00
Bastian Kleineidam
7c15d28f56 Prevent UnicodeDecodeError in robots.txt parsing. 2010-03-07 22:49:25 +01:00
Bastian Kleineidam
b8b0398dd2 Ensure redirected URL is Unicode encoded. 2010-03-07 22:11:55 +01:00
Bastian Kleineidam
c8e6995ecd Support HTTPS proxies. 2010-03-07 21:06:10 +01:00
Bastian Kleineidam
1e15e55689 Fix errors in Word file parsing. 2010-03-07 19:43:08 +01:00
Bastian Kleineidam
6a2fcf8ae9 Parse links in Word files. 2010-03-07 19:20:51 +01:00
Bastian Kleineidam
34a2f4a15d Disable and deprecated the --no-proxy-for option. 2010-03-07 17:45:48 +01:00
Bastian Kleineidam
b08524aa5f Updated dnspython module from upstream. 2010-03-07 16:40:17 +01:00
Bastian Kleineidam
796cf0a7cd Updated copyright year 2010-03-07 11:59:18 +01:00
Bastian Kleineidam
049d989c65 Move msgfmt.py into po/ subdir 2010-03-07 11:56:25 +01:00
Bastian Kleineidam
1bf004dafe Updated copyright year 2010-03-07 11:10:53 +01:00
Bastian Kleineidam
af6cb287d7 Only warn about missing emails in mailto: URLs. 2010-03-07 10:43:29 +01:00
Bastian Kleineidam
3d5c114f14 Warn on permament redirections even when URL is outside of domain filter. 2010-03-07 09:36:21 +01:00
Bastian Kleineidam
09623f066c Remove trailing spaces. 2010-03-06 11:03:25 +01:00
Bastian Kleineidam
2d73b907f1 Retry HTTP when server sent empty status line; should fix most of the BadStatusLine errors that are sporadically encountered. 2010-03-06 10:23:34 +01:00
Bastian Kleineidam
280a675698 Distinguish the empty status line from other BadStatusLine errors. 2010-03-06 10:08:08 +01:00
Bastian Kleineidam
bee8023540 Fixed URL encoding 2010-02-22 01:06:19 +01:00
Bastian Kleineidam
92272b9af9 Added missing license info to some files. 2009-12-02 21:39:29 +01:00
Bastian Kleineidam
77daf80e82 Add url encoding parameter 2009-11-28 11:56:35 +01:00
Bastian Kleineidam
d404b0b1bb Use /dev/urandom to avoid waiting for /dev/random 2009-11-21 12:13:49 +01:00
Bastian Kleineidam
66da1316bd Remove version comment in Changelog 2009-09-23 00:33:33 +02:00
Bastian Kleineidam
153c241049 Use i18n.default_encoding instead of a hardcoded one of iso-8859-1. 2009-08-22 12:21:50 +02:00
Bastian Kleineidam
92e1f90117 Use locale encoding as default, even if the language is not supported 2009-08-22 10:09:41 +02:00
Bastian Kleineidam
c52d15fd4d Improve search for lccollection.qhc on Windows systems 2009-07-31 07:18:25 +02:00
Bastian Kleineidam
3fd3ee90ec Fix GUI documentation install 2009-07-29 21:53:52 +02:00
Bastian Kleineidam
2a4f76be3b Moved HTML documentation files 2009-07-26 23:31:57 +02:00
Bastian Kleineidam
5cd7b84596 Allow digits at end of domain names in safe domain check. 2009-07-26 23:16:42 +02:00
Bastian Kleineidam
8533ade21f Add ID for each logged URL. 2009-07-26 22:31:51 +02:00
Bastian Kleineidam
5e06b6b8d4 Updated FSF address in GPL blurb 2009-07-24 23:58:20 +02:00
Bastian Kleineidam
a82e2236ae Copy system config to user config 2009-07-24 23:16:12 +02:00
Bastian Kleineidam
e6f43b6822 Fixed the no_proxy handling and added changelog entry 2009-07-24 07:19:49 +02:00
Bastian Kleineidam
d666e63d19 Print the noproxy variable in system info string 2009-07-22 23:41:46 +02:00
Bastian Kleineidam
fd610ba350 Encode spaces with %20 instead of + 2009-07-22 22:52:40 +02:00
Bastian Kleineidam
34219e2a12 Improved logging message. 2009-07-22 22:29:48 +02:00
Bastian Kleineidam
3121e3385e Use direct HTML documentation for the GUI client; moved the homepage content to a separate package. 2009-07-20 18:33:09 +02:00
Bastian Kleineidam
9faa7d33d2 Fix Python2.6 deprecation warnings 2009-06-26 23:19:36 +02:00
Bastian Kleineidam
4389cc28eb Fix Python2.6 deprecation warnings 2009-06-26 22:43:18 +02:00
Bastian Kleineidam
7f67027abf ignore the fragment part (ie. the anchor) of URIs when 
+  getting and caching content
 2009-06-26 07:22:36 +02:00
Bastian Kleineidam
00c15eef6a Minor code cleanups 2009-06-22 20:40:00 +02:00
Bastian Kleineidam
62922d48e8 Fix previous introduce config parsing error. 2009-06-18 20:29:31 +02:00
Bastian Kleineidam
c3450c7924 Fix uninitialized file descriptor in CSV output 2009-06-18 19:59:54 +02:00
Bastian Kleineidam
561430f184 Minor code cleanups and documentation improvements in the logger output base class. 2009-06-18 19:51:18 +02:00