Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-08 22:54:51 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
7196 commits 1 branch 0 tags 24 MiB
Commit graph

634 commits

Author SHA1 Message Date
Bastian Kleineidam
981079c041 Support itemtype attribute parsing. 2014-04-23 22:03:20 +02:00
Bastian Kleineidam
7baa2f0b1b Fix http_link check and add a basic auth check. 2014-04-10 18:06:15 +02:00
Bastian Kleineidam
4232b69633 Support <img> srcset attribute parsing. 2014-04-10 17:51:59 +02:00
Bastian Kleineidam
6caf654031 Parse Link: heaaders. 2014-04-10 17:50:55 +02:00
Bastian Kleineidam
b6b5c7a12e Simpler link parsing routine. 2014-03-27 19:49:17 +01:00
Bastian Kleineidam
a8623bc0bc Display SSL info on redirects. 2014-03-26 07:16:03 +01:00
Bastian Kleineidam
9cd67dfcb2 More SSL message work. 2014-03-20 20:24:57 +01:00
Bastian Kleineidam
9a7ad3a84f Print SSL cipher info for https URLs. 2014-03-19 17:02:34 +01:00
Bastian Kleineidam
ce733ae76b Don't check for robots.txt directives in local html files. 2014-03-19 16:33:22 +01:00
Bastian Kleineidam
9be667b52a Do not warn about missing addresses on mailto links that have subjects. 2014-03-18 23:27:59 +01:00
Bastian Kleineidam
fc73c6ca6e Log number of checked unique URLs. 2014-03-14 23:46:17 +01:00
Bastian Kleineidam
34bdf5c75a Updated copyright and docs. 2014-03-14 22:09:05 +01:00
Bastian Kleineidam
c51caf1133 Assertions should be earlier. 2014-03-14 20:26:11 +01:00
Bastian Kleineidam
2d2e010940 Move some scripts into the new script dir. 2014-03-12 19:29:11 +01:00
Bastian Kleineidam
306979abca Add HttpHeaderInfo plugin 2014-03-12 19:28:37 +01:00
Bastian Kleineidam
1733c6a6f2 Fix Travis CI build. 2014-03-11 19:56:36 +01:00
Bastian Kleineidam
bca226c293 Fix assertion checking external links; fix tests 2014-03-10 18:23:44 +01:00
Bastian Kleineidam
6b334dc79b Fix URL result caching. 2014-03-08 19:35:10 +01:00
Bastian Kleineidam
fab2c2da98 Improve content type setting. 2014-03-05 20:12:19 +01:00
Bastian Kleineidam
ef13a3fce1 Implement sitemap and sitemap index parsing. 2014-03-05 19:26:37 +01:00
Bastian Kleineidam
b17211f162 Set for release. 2014-03-04 21:36:24 +01:00
Bastian Kleineidam
978b24f2d7 Merge branch 'caching' 2014-03-04 07:21:42 +01:00
Bastian Kleineidam
f1076c8813 Increase url-too-long warning. 2014-03-03 23:31:04 +01:00
Bastian Kleineidam
82f81241fd Check all links and add better caching. 2014-03-03 23:29:45 +01:00
Bastian Kleineidam
cc21f8f3d2 Add missing import. 2014-03-02 20:01:55 +01:00
Bastian Kleineidam
b8175e2357 Disable news test. 2014-03-02 20:01:36 +01:00
Bastian Kleineidam
924c6285d2 Fix some tests 2014-03-02 07:45:04 +01:00
Bastian Kleineidam
98c8163179 Remove old test 2014-03-01 21:16:38 +01:00
Bastian Kleineidam
6f205a2574 Support checking Sitemap: URLs in robots.txt files. 2014-03-01 20:25:19 +01:00
Bastian Kleineidam
0e4d6f6e1a Parse sitemap urls in robots.txt files. 2014-03-01 19:57:57 +01:00
Bastian Kleineidam
7b34be590b Introduce check plugins, use Python requests for http/s connections, and some code cleanups and improvements. 2014-03-01 00:12:34 +01:00
Bastian Kleineidam
c806be5c15 Updated copyright 2014-01-08 22:33:04 +01:00
Bastian Kleineidam
e0a2558b2b Updated copyright. 2013-12-24 07:13:16 +01:00
Bastian Kleineidam
103e00b4d1 Allow disabling of ssl certificate checks. 2013-12-12 22:17:57 +01:00
Bastian Kleineidam
5736987b60 Refactor output loggers. 2013-12-11 18:41:55 +01:00
Bastian Kleineidam
78ed1e9e52 Do not GET on POST forms. 2013-12-10 23:42:43 +01:00
Bastian Kleineidam
b567f766ba Fix strtime test. 2013-12-06 07:13:44 +01:00
Bastian Kleineidam
b363945052 Adjust example.com/org tests. This seems to change every now and then. 2013-12-04 19:13:18 +01:00
Bastian Kleineidam
023da7c993 Remove the duplicate URL content check. 2013-12-04 19:12:40 +01:00
Bastian Kleineidam
84dac60f57 Fix network test 2013-12-04 19:05:20 +01:00
Bastian Kleineidam
36badddfac Update cookie code from Python module. 2013-12-04 19:05:08 +01:00
Bastian Kleineidam
c966fe6b24 Remove the http-wrong-redirect warning 2013-04-11 18:33:19 +02:00
Bastian Kleineidam
b7c82d1e75 Fix strformat.strsize() test. 2013-02-27 19:36:03 +01:00
Bastian Kleineidam
35bc79dd90 Updated copyright. 2013-01-25 21:14:27 +01:00
Bastian Kleineidam
a86e36e5d3 Fix test cases for example.com redirection. 2013-01-23 19:42:29 +01:00
Bastian Kleineidam
e6ad32c028 Catch UnicodeError for invalid host names. 2013-01-23 19:42:29 +01:00
Bastian Kleineidam
4dad2aa33c Support dns-prefetch URLs. 2013-01-17 20:41:09 +01:00
Bastian Kleineidam
03f2e19cfd Fix html tests. 2013-01-17 20:40:51 +01:00
Bastian Kleineidam
7fe72745ae Updated copyright. 2013-01-09 23:03:12 +01:00
Bastian Kleineidam
aaf35c0f4a Added Word test. 2013-01-09 23:02:47 +01:00
Bastian Kleineidam
e91c2edf7e Test all http response codes. 2012-11-13 18:11:25 +01:00
Bastian Kleineidam
cd4abb1f12 Improve repr() of url data, and remove alexa test script. 2012-11-09 19:09:38 +01:00
Bastian Kleineidam
7bd58af106 Updated copyright. 2012-11-07 18:07:00 +01:00
Bastian Kleineidam
faa052fa99 Fix test case. 2012-11-07 18:07:00 +01:00
Bastian Kleineidam
f9a7f5ef96 Restrict local file checking. 2012-11-07 18:07:00 +01:00
Bastian Kleineidam
eabaa41bd2 Do not check duplicate URLs. 2012-11-06 21:34:22 +01:00
Bastian Kleineidam
bc6cf5de34 Start local telnet server for tests. 2012-10-30 17:44:00 +01:00
Bastian Kleineidam
e594ca3c39 Improved documentation. 2012-10-30 17:44:00 +01:00
Bastian Kleineidam
5f2e6730a9 Allow python interpreter specification for test run. 2012-10-26 18:05:00 +02:00
Bastian Kleineidam
a77a5dddfd Fix sporadic test failures with a dummy directory listing. 2012-10-15 14:36:27 +02:00
Bastian Kleineidam
7929a48d78 Fix url split with invalid port names. 2012-10-13 12:03:09 +02:00
Bastian Kleineidam
57c2fd7b22 Add alexa run debug flag. 2012-10-10 21:05:07 +02:00
Bastian Kleineidam
c4e15c7b88 Improved duplication url check. 2012-10-10 21:04:48 +02:00
Bastian Kleineidam
aa2960e889 Fix content check. 2012-10-10 12:26:33 +02:00
Bastian Kleineidam
973fb6f565 Strip whitespace. 2012-10-10 12:26:19 +02:00
Bastian Kleineidam
e1e80b7dd5 Remove addrinfo cache. 2012-10-10 10:54:58 +02:00
Bastian Kleineidam
20be0f2519 Strip control chars from logger output. 2012-10-10 10:54:30 +02:00
Bastian Kleineidam
871508ef5d Add docs and updated copyright. 2012-10-10 06:53:16 +02:00
Bastian Kleineidam
63cf8adf54 Catch ValueError on invalid cookie expiration dates. 2012-10-10 06:44:38 +02:00
Bastian Kleineidam
a86a7332f3 Add debug output for alexa test run. 2012-10-09 19:47:46 +02:00
Bastian Kleineidam
81ca9a08d4 Fix typos. 2012-10-04 19:49:54 +02:00
Bastian Kleineidam
6f6608525e Split mail tests. 2012-10-01 20:11:59 +02:00
Bastian Kleineidam
6f5e55fd3b Code cleanup. 2012-10-01 10:43:20 +02:00
Bastian Kleineidam
1b3b040be5 Fix check result order. 2012-10-01 10:28:42 +02:00
Bastian Kleineidam
5a12ccf8d0 Fix anchor test result ordering. 2012-09-30 22:02:29 +02:00
Bastian Kleineidam
3c44056fde Code cleanup 2012-09-30 14:01:09 +02:00
Bastian Kleineidam
169bdecb69 Fix clamav test. 2012-09-30 12:00:44 +02:00
Bastian Kleineidam
39204ea0fe Use py.test skip function instead of nose. 2012-09-29 20:28:16 +02:00
Bastian Kleineidam
2479c53e6c Use a free port number in ftp tests for local server. 2012-09-29 19:22:12 +02:00
Bastian Kleineidam
a022c836bc Randomize site test. 2012-09-23 16:19:56 +02:00
Bastian Kleineidam
cff97b9718 Updated copyright. 2012-09-21 21:13:00 +02:00
Bastian Kleineidam
f6b007f757 Fix useragent matching in robots.txt parser. 2012-09-21 21:12:13 +02:00
Bastian Kleineidam
1c2a66ffaf Refactor http tests into multiple files. 2012-09-21 20:34:05 +02:00
Bastian Kleineidam
498567eb21 Remove alexa log files on distclean. 2012-09-21 16:04:46 +02:00
Bastian Kleineidam
32357c9683 Improve alexa test script. 2012-09-21 15:53:16 +02:00
Bastian Kleineidam
718c033989 Add alexa test run script. 2012-09-21 14:50:33 +02:00
Bastian Kleineidam
a03090c20f Optimize intern/extern pattern parsing. 2012-09-20 20:19:13 +02:00
Bastian Kleineidam
9d1c90f96c Write extra script to analyse a memory dump. 2012-09-18 16:08:31 +02:00
Bastian Kleineidam
aee515d406 Fix tests. 2012-09-18 09:17:08 +02:00
Bastian Kleineidam
58cbe4b152 Updated copyright. 2012-09-17 21:03:52 +02:00
Bastian Kleineidam
4e59056ee7 Warn about duplicate URL contents. 2012-09-17 19:49:50 +02:00
Bastian Kleineidam
99bf8aa940 Updated copyright. 2012-09-17 16:09:55 +02:00
Bastian Kleineidam
c3a6603987 Replace URL with example.org. 2012-09-17 16:07:06 +02:00
Bastian Kleineidam
cb71f483a5 Warn about too long URLs. 2012-09-17 16:00:23 +02:00
Bastian Kleineidam
93f3683ac1 Fix tests. 2012-09-02 23:22:01 +02:00
Bastian Kleineidam
07f7be5cf3 Remove slashdot from tests. 2012-08-23 23:56:50 +02:00
Bastian Kleineidam
14326710bc Updated copyright. 2012-08-23 16:46:06 +02:00
Bastian Kleineidam
e252bbf623 Remove Amazon quirk because the default behaviour handles this now. 2012-08-23 05:36:51 +02:00
Bastian Kleineidam
ecef16b2c9 Support WML sites. 2012-08-22 22:43:14 +02:00
Bastian Kleineidam
76f57dc4ad Updated copyright. 2012-08-14 20:37:24 +02:00
Bastian Kleineidam
564ae6479f Fix tests. 2012-08-13 18:01:59 +02:00
Bastian Kleineidam
fe82c380c3 Updated test data. 2012-08-12 11:15:36 +02:00
Bastian Kleineidam
1d7e93fe62 Updated http check data. 2012-08-12 10:55:25 +02:00
Bastian Kleineidam
b0e5c7fc59 Ignore feed: URLs. 2012-06-27 21:32:03 +02:00
Bastian Kleineidam
0fd1a78378 Always compare encoded anchor names. 2012-06-27 20:59:53 +02:00
Bastian Kleineidam
3934e63994 Fix url tests. 2012-06-24 21:48:16 +02:00
Bastian Kleineidam
b550a9dcb5 Updated copyright. 2012-06-23 14:31:11 +02:00
Bastian Kleineidam
31519f6a01 Fix handling of UNC pathnames. 2012-06-23 14:30:58 +02:00
Bastian Kleineidam
e7dd1d421b Fix urljoin test case. 2012-06-23 14:29:26 +02:00
Bastian Kleineidam
363ccc0121 Check <object codebase=...> as normal URL. 2012-06-23 14:28:32 +02:00
Bastian Kleineidam
0c71061f7d Add windows skip helper function. 2012-06-23 13:32:38 +02:00
Bastian Kleineidam
3dd35c57a8 Rename wrong module name. 2012-06-20 21:43:25 +02:00
Bastian Kleineidam
dcf886860f Fix binary safari bookmark test. 2012-06-20 21:40:14 +02:00
Bastian Kleineidam
4cce99a77d Test SSL certificate expiration. 2012-06-20 20:10:40 +02:00
Bastian Kleineidam
f107092a8a Fix handling of user/password info in URLs. 2012-06-10 22:07:42 +02:00
Bastian Kleineidam
838095cbd5 Updated copyright. 2012-06-10 14:58:38 +02:00
Bastian Kleineidam
d323971c5f Add memory debug configuration test. 2012-06-10 14:31:51 +02:00
Bastian Kleineidam
db95fce77e Ignore PHP processing instructions in local files. 2012-06-10 14:02:01 +02:00
Bastian Kleineidam
c3ffb0530f Fix robots.txt tests. 2012-06-10 13:19:30 +02:00
Bastian Kleineidam
7bb5dac321 Updated copyright 2012-04-23 21:33:59 +02:00
Bastian Kleineidam
67db3b5cd6 Improved check for test functions. 2012-04-23 20:58:55 +02:00
Bastian Kleineidam
cd6ee8a1bc Fix checker test cases for non-english locales. 2012-04-23 20:56:33 +02:00
Bastian Kleineidam
4cc19f4e9c Fix strformat tests on non-english locales. 2012-04-23 20:35:32 +02:00
Bastian Kleineidam
1cc3ac5f80 Updated copyright. 2012-04-22 20:45:24 +02:00
Bastian Kleineidam
0bd3402471 Fix CGI tests for changed function args. 2012-04-22 17:45:47 +02:00
Bastian Kleineidam
c2221e1a18 Ensure proper encoding in WSGI script. 2012-04-22 12:48:21 +02:00
Bastian Kleineidam
1ef9a022ca Make WSGI script more responsive by using threads. 2012-04-18 21:52:36 +02:00
Bastian Kleineidam
3d831c1adb Updated copyright. 2012-04-11 22:23:43 +02:00
Bastian Kleineidam
1a28c2e334 Detect invalid empty cookies. 2012-04-03 08:03:54 +02:00
Bastian Kleineidam
6d5e5f9efb Updated copyright. 2012-03-30 22:24:10 +02:00
Bastian Kleineidam
9ee9abcf0f Parse invalid comments <! bla > 2012-03-23 07:41:03 +01:00
Bastian Kleineidam
d6d82b96f1 Add cookiefile config option. 2012-03-22 22:29:56 +01:00
Bastian Kleineidam
4c9fd8d488 Cache real url. 2012-03-14 21:12:13 +01:00
Bastian Kleineidam
187a94312b Updated copyright. 2012-03-09 11:16:18 +01:00
Bastian Kleineidam
626bd3e249 Fix obfuscated IP address check. 2012-03-09 10:08:04 +01:00
Bastian Kleineidam
71f5ee42c8 Updated copyright. 2012-01-29 17:18:28 +01:00
Bastian Kleineidam
a0581cc2a1 Ignore steam:// URIs. 2012-01-10 19:37:19 +01:00
Bastian Kleineidam
f1eb51d885 Updated copyright 2012-01-06 09:21:30 +01:00
Bastian Kleineidam
6409651f55 Remove unused function. 2012-01-04 20:04:14 +01:00
Bastian Kleineidam
3c5b21c0c4 Do not use XXX tag here. 2012-01-04 18:57:56 +01:00
Bastian Kleineidam
fb979b4f3c Add test for archive attribute support. 2011-12-30 12:36:22 +01:00
Bastian Kleineidam
4a04ff3224 Add html5 tests. 2011-12-30 12:30:07 +01:00
Bastian Kleineidam
8848e34d20 Add missing copyright. 2011-12-25 11:17:48 +01:00
Bastian Kleineidam
dff425710d More Freshmeat/Freecode replacements. 2011-12-25 09:06:18 +01:00
Bastian Kleineidam
1c26c14b64 Set copyright year and add missing docstrings. 2011-12-25 08:45:27 +01:00
Bastian Kleineidam
9c40078ab9 Run obfuscated IP and unicode directory listing test only on linux. 2011-12-18 08:12:23 +01:00
Bastian Kleineidam
0e29ebde2a Run obfuscated IP test only on linux. 2011-12-18 08:10:33 +01:00
Bastian Kleineidam
2aea1ef1e5 Fix localhost tests. 2011-12-17 20:31:47 +01:00
Bastian Kleineidam
ef8d9b629f Use dynamic port number in results. 2011-12-17 19:13:14 +01:00
Bastian Kleineidam
f8ef9cca6a Test cleanup. 2011-12-17 16:39:21 +01:00
Bastian Kleineidam
3d9958dfbb Parse Safari bookmark files. 2011-12-17 16:38:25 +01:00
Bastian Kleineidam
1b5cad3b3e Only remove whitespace at start and end of URL. 2011-12-10 11:49:44 +01:00
Bastian Kleineidam
5576dfe10d Fix LFUCache: delete 5% of least frequently used entries on shrink, not 95%. 2011-12-08 22:10:53 +01:00
Bastian Kleineidam
9956f3712e Properly detect too-long Unicode hostnames. 2011-12-05 20:51:42 +01:00
Bastian Kleineidam
74ea444a9a Parse logger and logging part names case insensitive. 2011-10-10 20:32:58 +02:00
Bastian Kleineidam
d2ae6bf71c Properly detect HTML character encoding. 2011-08-14 12:49:31 +02:00
Bastian Kleineidam
09d9264470 Updated copyright. 2011-08-04 20:40:49 +02:00
Bastian Kleineidam
cdf91a0321 Improve cookie info message and fix cookie test cases. 2011-08-04 18:34:56 +02:00
Bastian Kleineidam
977d9e9ae6 Update cookie values instead of adding duplicate entries. 2011-08-01 20:26:31 +02:00
Bastian Kleineidam
210b45d1e4 Removed FastCGI script. 2011-07-25 21:37:35 +02:00
Bastian Kleineidam
51bcccfdfe Added new option --user-agent to set the User-Agent header. 2011-07-25 21:09:49 +02:00
Bastian Kleineidam
2550e16040 Remove query part from file links. 2011-05-29 17:49:01 +02:00
Bastian Kleineidam
430e1db78d Do not use fixed port for HTTP server. 2011-05-28 19:24:38 +02:00
Bastian Kleineidam
c9707ee735 Handle stray < before end tags. 2011-05-28 13:39:04 +02:00
Bastian Kleineidam
0f70438a87 Updated copyright. 2011-05-28 08:44:21 +02:00
Bastian Kleineidam
e1f724908d Move dnspython module into third_party directory. 2011-05-24 20:18:58 +02:00
Bastian Kleineidam
ce88b073d7 Added debug script for HTML parsing. 2011-05-20 19:22:42 +02:00
Bastian Kleineidam
7d04c3ee81 Handle stray < characters in HTML. 2011-05-20 06:50:08 +02:00
Bastian Kleineidam
2c8c59ddb0 Remove or rename unused variables. 2011-05-18 21:02:59 +02:00
Bastian Kleineidam
74c132c90b Updated copyright. 2011-04-26 14:57:57 +02:00
Bastian Kleineidam
498e5cc786 Test obfuscated IPs only on Linux. 2011-04-26 11:54:04 +02:00
Bastian Kleineidam
6a544f2d69 Only allow redirections to FTP, HTTP and HTTPS URLs. 2011-04-19 07:01:55 +02:00
Bastian Kleineidam
7365170564 Updated copyright. 2011-04-12 09:13:39 +02:00
Bastian Kleineidam
1a31d59df9 Added url.get_content() test. 2011-04-10 10:57:07 +02:00
Bastian Kleineidam
40cad4e468 Add detailed locale info to internal error output. 2011-04-06 11:56:55 +02:00
Bastian Kleineidam
82e5ba8ce6 Add warning tag attribute in XML loggers. 2011-03-15 13:42:21 +01:00
Bastian Kleineidam
f4f921384e Updated copyright 2011-03-13 07:52:18 +01:00
Bastian Kleineidam
77f207b69a Use sys.stdout wrapper for CGI output. 2011-03-12 09:02:29 +01:00
Bastian Kleineidam
ae109ed994 Correct conversion between URL and filename paths. 2011-03-11 10:38:17 +01:00
Bastian Kleineidam
420c21c2de Strip leading and trailing whitespace from URLs. 2011-03-07 12:33:09 +01:00
Bastian Kleineidam
633206342b Improved documentation. 2011-03-07 12:30:40 +01:00
Bastian Kleineidam
9d428329d1 Updated copyright. 2011-02-20 11:12:26 +01:00
Bastian Kleineidam
68a8de58d1 Deprecate the --interactive commandline option. 2011-02-20 11:05:29 +01:00
Bastian Kleineidam
e638a2fe6d Updated copyright and translations. Added some missing docstrings. 2011-02-17 07:38:02 +01:00
Bastian Kleineidam
0d4377d1ba Support Google Chrome Bookmark files. 2011-02-15 18:26:00 +01:00
Bastian Kleineidam
85f3690068 Updated copyright. 2011-02-11 14:00:31 +01:00
Bastian Kleineidam
6184d7eea7 Use example URLs. 2011-02-09 07:31:21 +01:00
Bastian Kleineidam
f11dcdf09f Fix tests with new example.com redirect. 2011-02-08 21:30:42 +01:00
Bastian Kleineidam
4a0c63aa56 Fix joining of URLs when parent URL has CGI parameter. 2011-02-08 21:25:55 +01:00
Bastian Kleineidam
48e4bd8bfd Updated copyright 2011-02-06 09:50:48 +01:00
Bastian Kleineidam
6f33956860 Detect local or development version in update check. 2011-01-31 09:57:22 +01:00
Bastian Kleineidam
ec2806588f Only run GUI test when DISPLAY variable is set. 2011-01-09 09:55:16 -06:00
Bastian Kleineidam
066c57ffe3 Update copyright and german translation. 2011-01-04 20:44:07 +01:00
Bastian Kleineidam
74ccd2838b Added update detection functions. 2011-01-04 19:15:56 +01:00
Bastian Kleineidam
d011d1524c Parse PHP files recursively. 2010-12-28 17:11:29 +01:00
Bastian Kleineidam
0d8a583e39 Fix internal pattern for file URLs (regression from commit 90e0f4e) 2010-12-21 21:10:31 +01:00
Bastian Kleineidam
90e0f4e5cc Detect filenames with spaces as internal links. 2010-12-21 07:05:12 +01:00
Bastian Kleineidam
9876fd91a5 Fix test cases after anchor caching bugfix. 2010-12-20 20:37:23 +01:00
Bastian Kleineidam
0f1d3ed513 Disable news tests for now. 2010-12-19 17:15:09 +01:00
Bastian Kleineidam
6811448bc7 Split Telnet tests. 2010-11-22 20:30:47 +01:00
Bastian Kleineidam
d0396c585d Fix configuration tests. 2010-11-22 20:30:32 +01:00
Bastian Kleineidam
19cfef0d33 Fix redirection test. 2010-11-22 19:52:21 +01:00
Bastian Kleineidam
26fc98b90c Fix usage of EnvironmentVarGuard. 2010-11-22 08:06:18 +01:00
Bastian Kleineidam
03034ddc1c Updated copyright 2010-11-21 11:25:07 +01:00
Bastian Kleineidam
017a1087ba Remove unneeded __future__ import 2010-11-21 10:45:30 +01:00
Bastian Kleineidam
eef778ed8e Use new EnvironmentVarGuard() for testing. 2010-11-21 10:44:54 +01:00
Bastian Kleineidam
17ce930611 Ignore irc:// URLs. 2010-11-10 19:56:31 +01:00
Bastian Kleineidam
c6ba688c70 Use new NTTP news server. 2010-11-06 17:27:23 +01:00
Bastian Kleineidam
636b6586ef Fix NNTP server availability test. 2010-11-06 17:27:05 +01:00
Bastian Kleineidam
532a4cf4e9 Revert amazon test changes since they fixed their servers. 2010-11-06 13:43:18 +01:00
Bastian Kleineidam
94e2225acc Updated tests for Amazon https server. 2010-11-05 12:27:09 +01:00
Bastian Kleineidam
e429dbcc13 Do not parse URL CGI part recursively. 2010-10-27 20:55:21 +02:00
Bastian Kleineidam
23403f09bb Do not print warning for HTTP to HTTPS or HTTPS to HTTP redirects. 2010-10-27 14:44:05 +02:00
Bastian Kleineidam
b6ec28c68e Make password entries in authentication configuration optional. 2010-10-25 17:33:13 +02:00
Bastian Kleineidam
085eb6e77a Obfuscated IPs are only working on POSIX systems. 2010-10-24 01:03:05 +02:00
Bastian Kleineidam
fe23306a01 Close GUI test window and delete instances to be sure QT deallocation routines are run. 2010-10-23 23:22:40 +02:00
Bastian Kleineidam
25d75bd4a2 Added login URL posting. 2010-10-14 18:36:11 +02:00
Bastian Kleineidam
4acf79c641 Add configuration file option for the --cookies commandline option. 2010-10-12 00:41:14 +02:00
Bastian Kleineidam
ffcd274087 Updated copyright 2010-09-05 21:02:51 +02:00
Bastian Kleineidam
8a1ac26c85 Warn about obfuscated IP numbers. 2010-09-05 20:11:02 +02:00
Bastian Kleineidam
5284017d67 Only fallback to HTTP GET when robots.txt sallows it. 2010-09-04 18:09:59 +02:00
Bastian Kleineidam
8a074aeea9 Work around Python 2.6+ urljoin bug. 2010-08-31 09:16:24 +02:00
Bastian Kleineidam
60f7af4598 Allow redirections to external URLs with same domain. 2010-08-13 01:22:18 +02:00
Bastian Kleineidam
761b292e37 Added skype: to list of recognized but ignored URL schemes. 2010-07-29 20:26:04 +02:00
Bastian Kleineidam
0f92b76290 Remove the unnormed URL warning. 2010-07-29 20:20:59 +02:00
Bastian Kleineidam
7d076e7129 Add get_size() method for local files. 2010-07-29 19:52:26 +02:00
Bastian Kleineidam
d9bfd25a68 Add warning if content size is zero 2010-07-28 08:19:55 +02:00
Bastian Kleineidam
4e1b6d667e Set copyright. 2010-03-26 20:51:59 +01:00
Bastian Kleineidam
c4c098bd83 pep8-ify the source a little more 2010-03-13 08:47:12 +01:00
Bastian Kleineidam
0b7badc238 Do not quote slashes in query values. 2010-03-11 20:19:31 +01:00
Bastian Kleineidam
57e3b05c88 limit cache sizes 2010-03-10 00:00:12 +01:00
Bastian Kleineidam
57397e938b Improved linkname parsing by adding a new peek() HTML parser function. 2010-03-09 11:31:12 +01:00
Bastian Kleineidam
25d56d9ef5 Test logger configuration parsing. 2010-03-09 09:49:20 +01:00
Bastian Kleineidam
d1827804d2 Replace docstrings in test methods with comments so they are not displayed by nosetest. 2010-03-09 08:42:46 +01:00
Bastian Kleineidam
18230a755d Fix FTP test result with three leading slashes before hostname. 2010-03-09 08:14:30 +01:00
Bastian Kleineidam
0af3cece1b Added check for pyftpdlib when running FTP test. 2010-03-09 07:49:43 +01:00
Bastian Kleineidam
60a1b5c528 Use relative imports 2010-03-09 07:43:31 +01:00
Bastian Kleineidam
cc0c79dd90 Use local FTP testserver. 2010-03-09 07:42:56 +01:00
Bastian Kleineidam
51a0ef0ad4 Speed up HTML parsing by stopping early and adding callbacks. 2010-03-08 09:04:33 +01:00
Bastian Kleineidam
34a2f4a15d Disable and deprecated the --no-proxy-for option. 2010-03-07 17:45:48 +01:00
Bastian Kleineidam
af6cb287d7 Only warn about missing emails in mailto: URLs. 2010-03-07 10:43:29 +01:00
Bastian Kleineidam
a9a209d3b9 Fix typo in assert method name. 2010-03-06 10:23:50 +01:00
Bastian Kleineidam
563b057a4d Updated copyright year; fix nntp newsserver test 2010-03-05 12:49:54 +01:00
Bastian Kleineidam
92f8911d88 Use non-deprecated assert methods for unit testing 2010-03-05 10:00:34 +01:00
Bastian Kleineidam
9a280607e0 Use decorators for test resources 2010-02-22 08:02:19 +01:00
Bastian Kleineidam
bee8023540 Fixed URL encoding 2010-02-22 01:06:19 +01:00
Bastian Kleineidam
9bc4772ba4 Fix encoding of fail messages. 2010-02-22 01:05:40 +01:00
Bastian Kleineidam
3694605bc0 Add correct encoding for mail test 2009-11-28 12:04:22 +01:00
Bastian Kleineidam
2d3ea65f78 Add unicode file test 2009-11-28 12:04:02 +01:00
Bastian Kleineidam
77daf80e82 Add url encoding parameter 2009-11-28 11:56:35 +01:00
Bastian Kleineidam
84bcb84878 Read and process result files in utf-8 2009-11-27 21:19:40 +01:00
Bastian Kleineidam
c81058cf3e encode in utf-8 2009-11-27 21:19:15 +01:00
Bastian Kleineidam
5cd7b84596 Allow digits at end of domain names in safe domain check. 2009-07-26 23:16:42 +02:00
Bastian Kleineidam
5e06b6b8d4 Updated FSF address in GPL blurb 2009-07-24 23:58:20 +02:00
Bastian Kleineidam
f0684a03f6 Added tests for no_proxy env var and --no-proxy-for option 2009-07-24 22:38:42 +02:00
Bastian Kleineidam
2a86f05c7b Moved proxy tests in separate file. 2009-07-24 07:21:27 +02:00
Bastian Kleineidam
a65b7bcc0c Fix debugging in test scripts 2009-07-24 07:20:36 +02:00
Bastian Kleineidam
fd610ba350 Encode spaces with %20 instead of + 2009-07-22 22:52:40 +02:00
Bastian Kleineidam
4389cc28eb Fix Python2.6 deprecation warnings 2009-06-26 22:43:18 +02:00
Bastian Kleineidam
90e6496196 Replace absolute paths with dynamic paths 2009-06-26 22:43:02 +02:00
Bastian Kleineidam
7f67027abf ignore the fragment part (ie. the anchor) of URIs when 
+  getting and caching content
 2009-06-26 07:22:36 +02:00
Bastian Kleineidam
cf02d7a193 Check for newsserver availability once to avoid multiple timeouts. 2009-06-26 07:22:05 +02:00
Bastian Kleineidam
bbcfa3533b Turn test doc strings into comments so they get not printed when running the tests. 2009-06-26 07:20:21 +02:00
Bastian Kleineidam
a69e5e9b06 Use example.com for invalid domains 2009-06-26 07:15:48 +02:00
Bastian Kleineidam
2f56eede1f Added schemeless URL testing 2009-06-22 21:11:04 +02:00
Bastian Kleineidam
e081d42ed7 Fix Mozilla bookmarks test file 2009-06-22 20:52:52 +02:00
Bastian Kleineidam
c3450c7924 Fix uninitialized file descriptor in CSV output 2009-06-18 19:59:54 +02:00
Bastian Kleineidam
14be26a16f Added skip messages 2009-03-09 07:43:13 +01:00
Bastian Kleineidam
1c27189af9 Documentation added 2009-03-08 19:34:00 +01:00
Bastian Kleineidam
369d59515a Added GUI test 2009-03-08 19:33:49 +01:00
Bastian Kleineidam
92cc2f946f Use a more neutral URL for network testing. 2009-03-07 16:38:20 +01:00
Bastian Kleineidam
92b6e7083b Time limited tests work only on posix systems. 2009-03-07 16:26:11 +01:00
Bastian Kleineidam
f957577064 Simplify test checks 2009-03-07 15:00:02 +01:00
Bastian Kleineidam
d03f2ffbd0 Removed unused import 2009-03-07 13:32:11 +01:00
Bastian Kleineidam
29e5e2a655 Skip limited news tests instead of failing 2009-03-07 10:28:01 +01:00
Bastian Kleineidam
4c670815a3 Add ability to run tests a limited time, and use this in the news checking. 2009-03-07 10:15:38 +01:00
Bastian Kleineidam
59ffbd43f0 Use AttrDict for transport object in loggers. 2009-03-07 09:43:55 +01:00
Bastian Kleineidam
e149644c5c Added attribute dictionary container 2009-03-07 00:45:58 +01:00
Bastian Kleineidam
7a59763508 Remove unused SetList container 2009-03-07 00:42:27 +01:00
Bastian Kleineidam
aa133efabf Fix test logger 2009-03-06 21:40:22 +01:00
Bastian Kleineidam
0b5f525f76 Print NNTP server welcome string as info 2009-03-06 20:57:35 +01:00
Bastian Kleineidam
a9335fb3e8 Make file list an iterator, and add missing slash if needed to manually given file URLs. 2009-03-02 08:02:27 +01:00
Bastian Kleineidam
a252d308dd Added proxy resource test 2009-02-28 13:06:44 +01:00
Bastian Kleineidam
a3483fcbd3 Do not compare with None in container tests 2009-02-24 13:15:28 +01:00
Bastian Kleineidam
8c221da089 Remove the custom set datatype 2009-02-24 13:15:07 +01:00
Bastian Kleineidam
84a6bb3464 Fix robotparser tests 2009-02-24 11:49:06 +01:00
Bastian Kleineidam
3fb05f4f9b Add new name output lines to test results 2009-02-23 20:08:06 +01:00
Bastian Kleineidam
ec30ca6ee4 Remove unused imports 2009-02-23 17:32:04 +01:00
calvin
3a9d0b702e fix windows network detection by providing correct ping options 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3980 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-02-20 11:17:55 +00:00
calvin
bc4c413664 Catch OSError in test functions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3978 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-02-20 10:18:30 +00:00
calvin
2e918a7b7a Added email syntax check. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3960 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-02-18 15:35:23 +00:00
calvin
366c711b43 Improved domain name checking 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3956 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-02-18 15:33:52 +00:00
calvin
c30e28e609 Upstream updates for dnspython 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3943 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-01-30 21:03:08 +00:00
calvin
1f803fd80c Run tests with nosetests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3941 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-01-28 23:12:03 +00:00
calvin
17bbc9ab59 Added working news server. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3902 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-01-10 20:09:31 +00:00
calvin
4ffe29615e Updated DNS code 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3898 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-01-10 18:05:13 +00:00
calvin
ff7f910185 Change NNTP server as the old one times out. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3893 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-01-10 14:11:35 +00:00
calvin
a26ca4c23a Replace C ftpparse module with Python implementation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3892 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-01-10 14:11:17 +00:00
calvin
f399b79e5a Unzip non-latin filename only on posix systems. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3889 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-01-08 23:06:19 +00:00
calvin
e9805dbd8a Updated copyright year to 2009 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3887 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2009-01-08 14:18:03 +00:00
calvin
7d05f0f544 Added --complete option 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3872 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-11-30 19:35:56 +00:00
calvin
c20e706761 Made some format changes on translated strings. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3870 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-11-28 20:22:48 +00:00
calvin
4306d6a4b6 Added back the unittest data files 
This time with the non-unicode filename hidden inside a ZIP file
to avoid breaking the subversion repository.

git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3868 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-11-27 19:23:40 +00:00
calvin
2758de9757 Added directory listing test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3866 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-11-20 18:48:23 +00:00
calvin
42c3e71329 Improved and tested opera bookmark parser 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3863 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-11-20 07:52:02 +00:00
calvin
9ab895751f Support parsing of Firefox 3 bookmark files 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3862 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-11-20 07:51:22 +00:00
calvin
7b2a21c133 Fix off-by-one error in cookie domain matching code. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3850 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-07-13 12:52:11 +00:00
calvin
b598e19358 Use working news server for tests. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3838 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-07-01 05:33:13 +00:00
calvin
d82264e72a Network test needs POSIX system. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3828 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-06-18 09:55:22 +00:00
calvin
7f756ca40c Added tests for application/xhtml+xml mime type parsing. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3819 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-06-16 19:51:58 +00:00
calvin
83bd7ce4ac Improved network interface detection on POSIX systems 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3792 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-06-07 13:08:36 +00:00
calvin
7cb6900a9c Account for added htmlutil package 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3791 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-06-07 13:08:10 +00:00
calvin
5f818f620a Backport namedtuple container from Python 2.6 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3783 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-06-05 07:13:55 +00:00
calvin
97772c9700 Improved email check messages. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3779 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-05-27 19:44:07 +00:00
calvin
61147a455e Resurrect test_dummy! 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3768 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-05-20 17:02:13 +00:00
calvin
0d5ad79330 Added test_dummy 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3767 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-05-20 17:02:00 +00:00
calvin
9352dbf5e4 Move test files to separate module 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3763 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-05-20 17:01:16 +00:00
calvin
3eac1be9ab Require and use Python 2.5 
Use Python 2.5 features and get rid of old compat code. Also some
code cleanups have been made.


git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3737 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-04-27 11:39:21 +00:00
calvin
6499cb1a63 updated copyright year 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3658 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2008-01-02 14:31:19 +00:00
calvin
df48d4a905 bump up copyright year 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3534 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2007-01-01 14:57:38 +00:00
calvin
e6f00e093b use unittest.TestCase for standard test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3130 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-24 20:17:30 +00:00
calvin
db1f9948ed StandardTest moved into test.py 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3125 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-24 20:11:48 +00:00
calvin
c7f2742243 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3098 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:00:43 +00:00
calvin
1e0581e718 use iter* dict methods 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3054 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-03 22:15:41 +00:00
calvin
cb89678653 update copyright 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3050 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-03 18:34:12 +00:00
calvin
8719ed81e0 better equality assert message 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3027 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-01 18:55:55 +00:00
calvin
e92aee054c updated copyright 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3010 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-03 19:12:47 +00:00
calvin
3a3c5cc3be get pofiles instead of set them 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2975 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:13:55 +00:00
calvin
d7a4a08659 updated tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2974 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-17 19:22:44 +00:00
calvin
062f155ed0 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2972 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-17 19:21:40 +00:00
calvin
1c9aa3069a added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2961 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-08 17:15:52 +00:00
calvin
62cbdf15d9 remove DNS Tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@244 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2001-04-03 18:59:38 +00:00
calvin
560e63eba8 glitches 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@118 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2000-06-18 12:36:42 +00:00
calvin
0329ca7682 Initial revision 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@5 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2000-02-26 10:24:46 +00:00