Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-18 11:31:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
6302 commits 1 branch 0 tags 24 MiB
Commit graph

266 commits

Author SHA1 Message Date
Bastian Kleineidam
f1076c8813 Increase url-too-long warning. 2014-03-03 23:31:04 +01:00
Bastian Kleineidam
82f81241fd Check all links and add better caching. 2014-03-03 23:29:45 +01:00
Bastian Kleineidam
cc21f8f3d2 Add missing import. 2014-03-02 20:01:55 +01:00
Bastian Kleineidam
b8175e2357 Disable news test. 2014-03-02 20:01:36 +01:00
Bastian Kleineidam
924c6285d2 Fix some tests 2014-03-02 07:45:04 +01:00
Bastian Kleineidam
7b34be590b Introduce check plugins, use Python requests for http/s connections, and some code cleanups and improvements. 2014-03-01 00:12:34 +01:00
Bastian Kleineidam
c806be5c15 Updated copyright 2014-01-08 22:33:04 +01:00
Bastian Kleineidam
e0a2558b2b Updated copyright. 2013-12-24 07:13:16 +01:00
Bastian Kleineidam
5736987b60 Refactor output loggers. 2013-12-11 18:41:55 +01:00
Bastian Kleineidam
b363945052 Adjust example.com/org tests. This seems to change every now and then. 2013-12-04 19:13:18 +01:00
Bastian Kleineidam
023da7c993 Remove the duplicate URL content check. 2013-12-04 19:12:40 +01:00
Bastian Kleineidam
c966fe6b24 Remove the http-wrong-redirect warning 2013-04-11 18:33:19 +02:00
Bastian Kleineidam
35bc79dd90 Updated copyright. 2013-01-25 21:14:27 +01:00
Bastian Kleineidam
a86e36e5d3 Fix test cases for example.com redirection. 2013-01-23 19:42:29 +01:00
Bastian Kleineidam
e6ad32c028 Catch UnicodeError for invalid host names. 2013-01-23 19:42:29 +01:00
Bastian Kleineidam
4dad2aa33c Support dns-prefetch URLs. 2013-01-17 20:41:09 +01:00
Bastian Kleineidam
03f2e19cfd Fix html tests. 2013-01-17 20:40:51 +01:00
Bastian Kleineidam
aaf35c0f4a Added Word test. 2013-01-09 23:02:47 +01:00
Bastian Kleineidam
e91c2edf7e Test all http response codes. 2012-11-13 18:11:25 +01:00
Bastian Kleineidam
7bd58af106 Updated copyright. 2012-11-07 18:07:00 +01:00
Bastian Kleineidam
faa052fa99 Fix test case. 2012-11-07 18:07:00 +01:00
Bastian Kleineidam
f9a7f5ef96 Restrict local file checking. 2012-11-07 18:07:00 +01:00
Bastian Kleineidam
eabaa41bd2 Do not check duplicate URLs. 2012-11-06 21:34:22 +01:00
Bastian Kleineidam
bc6cf5de34 Start local telnet server for tests. 2012-10-30 17:44:00 +01:00
Bastian Kleineidam
e594ca3c39 Improved documentation. 2012-10-30 17:44:00 +01:00
Bastian Kleineidam
a77a5dddfd Fix sporadic test failures with a dummy directory listing. 2012-10-15 14:36:27 +02:00
Bastian Kleineidam
aa2960e889 Fix content check. 2012-10-10 12:26:33 +02:00
Bastian Kleineidam
871508ef5d Add docs and updated copyright. 2012-10-10 06:53:16 +02:00
Bastian Kleineidam
81ca9a08d4 Fix typos. 2012-10-04 19:49:54 +02:00
Bastian Kleineidam
6f6608525e Split mail tests. 2012-10-01 20:11:59 +02:00
Bastian Kleineidam
6f5e55fd3b Code cleanup. 2012-10-01 10:43:20 +02:00
Bastian Kleineidam
1b3b040be5 Fix check result order. 2012-10-01 10:28:42 +02:00
Bastian Kleineidam
5a12ccf8d0 Fix anchor test result ordering. 2012-09-30 22:02:29 +02:00
Bastian Kleineidam
2479c53e6c Use a free port number in ftp tests for local server. 2012-09-29 19:22:12 +02:00
Bastian Kleineidam
cff97b9718 Updated copyright. 2012-09-21 21:13:00 +02:00
Bastian Kleineidam
1c2a66ffaf Refactor http tests into multiple files. 2012-09-21 20:34:05 +02:00
Bastian Kleineidam
a03090c20f Optimize intern/extern pattern parsing. 2012-09-20 20:19:13 +02:00
Bastian Kleineidam
aee515d406 Fix tests. 2012-09-18 09:17:08 +02:00
Bastian Kleineidam
58cbe4b152 Updated copyright. 2012-09-17 21:03:52 +02:00
Bastian Kleineidam
4e59056ee7 Warn about duplicate URL contents. 2012-09-17 19:49:50 +02:00
Bastian Kleineidam
99bf8aa940 Updated copyright. 2012-09-17 16:09:55 +02:00
Bastian Kleineidam
c3a6603987 Replace URL with example.org. 2012-09-17 16:07:06 +02:00
Bastian Kleineidam
cb71f483a5 Warn about too long URLs. 2012-09-17 16:00:23 +02:00
Bastian Kleineidam
93f3683ac1 Fix tests. 2012-09-02 23:22:01 +02:00
Bastian Kleineidam
07f7be5cf3 Remove slashdot from tests. 2012-08-23 23:56:50 +02:00
Bastian Kleineidam
14326710bc Updated copyright. 2012-08-23 16:46:06 +02:00
Bastian Kleineidam
e252bbf623 Remove Amazon quirk because the default behaviour handles this now. 2012-08-23 05:36:51 +02:00
Bastian Kleineidam
ecef16b2c9 Support WML sites. 2012-08-22 22:43:14 +02:00
Bastian Kleineidam
76f57dc4ad Updated copyright. 2012-08-14 20:37:24 +02:00
Bastian Kleineidam
564ae6479f Fix tests. 2012-08-13 18:01:59 +02:00
Bastian Kleineidam
fe82c380c3 Updated test data. 2012-08-12 11:15:36 +02:00
Bastian Kleineidam
1d7e93fe62 Updated http check data. 2012-08-12 10:55:25 +02:00
Bastian Kleineidam
b0e5c7fc59 Ignore feed: URLs. 2012-06-27 21:32:03 +02:00
Bastian Kleineidam
0fd1a78378 Always compare encoded anchor names. 2012-06-27 20:59:53 +02:00
Bastian Kleineidam
363ccc0121 Check <object codebase=...> as normal URL. 2012-06-23 14:28:32 +02:00
Bastian Kleineidam
3dd35c57a8 Rename wrong module name. 2012-06-20 21:43:25 +02:00
Bastian Kleineidam
dcf886860f Fix binary safari bookmark test. 2012-06-20 21:40:14 +02:00
Bastian Kleineidam
f107092a8a Fix handling of user/password info in URLs. 2012-06-10 22:07:42 +02:00
Bastian Kleineidam
db95fce77e Ignore PHP processing instructions in local files. 2012-06-10 14:02:01 +02:00
Bastian Kleineidam
7bb5dac321 Updated copyright 2012-04-23 21:33:59 +02:00
Bastian Kleineidam
cd6ee8a1bc Fix checker test cases for non-english locales. 2012-04-23 20:56:33 +02:00
Bastian Kleineidam
4c9fd8d488 Cache real url. 2012-03-14 21:12:13 +01:00
Bastian Kleineidam
187a94312b Updated copyright. 2012-03-09 11:16:18 +01:00
Bastian Kleineidam
626bd3e249 Fix obfuscated IP address check. 2012-03-09 10:08:04 +01:00
Bastian Kleineidam
71f5ee42c8 Updated copyright. 2012-01-29 17:18:28 +01:00
Bastian Kleineidam
a0581cc2a1 Ignore steam:// URIs. 2012-01-10 19:37:19 +01:00
Bastian Kleineidam
fb979b4f3c Add test for archive attribute support. 2011-12-30 12:36:22 +01:00
Bastian Kleineidam
4a04ff3224 Add html5 tests. 2011-12-30 12:30:07 +01:00
Bastian Kleineidam
8848e34d20 Add missing copyright. 2011-12-25 11:17:48 +01:00
Bastian Kleineidam
dff425710d More Freshmeat/Freecode replacements. 2011-12-25 09:06:18 +01:00
Bastian Kleineidam
9c40078ab9 Run obfuscated IP and unicode directory listing test only on linux. 2011-12-18 08:12:23 +01:00
Bastian Kleineidam
0e29ebde2a Run obfuscated IP test only on linux. 2011-12-18 08:10:33 +01:00
Bastian Kleineidam
2aea1ef1e5 Fix localhost tests. 2011-12-17 20:31:47 +01:00
Bastian Kleineidam
ef8d9b629f Use dynamic port number in results. 2011-12-17 19:13:14 +01:00
Bastian Kleineidam
f8ef9cca6a Test cleanup. 2011-12-17 16:39:21 +01:00
Bastian Kleineidam
3d9958dfbb Parse Safari bookmark files. 2011-12-17 16:38:25 +01:00
Bastian Kleineidam
09d9264470 Updated copyright. 2011-08-04 20:40:49 +02:00
Bastian Kleineidam
210b45d1e4 Removed FastCGI script. 2011-07-25 21:37:35 +02:00
Bastian Kleineidam
430e1db78d Do not use fixed port for HTTP server. 2011-05-28 19:24:38 +02:00
Bastian Kleineidam
6a544f2d69 Only allow redirections to FTP, HTTP and HTTPS URLs. 2011-04-19 07:01:55 +02:00
Bastian Kleineidam
82e5ba8ce6 Add warning tag attribute in XML loggers. 2011-03-15 13:42:21 +01:00
Bastian Kleineidam
f4f921384e Updated copyright 2011-03-13 07:52:18 +01:00
Bastian Kleineidam
ae109ed994 Correct conversion between URL and filename paths. 2011-03-11 10:38:17 +01:00
Bastian Kleineidam
420c21c2de Strip leading and trailing whitespace from URLs. 2011-03-07 12:33:09 +01:00
Bastian Kleineidam
633206342b Improved documentation. 2011-03-07 12:30:40 +01:00
Bastian Kleineidam
e638a2fe6d Updated copyright and translations. Added some missing docstrings. 2011-02-17 07:38:02 +01:00
Bastian Kleineidam
0d4377d1ba Support Google Chrome Bookmark files. 2011-02-15 18:26:00 +01:00
Bastian Kleineidam
85f3690068 Updated copyright. 2011-02-11 14:00:31 +01:00
Bastian Kleineidam
f11dcdf09f Fix tests with new example.com redirect. 2011-02-08 21:30:42 +01:00
Bastian Kleineidam
d011d1524c Parse PHP files recursively. 2010-12-28 17:11:29 +01:00
Bastian Kleineidam
0d8a583e39 Fix internal pattern for file URLs (regression from commit 90e0f4e) 2010-12-21 21:10:31 +01:00
Bastian Kleineidam
90e0f4e5cc Detect filenames with spaces as internal links. 2010-12-21 07:05:12 +01:00
Bastian Kleineidam
9876fd91a5 Fix test cases after anchor caching bugfix. 2010-12-20 20:37:23 +01:00
Bastian Kleineidam
0f1d3ed513 Disable news tests for now. 2010-12-19 17:15:09 +01:00
Bastian Kleineidam
6811448bc7 Split Telnet tests. 2010-11-22 20:30:47 +01:00
Bastian Kleineidam
19cfef0d33 Fix redirection test. 2010-11-22 19:52:21 +01:00
Bastian Kleineidam
26fc98b90c Fix usage of EnvironmentVarGuard. 2010-11-22 08:06:18 +01:00
Bastian Kleineidam
03034ddc1c Updated copyright 2010-11-21 11:25:07 +01:00
Bastian Kleineidam
017a1087ba Remove unneeded __future__ import 2010-11-21 10:45:30 +01:00
Bastian Kleineidam
eef778ed8e Use new EnvironmentVarGuard() for testing. 2010-11-21 10:44:54 +01:00
Bastian Kleineidam
17ce930611 Ignore irc:// URLs. 2010-11-10 19:56:31 +01:00
Bastian Kleineidam
c6ba688c70 Use new NTTP news server. 2010-11-06 17:27:23 +01:00
Bastian Kleineidam
532a4cf4e9 Revert amazon test changes since they fixed their servers. 2010-11-06 13:43:18 +01:00
Bastian Kleineidam
94e2225acc Updated tests for Amazon https server. 2010-11-05 12:27:09 +01:00
Bastian Kleineidam
23403f09bb Do not print warning for HTTP to HTTPS or HTTPS to HTTP redirects. 2010-10-27 14:44:05 +02:00
Bastian Kleineidam
085eb6e77a Obfuscated IPs are only working on POSIX systems. 2010-10-24 01:03:05 +02:00
Bastian Kleineidam
ffcd274087 Updated copyright 2010-09-05 21:02:51 +02:00
Bastian Kleineidam
8a1ac26c85 Warn about obfuscated IP numbers. 2010-09-05 20:11:02 +02:00
Bastian Kleineidam
5284017d67 Only fallback to HTTP GET when robots.txt sallows it. 2010-09-04 18:09:59 +02:00
Bastian Kleineidam
60f7af4598 Allow redirections to external URLs with same domain. 2010-08-13 01:22:18 +02:00
Bastian Kleineidam
761b292e37 Added skype: to list of recognized but ignored URL schemes. 2010-07-29 20:26:04 +02:00
Bastian Kleineidam
0f92b76290 Remove the unnormed URL warning. 2010-07-29 20:20:59 +02:00
Bastian Kleineidam
d9bfd25a68 Add warning if content size is zero 2010-07-28 08:19:55 +02:00
Bastian Kleineidam
4e1b6d667e Set copyright. 2010-03-26 20:51:59 +01:00
Bastian Kleineidam
c4c098bd83 pep8-ify the source a little more 2010-03-13 08:47:12 +01:00
Bastian Kleineidam
18230a755d Fix FTP test result with three leading slashes before hostname. 2010-03-09 08:14:30 +01:00
Bastian Kleineidam
0af3cece1b Added check for pyftpdlib when running FTP test. 2010-03-09 07:49:43 +01:00
Bastian Kleineidam
60a1b5c528 Use relative imports 2010-03-09 07:43:31 +01:00
Bastian Kleineidam
cc0c79dd90 Use local FTP testserver. 2010-03-09 07:42:56 +01:00
Bastian Kleineidam
34a2f4a15d Disable and deprecated the --no-proxy-for option. 2010-03-07 17:45:48 +01:00
Bastian Kleineidam
af6cb287d7 Only warn about missing emails in mailto: URLs. 2010-03-07 10:43:29 +01:00
Bastian Kleineidam
563b057a4d Updated copyright year; fix nntp newsserver test 2010-03-05 12:49:54 +01:00
Bastian Kleineidam
9a280607e0 Use decorators for test resources 2010-02-22 08:02:19 +01:00
Bastian Kleineidam
bee8023540 Fixed URL encoding 2010-02-22 01:06:19 +01:00
Bastian Kleineidam
9bc4772ba4 Fix encoding of fail messages. 2010-02-22 01:05:40 +01:00
Bastian Kleineidam
3694605bc0 Add correct encoding for mail test 2009-11-28 12:04:22 +01:00
Bastian Kleineidam
2d3ea65f78 Add unicode file test 2009-11-28 12:04:02 +01:00
Bastian Kleineidam
84bcb84878 Read and process result files in utf-8 2009-11-27 21:19:40 +01:00
Bastian Kleineidam
c81058cf3e encode in utf-8 2009-11-27 21:19:15 +01:00
Bastian Kleineidam
5e06b6b8d4 Updated FSF address in GPL blurb 2009-07-24 23:58:20 +02:00
Bastian Kleineidam
f0684a03f6 Added tests for no_proxy env var and --no-proxy-for option 2009-07-24 22:38:42 +02:00
Bastian Kleineidam
2a86f05c7b Moved proxy tests in separate file. 2009-07-24 07:21:27 +02:00
Bastian Kleineidam
a65b7bcc0c Fix debugging in test scripts 2009-07-24 07:20:36 +02:00
Bastian Kleineidam
90e6496196 Replace absolute paths with dynamic paths 2009-06-26 22:43:02 +02:00
Bastian Kleineidam
7f67027abf ignore the fragment part (ie. the anchor) of URIs when 
+  getting and caching content
 2009-06-26 07:22:36 +02:00
Bastian Kleineidam
cf02d7a193 Check for newsserver availability once to avoid multiple timeouts. 2009-06-26 07:22:05 +02:00
Bastian Kleineidam
bbcfa3533b Turn test doc strings into comments so they get not printed when running the tests. 2009-06-26 07:20:21 +02:00
Bastian Kleineidam
a69e5e9b06 Use example.com for invalid domains 2009-06-26 07:15:48 +02:00
Bastian Kleineidam
2f56eede1f Added schemeless URL testing 2009-06-22 21:11:04 +02:00
Bastian Kleineidam
e081d42ed7 Fix Mozilla bookmarks test file 2009-06-22 20:52:52 +02:00
Bastian Kleineidam
14be26a16f Added skip messages 2009-03-09 07:43:13 +01:00
Bastian Kleineidam
f957577064 Simplify test checks 2009-03-07 15:00:02 +01:00
Bastian Kleineidam
29e5e2a655 Skip limited news tests instead of failing 2009-03-07 10:28:01 +01:00
Bastian Kleineidam
4c670815a3 Add ability to run tests a limited time, and use this in the news checking. 2009-03-07 10:15:38 +01:00
Bastian Kleineidam
59ffbd43f0 Use AttrDict for transport object in loggers. 2009-03-07 09:43:55 +01:00
Bastian Kleineidam
aa133efabf Fix test logger 2009-03-06 21:40:22 +01:00
Bastian Kleineidam
0b5f525f76 Print NNTP server welcome string as info 2009-03-06 20:57:35 +01:00
Bastian Kleineidam
a9335fb3e8 Make file list an iterator, and add missing slash if needed to manually given file URLs. 2009-03-02 08:02:27 +01:00
Bastian Kleineidam
3fb05f4f9b Add new name output lines to test results 2009-02-23 20:08:06 +01:00
Bastian Kleineidam
ec30ca6ee4 Remove unused imports 2009-02-23 17:32:04 +01:00