Commit graph

534 commits

Author SHA1 Message Date
calvin
df857aab8d Intern patterns now accept URLs with and without "www." prefixes
as default. This allows sites to check that use both variants.


git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3714 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-04-21 09:18:58 +00:00
calvin
963feb2288 Double Ctrl-C stops checking immediately without cleanup.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3696 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-04-20 23:56:25 +00:00
calvin
ba148a9d71 Proper MX DNS request fallback
Properly fall back to DNS A requests when no MX host could be found
for a mailto: URL.


git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3689 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-04-14 22:34:46 +00:00
calvin
91a0aad5d8 Fix buggy persistent HTTP connections
Workaround for buggy servers that break protocol synchronization of
persistent HTTP connections.


git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3677 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-03-14 13:28:43 +00:00
calvin
1730097265 Prevent Unicode errors for non-ASCII emails
Prevent Unicode errors when email address contains non-ASCII characters.


git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3673 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-03-02 23:38:02 +00:00
calvin
4c7c1da310 Support subdirectory file completion for optcomplete
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3664 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-01-14 19:39:06 +00:00
calvin
5171fff259 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3663 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-01-14 19:17:26 +00:00
calvin
7a0b394f26 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3662 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-01-14 19:15:28 +00:00
calvin
7cf9723b10 don't parse <script for=''> as URL
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3659 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-01-11 16:45:30 +00:00
calvin
c971ebdabf Added Shockwave Flash (SWF) parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3656 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-12-28 02:12:48 +00:00
calvin
96852e6e96 release date
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3644 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-12-14 22:06:45 +00:00
calvin
ad7c9bbc76 Don't print cached errors or warnings unless verbose output is requested.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-12-14 10:58:10 +00:00
calvin
6c07be042d Add optional leading dot for cookie domain value
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3637 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-12-13 11:52:10 +00:00
calvin
fddf890bd4 Allow spaces in cookie values
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3636 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-12-13 11:44:18 +00:00
calvin
7b6ca18034 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3635 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-12-13 10:50:59 +00:00
calvin
031b6575ab Add documentation man page for the configuration file format.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3620 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-12-01 01:00:20 +00:00
calvin
8d2dc781e1 Ensure unused or expired connections are closed.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3617 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-11-30 16:42:41 +00:00
calvin
f8a54faae9 make sure internpat does not remove a trailing slash, which results in checking of URLs that are not a prefix of the given URL.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3613 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-11-30 10:37:14 +00:00
calvin
9cf3314eab Use constants for warning tags, avoiding typos in string constants. And move the constants into a separate module const.py
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-11-29 07:50:22 +00:00
calvin
fcde8bd4d6 try to detect unknown URL schemes instead of manually setting the assume_local flag
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3609 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-11-28 18:46:50 +00:00
calvin
a1d911127b remove comments from CSS files before parsing for links
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3601 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-11-14 18:46:14 +00:00
calvin
046177cc53 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3589 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-11-08 22:49:07 +00:00
calvin
e9c973fe06 Honor urllib.proxy_bypass() when ignoring proxy settings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3583 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-10-23 22:56:44 +00:00
calvin
079671dbc0 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3582 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-10-23 22:52:49 +00:00
calvin
4651dd14c8 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3569 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-08-08 19:41:05 +00:00
calvin
c2a664e28d updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3562 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-07-13 07:01:36 +00:00
calvin
40f7bb7f97 release date
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3558 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-06-16 22:08:12 +00:00
calvin
82427c7862 deprecate gopher: URLs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3556 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-06-13 00:48:03 +00:00
calvin
458890b87f updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3555 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-06-13 00:37:58 +00:00
calvin
f3e084531d updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-04-03 00:57:43 +00:00
calvin
61083d6a36 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3546 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-03-21 19:31:00 +00:00
calvin
e8438a684b document that --anchors enables a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3542 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-02-21 22:18:08 +00:00
calvin
56d98f9d71 mention that --anchors enables logging of warnings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3536 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2007-02-19 19:24:52 +00:00
calvin
111d8c400f release
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3532 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-12-15 17:26:29 +00:00
calvin
446ffc386f updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3525 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-11-21 18:06:47 +00:00
calvin
7fb471eb2e ignore errors on log file open, display a warning instead
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3518 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-11-21 17:10:27 +00:00
calvin
3a661ebf82 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3516 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-11-17 20:45:24 +00:00
calvin
4051f0dcbf updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3513 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-11-17 20:17:45 +00:00
calvin
932ad20489 release
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3490 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-25 19:51:32 +00:00
calvin
ea6d84c48d updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3488 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-25 19:48:23 +00:00
calvin
c0e4e7e461 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3484 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-24 10:18:04 +00:00
calvin
980fe1ea31 replace numerated config entries with numerical ones
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3477 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-21 14:30:27 +00:00
calvin
d3e8b99ff2 print active URLs on interrupt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3476 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-21 13:43:54 +00:00
calvin
f89029d0b6 document proxy URL syntax
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3474 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-21 12:54:43 +00:00
calvin
1883b79303 follow redirections when getting HTTP contents
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3473 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-21 09:27:38 +00:00
calvin
a25f32d32b updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3472 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-21 09:17:43 +00:00
calvin
6f221ae45f bump up version
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3467 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-16 10:08:59 +00:00
calvin
d3fcf1972f wording improved
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3465 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-16 09:24:25 +00:00
calvin
748cad3f04 removed more psyco docs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3464 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-16 09:20:52 +00:00
calvin
fc90eabcaf updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3462 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-09-16 09:17:23 +00:00