Commit graph

857 commits

Author SHA1 Message Date
calvin
cef58aba6e line ending for comments
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2073 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-29 00:49:44 +00:00
calvin
6ffd2c60f0 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2063 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-25 16:23:13 +00:00
calvin
0c945cff8d comment and date check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2062 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-25 16:20:58 +00:00
calvin
045e517a52 check date
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2061 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-25 14:51:38 +00:00
calvin
503e482583 new fallbackklass param for translator
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2039 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-23 23:31:13 +00:00
calvin
92350d482e updated with bison 1.875d
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2038 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-23 22:51:48 +00:00
calvin
c5c3310709 use memory defines of new bison 1.875d
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2037 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-23 22:51:21 +00:00
calvin
d51418aabc rebuilt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2036 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-22 22:51:59 +00:00
calvin
dfe43e5c3f use dict.update()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2035 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-22 22:51:28 +00:00
calvin
141a3d1c94 added redirect test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2034 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-22 22:34:26 +00:00
calvin
168197a072 make http request handler customizable
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2033 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-22 22:34:03 +00:00
calvin
9151b9fe72 doc updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2024 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 20:59:32 +00:00
calvin
c35431069c added url fix method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2023 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 20:56:12 +00:00
calvin
d1a468c3b8 adjust info and warning strings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2015 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 13:31:30 +00:00
calvin
3b13dd87e2 display correct url in redirect message
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2014 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 13:08:26 +00:00
calvin
0ef53ab56a fix typos
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2012 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 11:52:55 +00:00
calvin
be5a59e9fd add dots to warnings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2010 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 11:18:06 +00:00
calvin
bc89449080 add dots to info messages
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2008 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 11:06:31 +00:00
calvin
d2a6f4ed95 recheck robots.txt allowance after redirect
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2002 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-18 00:57:35 +00:00
calvin
89616a4bba basic robots_txt check method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2001 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-18 00:55:47 +00:00
calvin
4014012c1f basic is_extern method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1999 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-18 00:49:45 +00:00
calvin
74f1935be5 recheck extern/intern filters for redirected URLs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1998 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-18 00:49:33 +00:00
calvin
fae80e541c use new file cache keys in test results
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1988 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-15 19:17:35 +00:00
calvin
2765c5b116 use anchor and user info in cache key
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1987 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-15 19:16:02 +00:00
calvin
cafa412343 use base cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1986 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-15 19:15:22 +00:00
calvin
4485ab19aa only norm a changed file base_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1985 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-15 16:36:56 +00:00
calvin
b0d3c575ce test leading query exclam after host without path
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1982 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 11:12:34 +00:00
calvin
b150ff6ea8 handle leading query exclam after host without path
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1981 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 11:12:16 +00:00
calvin
265f942ba1 add unquoted redirectino url to info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1980 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 11:02:17 +00:00
calvin
1166804eb0 use idna domain for intern patterns
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1979 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 10:52:20 +00:00
calvin
72290074ac syntax cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1978 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 10:47:43 +00:00
calvin
ce998f63da added one idna test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1977 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 02:01:23 +00:00
calvin
6c62daba9c added one idna test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1976 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 01:58:26 +00:00
calvin
3576caf6d5 test fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1975 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 01:58:05 +00:00
calvin
2f3e7d18e0 test fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1974 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 01:55:47 +00:00
calvin
f3226afe0f do not encode empty host
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1973 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-14 01:41:29 +00:00
calvin
9c40e54e1e encode index.html data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1971 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-13 23:40:17 +00:00
calvin
f0048d0345 add unicode domain name warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1970 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-13 23:30:14 +00:00
calvin
75ec50b156 adjust for new url_norm method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1965 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-13 11:20:33 +00:00
calvin
e429264733 support unicode domain names
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1964 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-13 11:20:16 +00:00
calvin
820d07ba6f os-specific path name quote chars, and IDN support for hostnames
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1963 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-12 13:34:17 +00:00
calvin
7c83266566 serialize helper function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1962 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-12 13:25:40 +00:00
calvin
8ba7bccf5a separate encode function for loggers
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1961 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-11 08:56:56 +00:00
calvin
1997381c2b return unicode url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1960 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-10 16:41:41 +00:00
calvin
6ddf286c36 platform specific test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1959 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-10 16:41:13 +00:00
calvin
3d81638b8f use intern __repr__(), not repr()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1958 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-10 14:31:34 +00:00
calvin
25770a1109 encode failure messages
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1956 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-10 13:13:05 +00:00
calvin
34c2168807 use unicode url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1955 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-10 13:12:41 +00:00
calvin
e61ea956cc add url needs quoting for pipe char test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1951 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-09 17:56:17 +00:00
calvin
7ee019da0f add pipe to safe url chars
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1950 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-09 17:55:03 +00:00