Commit graph

175 commits

Author SHA1 Message Date
calvin
2fced4f37d documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2288 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-02-08 12:10:39 +00:00
calvin
d1fd01f669 remove expired connections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2287 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-02-08 10:41:27 +00:00
calvin
55652cabc0 fix nt path name for network paths
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2284 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-02-07 15:41:53 +00:00
calvin
344bfd1103 no return from add_connection
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2278 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-02-06 21:20:29 +00:00
calvin
bb3b972d8f always add connections, and close timed out ones
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2277 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-02-06 21:20:10 +00:00
calvin
3be005186a do not print XXX message, check for connected .sock attribute and always add to cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2276 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-02-06 21:15:28 +00:00
calvin
1d3dd0c35b documentation added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2258 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-31 20:18:17 +00:00
calvin
4f21309b9a added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2246 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-30 22:41:59 +00:00
calvin
01ceb0aafd HTTP connection pooling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2245 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-30 22:39:09 +00:00
calvin
9dea804d92 per-connection timeout
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2244 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-30 11:00:37 +00:00
calvin
b698701726 only release cached FTP connections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2243 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-29 23:29:45 +00:00
calvin
e76836a607 add time import
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2242 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-29 23:19:56 +00:00
calvin
372798487b start logger output before append_url is called since this can trigger logger.new_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2239 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-29 23:12:55 +00:00
calvin
2c40c0be3c FTP connection timeout
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2229 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-28 12:16:35 +00:00
calvin
639aeb294a return 'busy' on busy connections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2223 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-28 01:03:16 +00:00
calvin
7e0c34a3d9 better FTP connection pooling, remove unnecessary LIST
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2222 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-28 01:02:15 +00:00
calvin
914f2440b7 syntax cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2220 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-27 21:14:17 +00:00
calvin
49cfa19c5d ignore all close errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2219 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-27 21:11:48 +00:00
calvin
3e79dd7e09 added and use ftpparse module
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2218 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-27 19:03:33 +00:00
calvin
5ae97df822 use python 2.4
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2209 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-24 20:29:55 +00:00
calvin
e226131e59 use new nntp argument usenetrc
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2207 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-24 19:31:13 +00:00
calvin
93e3da02b2 socket.sslerror is now a subclass of socket.error
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2206 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-24 19:27:11 +00:00
calvin
8e2b4edd49 split status message prints
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2187 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-20 22:52:58 +00:00
calvin
10e8fd9fe3 make interrupt warning a plural form
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2181 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-20 21:44:10 +00:00
calvin
86e90da338 fix reversed sslerror version check logic
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2175 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-20 12:50:38 +00:00
calvin
f40e41a5bb cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2171 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-20 09:35:46 +00:00
calvin
d030a5b054 documentation updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2164 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-19 15:56:48 +00:00
calvin
647d7167ee documentation syntax
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2163 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-19 15:08:02 +00:00
calvin
b008747f39 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2160 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-19 01:04:38 +00:00
calvin
46de8b6ca0 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2159 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-19 00:40:06 +00:00
calvin
ef8613f2c7 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2157 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-19 00:08:41 +00:00
calvin
8ac75ce155 only add socket.sslerror to exception list if needed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2156 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-18 17:04:31 +00:00
calvin
700d564be7 documentation updates
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2148 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-18 01:00:45 +00:00
calvin
be4fb033b8 print VRFY info or warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2136 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-11 14:34:11 +00:00
calvin
15364fc362 fix username param
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2133 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-11 13:32:47 +00:00
calvin
b3e3448f96 sort MX hosts according to preference
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2132 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-11 13:29:34 +00:00
calvin
b06f144ced updated copyright year
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2122 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-01-11 02:22:43 +00:00
calvin
9e843d71a7 set smtp debug
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2098 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-12-07 11:06:34 +00:00
calvin
9829268533 ignore empty filenames in filelist
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2097 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-12-07 08:16:20 +00:00
calvin
0778ef9d6d use internal file get method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2094 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-12-07 00:01:28 +00:00
calvin
1e001992ac disable recursion debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2091 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-12-06 22:38:43 +00:00
calvin
ef0d624c0d unicode fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2089 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-12-06 22:34:20 +00:00
calvin
3b13dd87e2 display correct url in redirect message
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2014 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 13:08:26 +00:00
calvin
be5a59e9fd add dots to warnings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2010 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 11:18:06 +00:00
calvin
bc89449080 add dots to info messages
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2008 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-19 11:06:31 +00:00
calvin
d2a6f4ed95 recheck robots.txt allowance after redirect
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2002 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-18 00:57:35 +00:00
calvin
89616a4bba basic robots_txt check method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2001 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-18 00:55:47 +00:00
calvin
4014012c1f basic is_extern method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1999 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-18 00:49:45 +00:00
calvin
74f1935be5 recheck extern/intern filters for redirected URLs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1998 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-18 00:49:33 +00:00
calvin
2765c5b116 use anchor and user info in cache key
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1987 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-11-15 19:16:02 +00:00