Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-05 05:04:46 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
3487 commits 1 branch 0 tags 24 MiB
Commit graph

421 commits

Author SHA1 Message Date
calvin
5e6317a4bb remove old warning, and move effective url test to urlbase 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2532 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 18:25:32 +00:00
calvin
71407d0399 use new logger interface 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2528 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 14:52:38 +00:00
calvin
7925d5dd56 use collections.deque for incoming queue 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2518 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-13 21:05:52 +00:00
calvin
ba5939c7c5 allow optional empty url path 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2500 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-31 13:50:11 +00:00
calvin
bfe3f4cd4d do not add aliases that are in-progress 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2491 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 20:37:06 +00:00
calvin
5b64583904 add ignore_missing flag and do not cache already-cached aliases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2490 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 20:26:35 +00:00
calvin
eeb6da8330 do not cache HTTP connections with pending data 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2487 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 18:47:09 +00:00
calvin
ecd7e44935 add assertion for check queue 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2481 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 15:52:40 +00:00
calvin
911e2eb011 fix persistent connection detection 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2477 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 13:41:22 +00:00
calvin
7429dfa209 cached connection debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2476 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 13:40:54 +00:00
calvin
a50c3ce40a use threader init param to set number of threads 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2469 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 11:29:49 +00:00
calvin
9cc3f978a6 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2465 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 08:52:40 +00:00
calvin
8e720030d1 check A RR records when no MX RR record could be found 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2461 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-28 14:59:17 +00:00
calvin
bbf96868b8 document aliases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2458 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-18 14:21:12 +00:00
calvin
26e52022ea add aliases to cache 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2457 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-18 14:17:23 +00:00
calvin
dcd407782d no double alias reset 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2454 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-18 00:02:50 +00:00
calvin
0b0e672b4e cleanup of the fallbacks 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2453 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-16 17:34:02 +00:00
calvin
9b982062fc do not translate countries 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2434 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-12 00:43:52 +00:00
calvin
6857196b25 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2426 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 23:15:13 +00:00
calvin
964f313a89 fix return codes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2424 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 22:39:34 +00:00
calvin
2b8ca62e2e split up the big check function 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2423 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 22:37:09 +00:00
calvin
ac450295ac put country info in local check method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2412 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 20:30:41 +00:00
calvin
131bea1a59 avoid deadlock with cache lock 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2395 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:09:41 +00:00
calvin
e89ef2c57a use own locking class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2393 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:03:09 +00:00
calvin
4c248fce03 avoid deadlock with cache lock 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2392 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:02:52 +00:00
calvin
dc960185df only set connection debug level if CHECK logging is on debug 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2388 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 21:55:20 +00:00
calvin
7563f0edf9 fix lock class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2387 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 21:54:56 +00:00
calvin
3373644560 make the consumer a lock object itself 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2386 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 20:28:16 +00:00
calvin
7f6d1b1022 more headers stuff 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2382 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 14:59:03 +00:00
calvin
b3c3c3eaaa split off header methods in separate file 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2381 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 13:46:58 +00:00
calvin
ca49e04730 content encoding getter method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2380 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 13:39:20 +00:00
calvin
12b726b4df strip content type mime 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2379 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 13:33:20 +00:00
calvin
f344b75c8e documentation and syntax fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2378 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 10:26:30 +00:00
calvin
0d063a3b53 skip accept encoding, and list complete recursion list 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2377 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 08:44:45 +00:00
calvin
4972a5b2f4 add warning on decompress errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2375 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 21:04:02 +00:00
calvin
f808a03d3f no info for empty proxy 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2365 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 17:28:22 +00:00
calvin
e1e713036b use noproxyfor config values to ignore proxy settings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2360 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 13:57:01 +00:00
calvin
52d364ae54 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2359 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 10:38:09 +00:00
calvin
9e9e42e21e added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2358 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 10:23:48 +00:00
calvin
c8920096e0 make threadsafe geoip call 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2354 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 00:09:22 +00:00
calvin
0284f58359 log country name as info 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2352 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 00:08:48 +00:00
calvin
703da9eb65 safe decoding of non-unicode strings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2322 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-18 11:22:52 +00:00
calvin
05f5123d7c make sure infos and warnings are unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2320 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-18 09:20:45 +00:00
calvin
0e12b923f6 make sure results are unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2319 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-18 09:17:46 +00:00
calvin
44075c47bf clean up raise calls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2294 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 14:52:50 +00:00
calvin
77cea28d42 pylint cleanups 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2292 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 13:43:33 +00:00
calvin
2fced4f37d documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2288 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 12:10:39 +00:00
calvin
d1fd01f669 remove expired connections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2287 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 10:41:27 +00:00
calvin
55652cabc0 fix nt path name for network paths 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2284 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-07 15:41:53 +00:00
calvin
344bfd1103 no return from add_connection 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2278 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-06 21:20:29 +00:00
calvin
bb3b972d8f always add connections, and close timed out ones 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2277 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-06 21:20:10 +00:00
calvin
3be005186a do not print XXX message, check for connected .sock attribute and always add to cache 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2276 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-06 21:15:28 +00:00
calvin
1d3dd0c35b documentation added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2258 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-31 20:18:17 +00:00
calvin
4f21309b9a added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2246 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-30 22:41:59 +00:00
calvin
01ceb0aafd HTTP connection pooling 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2245 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-30 22:39:09 +00:00
calvin
9dea804d92 per-connection timeout 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2244 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-30 11:00:37 +00:00
calvin
b698701726 only release cached FTP connections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2243 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-29 23:29:45 +00:00
calvin
e76836a607 add time import 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2242 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-29 23:19:56 +00:00
calvin
372798487b start logger output before append_url is called since this can trigger logger.new_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2239 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-29 23:12:55 +00:00
calvin
2c40c0be3c FTP connection timeout 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2229 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 12:16:35 +00:00
calvin
639aeb294a return 'busy' on busy connections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2223 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 01:03:16 +00:00
calvin
7e0c34a3d9 better FTP connection pooling, remove unnecessary LIST 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2222 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 01:02:15 +00:00
calvin
914f2440b7 syntax cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2220 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-27 21:14:17 +00:00
calvin
49cfa19c5d ignore all close errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2219 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-27 21:11:48 +00:00
calvin
3e79dd7e09 added and use ftpparse module 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2218 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-27 19:03:33 +00:00
calvin
5ae97df822 use python 2.4 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2209 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 20:29:55 +00:00
calvin
e226131e59 use new nntp argument usenetrc 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2207 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 19:31:13 +00:00
calvin
93e3da02b2 socket.sslerror is now a subclass of socket.error 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2206 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 19:27:11 +00:00
calvin
8e2b4edd49 split status message prints 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2187 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 22:52:58 +00:00
calvin
10e8fd9fe3 make interrupt warning a plural form 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2181 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 21:44:10 +00:00
calvin
86e90da338 fix reversed sslerror version check logic 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2175 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 12:50:38 +00:00
calvin
f40e41a5bb cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2171 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 09:35:46 +00:00
calvin
d030a5b054 documentation updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2164 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 15:56:48 +00:00
calvin
647d7167ee documentation syntax 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2163 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 15:08:02 +00:00
calvin
b008747f39 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2160 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 01:04:38 +00:00
calvin
46de8b6ca0 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2159 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 00:40:06 +00:00
calvin
ef8613f2c7 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2157 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 00:08:41 +00:00
calvin
8ac75ce155 only add socket.sslerror to exception list if needed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2156 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 17:04:31 +00:00
calvin
700d564be7 documentation updates 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2148 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 01:00:45 +00:00
calvin
be4fb033b8 print VRFY info or warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2136 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 14:34:11 +00:00
calvin
15364fc362 fix username param 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2133 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 13:32:47 +00:00
calvin
b3e3448f96 sort MX hosts according to preference 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2132 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 13:29:34 +00:00
calvin
b06f144ced updated copyright year 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2122 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 02:22:43 +00:00
calvin
9e843d71a7 set smtp debug 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2098 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-07 11:06:34 +00:00
calvin
9829268533 ignore empty filenames in filelist 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2097 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-07 08:16:20 +00:00
calvin
0778ef9d6d use internal file get method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2094 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-07 00:01:28 +00:00
calvin
1e001992ac disable recursion debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2091 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-06 22:38:43 +00:00
calvin
ef0d624c0d unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2089 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-06 22:34:20 +00:00
calvin
3b13dd87e2 display correct url in redirect message 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2014 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 13:08:26 +00:00
calvin
be5a59e9fd add dots to warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2010 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 11:18:06 +00:00
calvin
bc89449080 add dots to info messages 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2008 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 11:06:31 +00:00
calvin
d2a6f4ed95 recheck robots.txt allowance after redirect 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2002 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-18 00:57:35 +00:00
calvin
89616a4bba basic robots_txt check method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2001 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-18 00:55:47 +00:00
calvin
4014012c1f basic is_extern method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1999 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-18 00:49:45 +00:00
calvin
74f1935be5 recheck extern/intern filters for redirected URLs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1998 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-18 00:49:33 +00:00
calvin
2765c5b116 use anchor and user info in cache key 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1987 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-15 19:16:02 +00:00
calvin
cafa412343 use base cache keys 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1986 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-15 19:15:22 +00:00
calvin
4485ab19aa only norm a changed file base_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1985 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-15 16:36:56 +00:00
calvin
265f942ba1 add unquoted redirectino url to info 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1980 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 11:02:17 +00:00
calvin
1166804eb0 use idna domain for intern patterns 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1979 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 10:52:20 +00:00
calvin
72290074ac syntax cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1978 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 10:47:43 +00:00
calvin
9c40e54e1e encode index.html data 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1971 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-13 23:40:17 +00:00
calvin
f0048d0345 add unicode domain name warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1970 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-13 23:30:14 +00:00
calvin
75ec50b156 adjust for new url_norm method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1965 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-13 11:20:33 +00:00
calvin
7c83266566 serialize helper function 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1962 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-12 13:25:40 +00:00
calvin
1997381c2b return unicode url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1960 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-10 16:41:41 +00:00
calvin
3d81638b8f use intern __repr__(), not repr() 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1958 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-10 14:31:34 +00:00
calvin
2be584891b norm changed base url again 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1945 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 17:02:42 +00:00
calvin
85497ca439 typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1944 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 16:58:51 +00:00
calvin
d671254279 make --quiet an alias for -o none 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1943 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 16:04:05 +00:00
calvin
9f95017d5b case sensitivity checking of NT filenames 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1927 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 08:11:09 +00:00
calvin
6f488fd189 remember base href in link parser 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1918 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-06 12:42:33 +00:00
calvin
607425065e add cache key asserts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1917 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-05 00:24:36 +00:00
calvin
2ba4a50965 ensure unicode for redirects 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1916 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-05 00:24:25 +00:00
calvin
437b56c9ad assert msgs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1915 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-05 00:24:08 +00:00
calvin
01f1c06149 no repr of url name 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1913 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 22:35:29 +00:00
calvin
9b28e3b346 unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1911 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 21:29:25 +00:00
calvin
00b1a426d1 convert url names to unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1909 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 13:50:54 +00:00
calvin
34081d925b unicode repr 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1908 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 13:49:59 +00:00
calvin
96722d09f1 coerce urls to unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1901 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-02 13:05:11 +00:00
calvin
de68f20f89 unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1899 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 22:34:50 +00:00
calvin
54b8126ccb cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1896 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:49:59 +00:00
calvin
dee1c867ff encode msgs to stderr 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1889 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:19:29 +00:00
calvin
65188d735c check for SSL support when generating https connection objects 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1858 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-25 21:18:22 +00:00
calvin
5950df2473 improved the documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1845 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-22 15:53:10 +00:00
calvin
6752070eba unused import cgi removed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1844 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-21 06:34:55 +00:00
calvin
97d6f02135 better missing trailing dir slash check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1842 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-20 19:40:57 +00:00
calvin
5405c2844b use FTP connection cache 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1841 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-20 19:22:32 +00:00
calvin
304bdda3bf added ftp connectin cache 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1840 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-20 19:21:35 +00:00
calvin
5201de5cb6 recurse into ftp links 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1839 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-20 18:30:44 +00:00
calvin
ee71260815 use new get_index_html utility function 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1838 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-20 17:49:26 +00:00
calvin
6bb7a08eb5 added get_index_html utility function 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1837 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-20 17:48:52 +00:00
calvin
0ab639242b search given filename in file list 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1833 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-20 14:43:10 +00:00
calvin
ff23bbf53d simplify incoming_get_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1812 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-16 21:40:03 +00:00
calvin
0dcd6a8425 assertion message 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1809 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-16 21:14:59 +00:00
calvin
d174276fd8 also display info in repr() 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1807 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-16 20:33:30 +00:00
calvin
f31407d2b4 remove cached urls from progress queue 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1806 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-16 20:33:14 +00:00
calvin
d2f7955f2c cookie warning msg fixed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1804 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-14 20:06:06 +00:00
calvin
fda2392fc6 do not catch cookie error on check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1802 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-14 20:01:35 +00:00
calvin
3f9e2646fe documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1801 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-14 20:01:22 +00:00
calvin
5c4662499c catch cookie errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1800 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-14 20:00:51 +00:00
calvin
00d2b6d96e added CookieError to error list 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1799 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-14 19:54:46 +00:00
calvin
ff000a8c5c documentation for cache keys 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1784 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-10 08:37:14 +00:00
calvin
228221fb85 install gettext method in default namespace 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1736 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-05 20:48:52 +00:00
calvin
17ce3f00b9 fix typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1732 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-04 23:23:20 +00:00
calvin
bf4309220e remove anchors from cache keys 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1722 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 19:55:23 +00:00
calvin
26b3f1bcf3 strip quotes from css urls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1721 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 19:55:05 +00:00
calvin
79b0ef54f5 support url list parsing in text files 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1709 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 14:54:59 +00:00
calvin
594797b5e2 content regex fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1708 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 14:43:11 +00:00
calvin
b1708fc725 get the complete content 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1707 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 14:29:07 +00:00
calvin
33f218d9a2 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1706 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 13:39:09 +00:00
calvin
a29240d868 do not error out on missing user/password of ftp link 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1705 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 13:38:46 +00:00
calvin
c79581fe31 adjust cache keys 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1704 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 13:30:24 +00:00
calvin
bacefcf242 separate cache keys for urls and recurions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1702 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 12:05:40 +00:00
calvin
1b4c190778 file output must honor verbose/quiet flag 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1693 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 08:26:10 +00:00
calvin
751d60f924 fix variable typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1692 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-09-03 06:39:37 +00:00
calvin
98144c5fb0 remove ccache incoming debug 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 22:23:09 +00:00
calvin
b257534a60 user/password authentication for robots.txt 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1653 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 21:39:57 +00:00
calvin
68e1f03094 reset aliases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1650 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 21:31:07 +00:00
calvin
6c97b96aa8 check cache for redirected urls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1648 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 20:43:58 +00:00
calvin
a1f9f2af2b remove some asserts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1642 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 19:28:12 +00:00
calvin
3f9c9cdd84 do not append error/valid to result 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 19:23:52 +00:00
calvin
fc65d8efb9 new in_progress cache, fix cache_key setting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1637 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 19:15:22 +00:00
calvin
60dc606510 forgot some cache adds 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1634 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-30 15:54:31 +00:00
calvin
07f25c6429 more code documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1629 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-29 15:48:17 +00:00
calvin
bbba28f781 downgrade the 'outside of domain filter' warning to an info message since after all the user is in full control over extern/intern stuff 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1626 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-29 12:45:03 +00:00
calvin
03086d7793 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 16:54:44 +00:00
calvin
7fb8e33ab3 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1582 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 09:27:29 +00:00
calvin
6567ffbfbc debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1581 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 09:27:22 +00:00
calvin
8194034e93 text magic 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1580 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 09:24:13 +00:00
calvin
39a6c0aeb0 status prefix 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1565 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 06:40:30 +00:00
calvin
b8f0ca1c92 strict rename to externstrictall 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1564 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 06:37:43 +00:00
calvin
74df7dd963 updated documentation, adjust login method for missing user or password 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1562 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 21:08:49 +00:00
calvin
388d25c949 dont connect with base class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1561 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 21:08:20 +00:00
calvin
c532adfd1c use new abort() method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1554 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 19:22:55 +00:00
calvin
1100eabb62 rename finish to abort, and correct the abort state 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1553 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 19:22:17 +00:00
calvin
02a1c329e8 only send http: referers, and catch bad HEAD replies on redirections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1552 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 18:54:31 +00:00
calvin
3ba4314786 fix cookie cache method calls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 18:25:28 +00:00
calvin
80ce276942 use new absolute_url function 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1550 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 18:21:26 +00:00
calvin
8e8eba71dc print redirection info 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1544 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 15:32:40 +00:00
calvin
1539b2c639 suggest -Dall debug run in internal error message 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1540 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 13:56:21 +00:00
calvin
fc7b2b4351 self.url should be normed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1535 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 12:47:29 +00:00
calvin
31233bb778 leave self.base_url unquoted 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1530 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 08:44:03 +00:00
calvin
c34abe18a2 set line/column always to int 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1520 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-26 18:30:12 +00:00
calvin
b4039684c3 got rid of urlconnect 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1501 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:53:08 +00:00
calvin
130b89f866 use urlbase and new is_safe url functions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1500 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:51:38 +00:00
calvin
c904caa5c5 move self.is_cache(), and use urlunsplit to set self.url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1499 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:50:40 +00:00
calvin
d0b54018ee use urlbase and its modified url building 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1498 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:49:37 +00:00
calvin
a2bb57d81f fix cache keys and url building 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1496 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:42:26 +00:00
calvin
b3c9db06ef add new ignored url schemes, and only fall back to file:// with urls given on the command line 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1489 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 18:25:41 +00:00
calvin
605cd63c7d log and cache invalid syntax urls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1488 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 18:24:59 +00:00
calvin
e3af24186b remove whitespace check, it is not needed now the url is always quoted 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1487 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 18:24:07 +00:00
calvin
95139bc0f9 added handler for invalid urls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1484 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 18:21:12 +00:00
calvin
0de757b5eb documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1480 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-24 21:34:07 +00:00
calvin
d24d8a512c do not use netrc 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1469 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-24 14:58:42 +00:00
calvin
0fe112ad4e better url joining 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1466 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 22:53:57 +00:00
calvin
01976e953b add trailing directory slash 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1463 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 22:27:24 +00:00
calvin
4e654e327b recursion of directories 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1462 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 22:20:11 +00:00
calvin
84b9c1ab2e set result for directories 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1461 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 22:15:59 +00:00
calvin
a2a1429b7e fix intern url setting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1460 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 21:34:16 +00:00
calvin
5bdea05dff fix endless loops with broken urls with a non-empty anchor 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1458 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 21:24:30 +00:00
calvin
36db68852f errors and warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1451 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 20:16:53 +00:00
calvin
614255a441 add intern url always on cmdline 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1444 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 23:24:25 +00:00
calvin
726aac7ac0 fix cache key 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1443 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 23:05:41 +00:00
calvin
c37d3acd50 move debug message for url queue adding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1442 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 23:05:31 +00:00
calvin
53e89e3b39 added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1435 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 21:39:08 +00:00
calvin
f2e7ca6040 split off cache and url consumer routines into separate classes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1432 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 21:35:47 +00:00
calvin
7a0888b9eb fix mail parsing, and connection closing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1428 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-16 20:11:21 +00:00
calvin
4756641e1b source code restructuring 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1423 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-16 19:20:53 +00:00
calvin
c9261c96c2 install_data 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1403 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-30 08:09:18 +00:00
calvin
213b9e3cec pycheck fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1400 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-26 13:54:32 +00:00
calvin
1f6670e8cd import fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1399 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-26 13:47:19 +00:00
calvin
96dd6ef4b8 import fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1398 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-26 12:01:52 +00:00
calvin
3e56e96e14 import fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1397 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-26 11:43:11 +00:00
calvin
02b177017e fix getUrlDataFrom invocation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1396 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-26 11:18:12 +00:00
calvin
b674575de1 import fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1388 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-22 13:36:43 +00:00
calvin
6942fccb50 import fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1386 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-22 13:19:18 +00:00
calvin
32bc5cd292 more import fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1383 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-22 10:54:47 +00:00
calvin
b60070a922 bk movements 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1375 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-20 14:50:00 +00:00
calvin
6476c8675d more import fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1364 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-19 08:58:59 +00:00
calvin
916f96cc0d checker module 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1357 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-07-07 18:15:17 +00:00