Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-09 23:24:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
3459 commits 1 branch 0 tags 24 MiB
Commit graph

1638 commits

Author SHA1 Message Date
calvin
ac682df355 be precise for threads: zero threads disable threading 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3188 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-15 18:35:16 +00:00
calvin
b3b45d7f06 add Timeout exception, and return in_progress URLs on status instead of unfinished 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3187 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-15 18:34:30 +00:00
calvin
b1e7ca58a2 remove unused imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3186 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-15 18:33:38 +00:00
calvin
dc62353ca2 don't catch SystemExit, and no bare except 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3185 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-15 18:06:44 +00:00
calvin
ffe233c2eb don't catch SystemExit, and no bare except 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3184 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-15 18:05:52 +00:00
calvin
938d193446 store timeout in configuration 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3183 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-15 18:05:17 +00:00
calvin
c8bcdf7d79 remove unused threader class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3182 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-15 18:02:07 +00:00
calvin
70fedc052c replace bare excepts with ones catching StandardError 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3181 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-15 18:01:29 +00:00
calvin
df8af83508 use debug lock class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3179 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 19:58:55 +00:00
calvin
ab1ba455f6 make lock class just a debug wrapper 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3178 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 19:58:46 +00:00
calvin
ffeaa3484e add debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3177 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 18:03:59 +00:00
calvin
df7a2076a9 cache DNS lookups 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3176 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 18:03:23 +00:00
calvin
afdccbaa80 set names of worker and status threads 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3175 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 17:50:36 +00:00
calvin
523e6e8e43 use variables in result lines 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3174 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 17:49:58 +00:00
calvin
91ff370ed7 on redirection to different URL scheme take caching into account; adjust tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3173 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 17:47:50 +00:00
calvin
2a336f8dad put redirects in url queue 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3172 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 17:01:41 +00:00
calvin
2cfcb5c0bb avoid double timeouts by raising timeout errors in robots.txt retrieval 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3171 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 12:58:31 +00:00
calvin
9a431fde40 fix imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3170 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 10:14:07 +00:00
calvin
5ba1324a73 an intern pattern matches both http and https URLs now 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3169 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 10:06:33 +00:00
calvin
853f1d7f51 always disable status thread after checking, and log end of output 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3165 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 08:41:52 +00:00
calvin
ddf3703962 put status printing in a separate module, with a flag that can be disabled 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3163 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-14 08:29:44 +00:00
calvin
53e1bd993e fix test output 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3162 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 21:25:59 +00:00
calvin
dc9f04e6dc adjust debug asserts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3159 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 21:03:21 +00:00
calvin
2947b4710d quote slashes in cgi values 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3158 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 20:52:30 +00:00
calvin
857582c026 honor case where fallback class is not given 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3157 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 20:51:11 +00:00
calvin
ee0a7bb824 don't return True on debug, add shutdown method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3156 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 20:50:52 +00:00
calvin
67f39e516c synchronize the log method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3152 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 18:53:41 +00:00
calvin
0d39d6139f no active tasks in status 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3150 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 18:15:40 +00:00
calvin
7afe60c841 removed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3149 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 18:08:35 +00:00
calvin
98a6d1eb00 added missing import 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3148 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 18:08:06 +00:00
calvin
b0c189d143 added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3147 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 18:07:46 +00:00
calvin
f002c5f965 Replace the old threading algorithm with a new one based on Queue.Queue and consumer threads 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3146 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 13:44:52 +00:00
calvin
d05c68ef74 added path encoding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3145 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 13:41:46 +00:00
calvin
c33e6d5907 split up invalid* tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3144 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 13:41:10 +00:00
calvin
3e8a221110 acquire locks directly 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3143 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 13:40:22 +00:00
calvin
bfd52936a6 fix config parsing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3142 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 09:53:53 +00:00
calvin
ac9d88cd99 added config test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3141 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-13 09:51:50 +00:00
calvin
394abbbab5 fix imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3137 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-12 14:51:09 +00:00
calvin
d667abac69 Don't encode the host header with idna if not necessary. Taken from Python subversion trunk. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3136 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-04 18:24:23 +00:00
calvin
c2f5d222e1 split off configuration parsing in a separate class, put config stuff into its own module directory 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3135 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-03 18:24:46 +00:00
calvin
d547b0ee31 fix mail tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3134 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-03 17:00:08 +00:00
calvin
0bd43753d3 remove old resource check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3133 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-03 16:59:58 +00:00
calvin
c35737ff3a use new long duration format 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3132 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-03 16:39:01 +00:00
calvin
58993644d8 use format_time from quodlibet source 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3131 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-05-03 16:35:37 +00:00
calvin
4b10271233 use unittest.TestCase for standard test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3129 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-24 20:16:57 +00:00
calvin
f9a59e616d added caseless dict classes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3128 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-24 20:13:29 +00:00
calvin
bae6c90f43 documentation cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3127 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-24 20:12:53 +00:00
calvin
a764b1484b import cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3126 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-24 20:12:40 +00:00
calvin
b4d4b2ed94 cast to size_t 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3122 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-11 23:53:25 +00:00
calvin
787d9143fe don't call write_color with None argument 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3120 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-08 10:26:15 +00:00
calvin
31e853e0d7 remove unnecessary global statements 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3119 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-08 09:02:14 +00:00
calvin
02ecf152c6 syntax cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3118 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-08 09:01:49 +00:00
calvin
cce1d273a7 really return value 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3117 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-08 09:00:44 +00:00
calvin
4845e926a9 always use default locale for translation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3116 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-08 09:00:23 +00:00
calvin
4f67591327 no bare excepts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3115 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-08 08:59:52 +00:00
calvin
2544c90708 fix detection of </script> 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3113 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-08 08:58:31 +00:00
calvin
6dacc9bf61 use has_* flags for resource availability 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3112 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-08 08:57:52 +00:00
calvin
78dfb4c293 whitespace normalization 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3106 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:15:07 +00:00
calvin
b503ea15f4 updated cgi tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3105 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:14:49 +00:00
calvin
9f7dde02f8 use WConio on Windows for colored output 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3104 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:14:15 +00:00
calvin
db223a1912 write label for graph 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3103 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:13:41 +00:00
calvin
38b83415dd correctly replace spaces in cgi params 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3102 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:12:43 +00:00
calvin
893300308c updated time format tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3101 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:12:30 +00:00
calvin
0132e4ca89 better time formatting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3100 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:05:45 +00:00
calvin
1cd74500ee no literal </script>, accept empty SGML comments, compress equivalence classes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3099 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 19:04:40 +00:00
calvin
e42f1a0cec replace sf.net with sourceforge.net 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3094 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-04-03 16:35:39 +00:00
calvin
df66edb7c3 allow empty comment in HTML parser 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3091 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-03-10 10:48:25 +00:00
calvin
aeb698cbec add localhost to local interface list 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3090 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-03-10 10:48:07 +00:00
calvin
1d724a034a Construct equivalence classes in flex scanner 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3089 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-03-09 22:38:51 +00:00
calvin
1bf4fac474 removed .cvsignore 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3086 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-24 20:09:03 +00:00
calvin
00310425ac updated copyright template 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3081 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-17 23:38:12 +00:00
calvin
68a4d32212 rename _synchronized in synchronize 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3079 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-16 19:47:37 +00:00
calvin
46ed49d148 ensure log output is unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3075 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-13 21:49:25 +00:00
calvin
276437c7d8 syntax cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3067 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-09 07:57:22 +00:00
calvin
287ec3b960 syntax 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3060 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-04 09:15:11 +00:00
calvin
e56215235c cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3058 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-03 23:58:30 +00:00
calvin
c334b8db13 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3056 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-03 23:21:20 +00:00
calvin
1e0581e718 use iter* dict methods 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3054 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-03 22:15:41 +00:00
calvin
2788fc2a59 add modification time information functions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3052 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-03 20:42:56 +00:00
calvin
6cda627f0f more tests added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3046 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-03 17:06:25 +00:00
calvin
2880274744 more test coverage 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3045 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 23:31:39 +00:00
calvin
38a7b15aeb accept a dict as lru init val 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3044 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 23:00:03 +00:00
calvin
902949f27e some format fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3043 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 22:59:42 +00:00
calvin
fac0b0f793 remove unused quote_val method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3042 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 22:58:40 +00:00
calvin
3f6ac53fff added tests for more coverage 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3041 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 22:58:11 +00:00
calvin
3a5f06cfa9 remove unused strip_quotes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3040 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 21:53:11 +00:00
calvin
a3e4780b38 quote attributes with unicode entity escapes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3039 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 21:40:57 +00:00
calvin
75be4d0bb6 fix entity resolving 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3038 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 21:40:02 +00:00
calvin
cbef33ec5e fix parsing of hexadecimal entities 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3037 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 20:06:59 +00:00
calvin
94e083315b allow escaped quotes in tag attributes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3036 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-02 20:05:59 +00:00
calvin
9fd7b24344 check return value of acquire() 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3034 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-01 19:48:22 +00:00
calvin
b6c947442a documentation fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3033 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-01 19:48:02 +00:00
calvin
1df673a79d add url_unsplit method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3029 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-01 18:56:20 +00:00
calvin
5a4f1248c3 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3028 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-01 18:56:04 +00:00
calvin
0a257847e3 add a Buffer class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3026 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-01 18:55:40 +00:00
calvin
6c14cf1d8b syntax 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3025 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-01 18:54:11 +00:00
calvin
a2ed1b323f do not lowercase the absolute url, caused the URL matching not to work for URLs with uppercase characters 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3022 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-02-01 18:49:31 +00:00
calvin
0681b1889f limit amount of read chunks, and cleanups 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3017 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-11 22:03:58 +00:00
calvin
0bb41a5ec3 do no print warning about different dns message ids 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3016 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-06 22:32:42 +00:00
calvin
bb3dac673f added coding line 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3015 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-06 15:04:29 +00:00
calvin
fc5e34b216 added more decorators 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3014 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-06 15:02:50 +00:00
calvin
e94c61529b catch value error on codec lookup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3013 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-06 15:02:32 +00:00
calvin
48cdfd32ee fix tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3011 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-04 01:20:20 +00:00
calvin
e92aee054c updated copyright 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3010 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-03 19:12:47 +00:00
calvin
fe24c56e84 only split host ports on known schemes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3009 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-03 18:37:42 +00:00
calvin
b4748cdcee back out decorator change 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3002 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-03 01:09:23 +00:00
calvin
bc846a20ff use own splitport method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3001 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-02 14:26:24 +00:00
calvin
6b6adab12f new decorator_with_args helper 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3000 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2006-01-02 14:25:50 +00:00
calvin
388475cbe2 new-style exceptions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2999 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-20 20:17:33 +00:00
calvin
7b3949eebf cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2996 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-20 09:09:32 +00:00
calvin
8d67ee35ef removed is_safe_js_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2995 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-20 09:08:51 +00:00
calvin
a24fd65943 always quote port value 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2992 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-19 14:08:34 +00:00
calvin
815fb9da83 more tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2991 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-19 14:06:53 +00:00
calvin
c84a33c7ce syntax fix 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2988 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 09:13:23 +00:00
calvin
856ff8ef2a assert debugs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2987 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:55:42 +00:00
calvin
aec847e570 assert debug 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2986 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:46:48 +00:00
calvin
1cec04018f cleanup unused imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2985 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:40:22 +00:00
calvin
19c0a3c2ed use new cookie parsing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2983 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:19:11 +00:00
calvin
5eb3061ee0 added new cookie parsing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2982 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:18:32 +00:00
calvin
a22d055d0b make debug() function assert'able 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2981 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:17:18 +00:00
calvin
d28567753b add is_encoding() method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2980 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:16:36 +00:00
calvin
cff9b1341b improved charset parsing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2979 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:16:25 +00:00
calvin
24e91ffaaf fix info logging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2978 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-18 08:15:49 +00:00
calvin
d7a4a08659 updated tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2974 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-17 19:22:44 +00:00
calvin
3b1b95af5a added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2970 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-17 19:18:08 +00:00
calvin
9425873830 cache aliases (from redirects) 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2964 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-08 20:20:21 +00:00
calvin
43fb20371f new tagged infos 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2963 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-08 20:20:04 +00:00
calvin
b34f4da7fe better error message if no nameservers could be found 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2962 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-08 20:19:48 +00:00
calvin
47b4a52134 removed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2958 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-08 17:14:39 +00:00
calvin
791bd87f6d use LinkCheckTest 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2956 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-08 17:08:08 +00:00
calvin
ee2d4e6ead moved ftests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2954 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-07 22:40:19 +00:00
calvin
4cf6f29afe unused import removed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2953 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-07 22:40:09 +00:00
calvin
26ccd4d81c fix func name typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2952 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-07 22:39:17 +00:00
calvin
329043bc9f use datadir 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2951 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-07 22:33:14 +00:00
calvin
98e3e26644 moved 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2950 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-07 22:32:48 +00:00
calvin
ddb09ab76a added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2949 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-07 21:55:16 +00:00
calvin
c86c0870d6 debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2946 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-06 22:32:31 +00:00
calvin
b733ffdb2a remove has_incoming, debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2945 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-06 22:32:14 +00:00
calvin
3c03728d29 add update_meta utility func 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2942 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-06 17:10:17 +00:00
calvin
b482d35656 fix exception name and add 0.0.0.0 to localhost list 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2941 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-12-06 11:47:38 +00:00
calvin
99c0382781 add timeit decorator 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2940 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-14 22:50:44 +00:00
calvin
e2a454e31f use new trace module 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2939 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-14 22:49:37 +00:00
calvin
ae508129f1 move trace into separate module 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2938 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-14 22:49:22 +00:00
calvin
7d1ea45be6 rebuild with bison 2.1 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2937 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-14 22:47:30 +00:00
calvin
bcbbe6ff60 allow https js urls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2935 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-12 19:56:46 +00:00
calvin
a4cfa10fdf better comment parsing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2934 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-12 19:56:31 +00:00
calvin
f65cfb87f9 fix tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2933 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-12 19:56:01 +00:00
calvin
065665a0f1 rename builtins 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2932 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-12 19:55:54 +00:00
calvin
77ed566471 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2931 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-09 07:46:22 +00:00
calvin
9eab0056ac encode url query 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2930 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-09 07:46:05 +00:00
calvin
e29efc31fa more checkes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2928 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-04 20:06:29 +00:00
calvin
c049837cdd remove parser messages 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2927 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-04 20:05:59 +00:00
calvin
de2e66e713 remove parser errors/warnings, and better error detection 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2926 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-04 20:05:35 +00:00
calvin
dffe4f906e documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2925 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-03 16:56:28 +00:00
calvin
35f1172481 count errors in tests, and add some more cases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2924 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-03 16:56:12 +00:00
calvin
b8aa3009d8 store a list of errors, and add more error messages to the parser 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2923 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-03 16:53:26 +00:00
calvin
7d5be699df documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2922 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-02 13:49:03 +00:00
calvin
0dca65accf depend on python >= 2.4 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2921 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-11-02 13:48:53 +00:00
calvin
7e90eccc84 dnspython 1.3.5 merged 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2920 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-31 08:59:29 +00:00
calvin
df34e1a8e9 remove unused imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2919 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-25 13:48:30 +00:00
calvin
1d891fffec fix typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2918 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-25 13:47:45 +00:00
calvin
fa3d35beff beautify equals check msg 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2917 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-25 13:47:28 +00:00
calvin
c2b4132eb9 ensure html attr values are strings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2915 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-25 13:47:03 +00:00
calvin
e3beb86ac1 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2911 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-17 12:18:18 +00:00
calvin
c9f5d1a0b1 catch gzip errors, and use linkchecker debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2910 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-15 00:06:48 +00:00
calvin
041df3a48d documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2906 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 22:54:23 +00:00
calvin
a2e422ce0d reindent 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2900 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 22:26:12 +00:00
calvin
96f4f946b2 remove unused imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2898 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 21:29:17 +00:00
calvin
d83720f05d do not parse any invalid config files 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2895 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 21:15:31 +00:00
calvin
8ce45149fa re-add nofollow check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2890 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 20:49:56 +00:00
calvin
93c498699d disable keyboard interrupt and SystemExit while aborting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2888 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 20:11:36 +00:00
calvin
9e560f9ccf only return on thread wait timeout 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2887 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 20:08:14 +00:00
calvin
c585d095b4 catch SystemExit from internal errors in subthreads, and eliminate abort wrapper 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2886 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 20:06:57 +00:00
calvin
5303f94b76 ensure proxy value syntax 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2883 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 17:59:20 +00:00
calvin
50ea41b12d use preferred locale for default encoding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2878 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 17:22:12 +00:00
calvin
753b907d51 remove unneeded imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2871 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:56:57 +00:00
calvin
66a30acc2d assume cStringIO is there 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2870 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:56:22 +00:00
calvin
6ca5dea8c3 define fs var 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2869 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:56:07 +00:00
calvin
19a290d81a query and anchor quoting tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2868 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:55:53 +00:00
calvin
9c8cee034a quote anchor 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2866 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:50:48 +00:00
calvin
8c809d1dc3 break long line 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2865 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:50:05 +00:00
calvin
25044ce08b print errors in the preferred encoding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2864 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:49:52 +00:00
calvin
c205cec12d remove script tag 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2859 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 20:09:40 +00:00
calvin
4e1bbfea64 adjust yyget_extra definition 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2858 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 16:16:19 +00:00
calvin
9eaf38d563 sane sparse path 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2857 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 16:15:55 +00:00
calvin
9076eaa7da python2.4, add sparse check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2856 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 16:15:00 +00:00
calvin
732366b3f5 add string include for size_t 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2855 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 15:53:32 +00:00
calvin
8953766ccd fix url part quoting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2853 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 14:08:14 +00:00
calvin
2da64736ba remove unneeded init_i18n() calls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2852 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 13:00:33 +00:00
calvin
80b6ba5416 init i18n on module load 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2850 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:52:36 +00:00
calvin
6dd4ac6a65 typo fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2849 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:52:28 +00:00
calvin
7cf3f83c0f better recursion check debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2848 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:39:46 +00:00
calvin
978ba63999 catch UnicodeError on syntax check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2847 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:10:32 +00:00
calvin
fccccac818 coerce to unicode in url_norm if arg was unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2845 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:09:16 +00:00
calvin
8cfcbf075a use archived musi-cal robots.txt page 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2844 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 10:08:58 +00:00
calvin
b48c6f7e96 fix default resolver init 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2843 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 09:55:26 +00:00
calvin
51f541607c catch CGI syntax errors in mailto: URLs and add a warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2841 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 23:06:07 +00:00
calvin
65150ad79e coerce to unicode after relative file handling 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2839 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:50:40 +00:00
calvin
e1192c078f do not append non-parseable meta refresh tags 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2838 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:21:59 +00:00
calvin
2bba7df3e7 handle case where func.__doc__ is None 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2837 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:10:32 +00:00
calvin
57c9f325a9 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2836 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:10:10 +00:00
calvin
5b6782c6a9 handle ignoreX and nofollowY stuff backwards compatible 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2834 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:05:16 +00:00
calvin
5c83b7c859 fix error call 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2833 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:59:46 +00:00
calvin
95081a62e6 remove unused imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2829 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:53:52 +00:00
calvin
ba6a2ed4e0 updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2819 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:15:09 +00:00
calvin
e11bc21593 new methods stripall and limit 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2818 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:14:05 +00:00
calvin
b28be779d7 ensure tags are ASCII, regen with bison 2.0 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2817 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:13:35 +00:00
calvin
4315e77ae1 dont use XXX markers here 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2816 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:12:41 +00:00
calvin
2ba2988d2c Add tests with invalid tag chars 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2815 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:12:12 +00:00
calvin
712df7d743 added quote_val 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2811 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:59:07 +00:00
calvin
a74e728246 ignore loopback interface 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2810 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:58:41 +00:00
calvin
fc4ce83372 dont quote exclams 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2809 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:57:36 +00:00
calvin
2f48855b32 added notimplemented 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2808 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:57:25 +00:00
calvin
da8a4d2cfe dynamic buffer for interface list 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2807 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:56:54 +00:00
calvin
4b697eccea added is_ascii and indent 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2806 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:55:51 +00:00
calvin
866999a883 added more tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2805 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:42:46 +00:00
calvin
37e8e21df6 add notimplemented 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2801 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-11 15:49:34 +00:00
calvin
d0dab1d0ac updated to dnspython 1.3.4 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2792 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-03 19:27:31 +00:00
calvin
33d3a6c974 fix invalid import in DNS resolver 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2790 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-03 18:47:32 +00:00
calvin
fe4395c41f test case for HTTP -> non-HTTP redirection 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2787 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 16:05:20 +00:00
calvin
f01b84b894 rework the redirection routine a little, putting warnings specifically for redirections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2786 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 15:51:12 +00:00
calvin
ed932cb165 debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2785 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 15:50:27 +00:00
calvin
f24bb87e54 add missing return 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2784 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 12:37:32 +00:00
calvin
afa8750dc3 catch ValueError raised by urllib2 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2783 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 09:45:30 +00:00
calvin
317ef181f0 handle all redirections to different URL schemes, 
not just HTTP -> not HTTP, and fix a variable typo


git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2780 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 08:53:57 +00:00
calvin
0d55ea45b7 fix variable clash 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2776 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-18 08:19:11 +00:00
calvin
b94eec79ef use correct value for status output of checked links 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2773 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-17 23:26:13 +00:00
calvin
9fa3a1216c replace 'print' with 'write' 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2772 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-16 07:12:44 +00:00
calvin
c553e233b7 change the custom XML format 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2770 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-16 07:12:15 +00:00
calvin
842333a36f write parent line/col as attrs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2765 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:51:07 +00:00
calvin
c2e235a154 fix end xml tag writing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2763 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:46:13 +00:00
calvin
e2e80367d1 add copyright, add more documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2762 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:41:54 +00:00
calvin
19118a0198 make copyright ASCII 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2761 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:37:45 +00:00
calvin
0b5294ef57 set output encoding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2760 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:37:16 +00:00
calvin
3011eb5ee6 new custom XML logger 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2759 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:33:15 +00:00
calvin
6239880f15 simplify test suite generation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2756 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 14:24:25 +00:00
calvin
d347840dee use official HTTP status names 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2754 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 11:31:32 +00:00
calvin
baf51d1f5d cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2752 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 17:56:05 +00:00
calvin
359612b6fe add missing import 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2751 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 17:53:27 +00:00
calvin
225c045815 do not cache unusual errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2750 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 17:11:13 +00:00
calvin
5d82d64c31 more result sanity check warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2749 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 13:35:18 +00:00
calvin
3fb9de0847 upstream updates 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2748 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 13:34:45 +00:00
calvin
c140b510b1 fix warning tags 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2746 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-13 19:33:26 +00:00
calvin
f80480469f config to ignore certain warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2743 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-13 15:03:17 +00:00
calvin
badb88ed68 use errno constant EPIPE 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2742 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-12 18:36:03 +00:00
calvin
5b5eda36e4 updated from python CVS 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2741 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-12 18:09:15 +00:00
calvin
b559c4f82e test for hierarchical URLs, and retain non-numeric port parts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2739 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-12 07:18:13 +00:00
calvin
907facaf16 put start_server into the try-finally clause 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2738 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-12 07:17:01 +00:00
calvin
34ced03fc2 added more norming tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2737 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 21:58:58 +00:00
calvin
5049e261fe added LOG_DNS 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2734 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 15:37:15 +00:00
calvin
bf9e55c1c8 updated documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2731 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 14:43:52 +00:00
calvin
3ce6aadfd6 updated documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2730 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 14:37:52 +00:00
calvin
e5197d429a added error check macro, and check errors on html_end_tag invocation. Also some documentation updates 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2729 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 12:02:18 +00:00
calvin
5244431a42 add ascii_safe method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2719 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-05 22:06:38 +00:00
calvin
56b2b422a9 ensure that thread name is ascii 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2718 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-05 22:06:18 +00:00
calvin
bb2b227b13 catch all errors on url check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2717 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-05 22:05:54 +00:00
calvin
e7ca18403a work around python bug occuring with incomplete gzip streams 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2716 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-05 19:56:42 +00:00
calvin
901227d436 assign extern info to local var 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2709 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-04 22:19:52 +00:00
calvin
aadd6fd71f fix typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2708 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-04 22:19:22 +00:00
calvin
5f2d11b613 fix logger using extern attribute 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2705 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-04 21:48:55 +00:00
calvin
2e207be127 allow empty relative URLs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2704 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-04 20:28:55 +00:00
calvin
55109f9111 fix log level 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2687 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-03 23:08:26 +00:00
calvin
23707a4471 added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2684 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 13:37:13 +00:00
calvin
f09d54f75b meta tests added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2683 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 13:36:52 +00:00
calvin
10bbe998c7 accept more meta tag urls for checking, eg favicons 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2682 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 13:36:39 +00:00
calvin
506eaa21b5 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2680 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 10:03:04 +00:00
calvin
555e2dc2a4 fixed test output 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2679 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 09:57:31 +00:00
calvin
49aa4ec208 remove unused imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2678 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-27 15:02:10 +00:00
calvin
1df5b81f0e updated test result data 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2677 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-23 16:21:26 +00:00
calvin
0c3e78569c fix norming 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2676 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-23 16:21:05 +00:00
calvin
217d34bb54 use new extern check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2675 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-22 12:30:03 +00:00
calvin
d48eb20a28 support extern filter in ignored url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2672 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-20 14:53:23 +00:00
calvin
990d548424 don't delete from incoming queue while iterating, but after. SF #1223920 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2671 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-20 09:49:27 +00:00
calvin
51e4657cf6 add one more parent path test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-12 21:19:12 +00:00
calvin
ea052008a2 send the complete email address with VRFY command 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2654 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-12 21:17:10 +00:00
calvin
cc0f7cb113 always norm a URL before sending a request 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2653 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-12 21:16:47 +00:00
calvin
eba33c61e6 resync with python 2.4 httplib 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2652 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-12 20:58:09 +00:00
calvin
125707fceb parse combined start/end tags in tag parsers, and added a test for that 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2649 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-09 15:10:29 +00:00
calvin
1b0e300f5d use cache_url_key instead of old get_cache_key() method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2648 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-09 15:08:53 +00:00
calvin
d965a387d5 catch curses setupterm errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2643 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-07 10:38:33 +00:00
calvin
c9239135b1 fix exception test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-02 21:54:41 +00:00
calvin
79d0850fed fix intern url of file: links 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2636 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-22 20:28:59 +00:00
calvin
fec843814c fix intern url of file: links 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2635 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-22 20:27:32 +00:00
calvin
c51a60e0b5 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2627 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 23:02:44 +00:00
calvin
afca416b67 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2625 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 20:25:01 +00:00
calvin
43c6ea202d remove unused 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2624 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:57:12 +00:00
calvin
6d8f0146d6 fix GET fallback handling 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2623 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:53:13 +00:00
calvin
d2107c7a6a split and fix initialization of UrlData objects 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2622 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:42:14 +00:00
calvin
cd32e823df fix url util call 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2621 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:02:52 +00:00
calvin
9666421a10 add log_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2620 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:02:40 +00:00
calvin
1fc5eb32b6 fix extern calculation and a typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2619 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:02:16 +00:00
calvin
f6f04e376e fix extern calculation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2618 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:01:51 +00:00
calvin
d6e56ceba2 remove lock from check_url in case of disabled threading 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2617 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 18:30:06 +00:00
calvin
3407ab362d syntax 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2616 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 18:29:38 +00:00
calvin
55d7d5f7df use a decorator to synchronize all the checker threads 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2614 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 15:49:06 +00:00
calvin
3f6d2fa753 specify thread name 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2613 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 22:16:23 +00:00
calvin
781ad5fdc0 catch exceptions on abort 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2612 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 22:15:54 +00:00
calvin
fd652881fb thread name and maximum wait for finish 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 22:15:18 +00:00
calvin
3db056f161 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2610 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 22:14:45 +00:00
calvin
4c270cfe74 log message formatting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2609 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 18:04:54 +00:00