calvin
|
7a31cb7ede
|
add tests for file output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3351 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-05 19:47:09 +00:00 |
|
calvin
|
7781fe88ce
|
use relative imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3350 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-05 19:46:47 +00:00 |
|
calvin
|
7667f3402f
|
send short keep-alive header value for test server
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3349 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-05 19:46:23 +00:00 |
|
calvin
|
e8e6a8af9a
|
set modified time after parsing of robots.txt entries
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3348 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-05 19:44:59 +00:00 |
|
calvin
|
cf75e543b3
|
use self.filename, not args['filename'] in __init__()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3347 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-05 19:44:30 +00:00 |
|
calvin
|
12946ec9f7
|
more test coverage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3344 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-05 13:30:54 +00:00 |
|
calvin
|
43c0e3447a
|
reduce wait/sleep time for URL queue getting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3341 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-04 23:51:32 +00:00 |
|
calvin
|
19a7495b9e
|
only accept ASCII robots.txt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3339 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-04 21:07:08 +00:00 |
|
calvin
|
d95d8c3d96
|
correctly handle internal errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3338 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-03 01:14:05 +00:00 |
|
calvin
|
21b53215e4
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3337 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-01 14:13:12 +00:00 |
|
calvin
|
997e686a69
|
no exit on internal errors in threads
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3336 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-01 14:13:04 +00:00 |
|
calvin
|
a57618a4ad
|
use relative imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3335 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-01 14:06:19 +00:00 |
|
calvin
|
c3fa9d7965
|
don't generate empty output files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3332 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-01 13:58:13 +00:00 |
|
calvin
|
677458b8d6
|
fix imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3330 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-06-01 13:54:55 +00:00 |
|
calvin
|
8763a42063
|
skip a test on nt platforms
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3327 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-29 16:08:37 +00:00 |
|
calvin
|
4f668b8f90
|
added file norm tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3326 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-29 14:22:37 +00:00 |
|
calvin
|
850684b1e0
|
datadir as url path
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3325 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-29 14:00:45 +00:00 |
|
calvin
|
2888c34859
|
split file tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3324 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-29 13:54:40 +00:00 |
|
calvin
|
5b8b2cbda1
|
use diff for file compare
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3323 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-29 13:43:10 +00:00 |
|
calvin
|
2e1102a1b5
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3322 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-29 12:57:51 +00:00 |
|
calvin
|
f5f7007c34
|
added abstract run_checked()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3316 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-25 14:25:04 +00:00 |
|
calvin
|
b442809838
|
look that cached URLs get checked quickly in large queues
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3315 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-25 11:35:24 +00:00 |
|
calvin
|
e211d3fd6c
|
fix internal error call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3314 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-25 11:33:23 +00:00 |
|
calvin
|
694f05405a
|
translate interrupt message, and check for changed signal handler
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3313 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-25 11:33:01 +00:00 |
|
calvin
|
cb853c4672
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3312 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-25 11:32:32 +00:00 |
|
calvin
|
4c8dcb012b
|
added a stoppable thread object
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3305 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-24 22:29:22 +00:00 |
|
calvin
|
c91ccc56d6
|
add and use a stoppable thread object
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3303 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-24 22:16:36 +00:00 |
|
calvin
|
c3afa5c9c6
|
improved tmieit decorator
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3299 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-24 16:54:47 +00:00 |
|
calvin
|
b898cc05d3
|
added§
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3298 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-24 16:54:37 +00:00 |
|
calvin
|
e7107bc270
|
return function result in timeit decorator
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3297 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-24 16:52:45 +00:00 |
|
calvin
|
1974bdcaf1
|
use xrange
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3296 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-24 16:52:39 +00:00 |
|
calvin
|
d557b0208f
|
whops, reintroduce url_data.url is None check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3295 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-24 00:00:33 +00:00 |
|
calvin
|
f30964679c
|
remove return in __init__
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3294 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-23 23:59:09 +00:00 |
|
calvin
|
f746b29522
|
documentation added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3292 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-23 22:04:30 +00:00 |
|
calvin
|
27997b0251
|
add a finish() method to wait for spawned threads to finish
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3290 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-23 19:55:35 +00:00 |
|
calvin
|
7a94995345
|
remove unused condition
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3289 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-23 19:51:22 +00:00 |
|
calvin
|
49a21901f9
|
raise correct Empty()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3288 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-23 18:57:26 +00:00 |
|
calvin
|
eaf1fd4ba1
|
use timeout for get() method, return thread object
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3286 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-23 16:33:09 +00:00 |
|
calvin
|
a1905bdb22
|
support timeout in get() method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3285 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-23 16:33:00 +00:00 |
|
calvin
|
5eec9cf527
|
update from subversion repo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3284 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-23 16:32:50 +00:00 |
|
calvin
|
97e20ccdd4
|
move status method to status package
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3283 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-22 21:35:41 +00:00 |
|
calvin
|
ff1e16230b
|
wait until status thread is finished
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3282 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-22 21:35:20 +00:00 |
|
calvin
|
e51bd72957
|
use xrange
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3280 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-19 23:02:46 +00:00 |
|
calvin
|
98597c267d
|
quote result line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3272 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-19 17:21:20 +00:00 |
|
calvin
|
3142663135
|
added tests for UnicodeError 'label too long'
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3270 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-19 17:13:28 +00:00 |
|
calvin
|
7e1e01bd36
|
do not catch UnicodeError, handle that intern
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3269 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-19 17:13:16 +00:00 |
|
calvin
|
2c13d7cac1
|
norm test urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3267 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 21:43:55 +00:00 |
|
calvin
|
608f8ba1c3
|
prepare filenames as URLs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3266 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 21:38:57 +00:00 |
|
calvin
|
37615dba02
|
use datadir, curdir placeholders
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3265 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 21:35:52 +00:00 |
|
calvin
|
14a29fb015
|
prepare filenames as URLs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3264 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 21:35:36 +00:00 |
|
calvin
|
0ba1520d13
|
fix filename for test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3263 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 21:14:30 +00:00 |
|
calvin
|
1dbc97abe7
|
script moving
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3262 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 21:10:16 +00:00 |
|
calvin
|
23879d78d4
|
adjust test result for new cache optimization
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3259 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 19:14:54 +00:00 |
|
calvin
|
cd8886c77f
|
adjust test results for optimized cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3258 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 18:55:03 +00:00 |
|
calvin
|
7f408cce19
|
fix the self.in_progress optimization
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3257 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 18:54:41 +00:00 |
|
calvin
|
d43acde696
|
added cookie parse tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3251 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 16:31:49 +00:00 |
|
calvin
|
06956060b5
|
added documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3250 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 16:31:33 +00:00 |
|
calvin
|
003532e20f
|
put in-progress URLs back to the top of the URL queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3248 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-18 16:16:19 +00:00 |
|
calvin
|
17555e2fa6
|
use configured timeout on abort, interrupt main
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3241 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 20:19:40 +00:00 |
|
calvin
|
74327404a4
|
ensure the signal module is available
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3240 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 20:19:13 +00:00 |
|
calvin
|
faddd9acc3
|
catch Timeout from abort
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3239 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 19:56:14 +00:00 |
|
calvin
|
781ccf96c1
|
add irc scheme to netloc using schemes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3238 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 19:12:29 +00:00 |
|
calvin
|
2ec5c054fe
|
merge ignoredurl and errorurl into unknownurl, updated tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3237 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 19:08:40 +00:00 |
|
calvin
|
a4e9b8eab1
|
fix debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3236 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 16:24:53 +00:00 |
|
calvin
|
4ec74f6f5c
|
added robots.txt tests for the internal HTTP server
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3232 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 15:47:48 +00:00 |
|
calvin
|
4bf2b361cb
|
added more crawldelay tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3230 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 15:36:34 +00:00 |
|
calvin
|
e574a97798
|
raise ValueError if wait delay is a negative value
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3229 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 15:36:27 +00:00 |
|
calvin
|
7dce5c4df9
|
fix callback call for crawldelay
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3228 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 15:36:09 +00:00 |
|
calvin
|
3adaf48b3d
|
add callback for crawldelay
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3227 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 15:35:58 +00:00 |
|
calvin
|
a741d7922c
|
add get_crawldelay method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3226 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-17 15:35:48 +00:00 |
|
calvin
|
fb319b3785
|
add callback after robots.txt parse
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3225 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 23:19:18 +00:00 |
|
calvin
|
2aed0f3bc5
|
add per-host wait times
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3224 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 23:03:44 +00:00 |
|
calvin
|
811f5492c4
|
fix --pause to delay requests to the same host
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3222 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 22:56:13 +00:00 |
|
calvin
|
ad28599e57
|
Note if URL is missing (instead of saying it is empty)
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3220 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 22:15:34 +00:00 |
|
calvin
|
00a60c6906
|
check if urldata.url is None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3219 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 22:14:34 +00:00 |
|
calvin
|
224f5e723b
|
don't find link name in empty urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3218 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 22:05:17 +00:00 |
|
calvin
|
72c718b7d5
|
added robots.txt parse test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3212 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 21:29:31 +00:00 |
|
calvin
|
d73aa0e5bd
|
parse crawl-delay parameter line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3211 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 21:29:18 +00:00 |
|
calvin
|
75e88c062a
|
added --cookiefile option to set initial cookie values
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3210 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 20:56:34 +00:00 |
|
calvin
|
c6b5759c39
|
print thread name on trace
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3206 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 17:00:49 +00:00 |
|
calvin
|
0bb2970222
|
remove old consumer code
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3205 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 17:00:27 +00:00 |
|
calvin
|
b6ad3084aa
|
added more anchor tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3201 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 16:22:56 +00:00 |
|
calvin
|
7c8ab1b6f7
|
No maximum size due to possible deadlocks.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3195 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-16 16:14:42 +00:00 |
|
calvin
|
e8bf93bd90
|
inherit from StandardError, not from Exception
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3194 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 22:22:24 +00:00 |
|
calvin
|
c10da15b08
|
add timeout setting to configuration file
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3192 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 19:04:21 +00:00 |
|
calvin
|
61fc7ab502
|
since join() is not interruptable, put in a little sleep() call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3191 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:36:55 +00:00 |
|
calvin
|
ca8ea4a2be
|
print in-progress URLs on status
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3189 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:35:37 +00:00 |
|
calvin
|
ac682df355
|
be precise for threads: zero threads disable threading
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3188 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:35:16 +00:00 |
|
calvin
|
b3b45d7f06
|
add Timeout exception, and return in_progress URLs on status instead of unfinished
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3187 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:34:30 +00:00 |
|
calvin
|
b1e7ca58a2
|
remove unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3186 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:33:38 +00:00 |
|
calvin
|
dc62353ca2
|
don't catch SystemExit, and no bare except
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3185 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:06:44 +00:00 |
|
calvin
|
ffe233c2eb
|
don't catch SystemExit, and no bare except
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3184 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:05:52 +00:00 |
|
calvin
|
938d193446
|
store timeout in configuration
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3183 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:05:17 +00:00 |
|
calvin
|
c8bcdf7d79
|
remove unused threader class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3182 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:02:07 +00:00 |
|
calvin
|
70fedc052c
|
replace bare excepts with ones catching StandardError
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3181 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-15 18:01:29 +00:00 |
|
calvin
|
df8af83508
|
use debug lock class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3179 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 19:58:55 +00:00 |
|
calvin
|
ab1ba455f6
|
make lock class just a debug wrapper
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3178 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 19:58:46 +00:00 |
|
calvin
|
ffeaa3484e
|
add debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3177 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 18:03:59 +00:00 |
|
calvin
|
df7a2076a9
|
cache DNS lookups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3176 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 18:03:23 +00:00 |
|
calvin
|
afdccbaa80
|
set names of worker and status threads
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3175 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 17:50:36 +00:00 |
|
calvin
|
523e6e8e43
|
use variables in result lines
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3174 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 17:49:58 +00:00 |
|
calvin
|
91ff370ed7
|
on redirection to different URL scheme take caching into account; adjust tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3173 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 17:47:50 +00:00 |
|
calvin
|
2a336f8dad
|
put redirects in url queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3172 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 17:01:41 +00:00 |
|
calvin
|
2cfcb5c0bb
|
avoid double timeouts by raising timeout errors in robots.txt retrieval
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3171 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 12:58:31 +00:00 |
|
calvin
|
9a431fde40
|
fix imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3170 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 10:14:07 +00:00 |
|
calvin
|
5ba1324a73
|
an intern pattern matches both http and https URLs now
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3169 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 10:06:33 +00:00 |
|
calvin
|
853f1d7f51
|
always disable status thread after checking, and log end of output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3165 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 08:41:52 +00:00 |
|
calvin
|
ddf3703962
|
put status printing in a separate module, with a flag that can be disabled
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3163 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-14 08:29:44 +00:00 |
|
calvin
|
53e1bd993e
|
fix test output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3162 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 21:25:59 +00:00 |
|
calvin
|
dc9f04e6dc
|
adjust debug asserts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3159 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 21:03:21 +00:00 |
|
calvin
|
2947b4710d
|
quote slashes in cgi values
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3158 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 20:52:30 +00:00 |
|
calvin
|
857582c026
|
honor case where fallback class is not given
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3157 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 20:51:11 +00:00 |
|
calvin
|
ee0a7bb824
|
don't return True on debug, add shutdown method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3156 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 20:50:52 +00:00 |
|
calvin
|
67f39e516c
|
synchronize the log method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3152 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 18:53:41 +00:00 |
|
calvin
|
0d39d6139f
|
no active tasks in status
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3150 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 18:15:40 +00:00 |
|
calvin
|
7afe60c841
|
removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3149 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 18:08:35 +00:00 |
|
calvin
|
98a6d1eb00
|
added missing import
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3148 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 18:08:06 +00:00 |
|
calvin
|
b0c189d143
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3147 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 18:07:46 +00:00 |
|
calvin
|
f002c5f965
|
Replace the old threading algorithm with a new one based on Queue.Queue and consumer threads
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3146 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 13:44:52 +00:00 |
|
calvin
|
d05c68ef74
|
added path encoding
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3145 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 13:41:46 +00:00 |
|
calvin
|
c33e6d5907
|
split up invalid* tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3144 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 13:41:10 +00:00 |
|
calvin
|
3e8a221110
|
acquire locks directly
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3143 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 13:40:22 +00:00 |
|
calvin
|
bfd52936a6
|
fix config parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3142 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 09:53:53 +00:00 |
|
calvin
|
ac9d88cd99
|
added config test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3141 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-13 09:51:50 +00:00 |
|
calvin
|
394abbbab5
|
fix imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3137 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-12 14:51:09 +00:00 |
|
calvin
|
d667abac69
|
Don't encode the host header with idna if not necessary. Taken from Python subversion trunk.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3136 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-04 18:24:23 +00:00 |
|
calvin
|
c2f5d222e1
|
split off configuration parsing in a separate class, put config stuff into its own module directory
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3135 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-03 18:24:46 +00:00 |
|
calvin
|
d547b0ee31
|
fix mail tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3134 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-03 17:00:08 +00:00 |
|
calvin
|
0bd43753d3
|
remove old resource check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3133 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-03 16:59:58 +00:00 |
|
calvin
|
c35737ff3a
|
use new long duration format
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3132 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-03 16:39:01 +00:00 |
|
calvin
|
58993644d8
|
use format_time from quodlibet source
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3131 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-05-03 16:35:37 +00:00 |
|
calvin
|
4b10271233
|
use unittest.TestCase for standard test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3129 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-24 20:16:57 +00:00 |
|
calvin
|
f9a59e616d
|
added caseless dict classes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3128 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-24 20:13:29 +00:00 |
|
calvin
|
bae6c90f43
|
documentation cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3127 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-24 20:12:53 +00:00 |
|
calvin
|
a764b1484b
|
import cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3126 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-24 20:12:40 +00:00 |
|
calvin
|
b4d4b2ed94
|
cast to size_t
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3122 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-11 23:53:25 +00:00 |
|
calvin
|
787d9143fe
|
don't call write_color with None argument
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3120 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-08 10:26:15 +00:00 |
|
calvin
|
31e853e0d7
|
remove unnecessary global statements
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3119 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-08 09:02:14 +00:00 |
|
calvin
|
02ecf152c6
|
syntax cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3118 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-08 09:01:49 +00:00 |
|
calvin
|
cce1d273a7
|
really return value
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3117 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-08 09:00:44 +00:00 |
|
calvin
|
4845e926a9
|
always use default locale for translation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3116 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-08 09:00:23 +00:00 |
|
calvin
|
4f67591327
|
no bare excepts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3115 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-08 08:59:52 +00:00 |
|
calvin
|
2544c90708
|
fix detection of </script>
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3113 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-08 08:58:31 +00:00 |
|
calvin
|
6dacc9bf61
|
use has_* flags for resource availability
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3112 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-08 08:57:52 +00:00 |
|
calvin
|
78dfb4c293
|
whitespace normalization
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3106 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 19:15:07 +00:00 |
|
calvin
|
b503ea15f4
|
updated cgi tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3105 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 19:14:49 +00:00 |
|
calvin
|
9f7dde02f8
|
use WConio on Windows for colored output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3104 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 19:14:15 +00:00 |
|
calvin
|
db223a1912
|
write label for graph
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3103 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 19:13:41 +00:00 |
|
calvin
|
38b83415dd
|
correctly replace spaces in cgi params
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3102 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 19:12:43 +00:00 |
|
calvin
|
893300308c
|
updated time format tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3101 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 19:12:30 +00:00 |
|
calvin
|
0132e4ca89
|
better time formatting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3100 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 19:05:45 +00:00 |
|
calvin
|
1cd74500ee
|
no literal </script>, accept empty SGML comments, compress equivalence classes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3099 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 19:04:40 +00:00 |
|
calvin
|
e42f1a0cec
|
replace sf.net with sourceforge.net
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3094 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-04-03 16:35:39 +00:00 |
|
calvin
|
df66edb7c3
|
allow empty comment in HTML parser
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3091 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-03-10 10:48:25 +00:00 |
|
calvin
|
aeb698cbec
|
add localhost to local interface list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3090 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-03-10 10:48:07 +00:00 |
|
calvin
|
1d724a034a
|
Construct equivalence classes in flex scanner
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3089 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-03-09 22:38:51 +00:00 |
|
calvin
|
1bf4fac474
|
removed .cvsignore
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3086 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-24 20:09:03 +00:00 |
|
calvin
|
00310425ac
|
updated copyright template
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3081 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-17 23:38:12 +00:00 |
|
calvin
|
68a4d32212
|
rename _synchronized in synchronize
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3079 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-16 19:47:37 +00:00 |
|
calvin
|
46ed49d148
|
ensure log output is unicode
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3075 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-13 21:49:25 +00:00 |
|
calvin
|
276437c7d8
|
syntax cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3067 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-09 07:57:22 +00:00 |
|
calvin
|
287ec3b960
|
syntax
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3060 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-04 09:15:11 +00:00 |
|
calvin
|
e56215235c
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3058 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-03 23:58:30 +00:00 |
|
calvin
|
c334b8db13
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3056 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-03 23:21:20 +00:00 |
|
calvin
|
1e0581e718
|
use iter* dict methods
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3054 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-03 22:15:41 +00:00 |
|
calvin
|
2788fc2a59
|
add modification time information functions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3052 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-03 20:42:56 +00:00 |
|
calvin
|
6cda627f0f
|
more tests added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3046 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-03 17:06:25 +00:00 |
|
calvin
|
2880274744
|
more test coverage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3045 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 23:31:39 +00:00 |
|
calvin
|
38a7b15aeb
|
accept a dict as lru init val
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3044 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 23:00:03 +00:00 |
|
calvin
|
902949f27e
|
some format fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3043 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 22:59:42 +00:00 |
|
calvin
|
fac0b0f793
|
remove unused quote_val method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3042 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 22:58:40 +00:00 |
|
calvin
|
3f6ac53fff
|
added tests for more coverage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3041 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 22:58:11 +00:00 |
|
calvin
|
3a5f06cfa9
|
remove unused strip_quotes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3040 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 21:53:11 +00:00 |
|
calvin
|
a3e4780b38
|
quote attributes with unicode entity escapes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3039 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 21:40:57 +00:00 |
|
calvin
|
75be4d0bb6
|
fix entity resolving
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3038 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 21:40:02 +00:00 |
|
calvin
|
cbef33ec5e
|
fix parsing of hexadecimal entities
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3037 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 20:06:59 +00:00 |
|
calvin
|
94e083315b
|
allow escaped quotes in tag attributes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3036 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-02 20:05:59 +00:00 |
|
calvin
|
9fd7b24344
|
check return value of acquire()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3034 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-01 19:48:22 +00:00 |
|
calvin
|
b6c947442a
|
documentation fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3033 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-01 19:48:02 +00:00 |
|
calvin
|
1df673a79d
|
add url_unsplit method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3029 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-01 18:56:20 +00:00 |
|
calvin
|
5a4f1248c3
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3028 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-01 18:56:04 +00:00 |
|
calvin
|
0a257847e3
|
add a Buffer class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3026 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-01 18:55:40 +00:00 |
|
calvin
|
6c14cf1d8b
|
syntax
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3025 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-01 18:54:11 +00:00 |
|
calvin
|
a2ed1b323f
|
do not lowercase the absolute url, caused the URL matching not to work for URLs with uppercase characters
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3022 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-02-01 18:49:31 +00:00 |
|
calvin
|
0681b1889f
|
limit amount of read chunks, and cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3017 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-11 22:03:58 +00:00 |
|
calvin
|
0bb41a5ec3
|
do no print warning about different dns message ids
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3016 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-06 22:32:42 +00:00 |
|
calvin
|
bb3dac673f
|
added coding line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3015 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-06 15:04:29 +00:00 |
|
calvin
|
fc5e34b216
|
added more decorators
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3014 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-06 15:02:50 +00:00 |
|
calvin
|
e94c61529b
|
catch value error on codec lookup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3013 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-06 15:02:32 +00:00 |
|
calvin
|
48cdfd32ee
|
fix tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3011 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-04 01:20:20 +00:00 |
|
calvin
|
e92aee054c
|
updated copyright
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3010 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-03 19:12:47 +00:00 |
|
calvin
|
fe24c56e84
|
only split host ports on known schemes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3009 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-03 18:37:42 +00:00 |
|
calvin
|
b4748cdcee
|
back out decorator change
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3002 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-03 01:09:23 +00:00 |
|
calvin
|
bc846a20ff
|
use own splitport method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3001 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-02 14:26:24 +00:00 |
|
calvin
|
6b6adab12f
|
new decorator_with_args helper
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3000 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2006-01-02 14:25:50 +00:00 |
|
calvin
|
388475cbe2
|
new-style exceptions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2999 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-20 20:17:33 +00:00 |
|
calvin
|
7b3949eebf
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2996 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-20 09:09:32 +00:00 |
|
calvin
|
8d67ee35ef
|
removed is_safe_js_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2995 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-20 09:08:51 +00:00 |
|
calvin
|
a24fd65943
|
always quote port value
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2992 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-19 14:08:34 +00:00 |
|
calvin
|
815fb9da83
|
more tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2991 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-19 14:06:53 +00:00 |
|
calvin
|
c84a33c7ce
|
syntax fix
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2988 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 09:13:23 +00:00 |
|
calvin
|
856ff8ef2a
|
assert debugs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2987 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:55:42 +00:00 |
|
calvin
|
aec847e570
|
assert debug
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2986 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:46:48 +00:00 |
|
calvin
|
1cec04018f
|
cleanup unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2985 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:40:22 +00:00 |
|
calvin
|
19c0a3c2ed
|
use new cookie parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2983 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:19:11 +00:00 |
|
calvin
|
5eb3061ee0
|
added new cookie parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2982 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:18:32 +00:00 |
|
calvin
|
a22d055d0b
|
make debug() function assert'able
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2981 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:17:18 +00:00 |
|
calvin
|
d28567753b
|
add is_encoding() method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2980 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:16:36 +00:00 |
|
calvin
|
cff9b1341b
|
improved charset parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2979 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:16:25 +00:00 |
|
calvin
|
24e91ffaaf
|
fix info logging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2978 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-18 08:15:49 +00:00 |
|
calvin
|
d7a4a08659
|
updated tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2974 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-17 19:22:44 +00:00 |
|
calvin
|
3b1b95af5a
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2970 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-17 19:18:08 +00:00 |
|
calvin
|
9425873830
|
cache aliases (from redirects)
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2964 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-08 20:20:21 +00:00 |
|
calvin
|
43fb20371f
|
new tagged infos
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2963 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-08 20:20:04 +00:00 |
|
calvin
|
b34f4da7fe
|
better error message if no nameservers could be found
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2962 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-08 20:19:48 +00:00 |
|
calvin
|
47b4a52134
|
removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2958 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-08 17:14:39 +00:00 |
|
calvin
|
791bd87f6d
|
use LinkCheckTest
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2956 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-08 17:08:08 +00:00 |
|
calvin
|
ee2d4e6ead
|
moved ftests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2954 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-07 22:40:19 +00:00 |
|
calvin
|
4cf6f29afe
|
unused import removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2953 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-07 22:40:09 +00:00 |
|
calvin
|
26ccd4d81c
|
fix func name typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2952 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-07 22:39:17 +00:00 |
|
calvin
|
329043bc9f
|
use datadir
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2951 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-07 22:33:14 +00:00 |
|
calvin
|
98e3e26644
|
moved
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2950 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-07 22:32:48 +00:00 |
|
calvin
|
ddb09ab76a
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2949 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-07 21:55:16 +00:00 |
|
calvin
|
c86c0870d6
|
debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2946 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-06 22:32:31 +00:00 |
|
calvin
|
b733ffdb2a
|
remove has_incoming, debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2945 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-06 22:32:14 +00:00 |
|
calvin
|
3c03728d29
|
add update_meta utility func
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2942 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-06 17:10:17 +00:00 |
|
calvin
|
b482d35656
|
fix exception name and add 0.0.0.0 to localhost list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2941 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-12-06 11:47:38 +00:00 |
|
calvin
|
99c0382781
|
add timeit decorator
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2940 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-14 22:50:44 +00:00 |
|
calvin
|
e2a454e31f
|
use new trace module
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2939 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-14 22:49:37 +00:00 |
|
calvin
|
ae508129f1
|
move trace into separate module
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2938 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-14 22:49:22 +00:00 |
|
calvin
|
7d1ea45be6
|
rebuild with bison 2.1
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2937 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-14 22:47:30 +00:00 |
|
calvin
|
bcbbe6ff60
|
allow https js urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2935 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-12 19:56:46 +00:00 |
|
calvin
|
a4cfa10fdf
|
better comment parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2934 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-12 19:56:31 +00:00 |
|
calvin
|
f65cfb87f9
|
fix tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2933 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-12 19:56:01 +00:00 |
|
calvin
|
065665a0f1
|
rename builtins
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2932 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-12 19:55:54 +00:00 |
|
calvin
|
77ed566471
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2931 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-09 07:46:22 +00:00 |
|
calvin
|
9eab0056ac
|
encode url query
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2930 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-09 07:46:05 +00:00 |
|
calvin
|
e29efc31fa
|
more checkes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2928 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-04 20:06:29 +00:00 |
|
calvin
|
c049837cdd
|
remove parser messages
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2927 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-04 20:05:59 +00:00 |
|
calvin
|
de2e66e713
|
remove parser errors/warnings, and better error detection
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2926 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-04 20:05:35 +00:00 |
|
calvin
|
dffe4f906e
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2925 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-03 16:56:28 +00:00 |
|
calvin
|
35f1172481
|
count errors in tests, and add some more cases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2924 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-03 16:56:12 +00:00 |
|
calvin
|
b8aa3009d8
|
store a list of errors, and add more error messages to the parser
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2923 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-03 16:53:26 +00:00 |
|
calvin
|
7d5be699df
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2922 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-02 13:49:03 +00:00 |
|
calvin
|
0dca65accf
|
depend on python >= 2.4
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2921 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-11-02 13:48:53 +00:00 |
|
calvin
|
7e90eccc84
|
dnspython 1.3.5 merged
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2920 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-31 08:59:29 +00:00 |
|
calvin
|
df34e1a8e9
|
remove unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2919 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-25 13:48:30 +00:00 |
|
calvin
|
1d891fffec
|
fix typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2918 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-25 13:47:45 +00:00 |
|
calvin
|
fa3d35beff
|
beautify equals check msg
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2917 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-25 13:47:28 +00:00 |
|
calvin
|
c2b4132eb9
|
ensure html attr values are strings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2915 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-25 13:47:03 +00:00 |
|
calvin
|
e3beb86ac1
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2911 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-17 12:18:18 +00:00 |
|
calvin
|
c9f5d1a0b1
|
catch gzip errors, and use linkchecker debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2910 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-15 00:06:48 +00:00 |
|
calvin
|
041df3a48d
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2906 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 22:54:23 +00:00 |
|
calvin
|
a2e422ce0d
|
reindent
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2900 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 22:26:12 +00:00 |
|
calvin
|
96f4f946b2
|
remove unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2898 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 21:29:17 +00:00 |
|
calvin
|
d83720f05d
|
do not parse any invalid config files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2895 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 21:15:31 +00:00 |
|
calvin
|
8ce45149fa
|
re-add nofollow check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2890 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 20:49:56 +00:00 |
|
calvin
|
93c498699d
|
disable keyboard interrupt and SystemExit while aborting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2888 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 20:11:36 +00:00 |
|
calvin
|
9e560f9ccf
|
only return on thread wait timeout
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2887 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 20:08:14 +00:00 |
|
calvin
|
c585d095b4
|
catch SystemExit from internal errors in subthreads, and eliminate abort wrapper
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2886 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 20:06:57 +00:00 |
|
calvin
|
5303f94b76
|
ensure proxy value syntax
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2883 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 17:59:20 +00:00 |
|
calvin
|
50ea41b12d
|
use preferred locale for default encoding
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2878 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 17:22:12 +00:00 |
|
calvin
|
753b907d51
|
remove unneeded imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2871 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 12:56:57 +00:00 |
|
calvin
|
66a30acc2d
|
assume cStringIO is there
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2870 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 12:56:22 +00:00 |
|
calvin
|
6ca5dea8c3
|
define fs var
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2869 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 12:56:07 +00:00 |
|
calvin
|
19a290d81a
|
query and anchor quoting tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2868 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 12:55:53 +00:00 |
|
calvin
|
9c8cee034a
|
quote anchor
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2866 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 12:50:48 +00:00 |
|
calvin
|
8c809d1dc3
|
break long line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2865 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 12:50:05 +00:00 |
|
calvin
|
25044ce08b
|
print errors in the preferred encoding
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2864 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-13 12:49:52 +00:00 |
|
calvin
|
c205cec12d
|
remove script tag
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2859 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 20:09:40 +00:00 |
|
calvin
|
4e1bbfea64
|
adjust yyget_extra definition
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2858 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 16:16:19 +00:00 |
|
calvin
|
9eaf38d563
|
sane sparse path
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2857 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 16:15:55 +00:00 |
|
calvin
|
9076eaa7da
|
python2.4, add sparse check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2856 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 16:15:00 +00:00 |
|
calvin
|
732366b3f5
|
add string include for size_t
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2855 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 15:53:32 +00:00 |
|
calvin
|
8953766ccd
|
fix url part quoting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2853 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 14:08:14 +00:00 |
|
calvin
|
2da64736ba
|
remove unneeded init_i18n() calls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2852 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 13:00:33 +00:00 |
|
calvin
|
80b6ba5416
|
init i18n on module load
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2850 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 12:52:36 +00:00 |
|
calvin
|
6dd4ac6a65
|
typo fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2849 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 12:52:28 +00:00 |
|
calvin
|
7cf3f83c0f
|
better recursion check debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2848 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 12:39:46 +00:00 |
|
calvin
|
978ba63999
|
catch UnicodeError on syntax check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2847 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 12:10:32 +00:00 |
|
calvin
|
fccccac818
|
coerce to unicode in url_norm if arg was unicode
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2845 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 12:09:16 +00:00 |
|
calvin
|
8cfcbf075a
|
use archived musi-cal robots.txt page
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2844 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 10:08:58 +00:00 |
|
calvin
|
b48c6f7e96
|
fix default resolver init
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2843 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-11 09:55:26 +00:00 |
|
calvin
|
51f541607c
|
catch CGI syntax errors in mailto: URLs and add a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2841 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 23:06:07 +00:00 |
|
calvin
|
65150ad79e
|
coerce to unicode after relative file handling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2839 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 22:50:40 +00:00 |
|
calvin
|
e1192c078f
|
do not append non-parseable meta refresh tags
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2838 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 22:21:59 +00:00 |
|
calvin
|
2bba7df3e7
|
handle case where func.__doc__ is None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2837 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 22:10:32 +00:00 |
|
calvin
|
57c9f325a9
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2836 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 22:10:10 +00:00 |
|
calvin
|
5b6782c6a9
|
handle ignoreX and nofollowY stuff backwards compatible
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2834 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 22:05:16 +00:00 |
|
calvin
|
5c83b7c859
|
fix error call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2833 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 21:59:46 +00:00 |
|
calvin
|
95081a62e6
|
remove unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2829 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 21:53:52 +00:00 |
|
calvin
|
ba6a2ed4e0
|
updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2819 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 21:15:09 +00:00 |
|
calvin
|
e11bc21593
|
new methods stripall and limit
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2818 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 21:14:05 +00:00 |
|
calvin
|
b28be779d7
|
ensure tags are ASCII, regen with bison 2.0
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2817 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 21:13:35 +00:00 |
|
calvin
|
4315e77ae1
|
dont use XXX markers here
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2816 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 21:12:41 +00:00 |
|
calvin
|
2ba2988d2c
|
Add tests with invalid tag chars
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2815 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-10-10 21:12:12 +00:00 |
|
calvin
|
712df7d743
|
added quote_val
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2811 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-16 13:59:07 +00:00 |
|
calvin
|
a74e728246
|
ignore loopback interface
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2810 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-16 13:58:41 +00:00 |
|
calvin
|
fc4ce83372
|
dont quote exclams
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2809 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-16 13:57:36 +00:00 |
|
calvin
|
2f48855b32
|
added notimplemented
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2808 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-16 13:57:25 +00:00 |
|
calvin
|
da8a4d2cfe
|
dynamic buffer for interface list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2807 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-16 13:56:54 +00:00 |
|
calvin
|
4b697eccea
|
added is_ascii and indent
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2806 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-16 13:55:51 +00:00 |
|
calvin
|
866999a883
|
added more tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2805 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-16 13:42:46 +00:00 |
|
calvin
|
37e8e21df6
|
add notimplemented
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2801 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-11 15:49:34 +00:00 |
|
calvin
|
d0dab1d0ac
|
updated to dnspython 1.3.4
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2792 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-03 19:27:31 +00:00 |
|
calvin
|
33d3a6c974
|
fix invalid import in DNS resolver
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2790 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-08-03 18:47:32 +00:00 |
|
calvin
|
fe4395c41f
|
test case for HTTP -> non-HTTP redirection
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2787 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-20 16:05:20 +00:00 |
|
calvin
|
f01b84b894
|
rework the redirection routine a little, putting warnings specifically for redirections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2786 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-20 15:51:12 +00:00 |
|
calvin
|
ed932cb165
|
debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2785 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-20 15:50:27 +00:00 |
|
calvin
|
f24bb87e54
|
add missing return
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2784 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-20 12:37:32 +00:00 |
|
calvin
|
afa8750dc3
|
catch ValueError raised by urllib2
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2783 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-20 09:45:30 +00:00 |
|
calvin
|
317ef181f0
|
handle all redirections to different URL schemes,
not just HTTP -> not HTTP, and fix a variable typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2780 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-20 08:53:57 +00:00 |
|
calvin
|
0d55ea45b7
|
fix variable clash
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2776 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-18 08:19:11 +00:00 |
|
calvin
|
b94eec79ef
|
use correct value for status output of checked links
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2773 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-17 23:26:13 +00:00 |
|
calvin
|
9fa3a1216c
|
replace 'print' with 'write'
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2772 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-16 07:12:44 +00:00 |
|
calvin
|
c553e233b7
|
change the custom XML format
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2770 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-16 07:12:15 +00:00 |
|
calvin
|
842333a36f
|
write parent line/col as attrs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2765 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-15 21:51:07 +00:00 |
|
calvin
|
c2e235a154
|
fix end xml tag writing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2763 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-15 21:46:13 +00:00 |
|
calvin
|
e2e80367d1
|
add copyright, add more documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2762 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-15 21:41:54 +00:00 |
|
calvin
|
19118a0198
|
make copyright ASCII
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2761 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-15 21:37:45 +00:00 |
|
calvin
|
0b5294ef57
|
set output encoding
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2760 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-15 21:37:16 +00:00 |
|
calvin
|
3011eb5ee6
|
new custom XML logger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2759 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-15 21:33:15 +00:00 |
|
calvin
|
6239880f15
|
simplify test suite generation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2756 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-15 14:24:25 +00:00 |
|
calvin
|
d347840dee
|
use official HTTP status names
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2754 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-15 11:31:32 +00:00 |
|
calvin
|
baf51d1f5d
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2752 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-14 17:56:05 +00:00 |
|
calvin
|
359612b6fe
|
add missing import
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2751 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-14 17:53:27 +00:00 |
|
calvin
|
225c045815
|
do not cache unusual errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2750 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-14 17:11:13 +00:00 |
|
calvin
|
5d82d64c31
|
more result sanity check warnings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2749 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-14 13:35:18 +00:00 |
|
calvin
|
3fb9de0847
|
upstream updates
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2748 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-14 13:34:45 +00:00 |
|
calvin
|
c140b510b1
|
fix warning tags
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2746 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-13 19:33:26 +00:00 |
|
calvin
|
f80480469f
|
config to ignore certain warnings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2743 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-13 15:03:17 +00:00 |
|
calvin
|
badb88ed68
|
use errno constant EPIPE
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2742 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-12 18:36:03 +00:00 |
|
calvin
|
5b5eda36e4
|
updated from python CVS
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2741 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-12 18:09:15 +00:00 |
|
calvin
|
b559c4f82e
|
test for hierarchical URLs, and retain non-numeric port parts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2739 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-12 07:18:13 +00:00 |
|
calvin
|
907facaf16
|
put start_server into the try-finally clause
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2738 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-12 07:17:01 +00:00 |
|
calvin
|
34ced03fc2
|
added more norming tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2737 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-11 21:58:58 +00:00 |
|
calvin
|
5049e261fe
|
added LOG_DNS
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2734 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-11 15:37:15 +00:00 |
|
calvin
|
bf9e55c1c8
|
updated documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2731 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-11 14:43:52 +00:00 |
|
calvin
|
3ce6aadfd6
|
updated documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2730 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-11 14:37:52 +00:00 |
|
calvin
|
e5197d429a
|
added error check macro, and check errors on html_end_tag invocation. Also some documentation updates
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2729 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-11 12:02:18 +00:00 |
|
calvin
|
5244431a42
|
add ascii_safe method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2719 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-05 22:06:38 +00:00 |
|
calvin
|
56b2b422a9
|
ensure that thread name is ascii
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2718 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-05 22:06:18 +00:00 |
|
calvin
|
bb2b227b13
|
catch all errors on url check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2717 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-05 22:05:54 +00:00 |
|
calvin
|
e7ca18403a
|
work around python bug occuring with incomplete gzip streams
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2716 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-05 19:56:42 +00:00 |
|
calvin
|
901227d436
|
assign extern info to local var
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2709 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-04 22:19:52 +00:00 |
|
calvin
|
aadd6fd71f
|
fix typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2708 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-04 22:19:22 +00:00 |
|
calvin
|
5f2d11b613
|
fix logger using extern attribute
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2705 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-04 21:48:55 +00:00 |
|
calvin
|
2e207be127
|
allow empty relative URLs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2704 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-04 20:28:55 +00:00 |
|
calvin
|
55109f9111
|
fix log level
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2687 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-07-03 23:08:26 +00:00 |
|
calvin
|
23707a4471
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2684 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-28 13:37:13 +00:00 |
|
calvin
|
f09d54f75b
|
meta tests added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2683 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-28 13:36:52 +00:00 |
|
calvin
|
10bbe998c7
|
accept more meta tag urls for checking, eg favicons
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2682 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-28 13:36:39 +00:00 |
|
calvin
|
506eaa21b5
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2680 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-28 10:03:04 +00:00 |
|
calvin
|
555e2dc2a4
|
fixed test output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2679 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-28 09:57:31 +00:00 |
|
calvin
|
49aa4ec208
|
remove unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2678 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-27 15:02:10 +00:00 |
|
calvin
|
1df5b81f0e
|
updated test result data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2677 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-23 16:21:26 +00:00 |
|
calvin
|
0c3e78569c
|
fix norming
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2676 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-23 16:21:05 +00:00 |
|
calvin
|
217d34bb54
|
use new extern check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2675 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-22 12:30:03 +00:00 |
|
calvin
|
d48eb20a28
|
support extern filter in ignored url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2672 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-20 14:53:23 +00:00 |
|
calvin
|
990d548424
|
don't delete from incoming queue while iterating, but after. SF #1223920
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2671 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-20 09:49:27 +00:00 |
|
calvin
|
51e4657cf6
|
add one more parent path test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-12 21:19:12 +00:00 |
|
calvin
|
ea052008a2
|
send the complete email address with VRFY command
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2654 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-12 21:17:10 +00:00 |
|
calvin
|
cc0f7cb113
|
always norm a URL before sending a request
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2653 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-12 21:16:47 +00:00 |
|
calvin
|
eba33c61e6
|
resync with python 2.4 httplib
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2652 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-12 20:58:09 +00:00 |
|
calvin
|
125707fceb
|
parse combined start/end tags in tag parsers, and added a test for that
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2649 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-09 15:10:29 +00:00 |
|
calvin
|
1b0e300f5d
|
use cache_url_key instead of old get_cache_key() method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2648 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-09 15:08:53 +00:00 |
|
calvin
|
d965a387d5
|
catch curses setupterm errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2643 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-07 10:38:33 +00:00 |
|
calvin
|
c9239135b1
|
fix exception test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-06-02 21:54:41 +00:00 |
|
calvin
|
79d0850fed
|
fix intern url of file: links
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2636 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-22 20:28:59 +00:00 |
|
calvin
|
fec843814c
|
fix intern url of file: links
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2635 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-22 20:27:32 +00:00 |
|
calvin
|
c51a60e0b5
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2627 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 23:02:44 +00:00 |
|
calvin
|
afca416b67
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2625 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 20:25:01 +00:00 |
|
calvin
|
43c6ea202d
|
remove unused
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2624 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 19:57:12 +00:00 |
|
calvin
|
6d8f0146d6
|
fix GET fallback handling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2623 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 19:53:13 +00:00 |
|
calvin
|
d2107c7a6a
|
split and fix initialization of UrlData objects
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2622 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 19:42:14 +00:00 |
|
calvin
|
cd32e823df
|
fix url util call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2621 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 19:02:52 +00:00 |
|
calvin
|
9666421a10
|
add log_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2620 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 19:02:40 +00:00 |
|
calvin
|
1fc5eb32b6
|
fix extern calculation and a typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2619 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 19:02:16 +00:00 |
|
calvin
|
f6f04e376e
|
fix extern calculation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2618 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 19:01:51 +00:00 |
|
calvin
|
d6e56ceba2
|
remove lock from check_url in case of disabled threading
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2617 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 18:30:06 +00:00 |
|
calvin
|
3407ab362d
|
syntax
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2616 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 18:29:38 +00:00 |
|
calvin
|
55d7d5f7df
|
use a decorator to synchronize all the checker threads
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2614 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-19 15:49:06 +00:00 |
|
calvin
|
3f6d2fa753
|
specify thread name
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2613 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 22:16:23 +00:00 |
|
calvin
|
781ad5fdc0
|
catch exceptions on abort
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2612 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 22:15:54 +00:00 |
|
calvin
|
fd652881fb
|
thread name and maximum wait for finish
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 22:15:18 +00:00 |
|
calvin
|
3db056f161
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2610 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 22:14:45 +00:00 |
|
calvin
|
4c270cfe74
|
log message formatting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2609 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 18:04:54 +00:00 |
|
calvin
|
e697b7a3ce
|
more generic nt filename test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2608 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 18:04:05 +00:00 |
|
calvin
|
e1e7055e79
|
trace filtering
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2606 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 17:58:35 +00:00 |
|
calvin
|
7df1caf58c
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2605 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 17:57:41 +00:00 |
|
calvin
|
a51a0913d3
|
nt specific test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2604 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 17:56:52 +00:00 |
|
calvin
|
63b76ec642
|
Use HTTPMessage() in all urllib handlers, really fixing the bug noted in http://www.python.org/sf/1117588. The workaround has been removed.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2603 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-18 17:53:39 +00:00 |
|
calvin
|
cb54822dac
|
trace ignore names
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2602 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-17 22:46:05 +00:00 |
|
calvin
|
c0d9e56a4d
|
new trace option
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2601 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-17 22:06:47 +00:00 |
|
calvin
|
50c536c82a
|
lock debug
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2600 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-17 22:06:17 +00:00 |
|
calvin
|
0ea778b6fd
|
dont trace with log function, else a deadlock occurs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2599 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-17 21:49:09 +00:00 |
|
calvin
|
ed738d2436
|
cmdline param defaults to False
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2595 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-17 19:00:17 +00:00 |
|
calvin
|
a85ac68e16
|
cmdline param
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2594 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-17 14:12:30 +00:00 |
|
calvin
|
e3a049ee27
|
make intern pattern of parent path
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2593 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-17 14:11:17 +00:00 |
|
calvin
|
6862ba1433
|
ability to set cmdline param in direct test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2592 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-17 09:40:34 +00:00 |
|
calvin
|
153ea4fa06
|
add cmdline arg to get_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2591 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-13 15:47:07 +00:00 |
|
calvin
|
1ec0c53c91
|
sanitize CGI env, add strip to goodaddrs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2590 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-13 15:46:31 +00:00 |
|
calvin
|
9413039083
|
updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2589 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-13 15:41:44 +00:00 |
|
calvin
|
d821abce85
|
news group info string
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2588 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-13 14:01:53 +00:00 |
|
calvin
|
666ead2bb3
|
updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2587 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-13 14:01:25 +00:00 |
|
calvin
|
51fdb7e4a3
|
updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2586 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-13 13:50:41 +00:00 |
|
calvin
|
208a7f095f
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2585 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-09 22:07:45 +00:00 |
|
calvin
|
1a7a771648
|
new intern/extern handling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2584 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-09 22:05:21 +00:00 |
|
calvin
|
ce2f2482eb
|
URL consistency
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2582 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-08 20:16:52 +00:00 |
|
calvin
|
6ff56a53cc
|
rename logger fields to logger parts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2579 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-08 20:06:40 +00:00 |
|
calvin
|
cd899b7e57
|
updated test results
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2574 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-06 22:28:49 +00:00 |
|
calvin
|
6919a06d8c
|
fix backtrace printing, and only call _log when the loglevel is enabled
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2573 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-06 22:17:23 +00:00 |
|
calvin
|
829e19e7ee
|
cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2572 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-06 22:15:12 +00:00 |
|
calvin
|
c07f42031a
|
ignored urls only issue an info instead of a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2569 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-06 14:59:22 +00:00 |
|
calvin
|
6eb990d227
|
do not hardcode output locale
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2568 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-06 13:21:10 +00:00 |
|
calvin
|
b6662a3098
|
use startswith method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2567 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-06 13:06:27 +00:00 |
|
calvin
|
cd3f5294cb
|
better file descriptor initialization and closing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2566 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-06 13:05:16 +00:00 |
|
calvin
|
bf8fd348aa
|
better msg
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2564 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-04 13:22:10 +00:00 |
|
calvin
|
532a04e436
|
method change is an info, not a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2563 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-04 13:18:19 +00:00 |
|
calvin
|
96b74a1f41
|
collapse reduntant dot path at beginning of url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2558 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-04 12:58:38 +00:00 |
|
calvin
|
fd8c56397a
|
updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2557 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-04 11:44:02 +00:00 |
|
calvin
|
49a2dee338
|
make robots.txt deny an info instead of a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2555 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-04 10:48:48 +00:00 |
|
calvin
|
a39f635b82
|
use some %r in warning strings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2554 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-04 10:48:10 +00:00 |
|
calvin
|
b6e146750d
|
try to read only existing default config files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-05-02 14:46:47 +00:00 |
|
calvin
|
d2a8764d18
|
do not store aliases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2550 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-27 12:48:48 +00:00 |
|
calvin
|
23e5212c7d
|
do not remove userinfo from host part of url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2544 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-26 17:53:31 +00:00 |
|
calvin
|
dc2b0feca4
|
removed redirection warnings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2543 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-26 17:51:41 +00:00 |
|
calvin
|
82dee6ae52
|
reintroduce the self.url updated, this time only for redirections but without a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2542 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-26 17:51:15 +00:00 |
|
calvin
|
93ce3364b0
|
split CGI params on both ampersand and semicolon
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2541 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-26 17:28:12 +00:00 |
|
calvin
|
134c76de4a
|
only use signals on posix systems
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2538 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-25 23:49:59 +00:00 |
|
calvin
|
60069a8862
|
improved internal error msg
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2537 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-25 23:46:37 +00:00 |
|
calvin
|
53b5f67745
|
removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2536 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-25 23:45:54 +00:00 |
|
calvin
|
c95c4b11d7
|
added tracing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2535 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-25 23:02:40 +00:00 |
|
calvin
|
5e6317a4bb
|
remove old warning, and move effective url test to urlbase
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2532 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-25 18:25:32 +00:00 |
|
calvin
|
006f79702e
|
make warnings enabled as default
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2529 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-25 14:52:52 +00:00 |
|
calvin
|
71407d0399
|
use new logger interface
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2528 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-25 14:52:38 +00:00 |
|
calvin
|
040139e6d8
|
count errors, warnings and number of checked links in the logger classes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2527 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-25 14:51:35 +00:00 |
|
calvin
|
f94f910209
|
signal handler
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2523 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-22 20:15:10 +00:00 |
|
calvin
|
7925d5dd56
|
use collections.deque for incoming queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2518 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-13 21:05:52 +00:00 |
|
calvin
|
813e1955d9
|
use pydoc.pager()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2511 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-04-07 13:46:24 +00:00 |
|
calvin
|
ba5939c7c5
|
allow optional empty url path
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2500 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-31 13:50:11 +00:00 |
|
calvin
|
cf05e2cb6f
|
correct get_cache_keys method name
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2499 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-31 08:18:50 +00:00 |
|
calvin
|
bfe3f4cd4d
|
do not add aliases that are in-progress
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2491 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 20:37:06 +00:00 |
|
calvin
|
5b64583904
|
add ignore_missing flag and do not cache already-cached aliases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2490 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 20:26:35 +00:00 |
|
calvin
|
eeb6da8330
|
do not cache HTTP connections with pending data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2487 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 18:47:09 +00:00 |
|
calvin
|
ecd7e44935
|
add assertion for check queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2481 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 15:52:40 +00:00 |
|
calvin
|
911e2eb011
|
fix persistent connection detection
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2477 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 13:41:22 +00:00 |
|
calvin
|
7429dfa209
|
cached connection debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2476 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 13:40:54 +00:00 |
|
calvin
|
ccdeaa86b4
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2475 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 12:35:03 +00:00 |
|
calvin
|
ebb48fa3b8
|
use get_true method to ensure that urls are always a unicode string and not None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2472 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 11:31:17 +00:00 |
|
calvin
|
63a71baae6
|
add get_true method to ListDict
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2471 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 11:30:47 +00:00 |
|
calvin
|
f141255ab2
|
allow zero number of threads (means trheading disabled)
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2470 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 11:30:29 +00:00 |
|
calvin
|
a50c3ce40a
|
use threader init param to set number of threads
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2469 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 11:29:49 +00:00 |
|
calvin
|
6cbbe9265e
|
added misc html parse test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2468 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 11:28:51 +00:00 |
|
calvin
|
cbd333955e
|
only strip line endings from test data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2467 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 11:28:07 +00:00 |
|
calvin
|
9cc3f978a6
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2465 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-29 08:52:40 +00:00 |
|
calvin
|
21757150f6
|
workaround for buggy l18n algorithm
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2464 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-28 23:52:46 +00:00 |
|
calvin
|
642e2d1698
|
do not split cgi params on semicolons
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2463 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-28 23:51:29 +00:00 |
|
calvin
|
1cf7426026
|
public method is_locked()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2462 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-28 15:56:25 +00:00 |
|
calvin
|
8e720030d1
|
check A RR records when no MX RR record could be found
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2461 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-28 14:59:17 +00:00 |
|
calvin
|
28d3b45819
|
aded
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2460 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-20 10:14:11 +00:00 |
|
calvin
|
bbf96868b8
|
document aliases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2458 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-18 14:21:12 +00:00 |
|
calvin
|
26e52022ea
|
add aliases to cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2457 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-18 14:17:23 +00:00 |
|
calvin
|
e24c38c2aa
|
redirect test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2456 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-18 14:16:56 +00:00 |
|
calvin
|
dcd407782d
|
no double alias reset
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2454 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-18 00:02:50 +00:00 |
|
calvin
|
0b0e672b4e
|
cleanup of the fallbacks
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2453 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-16 17:34:02 +00:00 |
|
calvin
|
9b982062fc
|
do not translate countries
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2434 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-12 00:43:52 +00:00 |
|
calvin
|
0baec73a77
|
only find redirection links with http-equiv='refresh'
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2428 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-11 23:47:45 +00:00 |
|
calvin
|
6857196b25
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2426 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-11 23:15:13 +00:00 |
|
calvin
|
964f313a89
|
fix return codes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2424 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-11 22:39:34 +00:00 |
|
calvin
|
2b8ca62e2e
|
split up the big check function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2423 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-11 22:37:09 +00:00 |
|
calvin
|
9c609c0852
|
fix debug log keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2422 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-11 22:12:18 +00:00 |
|
calvin
|
ac450295ac
|
put country info in local check method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2412 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-11 20:30:41 +00:00 |
|
calvin
|
8d206bac94
|
nice value +10 for low prio
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2399 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-10 23:43:10 +00:00 |
|
calvin
|
0c19d24b5d
|
no email in the user-agent
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2398 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-10 22:35:20 +00:00 |
|
calvin
|
882f204319
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2396 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-10 22:14:39 +00:00 |
|
calvin
|
131bea1a59
|
avoid deadlock with cache lock
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2395 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-10 22:09:41 +00:00 |
|
calvin
|
db299a1ead
|
support printing tracebacks
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2394 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-10 22:03:40 +00:00 |
|
calvin
|
e89ef2c57a
|
use own locking class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2393 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-10 22:03:09 +00:00 |
|
calvin
|
4c248fce03
|
avoid deadlock with cache lock
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2392 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-10 22:02:52 +00:00 |
|
calvin
|
4d0d76446f
|
own locking class, avoiding multiple acquire/releases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2391 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-10 22:02:24 +00:00 |
|
calvin
|
7f4b062f7c
|
fix lognames for -D option
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2389 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 21:57:51 +00:00 |
|
calvin
|
dc960185df
|
only set connection debug level if CHECK logging is on debug
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2388 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 21:55:20 +00:00 |
|
calvin
|
7563f0edf9
|
fix lock class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2387 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 21:54:56 +00:00 |
|
calvin
|
3373644560
|
make the consumer a lock object itself
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2386 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 20:28:16 +00:00 |
|
calvin
|
8e289cc522
|
dont disable threading on thread debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2385 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 20:11:44 +00:00 |
|
calvin
|
932c9864cb
|
new thread log name
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2384 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 20:09:21 +00:00 |
|
calvin
|
7f6d1b1022
|
more headers stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2382 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 14:59:03 +00:00 |
|
calvin
|
b3c3c3eaaa
|
split off header methods in separate file
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2381 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 13:46:58 +00:00 |
|
calvin
|
ca49e04730
|
content encoding getter method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2380 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 13:39:20 +00:00 |
|
calvin
|
12b726b4df
|
strip content type mime
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2379 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 13:33:20 +00:00 |
|
calvin
|
f344b75c8e
|
documentation and syntax fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2378 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 10:26:30 +00:00 |
|
calvin
|
0d063a3b53
|
skip accept encoding, and list complete recursion list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2377 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-09 08:44:45 +00:00 |
|
calvin
|
4972a5b2f4
|
add warning on decompress errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2375 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-08 21:04:02 +00:00 |
|
calvin
|
a78ef198df
|
disable logging on tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2373 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-08 20:59:49 +00:00 |
|
calvin
|
1e35c23986
|
eliminate tag attribute duplicates
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2372 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-08 20:51:38 +00:00 |
|
calvin
|
3913b28b3c
|
allow quoted CSS style url, and strip matching quotes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2371 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-08 20:49:00 +00:00 |
|
calvin
|
7d11778b5a
|
add link parser tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2370 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-08 19:30:11 +00:00 |
|
calvin
|
0f991d47b9
|
add tests for matching attribute for unquoting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2369 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-08 19:29:16 +00:00 |
|
calvin
|
d852672732
|
add matching attribute for unquoting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2368 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-08 19:28:48 +00:00 |
|
calvin
|
26108790c6
|
supply real consumer for build url test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2366 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-08 12:26:51 +00:00 |
|
calvin
|
f808a03d3f
|
no info for empty proxy
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2365 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 17:28:22 +00:00 |
|
calvin
|
067158d368
|
disable geoip for testing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2364 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 17:27:03 +00:00 |
|
calvin
|
5c52c35367
|
test noproxyfor
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2363 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 17:26:35 +00:00 |
|
calvin
|
7c5bef281a
|
support setting of config args
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2362 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 17:13:23 +00:00 |
|
calvin
|
e1e713036b
|
use noproxyfor config values to ignore proxy settings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2360 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 13:57:01 +00:00 |
|
calvin
|
52d364ae54
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2359 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 10:38:09 +00:00 |
|
calvin
|
9e9e42e21e
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2358 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 10:23:48 +00:00 |
|
calvin
|
2e996aecdb
|
catch re.compile() errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2357 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 10:22:26 +00:00 |
|
calvin
|
c8920096e0
|
make threadsafe geoip call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2354 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 00:09:22 +00:00 |
|
calvin
|
aa3facf19f
|
open geoip
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2353 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 00:08:53 +00:00 |
|
calvin
|
0284f58359
|
log country name as info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2352 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-07 00:08:48 +00:00 |
|
calvin
|
f3f64361cb
|
add thread prio setter
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2348 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-04 23:18:10 +00:00 |
|
calvin
|
ac8490ce54
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2345 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-03-04 20:28:28 +00:00 |
|
calvin
|
bf89b8e9a9
|
str() for unicode_safe objects
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2324 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-18 11:29:58 +00:00 |
|
calvin
|
daf6f351c4
|
documenation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2323 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-18 11:25:05 +00:00 |
|
calvin
|
703da9eb65
|
safe decoding of non-unicode strings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2322 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-18 11:22:52 +00:00 |
|
calvin
|
05f5123d7c
|
make sure infos and warnings are unicode
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2320 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-18 09:20:45 +00:00 |
|
calvin
|
0e12b923f6
|
make sure results are unicode
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2319 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-18 09:17:46 +00:00 |
|
calvin
|
e71e6fb281
|
*** empty log message ***
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2318 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-17 22:33:00 +00:00 |
|
calvin
|
569fa853a8
|
*** empty log message ***
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2317 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-17 22:31:56 +00:00 |
|
calvin
|
87b6b5a6f6
|
*** empty log message ***
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2316 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-17 22:28:40 +00:00 |
|
calvin
|
d834aa0f2d
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2310 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-17 13:34:10 +00:00 |
|
calvin
|
b20cd18280
|
exception syntax
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2308 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-17 00:02:22 +00:00 |
|
calvin
|
9560ad55ec
|
sort HTTP accept languages for preference
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2307 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-16 23:57:22 +00:00 |
|
calvin
|
e4ca505e05
|
do not error out on missing locale directory
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2306 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-16 23:50:44 +00:00 |
|
calvin
|
44075c47bf
|
clean up raise calls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2294 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-08 14:52:50 +00:00 |
|
calvin
|
77cea28d42
|
pylint cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2292 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-08 13:43:33 +00:00 |
|
calvin
|
4f3dc7a7fd
|
syntax error
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2290 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-08 12:48:55 +00:00 |
|
calvin
|
94c769aba0
|
more config write stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2289 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-08 12:33:01 +00:00 |
|
calvin
|
2fced4f37d
|
documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2288 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-08 12:10:39 +00:00 |
|
calvin
|
d1fd01f669
|
remove expired connections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2287 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-08 10:41:27 +00:00 |
|
calvin
|
55652cabc0
|
fix nt path name for network paths
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2284 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-07 15:41:53 +00:00 |
|
calvin
|
973b6d5098
|
work around for 302 redirect handling error
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2283 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-07 12:10:17 +00:00 |
|
calvin
|
4db7e58f84
|
added no quote test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2281 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-07 00:07:50 +00:00 |
|
calvin
|
fcf18b8e1f
|
add ! to no quote chars
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2280 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-07 00:07:02 +00:00 |
|
calvin
|
334c92708a
|
add unicode messages
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2279 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-06 21:25:40 +00:00 |
|
calvin
|
344bfd1103
|
no return from add_connection
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2278 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-06 21:20:29 +00:00 |
|
calvin
|
bb3b972d8f
|
always add connections, and close timed out ones
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2277 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-06 21:20:10 +00:00 |
|
calvin
|
3be005186a
|
do not print XXX message, check for connected .sock attribute and always add to cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2276 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-06 21:15:28 +00:00 |
|
calvin
|
03a7f5f065
|
translate log level names
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2271 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-02-01 02:05:34 +00:00 |
|
calvin
|
1d3dd0c35b
|
documentation added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2258 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-31 20:18:17 +00:00 |
|
calvin
|
4f21309b9a
|
added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2246 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-30 22:41:59 +00:00 |
|
calvin
|
01ceb0aafd
|
HTTP connection pooling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2245 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-30 22:39:09 +00:00 |
|
calvin
|
9dea804d92
|
per-connection timeout
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2244 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-30 11:00:37 +00:00 |
|
calvin
|
b698701726
|
only release cached FTP connections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2243 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-29 23:29:45 +00:00 |
|
calvin
|
e76836a607
|
add time import
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2242 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-29 23:19:56 +00:00 |
|
calvin
|
372798487b
|
start logger output before append_url is called since this can trigger logger.new_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2239 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-29 23:12:55 +00:00 |
|
calvin
|
879343f87b
|
write stubs, rename norm to normpath
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2236 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-28 16:14:31 +00:00 |
|
calvin
|
afeae9fbe4
|
default blacklist output file is in .linkchecker user dir
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2233 e7d03fd6-7b0d-0410-9947-9c21f3af8025
|
2005-01-28 15:34:52 +00:00 |
|