Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-14 01:23:11 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
2823 commits 1 branch 0 tags 24 MiB
Commit graph

1314 commits

Author SHA1 Message Date
calvin
6919a06d8c fix backtrace printing, and only call _log when the loglevel is enabled 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2573 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-06 22:17:23 +00:00
calvin
829e19e7ee cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2572 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-06 22:15:12 +00:00
calvin
c07f42031a ignored urls only issue an info instead of a warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2569 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-06 14:59:22 +00:00
calvin
6eb990d227 do not hardcode output locale 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2568 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-06 13:21:10 +00:00
calvin
b6662a3098 use startswith method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2567 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-06 13:06:27 +00:00
calvin
cd3f5294cb better file descriptor initialization and closing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2566 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-06 13:05:16 +00:00
calvin
bf8fd348aa better msg 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2564 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-04 13:22:10 +00:00
calvin
532a04e436 method change is an info, not a warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2563 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-04 13:18:19 +00:00
calvin
96b74a1f41 collapse reduntant dot path at beginning of url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2558 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-04 12:58:38 +00:00
calvin
fd8c56397a updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2557 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-04 11:44:02 +00:00
calvin
49a2dee338 make robots.txt deny an info instead of a warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2555 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-04 10:48:48 +00:00
calvin
a39f635b82 use some %r in warning strings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2554 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-04 10:48:10 +00:00
calvin
b6e146750d try to read only existing default config files 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-02 14:46:47 +00:00
calvin
d2a8764d18 do not store aliases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2550 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-27 12:48:48 +00:00
calvin
23e5212c7d do not remove userinfo from host part of url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2544 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-26 17:53:31 +00:00
calvin
dc2b0feca4 removed redirection warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2543 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-26 17:51:41 +00:00
calvin
82dee6ae52 reintroduce the self.url updated, this time only for redirections but without a warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2542 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-26 17:51:15 +00:00
calvin
93ce3364b0 split CGI params on both ampersand and semicolon 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2541 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-26 17:28:12 +00:00
calvin
134c76de4a only use signals on posix systems 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2538 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 23:49:59 +00:00
calvin
60069a8862 improved internal error msg 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2537 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 23:46:37 +00:00
calvin
53b5f67745 removed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2536 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 23:45:54 +00:00
calvin
c95c4b11d7 added tracing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2535 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 23:02:40 +00:00
calvin
5e6317a4bb remove old warning, and move effective url test to urlbase 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2532 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 18:25:32 +00:00
calvin
006f79702e make warnings enabled as default 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2529 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 14:52:52 +00:00
calvin
71407d0399 use new logger interface 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2528 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 14:52:38 +00:00
calvin
040139e6d8 count errors, warnings and number of checked links in the logger classes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2527 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-25 14:51:35 +00:00
calvin
f94f910209 signal handler 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2523 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-22 20:15:10 +00:00
calvin
7925d5dd56 use collections.deque for incoming queue 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2518 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-13 21:05:52 +00:00
calvin
813e1955d9 use pydoc.pager() 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2511 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-04-07 13:46:24 +00:00
calvin
ba5939c7c5 allow optional empty url path 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2500 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-31 13:50:11 +00:00
calvin
cf05e2cb6f correct get_cache_keys method name 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2499 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-31 08:18:50 +00:00
calvin
bfe3f4cd4d do not add aliases that are in-progress 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2491 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 20:37:06 +00:00
calvin
5b64583904 add ignore_missing flag and do not cache already-cached aliases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2490 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 20:26:35 +00:00
calvin
eeb6da8330 do not cache HTTP connections with pending data 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2487 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 18:47:09 +00:00
calvin
ecd7e44935 add assertion for check queue 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2481 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 15:52:40 +00:00
calvin
911e2eb011 fix persistent connection detection 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2477 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 13:41:22 +00:00
calvin
7429dfa209 cached connection debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2476 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 13:40:54 +00:00
calvin
ccdeaa86b4 added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2475 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 12:35:03 +00:00
calvin
ebb48fa3b8 use get_true method to ensure that urls are always a unicode string and not None 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2472 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 11:31:17 +00:00
calvin
63a71baae6 add get_true method to ListDict 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2471 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 11:30:47 +00:00
calvin
f141255ab2 allow zero number of threads (means trheading disabled) 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2470 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 11:30:29 +00:00
calvin
a50c3ce40a use threader init param to set number of threads 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2469 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 11:29:49 +00:00
calvin
6cbbe9265e added misc html parse test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2468 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 11:28:51 +00:00
calvin
cbd333955e only strip line endings from test data 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2467 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 11:28:07 +00:00
calvin
9cc3f978a6 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2465 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-29 08:52:40 +00:00
calvin
21757150f6 workaround for buggy l18n algorithm 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2464 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-28 23:52:46 +00:00
calvin
642e2d1698 do not split cgi params on semicolons 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2463 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-28 23:51:29 +00:00
calvin
1cf7426026 public method is_locked() 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2462 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-28 15:56:25 +00:00
calvin
8e720030d1 check A RR records when no MX RR record could be found 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2461 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-28 14:59:17 +00:00
calvin
28d3b45819 aded 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2460 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-20 10:14:11 +00:00
calvin
bbf96868b8 document aliases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2458 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-18 14:21:12 +00:00
calvin
26e52022ea add aliases to cache 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2457 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-18 14:17:23 +00:00
calvin
e24c38c2aa redirect test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2456 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-18 14:16:56 +00:00
calvin
dcd407782d no double alias reset 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2454 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-18 00:02:50 +00:00
calvin
0b0e672b4e cleanup of the fallbacks 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2453 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-16 17:34:02 +00:00
calvin
9b982062fc do not translate countries 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2434 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-12 00:43:52 +00:00
calvin
0baec73a77 only find redirection links with http-equiv='refresh' 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2428 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 23:47:45 +00:00
calvin
6857196b25 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2426 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 23:15:13 +00:00
calvin
964f313a89 fix return codes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2424 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 22:39:34 +00:00
calvin
2b8ca62e2e split up the big check function 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2423 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 22:37:09 +00:00
calvin
9c609c0852 fix debug log keys 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2422 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 22:12:18 +00:00
calvin
ac450295ac put country info in local check method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2412 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-11 20:30:41 +00:00
calvin
8d206bac94 nice value +10 for low prio 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2399 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 23:43:10 +00:00
calvin
0c19d24b5d no email in the user-agent 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2398 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:35:20 +00:00
calvin
882f204319 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2396 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:14:39 +00:00
calvin
131bea1a59 avoid deadlock with cache lock 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2395 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:09:41 +00:00
calvin
db299a1ead support printing tracebacks 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2394 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:03:40 +00:00
calvin
e89ef2c57a use own locking class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2393 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:03:09 +00:00
calvin
4c248fce03 avoid deadlock with cache lock 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2392 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:02:52 +00:00
calvin
4d0d76446f own locking class, avoiding multiple acquire/releases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2391 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-10 22:02:24 +00:00
calvin
7f4b062f7c fix lognames for -D option 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2389 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 21:57:51 +00:00
calvin
dc960185df only set connection debug level if CHECK logging is on debug 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2388 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 21:55:20 +00:00
calvin
7563f0edf9 fix lock class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2387 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 21:54:56 +00:00
calvin
3373644560 make the consumer a lock object itself 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2386 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 20:28:16 +00:00
calvin
8e289cc522 dont disable threading on thread debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2385 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 20:11:44 +00:00
calvin
932c9864cb new thread log name 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2384 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 20:09:21 +00:00
calvin
7f6d1b1022 more headers stuff 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2382 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 14:59:03 +00:00
calvin
b3c3c3eaaa split off header methods in separate file 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2381 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 13:46:58 +00:00
calvin
ca49e04730 content encoding getter method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2380 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 13:39:20 +00:00
calvin
12b726b4df strip content type mime 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2379 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 13:33:20 +00:00
calvin
f344b75c8e documentation and syntax fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2378 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 10:26:30 +00:00
calvin
0d063a3b53 skip accept encoding, and list complete recursion list 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2377 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-09 08:44:45 +00:00
calvin
4972a5b2f4 add warning on decompress errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2375 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 21:04:02 +00:00
calvin
a78ef198df disable logging on tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2373 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 20:59:49 +00:00
calvin
1e35c23986 eliminate tag attribute duplicates 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2372 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 20:51:38 +00:00
calvin
3913b28b3c allow quoted CSS style url, and strip matching quotes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2371 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 20:49:00 +00:00
calvin
7d11778b5a add link parser tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2370 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 19:30:11 +00:00
calvin
0f991d47b9 add tests for matching attribute for unquoting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2369 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 19:29:16 +00:00
calvin
d852672732 add matching attribute for unquoting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2368 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 19:28:48 +00:00
calvin
26108790c6 supply real consumer for build url test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2366 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-08 12:26:51 +00:00
calvin
f808a03d3f no info for empty proxy 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2365 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 17:28:22 +00:00
calvin
067158d368 disable geoip for testing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2364 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 17:27:03 +00:00
calvin
5c52c35367 test noproxyfor 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2363 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 17:26:35 +00:00
calvin
7c5bef281a support setting of config args 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2362 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 17:13:23 +00:00
calvin
e1e713036b use noproxyfor config values to ignore proxy settings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2360 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 13:57:01 +00:00
calvin
52d364ae54 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2359 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 10:38:09 +00:00
calvin
9e9e42e21e added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2358 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 10:23:48 +00:00
calvin
2e996aecdb catch re.compile() errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2357 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 10:22:26 +00:00
calvin
c8920096e0 make threadsafe geoip call 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2354 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 00:09:22 +00:00
calvin
aa3facf19f open geoip 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2353 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 00:08:53 +00:00
calvin
0284f58359 log country name as info 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2352 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-07 00:08:48 +00:00
calvin
f3f64361cb add thread prio setter 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2348 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-04 23:18:10 +00:00
calvin
ac8490ce54 added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2345 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-03-04 20:28:28 +00:00
calvin
bf89b8e9a9 str() for unicode_safe objects 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2324 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-18 11:29:58 +00:00
calvin
daf6f351c4 documenation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2323 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-18 11:25:05 +00:00
calvin
703da9eb65 safe decoding of non-unicode strings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2322 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-18 11:22:52 +00:00
calvin
05f5123d7c make sure infos and warnings are unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2320 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-18 09:20:45 +00:00
calvin
0e12b923f6 make sure results are unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2319 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-18 09:17:46 +00:00
calvin
e71e6fb281 *** empty log message *** 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2318 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-17 22:33:00 +00:00
calvin
569fa853a8 *** empty log message *** 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2317 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-17 22:31:56 +00:00
calvin
87b6b5a6f6 *** empty log message *** 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2316 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-17 22:28:40 +00:00
calvin
d834aa0f2d documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2310 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-17 13:34:10 +00:00
calvin
b20cd18280 exception syntax 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2308 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-17 00:02:22 +00:00
calvin
9560ad55ec sort HTTP accept languages for preference 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2307 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-16 23:57:22 +00:00
calvin
e4ca505e05 do not error out on missing locale directory 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2306 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-16 23:50:44 +00:00
calvin
44075c47bf clean up raise calls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2294 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 14:52:50 +00:00
calvin
77cea28d42 pylint cleanups 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2292 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 13:43:33 +00:00
calvin
4f3dc7a7fd syntax error 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2290 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 12:48:55 +00:00
calvin
94c769aba0 more config write stuff 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2289 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 12:33:01 +00:00
calvin
2fced4f37d documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2288 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 12:10:39 +00:00
calvin
d1fd01f669 remove expired connections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2287 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-08 10:41:27 +00:00
calvin
55652cabc0 fix nt path name for network paths 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2284 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-07 15:41:53 +00:00
calvin
973b6d5098 work around for 302 redirect handling error 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2283 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-07 12:10:17 +00:00
calvin
4db7e58f84 added no quote test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2281 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-07 00:07:50 +00:00
calvin
fcf18b8e1f add ! to no quote chars 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2280 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-07 00:07:02 +00:00
calvin
334c92708a add unicode messages 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2279 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-06 21:25:40 +00:00
calvin
344bfd1103 no return from add_connection 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2278 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-06 21:20:29 +00:00
calvin
bb3b972d8f always add connections, and close timed out ones 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2277 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-06 21:20:10 +00:00
calvin
3be005186a do not print XXX message, check for connected .sock attribute and always add to cache 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2276 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-06 21:15:28 +00:00
calvin
03a7f5f065 translate log level names 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2271 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-02-01 02:05:34 +00:00
calvin
1d3dd0c35b documentation added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2258 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-31 20:18:17 +00:00
calvin
4f21309b9a added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2246 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-30 22:41:59 +00:00
calvin
01ceb0aafd HTTP connection pooling 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2245 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-30 22:39:09 +00:00
calvin
9dea804d92 per-connection timeout 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2244 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-30 11:00:37 +00:00
calvin
b698701726 only release cached FTP connections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2243 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-29 23:29:45 +00:00
calvin
e76836a607 add time import 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2242 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-29 23:19:56 +00:00
calvin
372798487b start logger output before append_url is called since this can trigger logger.new_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2239 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-29 23:12:55 +00:00
calvin
879343f87b write stubs, rename norm to normpath 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2236 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 16:14:31 +00:00
calvin
afeae9fbe4 default blacklist output file is in .linkchecker user dir 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2233 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 15:34:52 +00:00
calvin
d04523b4fc move config file into a directory 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2232 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 15:08:07 +00:00
calvin
0aabca8444 do not just ignore but replace wrong encoded chars 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2231 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 15:06:41 +00:00
calvin
2c40c0be3c FTP connection timeout 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2229 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 12:16:35 +00:00
calvin
74b8c8745e edge label quoting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2227 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 11:51:39 +00:00
calvin
b10c3775f4 default dot output encoding is ascii 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2226 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 11:51:12 +00:00
calvin
a749829ae5 format fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2225 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 11:33:40 +00:00
calvin
3f4f525358 fix edge writing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2224 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 01:19:17 +00:00
calvin
639aeb294a return 'busy' on busy connections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2223 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 01:03:16 +00:00
calvin
7e0c34a3d9 better FTP connection pooling, remove unnecessary LIST 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2222 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-28 01:02:15 +00:00
calvin
914f2440b7 syntax cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2220 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-27 21:14:17 +00:00
calvin
49cfa19c5d ignore all close errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2219 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-27 21:11:48 +00:00
calvin
3e79dd7e09 added and use ftpparse module 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2218 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-27 19:03:33 +00:00
calvin
719143c8a1 added DOT graph output logger 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2216 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-27 17:11:03 +00:00
calvin
74805745e8 fix needs_quoting method by escaping chars and add [] to allowed chars 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2214 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-27 13:59:23 +00:00
calvin
5ae97df822 use python 2.4 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2209 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 20:29:55 +00:00
calvin
da8a12f408 use static dict 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2208 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 20:26:43 +00:00
calvin
e226131e59 use new nntp argument usenetrc 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2207 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 19:31:13 +00:00
calvin
93e3da02b2 socket.sslerror is now a subclass of socket.error 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2206 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 19:27:11 +00:00
calvin
5fb817be93 require python 2.4 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2205 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 19:27:00 +00:00
calvin
05c9b8b5e6 use linkchecker agent on getting /robots.txt 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2194 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-24 09:45:22 +00:00
calvin
8e2b4edd49 split status message prints 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2187 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 22:52:58 +00:00
calvin
07ec639486 read and use quotechar param 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2185 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 22:21:43 +00:00
calvin
fbb2dfbaeb change default csv separator to a comma, and add customisable quotechar param 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2184 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 22:21:18 +00:00
calvin
10e8fd9fe3 make interrupt warning a plural form 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2181 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 21:44:10 +00:00
calvin
86e90da338 fix reversed sslerror version check logic 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2175 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 12:50:38 +00:00
calvin
55cbb2f0a9 introduce MAX_NAMELEN 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2172 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 12:07:04 +00:00
calvin
f40e41a5bb cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2171 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 09:35:46 +00:00
calvin
cf30d1ae05 optimize link name search 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2170 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-20 09:32:24 +00:00
calvin
adc1d02217 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2165 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 21:11:43 +00:00
calvin
d030a5b054 documentation updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2164 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 15:56:48 +00:00
calvin
647d7167ee documentation syntax 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2163 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 15:08:02 +00:00
calvin
255b698f44 updated to latest upstream CVS version of 20050119 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2162 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 14:52:27 +00:00
calvin
a91183afa5 documentation updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2161 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 14:38:01 +00:00
calvin
b008747f39 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2160 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 01:04:38 +00:00
calvin
46de8b6ca0 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2159 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 00:40:06 +00:00
calvin
ef8613f2c7 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2157 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-19 00:08:41 +00:00
calvin
8ac75ce155 only add socket.sslerror to exception list if needed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2156 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 17:04:31 +00:00
calvin
194b1f4466 move version check into library 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2155 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 17:03:17 +00:00
calvin
b51dffce7d documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2154 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 16:59:23 +00:00
calvin
cec0a01f4b only call set_encoding for meta tags, and syntax cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2153 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 15:54:11 +00:00
calvin
83020982ba updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2152 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 15:53:34 +00:00
calvin
edfea898b4 documentation updated, and set_encoding no longer has tag attr 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2151 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 15:53:23 +00:00
calvin
4d7fa042ad use Py_CLEAR macor 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2150 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 15:52:04 +00:00
calvin
e58c070df7 supply Py_CLEAR macro 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2149 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 14:45:51 +00:00
calvin
700d564be7 documentation updates 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2148 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-18 01:00:45 +00:00
calvin
2e9525422b write column headers in first row; SF patch #1102338 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2143 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-16 23:30:16 +00:00
calvin
acbad02e8d updated mailto tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2137 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 14:34:23 +00:00
calvin
be4fb033b8 print VRFY info or warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2136 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 14:34:11 +00:00
calvin
15364fc362 fix username param 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2133 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 13:32:47 +00:00
calvin
b3e3448f96 sort MX hosts according to preference 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2132 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 13:29:34 +00:00
calvin
b06f144ced updated copyright year 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2122 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-11 02:22:43 +00:00
calvin
1f7563bd4e use extern optcomplete 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2118 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-10 20:37:23 +00:00
calvin
596959c121 use translator arg, not self 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2116 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-10 20:35:09 +00:00
calvin
c1a25e2e8b added tests for host matching and param splitting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2115 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-10 20:35:01 +00:00
calvin
b1d1af52a7 fix param splitting, query parsing, and host matching 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2114 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-01-10 20:34:26 +00:00
calvin
2fa156988e xhtml tests added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2113 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-08 16:27:03 +00:00
calvin
793862d9af *** empty log message *** 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2109 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-08 09:10:30 +00:00
calvin
4fbdbe3a51 XHTML support 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2108 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-08 09:09:06 +00:00
calvin
9e843d71a7 set smtp debug 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2098 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-07 11:06:34 +00:00
calvin
9829268533 ignore empty filenames in filelist 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2097 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-07 08:16:20 +00:00
calvin
0778ef9d6d use internal file get method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2094 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-07 00:01:28 +00:00
calvin
1e001992ac disable recursion debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2091 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-06 22:38:43 +00:00
calvin
6d99454ebf unicode split 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2090 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-06 22:34:38 +00:00
calvin
ef0d624c0d unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2089 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-06 22:34:20 +00:00
calvin
060d6f0b78 fix url mailto splitting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2087 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-06 20:12:31 +00:00
calvin
f33586a533 comment method docs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2085 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-12-06 17:54:31 +00:00
calvin
29f3efd91a use wrap method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2083 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-30 14:10:06 +00:00
calvin
76751c04af textwrap utility method for logger 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2082 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-30 14:09:42 +00:00
calvin
cef58aba6e line ending for comments 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2073 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-29 00:49:44 +00:00
calvin
6ffd2c60f0 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2063 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-25 16:23:13 +00:00
calvin
0c945cff8d comment and date check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2062 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-25 16:20:58 +00:00
calvin
045e517a52 check date 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2061 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-25 14:51:38 +00:00
calvin
503e482583 new fallbackklass param for translator 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2039 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-23 23:31:13 +00:00
calvin
92350d482e updated with bison 1.875d 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2038 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-23 22:51:48 +00:00
calvin
c5c3310709 use memory defines of new bison 1.875d 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2037 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-23 22:51:21 +00:00
calvin
d51418aabc rebuilt 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2036 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-22 22:51:59 +00:00
calvin
dfe43e5c3f use dict.update() 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2035 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-22 22:51:28 +00:00
calvin
141a3d1c94 added redirect test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2034 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-22 22:34:26 +00:00
calvin
168197a072 make http request handler customizable 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2033 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-22 22:34:03 +00:00
calvin
9151b9fe72 doc updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2024 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 20:59:32 +00:00
calvin
c35431069c added url fix method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2023 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 20:56:12 +00:00
calvin
d1a468c3b8 adjust info and warning strings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2015 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 13:31:30 +00:00
calvin
3b13dd87e2 display correct url in redirect message 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2014 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 13:08:26 +00:00
calvin
0ef53ab56a fix typos 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2012 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 11:52:55 +00:00
calvin
be5a59e9fd add dots to warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2010 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 11:18:06 +00:00
calvin
bc89449080 add dots to info messages 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2008 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-19 11:06:31 +00:00
calvin
d2a6f4ed95 recheck robots.txt allowance after redirect 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2002 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-18 00:57:35 +00:00
calvin
89616a4bba basic robots_txt check method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2001 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-18 00:55:47 +00:00
calvin
4014012c1f basic is_extern method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1999 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-18 00:49:45 +00:00
calvin
74f1935be5 recheck extern/intern filters for redirected URLs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1998 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-18 00:49:33 +00:00
calvin
fae80e541c use new file cache keys in test results 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1988 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-15 19:17:35 +00:00
calvin
2765c5b116 use anchor and user info in cache key 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1987 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-15 19:16:02 +00:00
calvin
cafa412343 use base cache keys 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1986 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-15 19:15:22 +00:00
calvin
4485ab19aa only norm a changed file base_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1985 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-15 16:36:56 +00:00
calvin
b0d3c575ce test leading query exclam after host without path 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1982 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 11:12:34 +00:00
calvin
b150ff6ea8 handle leading query exclam after host without path 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1981 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 11:12:16 +00:00
calvin
265f942ba1 add unquoted redirectino url to info 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1980 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 11:02:17 +00:00
calvin
1166804eb0 use idna domain for intern patterns 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1979 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 10:52:20 +00:00
calvin
72290074ac syntax cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1978 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 10:47:43 +00:00
calvin
ce998f63da added one idna test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1977 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 02:01:23 +00:00
calvin
6c62daba9c added one idna test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1976 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 01:58:26 +00:00
calvin
3576caf6d5 test fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1975 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 01:58:05 +00:00
calvin
2f3e7d18e0 test fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1974 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 01:55:47 +00:00
calvin
f3226afe0f do not encode empty host 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1973 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-14 01:41:29 +00:00
calvin
9c40e54e1e encode index.html data 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1971 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-13 23:40:17 +00:00
calvin
f0048d0345 add unicode domain name warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1970 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-13 23:30:14 +00:00
calvin
75ec50b156 adjust for new url_norm method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1965 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-13 11:20:33 +00:00
calvin
e429264733 support unicode domain names 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1964 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-13 11:20:16 +00:00
calvin
820d07ba6f os-specific path name quote chars, and IDN support for hostnames 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1963 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-12 13:34:17 +00:00
calvin
7c83266566 serialize helper function 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1962 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-12 13:25:40 +00:00
calvin
8ba7bccf5a separate encode function for loggers 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1961 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-11 08:56:56 +00:00
calvin
1997381c2b return unicode url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1960 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-10 16:41:41 +00:00
calvin
6ddf286c36 platform specific test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1959 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-10 16:41:13 +00:00
calvin
3d81638b8f use intern __repr__(), not repr() 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1958 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-10 14:31:34 +00:00
calvin
25770a1109 encode failure messages 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1956 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-10 13:13:05 +00:00
calvin
34c2168807 use unicode url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1955 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-10 13:12:41 +00:00
calvin
e61ea956cc add url needs quoting for pipe char test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1951 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 17:56:17 +00:00
calvin
7ee019da0f add pipe to safe url chars 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1950 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 17:55:03 +00:00
calvin
088cf521a8 return unicode strings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1949 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 17:54:20 +00:00
calvin
bb0921b1ba added no path quote test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1948 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 17:24:03 +00:00
calvin
e56fe74904 add | to nopathquote characters for windows file: links 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1947 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 17:21:45 +00:00
calvin
2be584891b norm changed base url again 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1945 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 17:02:42 +00:00
calvin
85497ca439 typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1944 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 16:58:51 +00:00
calvin
d671254279 make --quiet an alias for -o none 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1943 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 16:04:05 +00:00
calvin
19ce868d8f colored output disabled for windows platforms 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1940 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 15:46:14 +00:00
calvin
60750494b8 implement windows ANSI color support check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1937 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 14:02:18 +00:00
calvin
a87b8a64d2 do not catch exceptions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1936 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 12:39:53 +00:00
calvin
75c36e0e02 do not catch exceptions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1935 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 12:38:02 +00:00
calvin
f70ef0198d wrap should handle line endings os-specific 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1934 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 11:10:10 +00:00
calvin
2b60a133ba retain empty text arg in wrap() method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1933 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 10:28:33 +00:00
calvin
6a5fdb57c1 fix dns test on windows systems 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1932 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 10:19:01 +00:00
calvin
d238920739 added network resource 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1931 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 09:46:52 +00:00
calvin
9f95017d5b case sensitivity checking of NT filenames 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1927 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 08:11:09 +00:00
calvin
f01b2e7c4e fix typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1925 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 00:29:06 +00:00
calvin
c97f68f70a accept unicode in robots.txt can_fetch 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1924 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-09 00:00:59 +00:00
calvin
30024a4683 optimize img_re regular expression 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1919 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-06 12:43:48 +00:00
calvin
6f488fd189 remember base href in link parser 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1918 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-06 12:42:33 +00:00
calvin
607425065e add cache key asserts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1917 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-05 00:24:36 +00:00
calvin
2ba4a50965 ensure unicode for redirects 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1916 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-05 00:24:25 +00:00
calvin
437b56c9ad assert msgs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1915 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-05 00:24:08 +00:00
calvin
01f1c06149 no repr of url name 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1913 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 22:35:29 +00:00
calvin
4cae7dc7f6 test fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1912 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 22:34:20 +00:00
calvin
9b28e3b346 unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1911 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 21:29:25 +00:00
calvin
69041b2d9a do not catch log system exceptions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1910 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 17:51:54 +00:00
calvin
00b1a426d1 convert url names to unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1909 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 13:50:54 +00:00
calvin
34081d925b unicode repr 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1908 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 13:49:59 +00:00
calvin
84498b914a unicode diffs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1907 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 13:49:23 +00:00
calvin
4894467ca9 cut off leading 'u' of repr names 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1906 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-03 13:49:09 +00:00
calvin
ad78277935 accept unicode domain names according to RFC3490 (IDNA) 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1903 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-02 13:16:23 +00:00
calvin
78a7af2dbf accept unicode filenames in resolver config 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1902 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-02 13:05:39 +00:00
calvin
96722d09f1 coerce urls to unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1901 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-11-02 13:05:11 +00:00
calvin
4485cb4800 also overload NullTranslations gettext class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1900 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-28 16:03:42 +00:00
calvin
de68f20f89 unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1899 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 22:34:50 +00:00
calvin
abfd6c475d unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1898 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 21:03:02 +00:00
calvin
54b8126ccb cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1896 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:49:59 +00:00
calvin
b7f2c0eeab unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1894 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:48:50 +00:00
calvin
9ad203eef5 simplify, simplify 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1893 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:42:56 +00:00
calvin
f3a2f7e1a0 better deferred translation of field names 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1892 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:31:09 +00:00
calvin
29a6fc783d unicode fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1891 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:29:25 +00:00
calvin
b99c8a15e8 better deferred translation of field names 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1890 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:27:27 +00:00
calvin
dee1c867ff encode msgs to stderr 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1889 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-10-27 19:19:29 +00:00