Commit graph

1027 commits

Author SHA1 Message Date
calvin
ccdeaa86b4 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2475 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 12:35:03 +00:00
calvin
ebb48fa3b8 use get_true method to ensure that urls are always a unicode string and not None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2472 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 11:31:17 +00:00
calvin
63a71baae6 add get_true method to ListDict
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2471 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 11:30:47 +00:00
calvin
f141255ab2 allow zero number of threads (means trheading disabled)
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2470 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 11:30:29 +00:00
calvin
a50c3ce40a use threader init param to set number of threads
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2469 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 11:29:49 +00:00
calvin
6cbbe9265e added misc html parse test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2468 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 11:28:51 +00:00
calvin
cbd333955e only strip line endings from test data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2467 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 11:28:07 +00:00
calvin
9cc3f978a6 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2465 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 08:52:40 +00:00
calvin
21757150f6 workaround for buggy l18n algorithm
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2464 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-28 23:52:46 +00:00
calvin
642e2d1698 do not split cgi params on semicolons
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2463 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-28 23:51:29 +00:00
calvin
1cf7426026 public method is_locked()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2462 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-28 15:56:25 +00:00
calvin
8e720030d1 check A RR records when no MX RR record could be found
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2461 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-28 14:59:17 +00:00
calvin
28d3b45819 aded
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2460 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-20 10:14:11 +00:00
calvin
bbf96868b8 document aliases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2458 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-18 14:21:12 +00:00
calvin
26e52022ea add aliases to cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2457 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-18 14:17:23 +00:00
calvin
e24c38c2aa redirect test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2456 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-18 14:16:56 +00:00
calvin
dcd407782d no double alias reset
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2454 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-18 00:02:50 +00:00
calvin
0b0e672b4e cleanup of the fallbacks
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2453 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-16 17:34:02 +00:00
calvin
9b982062fc do not translate countries
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2434 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-12 00:43:52 +00:00
calvin
0baec73a77 only find redirection links with http-equiv='refresh'
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2428 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-11 23:47:45 +00:00
calvin
6857196b25 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2426 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-11 23:15:13 +00:00
calvin
964f313a89 fix return codes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2424 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-11 22:39:34 +00:00
calvin
2b8ca62e2e split up the big check function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2423 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-11 22:37:09 +00:00
calvin
9c609c0852 fix debug log keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2422 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-11 22:12:18 +00:00
calvin
ac450295ac put country info in local check method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2412 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-11 20:30:41 +00:00
calvin
8d206bac94 nice value +10 for low prio
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2399 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-10 23:43:10 +00:00
calvin
0c19d24b5d no email in the user-agent
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2398 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-10 22:35:20 +00:00
calvin
882f204319 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2396 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-10 22:14:39 +00:00
calvin
131bea1a59 avoid deadlock with cache lock
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2395 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-10 22:09:41 +00:00
calvin
db299a1ead support printing tracebacks
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2394 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-10 22:03:40 +00:00
calvin
e89ef2c57a use own locking class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2393 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-10 22:03:09 +00:00
calvin
4c248fce03 avoid deadlock with cache lock
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2392 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-10 22:02:52 +00:00
calvin
4d0d76446f own locking class, avoiding multiple acquire/releases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2391 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-10 22:02:24 +00:00
calvin
7f4b062f7c fix lognames for -D option
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2389 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 21:57:51 +00:00
calvin
dc960185df only set connection debug level if CHECK logging is on debug
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2388 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 21:55:20 +00:00
calvin
7563f0edf9 fix lock class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2387 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 21:54:56 +00:00
calvin
3373644560 make the consumer a lock object itself
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2386 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 20:28:16 +00:00
calvin
8e289cc522 dont disable threading on thread debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2385 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 20:11:44 +00:00
calvin
932c9864cb new thread log name
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2384 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 20:09:21 +00:00
calvin
7f6d1b1022 more headers stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2382 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 14:59:03 +00:00
calvin
b3c3c3eaaa split off header methods in separate file
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2381 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 13:46:58 +00:00
calvin
ca49e04730 content encoding getter method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2380 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 13:39:20 +00:00
calvin
12b726b4df strip content type mime
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2379 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 13:33:20 +00:00
calvin
f344b75c8e documentation and syntax fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2378 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 10:26:30 +00:00
calvin
0d063a3b53 skip accept encoding, and list complete recursion list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2377 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-09 08:44:45 +00:00
calvin
4972a5b2f4 add warning on decompress errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2375 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-08 21:04:02 +00:00
calvin
a78ef198df disable logging on tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2373 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-08 20:59:49 +00:00
calvin
1e35c23986 eliminate tag attribute duplicates
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2372 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-08 20:51:38 +00:00
calvin
3913b28b3c allow quoted CSS style url, and strip matching quotes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2371 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-08 20:49:00 +00:00
calvin
7d11778b5a add link parser tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2370 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-08 19:30:11 +00:00