Commit graph

1075 commits

Author SHA1 Message Date
calvin
153ea4fa06 add cmdline arg to get_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2591 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-13 15:47:07 +00:00
calvin
1ec0c53c91 sanitize CGI env, add strip to goodaddrs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2590 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-13 15:46:31 +00:00
calvin
9413039083 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2589 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-13 15:41:44 +00:00
calvin
d821abce85 news group info string
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2588 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-13 14:01:53 +00:00
calvin
666ead2bb3 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2587 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-13 14:01:25 +00:00
calvin
51fdb7e4a3 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2586 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-13 13:50:41 +00:00
calvin
208a7f095f added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2585 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-09 22:07:45 +00:00
calvin
1a7a771648 new intern/extern handling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2584 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-09 22:05:21 +00:00
calvin
ce2f2482eb URL consistency
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2582 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-08 20:16:52 +00:00
calvin
6ff56a53cc rename logger fields to logger parts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2579 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-08 20:06:40 +00:00
calvin
cd899b7e57 updated test results
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2574 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-06 22:28:49 +00:00
calvin
6919a06d8c fix backtrace printing, and only call _log when the loglevel is enabled
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2573 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-06 22:17:23 +00:00
calvin
829e19e7ee cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2572 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-06 22:15:12 +00:00
calvin
c07f42031a ignored urls only issue an info instead of a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2569 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-06 14:59:22 +00:00
calvin
6eb990d227 do not hardcode output locale
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2568 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-06 13:21:10 +00:00
calvin
b6662a3098 use startswith method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2567 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-06 13:06:27 +00:00
calvin
cd3f5294cb better file descriptor initialization and closing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2566 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-06 13:05:16 +00:00
calvin
bf8fd348aa better msg
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2564 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-04 13:22:10 +00:00
calvin
532a04e436 method change is an info, not a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2563 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-04 13:18:19 +00:00
calvin
96b74a1f41 collapse reduntant dot path at beginning of url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2558 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-04 12:58:38 +00:00
calvin
fd8c56397a updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2557 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-04 11:44:02 +00:00
calvin
49a2dee338 make robots.txt deny an info instead of a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2555 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-04 10:48:48 +00:00
calvin
a39f635b82 use some %r in warning strings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2554 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-04 10:48:10 +00:00
calvin
b6e146750d try to read only existing default config files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-02 14:46:47 +00:00
calvin
d2a8764d18 do not store aliases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2550 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-27 12:48:48 +00:00
calvin
23e5212c7d do not remove userinfo from host part of url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2544 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-26 17:53:31 +00:00
calvin
dc2b0feca4 removed redirection warnings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2543 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-26 17:51:41 +00:00
calvin
82dee6ae52 reintroduce the self.url updated, this time only for redirections but without a warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2542 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-26 17:51:15 +00:00
calvin
93ce3364b0 split CGI params on both ampersand and semicolon
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2541 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-26 17:28:12 +00:00
calvin
134c76de4a only use signals on posix systems
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2538 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-25 23:49:59 +00:00
calvin
60069a8862 improved internal error msg
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2537 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-25 23:46:37 +00:00
calvin
53b5f67745 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2536 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-25 23:45:54 +00:00
calvin
c95c4b11d7 added tracing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2535 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-25 23:02:40 +00:00
calvin
5e6317a4bb remove old warning, and move effective url test to urlbase
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2532 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-25 18:25:32 +00:00
calvin
006f79702e make warnings enabled as default
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2529 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-25 14:52:52 +00:00
calvin
71407d0399 use new logger interface
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2528 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-25 14:52:38 +00:00
calvin
040139e6d8 count errors, warnings and number of checked links in the logger classes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2527 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-25 14:51:35 +00:00
calvin
f94f910209 signal handler
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2523 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-22 20:15:10 +00:00
calvin
7925d5dd56 use collections.deque for incoming queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2518 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-13 21:05:52 +00:00
calvin
813e1955d9 use pydoc.pager()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2511 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-04-07 13:46:24 +00:00
calvin
ba5939c7c5 allow optional empty url path
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2500 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-31 13:50:11 +00:00
calvin
cf05e2cb6f correct get_cache_keys method name
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2499 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-31 08:18:50 +00:00
calvin
bfe3f4cd4d do not add aliases that are in-progress
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2491 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 20:37:06 +00:00
calvin
5b64583904 add ignore_missing flag and do not cache already-cached aliases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2490 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 20:26:35 +00:00
calvin
eeb6da8330 do not cache HTTP connections with pending data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2487 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 18:47:09 +00:00
calvin
ecd7e44935 add assertion for check queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2481 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 15:52:40 +00:00
calvin
911e2eb011 fix persistent connection detection
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2477 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 13:41:22 +00:00
calvin
7429dfa209 cached connection debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2476 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 13:40:54 +00:00
calvin
ccdeaa86b4 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2475 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 12:35:03 +00:00
calvin
ebb48fa3b8 use get_true method to ensure that urls are always a unicode string and not None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2472 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-03-29 11:31:17 +00:00