Commit graph

1133 commits

Author SHA1 Message Date
calvin
bb2b227b13 catch all errors on url check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2717 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-07-05 22:05:54 +00:00
calvin
e7ca18403a work around python bug occuring with incomplete gzip streams
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2716 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-07-05 19:56:42 +00:00
calvin
901227d436 assign extern info to local var
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2709 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-07-04 22:19:52 +00:00
calvin
aadd6fd71f fix typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2708 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-07-04 22:19:22 +00:00
calvin
5f2d11b613 fix logger using extern attribute
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2705 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-07-04 21:48:55 +00:00
calvin
2e207be127 allow empty relative URLs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2704 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-07-04 20:28:55 +00:00
calvin
55109f9111 fix log level
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2687 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-07-03 23:08:26 +00:00
calvin
23707a4471 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2684 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-28 13:37:13 +00:00
calvin
f09d54f75b meta tests added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2683 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-28 13:36:52 +00:00
calvin
10bbe998c7 accept more meta tag urls for checking, eg favicons
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2682 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-28 13:36:39 +00:00
calvin
506eaa21b5 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2680 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-28 10:03:04 +00:00
calvin
555e2dc2a4 fixed test output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2679 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-28 09:57:31 +00:00
calvin
49aa4ec208 remove unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2678 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-27 15:02:10 +00:00
calvin
1df5b81f0e updated test result data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2677 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-23 16:21:26 +00:00
calvin
0c3e78569c fix norming
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2676 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-23 16:21:05 +00:00
calvin
217d34bb54 use new extern check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2675 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-22 12:30:03 +00:00
calvin
d48eb20a28 support extern filter in ignored url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2672 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-20 14:53:23 +00:00
calvin
990d548424 don't delete from incoming queue while iterating, but after. SF #1223920
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2671 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-20 09:49:27 +00:00
calvin
51e4657cf6 add one more parent path test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-12 21:19:12 +00:00
calvin
ea052008a2 send the complete email address with VRFY command
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2654 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-12 21:17:10 +00:00
calvin
cc0f7cb113 always norm a URL before sending a request
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2653 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-12 21:16:47 +00:00
calvin
eba33c61e6 resync with python 2.4 httplib
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2652 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-12 20:58:09 +00:00
calvin
125707fceb parse combined start/end tags in tag parsers, and added a test for that
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2649 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-09 15:10:29 +00:00
calvin
1b0e300f5d use cache_url_key instead of old get_cache_key() method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2648 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-09 15:08:53 +00:00
calvin
d965a387d5 catch curses setupterm errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2643 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-07 10:38:33 +00:00
calvin
c9239135b1 fix exception test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-06-02 21:54:41 +00:00
calvin
79d0850fed fix intern url of file: links
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2636 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-22 20:28:59 +00:00
calvin
fec843814c fix intern url of file: links
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2635 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-22 20:27:32 +00:00
calvin
c51a60e0b5 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2627 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 23:02:44 +00:00
calvin
afca416b67 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2625 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 20:25:01 +00:00
calvin
43c6ea202d remove unused
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2624 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 19:57:12 +00:00
calvin
6d8f0146d6 fix GET fallback handling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2623 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 19:53:13 +00:00
calvin
d2107c7a6a split and fix initialization of UrlData objects
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2622 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 19:42:14 +00:00
calvin
cd32e823df fix url util call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2621 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 19:02:52 +00:00
calvin
9666421a10 add log_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2620 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 19:02:40 +00:00
calvin
1fc5eb32b6 fix extern calculation and a typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2619 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 19:02:16 +00:00
calvin
f6f04e376e fix extern calculation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2618 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 19:01:51 +00:00
calvin
d6e56ceba2 remove lock from check_url in case of disabled threading
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2617 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 18:30:06 +00:00
calvin
3407ab362d syntax
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2616 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 18:29:38 +00:00
calvin
55d7d5f7df use a decorator to synchronize all the checker threads
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2614 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-19 15:49:06 +00:00
calvin
3f6d2fa753 specify thread name
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2613 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 22:16:23 +00:00
calvin
781ad5fdc0 catch exceptions on abort
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2612 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 22:15:54 +00:00
calvin
fd652881fb thread name and maximum wait for finish
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 22:15:18 +00:00
calvin
3db056f161 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2610 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 22:14:45 +00:00
calvin
4c270cfe74 log message formatting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2609 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 18:04:54 +00:00
calvin
e697b7a3ce more generic nt filename test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2608 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 18:04:05 +00:00
calvin
e1e7055e79 trace filtering
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2606 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 17:58:35 +00:00
calvin
7df1caf58c documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2605 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 17:57:41 +00:00
calvin
a51a0913d3 nt specific test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2604 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 17:56:52 +00:00
calvin
63b76ec642 Use HTTPMessage() in all urllib handlers, really fixing the bug noted in http://www.python.org/sf/1117588. The workaround has been removed.
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2603 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2005-05-18 17:53:39 +00:00