Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-13 09:03:11 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
2823 commits 1 branch 0 tags 24 MiB
Commit graph

1314 commits

Author SHA1 Message Date
calvin
50ea41b12d use preferred locale for default encoding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2878 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 17:22:12 +00:00
calvin
753b907d51 remove unneeded imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2871 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:56:57 +00:00
calvin
66a30acc2d assume cStringIO is there 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2870 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:56:22 +00:00
calvin
6ca5dea8c3 define fs var 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2869 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:56:07 +00:00
calvin
19a290d81a query and anchor quoting tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2868 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:55:53 +00:00
calvin
9c8cee034a quote anchor 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2866 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:50:48 +00:00
calvin
8c809d1dc3 break long line 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2865 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:50:05 +00:00
calvin
25044ce08b print errors in the preferred encoding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2864 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-13 12:49:52 +00:00
calvin
c205cec12d remove script tag 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2859 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 20:09:40 +00:00
calvin
4e1bbfea64 adjust yyget_extra definition 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2858 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 16:16:19 +00:00
calvin
9eaf38d563 sane sparse path 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2857 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 16:15:55 +00:00
calvin
9076eaa7da python2.4, add sparse check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2856 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 16:15:00 +00:00
calvin
732366b3f5 add string include for size_t 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2855 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 15:53:32 +00:00
calvin
8953766ccd fix url part quoting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2853 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 14:08:14 +00:00
calvin
2da64736ba remove unneeded init_i18n() calls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2852 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 13:00:33 +00:00
calvin
80b6ba5416 init i18n on module load 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2850 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:52:36 +00:00
calvin
6dd4ac6a65 typo fixes 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2849 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:52:28 +00:00
calvin
7cf3f83c0f better recursion check debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2848 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:39:46 +00:00
calvin
978ba63999 catch UnicodeError on syntax check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2847 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:10:32 +00:00
calvin
fccccac818 coerce to unicode in url_norm if arg was unicode 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2845 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 12:09:16 +00:00
calvin
8cfcbf075a use archived musi-cal robots.txt page 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2844 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 10:08:58 +00:00
calvin
b48c6f7e96 fix default resolver init 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2843 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-11 09:55:26 +00:00
calvin
51f541607c catch CGI syntax errors in mailto: URLs and add a warning 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2841 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 23:06:07 +00:00
calvin
65150ad79e coerce to unicode after relative file handling 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2839 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:50:40 +00:00
calvin
e1192c078f do not append non-parseable meta refresh tags 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2838 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:21:59 +00:00
calvin
2bba7df3e7 handle case where func.__doc__ is None 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2837 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:10:32 +00:00
calvin
57c9f325a9 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2836 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:10:10 +00:00
calvin
5b6782c6a9 handle ignoreX and nofollowY stuff backwards compatible 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2834 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 22:05:16 +00:00
calvin
5c83b7c859 fix error call 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2833 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:59:46 +00:00
calvin
95081a62e6 remove unused imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2829 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:53:52 +00:00
calvin
ba6a2ed4e0 updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2819 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:15:09 +00:00
calvin
e11bc21593 new methods stripall and limit 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2818 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:14:05 +00:00
calvin
b28be779d7 ensure tags are ASCII, regen with bison 2.0 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2817 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:13:35 +00:00
calvin
4315e77ae1 dont use XXX markers here 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2816 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:12:41 +00:00
calvin
2ba2988d2c Add tests with invalid tag chars 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2815 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-10-10 21:12:12 +00:00
calvin
712df7d743 added quote_val 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2811 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:59:07 +00:00
calvin
a74e728246 ignore loopback interface 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2810 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:58:41 +00:00
calvin
fc4ce83372 dont quote exclams 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2809 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:57:36 +00:00
calvin
2f48855b32 added notimplemented 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2808 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:57:25 +00:00
calvin
da8a4d2cfe dynamic buffer for interface list 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2807 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:56:54 +00:00
calvin
4b697eccea added is_ascii and indent 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2806 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:55:51 +00:00
calvin
866999a883 added more tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2805 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-16 13:42:46 +00:00
calvin
37e8e21df6 add notimplemented 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2801 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-11 15:49:34 +00:00
calvin
d0dab1d0ac updated to dnspython 1.3.4 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2792 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-03 19:27:31 +00:00
calvin
33d3a6c974 fix invalid import in DNS resolver 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2790 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-08-03 18:47:32 +00:00
calvin
fe4395c41f test case for HTTP -> non-HTTP redirection 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2787 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 16:05:20 +00:00
calvin
f01b84b894 rework the redirection routine a little, putting warnings specifically for redirections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2786 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 15:51:12 +00:00
calvin
ed932cb165 debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2785 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 15:50:27 +00:00
calvin
f24bb87e54 add missing return 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2784 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 12:37:32 +00:00
calvin
afa8750dc3 catch ValueError raised by urllib2 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2783 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 09:45:30 +00:00
calvin
317ef181f0 handle all redirections to different URL schemes, 
not just HTTP -> not HTTP, and fix a variable typo


git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2780 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-20 08:53:57 +00:00
calvin
0d55ea45b7 fix variable clash 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2776 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-18 08:19:11 +00:00
calvin
b94eec79ef use correct value for status output of checked links 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2773 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-17 23:26:13 +00:00
calvin
9fa3a1216c replace 'print' with 'write' 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2772 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-16 07:12:44 +00:00
calvin
c553e233b7 change the custom XML format 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2770 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-16 07:12:15 +00:00
calvin
842333a36f write parent line/col as attrs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2765 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:51:07 +00:00
calvin
c2e235a154 fix end xml tag writing 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2763 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:46:13 +00:00
calvin
e2e80367d1 add copyright, add more documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2762 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:41:54 +00:00
calvin
19118a0198 make copyright ASCII 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2761 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:37:45 +00:00
calvin
0b5294ef57 set output encoding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2760 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:37:16 +00:00
calvin
3011eb5ee6 new custom XML logger 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2759 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 21:33:15 +00:00
calvin
6239880f15 simplify test suite generation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2756 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 14:24:25 +00:00
calvin
d347840dee use official HTTP status names 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2754 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-15 11:31:32 +00:00
calvin
baf51d1f5d cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2752 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 17:56:05 +00:00
calvin
359612b6fe add missing import 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2751 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 17:53:27 +00:00
calvin
225c045815 do not cache unusual errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2750 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 17:11:13 +00:00
calvin
5d82d64c31 more result sanity check warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2749 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 13:35:18 +00:00
calvin
3fb9de0847 upstream updates 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2748 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-14 13:34:45 +00:00
calvin
c140b510b1 fix warning tags 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2746 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-13 19:33:26 +00:00
calvin
f80480469f config to ignore certain warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2743 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-13 15:03:17 +00:00
calvin
badb88ed68 use errno constant EPIPE 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2742 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-12 18:36:03 +00:00
calvin
5b5eda36e4 updated from python CVS 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2741 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-12 18:09:15 +00:00
calvin
b559c4f82e test for hierarchical URLs, and retain non-numeric port parts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2739 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-12 07:18:13 +00:00
calvin
907facaf16 put start_server into the try-finally clause 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2738 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-12 07:17:01 +00:00
calvin
34ced03fc2 added more norming tests 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2737 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 21:58:58 +00:00
calvin
5049e261fe added LOG_DNS 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2734 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 15:37:15 +00:00
calvin
bf9e55c1c8 updated documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2731 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 14:43:52 +00:00
calvin
3ce6aadfd6 updated documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2730 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 14:37:52 +00:00
calvin
e5197d429a added error check macro, and check errors on html_end_tag invocation. Also some documentation updates 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2729 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-11 12:02:18 +00:00
calvin
5244431a42 add ascii_safe method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2719 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-05 22:06:38 +00:00
calvin
56b2b422a9 ensure that thread name is ascii 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2718 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-05 22:06:18 +00:00
calvin
bb2b227b13 catch all errors on url check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2717 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-05 22:05:54 +00:00
calvin
e7ca18403a work around python bug occuring with incomplete gzip streams 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2716 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-05 19:56:42 +00:00
calvin
901227d436 assign extern info to local var 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2709 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-04 22:19:52 +00:00
calvin
aadd6fd71f fix typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2708 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-04 22:19:22 +00:00
calvin
5f2d11b613 fix logger using extern attribute 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2705 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-04 21:48:55 +00:00
calvin
2e207be127 allow empty relative URLs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2704 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-04 20:28:55 +00:00
calvin
55109f9111 fix log level 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2687 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-07-03 23:08:26 +00:00
calvin
23707a4471 added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2684 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 13:37:13 +00:00
calvin
f09d54f75b meta tests added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2683 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 13:36:52 +00:00
calvin
10bbe998c7 accept more meta tag urls for checking, eg favicons 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2682 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 13:36:39 +00:00
calvin
506eaa21b5 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2680 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 10:03:04 +00:00
calvin
555e2dc2a4 fixed test output 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2679 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-28 09:57:31 +00:00
calvin
49aa4ec208 remove unused imports 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2678 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-27 15:02:10 +00:00
calvin
1df5b81f0e updated test result data 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2677 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-23 16:21:26 +00:00
calvin
0c3e78569c fix norming 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2676 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-23 16:21:05 +00:00
calvin
217d34bb54 use new extern check 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2675 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-22 12:30:03 +00:00
calvin
d48eb20a28 support extern filter in ignored url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2672 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-20 14:53:23 +00:00
calvin
990d548424 don't delete from incoming queue while iterating, but after. SF #1223920 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2671 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-20 09:49:27 +00:00
calvin
51e4657cf6 add one more parent path test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-12 21:19:12 +00:00
calvin
ea052008a2 send the complete email address with VRFY command 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2654 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-12 21:17:10 +00:00
calvin
cc0f7cb113 always norm a URL before sending a request 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2653 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-12 21:16:47 +00:00
calvin
eba33c61e6 resync with python 2.4 httplib 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2652 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-12 20:58:09 +00:00
calvin
125707fceb parse combined start/end tags in tag parsers, and added a test for that 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2649 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-09 15:10:29 +00:00
calvin
1b0e300f5d use cache_url_key instead of old get_cache_key() method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2648 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-09 15:08:53 +00:00
calvin
d965a387d5 catch curses setupterm errors 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2643 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-07 10:38:33 +00:00
calvin
c9239135b1 fix exception test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-06-02 21:54:41 +00:00
calvin
79d0850fed fix intern url of file: links 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2636 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-22 20:28:59 +00:00
calvin
fec843814c fix intern url of file: links 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2635 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-22 20:27:32 +00:00
calvin
c51a60e0b5 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2627 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 23:02:44 +00:00
calvin
afca416b67 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2625 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 20:25:01 +00:00
calvin
43c6ea202d remove unused 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2624 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:57:12 +00:00
calvin
6d8f0146d6 fix GET fallback handling 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2623 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:53:13 +00:00
calvin
d2107c7a6a split and fix initialization of UrlData objects 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2622 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:42:14 +00:00
calvin
cd32e823df fix url util call 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2621 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:02:52 +00:00
calvin
9666421a10 add log_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2620 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:02:40 +00:00
calvin
1fc5eb32b6 fix extern calculation and a typo 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2619 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:02:16 +00:00
calvin
f6f04e376e fix extern calculation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2618 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 19:01:51 +00:00
calvin
d6e56ceba2 remove lock from check_url in case of disabled threading 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2617 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 18:30:06 +00:00
calvin
3407ab362d syntax 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2616 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 18:29:38 +00:00
calvin
55d7d5f7df use a decorator to synchronize all the checker threads 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2614 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-19 15:49:06 +00:00
calvin
3f6d2fa753 specify thread name 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2613 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 22:16:23 +00:00
calvin
781ad5fdc0 catch exceptions on abort 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2612 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 22:15:54 +00:00
calvin
fd652881fb thread name and maximum wait for finish 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 22:15:18 +00:00
calvin
3db056f161 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2610 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 22:14:45 +00:00
calvin
4c270cfe74 log message formatting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2609 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 18:04:54 +00:00
calvin
e697b7a3ce more generic nt filename test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2608 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 18:04:05 +00:00
calvin
e1e7055e79 trace filtering 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2606 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 17:58:35 +00:00
calvin
7df1caf58c documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2605 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 17:57:41 +00:00
calvin
a51a0913d3 nt specific test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2604 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 17:56:52 +00:00
calvin
63b76ec642 Use HTTPMessage() in all urllib handlers, really fixing the bug noted in http://www.python.org/sf/1117588. The workaround has been removed. 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2603 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-18 17:53:39 +00:00
calvin
cb54822dac trace ignore names 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2602 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-17 22:46:05 +00:00
calvin
c0d9e56a4d new trace option 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2601 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-17 22:06:47 +00:00
calvin
50c536c82a lock debug 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2600 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-17 22:06:17 +00:00
calvin
0ea778b6fd dont trace with log function, else a deadlock occurs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2599 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-17 21:49:09 +00:00
calvin
ed738d2436 cmdline param defaults to False 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2595 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-17 19:00:17 +00:00
calvin
a85ac68e16 cmdline param 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2594 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-17 14:12:30 +00:00
calvin
e3a049ee27 make intern pattern of parent path 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2593 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-17 14:11:17 +00:00
calvin
6862ba1433 ability to set cmdline param in direct test 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2592 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-17 09:40:34 +00:00
calvin
153ea4fa06 add cmdline arg to get_url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2591 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-13 15:47:07 +00:00
calvin
1ec0c53c91 sanitize CGI env, add strip to goodaddrs 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2590 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-13 15:46:31 +00:00
calvin
9413039083 updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2589 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-13 15:41:44 +00:00
calvin
d821abce85 news group info string 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2588 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-13 14:01:53 +00:00
calvin
666ead2bb3 updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2587 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-13 14:01:25 +00:00
calvin
51fdb7e4a3 updated 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2586 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-13 13:50:41 +00:00
calvin
208a7f095f added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2585 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-09 22:07:45 +00:00
calvin
1a7a771648 new intern/extern handling 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2584 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-09 22:05:21 +00:00
calvin
ce2f2482eb URL consistency 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2582 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-08 20:16:52 +00:00
calvin
6ff56a53cc rename logger fields to logger parts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2579 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-08 20:06:40 +00:00
calvin
cd899b7e57 updated test results 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2574 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2005-05-06 22:28:49 +00:00