Commit graph

425 commits

Author SHA1 Message Date
calvin
e0a063104e parse css files recursively
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1058 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-17 10:53:48 +00:00
calvin
160237bd52 match multiple css urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1057 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-17 06:36:22 +00:00
calvin
8f9e0d7a97 check CSS background image urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1052 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-16 20:39:59 +00:00
calvin
7f3fc94dc1 accept more windows path specifications
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1046 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-10 13:30:44 +00:00
calvin
771d327f15 secure url pattern for cgi checking
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1044 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-05 15:47:07 +00:00
calvin
c744aa56fc use new robotparser2
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1042 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-09-23 22:00:14 +00:00
calvin
c4d243dfc7 re-added robotparser2.py, updated it
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1041 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-09-23 21:59:17 +00:00
calvin
8da038d3ef rebuild parser, ignore invalid leading attr backslash
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1031 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-09-11 21:54:36 +00:00
calvin
654b1007f5 umask setting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1028 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-29 13:03:29 +00:00
calvin
3fef6f6023 fix js script comment line parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1026 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-29 11:58:59 +00:00
calvin
7ff1edcd90 fix parsing of trailing end tag garbage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1023 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-19 11:48:49 +00:00
calvin
7e5970d256 remove unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1020 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-18 22:14:47 +00:00
calvin
c03e824438 use new-style classes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1008 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 13:19:39 +00:00
calvin
15a073de00 typo fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1007 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 13:01:33 +00:00
calvin
d648290705 csv logging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1002 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 12:41:55 +00:00
calvin
cbaebd7999 boolean stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1001 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 12:29:11 +00:00
calvin
d464c8ba15 check for python2.3
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1000 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 12:03:36 +00:00
calvin
3fb419154a more boolean stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@999 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:54:26 +00:00
calvin
8c1deec0c9 use boolean values, timeout changes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@998 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:49:30 +00:00
calvin
b2d6226b79 remove robotstxt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@997 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:31:29 +00:00
calvin
ad54ca88a4 use boolean values
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@996 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:31:00 +00:00
calvin
648df944b0 updated for python2.3
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@995 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:19:38 +00:00
calvin
d14a47ed1c use startswith method, updated re usage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@993 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:18:33 +00:00
calvin
119d8e2ea7 fix cgi output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@990 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-08 00:49:48 +00:00
calvin
e560a650cf updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@988 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-07 22:36:32 +00:00
calvin
5fdf81c56c fix proxy scheme
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@983 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-07 10:30:26 +00:00
calvin
6d724d04a4 handle http redirections to non-http url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@981 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-07 10:18:39 +00:00
calvin
72aeaf8e6e rename column name to col
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@975 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-05 12:59:24 +00:00
calvin
d25b0d51ce fix denyllow match for intern patterns
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@972 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-05 12:20:55 +00:00
calvin
cfb7937ed9 allow colon in attr names for namespaces
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@970 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-01 00:49:16 +00:00
calvin
307e57ba0d redirection fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@961 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 12:05:24 +00:00
calvin
09d916058a also accept a list of cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@960 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 11:25:40 +00:00
calvin
087eb8f3b6 restructuring
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@959 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 11:13:11 +00:00
calvin
33070b0923 do not warn missing backslash on .html files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@958 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 11:08:35 +00:00
calvin
cf17757fae check cache again on redirects
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@957 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 10:55:16 +00:00
calvin
2be119e899 quote url before request submit, previous map() call was useless
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@950 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-23 23:26:39 +00:00
calvin
9343fe7cd8 accept broken comment begin
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@947 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-10 12:20:44 +00:00
calvin
a4bcfca88e fix bug in strict check domain guessing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@942 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-09 20:36:44 +00:00
calvin
1d9a192f0e getRobotsTxtUrl function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@938 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-04 15:06:35 +00:00
calvin
308ceb45c5 add coding line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@933 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-04 14:24:44 +00:00
calvin
56a80ee9d1 add double quotes around all attributes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@930 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-04 14:21:20 +00:00
calvin
a3c938b8ae add domain colon for -s
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@927 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-25 20:03:17 +00:00
calvin
0dbf0949bd remove unused reges
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@926 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-24 20:57:57 +00:00
calvin
a3c0a2a9c6 cleanup, minor text parsing glitch
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@924 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-24 20:57:24 +00:00
calvin
6ef38e8454 fix thread option, minor cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@923 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-24 20:57:03 +00:00
calvin
9e9a8c63b7 enable automatic intern link config for -s
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@911 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-18 09:03:51 +00:00
calvin
ec4c6a0c81 inifinite recursion
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@907 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-18 07:50:08 +00:00
calvin
5680daff09 fix entity resolving
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@899 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-06 09:34:20 +00:00
calvin
3c78149f48 fix tag parsing with missing >
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@898 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-05 13:50:19 +00:00
calvin
98a0c329d8 also get id attributes on anchor check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@891 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-21 22:25:03 +00:00