Chris Mayo
d58b3ab285
Remove unused url.url_fix_common_typos()
2020-08-18 19:57:46 +01:00
Chris Mayo
9488e1eb41
Remove unused url.is_safe_x matches
2020-08-18 19:57:46 +01:00
Chris Mayo
71ea78382b
Remove unused url.safe_host_pattern()
2020-08-18 19:57:46 +01:00
Chris Mayo
794efd6d44
Remove unused url.is_duplicate_content_url()
2020-08-18 19:57:46 +01:00
Chris Mayo
e372657fb8
Remove unused url.get_content()
2020-08-18 19:57:46 +01:00
Chris Mayo
e4ba9c84ce
Remove unused url.match_{host,url}()
...
Removes deprecation warnings for urllib.parse.split{host,type}() in
url_split()
2020-08-18 19:57:46 +01:00
Chris Mayo
b32fe6f692
Merge pull request #478 from cjmayo/imp
...
Fix deprecation warning for use of the imp module
2020-08-18 19:56:40 +01:00
Chris Mayo
4ad20d7f03
Merge pull request #477 from cjmayo/sitemap
...
Detect sitemaps that do not start with an XML declaration
2020-08-18 19:51:32 +01:00
Chris Mayo
9d6e8f951b
Merge pull request #476 from cjmayo/linkcheckerrc
...
Add missing settings to the example linkcheckerrc
2020-08-18 19:46:20 +01:00
Chris Mayo
5d83e93829
Merge pull request #475 from cjmayo/iana
...
Update IANA scripts and ignored schemes
2020-08-18 19:40:35 +01:00
Chris Mayo
2a8b64a2c7
Merge pull request #485 from jonringer/patch-1
...
Update Makefile to use python3
2020-08-18 19:33:53 +01:00
Jon
d6ac167fe6
Update Makefile to use python3
...
Not sure if this file is still being used, but noticed it still pointed to a python version that no longer builds
2020-08-16 19:50:59 -07:00
Chris Mayo
0086c28b3a
Merge pull request #474 from cjmayo/srcset
...
Fix problems with trailing commas and data: URIs in srcset values
2020-08-15 16:58:38 +01:00
Chris Mayo
0269fd88b0
Merge pull request #473 from cjmayo/valueerror
...
Fix critical exception when parsing a URL with a ]
2020-08-15 16:51:17 +01:00
Chris Mayo
88566ad20a
Merge pull request #472 from cjmayo/baseref
...
Fix CSV logger not recognising base part setting
2020-08-15 16:41:57 +01:00
Chris Mayo
525b6751a9
Merge pull request #468 from cjmayo/interrupter
...
Rename director/interrupt.py to director/interrupter.py
2020-08-15 16:31:33 +01:00
Chris Mayo
ccaa882d50
Merge pull request #471 from cjmayo/status
...
Fix status=0 setting being ignored
2020-08-14 20:02:01 +01:00
Chris Mayo
33a5444dea
Merge pull request #469 from cjmayo/checklink
...
Remove defaults from lc_cgi.checklink()
2020-08-14 19:57:03 +01:00
Chris Mayo
b2d5498cbf
Merge pull request #467 from cjmayo/faq
...
Update the FAQ with plugins for HTML and CSS syntax checking
2020-08-14 19:50:32 +01:00
Chris Mayo
5aa2ddce4d
Merge pull request #461 from cjmayo/docstrings
...
Fix formatting and typos in docstrings
2020-08-14 19:45:41 +01:00
Chris Mayo
84c5e512ac
Merge pull request #459 from cjmayo/cached
...
Log a debug message when a cached URL is skipped
2020-08-14 19:41:04 +01:00
Chris Mayo
8c804c35a5
Detect sitemaps that do not start with an XML declaration
2020-08-11 19:35:56 +01:00
Chris Mayo
658c8051f0
Fix deprecation warning for use of the imp module
2020-08-10 19:32:04 +01:00
Chris Mayo
80763ed1ea
Add slack to the list of ignored schemes
...
slack:// is a way to interact with a local Slack client [1], and is not
something that LinkChecker can check.
[1] https://api.slack.com/reference/deep-linking#client
2020-08-09 17:10:26 +01:00
Chris Mayo
f19fd4f5bc
Update IANA scripts and ignored schemes (2020-07-28)
2020-08-09 17:10:26 +01:00
Chris Mayo
84a45b5171
Add missing settings to the example linkcheckerrc
2020-08-09 17:05:34 +01:00
Chris Mayo
d5690203fc
Fix critical exception when parsing a URL with a ]
...
e.g.:
<a href="http://localhost ]">square</a>
Causes urllib to raise a ValueError:
File "/usr/lib/python3.8/site-packages/linkcheck/url.py", line 315, in url_norm
line: urlparts = list(urllib.parse.urlsplit(url))
locals:
urlparts = <not found>
list = <builtin> <class 'list'>
urllib = <global> <module 'urllib' from '/usr/lib/python3.8/urllib/__init__.py'>
urllib.parse = <global> <module 'urllib.parse' from '/usr/lib/python3.8/urllib/parse.py'>
urllib.parse.urlsplit = <global> <function urlsplit at 0x7f950e699e50>
url = <local> 'http://localhost ]', len = 17
File "/usr/lib/python3.8/urllib/parse.py", line 440, in urlsplit
line: raise ValueError("Invalid IPv6 URL")
locals:
ValueError = <builtin> <class 'ValueError'>
2020-08-08 16:47:31 +01:00
Chris Mayo
27f22ae17a
Fix treating data: URIs in srcset values as links
2020-08-07 20:04:23 +01:00
Chris Mayo
7ba4053710
Fix critical exception if srcset value ends with a comma
...
Log a debug message as this is a minor syntax problem, won't stop
LinkChecker parsing strings up to the comma.
2020-08-07 20:04:23 +01:00
Chris Mayo
f3a823fb5b
Fix CSV logger not recognising base part setting
2020-08-07 19:45:24 +01:00
Chris Mayo
4f3f1ac0d4
Fix status=0 setting being ignored
...
- Set the correct default for the setting in configuration.Configuration
- Detect when the argument is not passed by setting the default to None
(store_false sets the default to True)
2020-08-06 19:32:33 +01:00
Chris Mayo
40b2ebff8f
Remove defaults from lc_cgi.checklink()
...
Only called from application() with arguments. Causes local environment
to be embedded in documentation when using Sphinx autodoc.
2020-08-05 19:54:56 +01:00
Chris Mayo
46b9e6b169
Rename director/interrupt.py to director/interrupter.py
...
Avoid a clash with director.interrupt() when automatically documenting.
2020-08-03 19:48:07 +01:00
Chris Mayo
39af879e68
Update the FAQ with plugins for HTML and CSS syntax checking
...
Options removed in 8.5:
64d95e45 ("Remove local HTML and CSS syntax check.", 2013-02-08)
Plugins added in 9.0:
7b34be59 ("Introduce check plugins, use Python requests for http/s
connections, and some code cleanups and improvements.", 2014-03-01)
2020-08-03 19:47:32 +01:00
Chris Mayo
dee21ee9a0
Fix formatting and typos in docstrings
2020-07-25 16:35:48 +01:00
Chris Mayo
500c13e2cb
Log a debug message when a cached URL is skipped
...
Skipping introduced in:
eaa538c8 ("don't check one url multiple times", 2016-11-09)
2020-07-21 19:54:18 +01:00
Chris Mayo
a977e4d712
Merge pull request #444 from cjmayo/isinstance
...
Remove or replace uses of isinstance()
2020-07-08 19:55:29 +01:00
Chris Mayo
7a0644a234
No need to process an empty string in str_format.ascii_safe()
2020-07-08 19:47:59 +01:00
Chris Mayo
282f8c970d
Merge pull request #442 from cjmayo/unicode_safe
...
Remove strformat.unicode_safe()
2020-07-08 19:38:56 +01:00
Chris Mayo
10170b2966
Add a test for the LocationInfo plugin
...
Because the GeoIP database now requires registration to download the
result of the lookup using geoip-database is not going to change.
2020-07-07 17:25:28 +01:00
Chris Mayo
b328520f08
Convert UrlBase syntax Exception to a string
...
Causes an exception when logging.
2020-07-07 17:25:28 +01:00
Chris Mayo
53bd5c4d21
Remove HttpUrl.getheader()
2020-07-07 17:25:28 +01:00
Chris Mayo
1018b8332b
Convert PDF URL to a string
2020-07-07 17:25:28 +01:00
Chris Mayo
3fcee872b6
urlparts need to support assignment
2020-07-07 17:25:28 +01:00
Chris Mayo
d91a328224
Remove strformat.unicode_safe() and strformat.url_unicode_split()
...
All strings support Unicode in Python 3.
2020-07-07 17:25:28 +01:00
Chris Mayo
4cb5b6f2fa
Merge pull request #443 from cjmayo/kde5
...
Replace KDE 3 proxy support with KDE 5 support
2020-07-07 17:12:53 +01:00
Chris Mayo
ab6315a8d3
Merge pull request #453 from cjmayo/brew
...
Update Mac installation instructions with Homebrew pip and macOS
2020-07-07 17:07:46 +01:00
Chris Mayo
18f20d592f
Check for KDE 5 proxy first and then KDE 4
...
Don't look for kde4-config in case a KDE 5 user still has it installed.
2020-07-07 17:06:25 +01:00
Chris Mayo
bd55c2ef8f
Compare KDE proxy ReversedException integer value to zero
2020-07-07 17:06:25 +01:00
Chris Mayo
893875d913
Update Mac installation instructions with Homebrew pip and macOS
...
The first release of macOS was in 2016.
2020-07-06 19:41:51 +01:00