Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-04-19 22:01:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
6930 commits 1 branch 0 tags 24 MiB
Commit graph

1108 commits

Author SHA1 Message Date
Chris Mayo
a0eb6d5187 Align documentation of debug in man pages 
Linked to:
b3967f75 ("Correct documentation of --debug in linkchecker(1)", 2022-09-30)
 2022-10-18 19:24:08 +01:00
Chris Mayo
b6eea83f63
Merge pull request #676 from cjmayo/robotmap 
Document sitemaps in linkchecker(1)
 2022-10-17 19:25:57 +01:00
Chris Mayo
93f1d3f4ac Document sitemaps in linkchecker(1) 2022-10-17 19:21:03 +01:00
Chris Mayo
8bc849dfde Make --cookiefile description in linkchecker(1) a bit clearer 2022-10-17 19:21:03 +01:00
Chris Mayo
0c5db040c8 Support maxrequestspersecond less than one 2022-10-05 19:28:01 +01:00
Chris Mayo
e88cf49c8f Enable average HTTP request rate to be above 4 per second 2022-10-05 19:28:01 +01:00
Chris Mayo
354ea933ca
Merge pull request #673 from cjmayo/sitemap 
Fix sitemap output with multiple threads
 2022-10-05 19:20:40 +01:00
Chris Mayo
8b2fb86895 Remove AnchorCheck disabled note in linkcheckerrc(5) 
A partial revert of:
fe6dea12 ("Update documentation for disabled plugins", 2021-11-29)
 2022-10-03 19:33:05 +01:00
Chris Mayo
033dcf89f9
Merge pull request #671 from cjmayo/example 
Fix formatting of ignoreerrors example in linkcheckerrc(5)
 2022-10-03 19:22:36 +01:00
Chris Mayo
b3967f75c4 Correct documentation of --debug in linkchecker(1) 
dns logger was removed in:
e1f72490 ("Move dnspython module into third_party directory.", 2011-05-24)

Threading has not been disabled with --debug since:
eaa8a963 ("Refactor logging configuration.", 2014-05-10)
 2022-09-30 19:22:17 +01:00
Chris Mayo
61071fc5dc
Merge pull request #668 from cjmayo/defaults 
Clarify default values in initial linkcheckerrc and elsewhere
 2022-09-28 19:36:44 +01:00
Chris Mayo
001212b915 Fix formatting of ignoreerrors example in linkcheckerrc(5) 
Introduced in:
8c959589 ("add option to ignore specific errors for specific URLs", 2022-07-21)
 2022-09-28 19:23:04 +01:00
Lukas Pirl
8c959589c3
add option to ignore specific errors for specific URLs 2022-09-25 22:52:04 +02:00
Chris Mayo
4962a302b3 Document default frequency of sitemap logger 2022-09-22 19:24:55 +01:00
Chris Mayo
b8d0928969 Document dialect option of csv logger 2022-09-22 19:24:55 +01:00
Chris Mayo
38dea6b7f4 Fix install with pip git+https 
pip only uses the wheel target.

Save building the metadata twice as a result in GitHub workflows and
update documentation.md.
 2022-09-13 19:32:06 +01:00
Chris Mayo
b6a7f2d313 Don't need hatch to build documentation 
This is a partial revert of:
47d1015e ("Replace setuptools and setup.py with hatch and pyproject.toml", 2022-09-05)

Also hatch is an option to run tests.
 2022-09-13 19:32:06 +01:00
Chris Mayo
af265f3d52 Write all metadata used to _release.py 
Enables running without installing.
Removes use of importlib.metadata.
 2022-09-13 19:32:06 +01:00
Chris Mayo
30e8cfad77
Merge pull request #651 from cjmayo/rate 
Rename url-rate-limited to http-rate-limited
 2022-09-12 19:25:52 +01:00
Chris Mayo
a0b28cc0ff Rename url-rate-limited to http-rate-limited 
Make consistent with the other warnings:

- The first part of the name represents the checker class in which the
  warning is raised

- Update initial comment
 2022-09-06 19:32:24 +01:00
Chris Mayo
fdc4a2eeca Bring development.md up to date 2022-09-05 19:30:38 +01:00
Chris Mayo
728d826eb3 Fix typo makefiles in doc/Makefile 2022-09-05 19:30:38 +01:00
Chris Mayo
931f86848e Remove obsolete doc/dot-travis-osx.yml 2022-09-05 19:30:38 +01:00
Chris Mayo
c627b00755
Merge pull request #639 from cjmayo/hatch 
Replace setuptools and setup.py with hatch and pyproject.toml
 2022-09-05 19:27:48 +01:00
Chris Mayo
47d1015e00 Replace setuptools and setup.py with hatch and pyproject.toml 2022-09-05 19:24:01 +01:00
Chris Mayo
d6936ceb91 Add warning url-content-type-unparseable 2022-09-02 19:29:11 +01:00
Chris Mayo
fb8df6f089 Document URL list in linkchecker(1) 
First enabled in:
b1708fc7 ("get the complete content", 2004-09-03)
 2022-09-02 19:29:11 +01:00
Chris Mayo
f018cc9fd1 Fix typo addtion in linkcheckerrc(5) 2022-09-02 19:17:45 +01:00
Kian-Meng Ang
a70ea9ea14 Fix typos 
Found via `codespell ./linkcheck/ ./tests ./doc/man/en -L bu,noone,fo,pres,shttp`
 2022-09-02 17:20:02 +08:00
Chris Mayo
b35036af2b
Merge pull request #634 from cjmayo/pyxdg 
Remove dependency on pyxdg
 2022-08-30 19:28:03 +01:00
Chris Mayo
fbceca5dc9 Remove dependency on pyxdg 
Read the environment variables and implement the same fallbacks.
Saves a hardly used dependency and is more explicit.
 2022-08-23 19:26:15 +01:00
Chris Mayo
10f3d33041 Finish documenting the use of XDG_CONFIG_HOME and XDG_DATA_HOME 
Introduced by:
a03e2e4a ("use xdg dirs for config & data", 2017-10-17)
 2022-08-23 19:21:53 +01:00
Chris Mayo
3f42367280 Document using the GitHub release artifacts 2022-08-23 19:21:53 +01:00
Chris Mayo
edd4c8443c Document the GitHub workflow for creating man pages and translations PR 2022-08-23 19:21:53 +01:00
Chris Mayo
7099dc73a7 Sphinx 6.0 extlinks compatibility 
WARNING: extlinks: Sphinx-6.0 will require a caption string to
contain exactly one '%s' and all other '%' need to be escaped as '%%'.
 2022-08-23 19:21:53 +01:00
Chris Mayo
48a1dde27a Document url-rate-limited 
Introduced in:
dcdc64e8 ("Turn status code 429 into warning instead of failure",
2020-03-25)
 2022-07-11 19:27:07 +01:00
Chris Mayo
a67e8fd0f5 Test and recommend pdfminer.six for PdfParser 
pdfminer is no longer actively maintained; distributions are now
packaging pdfminer.six as pdfminer.
 2022-05-18 19:29:54 +01:00
Chris Mayo
34ba737710 Remove cchardet from Docker image, tox env and recommendation 
Beautiful Soup 4.11 will use charset-normalizer.
 2022-04-11 19:26:18 +01:00
Chris Mayo
7673cd6c69 Update files to be edited during release process 2022-02-22 19:35:04 +00:00
Chris Mayo
b92418a950 Use R for Requests in install.txt 2022-02-22 19:35:04 +00:00
Chris Mayo
db012a33cf Update documentation.md with PKG-INFO 
_LinkChecker_configdata.py not created since:
fb03843b ("Remove _LinkChecker_configdata.py", 2021-12-30)
 2022-02-22 19:35:04 +00:00
Chris Mayo
5c0d66dd74 Raise minimum Python requirement to 3.7 2021-12-30 19:27:04 +00:00
Chris Mayo
169305a171 Update change log and upgrading for 10.1.0 2021-12-22 19:29:56 +00:00
LinkChecker
8b61794ba9 Update man pages 2021-12-21 19:41:24 +00:00
LinkChecker
41cb8880ba Update doc translation catalogs 2021-12-21 19:41:06 +00:00
Chris Mayo
58adec0a28
Merge pull request #599 from cjmayo/sitemap 
Use sphinx-sitemap to create a sitemap
 2021-12-20 19:25:41 +00:00
Chris Mayo
abd5a68c27 Use sphinx-sitemap to create a sitemap 2021-12-17 19:25:43 +00:00
Chris Mayo
de3361fae2 More proxy documentation updates 
a60648e34 ("Remove support for ftp_proxy", 2021-12-13)
9504a6ddd ("Document the curl_ca_bundle environment variable", 2021-12-13)
 2021-12-17 19:22:20 +00:00
Chris Mayo
c28559e0d9 Recommend ensurepip instead of get-pip.py 
Avoids manual download of the get-pip.py file.
 2021-12-15 19:34:24 +00:00
LinkChecker
7497f1aa63 Update man pages 2021-12-14 19:27:40 +00:00