Commit graph

1083 commits

Author SHA1 Message Date
Chris Mayo
d6936ceb91 Add warning url-content-type-unparseable 2022-09-02 19:29:11 +01:00
Chris Mayo
fb8df6f089 Document URL list in linkchecker(1)
First enabled in:
b1708fc7 ("get the complete content", 2004-09-03)
2022-09-02 19:29:11 +01:00
Chris Mayo
f018cc9fd1 Fix typo addtion in linkcheckerrc(5) 2022-09-02 19:17:45 +01:00
Kian-Meng Ang
a70ea9ea14 Fix typos
Found via `codespell ./linkcheck/ ./tests ./doc/man/en -L bu,noone,fo,pres,shttp`
2022-09-02 17:20:02 +08:00
Chris Mayo
b35036af2b
Merge pull request #634 from cjmayo/pyxdg
Remove dependency on pyxdg
2022-08-30 19:28:03 +01:00
Chris Mayo
fbceca5dc9 Remove dependency on pyxdg
Read the environment variables and implement the same fallbacks.
Saves a hardly used dependency and is more explicit.
2022-08-23 19:26:15 +01:00
Chris Mayo
10f3d33041 Finish documenting the use of XDG_CONFIG_HOME and XDG_DATA_HOME
Introduced by:
a03e2e4a ("use xdg dirs for config & data", 2017-10-17)
2022-08-23 19:21:53 +01:00
Chris Mayo
3f42367280 Document using the GitHub release artifacts 2022-08-23 19:21:53 +01:00
Chris Mayo
edd4c8443c Document the GitHub workflow for creating man pages and translations PR 2022-08-23 19:21:53 +01:00
Chris Mayo
7099dc73a7 Sphinx 6.0 extlinks compatibility
WARNING: extlinks: Sphinx-6.0 will require a caption string to
contain exactly one '%s' and all other '%' need to be escaped as '%%'.
2022-08-23 19:21:53 +01:00
Chris Mayo
48a1dde27a Document url-rate-limited
Introduced in:
dcdc64e8 ("Turn status code 429 into warning instead of failure",
2020-03-25)
2022-07-11 19:27:07 +01:00
Chris Mayo
a67e8fd0f5 Test and recommend pdfminer.six for PdfParser
pdfminer is no longer actively maintained; distributions are now
packaging pdfminer.six as pdfminer.
2022-05-18 19:29:54 +01:00
Chris Mayo
34ba737710 Remove cchardet from Docker image, tox env and recommendation
Beautiful Soup 4.11 will use charset-normalizer.
2022-04-11 19:26:18 +01:00
Chris Mayo
7673cd6c69 Update files to be edited during release process 2022-02-22 19:35:04 +00:00
Chris Mayo
b92418a950 Use R for Requests in install.txt 2022-02-22 19:35:04 +00:00
Chris Mayo
db012a33cf Update documentation.md with PKG-INFO
_LinkChecker_configdata.py not created since:
fb03843b ("Remove _LinkChecker_configdata.py", 2021-12-30)
2022-02-22 19:35:04 +00:00
Chris Mayo
5c0d66dd74 Raise minimum Python requirement to 3.7 2021-12-30 19:27:04 +00:00
Chris Mayo
169305a171 Update change log and upgrading for 10.1.0 2021-12-22 19:29:56 +00:00
LinkChecker
8b61794ba9 Update man pages 2021-12-21 19:41:24 +00:00
LinkChecker
41cb8880ba Update doc translation catalogs 2021-12-21 19:41:06 +00:00
Chris Mayo
58adec0a28
Merge pull request #599 from cjmayo/sitemap
Use sphinx-sitemap to create a sitemap
2021-12-20 19:25:41 +00:00
Chris Mayo
abd5a68c27 Use sphinx-sitemap to create a sitemap 2021-12-17 19:25:43 +00:00
Chris Mayo
de3361fae2 More proxy documentation updates
a60648e34 ("Remove support for ftp_proxy", 2021-12-13)
9504a6ddd ("Document the curl_ca_bundle environment variable", 2021-12-13)
2021-12-17 19:22:20 +00:00
Chris Mayo
c28559e0d9 Recommend ensurepip instead of get-pip.py
Avoids manual download of the get-pip.py file.
2021-12-15 19:34:24 +00:00
LinkChecker
7497f1aa63 Update man pages 2021-12-14 19:27:40 +00:00
LinkChecker
289ef5dc5b Update doc locale 2021-12-14 19:27:20 +00:00
Chris Mayo
315e729ec3 Fix typo "variables" in linkchecker(1) Proxy Support 2021-12-13 19:25:23 +00:00
Chris Mayo
9504a6dddf Document the curl_ca_bundle environment variable 2021-12-13 19:25:23 +00:00
Chris Mayo
a2e379a595 Remove built-in GNOME and KDE proxy support
Only http_proxy was ever supported.

Requests uses urllib.request.getproxies().

Fedora 35 and Ubuntu 20.04 do set proxy environment variables when
settings are added through the GUI.

GNOME location of proxy settings is subject to change:
https://wiki.gnome.org/Projects/NetworkManager/Proxies
https://gitlab.gnome.org/GNOME/gsettings-desktop-schemas/-/issues/27
2021-12-13 19:25:23 +00:00
Chris Mayo
fe5a34c68f Remove linkcheck.checker.proxysupport
Set up the requests.Session() with the complete proxy configuration
to fix a problem with using an HTTP server as an HTTPS proxy and
potential redirection issues.

Requests handles no_proxy.
2021-12-13 19:25:23 +00:00
Chris Mayo
a60648e348 Remove support for ftp_proxy
Was limited to HTTP proxy servers and prevents simplifying and fixing
HTTP proxy support.
2021-12-13 19:25:23 +00:00
Chris Mayo
2cc1319bee GitHub release must be created before Python distribution files
setuptools_scm will use the release tag.
2021-12-06 19:40:14 +00:00
Chris Mayo
d2d2a563cc Make installing from the git archive of a tagged commit possible
aka make GitHub release assets usable.

Requires setuptools-scm-git-archive.
2021-12-06 19:40:02 +00:00
Chris Mayo
3b19680e97 Add guidance on character set detecting including cchardet 2021-12-06 19:24:26 +00:00
Chris Mayo
6269134017 Correct documentation of text output encoding
50ea41b12 ("use preferred locale for default encoding", 2005-10-13)
714147cb2 ("Improved language and encoding detection by using local.getdefaultlocale() instead of locale.getlocale(category=LC_ALL)", 2009-03-04)
2021-11-29 19:48:50 +00:00
Chris Mayo
6de93650f9 Group output documentation 2021-11-29 19:48:50 +00:00
Chris Mayo
a4b14047d6 Make quiet/-q set application logging to warning 2021-11-29 19:48:50 +00:00
Chris Mayo
eb33b1c1e5 Remove --warning-regex documentation
Moved to RegexCheck plugin:
7b34be590 ("Introduce check plugins, use Python requests for http/s connections, and some code cleanups and improvements.", 2014-03-01)
2021-11-29 19:48:50 +00:00
Chris Mayo
a7155db64a Correct documentation of CSV separator
851e1121e ("Use semicolon as default CSV separator.", 2010-07-31)
2021-11-29 19:48:50 +00:00
Chris Mayo
895e2ddb43 Improve documentation of output 2021-11-29 19:48:50 +00:00
Chris Mayo
fe6dea12de Update documentation for disabled plugins 2021-11-29 19:35:34 +00:00
Chris Mayo
af93386bcc Version application using setuptools_scm
Version has the format X.Y.Z.postN+g12345678
2021-11-28 18:55:46 +00:00
Chris Mayo
e297b1a477 Stop including binary translation catalogs in the source
Makes it easier to contribute and accept translations.

Does add a new dependency on installation from source, polib. This is
not made mandatory because not all users will want translations.

polib has no further dependencies and can be installed anywhere
LinkChecker can, using pip too.

Add release process step to check polib is installed

The Wheel still includes translations. Recommend install from PyPI in
the README.

Translations were being compiled in setup.py until 2014, using a bundled
copy of msgfmt.py.
9c3739f1c ("Replace msgfmt.py with local tools.", 2014-09-08)
2021-11-22 19:30:33 +00:00
Chris Mayo
1194f5d943 Update pip URL in install.txt 2021-11-22 19:30:33 +00:00
Chris Mayo
d99e600edd Add translation .po file checks 2021-11-22 19:30:33 +00:00
Chris Mayo
119f6a961e Use an HTML list for custom menu entries in documentation
For compatibility with sphinx_rtd_theme 1.0, which otherwise renders the
entries with buttons.
2021-08-22 19:26:03 +01:00
Chris Mayo
49d994d7cc Reference GitHub Actions instead of Travis in documentation 2021-08-22 19:26:03 +01:00
Chris Mayo
b9b4936729 Fix broken Edit on GitHub links in documentation 2021-08-12 19:28:50 +01:00
Paul Haerle
f395c74aac
Make ResultCache max_size configurable (#544)
* Make ResultCache max_size configurable

fixes #463

* Add tests and docs.

* fix documentation...

...adapt the source, not the auto-generated man pages themselves as
requested in #544.

* fix typo.
2021-06-21 19:45:19 +01:00
Chris Mayo
c4b8a4aeec Changes for release 10.0.1 2021-01-28 19:20:24 +00:00