Commit graph

6769 commits

Author SHA1 Message Date
Chris Mayo
a12fcf04b2
Merge pull request #601 from cjmayo/template
Remove linkchecker from POSOURCES
2021-12-21 19:40:15 +00:00
Chris Mayo
42b1e38508 Remove linkchecker from POSOURCES
Removed in:
5fef9a3b ("Generate linkchecker command using an entry point", 2021-12-20)
2021-12-21 19:35:48 +00:00
Chris Mayo
bfee783500
Merge pull request #600 from cjmayo/entrypoint
Generate linkchecker command using an entry point
2021-12-21 19:29:43 +00:00
Chris Mayo
8bc3b39b41 One more proxy documentation update
a2e379a5 ("Remove built-in GNOME and KDE proxy support", 2021-12-13)
2021-12-21 19:23:00 +00:00
Chris Mayo
8007940770 Test more command arguments 2021-12-20 19:44:40 +00:00
Chris Mayo
5fef9a3b60 Generate linkchecker command using an entry point
drop_privileges() is only used by the linkchecker command.
Move installing SIGUSR1 handler to the linkchecker command only - fixes
intermittent test failures.
2021-12-20 19:34:58 +00:00
Chris Mayo
efb92fbee8 Create setup_config from linkchecker 2021-12-20 19:34:58 +00:00
Chris Mayo
e501c4ffac Create ArgParser from linkchecker 2021-12-20 19:34:58 +00:00
Chris Mayo
7ceb354e22 Remove unused linkchecker.ansicolor import from linkchecker
Not used since:
2f730f4e1 ("Add Nagios plugin.", 2012-06-20)
2021-12-20 19:34:58 +00:00
Chris Mayo
9bc1f4d04e Use relative import for configuration in failures.py 2021-12-20 19:34:58 +00:00
Chris Mayo
58adec0a28
Merge pull request #599 from cjmayo/sitemap
Use sphinx-sitemap to create a sitemap
2021-12-20 19:25:41 +00:00
Chris Mayo
366dcc14e2
Merge pull request #596 from cjmayo/doc-updates
Assorted minor documentation updates
2021-12-20 19:25:16 +00:00
Chris Mayo
abd5a68c27 Use sphinx-sitemap to create a sitemap 2021-12-17 19:25:43 +00:00
Chris Mayo
d8b0e023ec
Merge pull request #598 from cjmayo/workflows
Tweaks to helper workflows
2021-12-17 19:23:05 +00:00
Chris Mayo
de3361fae2 More proxy documentation updates
a60648e34 ("Remove support for ftp_proxy", 2021-12-13)
9504a6ddd ("Document the curl_ca_bundle environment variable", 2021-12-13)
2021-12-17 19:22:20 +00:00
Chris Mayo
2329d2bb11
Merge pull request #597 from cjmayo/nogit
Fix installation from source without git installed
2021-12-16 19:26:57 +00:00
Chris Mayo
eaa313ab49
Merge pull request #595 from cjmayo/dirlist
Require test_directory_listing to succeed
2021-12-16 19:26:40 +00:00
Chris Mayo
5cb406a8c3 Reword commit message updating documentation translations 2021-12-16 19:23:53 +00:00
Chris Mayo
dd2fe08ebd Add a manual trigger to publish Docker image 2021-12-15 19:41:20 +00:00
Chris Mayo
3ddc25fd4e Ensure application translations are updated by workflow 2021-12-15 19:41:20 +00:00
Chris Mayo
9ed2d8703b Fix installation from source without git installed 2021-12-15 19:40:27 +00:00
Chris Mayo
b0878dd7e8 Require TestFile.test_directory_listing to succeed 2021-12-15 19:36:53 +00:00
Chris Mayo
70c8da4088 Update issue template
Encourage the user to try debug logging.
2021-12-15 19:34:24 +00:00
Chris Mayo
c28559e0d9 Recommend ensurepip instead of get-pip.py
Avoids manual download of the get-pip.py file.
2021-12-15 19:34:24 +00:00
Chris Mayo
4444a87eb9 Update Requests bug link 2021-12-15 19:34:24 +00:00
Chris Mayo
92f189579e
Merge pull request #593 from cjmayo/man-updates
Updated man pages and translation catalogs
2021-12-15 19:31:21 +00:00
Chris Mayo
5f3b007934
Merge pull request #591 from cjmayo/robot
Assume robots.txt is UTF-8
2021-12-15 19:31:00 +00:00
Chris Mayo
4b6f3c38b3
Merge pull request #590 from cjmayo/guess
Don't guess the URL for files that end in .html
2021-12-15 19:30:40 +00:00
LinkChecker
e6021559e8 Update application translation catalogs 2021-12-14 19:27:40 +00:00
LinkChecker
7497f1aa63 Update man pages 2021-12-14 19:27:40 +00:00
LinkChecker
289ef5dc5b Update doc locale 2021-12-14 19:27:20 +00:00
Chris Mayo
d70ec6f75b Assume robots.txt is UTF-8
Match the Python standard library and Google's interpretation:
https://developers.google.com/search/docs/advanced/robots/robots_txt#file-format

Avoid Unhandled LookupError.
2021-12-13 19:31:55 +00:00
Chris Mayo
76815bcf47 Don't guess the URL for files that end in .html
Fixes:
linkchecker ftp.html
failing looking for ftp://ftp.html
2021-12-13 19:31:13 +00:00
Chris Mayo
7f175c13d4
Merge pull request #589 from cjmayo/proxy
Remove linkcheck.checker.proxysupport
2021-12-13 19:29:53 +00:00
Chris Mayo
315e729ec3 Fix typo "variables" in linkchecker(1) Proxy Support 2021-12-13 19:25:23 +00:00
Chris Mayo
9504a6dddf Document the curl_ca_bundle environment variable 2021-12-13 19:25:23 +00:00
Chris Mayo
a2e379a595 Remove built-in GNOME and KDE proxy support
Only http_proxy was ever supported.

Requests uses urllib.request.getproxies().

Fedora 35 and Ubuntu 20.04 do set proxy environment variables when
settings are added through the GUI.

GNOME location of proxy settings is subject to change:
https://wiki.gnome.org/Projects/NetworkManager/Proxies
https://gitlab.gnome.org/GNOME/gsettings-desktop-schemas/-/issues/27
2021-12-13 19:25:23 +00:00
Chris Mayo
fe5a34c68f Remove linkcheck.checker.proxysupport
Set up the requests.Session() with the complete proxy configuration
to fix a problem with using an HTTP server as an HTTPS proxy and
potential redirection issues.

Requests handles no_proxy.
2021-12-13 19:25:23 +00:00
Chris Mayo
35ecb7e639 Add https_proxy to internal error message 2021-12-13 19:25:23 +00:00
Chris Mayo
a60648e348 Remove support for ftp_proxy
Was limited to HTTP proxy servers and prevents simplifying and fixing
HTTP proxy support.
2021-12-13 19:25:23 +00:00
Chris Mayo
f2e5a435e3 Remove unused ProxySupport.proxyauth
Not used since:
7b34be590 ("Introduce check plugins, use Python requests for http/s connections, and some code cleanups and improvements.", 2014-03-01)
2021-12-13 19:25:23 +00:00
Chris Mayo
2e9f08748d
Merge pull request #587 from cjmayo/util-actions
Workflows to automate updating man pages and create distribution files
2021-12-13 19:24:48 +00:00
Chris Mayo
96f207d25f
Merge pull request #585 from cjmayo/scm_git_archive
Make installing from the git archive of a tagged commit possible
2021-12-13 19:23:34 +00:00
Chris Mayo
01dfc13886
Merge pull request #584 from cjmayo/releasedate
Set release date from HEAD
2021-12-13 19:22:19 +00:00
Chris Mayo
0b3bdedd6d
Merge pull request #583 from cjmayo/newest
Replace "Get the newest version at"
2021-12-13 19:21:32 +00:00
Chris Mayo
945ad903a3
Merge pull request #579 from cjmayo/redirect
Update HttpUrl.encoding after following redirects
2021-12-13 19:20:28 +00:00
Koen Van den Wijngaert
900586dc01
Better handling for link rel dns-prefetch and add preconnect support (#536)
preconnect is only DNS checked.

This is allowed even in the Resource Hints Editor's Draft
https://w3c.github.io/resource-hints/#preconnect
2021-12-09 19:38:30 +00:00
Chris Mayo
ef33a61b41 Workflow to automatically add Python distribution files to the release 2021-12-09 19:31:28 +00:00
Chris Mayo
26ed46ad40 Workflow to semi-automate man page and translation updates
Expected to be used form a fork, it will create a branch man-updates,
based on the upstream repository with additional commits with the updates.
Then a pull request would be created to send the updates upstream.
2021-12-09 19:31:28 +00:00
Chris Mayo
9dd39ef264 Remove *.mo from ignore-bad-ideas
.mo files have not been distributed since:
e297b1a47 ("Stop including binary translation catalogs in the source", 2021-11-22)
2021-12-07 19:44:20 +00:00