Commit graph

7021 commits

Author SHA1 Message Date
Chris Mayo
35e2f5a2f6
Merge pull request #735 from cjmayo/ignorewarnings
Move ignorewarnings to output section in linkcheckerrc(5)
2023-05-01 19:29:24 +01:00
Chris Mayo
3de691d193
Merge pull request #734 from cjmayo/releases
Release Improvements
2023-05-01 19:29:06 +01:00
Chris Mayo
f704f997d5 Add installation with pipx to documentation 2023-05-01 19:24:55 +01:00
Chris Mayo
75996718de Publish release to PyPI 2023-05-01 19:24:55 +01:00
Chris Mayo
5a1b7e1051 Don't need git to install from GitHub
Since:
98d32a11a ("Re-enable support for installing git archives", 2023-01-17)
2023-05-01 19:24:55 +01:00
Chris Mayo
b5a290e98e Use Coveralls GitHub Action
Python package stopped working.
2023-05-01 19:24:55 +01:00
Chris Mayo
f0b6ddda27 Move ignorewarnings to output section in linkcheckerrc(5)
As per ignoreerrors, this is not filtering.
2023-04-25 19:31:39 +01:00
Chris Mayo
6ac5ed4d57
Merge pull request #733 from cjmayo/currentThread
Replace deprecated threading.currentThread()
2023-04-25 19:21:58 +01:00
Chris Mayo
2987a588be
Merge pull request #732 from cjmayo/ftp
Fix FTP checker
2023-04-25 19:21:09 +01:00
Chris Mayo
99c77b2b27 Replace deprecated threading.currentThread() 2023-04-17 19:28:14 +01:00
Chris Mayo
4b06485a05 Fix FTP checker
In Python 2 StringIO could accept either Unicode or 8-bit strings.
Similar change made for HttpUrl:
06fdd78f9 ("Python3: fix TypeError in HttpUrl.read_content()",
2019-09-15)

Non-existent FtpUrl.max_size introduced in:
7b34be590 ("Introduce check plugins, use Python requests for http/s
connections, and some code cleanups and improvements.", 2014-03-01)

Additional self.direct() not added in:
f107092a8 ("Fix handling of user/password info in URLs.", 2012-06-10)
2023-04-17 19:24:22 +01:00
Chris Mayo
4433556915 Make checker.get_index_html() return bytes
Shared with FtpUrl.read_content().
2023-04-17 19:24:22 +01:00
Chris Mayo
1fcc0e2b4c Add FTP tests for listing and download 2023-04-17 19:24:22 +01:00
Chris Mayo
a7b9ac42be Fail on internal errors in LinkCheckTest.direct()
Copied from LinkCheckTest.file_test().
2023-04-17 19:24:22 +01:00
Chris Mayo
054a583b79
Merge pull request #726 from hroncok/patch-1
There is no LICENSE file, just COPYING
2023-03-09 19:25:36 +00:00
Miro Hrončok
6fbaff7b79
There is no LICENSE file, just COPYING 2023-03-09 15:42:43 +01:00
Chris Mayo
05bf593fdc
Merge pull request #722 from cjmayo/replace_cgi
Replace deprecated cgi module in loginurl tests
2023-01-30 19:36:56 +00:00
Chris Mayo
c055c4f52b
Merge pull request #721 from cjmayo/build
Set permissions for build workflow
2023-01-30 19:36:36 +00:00
Chris Mayo
91105d722a
Merge pull request #716 from cjmayo/py38
Raise minimum Python version to 3.8
2023-01-30 19:36:11 +00:00
Chris Mayo
3041c8af28
Merge pull request #717 from cjmayo/git_archive
Re-enable support for installing git archives
2023-01-23 19:28:40 +00:00
Chris Mayo
f31d532c7e
Merge pull request #715 from cjmayo/delete_docker
Delete oldest Docker images
2023-01-23 19:28:05 +00:00
Chris Mayo
beab10ba4f
Merge pull request #712 from cjmayo/getdefaultlocale
Replace deprecated locale.getdefaultlocale()
2023-01-23 19:27:28 +00:00
Chris Mayo
a673a26409 Replace deprecated cgi module in loginurl tests 2023-01-20 19:22:23 +00:00
Chris Mayo
7a09ab4bb4 Set permissions for build workflow 2023-01-19 19:25:57 +00:00
Chris Mayo
a61ffac5d3
Merge pull request #720 from cjmayo/rtd_sphinx
Allow sphinx-rtd-theme to pick the versions of sphinx & docutils
2023-01-18 19:30:14 +00:00
Chris Mayo
51c6b3ef2f Allow sphinx-rtd-theme to pick the versions of sphinx & docutils
From version 1.1.0 sphinx-rtd-theme adds upper bounds for compatible
versions of sphinx and docutils.
2023-01-18 19:22:50 +00:00
Chris Mayo
4162540019
Merge pull request #714 from cjmayo/python-version
Resolve actions/setup-python python-version warnings
2023-01-18 19:22:28 +00:00
Chris Mayo
0a5170286b
Merge pull request #719 from cjmayo/jquery
Ensure jQuery is installed to support Sphinx 6
2023-01-17 19:56:38 +00:00
Chris Mayo
67f884e507 Ensure jQuery is installed to support RTD on Sphinx 6
Without jQuery website search is broken.
2023-01-17 19:54:00 +00:00
Chris Mayo
98d32a11a7 Re-enable support for installing git archives
setuptools_scm 7 includes git archive support. hatch-vcs
currently requires a minimium of 6.4, ensure 7 is installed.
2023-01-17 19:26:24 +00:00
Chris Mayo
926932411d Only attempt to get rel attribute from link elements 2023-01-17 19:23:29 +00:00
Chris Mayo
643364a655 Raise minimum Python version to 3.8 2023-01-17 19:23:29 +00:00
Chris Mayo
8366bde4e2 Delete oldest Docker images
Keep 20 most recent.
2023-01-16 19:36:22 +00:00
Chris Mayo
aff5e2918d Resolve actions/setup-python python-version warnings 2023-01-14 17:22:20 +00:00
Chris Mayo
efc368e6ea Replace deprecated locale.getdefaultlocale()
gettext.translation() can do most of the work for us, calling
gettext.find() and with fallback=True returning a NullTranslations if no
catalog is found.

The do_unicode parameter of install_builtin() should have been removed
in:
384e1e196 ("Remove Python 2 gettext builtin installation", 2020-04-15)
2023-01-13 19:23:56 +00:00
Chris Mayo
ec9386d002
Merge pull request #713 from cjmayo/clamav
Make ClamAV cache directory writeable for cache action
2023-01-13 19:23:32 +00:00
Chris Mayo
86726a64f3 Make ClamAV cache directory writeable for cache action
Else cache restore fails:

/usr/bin/tar: ../../../../../var/lib/clamav/main.cvd: Cannot open: Permission denied
/usr/bin/tar: ../../../../../var/lib/clamav/freshclam.dat: Cannot open: File exists
/usr/bin/tar: ../../../../../var/lib/clamav/daily.cvd: Cannot open: File exists
/usr/bin/tar: ../../../../../var/lib/clamav/bytecode.cvd: Cannot open: Permission denied
/usr/bin/tar: ../../../../../var/lib/clamav: Cannot utime: Operation not permitted
/usr/bin/tar: Exiting with failure status due to previous errors
Warning: Failed to restore: Tar failed with error: The process '/usr/bin/tar' failed with exit code 2
Cache not found for input keys: clamav-v1
2023-01-12 19:53:03 +00:00
Chris Mayo
33b87190c7
Merge pull request #711 from cjmayo/docs
Fix build workflow docs job failure
2023-01-12 19:23:10 +00:00
Chris Mayo
87368c14da Fix build workflow docs job failure
cryptography 39 is causing problems on Ubuntu 22.04 for Sphinx
autosummary:

* AttributeError: module 'lib' has no attribute 'OpenSSL_add_all_algorithms'

Stop installing pdfminer.six which is causing cryptography to be
installed.
2023-01-09 19:25:07 +00:00
Marius Gedminas
d179b916b5
Merge pull request #710 from linkchecker/clamav-cdn-relief
Cache ClamAV signatures
2023-01-01 12:15:37 +02:00
Marius Gedminas
4ee13f140a Cache ClamAV signatures
We don't care if the signatures are stale (we only need the EICAR virus
test signature), so run freshclam only if the cache is missing entirely.

Closes #709.

Also, use apt-get instead of apt to avoid

    WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
2022-12-31 17:15:25 +02:00
Chris Mayo
9a5f914019
Merge pull request #708 from cjmayo/docker311
Update Docker image to Python 3.11
2022-12-12 19:25:03 +00:00
Chris Mayo
e3cd7f11ec Update Docker image to Python 3.11 2022-12-08 19:26:33 +00:00
Chris Mayo
2ddae7f798
Merge pull request #701 from cjmayo/rel1021
Documentation for release 10.2.1
2022-12-05 19:27:26 +00:00
Chris Mayo
1d7175f557
Merge pull request #704 from cjmayo/requests220
Increase minimum Requests version to 2.20
2022-12-05 19:25:22 +00:00
Chris Mayo
bf965c6a1a Tidy manual setup install steps 2022-12-05 19:22:35 +00:00
Chris Mayo
46c5712baf Add pdfminer.six to minimum version testing
20181108 is the version used by the current Debian oldstable.
Ubuntu 20.04 LTS has 20191020.

pdfminer installs cryptography, >= 38 breaks pyOpenSSL < 22 as found in
Ubuntu 20.04 LTS. Update docs job to use ubuntu-22.04 to avoid
failures.
2022-12-05 19:22:35 +00:00
Chris Mayo
44226ed7b8 Document installing pdfminer.six 2022-12-05 19:22:35 +00:00
Chris Mayo
aa79f5a600 Increase minimum Requests version to 2.20
2.20 fixes CVE-2018-18074.
2022-12-05 19:22:35 +00:00
Chris Mayo
b6a6c9ea44
Merge pull request #703 from cjmayo/template
Recommend linkchecker -Dcmdline when reporting issues
2022-12-01 19:29:23 +00:00