Commit graph

6713 commits

Author SHA1 Message Date
Chris Mayo
26ed46ad40 Workflow to semi-automate man page and translation updates
Expected to be used form a fork, it will create a branch man-updates,
based on the upstream repository with additional commits with the updates.
Then a pull request would be created to send the updates upstream.
2021-12-09 19:31:28 +00:00
Chris Mayo
b6d97be46c
Merge pull request #581 from cjmayo/version
Fix LinkChecker version shown on github.io
2021-12-06 19:31:22 +00:00
Chris Mayo
d1ad23016c
Merge pull request #582 from cjmayo/readme
Reference manuals and mention GitHub Packages in README
2021-12-06 19:30:11 +00:00
Chris Mayo
702bf36f53
Merge pull request #571 from cjmayo/cchardet
Add guidance on character set detecting to install.txt
2021-12-06 19:28:55 +00:00
Chris Mayo
7f78acf856 Fetch tag history in publish-pages 2021-12-06 19:27:49 +00:00
Chris Mayo
3eb3a70aab Limit token permissions and pin 3rd-party action in publish-pages 2021-12-06 19:27:49 +00:00
Chris Mayo
a4d2d49989
Merge pull request #580 from cjmayo/yamllint
Add a yamllint check for workflows
2021-12-06 19:24:59 +00:00
Chris Mayo
3b19680e97 Add guidance on character set detecting including cchardet 2021-12-06 19:24:26 +00:00
Chris Mayo
7e882d2530 Reference manuals and mention GitHub Packages in README 2021-12-01 19:43:07 +00:00
Chris Mayo
454ce0c3a5 Add a yamllint check for workflows 2021-11-30 19:45:17 +00:00
Chris Mayo
2bc0b716bc
Merge pull request #574 from cjmayo/nl_NL
Add Dutch translation
2021-11-30 19:29:39 +00:00
Chris Mayo
dc05b33460 Update application translation catalogs 2021-11-30 19:24:44 +00:00
Chris Mayo
0171bc950f Update nl_NL.po header fields 2021-11-30 19:24:44 +00:00
Gideon van Melle
8b11c2f56a Add Dutch translation
I made a Dutch translation
2021-11-30 19:24:44 +00:00
Chris Mayo
606472e910
Merge pull request #572 from cjmayo/latin1
Ignore an encoding of ISO-8859-1 returned by Requests
2021-11-29 19:55:16 +00:00
Chris Mayo
c89c617a58 Ignore an encoding of ISO-8859-1 returned by Requests
ISO-8859-1 is a fallback for Requests and causes us to mangle UTF-8
content.

Requests' utils.py:

def get_encoding_from_headers(headers):
    """Returns encodings from given HTTP Header Dict.

    :param headers: dictionary to extract encoding from.
    :rtype: str
    """

    content_type = headers.get('content-type')

    if not content_type:
        return None

    content_type, params = _parse_content_type_header(content_type)

    if 'charset' in params:
        return params['charset'].strip("'\"")

    if 'text' in content_type:
        return 'ISO-8859-1'

    if 'application/json' in content_type:
        # Assume UTF-8 based on RFC 4627: https://www.ietf.org/rfc/rfc4627.txt since the charset was unset
        return 'utf-8'
2021-11-29 19:52:37 +00:00
Chris Mayo
a78c78a803
Merge pull request #569 from cjmayo/output
Improve output documentation and make quiet/-q set log level to warning
2021-11-29 19:51:38 +00:00
Chris Mayo
6269134017 Correct documentation of text output encoding
50ea41b12 ("use preferred locale for default encoding", 2005-10-13)
714147cb2 ("Improved language and encoding detection by using local.getdefaultlocale() instead of locale.getlocale(category=LC_ALL)", 2009-03-04)
2021-11-29 19:48:50 +00:00
Chris Mayo
6de93650f9 Group output documentation 2021-11-29 19:48:50 +00:00
Chris Mayo
a4b14047d6 Make quiet/-q set application logging to warning 2021-11-29 19:48:50 +00:00
Chris Mayo
eb33b1c1e5 Remove --warning-regex documentation
Moved to RegexCheck plugin:
7b34be590 ("Introduce check plugins, use Python requests for http/s connections, and some code cleanups and improvements.", 2014-03-01)
2021-11-29 19:48:50 +00:00
Chris Mayo
a7155db64a Correct documentation of CSV separator
851e1121e ("Use semicolon as default CSV separator.", 2010-07-31)
2021-11-29 19:48:50 +00:00
Chris Mayo
895e2ddb43 Improve documentation of output 2021-11-29 19:48:50 +00:00
Chris Mayo
995dc9cd41
Merge pull request #570 from cjmayo/bs481
Set minimum Beautiful Soup version in setup.py
2021-11-29 19:44:35 +00:00
Chris Mayo
2d9c2b229c Set minimum Beautiful Soup version in setup.py 2021-11-29 19:41:38 +00:00
Chris Mayo
42333362aa
Merge pull request #575 from cjmayo/anchor
Disable AnchorCheck plugin
2021-11-29 19:38:37 +00:00
Chris Mayo
fe6dea12de Update documentation for disabled plugins 2021-11-29 19:35:34 +00:00
Chris Mayo
0356524369 Disable AnchorCheck plugin
Can't be relied on. Multiple reports of expected results not returned.

https://github.com/linkchecker/linkchecker/issues/542
https://github.com/linkchecker/linkchecker/issues/555
https://github.com/linkchecker/linkchecker/issues/568

Previously a fix was needed just to get the tests working:
0912e8a2c ("Don't strip the URL fragment from cache key if using AnchorCheck", 2020-07-27)

After:
eaa538c81 ("don't check one url multiple times", 2016-11-09)
2021-11-29 19:35:34 +00:00
Chris Mayo
822c607a33
Merge pull request #576 from cjmayo/docker
Release new Docker image hosted on GitHub Packages
2021-11-29 19:34:03 +00:00
Chris Mayo
9380f44a81 Note in README the unique Docker tags and where to find them 2021-11-29 19:28:47 +00:00
Chris Mayo
af93386bcc Version application using setuptools_scm
Version has the format X.Y.Z.postN+g12345678
2021-11-28 18:55:46 +00:00
Chris Mayo
edc974e7b9 Tag Docker image using latest, commit checksum and semver
The following tags will be added: latest, 1234567 and 1.2.3
2021-11-28 18:55:46 +00:00
Chris Mayo
99d0d5218b Release new Docker image hosted on GitHub Packages 2021-11-25 19:33:29 +00:00
Chris Mayo
c6ca3314ee
Merge pull request #573 from cjmayo/ghcrio
Add a workflow to publish docker image to ghcr.io
2021-11-23 19:59:09 +00:00
Chris Mayo
163c44378f Update to latest docker actions
metadata-action v3.6.0
build-push-action v2.7.0
2021-11-23 19:34:27 +00:00
Chris Mayo
fcbd957d16 Add a workflow to publish docker image to ghcr.io 2021-11-23 19:34:27 +00:00
Chris Mayo
72b0fd66c3
Merge pull request #563 from cjmayo/nomo
Stop including binary translation catalogs in the source
2021-11-22 19:35:29 +00:00
Chris Mayo
e297b1a477 Stop including binary translation catalogs in the source
Makes it easier to contribute and accept translations.

Does add a new dependency on installation from source, polib. This is
not made mandatory because not all users will want translations.

polib has no further dependencies and can be installed anywhere
LinkChecker can, using pip too.

Add release process step to check polib is installed

The Wheel still includes translations. Recommend install from PyPI in
the README.

Translations were being compiled in setup.py until 2014, using a bundled
copy of msgfmt.py.
9c3739f1c ("Replace msgfmt.py with local tools.", 2014-09-08)
2021-11-22 19:30:33 +00:00
Chris Mayo
1194f5d943 Update pip URL in install.txt 2021-11-22 19:30:33 +00:00
Chris Mayo
0304166e50 Update translation catalogs bugs address 2021-11-22 19:30:33 +00:00
Chris Mayo
9f1414c36a Set package name in translation catalogs 2021-11-22 19:30:33 +00:00
Chris Mayo
d99e600edd Add translation .po file checks 2021-11-22 19:30:33 +00:00
Chris Mayo
0ff291d034
Merge pull request #565 from cjmayo/wrapssl
Replace deprecated ssl.wrap_socket() in tests
2021-11-22 19:30:11 +00:00
Chris Mayo
ef60e9dcd6 Enable certificate verification during https test 2021-11-22 19:27:18 +00:00
Chris Mayo
bb4102da5a Replace deprecated ssl.wrap_socket() in tests 2021-11-22 19:27:18 +00:00
Chris Mayo
7d268b982e
Merge pull request #564 from cjmayo/depr310
Replace deprecated Thread.getName() and Condition.notifyAll()
2021-11-22 19:26:16 +00:00
Chris Mayo
2a77e12618 Replace deprecated Thread.getName() and Condition.notifyAll() 2021-11-16 19:45:38 +00:00
Chris Mayo
57a1234b49
Merge pull request #559 from cjmayo/3_10
Test with Python 3.10
2021-11-08 19:42:43 +00:00
Chris Mayo
375bedf79a List Python 3.10 as supported in trove classifiers 2021-10-18 19:47:18 +01:00
Chris Mayo
df2304490b Remove .travis.yml
No longer used, would have to be updated for new Python versions.
2021-10-18 19:46:31 +01:00