Commit graph

1749 commits

Author SHA1 Message Date
Thomas Zahner
b46cb5c02e
Don't echo potentially sensitive header data (#1728)
* Don't echo potentially sensitive header data
* Still show header name, for more user-friendliness
2025-06-12 17:08:15 +02:00
Thomas Zahner
469ccd0089 Update changelog 2025-06-11 16:44:23 +02:00
Matthias Endler
639c74e392 chore: release v0.19.0 2025-06-11 16:04:34 +02:00
Thomas Zahner
99ec1e7c07 Keep supporting 'latest' in CI Dockerfiles 2025-06-11 14:04:21 +02:00
Thomas Zahner
a11efce06d Follow renaming: latest -> nightly 2025-06-11 12:28:47 +02:00
Thomas Zahner
4797339b6a Follow renaming: latest -> nightly 2025-06-11 12:21:00 +02:00
Thomas Zahner
e59456b96e Add cli test 2025-06-11 11:19:51 +02:00
Thomas Zahner
f0a4b3a5a8 Add explanation 2025-06-11 11:19:51 +02:00
Thomas Zahner
4a8587665f Fix grammar
Co-authored-by: Matthias Endler <matthias@endler.dev>
2025-06-11 11:19:51 +02:00
Thomas Zahner
622bc6956f Update docs 2025-06-11 11:19:51 +02:00
Thomas Zahner
326f119e38 Extract DEFAULT_ACCEPTED_STATUS_CODES & apply clippy's suggestions 2025-06-11 11:19:51 +02:00
Thomas Zahner
74961d2470 Use StatusCodeSelector default as default accepted StatusCodes 2025-06-11 11:19:51 +02:00
Thomas Zahner
c2a0908747 Tiny improvements 2025-06-11 11:19:51 +02:00
Thomas Zahner
286ff50612 Remove dbg macro 2025-06-11 11:19:51 +02:00
Thomas Zahner
a0d078b4d8 Pass accepted values by reference 2025-06-11 11:19:51 +02:00
Thomas Zahner
3100fb2ee7 Make accepted codes non-optional 2025-06-11 11:19:51 +02:00
Thomas Zahner
d22d1888f1 Handle rejected TOO_MANY_REQUESTS 2025-06-11 11:19:51 +02:00
Thomas Zahner
a516461df6 Update Status::code 2025-06-11 11:19:51 +02:00
Thomas Zahner
25b835f12d Update tests 2025-06-11 11:19:51 +02:00
Thomas Zahner
54bbc080a9 Remove duplicated information from output 2025-06-11 11:19:51 +02:00
Thomas Zahner
a783ecc103 Update test 2025-06-11 11:19:51 +02:00
Thomas Zahner
f067b92a58 Change usage of ErrorKind::NetworkRequest, as it no longer represents rejected status codes 2025-06-11 11:19:51 +02:00
Thomas Zahner
2dfaef74ff Update test 2025-06-11 11:19:51 +02:00
Thomas Zahner
341f75e11b Update doc comment 2025-06-11 11:19:51 +02:00
Thomas Zahner
2ca69f4407 Make error message more user-friendly 2025-06-11 11:19:51 +02:00
Thomas Zahner
4e5043a3c3 Remove hardcoded rule for handling erroneous status codes differently 2025-06-11 11:19:51 +02:00
Thomas Zahner
31b2525a8d
Move archive functionality to library (#1720)
* Bump flake 1.83.0 -> 1.87.0
* Move archive functionality into lychee-lib
* Create example, update name and docs
* Split function & update tests
* Remove trailing slashes in API calls & update tests
* Apply lint suggestions
* Rename function
* Move module
* Add cargo-nextest to devShell to support 'make test'
2025-06-06 22:24:10 +02:00
dependabot[bot]
1305bccac3
Bump the dependencies group across 1 directory with 3 updates (#1714)
* Bump the dependencies group across 1 directory with 3 updates

Bumps the dependencies group with 3 updates in the / directory: [tokio](https://github.com/tokio-rs/tokio), [uuid](https://github.com/uuid-rs/uuid) and [criterion](https://github.com/bheisler/criterion.rs).


Updates `tokio` from 1.45.0 to 1.45.1
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.45.0...tokio-1.45.1)

Updates `uuid` from 1.16.0 to 1.17.0
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/v1.16.0...v1.17.0)

Updates `criterion` from 0.5.1 to 0.6.0
- [Changelog](https://github.com/bheisler/criterion.rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/bheisler/criterion.rs/compare/0.5.1...0.6.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-version: 1.45.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: uuid
  dependency-version: 1.17.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: criterion
  dependency-version: 0.6.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>

* Use `std::hint::black_box`

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Matthias <matthias@endler.dev>
2025-05-26 23:34:44 +02:00
Keming
1c97f26aa2
feat: respect the disabled property for stylesheet links (#1716)
Signed-off-by: Keming <kemingy94@gmail.com>
2025-05-25 13:13:22 +02:00
Keming
b128b86a48
feat: raise error when the default config file is invalid (#1715)
Signed-off-by: Keming <kemingy94@gmail.com>
2025-05-25 13:10:58 +02:00
Jakob
63cdb70e6d
Upgrade to 2024 edition (#1711)
* Upgrade to 2024 edition

* Revert expr_2021 -> expr

* resolve merge conflicts

* make lint happy
2025-05-24 18:23:23 +02:00
Keming
208fa80aa6
fix: only check the fragment when it's a file (#1713)
* fix: only check the fragment when it's a file
* add dir fragment test
* Clean up unused fragment_check in Client

---------

Signed-off-by: Keming <kemingy94@gmail.com>
Co-authored-by: Matthias <matthias@endler.dev>
2025-05-23 21:50:26 +02:00
Jakob
7d9d79791a
fix: ignore gitlab table of content in wikilinks (#1710)
* fix: ignore gitlab table of content in wikilinks

* Simplify test

---------

Co-authored-by: Matthias Endler <matthias@endler.dev>
2025-05-23 15:04:24 +02:00
Thomas Zahner
da166ce3c6
Fix test_exclude_example_domains (#1712)
* Configure test with the right feature flag

* Remove test exclusion, because test is now properly configured
2025-05-23 14:54:46 +02:00
Matthias Endler
35610764a1
Add support for custom headers in input processing (#1561) 2025-05-23 13:37:32 +02:00
Matthias Endler
973b2aa5e0
chore: update CI to install and verify cargo-msrv (#1706) 2025-05-18 02:02:35 +02:00
Matthias Endler
00118965bd
Fix lints (#1705) 2025-05-17 21:12:38 +02:00
Keming
874b0f0ca2
chore: verify the MSRV in CI lint (#1696)
Signed-off-by: Keming <kemingy94@gmail.com>
2025-05-14 01:54:05 +02:00
Keming
1ed357fe73
feat: detect website fragments (#1675)
Signed-off-by: Keming <kemingy94@gmail.com>
2025-05-14 01:52:08 +02:00
Thomas Zahner
a8c0f45795 Update documentation 2025-05-13 10:31:49 +02:00
Thomas Zahner
cc40894c38 Make Makefile more portable (make: /bin/bash: No such file or directory) 2025-05-13 10:31:49 +02:00
Thomas Zahner
4e16d2fc29 Remove flag 2025-05-13 10:31:49 +02:00
Jakob
3a0922757e
detect wikilinks, prevent plaintext extraction from links #1650 (#1679) 2025-05-12 23:06:51 +02:00
dependabot[bot]
a5cf40cbd4 Bump the dependencies group with 2 updates
Bumps the dependencies group with 2 updates: [clap](https://github.com/clap-rs/clap) and [tempfile](https://github.com/Stebalien/tempfile).


Updates `clap` from 4.5.37 to 4.5.38
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/clap_complete-v4.5.37...clap_complete-v4.5.38)

Updates `tempfile` from 3.19.1 to 3.20.0
- [Changelog](https://github.com/Stebalien/tempfile/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Stebalien/tempfile/compare/v3.19.1...v3.20.0)

---
updated-dependencies:
- dependency-name: clap
  dependency-version: 4.5.38
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: tempfile
  dependency-version: 3.20.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-05-12 16:01:57 +02:00
Matthias Endler
ab27d6fee3
Add possible values for minimum TLS version in help message (#1693)
Follow up of https://github.com/lycheeverse/lychee/pull/1655
2025-05-10 14:53:30 +02:00
Hugo McNally
fdf105c67a
Add TLS version option (#1655)
* Add a minimum TLS option
* Update help message for min tls version
2025-05-10 12:59:55 +02:00
dependabot[bot]
db6d3334c9
Bump the dependencies group across 1 directory with 11 updates (#1692)
Bumps the dependencies group with 11 updates in the / directory:

| Package | From | To |
| --- | --- | --- |
| [anyhow](https://github.com/dtolnay/anyhow) | `1.0.97` | `1.0.98` |
| [clap](https://github.com/clap-rs/clap) | `4.5.34` | `4.5.37` |
| [env_logger](https://github.com/rust-cli/env_logger) | `0.11.7` | `0.11.8` |
| [openssl-sys](https://github.com/sfackler/rust-openssl) | `0.9.106` | `0.9.108` |
| [tabled](https://github.com/zhiburt/tabled) | `0.18.0` | `0.19.0` |
| [tokio](https://github.com/tokio-rs/tokio) | `1.44.1` | `1.45.0` |
| [toml](https://github.com/toml-rs/toml) | `0.8.20` | `0.8.22` |
| [assert_cmd](https://github.com/assert-rs/assert_cmd) | `2.0.16` | `2.0.17` |
| [html5ever](https://github.com/servo/html5ever) | `0.30.0` | `0.31.0` |
| [octocrab](https://github.com/XAMPPRocky/octocrab) | `0.44.0` | `0.44.1` |
| [shellexpand](https://gitlab.com/ijackson/rust-shellexpand) | `3.1.0` | `3.1.1` |



Updates `anyhow` from 1.0.97 to 1.0.98
- [Release notes](https://github.com/dtolnay/anyhow/releases)
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.97...1.0.98)

Updates `clap` from 4.5.34 to 4.5.37
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/clap_complete-v4.5.34...clap_complete-v4.5.37)

Updates `env_logger` from 0.11.7 to 0.11.8
- [Release notes](https://github.com/rust-cli/env_logger/releases)
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rust-cli/env_logger/compare/v0.11.7...v0.11.8)

Updates `openssl-sys` from 0.9.106 to 0.9.108
- [Release notes](https://github.com/sfackler/rust-openssl/releases)
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-sys-v0.9.106...openssl-sys-v0.9.108)

Updates `tabled` from 0.18.0 to 0.19.0
- [Changelog](https://github.com/zhiburt/tabled/blob/master/CHANGELOG.md)
- [Commits](https://github.com/zhiburt/tabled/commits)

Updates `tokio` from 1.44.1 to 1.45.0
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.44.1...tokio-1.45.0)

Updates `toml` from 0.8.20 to 0.8.22
- [Commits](https://github.com/toml-rs/toml/compare/toml-v0.8.20...toml-v0.8.22)

Updates `assert_cmd` from 2.0.16 to 2.0.17
- [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md)
- [Commits](https://github.com/assert-rs/assert_cmd/compare/v2.0.16...v2.0.17)

Updates `html5ever` from 0.30.0 to 0.31.0
- [Commits](https://github.com/servo/html5ever/commits)

Updates `octocrab` from 0.44.0 to 0.44.1
- [Release notes](https://github.com/XAMPPRocky/octocrab/releases)
- [Changelog](https://github.com/XAMPPRocky/octocrab/blob/main/CHANGELOG.md)
- [Commits](https://github.com/XAMPPRocky/octocrab/compare/v0.44.0...v0.44.1)

Updates `shellexpand` from 3.1.0 to 3.1.1
- [Commits](https://gitlab.com/ijackson/rust-shellexpand/compare/shellexpand-3.1.0...shellexpand-3.1.1)

---
updated-dependencies:
- dependency-name: anyhow
  dependency-version: 1.0.98
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: clap
  dependency-version: 4.5.37
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: env_logger
  dependency-version: 0.11.8
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: openssl-sys
  dependency-version: 0.9.108
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: tabled
  dependency-version: 0.19.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: tokio
  dependency-version: 1.45.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: toml
  dependency-version: 0.8.22
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: assert_cmd
  dependency-version: 2.0.17
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: html5ever
  dependency-version: 0.31.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependencies
- dependency-name: octocrab
  dependency-version: 0.44.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
- dependency-name: shellexpand
  dependency-version: 3.1.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-09 16:32:56 +02:00
Keming
809958b75b
Specify MSRV (#1676)
* Specify MSRV

Signed-off-by: Keming <kemingy94@gmail.com>
2025-05-09 16:09:22 +02:00
Redddy
d232789faa Fix outdated link 2025-05-09 14:40:43 +02:00
Thomas Zahner
3319503b6c Remove once_cell as direct dependency 2025-05-09 14:31:05 +02:00