Hopiu/lychee
1
0
Fork 0
mirror of https://github.com/Hopiu/lychee.git synced 2026-04-02 20:50:39 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
1109 commits 1 branch 0 tags 5.1 MiB
Commit graph

1109 commits

This branch
This branch
All branches
Author SHA1 Message Date
dependabot[bot]
ff087cbed3
Bump hyper from 0.14.24 to 0.14.25 
Bumps [hyper](https://github.com/hyperium/hyper) from 0.14.24 to 0.14.25.
- [Release notes](https://github.com/hyperium/hyper/releases)
- [Changelog](https://github.com/hyperium/hyper/blob/v0.14.25/CHANGELOG.md)
- [Commits](https://github.com/hyperium/hyper/compare/v0.14.24...v0.14.25)

---
updated-dependencies:
- dependency-name: hyper
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-13 12:59:04 +00:00
Matthias Endler
55797071b0
Fix nested URL extraction in verbatim elements (#988) 
Skipping URLs in verbatim elements didn't take nested
elements into consideration, which were not verbatim.

For instance, the following HTML snippet would yield
`https://example.com` in non-verbatim mode, even if
it is nested inside a verbatim `<pre>` element:

```html
<pre><a href="https://example.com">link</a></pre>
```

This commit fixes the behavior for both `html5gum` and
`html5ever`.

Note that nested verbatim elements of the same kind
still are not handled correctly.

For instance,  the following HTML snippet would still yield
`https://example.com`:

```html
<pre>
  <pre></pre>
  <a href="https://example.com">link</a>
</pre>
```

The reason is that we currently only keep track of a single
verbatim element and not a stack of elements, which we
would need to unwind and resolve the situation.

Fixes https://github.com/lycheeverse/lychee/issues/986.
 2023-03-11 15:18:25 +01:00
Matthias Endler
2255ad9286
Better retry handling (#981) 
Previously, lychee would blindly retry all requests,
no matter if the request error was transient or fatal.

Taking a lesson from https://github.com/TrueLayer/reqwest-middleware,
we can be more granular about the error behavior.
This PR adds their retry logic to lychee, reducing the number of
unnecessary requests significantly.

I also made some ergonomic changes to the client, which should not
affect its behavior.
 2023-03-10 22:36:45 +01:00
Matthias Endler
30e2a2b62b
Fix --max-redirects (#987) 
Having more than the max number of redirects
caused lychee to abort the requests, but did not
lead to an error.

Related: https://github.com/lycheeverse/lychee-action/issues/164
 2023-03-10 15:15:37 +01:00
dependabot[bot]
ac189306ef Bump typed-builder from 0.13.0 to 0.14.0 
Bumps [typed-builder](https://github.com/idanarye/rust-typed-builder) from 0.13.0 to 0.14.0.
- [Release notes](https://github.com/idanarye/rust-typed-builder/releases)
- [Changelog](https://github.com/idanarye/rust-typed-builder/blob/master/CHANGELOG.md)
- [Commits](https://github.com/idanarye/rust-typed-builder/commits)

---
updated-dependencies:
- dependency-name: typed-builder
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-09 19:47:18 +01:00
dependabot[bot]
add15af2aa
Merge pull request #982 from lycheeverse/dependabot/cargo/serde-1.0.154 2023-03-09 13:05:12 +00:00
dependabot[bot]
7ffb9eac10
Bump serde from 1.0.153 to 1.0.154 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.153 to 1.0.154.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.153...v1.0.154)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-09 12:58:27 +00:00
dependabot[bot]
12f3dcbc6d Bump typed-builder from 0.12.0 to 0.13.0 
Bumps [typed-builder](https://github.com/idanarye/rust-typed-builder) from 0.12.0 to 0.13.0.
- [Release notes](https://github.com/idanarye/rust-typed-builder/releases)
- [Changelog](https://github.com/idanarye/rust-typed-builder/blob/master/CHANGELOG.md)
- [Commits](https://github.com/idanarye/rust-typed-builder/commits)

---
updated-dependencies:
- dependency-name: typed-builder
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-09 01:31:49 +01:00
dependabot[bot]
688d864671
Merge pull request #980 from lycheeverse/dependabot/cargo/serde-1.0.153 2023-03-08 13:05:07 +00:00
dependabot[bot]
a511793c5c
Bump serde from 1.0.152 to 1.0.153 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.152 to 1.0.153.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.152...v1.0.153)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-08 12:58:21 +00:00
Matthias Endler
fea200b512
Update FUNDING.yml 2023-03-08 00:49:50 +01:00
dependabot[bot]
684668f780
Merge pull request #979 from lycheeverse/dependabot/cargo/csv-1.2.1 2023-03-07 13:04:58 +00:00
dependabot[bot]
ce7d99d88c
Bump csv from 1.2.0 to 1.2.1 
Bumps [csv](https://github.com/BurntSushi/rust-csv) from 1.2.0 to 1.2.1.
- [Release notes](https://github.com/BurntSushi/rust-csv/releases)
- [Commits](https://github.com/BurntSushi/rust-csv/compare/1.2.0...1.2.1)

---
updated-dependencies:
- dependency-name: csv
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-07 12:58:08 +00:00
dependabot[bot]
46ed6f45ad
Merge pull request #976 from lycheeverse/dependabot/cargo/thiserror-1.0.39 2023-03-06 13:05:53 +00:00
dependabot[bot]
e8b4df4afc
Merge pull request #977 from lycheeverse/dependabot/cargo/serde_json-1.0.94 2023-03-06 13:05:30 +00:00
dependabot[bot]
244f013f22
Bump serde_json from 1.0.93 to 1.0.94 
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.93 to 1.0.94.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.93...v1.0.94)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-06 12:59:31 +00:00
dependabot[bot]
d17624e0fa
Bump thiserror from 1.0.38 to 1.0.39 
Bumps [thiserror](https://github.com/dtolnay/thiserror) from 1.0.38 to 1.0.39.
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.38...1.0.39)

---
updated-dependencies:
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-06 12:59:22 +00:00
Matthias
c9edb7f809 Split up quirks and skip twitter check 
It's flaky on Github
 2023-03-03 12:13:09 +01:00
Matthias
51628213d6 Explicit quirks output for test 2023-03-03 12:13:09 +01:00
Matthias
9eb3149a69 Custom config handling to spot errors when passing invalid config and ignoring errors loading missing default conf 2023-03-03 12:13:09 +01:00
Matthias
08d71e6196 Add new test config, which covers all tests 2023-03-03 12:13:09 +01:00
Matthias
49d1d3accb update help message 2023-03-03 12:13:09 +01:00
Matthias
6c133493e9 Revert "Don't ignore file-not-found errors when loading config" 
This reverts commit 9ade4502a27cb3776c5fb39cdad7666ab854a373.
 2023-03-03 12:13:09 +01:00
Matthias
08466ad59b Ignore config smoketest output report file 2023-03-03 12:13:09 +01:00
Matthias
19976cd9e7 Add test for missing and example config file and helper methods 2023-03-03 12:13:09 +01:00
Matthias
387766322d Don't ignore file-not-found errors when loading config 
This is no longer necessary ever since 712bdfa8cb
 2023-03-03 12:13:09 +01:00
Matthias
257ecd7bc0 disable all features flag (breaks example domain tests) 2023-03-03 12:13:09 +01:00
Matthias
c47f0b8c53 Use nextest for make test 2023-03-03 12:13:09 +01:00
Matthias
86f13609e6 Put lycheecache tests into separate subfolders to avoid race 2023-03-03 12:13:09 +01:00
Matthias
388bd20673 Fix tests after address is no longer a verbatim element 2023-03-03 12:13:09 +01:00
Matthias
17937537f8 Ignored URLs don't lead to failing exit code 2023-03-03 12:13:09 +01:00
Matthias
c549213bfe Fix test_skip_cache_unsupported 2023-03-03 12:13:09 +01:00
Matthias
f64c60aac0 Fix cache test 2023-03-03 12:13:09 +01:00
Matthias
09d0064e69 Split up test 2023-03-03 12:13:09 +01:00
Matthias
9b75da60a6 Ignore remap test 
https://github.com/robinst/linkify/pull/58
 2023-03-03 12:13:09 +01:00
Matthias
4306150e56 Excluded URLs are no longer cached 
See https://github.com/lycheeverse/lychee/pull/692
 2023-03-03 12:13:09 +01:00
Matthias
a7f7b989ef fix multiple_exclude_files test 2023-03-03 12:13:09 +01:00
Matthias
46d238ba93 fix url output 2023-03-03 12:13:09 +01:00
Matthias
e125d45a8e Multiple arguments get handled differently in clap in comparison to structopt 
We should document that change
 2023-03-03 12:13:09 +01:00
Matthias
59ddc1e27d Fix url input handling without scheme 2023-03-03 12:13:09 +01:00
Matthias
1f62590a02 Fix expected json output 2023-03-03 12:13:09 +01:00
Matthias
91c8bc3ef5 Temporarily move to criterion/master, which supports nextest 2023-03-03 12:13:09 +01:00
Matthias Endler
b4cc843f33 Add missing test- and linting flags 2023-03-03 12:13:09 +01:00
Matthias
ac13e5d16e Fix CLI tests 2023-03-03 12:13:09 +01:00
dependabot[bot]
74ce563c5d
Bump tokio from 1.25.0 to 1.26.0 (#974) 
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.25.0 to 1.26.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.25.0...tokio-1.26.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-03-02 17:06:33 +01:00
dependabot[bot]
c177507772
Merge pull request #973 from lycheeverse/dependabot/cargo/clap-4.1.8 2023-03-01 13:10:50 +00:00
dependabot[bot]
85ae5cf1de
Bump clap from 4.1.7 to 4.1.8 
Bumps [clap](https://github.com/clap-rs/clap) from 4.1.7 to 4.1.8.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v4.1.7...v4.1.8)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-01 13:00:44 +00:00
Lucy Voigt
ea03754934
Update 'verbose' in lychee TOML example to be Verbosity instead of boolean (#971) 
Co-authored-by: Lucy Voigt <lvoigt@launchdarkly.com>
 2023-02-28 22:51:20 +01:00
dependabot[bot]
458c10205e
Merge pull request #969 from lycheeverse/dependabot/cargo/clap-4.1.7 2023-02-28 13:02:25 +00:00
dependabot[bot]
4f130b4979
Bump clap from 4.1.6 to 4.1.7 
Bumps [clap](https://github.com/clap-rs/clap) from 4.1.6 to 4.1.7.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v4.1.6...v4.1.7)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-02-28 12:58:39 +00:00