linkchecker/tests/checker/data/norobots.html

2 lines
85 B
HTML

<meta name="robots" content="noindex, Nofollow">
<a href="do_not_check.html">bla</a>