Web scraper / crawler / spider. Supports robots protocol and user agent.
Install-Package SkyScraper -Version 1.0.46
dotnet add package SkyScraper --version 1.0.46
<PackageReference Include="SkyScraper" Version="1.0.46" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add SkyScraper --version 1.0.46
The NuGet Team does not provide support for this client. Please contact its maintainers for support.