Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
57 packages returned for Tags:"crawling"
Sort by
Relevance
Downloads
Recently updated
ProxyCrawlAPI
by:
proxycrawl
Deprecated
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.5
2,084 total downloads
last updated
7/27/2021
Latest version:
2.0.0
scrape
crawl
crawling
scraping
web
scrape
web
scraping
web
crawl
More tags
.NET library for scraping and crawling websites using the ProxyCrawl API.
Rhino.
Reporters.
Elastic
by:
gravity.customer-services
.NET 7.0
9,937 total downloads
last updated
3/21/2024
Latest version:
2024.3.21.1
automation
crawling
crawl
selenium
appium
testing
test
qa
gravity
api
More tags
Elastic Search Reporter.
WhoisParsers
by:
zmarty
.NET Framework 4.5
26,262 total downloads
last updated
12/11/2019
Latest version:
0.2.2
whois
rwhois
parser
parsers
crawling
arin
afrinic
apnic
lacnic
ripe
More tags
This allows you to: 1) Download and parse Whois records from bulk whois database dumps of IANA organizations (ARIN, AFRINIC, APNIC, LACNIC, RIPE ) and 2) Crawl and parse RWhois records from RFC 2167 ARIN...
More information
Isaac.
Spidey
by:
a6576171
.NET 5.0
805 total downloads
last updated
11/19/2020
Latest version:
0.7.4
simple
spider
framework
crawling
Spidey ! A simple spider framework for crawling
CrawlbaseAPI
by:
crawlbase
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.5
1,361 total downloads
last updated
10/4/2023
Latest version:
1.1.0
scrape
crawl
crawling
scraping
web
scrape
web
scraping
web
crawl
More tags
.NET library for scraping and crawling websites using the Crawlbase API.
Rhino.
Connectors.
Simulator
by:
gravity.customer-services
.NET 7.0
6,260 total downloads
last updated
3/21/2024
Latest version:
2024.3.21.1
automation
crawling
crawl
selenium
appium
testing
test
qa
gravity
api
More tags
Connector simulator for testing and learning purposes.
Rhino.
Connectors.
Azure.
Text
by:
gravity.customer-services
.NET 7.0
4,723 total downloads
last updated
10/21/2023
Latest version:
2023.10.21.2
automation
crawling
crawl
selenium
appium
automation
testing
automation
test
qa
More tags
Connector for Azure DevOps and Team Foundation Server (TFS).
Nick.
RobotsParser
by:
nicholasb.za
.NET 6.0
3,988 total downloads
last updated
1/1/2023
Latest version:
2.0.6
robots
parse
robots
web
crawling
robots.txt
web
scraping
spider
sitemap
More tags
https://github.com/nicholasbergesen/RobotsParser/blob/master/README.md
dotnet-
price-
parser
by:
tteguayco
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
428 total downloads
last updated
8/7/2021
Latest version:
1.0.0
web
scraping
crawling
price
prices
currency
currencies
Open source library for parsing prices from raw strings.
GithubDataNet
by:
liebki
.NET 7.0
593 total downloads
last updated
12/3/2023
Latest version:
0.3.2
github
crawler
github-trends
crawling
microsoft
git
htmlagilitypack
Github(Data)Net is a simple C# library, using HtmlAgilityPack to retrieve several things from GitHub, things like trending repositories, profiles of users, the repositories of users and related information.
CrawlCtrl
by:
CrawlCtrl
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
182 total downloads
last updated
1/21/2024
Latest version:
1.0.0-alpha.2
robots.txt
robots
crawler
crawling
sitemap
Deserialize robots.txt files
Rhino.
Reporters.
Junit
by:
gravity.customer-services
.NET 7.0
2,364 total downloads
last updated
5/24/2023
Latest version:
2023.5.24.2
automation
crawling
crawl
selenium
appium
automation
testing
automation
test
qa
More tags
Rhino plugin for creating a flat, single file XML report using the JUnit Jupiter standard
CrawlCtrl.
Reader
by:
CrawlCtrl
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
75 total downloads
last updated
1/21/2024
Latest version:
1.0.0-alpha.2
robots.txt
robots
crawler
crawling
sitemap
Convenient wrapper for the CrawlCtrl deserializer, that makes it easy to load and deserialize robots.txt files
Rhino.
Client.
TestRail
by:
gravity.customer-services
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,393 total downloads
last updated
5/21/2020
Latest version:
2020.5.21.4
automation
crawling
crawl
selenium
appium
automation
testing
automation
test
qa
More tags
.NET Standard Client Libraries for Test Rail Test Case Management.
CrawlCtrl.
DependencyInjection.
DotNet
by:
CrawlCtrl
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
76 total downloads
last updated
1/21/2024
Latest version:
1.0.0-alpha.2
robots.txt
robots
crawler
crawling
sitemap
di
dependency
injection
.NET dependency injection support for CrawlCtrl
jx.
dcsoup
by:
j4587698
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
444 total downloads
last updated
3/13/2023
Latest version:
1.0.1
HTML
jsoup
jquery
parse
parser
parsing
crawl
crawler
crawling
scrape
More tags
此fork仅为了移植一些jsoup的代码,以便在.net core下使用。不保证维护。 dcsoup is a .NET library for working with real-world HTML. It provides a very convenient API for extracting and manipulating data, using the best of DOM, CSS,...
More information
CrawlCtrl.
Reader.
DependencyInjection.
DotNet
by:
CrawlCtrl
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
76 total downloads
last updated
1/21/2024
Latest version:
1.0.0-alpha.2
robots.txt
robots
crawler
crawling
sitemap
di
dependency
injection
reader
.NET dependency injection support for CrawlCtrl.Reader
Previous
Next