Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
134 packages returned for Tags:"Crawler"
Sort by
Relevance
Downloads
Recently updated
HtmlAgilityPack
by:
zzzprojects
.NET 5.0
.NET Core 1.0
.NET Standard 1.3
.NET Framework 3.5
165,311,130 total downloads
last updated
4/30/2024
Latest version:
1.11.61
HTML
parse
crawler
spider
linq
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows...
More information
HtmlAgilityPack.
NetCore
by:
zulfahmi93
.NET 5.0
.NET Core 1.0
.NET Standard 1.3
.NET Framework 4.5
3,263,912 total downloads
last updated
7/22/2016
Latest version:
1.5.0.1
HTML
parse
crawler
spider
linq
Deprecated as there's new maintainer for original HAP project. Please check the new repo at https://github.com/zzzprojects/html-agility-pack. This is a port of HtmlAgilityPack library created by Simon...
More information
Wangkanai.
Detection.
Crawler
by:
wangkanai
Deprecated
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
694,672 total downloads
last updated
9/25/2020
Latest version:
2.0.1
aspnetcore
detection
crawler
ASP.NET Core Detection Crawler resolver components
Abot
by:
sjdirect
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
740,574 total downloads
last updated
8/9/2021
Latest version:
2.0.70
crawler
robot
spider
.net
dotnet
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to...
More information
HtmlAgilityPack.
Net45
by:
Tomap
.NET Framework 4.5
226,059 total downloads
last updated
5/20/2016
Latest version:
2.0.20
HTML
parse
crawler
spider
linq
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows...
More information
AbotX
by:
sjdirect
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
209,755 total downloads
last updated
4/9/2021
Latest version:
2.1.12
crawler
robot
spider
.net
dotnet
abot
A powerful C# web crawler that makes advanced crawling features easy to use. AbotX builds upon the open source Abot C# Web Crawler by providing a powerful set of wrappers and extensions.
JsHttpClient
by:
jasonsoft.net
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
112,154 total downloads
last updated
6/21/2020
Latest version:
1.0.6
JsHttpClient
JasonSoft.Net
HttpClient
HttpHelper
Crawler
HttpClient extension class, and the .Net Core version of the HttpHelper class. Simple and flexible crawler base class library. JsHttpClient类是 .Net Core 下的一个简单灵活的爬虫基础类库
DotnetSpider
by:
zlzforever
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
87,290 total downloads
last updated
7/11/2023
Latest version:
5.1.2
DotnetSpider
crawler
dotnet
core
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
FiftyOne.
DeviceDetection.
Shared
by:
51Degrees
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
329,542 total downloads
last updated
5/3/2024
Latest version:
4.4.121
51degrees
pipeline
data
device
detection
user-agent
parse
detection-library
bots
crawler
More tags
51Degrees Device Detection parses HTTP headers to return detailed hardware, operating system, browser, and crawler information for the devices used to access your website or service. This package contains...
More information
FiftyOne.
DeviceDetection.
Hash.
Engine.
OnPremise
by:
51Degrees
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
286,666 total downloads
last updated
5/3/2024
Latest version:
4.4.121
51degrees
pipeline
data
device
detection
user-agent
parse
detection-library
bots
crawler
More tags
51Degrees Device Detection parses HTTP headers to return detailed hardware, operating system, browser, and crawler information for the devices used to access your website or service. This package is an...
More information
FiftyOne.
DeviceDetection.
Cloud
by:
51Degrees
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
282,922 total downloads
last updated
5/3/2024
Latest version:
4.4.121
51degrees
pipeline
data
device
detection
user-agent
parse
detection-library
bots
crawler
More tags
51Degrees Device Detection parses HTTP headers to return detailed hardware, operating system, browser, and crawler information for the devices used to access your website or service. This package retrieves...
More information
FiftyOne.
DeviceDetection
by:
51Degrees
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
269,411 total downloads
last updated
5/3/2024
Latest version:
4.4.121
51degrees
pipeline
data
device
detection
user-agent
parse
detection-library
bots
crawler
More tags
51Degrees Device Detection parses HTTP headers to return detailed hardware, operating system, browser, and crawler information for the devices used to access your website or service. This is an alternative to...
More information
Spidey
by:
jacraig
.NET 6.0
35,945 total downloads
last updated
5/6/2024
Latest version:
5.0.86
web
crawler
Spidey is a library designed to help with crawling and parsing web content.
SkyScraper
by:
JonCanning
.NET Framework 4.5
38,592 total downloads
last updated
8/26/2016
Latest version:
1.0.46
spider
crawler
scraper
bot
Web scraper / crawler / spider. Supports robots protocol and user agent.
aemarcoCore
by:
aemarco
Deprecated
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
34,164 total downloads
last updated
10/9/2021
Latest version:
2.1.14
Crawler
FSK18
Wallpaper
Some stuff
SpiderSharp
by:
jefersonsv
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
30,341 total downloads
last updated
4/10/2019
Latest version:
1.0.25
spider
scrap
crawler
Web Crawling and Scraping Framework
dcsoup
by:
matarillo
.NET 5.0
.NET Core 1.0
.NET Standard 1.3
.NET Framework 4.5
99,343 total downloads
last updated
6/21/2017
Latest version:
1.0.0
HTML
jsoup
jquery
parse
parser
parsing
crawl
crawler
crawling
scrape
More tags
dcsoup is a .NET library for working with real-world HTML. It provides a very convenient API for extracting and manipulating data, using the best of DOM, CSS, and jquery-like methods. This library is basically...
More information
AbotCore
by:
Kemy
.NET 5.0
.NET Core 1.0
.NET Standard 1.6
.NET Framework 4.6
18,785 total downloads
last updated
11/21/2016
Latest version:
0.1.13-beta
crawler
robot
spider
.NET Core port of sjdirect/abot. Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..)....
More information
RuiJi.
Net.
Core
by:
lxiang
pingqi
.NET 5.0
.NET Core 3.0
.NET Standard 2.1
.NET Framework 4.7.2
17,462 total downloads
last updated
8/21/2020
Latest version:
1.2.2
crawler
extractor
scraper
crawler framework , distributed crawler extractor. try ruiji scraper --- chrome web crawler https://chrome.google.com/webstore/detail/ruiji-scraper/klhahkhllngppofpkjdlbmnglnmnbbol?hl=zh-CN&authuser=0
SoftCircuits.
HtmlMonkey
by:
SoftCircuits
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
41,609 total downloads
last updated
3/17/2024
Latest version:
2.2.0
html-parser
xml-parser
html
xml
parse
parser
crawler
spider
HtmlMonkey is a lightweight HTML/XML parser written in C#. It allows you to parse an HTML or XML string into a hierarchy of node objects, which can then be traversed or queried using jQuery-like selectors. The...
More information
Previous
Next