Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Frameworks
.NET
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
108 packages returned for Tags:"Crawler"
Sort by
Relevance
Downloads
Recently updated
HtmlAgilityPack
by:
zzzprojects
132,936,172 total downloads
last updated
9/9/2023
Latest version:
1.11.53
HTML
parse
crawler
spider
linq
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows...
More information
HtmlAgilityPack.
NetCore
by:
zulfahmi93
2,675,495 total downloads
last updated
7/22/2016
Latest version:
1.5.0.1
HTML
parse
crawler
spider
linq
Deprecated as there's new maintainer for original HAP project. Please check the new repo at https://github.com/zzzprojects/html-agility-pack. This is a port of HtmlAgilityPack library created by Simon...
More information
Wangkanai.
Detection.
Crawler
by:
wangkanai
Deprecated
602,329 total downloads
last updated
9/25/2020
Latest version:
2.0.1
aspnetcore
detection
crawler
ASP.NET Core Detection Crawler resolver components
Abot
by:
sjdirect
534,763 total downloads
last updated
8/9/2021
Latest version:
2.0.70
crawler
robot
spider
.net
dotnet
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to...
More information
HtmlAgilityPack.
Net45
by:
Tomap
156,338 total downloads
last updated
5/20/2016
Latest version:
2.0.20
HTML
parse
crawler
spider
linq
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows...
More information
JsHttpClient
by:
jasonsoft.net
106,279 total downloads
last updated
6/21/2020
Latest version:
1.0.6
JsHttpClient
JasonSoft.Net
HttpClient
HttpHelper
Crawler
HttpClient extension class, and the .Net Core version of the HttpHelper class. Simple and flexible crawler base class library. JsHttpClient类是 .Net Core 下的一个简单灵活的爬虫基础类库
AbotX
by:
sjdirect
144,251 total downloads
last updated
4/9/2021
Latest version:
2.1.12
crawler
robot
spider
.net
dotnet
abot
A powerful C# web crawler that makes advanced crawling features easy to use. AbotX builds upon the open source Abot C# Web Crawler by providing a powerful set of wrappers and extensions.
DotnetSpider
by:
zlzforever
59,273 total downloads
last updated
7/11/2023
Latest version:
5.1.2
DotnetSpider
crawler
dotnet
core
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Spidey
by:
jacraig
28,770 total downloads
last updated
9/20/2023
Latest version:
5.0.25
web
crawler
Spidey is a library designed to help with crawling and parsing web content.
aemarcoCore
by:
aemarco
Deprecated
32,519 total downloads
last updated
10/9/2021
Latest version:
2.1.14
Crawler
FSK18
Wallpaper
Some stuff
SkyScraper
by:
JonCanning
30,498 total downloads
last updated
8/26/2016
Latest version:
1.0.46
spider
crawler
scraper
bot
Web scraper / crawler / spider. Supports robots protocol and user agent.
SpiderSharp
by:
jefersonsv
29,694 total downloads
last updated
4/10/2019
Latest version:
1.0.25
spider
scrap
crawler
Web Crawling and Scraping Framework
dcsoup
by:
matarillo
86,995 total downloads
last updated
6/21/2017
Latest version:
1.0.0
HTML
jsoup
jquery
parse
parser
parsing
crawl
crawler
crawling
scrape
More tags
dcsoup is a .NET library for working with real-world HTML. It provides a very convenient API for extracting and manipulating data, using the best of DOM, CSS, and jquery-like methods. This library is basically...
More information
AbotCore
by:
Kemy
18,410 total downloads
last updated
11/21/2016
Latest version:
0.1.13-beta
crawler
robot
spider
.NET Core port of sjdirect/abot. Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..)....
More information
RuiJi.
Net.
Core
by:
lxiang
pingqi
16,214 total downloads
last updated
8/21/2020
Latest version:
1.2.2
crawler
extractor
scraper
crawler framework , distributed crawler extractor. try ruiji scraper --- chrome web crawler https://chrome.google.com/webstore/detail/ruiji-scraper/klhahkhllngppofpkjdlbmnglnmnbbol?hl=zh-CN&authuser=0
DotnetSpider.
Mongo
by:
zlzforever
9,764 total downloads
last updated
7/11/2023
Latest version:
5.1.2
DotnetSpider
crawler
dotnet
core
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
SoftCircuits.
HtmlMonkey
by:
SoftCircuits
26,180 total downloads
last updated
5/19/2022
Latest version:
2.1.2
html-parser
xml-parser
html
xml
parse
parser
crawler
spider
HtmlMonkey is a lightweight HTML/XML parser written in C#. It allows you to parse an HTML or XML string into a hierarchy of node objects, which can then be traversed or queried using jQuery-like selectors. The...
More information
Aspose.
HTML
by:
Aspose
1,532,766 total downloads
last updated
9/5/2023
Latest version:
23.9.0
Aspose.Total
Conholdate.Total
Conholdate
Windows-Forms
WinForms
Web-Forms
Assembly
Library
API
On-premise-API
More tags
Aspose.HTML for .NET is a cross-platform class library that works as a headless browser that you can seamlessly integrate within your own .NET, C#, VB.NET, and ASP.NET applications. Aspose.HTML for .NET helps...
More information
DotnetSpider.
MySql
by:
zlzforever
9,451 total downloads
last updated
7/11/2023
Latest version:
5.1.2
DotnetSpider
crawler
dotnet
core
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
DotnetSpider.
HBase
by:
zlzforever
8,807 total downloads
last updated
7/11/2023
Latest version:
5.1.2
DotnetSpider
crawler
dotnet
core
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Previous
Next