Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
134 packages returned for Tags:"Crawler"
Sort by
Relevance
Downloads
Recently updated
WebReaper
by:
AlexPavlov
.NET 7.0
5,158 total downloads
last updated
8/15/2023
Latest version:
3.5.1
scraper
crawler
parser
Declarative high performance web scraper in C#. Easily crawl any web site and parse the data, save structed result to a file, DB, etc.
Scraping
by:
otavioalfenas
.NET Framework 4.6.1
8,464 total downloads
last updated
10/14/2020
Latest version:
3.0.0.3
Scraping
C#
Crawler
Toolkit
Web
Robot
High productivity facilitator for scraping web pages
scSearchContrib.
Crawler
by:
sitecorian
.NET Framework 3.5
8,015 total downloads
last updated
5/7/2013
Latest version:
2.1.0
sitecore
search
lucene
advanced
database
crawler
The crawling/indexing component of the Sitecore Search Contrib project
AppStoresScraper
by:
Dissimilis
.NET Framework 4.5
13,508 total downloads
last updated
6/9/2016
Latest version:
1.2.1-CI00002
GooglePlayStore
GoogleStore
PlayStore
ITunes
ITunesStore
WindowsStore
AppStore
Parser
Scraper
Crawler
AppStoresScraper is library for downloading app metadata from Steam, Google, Apple and Windows app stores
SmogonTeamCrawler.
Core
by:
FullLifeGames
.NET 6.0
3,873 total downloads
last updated
1/23/2023
Latest version:
2.0.2
Smogon
Pokémon
Team
Crawler
Goes through http://www.smogon.com/forums/ and saves all teams it finds.
DotnetSpiderLite.
ProxyPools
by:
jxnkwlp
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
2,290 total downloads
last updated
5/31/2019
Latest version:
0.2.0
DotnetSpider
crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
DotnetSpider.
Kafka
by:
zlzforever
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
3,310 total downloads
last updated
8/28/2019
Latest version:
4.0.8-beta2
DotnetSpider
crawler
dotnet
core
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
AnimeDl
by:
Jerro
Deprecated
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
21,146 total downloads
last updated
3/14/2023
Latest version:
1.8.9
anime
animedl
scraper
animescraper
scraping
crawler
gogoanime
twistmoe
zoro
zoroto
More tags
AnimeDl scrapes animes from sites for streaming or downloading.
PlurCrawler
by:
Plurdis
.NET Framework 4.6.1
3,122 total downloads
last updated
3/16/2018
Latest version:
1.0.2
WebCrawling
Crawler
Plurdis
Crawler For Big Data Anaysising
Tenteikura
by:
bolthar
.NET Framework 4.0
1,965 total downloads
last updated
11/21/2012
Latest version:
1.0.0
Crawler
Web
A minimal multithreaded web crawler
imbWEM.
Core
by:
goran.grubic
.NET Framework 4.0
3,945 total downloads
last updated
2/16/2018
Latest version:
0.1.2.12
WEM
Crawler
Semantic
Data
Mining
Web Exploration Model: crawlers, crawler reports, web analytic console, web loader, web crawler experiment setup...
DotnetSpiderLite.
Scheduler.
Redis
by:
jxnkwlp
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,729 total downloads
last updated
5/31/2019
Latest version:
0.2.0
DotnetSpider
crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
DotNetExpose
by:
joao2391
.NET 6.0
2,604 total downloads
last updated
4/20/2022
Latest version:
1.0.5
Scrap
WebScrap
Crawler
WebCrawler
A package that helps you to scrap web pages. It shows you a lot of information about the page.
ExcavatorSharp.
WebScraper.
x64
by:
ExcavatorSharp
.NET Framework 4.5.2
8,036 total downloads
last updated
8/10/2020
Latest version:
1.2.8
scraping
scraper
html
web
parser
crawler
parsing
web-scraper
ExcavatorSharp is a multi-threaded server for scraping web data. It converts HTML code into a structured array of data. The library allows data scraping from multiple sites in parallel mode, within a single...
More information
totalrecall
by:
brandonc
.NET Framework
2,650 total downloads
last updated
6/8/2011
Latest version:
0.2.3
search
msbuild
crawler
lucene
Crawl and index your (static) asp.net website for searching using an MSBuild target. Simple search query interface. Uses Lucene.Net and NCrawler.
CoreCompat.
NScrape
by:
quamotion
.NET 5.0
.NET Core 1.0
.NET Standard 1.5
.NET Framework 4.5
8,879 total downloads
last updated
9/22/2017
Latest version:
0.4.0-r6
html
scrape
scraper
scraping
crawler
crawling
htmlagilitypack
htmlagility
agility
A web scraping framework for .Net
HtmlAgilityPack_Helper
by:
parsa5
.NET Framework
5,444 total downloads
last updated
11/15/2017
Latest version:
2.0.0
HtmlAgilityPack
Html
Parse
Crawler
Spider
HAP
It helps you to use HAP in easier and meaningful way via Reflection. It works somehow like Entity-Framework. Go to wiki in github page for tutorial : https://github.com/parsalotfy/HtmlAgilityPack_Helper/wiki
SocialSense
by:
fakeezz
.NET Framework 4.0
5,290 total downloads
last updated
8/31/2013
Latest version:
1.2.0
social
crawler
twitter
facebook
google+
blog
Crawler for main social networks
CrawlerLib.
Engine.
TestHelper
by:
Crawler-Lib
.NET Framework
16,576 total downloads
last updated
3/7/2015
Latest version:
2.3.5544.21265
crawler-lib
test
helper
nunit
mstest
unit-test
crawler
spider
bot
scraper
More tags
The Crawler-Lib Engine Test Helper simplifies the test of tasks. It can be used to develop unit tests and integration tests for tasks.
DotnetSpiderLite.
NLog
by:
jxnkwlp
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,435 total downloads
last updated
5/31/2019
Latest version:
0.2.0
DotnetSpider
crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
Previous
Next