82 packages returned for Tags:"Crawler"

This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world"... More information
Deprecated as there's new maintainer for original HAP project. Please check the new repo at https://github.com/zzzprojects/html-agility-pack. This is a port of HtmlAgilityPack library created by Simon Mourrier and Jeff Klawiter for .NET Core platform. This NuGet package supports can be used with... More information
  • 262 total downloads
  • last updated 1/13/2018
  • Latest version: 0.1.0
  • crawler
A web crawler written with .net standard
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to... More information
Spidey is a library designed to help with crawling and parsing web content.
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
  • 333 total downloads
  • last updated 12/10/2017
  • Latest version: 1.0.0
  • crawler spider
这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
  • 436 total downloads
  • last updated 5/5/2019
  • Latest version: 1.0.3
  • Web Crawler
Simple web crawler. Discover website resources and sitemap. Supports .net framework, .net standard and .net core.
  • 907 total downloads
  • last updated 11/21/2012
  • Latest version: 1.0.0
  • Crawler Web
A minimal multithreaded web crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET