zmarty

OpenScraping by: zmarty

13,983 total downloads
last updated 12/27/2018
Latest version: 1.4.2
html extraction scraping scraper parser parsing open scraping openscraping

Turn unstructured HTML pages into structured data. The OpenScraping library can extract information from HTML pages using a JSON config file with xPath rules. It can scrape even multi-level complex objects such as tables and forum posts.

WhoisParsers by: zmarty

Whois and RWhois Parsers and Crawlers

8,003 total downloads
last updated 1/19/2019
Latest version: 0.2.1
whois rwhois parser parsers crawling arin afrinic apnic lacnic ripe iana bulk database databases rfc 2167 referral servers download unpack decompress tsv

This allows you to: 1) Download and parse Whois records from bulk whois database dumps of IANA organizations (ARIN, AFRINIC, APNIC, LACNIC, RIPE ) and 2) Crawl and parse RWhois records from RFC 2167 ARIN Referral Whois Servers. It also provides utilities to increment IP addresses and to output Whois... More information