Web Crawl Utility
Web Crawl Utility
Rating (5)
Reviews: 1
Category: Developer tools
Web Crawl Utility
Web Crawl Utility

Description

The Web Crawl Utility allows you to use regular expressions to crawl content from websites and save it to either XML or text files.

You can crawl multiple websites up to a specified maximum number of links using a regular expression pattern of your own. Speed up the crawling by utilizing multiple simultaneous requests.

Parse the downloaded data using regular expression trees. You can remove text segments with regular expressions, make multiple matches, and use regular expressions on text segments recursively. Map the parsed data to XML or map to a text file.

The app features both light and dark themes and the fluent design with acrylic paint.

  • Crawling URLs by regular expressions
  • Parallel requests for optimized performance
  • Regular expression trees for matching complex data
  • Data to XML mapping
  • XML to text mapping
  • Parsing single pages
Product ID: 9PNGW9W36R8G
Release date: 2018-10-25
Last update: 2022-03-12