Web Crawl Utility
Rating
5
Reviews
1
App details
About Web Crawl Utility
The Web Crawl Utility allows you to use regular expressions to crawl content from websites and save it to either XML or text files.
You can crawl multiple websites up to a specified maximum number of links using a regular expression pattern of your own. Speed up the crawling by utilizing multiple simultaneous requests.
Parse the downloaded data using regular expression trees. You can remove text segments with regular expressions, make multiple matches, and use regular expressions on text segments recursively. Map the parsed data to XML or map to a text file.
The app features both light and dark themes and the fluent design with acrylic paint.
Key features
-
Crawling URLs by regular expressions
-
Parallel requests for optimized performance
-
Regular expression trees for matching complex data
-
Data to XML mapping
-
XML to text mapping
-
Parsing single pages