dev-go/fetchbot
Simple, flexible web crawler that follows robots.txt policies and crawl delays
Screenshots
View
Download
BrowseReverse Dependencies
Reverse dependancies are sometimes conditional based on your USE flags, Ebuild version and sometimes other packages. please keep this in mind.