Spidr
web spidering library that can spider a site, multiple domains, certain links or infinitely.
Ruby › Web Crawling: “A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.”
Selenium › Resources > Tools > Ruby: “web spidering library that can spider a site, multiple domains, certain links or infinitely.”