I wanted a quick way to run some XPath selectors against a web page today. Nokogiri comes with a command line tool that you can pass a url and it will drop you into an IRB session. This allows you to play around with some Ruby code to explore a webpage before scraping it.
This is useful, but I wanted to use it with Pry. It turns out that adding support for Pry is relatively easy, but I couldn’t find any clear top to bottom instructions, so I’ve documented the process below.
First install Nokogiri and Pry:
gem install nokogiri pry
Then add the following code to
That’s it! Now when you use the
nokogiri command line tool it will now drop you into a pry REPL. This is perfect for testing your CSS and XPath selectors when you’re writing a scraper.