GDOM

GDOM is the next generation of web-parsing, powered by GraphQL syntax and the Graphene framework.

Install it typing in your console:

pip install gdom

Usage

You can either do gdom --test to start a test server for testing queries or

gdom QUERY_FILE

Your QUERY_FILE could look similar to this:

{
  page(url:"http://www.yelp.com/biz/amnesia-san-francisco") {
    title: text(selector:"h1")
    phone: text(selector:".biz-phone")
    address: text(selector:".address")
    reviews: query(selector:"[itemprop=review]") {
      username: text(selector:".user-name a")
      comment: text(selector:"p")
    }
  }
}

This will output the results of your query in a nice json format.

Advanced usage

If you want to generalize your gdom query to any page, just rewrite your query file adding the $page var. So should look to something like this:

query ($page: String) {
  page(url:$page) {
    # ...
  }
}

And then, query it like:

gdom QUERY_FILE http://www.yelp.com/biz/amnesia-san-francisco