Ghost.py is a webkit web client written in python

I just tried to use dryscrape [1] for a project. It's great when it works, but it's not liberal enough in what it accepts [2], so it gives off showstopping InvalidResponseErrors (which make sense when the library is using for BDD, but not when you are using it to get at javascripty download links).

This ghost.py looks great, I'll give it a go after dinner tonight.

[1] https://github.com/niklasb/dryscrape

[2] http://en.wikipedia.org/wiki/Robustness_principle

[3] https://github.com/niklasb/dryscrape/issues/6

Re: Ghost.py is a webkit web client written in python

#8

Post by albertzeyer » Fri, Apr 27, 2012, 1:51 AM UTC

I have done this somewhat more directly with PyQt4. I wonder wether it's useful to have this layer in between. Whereby it seem to have some useful tools. This is the main code:

* https://github.com/jeanphix/Ghost.py/blob/master/ghost/ghost...

* https://github.com/jeanphix/Ghost.py/blob/master/ghost/utils...

If you are interested, this is some own code where I just use PyQt4 directly:

* https://github.com/albertz/google-books-export/blob/master/g...

Re: Ghost.py is a webkit web client written in python

#9

Post by albertzeyer » Fri, Apr 27, 2012, 2:05 AM UTC

wahnfrieden wrote: post #5

pie wrote: post #2

This appears to be a wrapper for PyQt4's QTWebKit. http://www.riverbankcomputing.co.uk/static/Docs/PyQt4/html/q...

Ah it's going to be a quite out of date version of Webkit then. Anyone know which version exactly? We're using PyQt and this has been a huge issue.

Here you'll find the exact revision for each Qt version: http://trac.webkit.org/wiki/QtWebKit

E.g. I use Qt 4.8 (via PyQt 4.9) and thus I have WebKit trunk from 2011-05-05 (r85855).

There is also PyQt4.QtWebKit.qWebKitVersion().

If you have the Qt source at hand, check src/3rdparty/webkit/VERSION.

Re: Ghost.py is a webkit web client written in python

#10

Post by wahnfrieden » Fri, Apr 27, 2012, 2:48 AM UTC

albertzeyer wrote: post #9

wahnfrieden wrote: post #5

Earlier quoted context omitted.

Ah it's going to be a quite out of date version of Webkit then. Anyone know which version exactly? We're using PyQt and this has been a huge issue.

Here you'll find the exact revision for each Qt version: http://trac.webkit.org/wiki/QtWebKit E.g. I use Qt 4.8 (via PyQt 4.9) and thus I have WebKit trunk from 2011-05-05 (r85855). There is also PyQt4.QtWebKit.qWebKitVersion(). If you have the Qt source at hand, check src/3rdparty/webkit/VERSION.

Thanks