On 16 January 2013 10:28, Trent W. Buck <trentbuck@gmail.com> wrote:

Geoff D'Arcy wrote:
> Most pay-walled News.com articles are accessible in full via Google.

If so, then tell your browser --user-agent='Hi I'm the booblegot' or
whatever their spider sends, and you should be golden.

My (untested) theory is that is looks at the Referer: header, not the user-agent header.

--
Brian May <brian@microcomaustralia.com.au>