16 Jan
2013
16 Jan
'13
12:12 a.m.
On 16 January 2013 10:28, Trent W. Buck <trentbuck@gmail.com> wrote:
Geoff D'Arcy wrote:
Most pay-walled News.com articles are accessible in full via Google.
If so, then tell your browser --user-agent='Hi I'm the booblegot' or whatever their spider sends, and you should be golden.
My (untested) theory is that is looks at the Referer: header, not the user-agent header. -- Brian May <brian@microcomaustralia.com.au>