Sat, 05 Jan 2008

Google blocks browsers
Netmeister has an interesting blurb about experience with Google blocking various UserAgents.

From the posting:

For example, perl's LWP::UserAgent sets the agent string per default to
"libwww-perl/#.#". Google apparently doesn't like that and will not
return results to you. Setting it to something like "Mozilla/5.0 (X11;
U; NetBSD i386; en-US; rv:1.8.1.3)" would work.

Interestingly, they appear to whitelist agents, rather than blacklisting
them.


What was that about not being evil?

writebacks

writebacks...

trackback

TrackBack ping me at:

http://www.rainysoul.net/~mforde/blog/index.pl.trackback

comment...

 
Name:
URL/Email: [http://... or mailto:you@wherever] (optional)
Title: (optional)
Comments:
Save my Name and URL/Email for next time
Captcha: To prevent comment spam, prove you're a human or a close approximation:
<@captcha.get output="yes" />
Enter text here: