Damn Spam!
Search 

Topics

User Functions






    Lost your password?

More stupid bots: Exabot and NG/2.0

    
Friday, January 20 2006 @ 19:41 CET
Contributed by: Dirk

For the last three weeks, I'm counting about a thousand requests from "Exabot/2.0", usually in bursts where it sends one request per second. However, I don't see a single request for our robots.txt from the bot.

In other words: This is yet another clueless bot made by a clueless company that you may want to block.

The requests all seem to come from 193.47.80.42, aka crawl6.exabot.com. Both the IP address and exabot.com are registered to a French company named Exalead, located in Paris.

In their FAQ they state that Exalead's robot engine conforms to the Robot Exclusion standard and the robots META rules. However, as stated above, I can not find any evidence of that in our logfiles. What I did find, however, is another bot, "NG/2.0" coming from the same IP address. That bot does seem to check the robots.txt occasionally (only twice in all of January, to be exact).

Sorry guys, that's not how this works. Go searching for a clue ...

P.S. Ann Elisabeth wasn't too happy with a previous incarnation of that bot either.

Filed under: Bots
()

View Printable Version

Trackback

Trackback URL for this entry: http://spam.tinyweb.net/trackback.php/stupid-bots-exabot-ng

Here's what others have to say about 'More stupid bots: Exabot and NG/2.0':

News, strange & weird
Tracked on Sunday, July 09 2006 @ 19:40 CEST

More stupid bots: Exabot and NG/2.0 | 16 comments | Create New Account
The following comments are owned by whomever posted them. This site is not responsible for what they say.
More stupid bots: Exabot and NG/2.0
Thank you for this information on Bots. Some of this has been helpful for me as a webmaster as well in stopping some major problems I have encountered. Keep up the good work.
Authored by: Anonymous on Tuesday, March 07 2006 @ 04:27 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
I'm just curious to know how to stop the thing since I've tried shorewall and robots.txt and it seems to have no effect..?
Authored by: Anonymous on Thursday, April 06 2006 @ 23:39 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
I have also identified Exabot on 193.47.80.41, 193.47.80.45, 193.47.80.51 and 193.47.80.38
Authored by: Anonymous on Saturday, July 29 2006 @ 02:19 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
also seen on: 193.47.80.40
Authored by: Anonymous on Sunday, July 30 2006 @ 06:05 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Should I arganise a forced shutdown all the 4-5 IP adresses
previously mentionned and then fetch and detain this IP-company's employees and stuff as well as others in relation
to this bot
at Paris? In Moscou such Jewish spammers pay sometimes with
body pain!
Authored by: Anonymous on Friday, August 25 2006 @ 19:24 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0

Even though I may occasionally use language that implies otherwise, I'm against violence. I'm also against racial slurs. And people who think the perceived anonymity of the net would let them get away with one or the other ...

Besides, you're barking up the wrong tree. The above is about a mildly annoying bot written by a clueless company. It has nothing to do with spam.

Authored by: Dirk on Friday, August 25 2006 @ 20:18 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Pal, you need to take a pill.

If it weren't for these "stupid" bots the web would be a very difficult place to navigate.

Stop being such an ahole and a techno-dork and look at the marketing upside.

duuhhh, it's all about my computer, my program...

duhh
Authored by: Anonymous on Monday, August 28 2006 @ 04:35 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
We had problems with border line specifications in the robots.txt like the use of the longest match rather than the first match, and chars like ? $ * or Crawl delay
All these features that are not in the historical rfc are now have been implemented in our search engine.
If you still have problems with this bot, could you please contact me through the exalead feedback form on our website or via crawler[at]exalead[dot]com.
thanks
Authored by: Anonymous on Wednesday, September 20 2006 @ 12:04 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
O yea why are you taking snapshots without permission?
Why are you ilegaly hotlinking out images?

Please put up a page telling us how to turn off those options for our websites and stay in your index and we will stop calling you a bad programmer.
Authored by: Anonymous on Thursday, November 23 2006 @ 00:41 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
It is just a bot like googlebot, exealed (http://www.exalead.com/search) is just a search engine. It has nothing to do with spam...
Authored by: Anonymous on Wednesday, November 15 2006 @ 10:27 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0

Sure, but I reserve the right to blog about stupid bots like these :-)

Clueless companies that run a search engine are the 3rd worst problem on a typical website these days (after the spammers and the script kiddies).

Authored by: Dirk on Wednesday, November 15 2006 @ 19:49 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
How true - how true !
Authored by: Anonymous on Wednesday, November 15 2006 @ 20:19 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Exealed is not a clueless company, it will become a major search engine in the next years. It's an important part of the european quaero project...
Authored by: Anonymous on Wednesday, November 22 2006 @ 16:05 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Exalead is COMPLETELY CLUELESS or they wouldn't do a preview mode and strip out peoples javascripts, which make my page look like hell and I couldn't bust out of their stupid frame.

I now send them error messages, clueless morons...
Authored by: Anonymous on Thursday, November 23 2006 @ 03:14 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
To forbid the preview or the thumbnail on Exalead, you should add
meta name="robots" content="nopreview"
or
meta name="robots" content="nothumbnail"
in the page

ExaleadGuy
Authored by: Anonymous on Friday, November 24 2006 @ 10:50 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
You keep this crap up and you bots will get banned.
FOLLOW robots.txt and stop loading our images when robots.txt forbids it!
Authored by: Anonymous on Sunday, December 17 2006 @ 18:14 CET
[ Reply to This | # ]

Copyright © 2008 Damn Spam! Powered By Geeklog