Damn Spam!
Search 

Topics

User Functions






Lost your password?

More stupid bots: Exabot and NG/2.0

    
Friday, January 20 2006 @ 19:41 CET
Contributed by: Dirk

For the last three weeks, I'm counting about a thousand requests from "Exabot/2.0", usually in bursts where it sends one request per second. However, I don't see a single request for our robots.txt from the bot.

In other words: This is yet another clueless bot made by a clueless company that you may want to block.

The requests all seem to come from 193.47.80.42, aka crawl6.exabot.com. Both the IP address and exabot.com are registered to a French company named Exalead, located in Paris.

In their FAQ they state that Exalead's robot engine conforms to the Robot Exclusion standard and the robots META rules. However, as stated above, I can not find any evidence of that in our logfiles. What I did find, however, is another bot, "NG/2.0" coming from the same IP address. That bot does seem to check the robots.txt occasionally (only twice in all of January, to be exact).

Sorry guys, that's not how this works. Go searching for a clue ...

P.S. Ann Elisabeth wasn't too happy with a previous incarnation of that bot either.

Filed under: Bots
()

What's Related

Story Options

Trackback

Trackback URL for this entry: http://spam.tinyweb.net/trackback.php/stupid-bots-exabot-ng

Here's what others have to say about 'More stupid bots: Exabot and NG/2.0':

News, strange & weird
Tracked on Sunday, July 09 2006 @ 19:40 CEST

More stupid bots: Exabot and NG/2.0 | 23 comments | Create New Account
The following comments are owned by whomever posted them. This site is not responsible for what they say.
More stupid bots: Exabot and NG/2.0
Thank you for this information on Bots. Some of this has been helpful for me as a webmaster as well in stopping some major problems I have encountered. Keep up the good work.
Authored by: Anonymous on Tuesday, March 07 2006 @ 04:27 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
I'm just curious to know how to stop the thing since I've tried shorewall and robots.txt and it seems to have no effect..?
Authored by: Anonymous on Thursday, April 06 2006 @ 23:39 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
I have also identified Exabot on 193.47.80.41, 193.47.80.45, 193.47.80.51 and 193.47.80.38
Authored by: Anonymous on Saturday, July 29 2006 @ 02:19 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
also seen on: 193.47.80.40
Authored by: Anonymous on Sunday, July 30 2006 @ 06:05 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Should I arganise a forced shutdown all the 4-5 IP adresses
previously mentionned and then fetch and detain this IP-company's employees and stuff as well as others in relation
to this bot
at Paris? In Moscou such Jewish spammers pay sometimes with
body pain!
Authored by: Anonymous on Friday, August 25 2006 @ 19:24 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0

Even though I may occasionally use language that implies otherwise, I'm against violence. I'm also against racial slurs. And people who think the perceived anonymity of the net would let them get away with one or the other ...

Besides, you're barking up the wrong tree. The above is about a mildly annoying bot written by a clueless company. It has nothing to do with spam.

Authored by: Dirk on Friday, August 25 2006 @ 20:18 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Pal, you need to take a pill.

If it weren't for these "stupid" bots the web would be a very difficult place to navigate.

Stop being such an ahole and a techno-dork and look at the marketing upside.

duuhhh, it's all about my computer, my program...

duhh
Authored by: Anonymous on Monday, August 28 2006 @ 04:35 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
We had problems with border line specifications in the robots.txt like the use of the longest match rather than the first match, and chars like ? $ * or Crawl delay
All these features that are not in the historical rfc are now have been implemented in our search engine.
If you still have problems with this bot, could you please contact me through the exalead feedback form on our website or via crawler[at]exalead[dot]com.
thanks
Authored by: Anonymous on Wednesday, September 20 2006 @ 12:04 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
O yea why are you taking snapshots without permission?
Why are you ilegaly hotlinking out images?

Please put up a page telling us how to turn off those options for our websites and stay in your index and we will stop calling you a bad programmer.
Authored by: Anonymous on Thursday, November 23 2006 @ 00:41 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Honestly thats why he asked for your Feed back just like a said in my post I just had to come back and tell you directly, you just acting like a tough guy on that side of your computer, and your NOT.

You have no idea what programmers go through, its like being the guy under the president who makes all the decisions ( we all know the president is just a puppet), So again, maybe you should make your own bot for your web site and these guys wouldnt get the shit you give them, but maybe you like the drama.
Authored by: Anonymous on Monday, December 15 2008 @ 22:42 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
if you lookup on whois you'll se the ip-range from 193.47.80.0 to 193.47.80.255 assigned to Exalead.
i've blocked the whole range now!

thx for that info about the bot don't obey the robots.txt standard!
Authored by: Anonymous on Wednesday, October 08 2008 @ 08:30 CEST
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Whats your IP Address?
Authored by: Anonymous on Monday, December 15 2008 @ 22:45 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
It is just a bot like googlebot, exealed (http://www.exalead.com/search) is just a search engine. It has nothing to do with spam...
Authored by: Anonymous on Wednesday, November 15 2006 @ 10:27 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0

Sure, but I reserve the right to blog about stupid bots like these :-)

Clueless companies that run a search engine are the 3rd worst problem on a typical website these days (after the spammers and the script kiddies).

Authored by: Dirk on Wednesday, November 15 2006 @ 19:49 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
How true - how true !
Authored by: Anonymous on Wednesday, November 15 2006 @ 20:19 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Exealed is not a clueless company, it will become a major search engine in the next years. It's an important part of the european quaero project...
Authored by: Anonymous on Wednesday, November 22 2006 @ 16:05 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Exalead is COMPLETELY CLUELESS or they wouldn't do a preview mode and strip out peoples javascripts, which make my page look like hell and I couldn't bust out of their stupid frame.

I now send them error messages, clueless morons...
Authored by: Anonymous on Thursday, November 23 2006 @ 03:14 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
To forbid the preview or the thumbnail on Exalead, you should add
meta name="robots" content="nopreview"
or
meta name="robots" content="nothumbnail"
in the page

ExaleadGuy
Authored by: Anonymous on Friday, November 24 2006 @ 10:50 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
You keep this crap up and you bots will get banned.
FOLLOW robots.txt and stop loading our images when robots.txt forbids it!
Authored by: Anonymous on Sunday, December 17 2006 @ 18:14 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
You must be the Four on that list!!!!
Authored by: Anonymous on Monday, December 15 2008 @ 22:44 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Seriously, you all neeed a life then to complain about Bots, if the Bots were not here, do you realize how much more dificult the information you would like and are requesting would not be found as easy.

Why dont you people really think about something before you get yourself involved with something that HELPS YOU in the long run, and take it offline.

I do agree with spam messages being forced into e-mail boxes, this is the problem you are having not with the bots its-self, maybe you should give the company some feedback on there bot to critique it so it works for both you and them.

Think people Think. There is More than 10 Petabytes of information on the Internet. thats 10,000,000,000,000,000 bits of information per peat, do you want to look through all of that or would you like to go straight to the information requested.
Authored by: Anonymous on Monday, December 15 2008 @ 22:34 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
exabot does not always obey robots.txt
i added it to my robot.txt files a month a go and it still crashed my server
now let's see what my firewall will do to 193.47.80.1/24
Authored by: Anonymous on Tuesday, January 27 2009 @ 08:06 CET
[ Reply to This | # ]
More stupid bots: Exabot and NG/2.0
Do you know anything about the internet and how it works? It's a series of tubes!

All joking aside. Yes, everyone here knows that bots are needed. No one is disagreeing with you. You're fighting a fight that you alone started against no one.

Keep up the thievery and ignoring robots.txt and your website won't be able to index anything. I'm guessing you don't have much experience in information services or have just enough to get you into trouble. These aren't the kind of people you want to mess with and piss off.

I hope you get the issues worked out so every can prosper from each others work, legitimately.
Authored by: Anonymous on Friday, December 04 2009 @ 18:36 CET
[ Reply to This | # ]

Copyright © 2010 Damn Spam! Powered by Geeklog