More stupid bots: Exabot and NG/2.0

Thank you for this information on Bots. Some of this has been helpful for me as a webmaster as well in stopping some major problems I have encountered. Keep up the good work.

I'm just curious to know how to stop the thing since I've tried shorewall and robots.txt and it seems to have no effect..?

I have also identified Exabot on 193.47.80.41, 193.47.80.45, 193.47.80.51 and 193.47.80.38

also seen on: 193.47.80.40

Should I arganise a forced shutdown all the 4-5 IP adresses
previously mentionned and then fetch and detain this IP-company's employees and stuff as well as others in relation
to this bot
at Paris? In Moscou such Jewish spammers pay sometimes with
body pain!

Even though I may occasionally use language that implies otherwise, I'm against violence. I'm also against racial slurs. And people who think the perceived anonymity of the net would let them get away with one or the other ...

Besides, you're barking up the wrong tree. The above is about a mildly annoying bot written by a clueless company. It has nothing to do with spam.

Pal, you need to take a pill.

If it weren't for these "stupid" bots the web would be a very difficult place to navigate.

Stop being such an ahole and a techno-dork and look at the marketing upside.

duuhhh, it's all about my computer, my program...

duhh

We had problems with border line specifications in the robots.txt like the use of the longest match rather than the first match, and chars like ? $ * or Crawl delay
All these features that are not in the historical rfc are now have been implemented in our search engine.
If you still have problems with this bot, could you please contact me through the exalead feedback form on our website or via crawler[at]exalead[dot]com.
thanks

O yea why are you taking snapshots without permission?
Why are you ilegaly hotlinking out images?

Please put up a page telling us how to turn off those options for our websites and stay in your index and we will stop calling you a bad programmer.

Honestly thats why he asked for your Feed back just like a said in my post I just had to come back and tell you directly, you just acting like a tough guy on that side of your computer, and your NOT.

You have no idea what programmers go through, its like being the guy under the president who makes all the decisions ( we all know the president is just a puppet), So again, maybe you should make your own bot for your web site and these guys wouldnt get the shit you give them, but maybe you like the drama.

Whats your IP Address?

Sure, but I reserve the right to blog about stupid bots like these :-)

Clueless companies that run a search engine are the 3rd worst problem on a typical website these days (after the spammers and the script kiddies).

How true - how true !

Exealed is not a clueless company, it will become a major search engine in the next years. It's an important part of the european quaero project...

Exalead is COMPLETELY CLUELESS or they wouldn't do a preview mode and strip out peoples javascripts, which make my page look like hell and I couldn't bust out of their stupid frame.

I now send them error messages, clueless morons...

To forbid the preview or the thumbnail on Exalead, you should add
meta name="robots" content="nopreview"
or
meta name="robots" content="nothumbnail"
in the page

ExaleadGuy

You keep this crap up and you bots will get banned.
FOLLOW robots.txt and stop loading our images when robots.txt forbids it!

You must be the Four on that list!!!!

Seriously, you all neeed a life then to complain about Bots, if the Bots were not here, do you realize how much more dificult the information you would like and are requesting would not be found as easy.

Why dont you people really think about something before you get yourself involved with something that HELPS YOU in the long run, and take it offline.

I do agree with spam messages being forced into e-mail boxes, this is the problem you are having not with the bots its-self, maybe you should give the company some feedback on there bot to critique it so it works for both you and them.

Think people Think. There is More than 10 Petabytes of information on the Internet. thats 10,000,000,000,000,000 bits of information per peat, do you want to look through all of that or would you like to go straight to the information requested.

exabot does not always obey robots.txt
i added it to my robot.txt files a month a go and it still crashed my server
now let's see what my firewall will do to 193.47.80.1/24

Do you know anything about the internet and how it works? It's a series of tubes!

All joking aside. Yes, everyone here knows that bots are needed. No one is disagreeing with you. You're fighting a fight that you alone started against no one.

Keep up the thievery and ignoring robots.txt and your website won't be able to index anything. I'm guessing you don't have much experience in information services or have just enough to get you into trouble. These aren't the kind of people you want to mess with and piss off.

I hope you get the issues worked out so every can prosper from each others work, legitimately.

I had a strange visit seeming that it landed on a page called "groupcp.php", which seems to be a remote Forum Injection Spam script. The file has never been on my site and it baffles me why Exabot would think it does exist...

As Exabot is FRENCH is seems to make perfect sense as an Englishman to BAN Exalead from invading this part of England!!

Since cp stands for Control Panel, Exabot is probably telling you that it was on a User CP on your forum. It said 'groupcp' because it takes a lot of data to find and give the exact location info each time. Googlebot does the same thing.

Exalead bot doesn't support <base> tag. Absolutely stupid, clueless crap!!