DIGIT-ARC read-only archive · snapshot: July 23, 2026

Block BADBOTS from crawling your website

18 posts · originally from https://geek.digit.in/community/threads/block-badbots-from-crawling-your-website.73683/

V
vaibhavtek Original post #1
Nov 20, 2007 at 3:44 PM
edited as against forum rules...
RCuber
RCuber #2
Nov 20, 2007 at 4:14 PM
Thanks you for copy pasting it from chip forum
*www.chip-india.com/forums/viewtopic.php?t=29177
Vishal Gupta
Nov 20, 2007 at 4:20 PM
^^ lol. :D

@vaibhavtek

After this, you still hvnt learnt the lesson:

*www.thinkdigit.com/forum/showthread.php?t=72401

Also don't post in wrong sections:

*www.thinkdigit.com/forum/showthread.php?t=71671
*www.thinkdigit.com/forum/showthread.php?t=71378
*www.thinkdigit.com/forum/showthread.php?t=69536
V
vaibhavtek #4
Nov 20, 2007 at 4:26 PM
Charan said:
Thanks you for copy pasting it from chip forum
*www.chip-india.com/forums/viewtopic.php?t=29177

this thing is also posted in other site some russian one.
I got from there so I didnot posted the source as the lang. is different...

Hope u understand...

Vishal Gupta said:
^^ lol. :D

@vaibhavtek

After this, you still hvnt learnt the lesson:

*www.thinkdigit.com/forum/showthread.php?t=72401

Also don't post in wrong sections:

*www.thinkdigit.com/forum/showthread.php?t=71671
*www.thinkdigit.com/forum/showthread.php?t=71378
*www.thinkdigit.com/forum/showthread.php?t=69536

Now will keep notice.
thanks....!!
Vishal Gupta
Nov 20, 2007 at 4:32 PM
^^ Even you take the info from russian site, pls mention the source and credits. ;)
RCuber
RCuber #6
Nov 20, 2007 at 4:35 PM
vaibhavtek said:
this thing is also posted in other site some russian one.
I got from there so I didnot posted the source as the lang. is different...

Hope u understand...

Hope you understand how to give proper credit to the actual source.

Plagiarism is not tolerated here in the forum. if you want to post something then give proper credit to the author. Be it Rusian, German,chiniese or martial its our problem to understand the language .. you give correct credit to the author then you get respect else you dont.

This is not the first time you are doing this.


Now Please give us the original russian source which you are claming.

and for other members here is the source from chip
There are some softwares available which can copy/download a whole website.Just think someone copies your whole website and create a same !

Generally these softwares uses "bots",similar to which search engines use
So better block them

Here's a list of few such (most commonly used ) bots with the syntax,Just add them in your robots.txt file to block them

This is quite obvious .. unless you dont know how to compare
V
vaibhavtek #7
Nov 20, 2007 at 4:40 PM
Vishal Gupta said:
^^ Even you take the info from russian site, pls mention the source and credits. ;)

i found that 6 -7 days ago while searching in google about site copier.
Gigacore
Nov 20, 2007 at 5:59 PM
@ vaibhava.. please give credits to authors... not be over smart :cool:
shantanu
Nov 20, 2007 at 6:34 PM
Vaibhav i gave you warnings before also.. mention source in your post by : 9 PM today.. or you will be given a weeks misery..

shantanu
ravi_9793
ravi_9793 #10
Nov 20, 2007 at 6:35 PM
@vaibhavtek .I hope you will take care of these from next time.Have pleasant stay here..and keep posting but within rules :p
RCuber
RCuber #11
Nov 20, 2007 at 6:36 PM
^^ you and subbu are in that thread :))
Faun
Faun #12
Nov 20, 2007 at 6:39 PM
source matters.
Gigacore
Gigacore #13
Nov 20, 2007 at 6:40 PM
vaibhav... dude.. u are breaching the main rule of this forum... so please be careful with this from next time..
ravi_9793
ravi_9793 #14
Nov 20, 2007 at 7:20 PM
why don't you now edit your post..and mention source.
V
vaibhavtek #15
Nov 20, 2007 at 7:24 PM
shantanu said:
Vaibhav i gave you warnings before also.. mention source in your post by : 9 PM today.. or you will be given a weeks misery..

shantanu

pls donot banned me..
plsssssssss
last chance

pls donot banned me..

plsssssssss

last chance
Vishal Gupta
Nov 20, 2007 at 7:36 PM
^^ Better to mention the Chip thread link in start of your first post and remember to provide original source with credits next time.

You'll not get any fame or respect by stealing others content.
V
vaibhavtek #17
Nov 20, 2007 at 8:23 PM
edited as against forum rules...
shantanu
shantanu #18
Nov 20, 2007 at 11:13 PM
Thread Closed... user not banned.. last warning..