flat assembler
Message board for the users of flat assembler.
![]() |
Author |
|
asmrox
i tried to search some info, and my old topics but...
http://board.flatassembler.net/robots.txt you blocked google. Why? http://www.google.com/search?q=site:board.flatassembler.net |
|||
![]() |
|
Ehtyar
I have to second this, it's bugged me for a while, phpbb search just can't match google.
Ehtyar. |
|||
![]() |
|
edfed
and if flat board is very slow, we cannot access it in less than 3 seconds...
then, yes, changing the host, leave this bot blocked (make this board elitist cause bad referenced by google) and everything will be ok. |
|||
![]() |
|
revolution
If a new host can cope with the traffic then I see no reason to continue to block the bots. Unless there is anther reason for blocking the bots that has not been revealed?
|
|||
![]() |
|
edfed
bots are bad. they pollute the screen with random posts.
|
|||
![]() |
|
revolution
edfed: The bots being discussed are not "chat bots"
|
|||
![]() |
|
edfed
ok! then i hope it will never be a forum bot, like ads by ggogle...
there are a lot of forums with a post from google or else company. if it appens on fasm board, i'll be sad. |
|||
![]() |
|
revolution
edfed: read up on "search bots", they index the forum so that you can search for things on sites like google. They never make posts.
|
|||
![]() |
|
asmrox
http://siteexplorer.search.yahoo.com/search?p=http://board.flatassembler.net
http://search.live.com/results.aspx?q=site:board.flatassembler.net http://www.altavista.com/web/results?q=site:board.flatassembler.net you blocked only google, other sucky crwalers index it. |
|||
![]() |
|
Tomasz Grysztar
google bot was much more agressive than the other ones.
|
|||
![]() |
|
revolution
I thought this:
http://board.flatassembler.net/robots.txt wrote: User-agent: * |
|||
![]() |
|
f0dder
revolution wrote: I thought this: Only bots that actually respect robots.txt? ![]() _________________ ![]() |
|||
![]() |
|
revolution
f0dder wrote: Only bots that actually respect robots.txt? |
|||
![]() |
|
itsnobody
if the search bots were unblocked the traffic would increase by like 10 times
|
|||
![]() |
|
< Last Thread | Next Thread > |
Forum Rules:
|
Copyright © 1999-2020, Tomasz Grysztar. Also on GitHub, YouTube, Twitter.
Website powered by rwasa.