Is it okay to block 'ahrefs.com/robot/' from accessing my sites

[urbanlegend]

Just an update, after blocking the useless bots the sever is running 0.3 load max, I wish i had done this a long time ago.

That explains how the board opens up faster than recent times. Keep it up.

[porntraveller]

Just an update, after blocking the useless bots the sever is running 0.3 load max, I wish i had done this a long time ago.

That explains how the board opens up faster than recent times. Keep it up.

I noticed just now things work fast around here

[Cumslut]

Which search bots except for Google and Bing should you not block?

[greatpornlinks]

Block it if it is hurting your page load times.

[BOB777]

I am so pissed with bots I have started to block everyone I notice hitting my sites.

[antisocial]

Bots give away your site secrets to your competition why allow them to snoop on your site

[calista]

Yes bots share information about your site

[cimage]

Since blocking a whole number of bots including search ones my sites load a lot faster.

[yobilinks]

Since blocking a whole number of bots including search ones my sites load a lot faster.

The only two I allow are Google and Bing the rest can go screw themselves

[TheButcher]

Since blocking a whole number of bots including search ones my sites load a lot faster.

The only two I allow are Google and Bing the rest can go screw themselves

Amen

[mybitches]

Since blocking a whole number of bots including search ones my sites load a lot faster.

I'll start on this today tit makes sense. Can you somehow block them at the server level with .htaccess so not to spend time updating every site on the box?

[badkitty]

I'll block all non-English search engine bots since I want English language traffic to my sites