AI crawlers - block or do not block

[blackbooty]

Hi just asking I added Cloudflare and it works. There is an option to block all AI crawlers, do I say yes or no.
Thanks for your time.

[Kosta]

are crawlers the same as search bots?

[misterporn]

You want all the search spiders crawling your site to get higher placement in resuts leave them alone.

[jimp]

Depends what you get from them, and right now its close to nothing. GPTBot and the rest dont send clicks back, so blocking costs you very little. The one I'd leave alone is Googlebot, and watch that Cloudflare doesnt lump Google-Extended in with something you need, thats the AI training one and its separate from search. Turn it on, then check your search traffic a couple weeks later.

[Emil]

Keep anything Google block everything else

[ricco]

Block the fuckers they are worth dick and slow down the databases which leads to slowing down the blog.

[greatpornlinks]

Block all spiders except for Google and Bing, save yourself the headaches that these bots bring. All you want is Google and Bing hits.

[TheButcher]

I block them using robots.txt , htaccess and now a third place in Cloudflare. I am sick and tired of bots hitting the board.

[Big MOE]

Blocked on my sites they spell trouble when they start hitting the WP php files and slow my sites to a crawl.

[pussylover]

It's wild out there you do not need more darn bots

[gotonudecom]

https://exposemyself.com/free-ai-seo-site-audit/

test amazon
google
and see what they are doing.
then test yourself.

[jag]

Keep on mind AI search is growing.

[gotonudecom]

Keep on mind AI search is growing.

in short, don't block the good ones!

[badkitty]

Keep on mind AI search is growing.

in short, don't block the good ones!

can you list the ones that are 'good'

[gotonudecom]

Keep on mind AI search is growing.

in short, don't block the good ones!

can you list the ones that are 'good'

use my tool
search for Amazon.com

then you know what they do.