AI crawlers - block or do not block

Discussion Of All Legal Topics Is Fine Anything Goes. Be Respectful of Others. No Personal Information or Attacks.
All Traffic, Link, Banner, Push Notification and Advertising, Offers & Requests Here,.
Domains & Websites For Sale and Requests Here.
Keep One thread per person & No More Than 1 Weekly Bump.
User avatar
AlexO
Verified Member
Verified Member
Posts: 6390
Joined: February 10th, 2018, 5:37 pm
Title: I like Celebrities

#16

Post by AlexO » October 3rd, 2026, 9:05 am

gotonudecom wrote: ↑
September 29th, 2026, 10:09 am
jag wrote: ↑
September 29th, 2026, 8:29 am
Keep on mind AI search is growing.
in short, don't block the good ones!
I'll tell you what I allow.

Google of course, Bing even though I get 90% less clicks from it than Google but whatever, and duckduckgo last but not least Twitterbot.
Give me celebrity porn :twisted:

foxxxychick
Verified Member
Verified Member
Posts: 363
Joined: March 4th, 2023, 7:26 am

#17

Post by foxxxychick » October 5th, 2026, 9:03 am

What do the seo specialists have to say

User avatar
gotonudecom
Verified Member
Verified Member
Posts: 3168
Joined: February 6th, 2018, 1:54 pm
Title: DomainMaster
Referrals: 30
Contact:

#18

Post by gotonudecom » October 5th, 2026, 4:47 pm

foxxxychick wrote: ↑
October 5th, 2026, 9:03 am
What do the seo specialists have to say
What makes you think an SEO specialists has any idea about this?
I already provided a tool and instructions on how to use it.
this tools provides access to what the giants on the internet are doing.

That is how you get the answer to this. Unless you want someone pretending to be and SEO specialist to use the tool and tell you what it shows.

3ric
Verified Member
Verified Member
Posts: 962
Joined: February 20th, 2022, 8:57 pm

#19

Post by 3ric » October 9th, 2026, 7:10 pm

I block them all




bucksm
Verified Member
Verified Member
Posts: 778
Joined: February 19th, 2018, 7:23 pm

#20

Post by bucksm » October 11th, 2026, 1:47 pm

The verdict is still out I am not decided on them yet




User avatar
shoopa
Verified Member
Verified Member
Posts: 1850
Joined: February 26th, 2018, 7:32 pm

#21

Post by shoopa » October 13th, 2026, 3:56 pm

You want more bots dragging down your server leave them be




miracles
New Member
New Member
Posts: 2
Joined: August 25th, 2025, 8:43 am

#22

Post by miracles » October 14th, 2026, 5:22 am

Do keep them around, but optimize your content around them. Blocking these is not the way to go




User avatar
BHT
Verified Member
Verified Member
Posts: 1458
Joined: March 30th, 2018, 3:28 pm

#23

Post by BHT » October 14th, 2026, 7:16 am

miracles wrote: ↑
October 14th, 2026, 5:22 am
Do keep them around, but optimize your content around them. Blocking these is not the way to go
Hey dude you into AI ?




User avatar
gotonudecom
Verified Member
Verified Member
Posts: 3168
Joined: February 6th, 2018, 1:54 pm
Title: DomainMaster
Referrals: 30
Contact:

#24

Post by gotonudecom » October 16th, 2026, 6:20 am

3ric wrote: ↑
October 9th, 2026, 7:10 pm
I block them all
have you tried my new tool?
https://sponsorchat.com/viewtopic.php?p=202202#p202202


I have another one I am beta testing?

anyone have access to their server logs want to try it?

User avatar
LuKenGas
Verified Member
Verified Member
Posts: 2209
Joined: February 23rd, 2018, 8:07 am

#25

Post by LuKenGas » October 17th, 2026, 6:03 pm

gotonudecom wrote: ↑
October 1st, 2026, 7:16 pm
badkitty wrote: ↑
October 1st, 2026, 10:44 am
gotonudecom wrote: ↑
September 29th, 2026, 10:09 am


in short, don't block the good ones!
can you list the ones that are 'good'
use my tool
search for Amazon.com

then you know what they do.


Sound idea r6d10k paqwb623




AI crawlers - block or do not block

Post Reply