how to block semantic-visions.com crawler

Discussion Of All Legal Topics Is Fine Anything Goes. Be Respectful of Others. No Personal Information or Attacks.
All Traffic, Link, Banner, Push Notification and Advertising, Offers & Requests Here,.
Domains & Websites For Sale and Requests Here.
Keep One thread per person & No More Than 1 Weekly Bump.
Post Reply
misterporn
Verified Member
Verified Member
Posts: 879
Joined: May 24th, 2018, 4:21 pm

how to block semantic-visions.com crawler

#1

Post by misterporn » August 9th, 2024, 8:48 am

I tried adding "semantic-visions.com crawler" to my htaccess but it fails, how do I block this crawler from my website

thx




Nakedtruth
Verified Member
Verified Member
Posts: 1034
Joined: February 28th, 2018, 4:46 pm
Title: The true word

#2

Post by Nakedtruth » August 10th, 2024, 5:51 am

You could add it to robots.txt




NSWDave
Verified Member
Verified Member
Posts: 1151
Joined: September 11th, 2021, 8:31 pm
Title: Aussie man

#3

Post by NSWDave » August 11th, 2024, 9:27 am

You'll need the name of the spider to block using htaccess.




User avatar
gspotman
Verified Member
Verified Member
Posts: 1412
Joined: June 6th, 2018, 7:42 pm

#4

Post by gspotman » August 15th, 2024, 2:40 pm

misterporn did you figure this out?
Teams: 60c094411cbb39b8
Email: gspotman@gmx.com

how to block semantic-visions.com crawler

Post Reply