please help me understand all these search bots
-
Lizza
- Verified Member

- Posts: 104
- Joined: July 13th, 2018, 3:36 am
please help me understand all these search bots
Hello please help me understand why there are hundreds of Google, Bing, Majestic and other search engine bots always roaming my sites but my sites do not get ore than 5 or 6 listings on the search engine results.
Thank you for the help.
Thank you for the help.
- BrasSmonkey
- Verified Member

- Posts: 7893
- Joined: February 28th, 2018, 6:31 pm
- Title: Smell My Sack
- Referrals: 1
- Contact:
slide me an email or just target the bots you want. the rest will follow
THE LAKEN RILEY ACT IS NOW LAW!!! TRUMP 2025!!!
DACA HAS ENDED!!! email: brassballz-@-techie.com
DACA HAS ENDED!!! email: brassballz-@-techie.com
- TheButcher
- Administrator

- Posts: 17530
- Joined: February 2nd, 2018, 11:48 am
- Title: I like weekends
- Referrals: 1
- Contact:
I like search bots send them to me 
-
Thompsone
- Verified Member

- Posts: 31
- Joined: July 15th, 2022, 5:32 am
My understanding on this from my very limited reading on the subject,you want search bots running across your site.
- bestfreeporn
- Verified Member

- Posts: 2308
- Joined: February 20th, 2018, 6:34 pm
- Referrals: 1
-
Delia
- Verified Member

- Posts: 60
- Joined: May 8th, 2021, 2:54 pm
Make some posts with images,search engines love images in posts. This will help your pages get listed faster.
- tacnet
- Board Sponsor

- Posts: 3641
- Joined: February 22nd, 2019, 7:21 pm
- Referrals: 9
- Contact:
Google will not index all pages that it crawls. It depends on how important it considers each page, how the page ranks and now even includes your page speed scores (or core web vitals)
You can check how many pages google has indexed by googling "site:mydomain.com"
As a general rule of thumb (and this excludes external links, page rank etc), google will see your index page as the most important. Pages directly linked from the index are the next most important. The deeper google has to crawl to find a page, the less importance it attaches to that page
So try and keep your site structure as "flat" as possible rather than deep
Check your page speed scores https://pagespeed.web.dev/
You can check how many pages google has indexed by googling "site:mydomain.com"
As a general rule of thumb (and this excludes external links, page rank etc), google will see your index page as the most important. Pages directly linked from the index are the next most important. The deeper google has to crawl to find a page, the less importance it attaches to that page
So try and keep your site structure as "flat" as possible rather than deep
Check your page speed scores https://pagespeed.web.dev/
-
3ric
- Verified Member

- Posts: 964
- Joined: February 20th, 2022, 8:57 pm
That was really helpful for metacnet wrote: ↑March 9th, 2023, 3:13 pmGoogle will not index all pages that it crawls. It depends on how important it considers each page, how the page ranks and now even includes your page speed scores (or core web vitals)
You can check how many pages google has indexed by googling "site:mydomain.com"
As a general rule of thumb (and this excludes external links, page rank etc), google will see your index page as the most important. Pages directly linked from the index are the next most important. The deeper google has to crawl to find a page, the less importance it attaches to that page
So try and keep your site structure as "flat" as possible rather than deep
Check your page speed scores https://pagespeed.web.dev/
-
JB2302
- Verified Member

- Posts: 185
- Joined: March 31st, 2018, 4:51 am
I did not know that one