Cookie Consent by Free Privacy Policy Generator

The Best Of

Go to the Best Of the SEO Community.

Noah
Noah
Jan 19, 2025, 11:19 AM
Forwarded from another channel:
Forwarded thread from another channel:
Jeremy Rivera
Jeremy Rivera
Dec 19, 2024, 4:05 PM
Uh technical SEO friends -
Disallow: /*?*hs_preview=*
Disallow: /*?*hsCacheBuster=*
Would Google discard everything after the * and treat this as essentially
Disallow: /
Kyle Faber
Kyle Faber
Dec 19, 2024, 4:08 PM
Nope. Only if the params are present.
Valentin Pletzer
Valentin Pletzer
Dec 20, 2024, 12:40 AM
In Bing Webmaster Tools you can “edit” (those are not real edits) the robots.txt and check against URLs to see what would happen:
Sign in or signup for Bing Webmaster Tools and improve your site’s performance in search. Get access to free reports, tools and resources.
Tory Gray
Tory Gray
Dec 20, 2024, 6:52 AM
Seconding (thirding?!) the above. Google is *specific* - that’ll only block those specific param urls from getting crawled (not indexed) - whatever order the params are in
John Mueller
John Mueller
Dec 24, 2024, 7:05 AM
I mentioned this somewhere else, I think ???? , but I've seen this when sites do a cookie / bot / login-redirect. The actual / final URL doesn't have the parameters, but one of the intermediate URLs does use them -- then these robots.txt directives will block the whole set. If any URL within a redirect chain is blocked, the whole chain is blocked. Search Console focuses on the "final" URL with inspect URL. I *think* you can trick it by looking at the rendered HTML / console output there. You can also try it in an incognito window with the Googlebot user-agent.

Our Values

What we believe in

Building friendships

Kindness

Giving

Elevating others

Creating Signal

Discussing ideas respectfully

What has no home here

Diminishing others

Gatekeeping

Taking without giving back

Spamming others

Arguing

Selling links and guest posts


Sign up for our Newsletter

Join our mailing list for updates

By signing up, you agree to our Privacy Policy and Terms of Service. We may send you occasional newsletters and promotional emails about our products and services. You can opt-out at any time.

Apply now to join our amazing community.

Powered by MODXModx Logo
the blazing fast + secure open source CMS.