Google’s Mobile-Friendly Test Doesn’t Follow Robots.txt Rules

Google’s Mobile-Friendly Test Doesn’t Follow Robots.txt Rules
‘ );

h3_html = ‘



cta = ‘‘+cat_head_params.cta_text.textual content+’
atext = ‘


scdetails = scheader.getElementsByClassName( ‘scdetails’ );
sappendHtml( scdetails[0], h3_html );
sappendHtml( scdetails[0], atext );
sappendHtml( scdetails[0], cta );
// emblem
sappendHtml( scheader, “” );
sc_logo = scheader.getElementsByClassName( ‘sc-logo’ );
logo_html = ‘‘;
sappendHtml( sc_logo[0], logo_html );

sappendHtml( scheader, ‘


‘ );

if(“undefined”!=typeof __gaTracker)
} // endif cat_head_params.sponsor_logo

Google’s John Mueller not too long ago suggested the corporate’s mobile-friendly check doesn’t observe the principles written in robots.txt recordsdata.

This matter got here up in a Google Webmaster Central hangout the place a query was requested concerning the mobile-friendly check and its relation to crawling and indexing.

Here is the query that was submitted:

“If I can see my text in Google’s mobile-friendly test, can I ensure that Google doesn’t have a problem with reading and indexing my content and my pages?”

In response, Mueller mentioned it’s appropriate that if the mobile-friendly check can render a web page then that’s an indication it may be crawled and listed simply positive.

The one factor to be careful for is robots.txt recordsdata, which the mobile-friendly check doesn’t reply to. That means it received’t let you know the server response for a web page, or whether or not any JavaScript recordsdata are being blocked.

So, along with the mobile-friendly check, website house owners must be utilizing the examine URL instrument in Search Console to verify every little thing is working as supposed.

Hear Mueller’s full response within the video under, beginning on the 28:36 mark:

“For probably the most half – sure, that’s appropriate. There will be refined points with JavaScript however, normally, the mobile-friendly check is one thing that makes use of the brand new chromium setup that we use for Googlebot. So if [the web page] works in a mobile-friendly check it ought to work for indexing as nicely.

One of the issues to be careful for right here is the mobile-friendly check – so far as I do know – doesn’t observe the robots.txt guidelines.

So that’s one thing the place you may wish to use the Inspect URL instrument in Search Console to ensure that, really, your JavaScript recordsdata, and your server responses, and all of which can be working nicely from that perspective.”

Source hyperlink search engine optimization

Be the first to comment

Leave a Reply

Your email address will not be published.