h3_html = ‘
cta = ‘
atext = ‘
scdetails = scheader.getElementsByClassName( ‘scdetails’ );
sappendHtml( scdetails, h3_html );
sappendHtml( scdetails, atext );
sappendHtml( scdetails, cta );
sappendHtml( scheader, “http://www.searchenginejournal.com/” );
sc_logo = scheader.getElementsByClassName( ‘sc-logo’ );
logo_html = ‘‘;
sappendHtml( sc_logo, logo_html );
sappendHtml( scheader, ‘
} // endif cat_head_params.sponsor_logo
Google’s John Mueller not too long ago suggested the corporate’s mobile-friendly check doesn’t observe the principles written in robots.txt recordsdata.
This matter got here up in a Google Webmaster Central hangout the place a query was requested concerning the mobile-friendly check and its relation to crawling and indexing.
Here is the query that was submitted:
“If I can see my text in Google’s mobile-friendly test, can I ensure that Google doesn’t have a problem with reading and indexing my content and my pages?”
In response, Mueller mentioned it’s appropriate that if the mobile-friendly check can render a web page then that’s an indication it may be crawled and listed simply positive.
So, along with the mobile-friendly check, website house owners must be utilizing the examine URL instrument in Search Console to verify every little thing is working as supposed.
Hear Mueller’s full response within the video under, beginning on the 28:36 mark:
One of the issues to be careful for right here is the mobile-friendly check – so far as I do know – doesn’t observe the robots.txt guidelines.