.Google.com restricts robots.txt help to 4 industries, clarifying its standpoint on unsupported ordinances.Google.com merely assists four specific robots.txt areas.Unsupported regulations in robots.txt will be dismissed.Consider auditing your robots.txt documents due to this update.