# Last Updated: 01/05/2021, GSE NIC # ---------------------- WCD ---------------------- # Note: Site-stored robots.txt are not honored, except on host-header sites / subdomains # All directives for www.oregon.gov are to be stored here # Remove an indexed SERP and/or submit a 'Remove URL' request in Webmaster Tools # Note: The Allow directives are added for many Google-specific Mobile Tests to fully render the page. # Without these directives, the state sites could get poor grades for mobile-friendliness which # can result is a lower Page Rank and other SEO scores, as well as incorrect analytics in # the Google Analytics product. User-agent: thunderstonesa Allow: /penalty_index.html Allow: /dcbs_index.html Allow: /DCBS_index.html # (case variation) Allow: /PenaltyOrders/ Allow: /penaltyorders/ # (case variation) Allow: /ContestedCases/ Allow: /contestedcases/ # (case variation)