Google supports a variety of methods that allows you to decide outside of crawling and indexing of one's URLs. If you must block some data files, directories, and even your entire site from Google Search, look into our guide about approaches to circumvent content from showing up in search success. Arrange your websiteSearch and pattern recognition