To avoid undesirable content material while in the lookup indexes, website owners can instruct spiders to not crawl sure documents or directories with the standard robots.txt file in the foundation Listing on the area. Moreover, a web page can be explicitly excluded from the internet search engine's databases by using https://news.rafeeg.ae