To prevent undesirable material while in the search indexes, site owners can instruct spiders never to crawl certain information or directories in the normal robots.txt file in the basis Listing in the area. In addition, a website page may be explicitly excluded from the online search engine's database by using https://news.rafeeg.ae