User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-login.php Disallow: /wp-register.php # Search result pages are allowed to be crawled so Google can see # their noindex tag (see iuh_noindex_search_pages) and properly drop # them from results — blocking them here instead would prevent # Google from ever seeing that tag in the first place. # Sitemaps Sitemap: https://islamicurduhub.com/?iuh_sitemap=1 # Crawl delay Crawl-delay: 10