# https://newreleases.name.ng/robots.txt # # Public pages remain crawlable so existing indexed URLs and their assets keep # working after deployment. The upgrade hostname is excluded separately by an # HTTP X-Robots-Tag header that is conditional on that hostname. User-agent: * Allow: / Disallow: /admin/ Disallow: /cron/ Disallow: /includes/ Allow: /assets/ Allow: /*.css$ Allow: /*.js$ Allow: /*.svg$ Allow: /*.png$ Allow: /*.jpg$ Allow: /*.webp$ Sitemap: https://newreleases.name.ng/sitemap.xml