SEO & Crawl policy

Robots.txt
Viewer.

This page displays the crawl policy for SabKaregaAI. It tells search engine bots which pages they are allowed or disallowed from crawling and indexing.

Current robots.txt

sabkaregaai.in/robots.txt

Raw file served at the root of the domain.

View raw file

User-agent: *
Allow: /
Disallow: /auth
Disallow: /dashboard
Disallow: /profile
Disallow: /setting

Sitemap: https://sabkaregaai.in/sitemap.xml

What this means

✅ Allowed pages

/ — Homepage /about — About page /pdf — PDF Studio /qr — QR Generator /game — Game Zone /faq — FAQ /contact — Contact /privacy — Privacy Policy /terms — Terms of Use /sitemap — Sitemap

🚫 Disallowed pages

/auth — Authentication /dashboard — Dashboard /profile — User profile /setting — Settings

Private pages are excluded from search engine indexing to protect user privacy and prevent unnecessary crawling of authenticated routes.

Sitemap reference

The robots.txt points all bots to the XML sitemap for a complete list of public URLs.

Sitemap: https://sabkaregaai.in/sitemap.xml

View sitemap.xml HTML sitemap

SEO setup

🤖

All bots welcome

User-agent wildcard (*) allows all crawlers including Googlebot, Bingbot, and others.

🗺️

Sitemap declared

XML sitemap is referenced for fast discovery of all public pages by search engines.

🔒

Private routes protected

Dashboard, profile, auth, and settings pages are excluded from indexing for user privacy.

Robots.txtViewer.