# robots.txt for supremetechy.com # # Search engines and AI assistants are welcome. The disallowed paths are # checkout, signed-in dashboards and one-time links, which have nothing worth # indexing. (robots.txt is advisory, not access control: those pages are # protected by sign-in, not by this file.) # # A crawler that matches a named group below ignores the "*" group, so each # group repeats the same rules. User-agent: * Allow: / Disallow: /checkout.html Disallow: /checkout-success.html Disallow: /Dashboard.html Disallow: /Dashboard-Complete.html Disallow: /mcpaas-portal/dashboard/ Disallow: /mcpaas-portal/setup/ Disallow: /mcpaas-portal/requests/ Disallow: /mcpaas-portal/admin/ Disallow: /mcpaas-admin/ # AI assistants, AI search and AI training crawlers: same rules, stated # explicitly so it's clear they're allowed. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Amortibot Allow: / Disallow: /checkout.html Disallow: /checkout-success.html Disallow: /Dashboard.html Disallow: /Dashboard-Complete.html Disallow: /mcpaas-portal/dashboard/ Disallow: /mcpaas-portal/setup/ Disallow: /mcpaas-portal/requests/ Disallow: /mcpaas-portal/admin/ Disallow: /mcpaas-admin/ Sitemap: https://supremetechy.com/sitemap.xml Sitemap: https://supremetechy.com/b/sitemap.xml # Amorti agent files: machine-readable profile and usage guide for AI agents. # (Non-standard directives; crawlers that don't know them ignore them.) Agentic-Manifest: https://supremetechy.com/.well-known/agentics-manifest.json Agent-Guide: https://supremetechy.com/.well-known/agent-guide.md # Agentic Resource Discovery (agenticresourcediscovery.org): the agents, MCP servers, # skills and plugins published here, and every business on Amorti. Agentmap: https://supremetechy.com/.well-known/ard.json