User-agent: * Allow: / Disallow: /admin Disallow: /api/admin Disallow: /hub/ Disallow: /profile Sitemap: http://0.0.0.0:8000/sitemap.xml