User-agent: * # Public search engines and AI crawlers may crawl all public content. Allow: /en/ Allow: /fi/ Allow: /llms.txt # Disallow non-public, authenticated, and functional URLs Disallow: /admin/ Disallow: /api/ Disallow: /accounts/ Disallow: /en/portal/ Disallow: /fi/portal/ Disallow: /debug/ Disallow: /health # Public functional pages use HTML noindex directives and must remain crawlable # so search engines can read those directives. Sitemap: https://datalystics.com/sitemap.xml