# GetSim — robots.txt
# We welcome traditional search and AI crawlers on the public marketing surface.
#
# Two rules govern this file and are easy to get wrong:
#
# 1. A crawler obeys exactly ONE group: the most specific User-agent match. A
#    named group does NOT inherit the Disallow lines from `User-agent: *`. So
#    every named agent below has to repeat the private paths, which is why the
#    AI crawlers share a single group rather than getting one block each.
# 2. The signed-in app lives on unprefixed paths (/esims, /numbers, /balance,
#    /profile, /support, /dashboard, /payment) AND on locale-prefixed copies of
#    the same segments (/tr/esims, /de/balance, ...), because routes/app.php is
#    loaded inside the localized group. Those segments are literal in every locale;
#    only the public landing slugs in routes/web.php are translated. The
#    `/*/` wildcard covers the 17 prefixed variants.
#
# These paths also render `noindex` from React, but that tag only exists when
# server-side rendering succeeds. robots.txt is the layer that holds when it
# does not.

User-agent: *
Allow: /
Disallow: /admin
Disallow: /api
Disallow: /manage
Disallow: /dashboard
Disallow: /esims
Disallow: /numbers
Disallow: /balance
Disallow: /profile
Disallow: /support
Disallow: /payment
Disallow: /*/dashboard
Disallow: /*/esims
Disallow: /*/numbers
Disallow: /*/balance
Disallow: /*/profile
Disallow: /*/support
Disallow: /*/payment

# Major AI crawlers — explicitly welcomed on public pages, held out of the app.
User-agent: GPTBot
User-agent: ChatGPT-User
User-agent: OAI-SearchBot
User-agent: ClaudeBot
User-agent: Claude-Web
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: Google-Extended
User-agent: Bingbot
User-agent: Applebot
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCBot
User-agent: meta-externalagent
Allow: /
Disallow: /admin
Disallow: /api
Disallow: /manage
Disallow: /dashboard
Disallow: /esims
Disallow: /numbers
Disallow: /balance
Disallow: /profile
Disallow: /support
Disallow: /payment
Disallow: /*/dashboard
Disallow: /*/esims
Disallow: /*/numbers
Disallow: /*/balance
Disallow: /*/profile
Disallow: /*/support
Disallow: /*/payment

Sitemap: https://getsim.app/sitemap.xml