---
title: "Academy Article"
canonical_url: "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt"
locale: en
meta:
"og:title": "Academy Article"
---
[Go to home](https://academy.laioutr.com/en)
- [Essentials apps](https://academy.laioutr.com/en/bereiche/essentials-apps)
- [SEO and GEO](https://academy.laioutr.com/en/leitfaeden/seo-and-geo)
- [Sitemap, robots.txt and llms.txt](https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt)
# Sitemap, robots.txt and llms.txt
robots.txt controls what crawlers may visit, the sitemap lists every indexable page, and llms.txt points AI systems to the content. All three files sit at the root of the domain and follow the robots settings from Studio.
## Before you start
- Plan
- Any platform licence
- Role
- Editor for per-page robots settings
- Duration
- 5 min
### Prerequisites
- SEO essentials installed
Last reviewed on October 15, 2026
### robots.txt
`/robots.txt` lists which paths crawlers may visit. The file exists in every Laioutr frontend. The development team blocks paths such as checkout or account globally, while individual pages get a robots value in the **SEO** area in Studio. That value is output as a meta tag and as an `X-Robots-Tag` header. Without a value, `index, follow` applies. Non-production environments are excluded from indexing automatically.
### Sitemap
`/sitemap.xml` lists all pages of the project so that search engines find them quickly. Pages with `noindex` are left out automatically.
### llms.txt
`/llms.txt` is a guidance file for AI systems and part of **AI Search & LLM Ready**. Laioutr generates and maintains it automatically so that AI search can find and cite the content. It has nothing to do with the AI Search & Discovery add-on, which runs the search on the site itself.
## Step by step
1. 1 ### Step 1: Know the robots values
**index, follow** for normal pages, **noindex, follow** for pages without search value but with important links, **noindex, nofollow** for checkout and account, **index, nofollow** rarely.
2. 2 ### Step 2: Open the files
Open `/robots.txt`, `/sitemap.xml` and `/llms.txt` on the live domain to see the current state.
3. 3 ### Step 3: Submit the sitemap
Submit the sitemap address in Google Search Console and the webmaster tools of other search engines.
## Frequently asked questions
Why is a page missing from the sitemap?
Usually it is set to noindex in Studio. The sitemap automatically leaves out noindex pages.
Can llms.txt be edited?
Laioutr manages the file automatically from the project's content. No manual upkeep is needed.
Is the staging environment indexed?
No. Non-production environments are blocked for search engines automatically.
## Related
- [SEO basics before launch](https://academy.laioutr.com/en/artikel/seo-basics-before-launch)10 min
Before going live, every important page needs a meta title, a description and the right robots value, the organisation belongs in the structured data, and old URLs redirect to new ones. The team then checks robots.txt, sitemap and rich results on the live domain.
- [Structured data with Schema.org](https://academy.laioutr.com/en/artikel/structured-data-schema-org)6 min
Every Laioutr page carries exactly one Schema.org graph as JSON-LD, with no extra module. The SEO app provides website, page and organisation, and sections add breadcrumbs, FAQ, products and product lists.
- [Performance and technical SEO in code](https://academy.laioutr.com/en/artikel/performance-and-technical-seo-in-code)10 min
Laioutr frontends render on the server, cache data in Orchestr and deliver media through the Laioutr CDN with transformations at the edge. Canonical, hreflang and Schema.org data are generated automatically; developers control HTTP caching via routeRules and how the entry script loads.
- [SEO and GEO essentials: search engines, AI search and redirects](https://academy.laioutr.com/en/apps/seo-geo-essentials-search-ai-search-redirects)9 min
The SEO essentials app bundles what search engines and AI search need from a Laioutr storefront: robots.txt, sitemap, per-page meta data, Schema.org and llms.txt. Redirects and URL history in Cockpit keep old addresses reachable.
## Learn it in a lesson
- [SEO fields and AI visibility](https://academy.laioutr.com/en/lektionen/frontend-manager-seo-and-ai-visibility)10 min
- [Performance and technical SEO](https://academy.laioutr.com/en/lektionen/developer-performance-and-technical-seo)12 min
## [SEO and GEO](https://academy.laioutr.com/en/leitfaeden/seo-and-geo)
Search this guide
1. [SEO basics before launch](https://academy.laioutr.com/en/artikel/seo-basics-before-launch)10 min
2. [Set up redirects from the old site](https://academy.laioutr.com/en/artikel/set-up-redirects-from-old-site)8 min
3. [Sitemap, robots.txt and llms.txt](https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt)5 min
4. [Structured data with Schema.org](https://academy.laioutr.com/en/artikel/structured-data-schema-org)6 min
5. [Multilingual SEO and hreflang](https://academy.laioutr.com/en/artikel/multilingual-seo-hreflang)6 min
6. [SEO and GEO essentials: search engines, AI search and redirects](https://academy.laioutr.com/en/apps/seo-geo-essentials-search-ai-search-redirects)9 min
## Structured Data
```json
{
"@context": "https://schema.org",
"@graph": [
{
"@id": "https://academy.laioutr.com/#website",
"@type": "WebSite",
"inLanguage": "en",
"name": "Default",
"url": "https://academy.laioutr.com/",
"translationOfWork": {
"@id": "https://academy.laioutr.com/#website"
}
},
{
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#webpage",
"name": "Academy Article",
"url": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt",
"@type": [
"WebPage",
"FAQPage"
],
"breadcrumb": {
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#breadcrumb"
},
"isPartOf": {
"@id": "https://academy.laioutr.com/#website"
},
"mainEntity": [
{
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#/schema/question/1"
},
{
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#/schema/question/2"
},
{
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#/schema/question/3"
}
],
"potentialAction": [
{
"@type": "ReadAction",
"target": [
"https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt"
]
}
]
},
{
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#breadcrumb",
"@type": "BreadcrumbList",
"itemListElement": [
{
"@type": "ListItem",
"name": "Home",
"item": "https://academy.laioutr.com/en",
"position": 1
},
{
"@type": "ListItem",
"name": "Essentials apps",
"item": "https://academy.laioutr.com/en/bereiche/essentials-apps",
"position": 2
},
{
"@type": "ListItem",
"name": "SEO and GEO",
"item": "https://academy.laioutr.com/en/leitfaeden/seo-and-geo",
"position": 3
},
{
"@type": "ListItem",
"name": "Sitemap, robots.txt and llms.txt",
"item": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt",
"position": 4
}
]
},
{
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#/schema/question/1",
"@type": "Question",
"inLanguage": "en",
"name": "Why is a page missing from the sitemap?",
"acceptedAnswer": {
"@type": "Answer",
"text": "Usually it is set to noindex in Studio. The sitemap automatically leaves out noindex pages.
"
}
},
{
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#/schema/question/2",
"@type": "Question",
"inLanguage": "en",
"name": "Can llms.txt be edited?",
"acceptedAnswer": {
"@type": "Answer",
"text": "Laioutr manages the file automatically from the project's content. No manual upkeep is needed.
"
}
},
{
"@id": "https://academy.laioutr.com/en/artikel/sitemap-robots-txt-llms-txt#/schema/question/3",
"@type": "Question",
"inLanguage": "en",
"name": "Is the staging environment indexed?",
"acceptedAnswer": {
"@type": "Answer",
"text": "No. Non-production environments are blocked for search engines automatically.
"
}
}
]
}
```