What is robots.txt?
A small text file on your site that tells search engines which pages they may visit.
In everyday terms
Like a sign on your shop door saying which areas are open to customers and which are staff-only.
A little more detail
Crawlers check yourdomain.com/robots.txt before reading your site. Most sites simply allow everything and point to their sitemap — our free robots.txt Generator builds a safe one in seconds. It also controls whether AI assistants can read (and recommend) your content.
Related terms
SEO (Search Engine Optimization)
Everything you do to help your website show up in Google search results.
Keywords
The words and phrases people type into Google when looking for what you offer.
Backlinks
Links from other websites pointing to yours.
Meta Title & Description
The clickable headline and summary that appear for your page in Google.
Now put it into practice
Run a free AI audit of your site and get clear, plain-English fixes — no jargon.