How to Edit Your Domains
Find it in the Admin Center: Search.gov Home > Admin Center > YourSite > Manage Content > Domains
How to include content
Fill out the applicable domains, subdomains, or folders to return results specific to your website. You do not need to include https://
as we recognize domains with or without it.
Including entire sites
- List
yoursite.gov
(without www) to search your entire site, including all subdomains. - List
yoursite.gov
andyoursite2.gov
to search multiple sites.
Including specific subdomains
- List
www.yoursite.gov
to include only content under the ‘www’ domain. - List
subdomain.yoursite.gov
to include subdomains.
Including specific directories
List yoursite.gov/folder
to include folders. This will include all subfolders, including yoursite.gov/folder/subfolder1
and yoursite.gov/folder/subfolder2
.
How to exclude content
Excluding domains or folders
You can exclude specific subdomains or folders by:
- Listing the excluded subdomains or folders in your robots.txt file. This blocks them from all crawlers that follow the robots exclusion protocol.
- Excluding them by omission. For example, to exclude subdomain3, list only
subdomain1.yoursite.gov
,subdomain2.yoursite.gov
, andsubdomain4.yoursite.gov
.
### Excluding URLs</a>
You can remove or filter specific URLs by:
- Removing the page from your site and returning a 404 (Not Found), 401 (Gone), or 301 (Permanently Moved) HTTP status.
- Adding a noindex robots metatag or x-robots tag. This blocks them from all crawlers that follow the robots exclusion protocol.