How to Edit Your Domains
Find it in the Admin Center: Search.gov Home > Admin Center > YourSite > Manage Content > Domains
Enter the applicable domains, subdomains, or folders to return results specific to your website. You do not need to include https:// as we recognize domains with or without it.
Entire Site(s)
- List yoursite.gov (without www) to search your entire site, including all subdomains.
- List yoursite.gov and yoursite2.gov to search multiple sites.
Specific Subdomains
- List www.yoursite.gov to include only the primary ‘www’ domain.
- List subdomain.yoursite.gov to include subdomains.
Specific Directories
List yoursite.gov/folder to include folders. Note: this will include all sub-folders (if they exist), i.e. yoursite.gov/folder/folder2.
You cannot specify individual URLs, but you can filter unwanted URLs from results.
How to Exclude Content
Domains
You can exclude specific subdomains or folders by:
- List the excluded subdomains or folders in your robots.txt file. This blocks them from all crawlers that follow the robots exclusion protocol.
- Exclude them by omission. For example, to exclude subdomain3, list only subdomain1.yoursite.gov, subdomain2.yoursite.gov, and subdomain4.yoursite.gov.
You can remove or filter specific URLs by:
- Removing the page from your site and returning a 404 (Not Found), 401 (Gone), or 301 (Permanently Moved) HTTP status.
- Adding a noindex robots metatag or x-robots tag. This blocks them from all crawlers that follow the robots exclusion protocol.
- Requesting the page’s removal using the Block URLs option in Bing Webaster Tools and Remove URLs option in Google Webmaster Tools.
- Use the Filter URLs option under the Advanced tab. Note that this option should be used only if the other options aren’t feasible as it can have an undesired effect on other features such as the display of spelling suggestions and relevance ranking.