When we think about indexing pages for search, we usually think about indexing the primary content of the page. But if the page isn’t structured to tell the search engine where that content is to be found, it will collect the
<body> tag, and then filter out the
<footer> elements, if present. If
<footer> are not present, we collect the full contents of the
<body> tag. Learn more on our post about aiming search engines at the content you really want to be searchable, using the </main> element.
You can read more detail on each of the following elements here.
- meta description
- meta keywords
- locale or language (from the opening
- lastmod (collected from XML sitemaps)
In addition to HTML pages with their various file extensions, Search.gov indexes the following file types:
- Word docs
- Excel docs
- Images can be indexed either using our Flickr integration, or by sending us an MRSS feed. Note that images are not indexed during web page indexing, so you’ll need to use one of these two methods.