Changes to Robots.txt

Current Robots.txt:

User-agent: *
Sitemap: https://dlg.usg.edu/sitemap.xml.gz
Disallow: /records?
Disallow: /records.html?
Disallow: /records.atom?
Disallow: /records.rss?
Disallow: /records/facet
Disallow: /records/map
Disallow: /collection
Disallow: /collections?
Disallow: /collections.html?
Disallow: /collections/facet
Disallow: /institutions
Disallow: /counties
Disallow: /map

• allow "/collection" so that individual collection pages can be indexed
• allow counties and institutions