Uploaded image for project: 'Teiid'
  1. Teiid
  2. TEIID-5993

Add robots.txt to better crawl content

XMLWordPrintable

    • Icon: Quality Risk Quality Risk
    • Resolution: Unresolved
    • Icon: Major Major
    • Backlog
    • None
    • Documentation
    • None
    • DV Sprint 66
    • 0.1

      We should do a better job of directing what pages are crawled. I added a robots.txt to prevent the crawling of legacy. Something similar should be added for teiid.github.com to allow only the crawling of master.

              Unassigned Unassigned
              rhn-engineering-shawkins Steven Hawkins
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:

                  Estimated:
                  Original Estimate - 1 hour
                  1h
                  Remaining:
                  Remaining Estimate - 1 hour
                  1h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified