Uploaded image for project: 'Teiid'
  1. Teiid
  2. TEIID-5993

Add robots.txt to better crawl content

XMLWordPrintable

    • Icon: Quality Risk Quality Risk
    • Resolution: Unresolved
    • Icon: Major Major
    • Backlog
    • None
    • Documentation
    • None
    • DV Sprint 66
    • 0.1

      We should do a better job of directing what pages are crawled. I added a robots.txt to prevent the crawling of legacy. Something similar should be added for teiid.github.com to allow only the crawling of master.

            Unassigned Unassigned
            rhn-engineering-shawkins Steven Hawkins
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:

                Estimated:
                Original Estimate - 1 hour
                1h
                Remaining:
                Remaining Estimate - 1 hour
                1h
                Logged:
                Time Spent - Not Specified
                Not Specified