Файл robots.txt Белого дома

Jan 21, 2009 17:54

Вчера:

User-agent: *
Disallow: /cgi-bin
Disallow: /search
Disallow: /query.html
Disallow: /omb/search
Disallow: /omb/query.html
Disallow: /expectmore/search
Disallow: /expectmore/query.html
Disallow: /results/search
Disallow: /results/query.html
Disallow: /earmarks/search
Disallow: /earmarks/query.html
Disallow: /help
Disallow: /360pics/text
Disallow: /911/911day/text
Disallow: /911/heroes/text [ И ещё 2400+ строк ]

И сегодня

User-agent: *
Disallow: /includes/ [ Это всё! ]

politics, usa, fun

Previous post Next post
Up