User-agent: * Allow: / Disallow: /redirect Disallow: /airlineredirect Disallow: /rssairlineredirect Disallow: /images Disallow: /css Disallow: /ajax