User-agent: * Disallow: /api/ Disallow: /login/ Disallow: /register-to-bid/result/ Disallow: /terms-conditions/ Disallow: /redirect/