15 lines
284 B
Plaintext
15 lines
284 B
Plaintext
User-agent: *
|
|
Allow: /autojobs/
|
|
Allow: /autojobs/signup
|
|
Allow: /autojobs/login
|
|
|
|
User-agent: GPTBot
|
|
Disallow: /autojobs/dashboard
|
|
Disallow: /autojobs/api/
|
|
|
|
User-agent: CCBot
|
|
Disallow: /autojobs/dashboard
|
|
Disallow: /autojobs/api/
|
|
|
|
Sitemap: https://hostpioneers.com/autojobs/sitemap.xml
|