User-Agent: *
Disallow: /internal/
Disallow: /images/
Disallow: /js/
Disallow: /log/
Disallow: /styles/