Welcome to the Treehouse Community

Want to collaborate on code errors? Have bugs you need feedback on? Looking for an extra set of eyes on your latest project? Get support with fellow developers, designers, and programmers of all backgrounds and skill levels here with the Treehouse Community! While you're at it, check out some resources Treehouse students have shared here.

Looking to learn something new?

Treehouse offers a seven day free trial for new students. Get access to thousands of hours of content and join thousands of Treehouse students and alumni in the community today.

Start your free trial

General Discussion

Jeremy Castanza
Jeremy Castanza
12,081 Points

Best Practices for Robots.txt ???

Hello,

I was hoping to generate some discussion and get some questions answered about Robots.txt. I'm working on a legacy project built on Classic ASP and I noticed that CSS and Javascript were disallowed. I did some digging and the consensus that I'm getting as of recent years is that this is no longer the practice and can impact SEO/Google's indexing of a site.

With that said, I'm wondering what are other types of directories or files that SHOULD be disallowed (i.e. Sass, Git repo, wp-admin, maintenance files, etc.)?

I'm curious to see what the Treehouse community's thoughts are on this.

Thanks!