Welcome to the Treehouse Community

Want to collaborate on code errors? Have bugs you need feedback on? Looking for an extra set of eyes on your latest project? Get support with fellow developers, designers, and programmers of all backgrounds and skill levels here with the Treehouse Community! While you're at it, check out some resources Treehouse students have shared here.

Looking to learn something new?

Treehouse offers a seven day free trial for new students. Get access to thousands of hours of content and join thousands of Treehouse students and alumni in the community today.

Start your free trial

Development Tools

Posted by Cory Walter
Cory Walter
2,309 Points

Spiders/Scripts?

Can anyone point me in the right direction for creating or learning how to create spiders or scripts/macros to crawl a website for product data and flag updated or new information in a csv?

Thanks.

James Barnett
James Barnett
39,199 Points
James Barnett
James Barnett
39,199 Points

Do you have access to the backend database/files?

Cory Walter
Cory Walter
2,309 Points

James, I am new to spiders. But I do not have access to the backend files/database. I think once I had done an initial crawl and extract all the product detail, I would then create a file or DB table to compare future crawls against.