Welcome to the Treehouse Community

The Treehouse Community is a meeting place for developers, designers, and programmers of all backgrounds and skill levels to get support. Collaborate here on code errors or bugs that you need feedback on, or asking for an extra set of eyes on your latest project. Join thousands of Treehouse students and alumni in the community today. (Note: Only Treehouse students can comment or ask questions, but non-students are welcome to browse our conversations.)

Looking to learn something new?

Treehouse offers a seven day free trial for new students. Get access to thousands of hours of content and a supportive community. Start your free trial today.

Development Tools

Posted by Cory Walter
Cory Walter
2,309 Points

Spiders/Scripts?

Can anyone point me in the right direction for creating or learning how to create spiders or scripts/macros to crawl a website for product data and flag updated or new information in a csv?

Thanks.

James Barnett
James Barnett
39,199 Points
James Barnett
James Barnett
39,199 Points

Do you have access to the backend database/files?

Cory Walter
Cory Walter
2,309 Points

James, I am new to spiders. But I do not have access to the backend files/database. I think once I had done an initial crawl and extract all the product detail, I would then create a file or DB table to compare future crawls against.