Welcome to the Treehouse Community

Want to collaborate on code errors? Have bugs you need feedback on? Looking for an extra set of eyes on your latest project? Get support with fellow developers, designers, and programmers of all backgrounds and skill levels here with the Treehouse Community! While you're at it, check out some resources Treehouse students have shared here.

Looking to learn something new?

Treehouse offers a seven day free trial for new students. Get access to thousands of hours of content and join thousands of Treehouse students and alumni in the community today.

Start your free trial

Python

Henrik Christensen
seal-mask
.a{fill-rule:evenodd;}techdegree
Henrik Christensen
Python Web Development Techdegree Student 38,322 Points
Posted by Henrik Christensen
.a{fill-rule:evenodd;}techdegree
Henrik Christensen
Python Web Development Techdegree Student 38,322 Points

scraping

Hi,

I'm trying to learn about data science and web scraping/crawling, but I'm having a very hard time to find any good websites to scrape for practice.

I'm hoping maybe one of you guys (or ladies) have knowledge of a great site to scrape for practice :-)

1 Answer

justdave
justdave
31,518 Points

The Lego site is the go to for a lot of tutorials, so I assume they're used to it and has a decent amount of stuff to scrape but not too much. If you want a challenge try some local council/government sites, they tend to have a mess of disorganized links which are good practice.

I would pick something that is going to be useful for you in future projects though, since putting together a good scraper/crawler can take a while, you want to get back the most you can from your time investment.