Welcome to the Treehouse Community

The Treehouse Community is a meeting place for developers, designers, and programmers of all backgrounds and skill levels to get support. Collaborate here on code errors or bugs that you need feedback on, or asking for an extra set of eyes on your latest project. Join thousands of Treehouse students and alumni in the community today. (Note: Only Treehouse students can comment or ask questions, but non-students are welcome to browse our conversations.)

Looking to learn something new?

Treehouse offers a seven day free trial for new students. Get access to thousands of hours of content and a supportive community. Start your free trial today.

Python Scraping Data From the Web Additional Scraping Tasks An Intelligent Spider

Josh Keenan
Josh Keenan
19,528 Points
Posted by Josh Keenan
Josh Keenan
19,528 Points

Form contents not being output

So I have run this and like another user, this spider doesn't actually output anything at all and I have no idea why. Code should be pretty much identical to that in the video.

from scrapy.http import FormRequest
from scrapy.spiders import Spider


class FormSpider(Spider):
    name = "horseform"

    start_urls = ["https://treehouse-projects.github.io/horse-land/form.html"]

    def parse(self, response):
        formdata = {"firstname": "Tom", "lastname": "Thomson", "jobtitle": "Chef"}
        return FormRequest.from_response(response,
                                         formnumber=0,
                                         formdata=formdata,
                                         callback=self.after_post)

    def after_post(self, response):
        print("\n \n ============= \n \nForm processed.\n\n")
        print(response)
        print("\n\n ============= \n \