Python Scraping Data From the Web Additional Scraping Tasks An Intelligent Spider

Josh Keenan
Josh Keenan
17,380 Points

Form contents not being output

So I have run this and like another user, this spider doesn't actually output anything at all and I have no idea why. Code should be pretty much identical to that in the video.

from scrapy.http import FormRequest
from scrapy.spiders import Spider


class FormSpider(Spider):
    name = "horseform"

    start_urls = ["https://treehouse-projects.github.io/horse-land/form.html"]

    def parse(self, response):
        formdata = {"firstname": "Tom", "lastname": "Thomson", "jobtitle": "Chef"}
        return FormRequest.from_response(response,
                                         formnumber=0,
                                         formdata=formdata,
                                         callback=self.after_post)

    def after_post(self, response):
        print("\n \n ============= \n \nForm processed.\n\n")
        print(response)
        print("\n\n ============= \n \