Python Scraping Data From the Web Additional Scraping Tasks An Intelligent Spider

Josh Keenan
Josh Keenan
17,357 Points
Posted by Josh Keenan
Josh Keenan
17,357 Points

Form contents not being output

So I have run this and like another user, this spider doesn't actually output anything at all and I have no idea why. Code should be pretty much identical to that in the video.

from scrapy.http import FormRequest
from scrapy.spiders import Spider


class FormSpider(Spider):
    name = "horseform"

    start_urls = ["https://treehouse-projects.github.io/horse-land/form.html"]

    def parse(self, response):
        formdata = {"firstname": "Tom", "lastname": "Thomson", "jobtitle": "Chef"}
        return FormRequest.from_response(response,
                                         formnumber=0,
                                         formdata=formdata,
                                         callback=self.after_post)

    def after_post(self, response):
        print("\n \n ============= \n \nForm processed.\n\n")
        print(response)
        print("\n\n ============= \n \