I am working on a scrapy project which requires some additional libs other than scrapy and python like Sqlalchemy, psycopg2 ect. Right now everything is working good and now I'd like to deploy the spider to Heroku and for monitoring, scheduling stuff I am trying to use Scrapyd server and ScrapydWeb for web interface. I deployed the scrapyd server on Heroku but for web interface it is showing application error and when I saw the logs error was:
when I tried locally scrapydweb response with 400 bad request. How to fix it?
scrapydweb_settings_v10.py
I am working on a scrapy project which requires some additional libs other than scrapy and python like Sqlalchemy, psycopg2 ect. Right now everything is working good and now I'd like to deploy the spider to Heroku and for monitoring, scheduling stuff I am trying to use Scrapyd server and ScrapydWeb for web interface. I deployed the scrapyd server on Heroku but for web interface it is showing application error and when I saw the logs error was:
when I tried locally scrapydweb response with 400 bad request. How to fix it?
scrapydweb_settings_v10.py