Q:

Deploy scrapyd spider with external packages

The scrapyd docs include the following note:

scrapyd-deploy won’t deploy anything outside the project module...

Does that mean that I cannot import from site-packages in my spiders?  
My spiders rely on external libraries such as MySQL-python and tldextract.  Must I include these libraries within the project module and import from the include libraries as opposed to site-packages?

A:

I think Deploying your project documentation paragraph should clarify things:

Finally, to deploy your project use:
scrapyd-deploy scrapyd -p project1

This will eggify your project and
  upload it to the target, printing the JSON response returned from the
  Scrapyd server. If you have a setup.py file in your project, that one
  will be used. Otherwise a setup.py file will be created automatically
  (based on a simple template) that you can edit later.

In other words, you would/should have MySQL-python, tldextract or other dependencies listed in setup.py which would be automatically installed during deployment.

