Scrapyd

Available projects:

How to schedule a spider?

To schedule a spider you need to use the API (this web UI is only for monitoring)

Example using curl:

curl http://localhost:5555/schedule.json -d project=default -d spider=somespider

For more information about the API, see the Scrapyd documentation