Sample Integrations
Scrapy (for Python)
After installing Scrapy (pip install scrapy
) and creating a project (scrapy startproject [project name]
), you can connect to the Massive Network by saving code like that below to a file in the new [project name]/[project name]/spiders
subdirectory then running scrapy crawl demo
from the top-level [project name]
directory (Scrapy doesn’t seem to support HTTPS proxy connections, but you can use the network’s HTTP port):