Note
Check Platform specific installation notes first.
The installation steps assume that you have the following things installed:
You can install Scrapy using pip (which is the canonical way to install Python packages).
To install using pip:
pip install Scrapy
Install Python 2.7 from http://python.org/download/
You need to adjust PATH environment variable to include paths to the Python executable and additional scripts. The following paths need to be added to PATH:
C:\Python2.7\;C:\Python2.7\Scripts\;
To update the PATH open a Command prompt and run:
c:\python27\python.exe c:\python27\tools\scripts\win_add2path.py
Close the command prompt window and reopen it so changes take effect, run the following command and check it shows the expected Python version:
python --version
Install pip from https://pip.pypa.io/en/latest/installing.html
Now open a Command prompt to check pip is installed correctly:
pip --version
At this point Python 2.7 and pip package manager must be working, let’s install Scrapy:
pip install Scrapy
Don’t use the python-scrapy package provided by Ubuntu, they are typically too old and slow to catch up with latest Scrapy.
Instead, use the official Ubuntu Packages, which already solve all dependencies for you and are continuously updated with the latest bug fixes.
You can follow the generic instructions or install Scrapy from AUR Scrapy package:
yaourt -S scrapy