2016-06-15 7 views
0

私の今日は、Pythonがプリインストールされた新鮮なUbuntuの16.04をインストール:マニュアルページhttp://doc.scrapy.org/en/latest/intro/install.htmlに述べたようにScrapyセットアップUbuntuは16.04または任意の他の

[email protected]:~$ python --version 
Python 2.7.11+ 
[email protected]:~$ python3 --version 
Python 3.5.1+ 

私は、このリンクhttp://doc.scrapy.org/en/latest/topics/ubuntu.html#topics-ubuntuを開き、Scrapyをインストールするために説明されている手順に従ってみました。

しかし、私はステップ3

sudo apt-get update && sudo apt-get install scrapy 

後にエラーが出る...

The following packages have unmet dependencies: 
scrapy : Depends: python-support (>= 0.90.0) but it is not installable 
      Recommends: python-setuptools but it is not going to be installed 
E: Unable to correct problems, you have held broken packages. 

私はScrapyとエラーに関する昨日の問題を投稿し、それはあまりにもが、Windows上でのセットアップの問題だったように見えます。 Cannot setup Scrapy on windowsだから私はUbuntuでもう一度やり直してみました。

Ubuntu 16.04でScrapyを設定するにはどうすればよいですか、それとも他のバージョンかもしれませんか?古いScrapyのマニュアルのようです。私はScrapyプロジェクトが死んだと思うだろうが、人々はまだScrapyを使用していることを知っている。 ScrapyはPython 2でのみ動作します+?だから私はWindowsにとどまります。すべてのバリアントを確認することはできません。時間がかかり過ぎる。誰もが安定した設定(オペレーティングシステム+ Pythonのバージョン)と言いますか?

ありがとうございました。

アップデートはここで私は、ドッカーてみました。私は端末からDockerfile、他のステップを作成する:1 があってはならないDockerfileの最初の行のように見える

[email protected]:~$ cat Dockerfile 
$ cat Dockerfile 
FROM ubuntu:xenial 

ENV DEBIAN_FRONTEND noninteractive 

RUN apt-get update 

# Install Python3 and dev headers 
RUN apt-get install -y \ 
    python3 \ 
    python-dev \ 
    python3-dev 

# Install cryptography 
RUN apt-get install -y \ 
    build-essential \ 
    libssl-dev \ 
    libffi-dev 

# install lxml 
RUN apt-get install -y \ 
    libxml2-dev \ 
    libxslt-dev 

# install pip 
RUN apt-get install -y python-pip 

RUN useradd --create-home --shell /bin/bash scrapyuser 

USER scrapyuser 
WORKDIR /home/scrapyuser 
[email protected]:~$ sudo docker build -t redapple/scrapy-ubuntu-xenial . 
Sending build context to Docker daemon 81.21 MB 
Step 1 : $ 
Unknown instruction: $ 
[email protected]:~$ sudo docker run -t -i redapple/scrapy-ubuntu-xenial 
Unable to find image 'redapple/scrapy-ubuntu-xenial:latest' locally 
Pulling repository docker.io/redapple/scrapy-ubuntu-xenial 
docker: Error: image redapple/scrapy-ubuntu-xenial not found. 
See 'docker run --help'. 
[email protected]:~$ pip install scrapy 
Requirement already satisfied (use --upgrade to upgrade): scrapy in ./.local/lib/python2.7/site-packages 
Requirement already satisfied (use --upgrade to upgrade): queuelib in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): pyOpenSSL in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): Twisted>=10.0.0 in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): six>=1.5.2 in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): w3lib>=1.14.2 in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): service-identity in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): cssselect>=0.9 in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): lxml in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): parsel>=0.9.3 in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): PyDispatcher>=2.0.5 in ./.local/lib/python2.7/site-packages (from scrapy) 
Requirement already satisfied (use --upgrade to upgrade): cryptography>=1.3 in ./.local/lib/python2.7/site-packages (from pyOpenSSL->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): zope.interface>=3.6.0 in ./.local/lib/python2.7/site-packages (from Twisted>=10.0.0->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): pyasn1-modules in ./.local/lib/python2.7/site-packages (from service-identity->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): pyasn1 in ./.local/lib/python2.7/site-packages (from service-identity->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): attrs in ./.local/lib/python2.7/site-packages (from service-identity->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): setuptools>=11.3 in ./.local/lib/python2.7/site-packages (from cryptography>=1.3->pyOpenSSL->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): ipaddress in ./.local/lib/python2.7/site-packages (from cryptography>=1.3->pyOpenSSL->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): enum34 in ./.local/lib/python2.7/site-packages (from cryptography>=1.3->pyOpenSSL->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): idna>=2.0 in ./.local/lib/python2.7/site-packages (from cryptography>=1.3->pyOpenSSL->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): cffi>=1.4.1 in ./.local/lib/python2.7/site-packages (from cryptography>=1.3->pyOpenSSL->scrapy) 
Requirement already satisfied (use --upgrade to upgrade): pycparser in ./.local/lib/python2.7/site-packages (from cffi>=1.4.1->cryptography>=1.3->pyOpenSSL->scrapy) 
[email protected]:~$ scrapy version 
The program 'scrapy' is currently not installed. You can install it by typing: 
sudo apt install python-scrapy 

UPDATE。私がそれを取り除くと($ cat Dockerfile)

私はドッカーのイメージを稼働させることができますが、もう一度ピップをインストールすると幸いです。以上のことより、私はドッカーとの間でいくつかのオーバーヘッドを行う必要があることを認識しています(私はコーディング時にGUIを好みます)。このDockerイメージには何かツールがインストールされていますか?ここにインストールログ:

[email protected]:~$ sudo docker run -t -i redapple/scrapy-ubuntu-xenial 
    [email protected]:~$ python --version 
    Python 2.7.11+ 
    [email protected]:~$ python3 --version 
    Python 3.5.1+ 
    [email protected]:~$ pip install scrapy 
    Collecting scrapy 
     Downloading Scrapy-1.1.0-py2.py3-none-any.whl (294kB) 
     100% |################################| 296kB 245kB/s 
    Collecting queuelib (from scrapy) 
     Downloading queuelib-1.4.2-py2.py3-none-any.whl 
    Collecting pyOpenSSL (from scrapy) 
     Downloading pyOpenSSL-16.0.0-py2.py3-none-any.whl (45kB) 
     100% |################################| 51kB 12.7MB/s 
    Collecting Twisted>=10.0.0 (from scrapy) 
     Downloading Twisted-16.2.0.tar.bz2 (2.9MB) 
     100% |################################| 2.9MB 472kB/s 
    Collecting six>=1.5.2 (from scrapy) 
     Downloading six-1.10.0-py2.py3-none-any.whl 
    Collecting w3lib>=1.14.2 (from scrapy) 
     Downloading w3lib-1.14.2-py2.py3-none-any.whl 
    Collecting service-identity (from scrapy) 
     Downloading service_identity-16.0.0-py2.py3-none-any.whl 
    Collecting cssselect>=0.9 (from scrapy) 
     Downloading cssselect-0.9.2-py2.py3-none-any.whl 
    Collecting lxml (from scrapy) 
     Downloading lxml-3.6.0.tar.gz (3.7MB) 
     100% |################################| 3.7MB 389kB/s 
    Collecting parsel>=0.9.3 (from scrapy) 
     Downloading parsel-1.0.2-py2.py3-none-any.whl 
    Collecting PyDispatcher>=2.0.5 (from scrapy) 
     Downloading PyDispatcher-2.0.5.tar.gz 
    Collecting cryptography>=1.3 (from pyOpenSSL->scrapy) 
     Downloading cryptography-1.4.tar.gz (399kB) 
     100% |################################| 409kB 1.4MB/s 
    Collecting zope.interface>=3.6.0 (from Twisted>=10.0.0->scrapy) 
     Downloading zope.interface-4.2.0.tar.gz (146kB) 
     100% |################################| 153kB 1.2MB/s 
    Collecting pyasn1-modules (from service-identity->scrapy) 
     Downloading pyasn1_modules-0.0.8-py2.py3-none-any.whl 
    Collecting pyasn1 (from service-identity->scrapy) 
     Downloading pyasn1-0.1.9-py2.py3-none-any.whl 
    Collecting attrs (from service-identity->scrapy) 
     Downloading attrs-16.0.0-py2.py3-none-any.whl 
    Collecting idna>=2.0 (from cryptography>=1.3->pyOpenSSL->scrapy) 
     Downloading idna-2.1-py2.py3-none-any.whl (54kB) 
     100% |################################| 61kB 10.8MB/s 
    Collecting setuptools>=11.3 (from cryptography>=1.3->pyOpenSSL->scrapy) 
     Downloading setuptools-23.0.0-py2.py3-none-any.whl (435kB) 
     100% |################################| 440kB 1.2MB/s 
    Collecting enum34 (from cryptography>=1.3->pyOpenSSL->scrapy) 
     Downloading enum34-1.1.6-py2-none-any.whl 
    Collecting ipaddress (from cryptography>=1.3->pyOpenSSL->scrapy) 
     Downloading ipaddress-1.0.16-py27-none-any.whl 
    Collecting cffi>=1.4.1 (from cryptography>=1.3->pyOpenSSL->scrapy) 
     Downloading cffi-1.6.0.tar.gz (397kB) 
     100% |################################| 399kB 1.3MB/s 
    Collecting pycparser (from cffi>=1.4.1->cryptography>=1.3->pyOpenSSL->scrapy) 
     Downloading pycparser-2.14.tar.gz (223kB) 
     100% |################################| 225kB 1.1MB/s 
    Building wheels for collected packages: Twisted, lxml, PyDispatcher, cryptography, zope.interface, cffi, pycparser 
     Running setup.py bdist_wheel for Twisted ... done 
     Stored in directory: /home/scrapyuser/.cache/pip/wheels/fe/9d/3f/9f7b1c768889796c01929abb7cdfa2a9cdd32bae64eb7aa239 
     Running setup.py bdist_wheel for lxml ... done 
     Stored in directory: /home/scrapyuser/.cache/pip/wheels/6c/eb/a1/e4ff54c99630e3cc6ec659287c4fd88345cd78199923544412 
     Running setup.py bdist_wheel for PyDispatcher ... done 
     Stored in directory: /home/scrapyuser/.cache/pip/wheels/86/02/a1/5857c77600a28813aaf0f66d4e4568f50c9f133277a4122411 
     Running setup.py bdist_wheel for cryptography ... done 
     Stored in directory: /home/scrapyuser/.cache/pip/wheels/f6/6c/21/11ec069285a52d7fa8c735be5fc2edfb8b24012c0f78f93d20 
     Running setup.py bdist_wheel for zope.interface ... done 
     Stored in directory: /home/scrapyuser/.cache/pip/wheels/20/a2/bc/74fe87cee17134f5219ba01fe82dd8c10998377e0fb910bb22 
     Running setup.py bdist_wheel for cffi ... done 
     Stored in directory: /home/scrapyuser/.cache/pip/wheels/8f/00/29/553c1b1db38bbeec3fec428ae4e400cd8349ecd99fe86edea1 
     Running setup.py bdist_wheel for pycparser ... done 
     Stored in directory: /home/scrapyuser/.cache/pip/wheels/9b/f4/2e/d03e949a551719a1ffcb659f2c63d8444f4df12e994ce52112 
    Successfully built Twisted lxml PyDispatcher cryptography zope.interface cffi pycparser 
    Installing collected packages: queuelib, idna, pyasn1, six, setuptools, enum34, ipaddress, pycparser, cffi, cryptography, pyOpenSSL, zope.interface, Twisted, w3lib, pyasn1-modules, attrs, service-identity, cssselect, lxml, parsel, PyDispatcher, scrapy 
    Successfully installed PyDispatcher Twisted attrs cffi cryptography cssselect enum34 idna ipaddress lxml parsel pyOpenSSL pyasn1 pyasn1-modules pycparser queuelib scrapy service-identity setuptools-20.7.0 six w3lib zope.interface 
    You are using pip version 8.1.1, however version 8.1.2 is available. 
    You should consider upgrading via the 'pip install --upgrade pip' command. 
    [email protected]:~$ scrapy version 
    bash: scrapy: command not found 

答えて

関連する問題