擅长:python、mysql、java
<p>如果您试图抓取的网站具有javascript呈现的动态元素,则需要Xvfb</p>
<pre><code>sudo apt-get install -y xvfb
</code></pre>
<blockquote>
<p><em>"Xvfb or X virtual framebuffer is a display server implementing the</em>
<em>X11 display server protocol. In contrast to other display servers,</em>
<em>Xvfb performs all graphical operations in virtual memory without</em>
<em>showing any screen output."</em></p>
</blockquote>
<p>在python中,Xvfb有两个包装器</p>
<p><strong>1-xvfbwrapper</strong></p>
<pre><code>pip install xvfbwrapper
</code></pre>
<p>然后在python文件中添加:</p>
<pre><code>from xvfbwrapper import Xvfb
display = Xvfb()
display.start()
</code></pre>
<p><strong>2-pyvirtualdisplay</strong></p>
<pre><code>pip install PyVirtualDisplay
</code></pre>
<p>然后在代码中:</p>
<pre><code>from pyvirtualdisplay import Display
display = Display(visible=0, size=(1024, 768))
display.start()
</code></pre>