文件列表:

《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\advanced_link_crawler.py (4040, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\advanced_link_crawler_using_requests.py (3832, 2019-04-10)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\downloading_a_page.py (340, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\id_iteration_crawler.py (1244, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\link_crawler.py (1803, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\retrying_downloads.py (548, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\setting_user_agent.py (662, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\sitemap_crawler.py (1088, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\throttle.py (807, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp1\__init__.py (0, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\advanced_link_crawler.py (4855, 2018-06-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\all_scrapers.py (1618, 2018-06-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\beautifulsoup.py (383, 2018-06-11)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\beautifulsoup_brokenhtml.py (603, 2018-06-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\csv_callback.py (833, 2018-06-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\family_trees.py (443, 2018-06-11)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\lxml_brokenhtml.py (233, 2018-06-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\lxml_scraper.py (289, 2018-06-11)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\regex.py (536, 2018-06-11)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\test_scrapers.py (912, 2018-06-11)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\xpath_scraper.py (286, 2018-06-11)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp2\__init__.py (0, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp3\advanced_link_crawler.py (3083, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp3\diskcache.py (3328, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp3\downloader.py (3165, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp3\downloader_requests_cache.py (3312, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp3\rediscache.py (1650, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp3\requests_cache_link_crawler.py (3027, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp3\url_parsing.py (854, 2018-06-12)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp3\__init__.py (0, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp4\advanced_link_crawler.py (4426, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp4\alexa_callback.py (731, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp4\extract_list.py (474, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp4\redis_queue.py (1992, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp4\threaded_crawler.py (5690, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp4\threaded_crawler_with_queue.py (6480, 2017-08-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp5\browser_render.py (2783, 2018-06-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp5\json_one_req.py (497, 2018-06-30)
《用Python写网络爬虫（第2版）》源代码\wswp-code\code\chp5\json_scraper.py (859, 2018-06-30)
... ...

## Web Scraping with Python Welcome to the code repository for [Web Scraping with Python, Second Edition](https://www.packtpub.com/big-data-and-business-intelligence/python-web-scraping-second-edition)! I hope you find the code and data here useful. If you have any questions reach out to @kjam on Twitter or GitHub. ### Code Structure All of the code samples are in folders separated by chapter. Scripts are intended to be run from the `code` folder, allowing you to easily import from the chapters. ### Code Examples I have not included every code sample you've found in the book, but I have included a majority of the finished scripts. Although these are included, I encourage you to write out each code sample on your own and use these only as a reference. ### Firefox Issues Depending on your version of Firefox and Selenium, you may run into JavaScript errors. Here are some fixes: * Use an older version of Firefox * Upgrade Selenium to >=3.0.2 and download the [geckodriver](https://github.com/mozilla/geckodriver/releases). Make sure the geckodriver is findable by your PATH variable. You can do this by adding this line to your `.bashrc` or `.bash_profile`. (Wondering what these are? Please read the Appendix C on learning the command line). * Use [PhantomJS](http://phantomjs.org/) with Selenium (change your browser line to `webdriver.PhantomJS('path/to/your/phantomjs/installation')`) * Use Chrome, InternetExplorer or any other [supported browser](http://www.seleniumhq.org/about/platforms.jsp) Feel free to reach out if you have any questions! ### Issues with Module Import Seeing chp1 ModuleNotFound errors? Try adding this snippet to the file: ``` import os import sys sys.path.append(os.path.abspath(os.path.join(os.path.dirname(__file__), os.pardir))) ``` What this does is append the main module to your system path, which is where Python looks for imports. On some installations, I have noticed the current directory is not immediately added (common practice), so this code *explicitly* adds that directory to your path. ### Corrections? If you find any issues in these code examples, feel free to submit an Issue or Pull Request. I appreciate your input! ### Questions? Reach out to @kjam on Twitter or GitHub. @kjam is also often on freenode. :)

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：