scrapy-jounery
所属分类：数据采集/爬虫
开发工具：Python
文件大小：0KB
下载次数：0
上传日期：2023-11-13 14:17:18
上 传 者：
sh-1993
说明： 淫秽的娱乐
(scrapy jounery)
文件列表:
.python-version (6, 2023-11-15)
Note.md (691, 2023-11-15)
bookscraper/ (0, 2023-11-15)
bookscraper/bookscraper/ (0, 2023-11-15)
bookscraper/bookscraper/__init__.py (0, 2023-11-15)
bookscraper/bookscraper/items.py (796, 2023-11-15)
bookscraper/bookscraper/middlewares.py (8178, 2023-11-15)
bookscraper/bookscraper/pipelines.py (5009, 2023-11-15)
bookscraper/bookscraper/settings.py (4137, 2023-11-15)
bookscraper/bookscraper/spiders/ (0, 2023-11-15)
bookscraper/bookscraper/spiders/__init__.py (161, 2023-11-15)
bookscraper/bookscraper/spiders/bookspider.py (2820, 2023-11-15)
bookscraper/booksdata.csv (11664, 2023-11-15)
bookscraper/booksdata.json (6167, 2023-11-15)
bookscraper/main.py (378, 2023-11-15)
bookscraper/scrapy.cfg (436, 2023-11-15)
bookscraper/setup.py (258, 2023-11-15)
requirements.txt (1105, 2023-11-15)
scrapydweb_settings_v10.py (17754, 2023-11-15)
# Note
## Scrapyd
scrapyd > scrapyd_logs.txt 2>&1 &
### API
To check the load status of a service.
`curl http://localhost:6800/daemonstatus.json`
Schedule a spider run (also known as a job), returning the job id.
`curl http://localhost:6800/schedule.json -d project=bookscraper -d spider=bookspider`
## Scrapy-deploy
scrapyd-deploy default
## Scrapy-web
scrapydweb > scrapydweb_logs.txt 2>&1 &
## Pyenv
export v=3.9.0; wget https://npm.taobao.org/mirrors/python/$v/Python-$v.tar.xz -P ~/.pyenv/cache/; pyenv install $v
sudo apt-get update
cann't correct install python cause bz2 module missing
- https://stackoverflow.com/questions/60775172/pyenvs-python-is-missing-bzip2-module
近期下载者：
相关文件：
收藏者：