rabitmq-curling
所属分类：中间件编程
开发工具：PHP
文件大小：0KB
下载次数：0
上传日期：2023-06-03 15:26:29
上 传 者：
sh-1993
说明： 它从新闻网站中提取数据，并使用MQ进行并行处理，将数据放入数据库
(It s fetching data from news website and do parallel processing by using MQ and put data into database)
文件列表:
composer.json (143, 2023-06-03)
composer.lock (53414, 2023-06-03)
db.php (1651, 2023-06-03)
index.php (1298, 2023-06-03)
receiving.php (1748, 2023-06-03)
scraping - Copy.php (2063, 2023-06-03)
scraping.php (1159, 2023-06-03)
sending.php (771, 2023-06-03)
vendor/ (0, 2023-06-03)
vendor/autoload.php (178, 2023-06-03)
vendor/composer/ (0, 2023-06-03)
vendor/composer/ClassLoader.php (16068, 2023-06-03)
vendor/composer/InstalledVersions.php (14991, 2023-06-03)
vendor/composer/LICENSE (1070, 2023-06-03)
vendor/composer/autoload_classmap.php (333, 2023-06-03)
vendor/composer/autoload_files.php (743, 2023-06-03)
vendor/composer/autoload_namespaces.php (149, 2023-06-03)
vendor/composer/autoload_psr4.php (1705, 2023-06-03)
vendor/composer/autoload_real.php (2629, 2023-06-03)
vendor/composer/autoload_static.php (5231, 2023-06-03)
vendor/composer/installed.json (55797, 2023-06-03)
vendor/composer/installed.php (9140, 2023-06-03)
vendor/composer/platform_check.php (925, 2023-06-03)
vendor/fabpot/ (0, 2023-06-03)
vendor/fabpot/goutte/ (0, 2023-06-03)
vendor/fabpot/goutte/.travis.yml (339, 2023-06-03)
vendor/fabpot/goutte/Goutte/ (0, 2023-06-03)
vendor/fabpot/goutte/Goutte/Client.php (397, 2023-06-03)
vendor/fabpot/goutte/Goutte/Resources/ (0, 2023-06-03)
vendor/fabpot/goutte/Goutte/Resources/phar-stub.php (298, 2023-06-03)
vendor/fabpot/goutte/Goutte/Tests/ (0, 2023-06-03)
vendor/fabpot/goutte/Goutte/Tests/ClientTest.php (534, 2023-06-03)
vendor/fabpot/goutte/LICENSE (1065, 2023-06-03)
vendor/fabpot/goutte/box.json (428, 2023-06-03)
vendor/fabpot/goutte/composer.json (821, 2023-06-03)
vendor/fabpot/goutte/phpunit.xml.dist (534, 2023-06-03)
vendor/masterminds/ (0, 2023-06-03)
... ...
# rabitmq-curling
This code implementation involves fetching data from a news website and performing parallel processing using message queues (MQ) to store the data into a database.
## Files Used:
db.php: This file contains the necessary logic for retrieving, saving, and updating data in the news table of the database.
sending.php: This file handles the logic for fetching data from the https://highload.today website and putting it into a RabbitMQ to enable parallel data transmission.
receiving.php: This file focuses on retrieving data from the sending point of the message queue (MQ) and storing it into the database for further processing and analysis.
These files collectively enable the parallel processing of data, allowing for efficient retrieval, storage, and utilization of news data from the specified website.
近期下载者：
相关文件：
收藏者：