文件列表:

.travis.yml (316, 2023-10-18)
LICENSE (1062, 2023-10-18)
MANIFEST.in (63, 2023-10-18)
docs/ (0, 2023-10-18)
docs/images/ (0, 2023-10-18)
docs/images/banner.png (816555, 2023-10-18)
docs/images/demo1.png (111944, 2023-10-18)
docs/images/demo2.png (101480, 2023-10-18)
docs/images/demo3.png (255608, 2023-10-18)
docs/images/demo4.png (189575, 2023-10-18)
docs/images/demo5.png (51983, 2023-10-18)
docs/images/demo6.png (54816, 2023-10-18)
requirements-test.txt (105, 2023-10-18)
requirements.txt (177, 2023-10-18)
setup.py (1273, 2023-10-18)
telegram_news/ (0, 2023-10-18)
telegram_news/__init__.py (559, 2023-10-18)
telegram_news/constant.py (1635, 2023-10-18)
telegram_news/displaypolicy.py (3966, 2023-10-18)
telegram_news/ratelimit.py (4944, 2023-10-18)
telegram_news/table.sql (106, 2023-10-18)
telegram_news/template/ (0, 2023-10-18)
telegram_news/template/__init__.py (391, 2023-10-18)
telegram_news/template/common.py (45453, 2023-10-18)
telegram_news/utils.py (17333, 2023-10-18)

Telegram-news

## Introduction This is a easy-to-learn, flexible and standardized message fetching and pushing framework, especially for [Telegram](http://www.telegram.org) and [Telegram Bot](https://core.telegram.org/bots). The target news source can be HTML page, JSON and XML. We also provide customized process for unknown data format. Push the latest news to your channel or group once it happens! ## Install ```shell $ pip install telegram-news ``` Or, you can install by cloning this repository: ```shell $ git clone https://github.com/ESWZY/telegram-news.git $ cd telegram-news $ python setup.py install ``` ## Prepare It does not need much so that you can run your code anywhere. First, ask [@BotFather](https://t.me/botfather) for a bot and bot token. After that, create a public [channel](https://telegram.org/tour/channels) or [group](https://telegram.org/tour/groups), and remember chat id you just named. Do not forget to invite your bot into your channel or group and make it an admin. You also need a SQL database. Any SQL database is OK. Especially, I recommend [PostgreSQL](https://www.postgresql.org/). ## Quick deploy on Heroku Click button to deploy an example for free. Python environment and PostgreSQL database have been prepared. After deployment, start the worker in "Resources" tab, and then you can see the effect in your channel/group, which contains both SCMP news and Wiki news at same time. Also, you can have a look at the quick deployment source code of this project in [ESWZY/telegram-news-getting-started](https://github.com/ESWZY/telegram-news-getting-started). ## Usage Those are 3 examples for you to understand how to use the framework. ### Basic Example ```python import os from sqlalchemy import create_engine from sqlalchemy.orm import Session from telegram_news.template import InfoExtractor, NewsPostman # Three required fields: # Your bot token obtained from @BotFather bot_token = os.getenv("TOKEN") # Add your bots into a channel as an administrator channel = os.getenv("CHANNEL") # Your database to store old messages. DATABASE_URL = os.getenv("DATABASE_URL") # Create a database session engine = create_engine(DATABASE_URL) db = Session(bind=engine.connect()) # The news source url = "https://en.wikinews.org/wiki/Main_Page" tag = "Wiki News" table_name = "wikinews" # Info extractor to process data format ie = InfoExtractor() # Select select element by CSS-based selector ie.set_list_selector('#MainPage_latest_news_text > ul > li') ie.set_title_selector('#firstHeading') ie.set_paragraph_selector('#mw-content-text > div > p:not(p:nth-child(1))') ie.set_time_selector('#mw-content-text > div > p:nth-child(1) > strong') ie.set_source_selector('span.sourceTemplate') # Set a max length for post, Max is 4096 ie.max_post_length = 2000 # News postman to manage sending affair np = NewsPostman(listURLs=[url, ], sendList=[channel, ], db=db, tag=tag) np.set_bot_token(bot_token) np.set_extractor(ie) np.set_table_name(table_name) # Start to work! np.poll() ``` Typical results: ### Advanced Example ```python import os from sqlalchemy import create_engine from sqlalchemy.orm import Session from telegram_news.template import InfoExtractor, NewsPostman bot_token = os.getenv("TOKEN") channel = os.getenv("CHANNEL") DATABASE_URL = os.getenv("DATABASE_URL") engine = create_engine(DATABASE_URL) db = Session(bind=engine.connect()) # Above code is as same as the basic example, you can reuse those code directly url_2 = "https://www.cnbeta.com/" tag_2 = "cnBeta" table_name_2 = "cnbetanews" ie_2 = InfoExtractor() ie_2.set_list_selector('.items-area > div > dl > dt > a') ie_2.set_title_selector('header > h1') # Select many target at same time ie_2.set_paragraph_selector('div.cnbeta-article-body > div.article-summary > p, ' # Summary only 'div.cnbeta-article-body > div.article-content > p') # Content only ie_2.set_time_selector('header > div > span:nth-child(1)') ie_2.set_source_selector('header > div > span.source') # Select image to display, then the max length is down to 1024 ie_2.set_image_selector('div.cnbeta-article-body > div.article-summary > p img, ' # From summary only 'div.cnbeta-article-body > div.article-content > p img') # From content only ie_2.max_post_length = 1000 np_2 = NewsPostman(listURLs=[url_2, ], sendList=[channel], tag=tag_2, db=db) np_2.set_extractor(ie_2) np_2.set_table_name(table_name_2) np_2.poll() ``` Typical results: ### Advanced Example for JSON and XML The handle for JSON and XML are quite similar. You can convert XML to JSON by function `telegram_news.utils.xml_to_json`, and use `NewsPostmanJSON` and `InfoExtractorJSON`. Or, you can use `NewsPostmanXML` and `InfoExtractorXML` directly. You should use key list to recursively route to the information you want. ```python import hashlib import json import os from sqlalchemy import create_engine from sqlalchemy.orm import Session from telegram_news.template import InfoExtractorJSON, NewsPostmanJSON from telegram_news.utils import xml_to_json bot_token = os.getenv("TOKEN") channel = os.getenv("CHANNEL") DATABASE_URL = os.getenv("DATABASE_URL") engine = create_engine(DATABASE_URL) db = Session(bind=engine.connect()) url_3 = "https://www.scmp.com/rss/91/feed" tag_3 = "SCMP" table_name_3 = "scmpnews" ie_3 = InfoExtractorJSON() # Pre-process the XML string, convert to JSON string def list_pre_process(text): text = json.loads(xml_to_json(text)) return json.dumps(text) ie_3.set_list_pre_process_policy(list_pre_process) # Route by key list ie_3.set_list_router(['rss', 'channel', 'item']) ie_3.set_link_router(['link']) ie_3.set_title_router(['title']) ie_3.set_paragraphs_router(['description']) ie_3.set_time_router(['pubDate']) ie_3.set_source_router(['author']) ie_3.set_image_router(['media:thumbnail', '@url']) # Customize ID for news item def id_policy(link): return hashlib.md5(link.encode("utf-8")).hexdigest() ie_3.set_id_policy(id_policy) np_3 = NewsPostmanJSON(listURLs=[url_3], sendList=[channel], db=db, tag=tag_3) np_3.set_extractor(ie_3) np_3.set_table_name(table_name_3) np_3.poll() ``` Typical results: ### Parallel Program If you use the same database and send to the same channel, you can simply joint each part of code block, and call `poll()` function simultaneously. An example you can find in our Heroku deploy template repo: https://github.com/ESWZY/telegram-news-getting-started/blob/master/main.py ## Example Channel A Telegram channel of [basic example](https://github.com/ESWZY/telegram-news#basic-example) for English Wikinews: [~~@wikinews_en~~](https://t.me/joinchat/T7TbJUWpgUpGmarY) (in English) A Telegram channel for realtime earthquake warning powered by Telegram-news: [@earthquake_alert](https://t.me/s/earthquake_alert) (in Chinese) ## TODO - [x] HTML item list - [x] JSON item list - [x] XML item list - [x] Send Image - [x] Send Video - [x] Send media group - [ ] Send file - [ ] Send audio - [x] File sending retry - [ ] CC as e-mail - [ ] Webhook - [ ] Update message by message ID - [ ] Document - [ ] GUI ## Feedback Feel free to contact with me if you have any question. Also welcome any contribute. If you build a channel by this, don't forget to share that good news with us! ## License Licensed under the MIT License.

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：