fyp-news-summary

所属分类:collect
开发工具:Python
文件大小:0KB
下载次数:0
上传日期:2023-05-31 16:43:48
上 传 者sh-1993
说明:  用于最新在线新闻的抽象新闻摘要生成器,
(Abstractive news summary generator for the latest online news,)

文件列表:
Dockerfile (314, 2023-05-31)
aws.png (53305, 2023-05-31)
db.sqlite3 (8187904, 2023-05-31)
env.yaml (1776, 2023-05-31)
final_year_project_django/ (0, 2023-05-31)
final_year_project_django/__init__.py (0, 2023-05-31)
final_year_project_django/asgi.py (427, 2023-05-31)
final_year_project_django/data_import.py (2312, 2023-05-31)
final_year_project_django/forms.py (132, 2023-05-31)
final_year_project_django/ingestion.py (4577, 2023-05-31)
final_year_project_django/migrations/ (0, 2023-05-31)
final_year_project_django/migrations/0001_initial.py (698, 2023-05-31)
final_year_project_django/migrations/0002_rename_tile_news_title.py (366, 2023-05-31)
final_year_project_django/migrations/0003_news_category.py (458, 2023-05-31)
final_year_project_django/migrations/__init__.py (0, 2023-05-31)
final_year_project_django/models.py (381, 2023-05-31)
final_year_project_django/search.py (2570, 2023-05-31)
final_year_project_django/settings.py (3191, 2023-05-31)
final_year_project_django/static/ (0, 2023-05-31)
final_year_project_django/static/Search_results.js (22562, 2023-05-31)
final_year_project_django/static/main.css (378, 2023-05-31)
final_year_project_django/templates/ (0, 2023-05-31)
final_year_project_django/templates/index.html (222, 2023-05-31)
final_year_project_django/templates/parent.html (1214, 2023-05-31)
final_year_project_django/templates/search_page.html (271, 2023-05-31)
final_year_project_django/templates/settings.html (89, 2023-05-31)
final_year_project_django/urls.py (1101, 2023-05-31)
final_year_project_django/views.py (2517, 2023-05-31)
final_year_project_django/wsgi.py (427, 2023-05-31)
functions/ (0, 2023-05-31)
functions/fetch_from_s3_bucket/ (0, 2023-05-31)
functions/fetch_from_s3_bucket/s3_fetch.py (1977, 2023-05-31)
functions/fetch_news_from_rss/ (0, 2023-05-31)
functions/fetch_news_from_rss/deploymentscript.sh (205, 2023-05-31)
functions/fetch_news_from_rss/fetch_news.py (2427, 2023-05-31)
manage.py (822, 2023-05-31)
project_write_up.pdf (1030643, 2023-05-31)
requirements.txt (893, 2023-05-31)
scoring/ (0, 2023-05-31)
... ...

# Lucid - A news summary generator Full write up in file marked "project_write_up.pdf" Note the tests have been removed from the learn version of this site due to size limitations. ## Overview of the program The program uses the following library's ### Python - Django (used to create front end) - OpenAI (used for GPT-3 interaction) - boto3(used for AWS interaction) - Beautiful Soup (used for web scraping) - Huggingface(sentence-transformers) used for pretrained models - Rouge-score used for running rouge score ### Server infrastructure ![AWS diagram](https://github.com/Acollie/fyp-news-summary/blob/master/aws.png) ### Javascript - Vue.js (handing front end events) - Vue-router (url routing on the front end) - Axios (sending API calls) - Bootstrap (for making professional UI elements) ## How to run program with conda (https://docs.conda.io/projects/conda/en/latest/user-guide/install/index.html) 1. Download the repo via Github 2. Create an environment `conda create -n myenv python=3.6` 3. Then run `conda env update -f env.yaml` this should install all the dependencies required for the project. If this command does not work try this `conda env update -f env.yaml --prune` 4. Then activate the environment by running `source activate myenv` 5. Start the program using `python manage.py runserver` this can take a while since initially the models will need to be downloaded. 6. Go to [localhost:8000](https://github.com/Acollie/fyp-news-summary/blob/master/https://localhost:8000 "localhost:8000") 7. Enter an item into the search box the search term "War in ukraine" yields the best results ## Important features ### Creating summary of news articles Functions are inside the `ingestion.py` ### Searching transformer based seen in file Functions are inside the `search.py` ### Fetching data from the internet This handled inside the functions file `s3_fetch.py` fetched data from the s3.environment `fetch_news.py` ### Front end parts Javascript inside `static/Search_results.js` HTML stored `templates/`

近期下载者

相关文件


收藏者