NewsScraper
所属分类:云数据库/云存储
开发工具:JavaScript
文件大小:15134KB
下载次数:0
上传日期:2022-12-11 11:12:27
上 传 者:
sh-1993
说明: 全堆栈站点-新闻站点刮刀,Mongo Mongoose ORM
(Full Stack Site - News Site scrapper, Mongo Mongoose ORM)
文件列表:
Database-Schema.md (1452, 2019-11-02)
TestCases.md (1198, 2019-11-02)
UseCases-PsuedoCode.md (2154, 2019-11-02)
models (0, 2019-11-02)
models\Comment.js (591, 2019-11-02)
models\Story.js (771, 2019-11-02)
models\index.js (136, 2019-11-02)
package-lock.json (35119, 2019-11-02)
package.json (709, 2019-11-02)
public (0, 2019-11-02)
public\assets (0, 2019-11-02)
public\assets\css (0, 2019-11-02)
public\assets\css\main.css (1039, 2019-11-02)
public\assets\img (0, 2019-11-02)
public\assets\img\comments.png (233671, 2019-11-02)
public\assets\img\home-page-img.png (197514, 2019-11-02)
public\assets\img\news-scraper-demo.gif (16070467, 2019-11-02)
public\assets\js (0, 2019-11-02)
public\assets\js\home.js (4710, 2019-11-02)
routes (0, 2019-11-02)
routes\comment-api-routes.js (1892, 2019-11-02)
routes\html-routes.js (1150, 2019-11-02)
routes\scrape-api-routes.js (2817, 2019-11-02)
server.js (1510, 2019-11-02)
views (0, 2019-11-02)
views\home.handlebars (1944, 2019-11-02)
views\layouts (0, 2019-11-02)
views\layouts\main.handlebars (1130, 2019-11-02)
views\partials (0, 2019-11-02)
views\partials\stories (0, 2019-11-02)
views\partials\stories\story-item.handlebars (401, 2019-11-02)
# News Scraper
## Full Stack website that scrapes headlines from LA Times
## Description
This full stack web site scrapes story headlines from the LA Times and allows for user comments to be added/removed to each story. Headlines, summary, link and comments are stored in a mongo database.
- #### Front-End Technology
- HTML, CSS, JavaScript (ES6), jQuery, Bootstrap, Handlebars
#### Back-End Technology
- Node.js, Express.js, mongo.js, mongoose ORM, JavaScript (ES6), NPM packages (axios, cheerio,express, mongoose, morgan), Heroku
## Details:
- #### Github project :
News Scraper Repository
- #### Deployed Heroku link:
News Scraper
- #### For further design and development details see:
- #### [UseCases and Psuedo Code](https://github.com/mylescarey2019/NewsScraper/blob/master/UseCases-PsuedoCode.md)
- #### [Test Cases](https://github.com/mylescarey2019/NewsScraper/blob/master/TestCases.md)
- #### [Database Schema and SQL Queries](https://github.com/mylescarey2019/NewsScraper/blob/master/Database-Schema.md)
- #### Demo walkthru GIF :
- Use Cases seen in demo below
- [x] scrap brings in new stories
- [x] comment section: add comments, deleted comments
- [x] db persistence - browser refresh then app shows same comments
![dorm-demo](https://github.com/mylescarey2019/NewsScraper/blob/master/./public/assets/img/news-scraper-demo.gif)
#### Screen Captures:
home page
![home-page-img](https://github.com/mylescarey2019/NewsScraper/blob/master/./public/assets/img/home-page-img.png)
comment section
![survey-page-img](https://github.com/mylescarey2019/NewsScraper/blob/master/./public/assets/img/comments.png)
## Getting Started
### Native and NPM Packages Used
1. express - for interactive command line response
2. mongoose - for database connectivity
3. axios - for web page scraping
4. cheerio - for JQuery like selection experience in node
5. handlebars - templating engine for rendering home page
### Dependencies
- none -
### Installing
- none necessary - use link to page deployed on Heroku
### Executing program
- scrape new stories via nav button
- click on story comment button to open comment section
- add and delete comments
- link to LA Times story
#### Possible Enhancements
- [ ] allow user to mark stories as saved and purge old stories from db
## Authors
Myles Carey
mylescarey2019@gmail.com
## Version History
- 1.0 - Initial Release
## License
## Acknowledgments
Thanks to beta testers - my 15yo & 17yo daughters and wife
近期下载者:
相关文件:
收藏者: