NewsScraper

所属分类:云数据库/云存储
开发工具:JavaScript
文件大小:15134KB
下载次数:0
上传日期:2022-12-11 11:12:27
上 传 者sh-1993
说明:  全堆栈站点-新闻站点刮刀,Mongo Mongoose ORM
(Full Stack Site - News Site scrapper, Mongo Mongoose ORM)

文件列表:
Database-Schema.md (1452, 2019-11-02)
TestCases.md (1198, 2019-11-02)
UseCases-PsuedoCode.md (2154, 2019-11-02)
models (0, 2019-11-02)
models\Comment.js (591, 2019-11-02)
models\Story.js (771, 2019-11-02)
models\index.js (136, 2019-11-02)
package-lock.json (35119, 2019-11-02)
package.json (709, 2019-11-02)
public (0, 2019-11-02)
public\assets (0, 2019-11-02)
public\assets\css (0, 2019-11-02)
public\assets\css\main.css (1039, 2019-11-02)
public\assets\img (0, 2019-11-02)
public\assets\img\comments.png (233671, 2019-11-02)
public\assets\img\home-page-img.png (197514, 2019-11-02)
public\assets\img\news-scraper-demo.gif (16070467, 2019-11-02)
public\assets\js (0, 2019-11-02)
public\assets\js\home.js (4710, 2019-11-02)
routes (0, 2019-11-02)
routes\comment-api-routes.js (1892, 2019-11-02)
routes\html-routes.js (1150, 2019-11-02)
routes\scrape-api-routes.js (2817, 2019-11-02)
server.js (1510, 2019-11-02)
views (0, 2019-11-02)
views\home.handlebars (1944, 2019-11-02)
views\layouts (0, 2019-11-02)
views\layouts\main.handlebars (1130, 2019-11-02)
views\partials (0, 2019-11-02)
views\partials\stories (0, 2019-11-02)
views\partials\stories\story-item.handlebars (401, 2019-11-02)

# News Scraper ## Full Stack website that scrapes headlines from LA Times ## Description This full stack web site scrapes story headlines from the LA Times and allows for user comments to be added/removed to each story. Headlines, summary, link and comments are stored in a mongo database. - #### Front-End Technology - HTML, CSS, JavaScript (ES6), jQuery, Bootstrap, Handlebars #### Back-End Technology - Node.js, Express.js, mongo.js, mongoose ORM, JavaScript (ES6), NPM packages (axios, cheerio,express, mongoose, morgan), Heroku ## Details: - #### Github project : News Scraper Repository - #### Deployed Heroku link: News Scraper - #### For further design and development details see: - #### [UseCases and Psuedo Code](https://github.com/mylescarey2019/NewsScraper/blob/master/UseCases-PsuedoCode.md) - #### [Test Cases](https://github.com/mylescarey2019/NewsScraper/blob/master/TestCases.md) - #### [Database Schema and SQL Queries](https://github.com/mylescarey2019/NewsScraper/blob/master/Database-Schema.md) - #### Demo walkthru GIF : - Use Cases seen in demo below - [x] scrap brings in new stories - [x] comment section: add comments, deleted comments - [x] db persistence - browser refresh then app shows same comments ![dorm-demo](https://github.com/mylescarey2019/NewsScraper/blob/master/./public/assets/img/news-scraper-demo.gif) #### Screen Captures: home page ![home-page-img](https://github.com/mylescarey2019/NewsScraper/blob/master/./public/assets/img/home-page-img.png) comment section ![survey-page-img](https://github.com/mylescarey2019/NewsScraper/blob/master/./public/assets/img/comments.png) ## Getting Started ### Native and NPM Packages Used 1. express - for interactive command line response 2. mongoose - for database connectivity 3. axios - for web page scraping 4. cheerio - for JQuery like selection experience in node 5. handlebars - templating engine for rendering home page ### Dependencies - none - ### Installing - none necessary - use link to page deployed on Heroku ### Executing program - scrape new stories via nav button - click on story comment button to open comment section - add and delete comments - link to LA Times story #### Possible Enhancements - [ ] allow user to mark stories as saved and purge old stories from db ## Authors Myles Carey mylescarey2019@gmail.com ## Version History - 1.0 - Initial Release ## License ## Acknowledgments Thanks to beta testers - my 15yo & 17yo daughters and wife

近期下载者

相关文件


收藏者