文件列表:

.ipynb_checkpoints (0, 2022-09-25)
.ipynb_checkpoints\Procfile-checkpoint (53, 2022-09-25)
.ipynb_checkpoints\file-checkpoint.txt (0, 2022-09-25)
NewDBFolder (0, 2022-09-25)
NewDBFolder\.ipynb_checkpoints (0, 2022-09-25)
NewDBFolder\.ipynb_checkpoints\NewDB-checkpoint.ipynb (9530, 2022-09-25)
NewDBFolder\NewDB.ipynb (9530, 2022-09-25)
Procfile (53, 2022-09-25)
RunTimestampFetch.py (589, 2022-09-25)
__pycache__ (0, 2022-09-25)
__pycache__\osrs_fcns.cpython-38.pyc (3455, 2022-09-25)
file.txt (0, 2022-09-25)
geitems.db (33845248, 2022-09-25)
notebooks (0, 2022-09-25)
notebooks\.ipynb (72, 2022-09-25)
notebooks\.ipynb_checkpoints (0, 2022-09-25)
notebooks\.ipynb_checkpoints\.ipynb-checkpoint (72, 2022-09-25)
notebooks\.ipynb_checkpoints\Add-LatestCSVsToDB-checkpoint.py (501, 2022-09-25)
notebooks\.ipynb_checkpoints\Dashboard_Testing-checkpoint.ipynb (604, 2022-09-25)
notebooks\.ipynb_checkpoints\Get-LastestPriceCSVs-checkpoint.py (709, 2022-09-25)
notebooks\.ipynb_checkpoints\Get_all_prices_w_item_names-checkpoint.ipynb (13134, 2022-09-25)
notebooks\.ipynb_checkpoints\IQR Dict-checkpoint.ipynb (47171, 2022-09-25)
notebooks\.ipynb_checkpoints\Requesting5mtimedata-checkpoint.ipynb (45383, 2022-09-25)
notebooks\.ipynb_checkpoints\Task_scheduler-checkpoint.ipynb (3086, 2022-09-25)
notebooks\.ipynb_checkpoints\Update-DB-checkpoint.py (117, 2022-09-25)
notebooks\.ipynb_checkpoints\additemstodb-checkpoint.ipynb (7013, 2022-09-25)
notebooks\.ipynb_checkpoints\addpricestodb-checkpoint.ipynb (24955, 2022-09-25)
notebooks\.ipynb_checkpoints\concatCSVs-checkpoint.ipynb (72, 2022-09-25)
notebooks\.ipynb_checkpoints\createitemdb-checkpoint.ipynb (2225, 2022-09-25)
notebooks\.ipynb_checkpoints\createpricetable-checkpoint.ipynb (2425, 2022-09-25)
notebooks\.ipynb_checkpoints\dashPractice-checkpoint.ipynb (19292, 2022-09-25)
notebooks\.ipynb_checkpoints\getItemInfoByName-checkpoint.ipynb (12784, 2022-09-25)
notebooks\.ipynb_checkpoints\latestTime-checkpoint.txt (12, 2022-09-25)
notebooks\.ipynb_checkpoints\latest_osrs_items-checkpoint.csv (410957, 2022-09-25)
notebooks\.ipynb_checkpoints\latest_osrs_items2022-03-07 12-41-21-checkpoint.csv (410957, 2022-09-25)
notebooks\.ipynb_checkpoints\osrs_fcns-checkpoint.py (13073, 2022-09-25)
... ...

# GEoutlier_detection The goal of this project is to explore OldSchool Runescape market data. Some things I am interested in are: - Different market indices and the differences in calculation (dow/sp500) - How might increasing trade volume affect complementary items (seeds->potions) - ## Data The OSRS API provides two sets of data that I will use. The first is information about each item that currently exists in the game. This includes an item id, members item or not, in-game examine text, and name of the item. This data changes less often because items and updates occur less frequently than economy transactions. An example table can be found in the notebooks folder called latest_osrs_items. The most interesting data is the five minute price updates. Querying the api will return all items that have been traded in the last five minutes so low volume items will not appear often. Each query for the prices returns an item id, avg high and low prices, high and low volumes, and a UNIX timestamp. Many examples of this data are in the prices folder in any one of the csv files. ## Data Management When I started this project, I was storing new data in separate csv files. I quickly realized that this was the wrong way to do this. Next, I started up a MySQL database on another computer, but I didn't want to deal with making separate users for accessing the data. I also do not know how to set up access outside of my own network. I decided to switch to SQlite for the rest of the project. I have finished collecting past data starting from March 08, 2021 1:35:00 until September 2022. I have a few scripts that can run to keep the database updated. The first script is Get_LatestPriceCSVs() that keeps track of the latest timestamp of data requested, gets the new data, increments the timestamp by five minutes (300 sec), and saves the csv to a Data_CSVs folder. The next script is called runTableAdder(). It iterates through the CSVs in the Data_CSVs folder and adds each to the database and moves them to the Imported folder after they are added. I need to add some method for deleting the oldest X files. A script called Update-DB.py runs both of these in sequence. It can be run at any time to get the database caught up to the current date. ### Tables My database contains two tables. One is for all of the item data so that I can get the item names and examine text. The other contains all entries for item prices. The notebooks where I created these tables are called createitemdb.ipynb and createpricetable.ipynb. First, I pull the price data from the API. Then, I format it into a pandas dataframe and change some datatypes. After that, I put each row into the prices table of the database. *Note: Pandas datatypes cause issues when adding the data to the database. I explicitly cast each value as the correct type before adding the data.

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：