文件列表:

CS226_project.iml (80, 2020-01-08)
KML.py (1073, 2020-01-08)
Start.kml (326, 2020-01-08)
pom.xml (3516, 2020-01-08)
src/ (0, 2020-01-08)
src/main/ (0, 2020-01-08)
src/main/scala/ (0, 2020-01-08)
src/main/scala/CS226.scala (4207, 2020-01-08)
src/main/scala/GeoTestJson.scala (3286, 2020-01-08)
start_spark.sh (319, 2020-01-08)

## Usage Enter the root of the project, and use the following code to run the project ./start_spark.sh Our code can run well in cluster, and there is a same project in there to named "CS226_code". You can also go to that directory and use the code mentioned to start it. ## Note In last line of start script, there are two parameters. The first one is the path to the roadmap dataset. Default is the sample dataset we generated, since the whole data is too big to run. The second parameter is the number of dem data files being used in the project. There are 33 data files in total, and we just use two files to generate the result. The result of the project will be in the directory "data/output" and "data/output_kml". The "output" saves the output of the spark job and the "output_kml" saves the kml files that we generated based on the result of spark. Finally, we download the kml files and use Google Earth to visualize it. ## Some Details We take 1000000 data from original dataset as sample. There is a limitation of memory in the given cluster, we get error when we try to use the whole dataset.

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：