mammoth

所属分类:云计算
开发工具:Java
文件大小:4350KB
下载次数:0
上传日期:2014-04-24 04:14:45
上 传 者sh-1993
说明:  基于hadoop-1.0.1的以内存为中心的MapReduce。
(A memory-centric MapReduce based on hadoop-1.0.1.)

文件列表:
LICENSE.txt (13366, 2014-04-24)
TR-mammoth-HUST.pdf (394412, 2014-04-24)
hadoop-core-1.0.1-mammoth-0.9.0.jar (3997789, 2014-04-24)
src (0, 2014-04-24)
src\org (0, 2014-04-24)
src\org\apache (0, 2014-04-24)
src\org\apache\hadoop (0, 2014-04-24)
src\org\apache\hadoop\fs (0, 2014-04-24)
src\org\apache\hadoop\fs\FSDataOutputStream.java (3144, 2014-04-24)
src\org\apache\hadoop\fs\FileSystem.java (57213, 2014-04-24)
src\org\apache\hadoop\fs\LocalFileSystem.java (3981, 2014-04-24)
src\org\apache\hadoop\fs\RawLocalFileSystem.java (16653, 2014-04-24)
src\org\apache\hadoop\fs\package.html (861, 2014-04-24)
src\org\apache\hadoop\mapred (0, 2014-04-24)
src\org\apache\hadoop\mapred\CacheFile.java (5692, 2014-04-24)
src\org\apache\hadoop\mapred\CacheOutputStream.java (883, 2014-04-24)
src\org\apache\hadoop\mapred\CachePool.java (3082, 2014-04-24)
src\org\apache\hadoop\mapred\Child.java (21186, 2014-04-24)
src\org\apache\hadoop\mapred\ChildRamManager.java (10910, 2014-04-24)
src\org\apache\hadoop\mapred\DefaultJvmMemoryManager.java (42930, 2014-04-24)
src\org\apache\hadoop\mapred\IFile.java (22240, 2014-04-24)
src\org\apache\hadoop\mapred\IFileOutputStream.java (2721, 2014-04-24)
src\org\apache\hadoop\mapred\JSPUtil.java (23133, 2014-04-24)
src\org\apache\hadoop\mapred\JVMId.java (4192, 2014-04-24)
src\org\apache\hadoop\mapred\JobClient.java (72137, 2014-04-24)
src\org\apache\hadoop\mapred\JobConf.java (65970, 2014-04-24)
src\org\apache\hadoop\mapred\JobConfigurable.java (1049, 2014-04-24)
src\org\apache\hadoop\mapred\JobContext.java (1617, 2014-04-24)
src\org\apache\hadoop\mapred\JobID.java (4079, 2014-04-24)
src\org\apache\hadoop\mapred\JobInProgress.java (126171, 2014-04-24)
src\org\apache\hadoop\mapred\JobInProgressListener.java (1660, 2014-04-24)
src\org\apache\hadoop\mapred\JobInfo.java (2381, 2014-04-24)
src\org\apache\hadoop\mapred\JobLocalizer.java (21976, 2014-04-24)
src\org\apache\hadoop\mapred\JobPriority.java (989, 2014-04-24)
src\org\apache\hadoop\mapred\JobProfile.java (4976, 2014-04-24)
src\org\apache\hadoop\mapred\JobQueueClient.java (6446, 2014-04-24)
src\org\apache\hadoop\mapred\JobQueueInfo.java (3581, 2014-04-24)
src\org\apache\hadoop\mapred\JobQueueJobInProgressListener.java (5504, 2014-04-24)
... ...

How to use: Mammoth is a memory-centric MapReduce based on hadoop-1.0.1 aiming to solve the problem of I/O bottleneck in data-intensive applications. About how to use hadoop, you can refer to its homepage: http://hadoop.apache.org/. In the following part of this document, we assume you are familiar with hadoop. You can just replace the "hadoop-core-1.0.1.jar" under $HADOOP_HOME with the compiled "hadoop-core-1.0.1-mammoth-0.9.0.jar". After that you can use mammoth just in the same way with original hadoop. Mammoth is developed with ***-bit jdk7, and you are suggested to use the same. You must specify the child jvm options before running your job, eg: mapred.job.child.java.opts -d*** -Xmx8000M -Xms8000M This parameter is the only one required to be manually specified because Mammoth can maximize the usage of memory in runtime using a rule-based heuristic. You can learn more about the Mammoth on the following page: http://grid.hust.edu.cn/xhshi/projects/mammoth.htm.

近期下载者

相关文件


收藏者