文件列表:

ensureBucket.sh (49, 2012-07-11)
ensureCluster.sh (1604, 2012-07-11)
ensureCredentials.sh (111, 2012-07-11)
hadoopDemo.sh (895, 2012-07-11)
pigJob.sh (673, 2012-07-11)
thirdparty (0, 2012-07-11)
thirdparty\elastic-mapreduce-ruby (0, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\CHANGELOG (2071, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\LICENSE.txt (39772, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\NOTICE.txt (1005, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon (0, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\aws (0, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\aws\exceptions.rb (6848, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral (0, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\awsquery.rb (5314, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\awsquerychainhelper.rb (3398, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\awsqueryhandler.rb (5627, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\awsqueryurihandler.rb (894, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\call.rb (1757, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\dispatcher.rb (997, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\ec2client.rb (3585, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\elasticmapreduceclient.rb (8160, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\handler.rb (397, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\httpdelegationhelper.rb (578, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\httpdestinationhandler.rb (910, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\httphandler.rb (4731, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\identityhandler.rb (959, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\job.rb (413, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\logfactory.rb (835, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\option.rb (1877, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\orchestrator.rb (1318, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\querystringmap.rb (2220, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\service.rb (4640, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\simplelog.rb (2638, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\urlencoding.rb (401, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\v0signaturehandler.rb (855, 2012-07-11)
thirdparty\elastic-mapreduce-ruby\amazon\coral\v0signaturehelper.rb (2432, 2012-07-11)
... ...

# HadoopDemo Test drive Hadoop on AWS Elastic Map Reduce ## Prerequisites You should have an AWS account. ## Installation ## Example Usage I'll test drive running a map reduce job on user agent strings. To extract the user agent strings from a web server log, I used this command: ```bash awk -v FS='"' '{ if( $(NF - 1) !~ "-" ) print $(NF - 1) }' webServer.log > userAgents.log ``` Then, I uploaded the file to an AWS S3 bucket, since S3 buckets are the preferred way to provide input to and retrieve output from AWS Elastic Map Reduce nodes. ```bash ``` ```bash ./hadoopDemo.sh ```

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：