hadoop word count example where does reducer output go?

Question

I have a map/reduce I am looking at on cassandra and it has this line in the reducer

context.write(key, new IntWritable(sum));

and I would like to see the full list of keys and their total count. Where do I go to get this information.

as an example, I see the word count example but see no code for outputting stuff to the screen but somehow it does output stuff to the screen. Where is my output for my map/reduce going then?

http://hadoop.apache.org/docs/stable/mapred_tutorial.html#Example%3A+WordCount+v2.0

thanks, Dean

... It "outputs stuff to the screen" because it runs cat via HDFS. The file is wherever you've defined your HDFS to be. — Dave Newton
– Dave Newton, Commented Sep 12, 2013 at 16:18

Chaos · Accepted Answer · 2013-09-12 17:19:44Z

1

Your Map/Reduce output goes to an output directory in HDFS that you define in your code or as a runtime parameter, or in your job configuration file.

answered Sep 12, 2013 at 17:19

Chaos

11.8k14 gold badges46 silver badges70 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

hadoop word count example where does reducer output go?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related