Hadoop:减速器的数量与我在程序中设置的数量不相等
问题描述:
我在 mapred-site.xml
中设置了mapred.tasktracker.reduce.tasks.maximum为10,并且我还写了 jobConf.setNumReduceTasks (5)
在我的工作中。
I have set mapred.tasktracker.reduce.tasks.maximum to 10 in mapred-site.xml
, and I also write jobConf.setNumReduceTasks(5)
in my job.
如果我在Shell中运行作业,一切都可以。
Everything is ok if I run the job in Shell.
但是当我通过eclipse运行相同的工作时,只有一个reducer被启动。
But when I run the same job by eclipse, only one reducer was launched.
我尝试在eclipse中编辑Map / Reduce Locations,并设置 mapred.reduce.tasks
为10.但这仍然不起作用。
I try to edit Map/Reduce Locations in eclipse, and set mapred.reduce.tasks
to 10. But that still doesn't work.
是否有其他参数可以在eclipse中调整?
Is there any other parameters I can adjust in eclipse?
答