Deleting intermediate data while chaining multiple MapReduce

BIG DATA Apache Hadoop
#1

How to delete the intermediate data while chaining multiple MapReduce jobs in Hadoop ?

#2

This can be done using:

FileSystem.delete(Path f, boolean recursive);

Here, the path is the location on HDFS of the data.
Note: Make sure that you only delete this data once no other job requires it.

#7

This topic is now closed. New replies are no longer allowed.

#8

This topic is now unlisted. It will no longer be displayed in any topic lists. The only way to access this topic is via direct link.

#9

This topic is now opened. New replies are allowed.

#10

This topic is now listed. It will be displayed in topic lists.