HDFS copyToLocalFile抛出java。伊奥。IOException:Mkdirs无法创建文件

Question

我试图使用Hadoop FileSystem类将文件从HDFS复制到本地linux文件系统

我有权在我试图复制的路径中创建文件夹，我使用mkdir命令进行了检查

我还尝试使用shell命令hadoop fs -copyToLocal hdfsFilePath localFilepath它正在工作

我正在用纱线簇运行这个。 我尝试了以下方法，但我得到了java.io.IOException: Mkdirs failed to create file:/home/user错误

错误日志：

16/01/14 01:09:36 ERROR util.FileUtil: 
java.io.IOException: Mkdirs failed to create /home/user (exists=false, cwd=file:/hdfs4/yarn/nm/usercache/user/appcache/application_1452126203792_8862/container_e2457_1452126203792_8862_01_000001)
    at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:442)
    at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:428)
    at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:908)
    at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:889)
    at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:786)
    at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:365)
    at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
    at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
    at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1970)
    at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1939)
    at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1915)
    at com.batch.util.FileUtil.copyToLocalFileSystem(FileUtil.java:66)
    at com.batch.dao.impl.DaoImpl.writeFile(DaoImpl.java:108)
    at com.batch.JobDriver.runJob(JobDriver.java:79)
    at com.batch.JobDriver.main(JobDriver.java:54)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:497)
    at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:480)

实际上，我将localFilePath作为/home/user/test传递，但我得到的错误是failed to create file:/home/user

fs.copyToLocalFile(hdfsFilePath, localFilePath);
fs.copyToLocalFile(false, hdfsFilePath, localFilePath, true);