big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,557 Commits 2 Branches 2 Tags 264 MiB
369ddc67bd
Commit Graph

2796 Commits

Author SHA1 Message Date
Jitendra Pandey
369ddc67bd HDFS-8153. Error Message points to wrong parent directory in case of path component name length error. Contributed by Anu Engineer. 2015-04-16 22:13:09 -07:00
Tsz-Wo Nicholas Sze
9595cc003c HDFS-7891. A block placement policy with best rack failure tolerance. Contributed by Walter Su 2015-04-16 18:25:53 -07:00
Tsz-Wo Nicholas Sze
75bbcc8bf3 HDFS-8082. Move dfs.client.read.*, dfs.client.short.circuit.*, dfs.client.mmap.* and dfs.client.hedged.read.* conf from DFSConfigKeys to HdfsClientConfigKeys. 2015-04-16 13:22:31 -07:00
Haohui Mai
80a2a12423 HDFS-8135. Remove the deprecated FSConstants class. Contributed by Li Lu. 2015-04-16 11:26:05 -07:00
Andrew Wang
2e8ea780a4 HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R. 2015-04-16 07:14:44 -07:00
Jing Zhao
fddd55279d HDFS-8127. NameNode Failover during HA upgrade can cause DataNode to finalize upgrade. Contributed by Jing Zhao. 2015-04-14 15:05:23 -07:00
cnauroth
fef596df03 HDFS-8055. NullPointerException when topology script is missing. Contributed by Anu Engineer. 2015-04-14 10:19:30 -07:00
cnauroth
d45aa7647b HDFS-6666. Abort NameNode and DataNode startup if security is enabled but block access token is not enabled. Contributed by Vijay Bhat. 2015-04-14 09:59:01 -07:00
Tsz-Wo Nicholas Sze
7fc50e2525 HDFS-8083. Move dfs.client.write.* conf from DFSConfigKeys to HdfsClientConfigKeys.Write. 2015-04-13 11:43:35 -07:00
Vinayakumar B
14384f5b51 HDFS-8111. NPE thrown when invalid FSImage filename given for 'hdfs oiv_legacy' cmd ( Contributed by surendra singh lilhore ) 2015-04-13 17:16:05 +05:30
cnauroth
f8f5887209 HDFS-7933. fsck should also report decommissioning replicas. Contributed by Xiaoyu Yao. 2015-04-11 13:23:18 -07:00
Tsz-Wo Nicholas Sze
60da0e49e7 HDFS-8084. Move dfs.client.failover.* confs from DFSConfigKeys to HdfsClientConfigKeys.Failover and fix typos in the dfs.http.client.* configuration keys. 2015-04-10 19:38:43 -07:00
Haohui Mai
36e4cd3be6 HDFS-8103. Move BlockTokenSecretManager.AccessMode into BlockTokenIdentifier. Contributed by Haohui Mai. 2015-04-10 16:36:45 -07:00
Tsz-Wo Nicholas Sze
2cc9514ad6 HDFS-8100. Refactor DFSClient.Conf to a standalone class and separates short-circuit related conf to ShortCircuitConf. 2015-04-10 14:48:45 -07:00
Arun Suresh
7660da95cb HDFS-7931. DistributedFileSystem should not look for keyProvider in cache if Encryption is disabled (asuresh) 2015-04-10 11:40:25 -07:00
Vinayakumar B
987c9e12e1 HDFS-7939. Two fsimage_rollback_* files are created which are not deleted after rollback. (Contributed by J.Andreina) 2015-04-10 11:12:07 +05:30
Konstantin V Shvachko
0959b67f1a HDFS-8081. Split getAdditionalBlock() into two methods. Contributed by Konstantin Shvachko 2015-04-09 22:00:20 -07:00
Haohui Mai
af9d4fede5 HDFS-8102. Separate webhdfs retry configuration keys from DFSConfigKeys. Contributed by Haohui Mai. 2015-04-09 14:36:27 -07:00
Arun Suresh
922b7ed21d HDFS-8091: ACLStatus and XAttributes should be presented to INodeAttributesProvider before returning to client (asuresh) 2015-04-09 12:38:33 -07:00
Colin Patrick Mccabe
30acb7372a HDFS-8099. Change "DFSInputStream has been closed already" message to debug log level (Charles Lamb via Colin P. McCabe) 2015-04-09 11:22:39 -07:00
Aaron T. Myers
3fe61e0bb0 HDFS-8101. DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime. Contributed by Sean Busbey. 2015-04-09 09:40:08 -07:00
Vinayakumar B
9d8952f97f HDFS-8096. DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers (Contributed by Vinayakumar B) 2015-04-09 11:58:00 +05:30
Andrew Wang
b1e059089d HDFS-7979. Initialize block report IDs with a random number. 2015-04-08 21:43:42 -07:00
Haohui Mai
cc25823546 HDFS-8089. Move o.a.h.hdfs.web.resources.* to the client jars. Contributed by Haohui Mai. 2015-04-08 16:30:08 -07:00
Andrew Wang
5a540c3d31 HDFS-8025. Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated. Contributed by Ming Ma. 2015-04-08 16:09:17 -07:00
Haohui Mai
bd4c99bece Revert HDFS-7808. 2015-04-08 15:59:55 -07:00
Andrew Wang
6af0d74a75 HDFS-7725. Incorrect 'nodes in service' metrics caused all writes to fail. Contributed by Ming Ma. 2015-04-08 15:52:06 -07:00
Andrew Wang
a42bb1cd91 HDFS-8076. Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible. Contributed by Zhe Zhang. 2015-04-08 15:41:48 -07:00
Kihwal Lee
285b31e75e HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee. 2015-04-08 15:38:29 -05:00
Tsz-Wo Nicholas Sze
c931a3c776 HDFS-8079. Move CorruptFileBlockIterator to a new hdfs.client.impl package. 2015-04-08 11:50:52 -07:00
Arpit Agarwal
608c499841 HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (Arpit Agarwal) 2015-04-08 11:38:21 -07:00
Haohui Mai
ab04ff9efe HDFS-8080. Separate JSON related routines used by WebHdfsFileSystem to a package local class. Contributed by Haohui Mai. 2015-04-07 21:30:57 -07:00
Vinayakumar B
d505c8acd3 HDFS-8073. Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. (Contributed by Walter Su) 2015-04-08 09:56:37 +05:30
Tsz-Wo Nicholas Sze
4be648b55c HDFS-8079. Move dfs.client.retry.* confs from DFSConfigKeys to HdfsClientConfigKeys.Retry. 2015-04-07 19:48:57 -07:00
Yongjun Zhang
66763bb06f HDFS-5215. dfs.datanode.du.reserved is not considered while computing 
available space ( Brahma Reddy Battula via Yongjun Zhang)
 2015-04-07 19:31:58 -07:00
cnauroth
1e72d98c69 HDFS-8038. PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. Contributed by Xiaoyu Yao. 2015-04-07 14:23:01 -07:00
Tsz-Wo Nicholas Sze
571a1ce9d0 HDFS-8049. Add @InterfaceAudience.Private annotation to hdfs client implementation. Contributed by Takuya Fukudome 2015-04-07 13:59:48 -07:00
Konstantin V Shvachko
75c5454860 HDFS-8071. Redundant checkFileProgress() in PART II of getAdditionalBlock(). Contributed by Konstantin Shvachko. 2015-04-06 22:20:44 -07:00
Colin Patrick Mccabe
28bebc81db HDFS-7999. FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time (sinago via cmccabe) 2015-04-06 08:56:52 -07:00
Colin Patrick Mccabe
ef591b1d6a HDFS-8051. FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. (Lei (Eddy) Xu via Colin P. McCabe) 2015-04-03 16:34:23 -07:00
Colin Patrick Mccabe
023133cef9 HDFS-7996. After swapping a volume, BlockReceiver reports ReplicaNotFoundException (Lei (Eddy) Xu via Colin P. McCabe) 2015-04-03 14:19:46 -07:00
Jing Zhao
72f6bd4893 HDFS-7811. Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage. Contributed by Xiaoyu Yao and Jing Zhao. 2015-04-02 21:20:30 -07:00
Haohui Mai
96649c38f9 HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-04-02 11:36:51 -07:00
Tsz-Wo Nicholas Sze
9ed43f2189 HDFS-7888. Change DFSOutputStream and DataStreamer for convenience of subclassing. Contributed by Li Bo 2015-04-02 10:59:26 -07:00
Vinayakumar B
867d5d2675 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 2015-04-02 08:12:00 +05:30
Haohui Mai
6ccf4fbf8a HDFS-8008. Support client-side back off when the datanodes are congested. Contributed by Haohui Mai. 2015-04-01 16:54:46 -07:00
Colin Patrick Mccabe
3c7adaaf35 HDFS-7922. ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors (Rakesh R via Colin P. McCabe) 2015-04-01 16:02:39 -07:00
Colin Patrick Mccabe
c94d594a57 HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe) 2015-04-01 14:10:10 -07:00
Andrew Wang
ed72daa5df HDFS-7978. Add LOG.isDebugEnabled() guard for some LOG.debug(..). Contributed by Walter Su. 2015-04-01 12:54:28 -07:00
Haohui Mai
53471d462c HDFS-8009. Signal congestion on the DataNode. Contributed by Haohui Mai. 2015-04-01 10:56:53 -07:00