big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,110 Commits 2 Branches 2 Tags 264 MiB
a3990ca414
Commit Graph

2923 Commits

Author SHA1 Message Date
Andrew Wang
a3990ca414 HDFS-8591. Remove support for deprecated configuration key dfs.namenode.decommission.nodes.per.interval. 2015-06-16 10:03:34 -07:00
Haohui Mai
32e39d8a29 HDFS-8592. SafeModeException never get unwrapped. Contributed by Haohui Mai. 2015-06-15 22:07:24 -07:00
Tsz-Wo Nicholas Sze
321940cf19 HDFS-8540. Mover should exit with NO_MOVE_BLOCK if no block can be moved. Contributed by surendra singh lilhore 2015-06-15 16:26:53 -07:00
Tsz-Wo Nicholas Sze
2cb09e98e3 HDFS-8576. Lease recovery should return true if the lease can be released and the file can be closed. Contributed by J.Andreina 2015-06-15 16:07:38 -07:00
Yongjun Zhang
b0dc291961 HDFS-8596. TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of "datanode" attribute. Contributed by Yongjun Zhang. 2015-06-14 11:39:31 -07:00
cnauroth
b8341f1cd8 HDFS-8593. Calculation of effective layout version mishandles comparison to current layout version in storage. Contributed by Chris Nauroth. 2015-06-13 10:37:52 -07:00
Haohui Mai
eef7b50e23 HDFS-8572. DN always uses HTTP/localhost@REALM principals in SPNEGO. Contributed by Haohui Mai. 2015-06-12 14:45:34 -07:00
Andrew Wang
c17439c2dd HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang. 2015-06-12 11:38:39 -07:00
Colin Patrick Mccabe
12b5b06c06 HDFS-7923. The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages (cmccabe) 2015-06-12 11:17:51 -07:00
Andrew Wang
b258b344bb HDFS-8573. Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline. Contributed by Eddy Xu. 2015-06-11 10:12:31 -07:00
Andrew Wang
a7a7768341 HDFS-8549. Abort the balancer if an upgrade is in progress. 2015-06-10 13:42:57 -07:00
Arpit Agarwal
3107434031 HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal) 2015-06-09 20:58:39 -07:00
Xiaoyu Yao
927577c87c HDFS-8552. Fix hdfs CLI usage message for namenode and zkfc. Contributed by Brahma Reddy Battula 2015-06-08 21:57:26 -07:00
Xiaoyu Yao
b61b489995 HDFS-8116. Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManager. Contributed by Brahma Reddy Battula. 2015-06-06 18:47:45 -07:00
cnauroth
71de367c5e HDFS-8432. Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases. Contributed by Chris Nauroth. 2015-06-06 09:43:47 -07:00
cnauroth
e46cb80002 HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. 2015-06-06 09:17:03 -07:00
Xiaoyu Yao
3841d09765 HDFS-8522. Change heavily recorded NN logs from INFO to DEBUG level. (Contributed by Xiaoyu Yao) 2015-06-05 15:09:24 -07:00
Andrew Wang
b2540f486e HDFS-8535. Clarify that dfs usage in dfsadmin -report output includes all block replicas. Contributed by Eddy Xu. 2015-06-04 15:35:07 -07:00
Andrew Wang
5149dc7b97 HDFS-8532. Make the visibility of DFSOutputStream#streamer member variable to private. Contributed by Rakesh R. 2015-06-04 11:09:19 -07:00
Kihwal Lee
ade6d9a61e HDFS-8463. Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException. Contributed by Masatake Iwasaki. 2015-06-04 12:51:00 -05:00
Vinayakumar B
c59e745630 HDFS-3716. Purger should remove stale fsimage ckpt files (Contributed by J.Andreina) 2015-06-03 15:30:40 +05:30
Vinayakumar B
e965dcec37 HDFS-8470. fsimage loading progress should update inode, delegation token and cache pool count. (Contributed by surendra singh lilhore) 2015-06-03 14:24:55 +05:30
Vinayakumar B
54f83d9bd9 HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 2015-06-03 12:11:46 +05:30
Colin Patrick Mccabe
806e407ac8 HDFS-8521. Add VisibleForTesting annotation to BlockPoolSlice#selectReplicaToDelete. (cmccabe) 2015-06-02 20:06:28 -07:00
Andrew Wang
c1d50a91f7 HDFS-8513. Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant. (wang) 2015-06-02 15:48:26 -07:00
Andrew Wang
efc510a570 HDFS-8386. Improve synchronization of 'streamer' reference in DFSOutputStream. Contributed by Rakesh R. 2015-06-02 15:39:24 -07:00
Colin Patrick Mccabe
03fb5c6425 HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) 2015-06-02 11:40:37 -07:00
Vinayakumar B
a2bd6217eb HDFS-8256. '-storagepolicies , -blockId ,-replicaDetails ' options are missed out in usage and from documentation (Contributed by J.Andreina) 2015-06-02 16:07:18 +05:30
Jing Zhao
cdc13efb1a HDFS-8489. Subclass BlockInfo to represent contiguous blocks. Contributed by Zhe Zhang. 2015-06-01 11:42:58 -07:00
Tsuyoshi Ozawa
c2356cb0bc HDFS-8490. Typo in trace enabled log in ExceptionHandler of WebHDFS. Contributed by Archana T. 2015-06-01 00:41:50 +09:00
Jing Zhao
7817674a3a HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by Ming Ma. 2015-05-29 11:05:13 -07:00
Vinayakumar B
b75df697e0 HDFS-7401. Add block info to DFSInputStream' WARN message when it adds node to deadNodes (Contributed by Arshad Mohammad) 2015-05-29 16:36:19 +05:30
Colin Patrick Mccabe
a1140959da HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-05-28 12:00:55 -07:00
Andrew Wang
4928f54733 HDFS-8482. Rename BlockInfoContiguous to BlockInfo. Contributed by Zhe Zhang. 2015-05-27 15:42:07 -07:00
Haohui Mai
ada233b7cd HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang. 2015-05-24 22:30:32 -07:00
Vinayakumar B
0c6638c2ea HDFS-8268. Port conflict log for data node server is not sufficient (Contributed by Mohammad Shahid Khan) 2015-05-22 16:15:15 +05:30
Xiaoyu Yao
05e04f34f2 HDFS-8451. DFSClient probe for encryption testing interprets empty URI property for enabled. Contributed by Steve Loughran. 2015-05-21 11:58:00 -07:00
Haohui Mai
2b6bcfdafa HDFS-8421. Move startFile() and related functions into FSDirWriteFileOp. Contributed by Haohui Mai. 2015-05-21 08:08:28 -07:00
Akira Ajisaka
dc8434ab2b HDFS-4383. Document the lease limits. Contributed by Arshad Mohammad. 2015-05-21 17:30:43 +09:00
Kihwal Lee
8860e352c3 HDFS-8404. Pending block replication can get stuck using older genstamp. Contributed by Nathan Roberts. 2015-05-19 13:05:15 -05:00
Colin Patrick Mccabe
470c87dbc6 HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 2015-05-19 10:50:15 -07:00
Kihwal Lee
de30d66b26 HDFS-8131. Implement a space balanced block placement policy. Contributed by Liu Shaohui. 2015-05-19 08:04:38 -05:00
Vinayakumar B
93972a332a HDFS-6348. SecondaryNameNode not terminating properly on runtime exceptions (Contributed by Rakesh R) 2015-05-19 12:24:25 +05:30
Ravi Prakash
cdfae446ad HDFS-4185. Add a metric for number of active leases (Rakesh R via raviprak) 2015-05-18 12:37:21 -07:00
Tsz-Wo Nicholas Sze
0c590e1c09 HDFS-8405. Fix a typo in NamenodeFsck. Contributed by Takanobu Asanuma 2015-05-19 02:57:54 +08:00
Arpit Agarwal
a2190bf15d HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:36:29 -07:00
Arpit Agarwal
e453989a57 HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit Agarwal) 2015-05-16 09:05:35 -07:00
Haohui Mai
ac742c762d HDFS-8403. Eliminate retries in TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal. 2015-05-15 19:12:40 -07:00
Haohui Mai
e5afac5896 HDFS-8394. Move getAdditionalBlock() and related functionalities into a separate class. Contributed by Haohui Mai. 2015-05-15 19:09:59 -07:00
Jing Zhao
8f37873342 HDFS-8397. Refactor the error handling code in DataStreamer. Contributed by Tsz Wo Nicholas Sze. 2015-05-15 16:14:54 -07:00