4948 Commits

Author SHA1 Message Date
cnauroth
0e80d51983 HDFS-8554. TestDatanodeLayoutUpgrade fails on Windows. Contributed by Chris Nauroth. 2015-06-08 08:39:02 -07:00
cnauroth
a6cb4894b4 HDFS-8539. Hdfs doesnt have class debug in windows. Contributed by Anu Engineer. 2015-06-07 13:01:43 -07:00
Xiaoyu Yao
b61b489995 HDFS-8116. Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManager. Contributed by Brahma Reddy Battula. 2015-06-06 18:47:45 -07:00
cnauroth
71de367c5e HDFS-8432. Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases. Contributed by Chris Nauroth. 2015-06-06 09:43:47 -07:00
cnauroth
e46cb80002 HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. 2015-06-06 09:17:03 -07:00
Xiaoyu Yao
3841d09765 HDFS-8522. Change heavily recorded NN logs from INFO to DEBUG level. (Contributed by Xiaoyu Yao) 2015-06-05 15:09:24 -07:00
Zhe Zhang
2eee19cd1d HDFS-8460. Erasure Coding: stateful read result doesn't match data occasionally because of flawed test. Contributed by Walter Su. 2015-06-05 13:39:37 -07:00
Zhe Zhang
c0929ab3c2 HDFS-8319. Erasure Coding: support decoding for stateful read. Contributed by Jing Zhao. 2015-06-04 18:16:41 -07:00
Andrew Wang
b2540f486e HDFS-8535. Clarify that dfs usage in dfsadmin -report output includes all block replicas. Contributed by Eddy Xu. 2015-06-04 15:35:07 -07:00
Andrew Wang
5149dc7b97 HDFS-8532. Make the visibility of DFSOutputStream#streamer member variable to private. Contributed by Rakesh R. 2015-06-04 11:09:19 -07:00
Kihwal Lee
ade6d9a61e HDFS-8463. Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException. Contributed by Masatake Iwasaki. 2015-06-04 12:51:00 -05:00
yliu
a31eada33a HDFS-8328. Follow-on to update decode for DataNode striped blocks reconstruction. (yliu) 2015-06-04 14:41:38 +08:00
Zhe Zhang
673280df24 HDFS-7621. Erasure Coding: update the Balancer/Mover data migration logic. Contributed by Walter Su. 2015-06-03 11:51:58 -07:00
Vinayakumar B
c59e745630 HDFS-3716. Purger should remove stale fsimage ckpt files (Contributed by J.Andreina) 2015-06-03 15:30:40 +05:30
Vinayakumar B
444a4510c8 HDFS-8523. Remove usage information on unsupported operation 'fsck -showprogress' from branch-2 (Contributed by J.Andreina)
Merged CHANGES.txt from branch-2.7

(cherry picked from commit 0ed9c2d8fec93b5dac9c305eda272ad8dfd869a9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md

(cherry picked from commit dd98cfd328dddb01a1220786d28a80195021611b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
2015-06-03 15:20:42 +05:30
Vinayakumar B
e965dcec37 HDFS-8470. fsimage loading progress should update inode, delegation token and cache pool count. (Contributed by surendra singh lilhore) 2015-06-03 14:24:55 +05:30
Vinayakumar B
54f83d9bd9 HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 2015-06-03 12:11:46 +05:30
Colin Patrick Mccabe
806e407ac8 HDFS-8521. Add VisibleForTesting annotation to BlockPoolSlice#selectReplicaToDelete. (cmccabe) 2015-06-02 20:06:28 -07:00
Jing Zhao
5f15084bd5 HDFS-8453. Erasure coding: properly handle start offset for internal blocks in a block group. Contributed by Zhe Zhang. 2015-06-02 16:14:08 -07:00
Andrew Wang
c1d50a91f7 HDFS-8513. Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant. (wang) 2015-06-02 15:48:26 -07:00
Andrew Wang
efc510a570 HDFS-8386. Improve synchronization of 'streamer' reference in DFSOutputStream. Contributed by Rakesh R. 2015-06-02 15:39:24 -07:00
Jing Zhao
71329e817b HDFS-8517. Fix a decoding issue in stripped block recovering in client side. Contributed by Kai Zheng. 2015-06-02 15:35:49 -07:00
Colin Patrick Mccabe
03fb5c6425 HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) 2015-06-02 11:40:37 -07:00
Vinayakumar B
2d847e7d62 HDFS-8444. Erasure Coding: fix cannot rename a zone dir (Contributed by Walter Su) 2015-06-02 16:41:19 +05:30
Vinayakumar B
9b54e66f3e HDFS-8336. Expose some administrative erasure coding operations to HdfsAdmin (Contributed by Uma Maheswara Rao G) 2015-06-02 16:38:43 +05:30
Vinayakumar B
a2bd6217eb HDFS-8256. '-storagepolicies , -blockId ,-replicaDetails ' options are missed out in usage and from documentation (Contributed by J.Andreina) 2015-06-02 16:07:18 +05:30
Jing Zhao
cdc13efb1a HDFS-8489. Subclass BlockInfo to represent contiguous blocks. Contributed by Zhe Zhang. 2015-06-01 11:42:58 -07:00
Zhe Zhang
014bd32c58 HDFS-8481. Erasure coding: remove workarounds in client side stripped blocks recovering. Contributed by Zhe Zhang. 2015-06-01 09:37:29 -07:00
Tsuyoshi Ozawa
c2356cb0bc HDFS-8490. Typo in trace enabled log in ExceptionHandler of WebHDFS. Contributed by Archana T. 2015-06-01 00:41:50 +09:00
Andrew Wang
7673d4f205 HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang) 2015-05-29 14:54:18 -07:00
Jing Zhao
7817674a3a HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by Ming Ma. 2015-05-29 11:05:13 -07:00
Vinayakumar B
b75df697e0 HDFS-7401. Add block info to DFSInputStream' WARN message when it adds node to deadNodes (Contributed by Arshad Mohammad) 2015-05-29 16:36:19 +05:30
Akira Ajisaka
d725dd8af6 HDFS-8443. Document dfs.namenode.service.handler.count in hdfs-site.xml. Contributed by J.Andreina. 2015-05-29 11:36:08 +09:00
Allen Wittenauer
ae14543420 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits (aw) 2015-05-28 13:24:01 -07:00
Colin Patrick Mccabe
a1140959da HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-05-28 12:00:55 -07:00
Colin Patrick Mccabe
d2d95bfe88 HDFS-8407. libhdfs hdfsListDirectory must set errno to 0 on success (Masatake Iwasaki via Colin P. McCabe) 2015-05-28 11:38:06 -07:00
cnauroth
50eeea1300 HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. 2015-05-27 22:54:10 -07:00
Allen Wittenauer
bf500d9798 HDFS-5033. Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source (Darrell Taylor via aw) 2015-05-27 16:51:34 -07:00
Andrew Wang
4928f54733 HDFS-8482. Rename BlockInfoContiguous to BlockInfo. Contributed by Zhe Zhang. 2015-05-27 15:42:07 -07:00
Haohui Mai
c46d4bafe1 Update CHANGES.txt for HDFS-8135. 2015-05-27 11:07:15 -07:00
Akira Ajisaka
bb1816328a HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki. 2015-05-27 18:04:40 +09:00
Jing Zhao
1299357a05 HDFS-8479. Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421. Contributed by Zhe Zhang. 2015-05-26 16:06:50 -07:00
Zhe Zhang
c9e0268216 Addendum fix for HDFS-7912. 2015-05-26 12:32:16 -07:00
Colin Patrick Mccabe
7dba7005b7 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) 2015-05-26 12:15:46 -07:00
Vinayakumar B
80c56c2d31 HDFS-8408. Revisit and refactor ErasureCodingInfo (Contributed by Vinayakumar B)
Added missed file
2015-05-26 12:07:15 -07:00
Vinayakumar B
9a18598e2d HDFS-8408. Revisit and refactor ErasureCodingInfo (Contributed by Vinayakumar B) 2015-05-26 12:07:15 -07:00
Kai Zheng
b30e96bfb4 HDFS-8382 Remove chunkSize and initialize from erasure coder. Contributed by Kai Zheng 2015-05-26 12:07:15 -07:00
Tsz-Wo Nicholas Sze
0ed92e5b13 HDFS-7768. Change fsck to support EC files. Contributed by Takanobu Asanuma 2015-05-26 12:07:15 -07:00
Walter Su
3d734df24c HDFS-8441. Erasure Coding: make condition check earlier for setReplication. (waltersu4549) 2015-05-26 12:07:09 -07:00
Zhe Zhang
7af05a3db4 HDFS-8294. Erasure Coding: Fix Findbug warnings present in erasure coding. Contributed by Rakesh R. 2015-05-26 12:02:34 -07:00