Commit Graph

4080 Commits

Author SHA1 Message Date
Colin Patrick Mccabe
61df1b27a7 HDFS-7410. Support CreateFlags with append() to support hsync() for appending streams (Vinayakumar B via Colin P. McCabe) 2015-03-26 13:21:09 -07:00
Arpit Agarwal
3d0708bdb0 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:24:11 -07:00
Kihwal Lee
222845632b HDFS-7963. Fix expected tracing spans in TestTracing. Contributed by Masatake Iwasaki. 2015-03-26 08:44:58 -05:00
cnauroth
4528eb9fb2 HADOOP-11524. hadoop_do_classpath_subcommand throws a shellcheck warning. Contributed by Chris Nauroth. 2015-03-25 22:36:09 -07:00
Kihwal Lee
fc1031af74 HDFS-7928. Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy. Contributed by Rushabh Shah. 2015-03-25 14:42:59 -05:00
Jing Zhao
97e2aa2551 Move HDFS-6353 to the trunk section in CHANGES.txt 2015-03-25 11:15:44 -07:00
Jing Zhao
5e21e4ca37 HDFS-6353. Check and make checkpoint before stopping the NameNode. Contributed by Jing Zhao. 2015-03-25 10:38:00 -07:00
Haohui Mai
80278a5f85 HDFS-7985. WebHDFS should be always enabled. Contributed by Li Lu. 2015-03-24 21:55:56 -07:00
Jitendra Pandey
53a28afe29 HDFS-6826. Plugin interface to enable delegation of HDFS authorization assertions. Contributed by Arun Suresh. 2015-03-24 16:02:40 -07:00
Haohui Mai
e38ef70fbc HDFS-7713. Implement mkdirs in the HDFS Web UI. Contributed by Ravi Prakash. 2015-03-24 15:48:52 -07:00
Jing Zhao
a16bfff71b HDFS-7854. Separate class DataStreamer out of DFSOutputStream. Contributed by Li Bo. 2015-03-24 11:06:13 -07:00
Brandon Li
570a83ae80 HDFS-7977. NFS couldn't take percentile intervals. Contributed by Brandon Li 2015-03-24 10:49:16 -07:00
Harsh J
eda02540ce HDFS-7875. Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated. Contributed by Nijel. 2015-03-24 23:06:18 +05:30
Brandon Li
51f1f49374 HDFS-7976. Update NFS user guide for mount option 'sync' to minimize or avoid reordered writes. Contributed by Brandon Li 2015-03-24 10:28:38 -07:00
Andrew Wang
6413d34986 HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu. 2015-03-24 09:07:02 -07:00
Vinayakumar B
c6c396fcd6 HDFS-3325. When configuring 'dfs.namenode.safemode.threshold-pct' to a value greater or equal to 1 there is mismatch in the UI report (Contributed by J.Andreina) 2015-03-24 12:12:01 +05:30
Plamen Jeliazkov
970ee3fc56 HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov. 2015-03-23 23:05:21 -07:00
Andrew Wang
50ee8f4e67 HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu. 2015-03-23 22:00:34 -07:00
Tsz-Wo Nicholas Sze
d7e3c3364e HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula 2015-03-24 13:49:17 +09:00
cnauroth
2c238ae4e0 HDFS-7917. Use file to replace data dirs in test to simulate a disk failure. Contributed by Lei (Eddy) Xu. 2015-03-23 16:29:51 -07:00
Brandon Li
36af4a913c HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li 2015-03-23 10:06:47 -07:00
Kihwal Lee
75ead273be HDFS-6841. Use Time.monotonicNow() wherever applicable instead of Time.now(). Contributed by Vinayakumar B 2015-03-20 14:02:09 -05:00
Jing Zhao
d368d3647a HDFS-7957. Truncate should verify quota before making changes. Contributed by Jing Zhao. 2015-03-20 11:50:24 -07:00
Jing Zhao
a6a5aae472 HDFS-7829. Code clean up for LocatedBlock. Contributed by Takanobu Asanuma. 2015-03-20 10:50:19 -07:00
Yongjun Zhang
15612313f5 HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. 2015-03-20 09:12:42 -07:00
yliu
978ef11f26 HDFS-7962. Remove duplicated logs in BlockManager. (yliu) 2015-03-20 05:29:25 +08:00
yliu
e37ca221bf HDFS-7930. commitBlockSynchronization() does not remove locations. (yliu) 2015-03-19 23:23:19 +08:00
Kihwal Lee
61a4c7fc98 HDFS-7932. Speed up the shutdown of datanode during rolling upgrade. Contributed by Kihwal Lee. 2015-03-19 12:27:03 -05:00
Vinayakumar B
5be5129d93 HDFS.7849. Update documentation for enabling a new feature in rolling upgrade ( Contributed by J.Andreina ) 2015-03-19 19:05:42 +05:30
Kihwal Lee
e79be0ee12 HDFS-7816. Unable to open webhdfs paths with "+". Contributed by Haohui Mai 2015-03-19 08:01:01 -05:00
Vinayakumar B
355e008ffb HDFS-7867. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina) Updated JIRA id. 2015-03-19 12:10:39 +05:30
Vinayakumar B
338b477ff7 HDFS-7869. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina) 2015-03-19 11:59:31 +05:30
Jing Zhao
c7c71cdba5 HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contributed by Jing Zhao. 2015-03-18 18:53:50 -07:00
Colin Patrick Mccabe
43b41f2241 HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zhang via Colin P. McCabe) 2015-03-18 18:48:54 -07:00
Jing Zhao
bee5a6a64a HDFS-7943. Append cannot handle the last block with length greater than the preferred block size. Contributed by Jing Zhao. 2015-03-18 18:40:59 -07:00
Colin Patrick Mccabe
8234fd0e10 HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe) 2015-03-18 18:14:54 -07:00
Haohui Mai
8c40e88d5d HDFS-7945. The WebHdfs system on DN does not honor the length parameter. Contributed by Haohui Mai. 2015-03-18 16:19:46 -07:00
Arpit Agarwal
c239b6d376 HDFS-7914. TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in use. (Contributed by Xiaoyu Yao) 2015-03-18 14:04:53 -07:00
Haohui Mai
f0dea037ff HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei (Eddy) Xu. 2015-03-18 13:33:41 -07:00
Arpit Agarwal
02a67aad65 Fix CHANGES.txt for HDFS-7722. 2015-03-18 12:52:42 -07:00
Arpit Agarwal
e817cedcdc HDFS-7951. Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux. (Contributed by Xiaoyu Yao) 2015-03-18 12:45:46 -07:00
Arpit Agarwal
d462c62755 HDFS-7950. Fix TestFsDatasetImpl#testAddVolumes failure on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:35:30 -07:00
Arpit Agarwal
fdd58aa32f HDFS-7948. TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:26:00 -07:00
Haohui Mai
402817cd9b HDFS-7953. NN Web UI fails to navigate to paths that contain #. Contributed by kanaka kumar avvaru. 2015-03-18 11:08:08 -07:00
Arpit Agarwal
5b322c6a82 HDFS-7946. TestDataNodeVolumeFailureReporting NPE on Windows. (Contributed by Xiaoyu Yao) 2015-03-17 21:34:31 -07:00
Colin Patrick Mccabe
d8846707c5 HDFS-7940. Add tracing to DFSClient#setQuotaByStorageType (Rakesh R via Colin P. McCabe) 2015-03-17 10:47:21 -07:00
Vinayakumar B
018893e81e HDFS-5356. MiniDFSCluster should close all open FileSystems when shutdown() (Contributed by Rakesh R) 2015-03-17 15:32:34 +05:30
yliu
48c2db34ef HDFS-7838. Expose truncate API for libhdfs. (yliu) 2015-03-17 07:22:17 +08:00
Harsh J
046521cd65 HDFS-2360. Ugly stacktrce when quota exceeds. (harsh) 2015-03-17 10:28:17 +05:30
Konstantin V Shvachko
ce5de93a58 HDFS-7886. Fix TestFileTruncate falures. Contributed by Plamen Jeliazkov and Konstantin Shvachko. 2015-03-16 12:54:04 -07:00