big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,441 Commits 2 Branches 2 Tags 264 MiB
96649c38f9
Commit Graph

2754 Commits

Author SHA1 Message Date
Haohui Mai
96649c38f9 HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-04-02 11:36:51 -07:00
Tsz-Wo Nicholas Sze
9ed43f2189 HDFS-7888. Change DFSOutputStream and DataStreamer for convenience of subclassing. Contributed by Li Bo 2015-04-02 10:59:26 -07:00
Vinayakumar B
867d5d2675 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 2015-04-02 08:12:00 +05:30
Haohui Mai
6ccf4fbf8a HDFS-8008. Support client-side back off when the datanodes are congested. Contributed by Haohui Mai. 2015-04-01 16:54:46 -07:00
Colin Patrick Mccabe
3c7adaaf35 HDFS-7922. ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors (Rakesh R via Colin P. McCabe) 2015-04-01 16:02:39 -07:00
Colin Patrick Mccabe
c94d594a57 HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe) 2015-04-01 14:10:10 -07:00
Andrew Wang
ed72daa5df HDFS-7978. Add LOG.isDebugEnabled() guard for some LOG.debug(..). Contributed by Walter Su. 2015-04-01 12:54:28 -07:00
Haohui Mai
53471d462c HDFS-8009. Signal congestion on the DataNode. Contributed by Haohui Mai. 2015-04-01 10:56:53 -07:00
Akira Ajisaka
18a91fe4df HDFS-6945. BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed. (aajisaka) 2015-04-01 09:07:28 +09:00
yliu
3df61f303a HDFS-7997. The first non-existing xattr should also throw IOException. (zhouyingchao via yliu) 2015-03-31 21:17:44 +08:00
Arpit Agarwal
85dc3c14b2 HDFS-7944. Minor cleanup of BlockPoolManager#getAllNamenodeThreads. (Arpit Agarwal) 2015-03-30 21:24:51 -07:00
Harsh J
cce66ba3c9 HDFS-3918. EditLogTailer shouldn't log WARN when other node is in standby mode. Contributed by Todd Lipcon. 2015-03-31 08:04:18 +05:30
Arpit Agarwal
1a495fbb48 HDFS-7645. Rolling upgrade is restoring blocks from trash multiple times (Contributed by Vinayakumar B and Keisuke Ogiwara) 2015-03-30 15:25:16 -07:00
Haohui Mai
b80457158d HDFS-7748. Separate ECN flags from the Status in the DataTransferPipelineAck. Contributed by Anu Engineer and Haohui Mai. 2015-03-30 11:59:21 -07:00
Colin Patrick Mccabe
1feb9569f3 HDFS-7261. storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState() (Brahma Reddy Battula via Colin P. McCabe) 2015-03-30 10:46:21 -07:00
Kihwal Lee
04ee18ed48 HDFS-7742. Favoring decommissioning node for replication can cause a block to stay 
underreplicated for long periods. Contributed by Nathan Roberts.
 2015-03-30 10:10:11 -05:00
Harsh J
ae3e8c61ff HDFS-4396. Add START_MSG/SHUTDOWN_MSG for ZKFC. Contributed by Liang Xie. 2015-03-30 15:21:18 +05:30
Vinayakumar B
1ed9fb7664 HDFS-7890. Improve information on Top users for metrics in RollingWindowsManager and lower log level (Contributed by J.Andreina) 2015-03-30 10:02:48 +05:30
Harsh J
3d9132d434 HDFS-7501. TransactionsSinceLastCheckpoint can be negative on SBNs. Contributed by Gautam Gopalakrishnan. 2015-03-29 00:45:01 +05:30
Arun Suresh
e97f8e44af HDFS-8004. Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone. (awang via asuresh) 2015-03-27 19:23:45 -07:00
Kihwal Lee
60882ab26d HDFS-7990. IBR delete ack should not be delayed. Contributed by Daryn Sharp. 2015-03-27 09:05:17 -05:00
Colin Patrick Mccabe
61df1b27a7 HDFS-7410. Support CreateFlags with append() to support hsync() for appending streams (Vinayakumar B via Colin P. McCabe) 2015-03-26 13:21:09 -07:00
Arpit Agarwal
3d0708bdb0 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:24:11 -07:00
Kihwal Lee
fc1031af74 HDFS-7928. Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy. Contributed by Rushabh Shah. 2015-03-25 14:42:59 -05:00
Jing Zhao
5e21e4ca37 HDFS-6353. Check and make checkpoint before stopping the NameNode. Contributed by Jing Zhao. 2015-03-25 10:38:00 -07:00
Haohui Mai
80278a5f85 HDFS-7985. WebHDFS should be always enabled. Contributed by Li Lu. 2015-03-24 21:55:56 -07:00
Jitendra Pandey
53a28afe29 HDFS-6826. Plugin interface to enable delegation of HDFS authorization assertions. Contributed by Arun Suresh. 2015-03-24 16:02:40 -07:00
Jing Zhao
a16bfff71b HDFS-7854. Separate class DataStreamer out of DFSOutputStream. Contributed by Li Bo. 2015-03-24 11:06:13 -07:00
Harsh J
eda02540ce HDFS-7875. Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated. Contributed by Nijel. 2015-03-24 23:06:18 +05:30
Andrew Wang
6413d34986 HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu. 2015-03-24 09:07:02 -07:00
Vinayakumar B
c6c396fcd6 HDFS-3325. When configuring 'dfs.namenode.safemode.threshold-pct' to a value greater or equal to 1 there is mismatch in the UI report (Contributed by J.Andreina) 2015-03-24 12:12:01 +05:30
Plamen Jeliazkov
970ee3fc56 HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov. 2015-03-23 23:05:21 -07:00
Andrew Wang
50ee8f4e67 HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu. 2015-03-23 22:00:34 -07:00
Tsz-Wo Nicholas Sze
d7e3c3364e HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula 2015-03-24 13:49:17 +09:00
Kihwal Lee
75ead273be HDFS-6841. Use Time.monotonicNow() wherever applicable instead of Time.now(). Contributed by Vinayakumar B 2015-03-20 14:02:09 -05:00
Jing Zhao
d368d3647a HDFS-7957. Truncate should verify quota before making changes. Contributed by Jing Zhao. 2015-03-20 11:50:24 -07:00
Jing Zhao
a6a5aae472 HDFS-7829. Code clean up for LocatedBlock. Contributed by Takanobu Asanuma. 2015-03-20 10:50:19 -07:00
Yongjun Zhang
15612313f5 HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. 2015-03-20 09:12:42 -07:00
yliu
978ef11f26 HDFS-7962. Remove duplicated logs in BlockManager. (yliu) 2015-03-20 05:29:25 +08:00
yliu
e37ca221bf HDFS-7930. commitBlockSynchronization() does not remove locations. (yliu) 2015-03-19 23:23:19 +08:00
Kihwal Lee
61a4c7fc98 HDFS-7932. Speed up the shutdown of datanode during rolling upgrade. Contributed by Kihwal Lee. 2015-03-19 12:27:03 -05:00
Kihwal Lee
e79be0ee12 HDFS-7816. Unable to open webhdfs paths with "+". Contributed by Haohui Mai 2015-03-19 08:01:01 -05:00
Vinayakumar B
338b477ff7 HDFS-7869. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina) 2015-03-19 11:59:31 +05:30
Jing Zhao
c7c71cdba5 HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contributed by Jing Zhao. 2015-03-18 18:53:50 -07:00
Colin Patrick Mccabe
43b41f2241 HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zhang via Colin P. McCabe) 2015-03-18 18:48:54 -07:00
Jing Zhao
bee5a6a64a HDFS-7943. Append cannot handle the last block with length greater than the preferred block size. Contributed by Jing Zhao. 2015-03-18 18:40:59 -07:00
Colin Patrick Mccabe
8234fd0e10 HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe) 2015-03-18 18:14:54 -07:00
Haohui Mai
8c40e88d5d HDFS-7945. The WebHdfs system on DN does not honor the length parameter. Contributed by Haohui Mai. 2015-03-18 16:19:46 -07:00
Haohui Mai
f0dea037ff HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei (Eddy) Xu. 2015-03-18 13:33:41 -07:00
Colin Patrick Mccabe
d8846707c5 HDFS-7940. Add tracing to DFSClient#setQuotaByStorageType (Rakesh R via Colin P. McCabe) 2015-03-17 10:47:21 -07:00