big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,758 Commits 2 Branches 2 Tags 264 MiB
a0b5a0a419
Commit Graph

11758 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jing Zhao
c8bca62718 HDFS-8809. HDFS fsck reports under construction blocks as CORRUPT. Contributed by Jing Zhao. 2015-08-20 16:31:24 -07:00
Colin Patrick Mccabe
7642f64c24 HDFS-8922. Link the native_mini_dfs test library with libdl, since IBM Java requires it (Ayappan via Colin P. McCabe) 2015-08-20 13:57:32 -07:00
Wangda Tan
fc07464d1a YARN-2923. Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup. (Naganarasimha G R) 2015-08-20 11:51:03 -07:00
Yongjun Zhang
0bc15cb6e6 HDFS-8828. Utilize Snapshot diff report to build diff copy list in distcp. (Yufei Gu via Yongjun Zhang) 2015-08-20 08:02:54 -07:00
yliu
5e8fe89437 HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu) 2015-08-20 20:15:03 +08:00
yliu
80a29906bc HDFS-8884. Fail-fast check in BlockPlacementPolicyDefault#chooseTarget. (yliu) 2015-08-20 20:07:18 +08:00
Akira Ajisaka
36b1a1e784 HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki. 2015-08-20 11:09:45 +09:00
Robert Kanter
1e06299df8 HADOOP-12317. Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST (adhoot via rkanter) 2015-08-19 19:00:51 -07:00
Jing Zhao
4e14f7982a HDFS-8917. Cleanup BlockInfoUnderConstruction from comments and tests. Contributed by Zhe Zhang. 2015-08-19 15:11:37 -07:00
Haohui Mai
3aac4758b0 HDFS-8803. Move DfsClientConf to hdfs-client. Contributed by Mingliang Liu. 2015-08-19 11:28:05 -07:00
Jing Zhao
f61120d964 HDFS-8867. Enable optimized block reports. Contributed by Daryn Sharp. 2015-08-19 10:36:56 -07:00
Arpit Agarwal
9c3571ea60 HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer) 2015-08-19 09:42:35 -07:00
yliu
2da5aaab33 HDFS-8908. TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode. (Tsz Wo Nicholas Sze via yliu) 2015-08-19 21:55:43 +08:00
Xuan
22dc5fc209 YARN-4028. AppBlock page key update and diagnostics value null on 
recovery. Contributed by Bibin A Chundatt
 2015-08-18 22:53:03 -07:00
Tsz-Wo Nicholas Sze
7ecbfd44aa HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes. 2015-08-18 19:25:50 -07:00
Chris Douglas
30e342a5d3 HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan 2015-08-18 17:32:48 -07:00
Benoy Antony
71aedfabf3 hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu. 2015-08-18 13:43:34 -07:00
Zhihai Xu
14215c8ef8 YARN-4057. If ContainersMonitor is not enabled, only print related log info one time. Contributed by Jun Gong. 2015-08-18 11:36:02 -07:00
Zhihai Xu
3a76a010b8 YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao. 2015-08-18 10:36:40 -07:00
Akira Ajisaka
fc509f66d8 HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S. 2015-08-18 23:31:52 +09:00
yliu
71566e2382 HDFS-8862. BlockManager#excessReplicateMap should use a HashMap. (yliu) 2015-08-18 09:23:06 +08:00
Tsz-Wo Nicholas Sze
51a00964da HDFS-8278. When computing max-size-to-move in Balancer, count only the storage with remaining >= default block size. 2015-08-17 17:55:25 -07:00
Andrew Wang
eee4d716b4 HDFS-8895. Remove deprecated BlockStorageLocation APIs. 2015-08-17 17:40:37 -07:00
Arpit Agarwal
a88f31ebf3 HDFS-8880. NameNode metrics logging. (Arpit Agarwal) 2015-08-17 16:55:46 -07:00
Colin Patrick Mccabe
ec183faadc HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe) 2015-08-17 15:25:29 -07:00
Colin Patrick Mccabe
c77bd6af16 HDFS-8792. BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory (Yi Liu via Colin P. McCabe) 2015-08-17 12:00:45 -07:00
Haohui Mai
e535e0f05b HDFS-8801. Convert BlockInfoUnderConstruction as a feature. Contributed by Jing Zhao. 2015-08-17 11:28:28 -07:00
Haohui Mai
456e901a4c HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai. 2015-08-17 11:04:00 -07:00
Andrew Wang
2e7b7e2cda HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging. 2015-08-17 10:17:06 -07:00
Xiaoyu Yao
a7862d5fe4 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer. 2015-08-17 10:15:56 -07:00
Karthik Kambatla
13604bd5f1 YARN-4055. Report node resource utilization in heartbeat. (Inigo Goiri via kasha) 2015-08-16 15:08:53 -07:00
Karthik Kambatla
def12933b3 YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha) 2015-08-16 06:24:16 -07:00
Karthik Kambatla
8dfec7a197 MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha) 2015-08-15 00:52:11 -07:00
Jing Zhao
dc7a061668 HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang. 2015-08-14 14:42:43 -07:00
Tsz-Wo Nicholas Sze
2bc0a4f299 HDFS-8824. Do not use small blocks for balancing the cluster. 2015-08-14 13:03:19 -07:00
Xiaoyu Yao
1569228ec9 HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao) 2015-08-14 12:34:31 -07:00
Karthik Kambatla
27d24f96ab MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) 2015-08-14 12:29:50 -07:00
Vinayakumar B
84bf71295a HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 
Moved to 2.6.1
 2015-08-14 16:13:30 +05:30
Vinayakumar B
fc508b41a9 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 
Moved to 2.6.1
 2015-08-14 15:55:29 +05:30
Vinayakumar B
05ed69058f HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
Moved to 2.6.1
 2015-08-14 12:53:46 +05:30
Vinayakumar B
08bd4edf40 HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang) 
Moved to 2.6.1
 2015-08-14 12:38:00 +05:30
Vinayakumar B
e7aa81394d HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1
 2015-08-14 12:23:51 +05:30
Vinayakumar B
24a11e3996 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
 2015-08-14 12:09:56 +05:30
Vinayakumar B
fa2641143c HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo. 
Moved CHANGES.txt entry to 2.6.1
 2015-08-14 11:45:43 +05:30
Vinayakumar B
f2b4bc9b6a HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe) 
Moved CHANGES.txt entry to 2.6.1
 2015-08-14 11:37:39 +05:30
Vinayakumar B
d25cb8fe12 HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne. 
Moved CHANGES.TXT entry to 2.6.1
 2015-08-14 11:23:51 +05:30
Arpit Agarwal
6b1cefc561 HADOOP-12322. Typos in rpcmetrics.java. (Contributed by Anu Engineer) 2015-08-13 21:17:30 -07:00
Jian He
0a030546e2 YARN-3987. Send AM container completed msg to NM once AM finishes. Contributed by sandflee 2015-08-13 16:22:53 -07:00
Jian He
7a445fcfab YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe 2015-08-13 16:02:57 -07:00
Jian He
38aed1a94e YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong 2015-08-13 14:46:08 -07:00