Commit Graph

10890 Commits

Author SHA1 Message Date
Jian He
674c7ef649 YARN-3503. Expose disk utilization percentage and bad local and log dir counts in NM metrics. Contributed by Varun Vasudev 2015-04-21 20:57:02 -07:00
Jian He
bdd90110e6 YARN-3494. Expose AM resource limit and usage in CS QueueMetrics. Contributed by Rohith Sharmaks 2015-04-21 20:06:20 -07:00
Wangda Tan
e71d0d87d9 YARN-3410. YARN admin should be able to remove individual application records from RMStateStore. (Rohith Sharmaks via wangda) 2015-04-21 17:51:22 -07:00
Ravi Prakash
cfba355052 HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak) 2015-04-21 16:49:37 -07:00
Steve Loughran
2c14690368 HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. (Larry McCay via stevel) 2015-04-21 22:38:41 +01:00
Gera Shegalov
89ded89e86 MAPREDUCE-6297. Task Id of the failed task in diagnostics should link to the task page. (Siqi Li via gera) 2015-04-21 13:57:23 -07:00
Gera Shegalov
6d2cf9fbbd HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 2015-04-21 13:57:23 -07:00
Gera Shegalov
725eb52ddc MAPREDUCE-6293. Set job classloader on uber-job's LocalContainerLauncher event thread. (Sangjin Lee via gera) 2015-04-21 13:57:22 -07:00
Tsuyoshi Ozawa
105afd5477 YARN-3495. Confusing log generated by FairScheduler. Contributed by Brahma Reddy Battula. 2015-04-22 05:47:59 +09:00
Allen Wittenauer
73ddb6b4f8 HADOOP-11746. rewrite test-patch.sh (aw) 2015-04-21 21:29:45 +01:00
Colin Patrick Mccabe
997408eaac HDFS-8133. Improve readability of deleted block check (Daryn Sharp via Colin P. McCabe) 2015-04-21 11:43:24 -07:00
Arun Suresh
424a00daa0 HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) 2015-04-21 11:31:51 -07:00
Arpit Agarwal
dfc1c4c303 HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:05 -07:00
Vinayakumar B
8ddbb8dd43 HDFS-7993. Provide each Replica details in fsck (Contributed by J.Andreina) 2015-04-21 15:24:49 +05:30
Vinod Kumar Vavilapalli
d52de61544 Set the release date for 2.7.0 2015-04-20 20:16:58 -07:00
Vinayakumar B
ed4137cebf HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B)
Updated CHANGES.TXT for correct version
2015-04-21 07:59:43 +05:30
Wangda Tan
44872b76fc YARN-3463. Integrate OrderingPolicy Framework with CapacityScheduler. (Craig Welch via wangda) 2015-04-20 17:12:32 -07:00
Arpit Agarwal
c92f6f3605 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:42 -07:00
Robert Kanter
d50e8f0928 MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a regression from MR1 (zxu via rkanter) 2015-04-20 14:14:08 -07:00
Jian He
f967fd2f21 YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy. Contributed by Jason Lowe 2015-04-20 10:38:27 -07:00
Vinayakumar B
c17cd4f7c1 HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) 2015-04-20 14:58:04 +05:30
Haohui Mai
5c97db07fb HDFS-8169. Move LocatedBlocks and related classes to hdfs-client. Contributed by Haohui Mai. 2015-04-20 00:36:46 -07:00
Arpit Agarwal
8511d80804 HDFS-8152. Refactoring of lazy persist storage cases. (Arpit Agarwal) 2015-04-19 16:09:06 -07:00
Tsuyoshi Ozawa
5459b241c8 HDFS-8043. NPE in MiniDFSCluster teardown. Contributed by Brahma Reddy Battula. 2015-04-19 18:19:36 +09:00
Tsuyoshi Ozawa
5112477d9e HDFS-7863. Missing description of some methods and parameters in javadoc of FSDirDeleteOp. Contributed by Brahma Reddy Battula. 2015-04-19 18:06:56 +09:00
Jian He
497c86b485 YARN-3136. Fixed a synchronization problem of AbstractYarnScheduler#getTransferredContainers. Contributed by Sunil G 2015-04-18 12:46:37 -07:00
Wangda Tan
f47a5763ac YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda) 2015-04-17 17:22:27 -07:00
Wangda Tan
f65eeb412d YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed. (Jian He via wangda) 2015-04-17 17:11:22 -07:00
Jian He
6779467ab6 YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks 2015-04-17 15:55:34 -07:00
Jian He
d573f09fb9 YARN-2696. Queue sorting in CapacityScheduler should consider node label. Contributed by Wangda Tan 2015-04-17 13:36:59 -07:00
Junping Du
1db355a875 YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong. 2015-04-17 13:18:59 -07:00
Haohui Mai
c6b5203cfd HADOOP-11837. AuthenticationFilter should destroy SignerSecretProvider in Tomcat deployments. Contributed by Bowen Zhang. 2015-04-17 10:59:47 -07:00
Haohui Mai
76e7264e8d HDFS-8165. Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client. Contributed by Haohui Mai. 2015-04-16 22:49:30 -07:00
Jitendra Pandey
369ddc67bd HDFS-8153. Error Message points to wrong parent directory in case of path component name length error. Contributed by Anu Engineer. 2015-04-16 22:13:09 -07:00
Jian He
bb6dde68f1 YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang 2015-04-16 19:43:37 -07:00
Tsz-Wo Nicholas Sze
9595cc003c HDFS-7891. A block placement policy with best rack failure tolerance. Contributed by Walter Su 2015-04-16 18:25:53 -07:00
Akira Ajisaka
4308910eed Revert "HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema"
This reverts commit eb1d4c39e0.
2015-04-16 16:54:01 -05:00
Tsz-Wo Nicholas Sze
75bbcc8bf3 HDFS-8082. Move dfs.client.read.*, dfs.client.short.circuit.*, dfs.client.mmap.* and dfs.client.hedged.read.* conf from DFSConfigKeys to HdfsClientConfigKeys. 2015-04-16 13:22:31 -07:00
Haohui Mai
80a2a12423 HDFS-8135. Remove the deprecated FSConstants class. Contributed by Li Lu. 2015-04-16 11:26:05 -07:00
Akira Ajisaka
1fa8075794 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. 2015-04-16 10:04:09 -05:00
Andrew Wang
2e8ea780a4 HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R. 2015-04-16 07:14:44 -07:00
Jian He
1b89a3e173 YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan 2015-04-15 13:57:06 -07:00
Jian He
b2e6cf607f YARN-3404. Display queue name on application page. Contributed by Ryu Kobayashi 2015-04-15 13:52:50 -07:00
Akira Ajisaka
de0f1700c1 HDFS-8149. The footer of the Web UI "Hadoop, 2014" is old. Contributed by Brahma Reddy Battula. 2015-04-15 15:31:04 -05:00
Jing Zhao
b172d03595 HDFS-7934. Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN. Contributed by J. Andreina. 2015-04-15 13:10:38 -07:00
Jing Zhao
4c097e473b HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao. 2015-04-15 12:37:20 -07:00
Tsuyoshi Ozawa
e48cedc663 YARN-3326. Support RESTful API for getLabelsToNodes. Contributed by Naganarasimha G R. 2015-04-15 14:03:55 -05:00
Arpit Agarwal
9e8309a1b2 HDFS-8144. Split TestLazyPersistFiles into multiple tests. (Arpit Agarwal) 2015-04-15 10:25:04 -07:00
Wangda Tan
5004e75332 YARN-3318. Create Initial OrderingPolicy Framework and FifoOrderingPolicy. (Craig Welch via wangda) 2015-04-15 09:56:32 -07:00
Jing Zhao
fddd55279d HDFS-8127. NameNode Failover during HA upgrade can cause DataNode to finalize upgrade. Contributed by Jing Zhao. 2015-04-14 15:05:23 -07:00