big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
19,164 Commits 2 Branches 2 Tags 264 MiB
88cbe57c06
Commit Graph

19164 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Konstantinos Karanasos
3b34fca4b5 YARN-8113. Update placement constraints doc with application namespaces and inter-app constraints. Contributed by Weiwei Yang. 2018-05-02 11:49:56 -07:00
Eric Yang
883f68222a YARN-8209. Fixed NPE in Yarn Service deletion. 
Contributed by Eric Badger
 2018-05-02 14:33:31 -04:00
James Clampffer
19ae588fde HDFS-11807. libhdfs++: Get minidfscluster tests running under valgrind. Contributed by Anatoli Shein. 2018-05-02 11:49:12 -04:00
Steve Loughran
fe649bb305 HADOOP-12071. conftest is not documented. 
Contributed by Kengo Seki.
 2018-05-02 13:33:56 +01:00
Weiwei Yang
251f528814 YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang. 2018-05-02 17:54:46 +08:00
Yiqun Lin
3265b55119
YARN-6385. Fix checkstyle warnings in TestFileSystemApplicationHistoryStore 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-05-02 18:14:02 +09:00
Jason Lowe
e07156e8b0
HADOOP-15406. hadoop-nfs dependencies for mockito and junit are not test scope 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-05-02 17:30:10 +09:00
BELUGA BEHR
33768724ff
HADOOP-15377. Improve debug messages in MetricsConfig.java 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-05-02 17:09:22 +09:00
Bibin A Chundatt
1a95a4524a
MAPREDUCE-7073. Optimize TokenCache#obtainTokensForNamenodesInternal 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-05-02 16:14:28 +09:00
Yiqun Lin
37269261d1 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri. 2018-05-02 14:49:39 +08:00
Steve Loughran
8f42dafcf8 HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong 
Contributed by Ajay Kumar
 2018-05-01 22:32:40 +01:00
Jason Lowe
68c6ec719d MAPREDUCE-7086. Add config to allow FileInputFormat to ignore directories when recursive=false. Contributed by Sergey Shelukhin 2018-05-01 16:19:53 -05:00
Eric Yang
24eeea8b18 YARN-7799. Improved YARN service jar file handling. 
Contributed by Billie Rinaldi
 2018-05-01 16:46:34 -04:00
Inigo Goiri
9e2cfb2d3f HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang. 2018-05-01 08:12:46 -07:00
Billie Rinaldi
4e1382aca4 YARN-2674. Fix distributed shell AM container relaunch during RM work preserving restart. Contributed by Shane Kumpf 2018-05-01 07:27:47 -07:00
Sunil G
d6139c5106 YARN-8187. [UI2] Individual Node page does not contain breadcrumb trail. Contributed by Zian Chen. 2018-05-01 14:01:34 +05:30
Anu Engineer
f0c3dc4cf4 HDDS-13. Refactor StorageContainerManager into seperate RPC endpoints. Contributed by Anu Engineer. 2018-04-30 21:41:10 -07:00
Weiwei Yang
2d319e3793 YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang. 2018-05-01 09:47:10 +08:00
Eric Yang
a966ec6e23 YARN-8228. Added hostname length check for docker container. 
Contributed by Shane Kumpf
 2018-04-30 19:12:53 -04:00
Aaron Fabbri
919865a34b
HADOOP-15239 S3ABlockOutputStream.flush() be no-op when stream closed. Contributed by Gabor Bota. 2018-04-30 16:02:57 -07:00
Inigo Goiri
fc074a359c HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak. 2018-04-30 13:28:33 -07:00
Konstantinos Karanasos
9b09555451 YARN-8195. Fix constraint cardinality check in the presence of multiple target allocation tags. Contributed by Weiwei Yang. 2018-04-30 11:54:30 -07:00
Anu Engineer
3d43474f75 HDDS-11. Fix findbugs exclude rules for ozone and hdds projects. Contributed by Elek, Marton. 2018-04-30 09:20:58 -07:00
Inigo Goiri
eb7fe1d588 HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang. 2018-04-28 09:05:30 -07:00
Weiwei Yang
2c95eb8111 YARN-8225. YARN precommit build failing in TestPlacementConstraintTransformations. Contributed by Shane Kumpf. 2018-04-28 17:37:37 +08:00
Inigo Goiri
484440602c HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S. 2018-04-27 16:28:17 -07:00
Inigo Goiri
f469628bba HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari. 2018-04-27 15:13:47 -07:00
Wangda Tan
92c5331423 YARN-8005. Add unit tests for queue priority with dominant resource calculator. (Zian Chen via wangda) 
Change-Id: I17a645f20869a1e5d86fa7a325c93fec908b91dc
 2018-04-27 13:08:43 -07:00
Wangda Tan
b1833d9ba2 YARN-8210. AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs. (Suma Shivaprasad via wangda) 
Change-Id: I70edd6e301fd5e78d479e1882aedc9332a0827aa
 2018-04-27 13:07:38 -07:00
Rohith Sharma K S
ef3ecc308d YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G. 2018-04-27 22:58:10 +05:30
Wei-Chiu Chuang
bff3d7b0cf HADOOP-15382. Log kinit output in credential renewal thread. Contributed by Gabor Bota. 2018-04-27 10:05:55 -07:00
Eric Yang
24a5ccbf4b YARN-7781. Update YARN service documentation. 
Contributed by Gour Saha
 2018-04-27 12:38:30 -04:00
Eric Yang
14b47990af YARN-8204. Added a flag to disable YARN service upgrade. 
Contributed by Chandni Singh
 2018-04-27 12:24:43 -04:00
Billie Rinaldi
9ab3f97089 YARN-8211. Yarn registry dns log finds BufferUnderflowException on port ping. Contributed by Eric Yang 2018-04-27 07:58:43 -07:00
Billie Rinaldi
914d6b5cb1 YARN-8208. Add log statement for Docker client configuration file at INFO level. Contributed by Yesha Vora 2018-04-27 06:10:32 -07:00
Ewan Higgs
84ecfe3ceb
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-04-27 19:21:37 +09:00
Weiwei Yang
ba2db39c65 YARN-8152. Add chart in SLS to illustrate the throughput of the scheduler. Contributed by Tao Yang. 2018-04-27 15:36:21 +08:00
Sunil G
71220d218d YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen. 2018-04-27 10:42:30 +05:30
Sunil G
7fc09c4f72 YARN-8215. ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM. Contributed by Rohith Sharma K S. 2018-04-27 10:33:42 +05:30
Sunil G
1634de0fc1 YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S. 2018-04-27 10:26:57 +05:30
Aaron Fabbri
7d8bcf534a
HADOOP-13756 LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash. (Gabor Bota) 2018-04-26 20:41:29 -07:00
Yiqun Lin
0a293de00d HDFS-13499. RBF: Show disabled name services in the UI. Contributed by Inigo Goiri. 2018-04-27 10:38:15 +08:00
Eric Yang
93979db840 YARN-8122. Added component health monitoring for YARN service. 
Contributed by Gour Saha
 2018-04-26 19:17:32 -04:00
Inigo Goiri
09c9cf1d43 HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li. 2018-04-26 13:54:40 -07:00
Billie Rinaldi
598483e496 YARN-8140. Improve log message when launch cmd is ran for stopped yarn service. Contributed by Eric Yang 2018-04-26 13:54:40 -07:00
Eric Yang
4a7369b095 YARN-7939. Added support to upgrade a component instance. 
Contributed by Chandni Singh
 2018-04-26 13:54:40 -07:00
Sunil G
83e60cd2db MAPREDUCE-7042. Killed MR job data does not move to mapreduce.jobhistory.done-dir when ATS v2 is enabled. Contributed by Rohith Sharma K S. 2018-04-26 13:54:40 -07:00
Wangda Tan
2a0fa50f9d YARN-8193. YARN RM hangs abruptly (stops allocating resources) when running successive applications. (Zian Chen via wangda) 
Change-Id: Ia83dd2499ee9000b9e09ae5a932f21a13c0ddee6
 2018-04-26 13:54:40 -07:00
Wangda Tan
13d389bf51 HADOOP-15411. AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator. (Suma Shivaprasad via wangda) 
Change-Id: Ia19458a43aceb4ffdb1e8eccc519655235d92ba9
 2018-04-26 13:54:40 -07:00
Lei Xu
a8e428b2dc HDFS-13468. Add erasure coding metrics into ReadStatistics. (Contributed by Lei (Eddy) Xu) 2018-04-26 13:54:40 -07:00