big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,184 Commits 2 Branches 2 Tags 264 MiB
b52fd05d42
Commit Graph

22184 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Siyao Meng
93f2283a69 HADOOP-16289. Allow extra jsvc startup option in hadoop_start_secure_daemon in hadoop-functions.sh. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-05-06 15:47:33 -07:00
Haibo Chen
597fa47ad1 YARN-9529. Log correct cpu controller path on error while initializing CGroups. (Contributed by Jonathan Hung) 2019-05-06 11:56:22 -07:00
Márton Elek
fb7c1cad0e
Revert "HDDS-1384. TestBlockOutputStreamWithFailures is failing" 
This reverts commit dead9b4049.
 2019-05-06 20:17:00 +02:00
Weiwei Yang
12b7059ddc YARN-9440. Improve diagnostics for scheduler and app activities. Contributed by Tao Yang. 2019-05-06 20:00:15 +08:00
Siddharth
1d70c8ca0f HDDS-1464. Client should have different retry policies for different exceptions. (#785) 2019-05-05 09:21:15 -07:00
Surendra Singh Lilhore
69b903bbd8 HDFS-14372. NPE while DN is shutting down. Contributed by lujie. 2019-05-05 16:33:52 +05:30
Surendra Singh Lilhore
e424392a62 HDFS-14438. Fix typo in OfflineEditsVisitorFactory. Contributed by bianqi. 2019-05-05 13:38:09 +05:30
Giovanni Matteo Fumarola
d331a2a0c2 YARN-9528. Federation RMs starting up at the same time can give duplicate application IDs. Contributed by Young Chen. 2019-05-03 15:05:17 -07:00
avijayanhwx
f194540520 HDDS-1448 : RatisPipelineProvider should only consider open pipeline while excluding dn for pipeline allocation. (#786) 2019-05-04 00:19:00 +05:30
Chen Liang
1d59cc490c HADOOP-16292. Refactor checkTrustAndSend in SaslDataTransferClient to make it cleaner. Contributed by Sherwood Zheng. 2019-05-03 10:14:17 -07:00
Vinayakumar B
f1875b205e HADOOP-16059. Use SASL Factories Cache to Improve Performance. Contributed by Ayush Saxena. 2019-05-03 11:22:14 +05:30
Shweta
d6b7609c96 HDFS-14453. Improve Bad Sequence Number Error Message. Contributed by Shweta. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-05-02 14:25:02 -07:00
Siddharth
1df679985b HDDS-1473. DataNode ID file should be human readable. (#781) 2019-05-02 13:59:14 -07:00
Giovanni Matteo Fumarola
7a3188d054 HADOOP-16282. Avoid FileStream to improve performance. Contributed by Ayush Saxena. 2019-05-02 12:58:42 -07:00
Eric E Payne
b094b94d43 YARN-9285: RM UI progress column is of wrong type. Contributed by Ahmed Hussein. 2019-05-02 19:39:26 +00:00
Inigo Goiri
865c328930 HDFS-14460. DFSUtil#getNamenodeWebAddr should return HTTPS address based on policy configured. Contributed by CR Hota. 2019-05-02 10:09:21 -07:00
Márton Elek
6a427456eb
HADOOP-16183. Use latest Yetus to support ozone specific build process 
Closes #599
 2019-05-02 16:48:30 +02:00
Bharat Viswanadham
4605db369e
HDDS-1482. Use strongly typed codec implementations for the S3Table 
Closes #789
 2019-05-02 13:56:30 +02:00
Márton Elek
e2f0f72677
HDDS-1469. Generate default configuration fragments based on annotations 
Closes #773
 2019-05-02 12:14:43 +02:00
Vivek Ratnavel Subramanian
3cb1d09b2e
HDDS-1479. Update S3.md documentation 
Closes #791
 2019-05-02 11:49:37 +02:00
Márton Elek
a2887f5c23
HDDS-1468. Inject configuration values to Java objects 
Closes #772
 2019-05-02 11:35:01 +02:00
Márton Elek
f1673b0db1
HDDS-1478. Provide k8s resources files for prometheus and performance tests 
Closes #783
 2019-05-02 11:23:44 +02:00
Márton Elek
2ab318b603
HDDS-1412. Provide example k8s deployment files as part of the release package 
Closes #719
 2019-05-02 11:18:54 +02:00
dineshchitlangia
f682a171f5 HDDS-1483. Fix getMultipartKey javadoc. (#790) 2019-05-01 21:51:11 -07:00
Siyao Meng
7cb46f035a HDFS-14463. Add Log Level link under NameNode and DataNode Web UI Utilities dropdown. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-05-01 16:48:44 -07:00
Sahil Takiar
4877f0aa51 HDFS-3246: pRead equivalent for direct read path (#597) 
HDFS-3246: pRead equivalent for direct read path

Contributed by Sahil Takiar
 2019-04-30 14:52:16 -07:00
Eric Yang
accb811e57 YARN-6929. Improved partition algorithm for yarn remote-app-log-dir. 
Contributed by Prabhu Joseph
 2019-04-30 17:04:59 -04:00
Márton Elek
dead9b4049
HDDS-1384. TestBlockOutputStreamWithFailures is failing 
Closes #750
 2019-04-30 14:27:39 +02:00
Ben Roling
0af4011580
HADOOP-16221. S3Guard: add option to fail operation on metadata write failure. 2019-04-30 11:53:26 +01:00
Zhankun Tang
7fbaa7d66f YARN-9476. [YARN-9473] Create unit tests for VE plugin. Contributed by Peter Bacsko. 2019-04-30 11:06:44 +08:00
Zhankun Tang
24f218aef8 SUBMARINE-64. Improve TonY runtime's document. Contributed by Keqiu Hu. 2019-04-30 10:54:25 +08:00
Ajay Kumar
382a962d8d
Revert "HDDS-973. HDDS/Ozone fail to build on Windows." 
This reverts commit 5dae1a0c66.
 2019-04-29 19:46:20 -07:00
Arpit Agarwal
4b4200f1f8
HDFS-13677. Dynamic refresh Disk configuration results in overwriting VolumeMap. Contributed by xuzq. 2019-04-29 14:49:35 -07:00
Ajay Yadav
95790bb7e5
HDDS-1430. NPE if secure ozone if KMS uri is not defined. Contributed by Ajay Kumar. (#752) 2019-04-29 14:07:23 -07:00
Elek, Márton
59816dff94 HDDS-1462. Fix content and format of Ozone documentation. Contributed by Elek, Marton. (#767) 2019-04-29 13:28:19 -07:00
Siddharth
5bca062d0e HDDS-1476. Fix logIfNeeded logic in EndPointStateMachine. (#779) 2019-04-29 12:05:38 -07:00
Xiaoyu Yao
a96d16a843
HDDS-1455. Inconsistent naming convention with Ozone Kerberos configuration. Contributed by Xiaoyu Yao. (#762) 2019-04-29 11:18:11 -07:00
Ajay Yadav
dbce729b24 HDDS-1472. Add retry to kinit command in smoketests. Contributed by Ajay Kumar. (#778) 2019-04-29 07:46:01 -07:00
Da Zhou
1cef194a28
HADOOP-16242. ABFS: add bufferpool to AbfsOutputStream. 
Contributed by Da Zhou.
 2019-04-29 13:27:28 +01:00
Ajay Yadav
b434f558ca
HDDS-1471. Update ratis dependency to 0.3.0. Contributed by Ajay Kumar. (#777) 2019-04-28 20:57:59 -07:00
Bharat Viswanadham
43b2a4b77b
HDDS-1456. Stop the datanode, when any datanode statemachine state is… (#769) 2019-04-26 14:25:34 -07:00
Hanisha Koneru
37582705fa
HDDS-1403. KeyOutputStream writes fails after max retries while writing to a closed container (#753) 2019-04-26 10:39:03 -07:00
Lokesh Jain
556eafd01a
HDDS-1460: Add the optmizations of HDDS-1300 to BasicOzoneFileSystem (#765) 2019-04-26 17:29:50 +05:30
Siddharth Wagle
c35abcd831
HDDS-999. Make the DNS resolution in OzoneManager more resilient 
Closes #758
 2019-04-26 12:38:24 +02:00
Eric Badger
79d3d35398 YARN-9486. Docker container exited with failure does not get clean up correctly. Contributed by Eric Yang 2019-04-26 01:21:28 +00:00
Zhankun Tang
b5dcf64f97 SUBMARINE-44. Upgrade Docker image's tensorflow version to 1.13.1. Contributed by Zac Zhou. 2019-04-25 17:58:26 +08:00
Zhankun Tang
0b3d41bdee SUBMARINE-54. Add test coverage for YarnServiceJobSubmitter and make it ready for extension for PyTorch. Contributed by Szilard Nemeth. 2019-04-25 12:52:24 +08:00
Akira Ajisaka
afe6613ee6
MAPREDUCE-7200. Remove stale eclipse templates. Contributed by Wanqiang Ji. 2019-04-25 11:18:39 +09:00
Sean Mackrory
a703dae25e HADOOP-16222. Fix new deprecations after guava 27.0 update in trunk. Contributed by Gabor Bota. 2019-04-24 10:39:00 -06:00
Ben Roling
e1c5ddf2aa
HADOOP-16252. Add prefix to dynamo tables in tests. 
Contributed by Ben Roling.
 2019-04-24 14:55:58 +01:00