big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,208 Commits 2 Branches 2 Tags 264 MiB
cbae241320
Commit Graph

22208 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anu Engineer
101d5b5f86 HDFS-14234. Limit WebHDFS to specifc user, host, directory triples. 
Contributed by Clay B.
 2019-06-10 17:55:16 -07:00
He Xiaoqiao
bd46bdf9f9 HDFS-14553. Make queue size of BlockReportProcessingThread configurable. Contributed by He Xiaoqiao. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-10 17:21:52 -07:00
Suma Shivaprasad
9191e08f0a YARN-9569. Auto-created leaf queues do not honor cluster-wide min/max memory/vcores. Contributed by Craig Condit. 2019-06-10 14:33:24 -07:00
Wei-Chiu Chuang
0d160a0ba8 HDFS-10210. Remove the defunct startKdc profile from hdfs. Contributed by Wei-Chiu Chuang, Akira Ajisaka. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: Akira Ajisaka <aajisaka@apache.org>
 2019-06-10 14:13:53 -07:00
Hanisha Koneru
7217494f40 HDFS-10659. Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory. Contributed by star, Hanisha Koneru. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-10 13:45:37 -07:00
Adam Antal
e94e643584 YARN-9471. Cleanup in TestLogAggregationIndexFileController. Contributed by Adam Antal. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-10 12:18:15 -07:00
Shweta Yakkali
d6d95d2686 HDFS-14494. Move Server logging of StatedId inside receiveRequestState(). Contributed by Shweta Yakkali. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-10 10:23:18 -07:00
Shweta Yakkali
fcfe7a3cc0 HDDS-1655. Redundant toString() call for metaDataPath in KeyValueContainerCheck (#932) 2019-06-08 22:12:29 -07:00
Ajay Yadav
9deac3b6bf HDDS-1657. Fix parallelStream usage in volume and key native acl. Contributed by Ajay Kumar. (#926) 2019-06-07 21:47:14 -07:00
Elek, Márton
46b23c11b0 HDDS-1636. Tracing id is not propagated via async datanode grpc call (#895) 2019-06-07 20:40:32 -07:00
Erik Krogen
76b94c274f HADOOP-16345. Fix a potential NPE when instantiating FairCallQueue metrics. Contributed by Erik Krogen. 2019-06-07 14:20:44 -07:00
Steve Loughran
4e38dafde4
HADOOP-15563. S3Guard to support creating on-demand DDB tables. 
Contributed by Steve Loughran

Change-Id: I2262b5b9f52e42ded8ed6f50fd39756f96e77087
 2019-06-07 18:26:10 +01:00
S O'Donnell
85479577da
HDDS-1622. Use picocli for StorageContainerManager 
Closes #918
 2019-06-07 17:50:57 +02:00
Huan-Ping Su
14552d19e3
HADOOP-16344. Make DurationInfo public unstable. 
Second attempt: imports fixed up.

Contributed by Huan-Ping Su and Kai Xie.

Change-Id: Ib2a85dd4b2d12b840692cc854cc53ddb3bdde7d5
 2019-06-07 12:55:17 +01:00
Hanisha Koneru
a91d24fea4
HDDS-1496. Support partial chunk reads and checksum verification (#804) 2019-06-06 19:44:40 -07:00
Hanisha Koneru
0b115b60b0 HDDS-1371. OMSnapshotProvider to download DB checkpoint from leader OM. (#703) 2019-06-06 19:42:34 -07:00
Akira Ajisaka
3ea4f41d9f
MAPREDUCE-6794. Remove unused properties from TTConfig.java 2019-06-07 10:27:41 +09:00
Eric Yang
cb9bc6e64c YARN-9581. Fixed yarn logs cli to access RM2. 
Contributed by Prabhu Joseph
 2019-06-06 16:41:58 -04:00
Sammi Chen
8ca58efeec HDDS-1490. Support configurable container placement policy through 'o… (#903) 2019-06-06 12:14:47 -07:00
Inigo Goiri
e1dfc060f8 HDFS-14486. The exception classes in some throw statements do not accurately describe why they are thrown. Contributed by Ayush Saxena. 2019-06-06 11:59:53 -07:00
Xiaoyu Yao
c7e6f076df HDDS-1650. Fix Ozone tests leaking volume checker thread. Contributed by Xiaoyu Yao. (#915) 2019-06-06 23:50:04 +05:30
Xiaoyu Yao
76c0183ae3 HDDS-1652. HddsDispatcher should not shutdown volumeSet. Contributed by Xiaoyu Yao. (#916) 2019-06-06 23:47:59 +05:30
avijayanhwx
fe069570d8 HDDS-1647 : Recon config tag does not show up on Ozone UI. (#914) 2019-06-06 23:43:29 +05:30
Shweta Yakkali
c8276f3e76 HDDS-1201. Reporting Corruptions in Containers to SCM (#912) 2019-06-06 23:36:48 +05:30
Inigo Goiri
944adc61b1 HDFS-14527. Stop all DataNodes may result in NN terminate. Contributed by He Xiaoqiao. 2019-06-06 10:20:28 -07:00
Bharat Viswanadham
0b8a2608e0 HDDS-1605. Implement AuditLogging for OM HA Bucket write requests. (#867) 2019-06-06 10:13:36 -07:00
Steve Loughran
1f244b4227
Revert "HADOOP-16344. Make DurationInfo public unstable." 
This reverts commit 829848ba2e.

Change-Id: Ied91250e191b2ba701a8fc697c78b3756ce76be8
 2019-06-06 17:49:31 +01:00
S O'Donnell
36757ad6a9
HDDS-1645. Change the version of Pico CLI to the latest 3.x release - 3.9.6 
Closes #909
 2019-06-06 16:00:00 +02:00
Weiwei Yang
0976392502 YARN-9590. Correct incompatible, incomplete and redundant activities. Contributed by Tao Yang. 2019-06-06 21:59:01 +08:00
supratimdeka
9fded678ff HDDS-1621. writeData in ChunkUtils should not use AsynchronousFileChannel. Contributed by Supratim Deka (#917) 2019-06-06 18:53:37 +05:30
Huan-Ping Su
829848ba2e
HADOOP-16344. Make DurationInfo public unstable. 
Contributed by Huan-Ping Su

Change-Id: I64a94cf382f9db78b4ef49a3912f25f0d906af7c
 2019-06-06 12:52:49 +01:00
Márton Elek
f7c77b395f
HDDS-1458. Create a maven profile to run fault injection tests. Contributed by Eric Yang. 2019-06-06 12:24:13 +02:00
Sunil G
649666e118 YARN-9573. DistributedShell cannot specify LogAggregationContext. Contributed by Adam Antal. 2019-06-06 14:51:55 +05:30
Steve Loughran
ec26c431f9
HADOOP-16117. Update AWS SDK to 1.11.563. 
Contributed by Steve Loughran.

Change-Id: I7c46ed2a6378e1370f567acf4cdcfeb93e43fa13
 2019-06-06 10:08:18 +01:00
Sammi Chen
73954c1dd9 HDDS-1612. Add 'scmcli printTopology' shell command to print datanode topology. Contributed by Sammi Chen.(#910) 2019-06-05 20:13:39 -07:00
Eric Yang
294695dd57 HADOOP-16314. Make sure all web end points are covered by the same authentication filter. 
Contributed by Prabhu Joseph
 2019-06-05 18:55:13 -04:00
Ajay Yadav
3b1c2577d7 HDDS-1541. Implement addAcl,removeAcl,setAcl,getAcl for Key. Contributed by Ajay Kumat. (#885) 2019-06-05 14:42:10 -07:00
ChenSammi
0b1e288deb HDDS-1637. Fix random test failure TestSCMContainerPlacementRackAware. Contributed by Sammi Chen. (#904) 2019-06-05 09:09:36 -07:00
Sammi Chen
d1aad44490 HDFS-14356. Implement HDFS cache on SCM with native PMDK libs. Contributed by Feilong He. 2019-06-05 21:33:00 +08:00
Steve Loughran
309501c6fa
Revert "HADOOP-16050: s3a SSL connections should use OpenSSL" 
This reverts commit b067f8acaa.

Change-Id: I584b050a56c0e6f70b11fa3f7db00d5ac46e7dd8
 2019-06-05 13:54:55 +01:00
Steve Loughran
7724d8031b Revert "HADOOP-16321: ITestS3ASSL+TestOpenSSLSocketFactory failing with java.lang.UnsatisfiedLinkErrors" 
This reverts commit 5906268f0d.
 2019-06-05 13:54:42 +01:00
Márton Elek
42cd861be0
HDDS-1628. Fix the execution and return code of smoketest executor shell script 
Closes #902
 2019-06-05 14:04:17 +02:00
Weiwei Yang
433e97cd34 YARN-9600. Support self-adaption width for columns of containers table on app attempt page. Contributed by Tao Yang. 2019-06-05 13:55:30 +08:00
Vivek Ratnavel Subramanian
ef2da40a70
HDDS-1640. Reduce the size of recon jar file 
Closes #907
 2019-06-05 07:51:23 +02:00
Zhankun Tang
cd17cc2868 SUBMARINE-89. Add submarine-src profile to generate source package. Contributed by Sunil Govindan. 2019-06-05 10:44:44 +08:00
Sunil G
96d818a2f7 SUBMARINE-88. rat.sh regex pattern not working issue while using lower version of grep in ubuntu16.04. Contributed by Zhankun Tang. 2019-06-05 07:48:24 +05:30
Wanqiang Ji
e7e30a5f8b
MAPREDUCE-7210. Replace mapreduce.job.counters.limit with mapreduce.job.counters.max in mapred-default.xml 
This closes #878

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-06-05 10:45:23 +09:00
Eric Yang
d45669cd3c YARN-7537. Add ability to load hbase config from distributed file system. 
Contributed by Prabhu Joseph
 2019-06-04 19:26:06 -04:00
avijayanhwx
1a78794227 HDDS-1624 : Refactor operations inside the bucket lock in OM key write. (#882) 2019-06-04 15:41:37 -07:00
Bharat Viswanadham
580b639908
HDDS-1600. Add userName and IPAddress as part of OMRequest. (#857) 2019-06-04 12:31:44 -07:00