big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,349 Commits 2 Branches 2 Tags 264 MiB
9df1c84be0
Commit Graph

20349 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anu Engineer
c07b95bdfc HDDS-645. Enable OzoneFS contract tests by default. 
Contributed by Arpit Agarwal.
 2018-10-12 14:46:04 -07:00
Arpit Agarwal
3a684a2b23 HDDS-644. Rename dfs.container.ratis.num.container.op.threads. Contributed by Bharat Viswanadham. 2018-10-12 14:44:51 -07:00
Anu Engineer
02e1ef5e07 HDDS-624.PutBlock fails with Unexpected Storage Container Exception. 
Contributed by  Arpit Agarwal.
 2018-10-12 14:22:46 -07:00
Bharat Viswanadham
8ae8a5004f HDDS-606. Create delete s3Bucket. Contributed by Bharat Viswanadham. 2018-10-12 13:58:53 -07:00
Arpit Agarwal
56b18b9df1 HDDS-639. ChunkGroupInputStream gets into infinite loop after reading a block. Contributed by Mukul Kumar Singh. 2018-10-12 13:33:38 -07:00
Arpit Agarwal
85ccab7d3f HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh. 2018-10-12 11:30:57 -07:00
Xiaoyu Yao
07d55292dc HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly(addendum). Contributed by Mukul Kumar Singh. 2018-10-12 10:51:50 -07:00
Xiaoyu Yao
e12edb3d8f HDDS-555. RandomKeyGenerator runs not closing the XceiverClient properly. Contributed by Mukul Kumar Singh. 2018-10-12 10:36:57 -07:00
Inigo Goiri
f63ee083db HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui. 2018-10-12 10:10:12 -07:00
Bharat Viswanadham
38fe447d93 HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham. 2018-10-12 09:58:16 -07:00
Robert Kanter
f1342cdf41 HADOOP-15832. Addendum: Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter 2018-10-12 09:40:34 -07:00
Xiao Chen
5ec86b445c HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. 
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.
 2018-10-12 09:35:52 -07:00
Vinayakumar B
6e0e6daaf3 HDFS-13945. TestDataNodeVolumeFailure is Flaky. Contributed by Ayush Saxena. 2018-10-12 17:34:10 +05:30
Vinayakumar B
de44e1064f HDFS-13156. HDFS Block Placement Policy - Client Local Rack. Contributed by Ayush Saxena. 2018-10-12 17:27:23 +05:30
Steve Loughran
e36ae9639f
HADOOP-15831. Include modificationTime in the toString method of CopyListingFileStatus. 
Contributed by Ted Yu.
 2018-10-12 09:59:19 +01:00
Yiqun Lin
5da042227c HDDS-628. Fix outdated names used in HDDS documentations. 2018-10-12 14:00:13 +08:00
Vrushali C
bca928d3c7 YARN-3879 [Storage implementation] Create HDFS backing storage implementation for ATS reads. Contributed by Abhishek Modi. 2018-10-11 21:14:06 -07:00
Bharat Viswanadham
74db993a61 HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru. 2018-10-11 21:03:01 -07:00
Shweta
c0118105b7 HDFS-13973. getErasureCodingPolicy should log path in audit event. Contributed by Shweta. 
Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-10-11 20:39:41 -07:00
Vrushali C
a3edfddcf7 YARN-8834 Provide Java client for fetching Yarn specific entities from TimelineReader. Contributed by Abhishek Modi 2018-10-11 20:21:00 -07:00
Tsz Wo Nicholas Sze
fb18cc5eaa HDDS-625. putKey hangs for a long time after completion, sometimes forever. Contributed by Arpit Agarwal 2018-10-12 10:37:37 +08:00
Anu Engineer
604c27c33a HDDS-634. OzoneFS: support basic user group and permission for file/dir. 
Contributed by Xiaoyu Yao.
 2018-10-11 17:25:25 -07:00
Arpit Agarwal
50552479c4 HDDS-636. Turn off ozone.metastore.rocksdb.statistics for now. Contributed by Arpit Agarwal. 2018-10-11 17:21:27 -07:00
Jitendra Pandey
0bc6d0484a HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:12:47 -07:00
Vrushali C
8d1981806f YARN-5742 Serve aggregated logs of historical apps from timeline service. Contributed by Rohith Sharma KS 2018-10-11 16:26:07 -07:00
Robert Kanter
d91d47bc73 HADOOP-15717. TGT renewal thread does not log IOException (snemeth via rkanter) 2018-10-11 15:35:44 -07:00
Xiao Chen
64f2b32d57 HADOOP-15676. Cleanup TestSSLHttpServer. Contributed by Szilard Nemeth. 2018-10-11 15:12:36 -07:00
Xiaoyu Yao
c05b260069 HDDS-627. OzoneFS read from an MR Job throws java.lang.ArrayIndexOutOfBoundsException. Contributed by Mukul Kumar Singh. 2018-10-11 15:08:22 -07:00
Siyao Meng
6dcfef79af HDFS-13878. HttpFS: Implement GETSNAPSHOTTABLEDIRECTORYLIST. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-10-11 15:01:50 -07:00
Inigo Goiri
3532aa3886 HDFS-13968. BlockReceiver Array-Based Queue. Contributed by BELUGA BEHR. 2018-10-11 13:49:39 -07:00
Hanisha Koneru
eb34b5f8af HDDS-601. On restart, SCM throws 'No such datanode' exception. 2018-10-11 13:20:32 -07:00
Steve Loughran
2addebb94f
HDFS-13951. HDFS DelegationTokenFetcher can't print non-HDFS tokens in a tokenfile. 
Contributed by Steve Loughran.
 2018-10-11 20:03:56 +01:00
Steve Loughran
735a36afd5
MAPREDUCE-7149. Javadocs for FileInputFormat and OutputFormat to mention DT collection. 
Contributed by Steve Loughran.
 2018-10-11 20:01:42 +01:00
Billie Rinaldi
96d28b4750 YARN-8777. Container Executor C binary change to execute interactive docker command. Contributed by Eric Yang 2018-10-11 09:25:21 -07:00
Arpit Agarwal
47eeb3eb7b HDDS-630. Rename KSM to OM in Hdds.md. Contributed by Takanobu Asanuma. 2018-10-11 09:20:11 -07:00
Billie Rinaldi
aeeb0389a5 YARN-8710. Service AM should set a finite limit on NM container max retries. Contributed by Suma Shivaprasad 2018-10-11 08:59:17 -07:00
Jason Lowe
e787d65a08 YARN-8861. executorLock is misleading in ContainerLaunch. Contributed by Chandni Singh 2018-10-11 10:54:57 -05:00
Steve Loughran
ee816f1fd7
HADOOP-15837. DynamoDB table Update can fail S3A FS init. 
Contributed by Steve Loughran.
 2018-10-11 14:57:38 +01:00
Sunil G
8a37983990 YARN-8753. [UI2] Lost nodes representation missing from Nodemanagers Chart. Contributed by Yesha Vora. 2018-10-11 16:15:25 +05:30
Sunil G
d3da741fa2 YARN-8666. [UI2] Remove application tab from YARN Queue Page. Contributed by Yesha Vora. 2018-10-11 16:05:53 +05:30
Takanobu Asanuma
7b57f2f71f HADOOP-15785. [JDK10] Javadoc build fails on JDK 10 in hadoop-common. Contributed by Dinesh Chitlangia. 2018-10-11 13:51:51 +09:00
Robert Kanter
f261c31937 HADOOP-15708. Reading values from Configuration before adding deprecations make it impossible to read value with deprecated key (zsiegl via rkanter) 2018-10-10 18:51:37 -07:00
Arpit Agarwal
2bd000c851 HDDS-619. hdds.db.profile should not be tagged as a required setting & should default to DISK. Contributed by Dinesh Chitlangia. 2018-10-10 17:37:20 -07:00
Vrushali C
045069efec YARN-6989 Ensure timeline service v2 codebase gets UGI from HttpServletRequest in a consistent way. Contributed by Abhishek Modi 2018-10-10 15:17:05 -07:00
Hrishikesh Gadre
bf3d591f0c HDFS-13956. iNotify should include information to identify a file as either replicated or erasure coded. Contributed by Hrishikesh Gadre. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-10-10 10:23:07 -07:00
Weiwei Yang
3ead525c71 HDFS-12459. Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-10-10 10:11:10 -07:00
Steve Loughran
cdc4350718
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys. 
Contributed by Steve Loughran.
 2018-10-10 17:00:37 +01:00
Kitti Nanasi
10185d9a77 HDFS-13882. Set a maximum delay for retrying locateFollowingBlock. Contributed by Kitti Nanasi. 
Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-10-10 08:55:32 -07:00
Nanda kumar
90552b1ea8 HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh. 2018-10-10 20:50:49 +05:30
Jason Lowe
5ce70e1211 YARN-7644. NM gets backed up deleting docker containers. Contributed by Chandni Singh 2018-10-10 09:52:19 -05:00