big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,939 Commits 2 Branches 2 Tags 264 MiB
e120ee865a
Commit Graph

15939 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Karthik Kambatla
754cb4e30f YARN-5047. Refactor nodeUpdate across schedulers. (Ray Chiang via kasha) 2016-10-20 21:17:48 -07:00
Karthik Kambatla
a064865abf YARN-4911. Bad placement policy in FairScheduler causes the RM to crash 2016-10-20 20:57:04 -07:00
Mingliang Liu
d7d87deece HDFS-10998. Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA. Contributed by Xiaobing Zhou 2016-10-20 19:51:48 -07:00
Anu Engineer
262827cf75 HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal. 2016-10-20 13:35:26 -07:00
Wei-Chiu Chuang
5e83a21cb6 HDFS-10976. Report erasure coding policy of EC files in Fsck. Contributed by Wei-Chiu Chuang. 2016-10-20 13:06:43 -07:00
Anu Engineer
3fbf4cd5da HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran. 2016-10-20 12:33:58 -07:00
Wei-Chiu Chuang
6d2da38d16 HDFS-11018. Incorrect check and message in FsDatasetImpl#invalidate. Contributed by Yiqun Lin. 2016-10-20 10:56:39 -07:00
Brahma Reddy Battula
f872c6bc03 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 2016-10-20 21:47:17 +05:30
Brahma Reddy Battula
6fb6b651e8 HDFS-10699. Log object instance get incorrectly in TestDFSAdmin. Contributed by Yiqun Lin 2016-10-20 21:28:16 +05:30
Kihwal Lee
5c0bffddc0 HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 2016-10-20 10:48:35 -05:00
Brahma Reddy Battula
4c73be135c HDFS-9480. Expose nonDfsUsed via StorageTypeStats. Contributed by Brahma Reddy Battula 2016-10-20 20:45:45 +05:30
Steve Loughran
9ae270af02 HADOOP-13735 ITestS3AFileContextStatistics.testStatistics() failing. Contributed by Pieter Reuse 2016-10-20 14:50:59 +01:00
Brahma Reddy Battula
73504b1bdc HDFS-11025. TestDiskspaceQuotaUpdate fails in trunk due to Bind exception. Contributed by Yiqun Lin 2016-10-20 10:41:18 +05:30
Yongjun Zhang
8650cc84f2 HDFS-9820. Improve distcp to support efficient restore to an earlier snapshot. Contributed by Yongjun Zhang. 2016-10-19 17:37:54 -07:00
Arpit Agarwal
b4564103e4 HDFS-10752. Several log refactoring/improvement suggestion in HDFS. Contributed by Hanisha Koneru. 2016-10-19 17:20:07 -07:00
Sangjin Lee
e9c4616b5e YARN-5561. [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST. Contributed by Rohith Sharma K S. 2016-10-19 09:45:23 -07:00
Xiao Chen
c5573e6a75 HDFS-11009. Add a tool to reconstruct block meta file from CLI. 2016-10-18 22:42:28 -07:00
Benoy Antony
4bca385241 HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter 2016-10-18 18:32:01 -07:00
Xiao Chen
d75cbc5749 HADOOP-13693. Remove the message about HTTP OPTIONS in SPNEGO initialization message from kms audit log. 2016-10-18 18:24:59 -07:00
Xiao Chen
efdf810cf9 HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge. 2016-10-18 18:18:43 -07:00
Robert Kanter
29caf6d7df MAPREDUCE-6791. remove unnecessary dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle (haibochen via rkanter) 2016-10-18 18:00:29 -07:00
Xiaoyu Yao
c62ae7107f HDFS-10906. Add unit tests for Trash with HDFS encryption zones. Contributed by Hanisha Koneru. 2016-10-18 14:05:43 -07:00
Steve Loughran
6c348c5691 HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran 2016-10-18 21:16:02 +01:00
Xuan
b733a6f862 YARN-5718. TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior. Contributed by Junping Du. 2016-10-18 11:06:47 -07:00
Varun Saxena
b154d3edce YARN-5743. [Atsv2] Publish queue name and RMAppMetrics to ATS (Rohith Sharma K S via Varun Saxena) 2016-10-18 23:32:52 +05:30
Kai Zheng
d26a1bb9d6 HDFS-10920. TestStorageMover#testNoSpaceDisk is failing intermittently. Contributed by Rakesh R 2016-10-18 14:51:08 +06:00
Kai Zheng
c023c74886 HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki 2016-10-18 12:02:53 +06:00
Akira Ajisaka
bedfec0c10 HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini. 2016-10-18 15:00:44 +09:00
Yongjun Zhang
0bc6d37f3c Revert "HDFS-9820. Improve distcp to support efficient restore to an earlier snapshot. Contributed by Yongjun Zhang." 
This reverts commit 412c4c9a34.
 2016-10-17 22:47:37 -07:00
Ming Ma
b61fb267b9 HDFS-9390. Block management for maintenance states. 2016-10-17 17:45:41 -07:00
Robert Kanter
f5d9235914 YARN-5466. DefaultContainerExecutor needs JavaDocs (templedf via rkanter) 2016-10-17 14:29:09 -07:00
Xiaoyu Yao
8fd4c37c45 HDFS-10922. Adding additional unit tests for Trash (II). Contributed by Weiwei Yang. 2016-10-17 14:21:36 -07:00
Andrew Wang
b671ee6846 HDFS-11013. Correct typos in native erasure coding dump code. Contributed by László Bence Nagy. 2016-10-17 14:14:50 -07:00
Andrew Wang
987ee51141 HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei. 2016-10-17 13:25:58 -07:00
Andrew Wang
0f4afc8100 HADOOP-13722. Code cleanup -- ViewFileSystem and InodeTree. Contributed by Manoj Govindassamy. 2016-10-17 13:15:11 -07:00
Yongjun Zhang
412c4c9a34 HDFS-9820. Improve distcp to support efficient restore to an earlier snapshot. Contributed by Yongjun Zhang. 2016-10-17 11:04:42 -07:00
Wei-Chiu Chuang
ed9fcbec54 HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory. 2016-10-17 05:04:49 -07:00
Sangjin Lee
1f304b0c7f YARN-5699. Retrospect yarn entity fields which are publishing in events info fields. Contributed by Rohith Sharma K S. 2016-10-15 13:54:40 -07:00
Brahma Reddy Battula
5f4ae85bd8 HDFS-11003. Expose XmitsInProgress through DataNodeMXBean. Contributed By Brahma Reddy Battula 2016-10-15 22:28:33 +05:30
Akira Ajisaka
5ad037df25 HDFS-11012. Unnecessary INFO logging on DFSClients for InvalidToken. Contributed by Harsh J. 
This closes #142
 2016-10-15 22:14:24 +09:00
Vinitha Reddy Gankidi
391ce535a7 HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 2016-10-14 18:13:54 -07:00
Anu Engineer
30bb1970cc HDFS-10558. DiskBalancer: Print the full path to plan file. Contributed by Xiaobing Zhou. 2016-10-14 17:07:59 -07:00
Mingliang Liu
76cc84e6d4 HDFS-11008. Change unit test for testing parsing "-source" parameter in Balancer CLI. Contributed by Mingliang Liu 2016-10-14 14:29:02 -07:00
Andrew Wang
aee538be6c HADOOP-13721. Remove stale method ViewFileSystem#getTrashCanLocation. Contributed by Manoj Govindassamy. 2016-10-14 14:08:31 -07:00
Lei Xu
8c520a27cb HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 2016-10-14 13:41:59 -07:00
Jing Zhao
adb96e109f HDFS-10827. When there are unrecoverable ec block groups, Namenode Web UI doesn't show the block names. Contributed by Takanobu Asanuma. 2016-10-14 13:21:53 -07:00
Andrew Wang
0007360c33 HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 2016-10-14 11:41:29 -07:00
Benoy Antony
701c27a776 HDFS-10735 Distcp using webhdfs on secure HA clusters fails with StandbyException 2016-10-14 10:26:39 -07:00
Kihwal Lee
8a9f6635a3 HDFS-10990. TestPendingInvalidateBlock should wait for IBRs. Contributed by Yiqun Lin. 2016-10-14 11:38:48 -05:00
Xiaoyu Yao
dbe663d524 HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang. 2016-10-13 23:05:16 -07:00