big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,707 Commits 2 Branches 2 Tags 264 MiB
d8fa1cfa67
Commit Graph

14707 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anu Engineer
bee9f57f5c HDFS-10808. DiskBalancer does not execute multi-steps plan-redux. Contributed by Anu Engineer. 2016-09-09 15:00:39 -07:00
Andrew Wang
cba973f036 HDFS-10832. Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions. 2016-09-09 12:12:29 -07:00
Chris Douglas
9f192cc5ac MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan 2016-09-09 11:12:44 -07:00
Steve Loughran
4b6d795f28 HADOOP-13540 improve section on troubleshooting s3a auth problems. Contributed by Steve Loughran 2016-09-09 18:55:32 +01:00
Xiao Chen
a0b0383677 Addendum patch for HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-09 10:54:14 -07:00
Kihwal Lee
d4d076876a HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp. 2016-09-09 10:39:35 -05:00
Anu Engineer
baab48922a HDFS-9849. DiskBalancer: reduce lock path in shutdown code. Contributed by Yuanbo Liu. 2016-09-08 20:00:42 -07:00
Anu Engineer
35c5943b8b HDFS-10553. DiskBalancer: Rename Tools/DiskBalancer class to Tools/DiskBalancerCLI. Contributed by Manoj Govindassamy. 2016-09-08 19:26:56 -07:00
Andrew Wang
b07c266dca HDFS-10831. Add log when URLConnectionFactory.openConnection failed. Contributed by yunjiong zhao. 2016-09-08 18:30:18 -07:00
Chris Douglas
011f3b24d4 HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang 2016-09-08 17:53:40 -07:00
Chris Douglas
1192781a78 HADOOP-13519. Make Path Serializable. Contributed by Steve Loughran 2016-09-08 17:46:12 -07:00
Chris Douglas
b6d839a60c HDFS-10845. Change defaults in hdfs-site.xml to match timeunit type. Contributed by Yiqun Lin 2016-09-08 13:29:30 -07:00
Allen Wittenauer
cae331186d Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)" 
This reverts commit 05ede00386.
 2016-09-08 12:40:30 -07:00
Zhe Zhang
401db4fc65 HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng. 2016-09-08 11:54:33 -07:00
Akira Ajisaka
20a20c2f6e HDFS-10847. Complete the document for FileDistribution processor in OfflineImageViewer. Contributed by Yiqun Lin. 2016-09-09 01:34:34 +09:00
Akira Ajisaka
2d1bf53c7e HDFS-10844. test_libhdfs_threaded_hdfs_static and test_libhdfs_zerocopy_hdfs_static are failing. 2016-09-09 00:49:22 +09:00
Akira Ajisaka
63f594892e HDFS-10778. Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer. 2016-09-08 15:13:43 +09:00
Kai Zheng
d355573f56 Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng" 
This reverts commit 62a9667136
 2016-09-08 05:50:17 +08:00
Anu Engineer
f414d5e118 HADOOP-13388. Clean up TestLocalFileSystemPermission. Contributed by Andras Bokor. 2016-09-07 11:09:41 -07:00
Steve Loughran
7fdfcd8a6c HADOOP-13541 explicitly declare the Joda time version S3A depends on. Contributed by Stevel Loughran 2016-09-07 12:25:23 +01:00
Karthik Kambatla
c0e492e50f YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha) 2016-09-06 22:40:20 -07:00
Xiao Chen
680be58aac HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen. 2016-09-06 20:54:17 -07:00
Mingfei
e671a0f52b HADOOP-13481. User documents for Aliyun OSS FileSystem. Contributed by Genmao Yu. 2016-09-07 11:17:43 +08:00
Mingfei
d33e928fbe HADOOP-13529. Do some code refactoring. Contributed by Genmao Yu. 2016-09-07 11:15:48 +08:00
Mingfei
cdb77110e7 HADOOP-13498. The number of multi-part upload part should not bigger than 10000. Contributed by Genmao Yu. 2016-09-07 11:15:48 +08:00
Mingfei
6bb741b9f8 HADOOP-13499. Support session credentials for authenticating with Aliyun. Contributed by Genmao Yu. 2016-09-07 11:15:48 +08:00
Mingfei
bd2d97adee HADOOP-13483. File create should throw error rather than overwrite directories. Contributed by Genmao Yu. 2016-09-07 11:15:47 +08:00
Mingfei
4d84c814fc HADOOP-13491. Fix several warnings from findbugs. Contributed by Genmao Yu. 2016-09-07 11:15:47 +08:00
Kai Zheng
a5d5342228 HADOOP-12756. Incorporate Aliyun OSS file system implementation. Contributed by Mingfei Shi and Lin Zhou 2016-09-07 11:15:47 +08:00
Arpit Agarwal
5f23abfa30 HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-06 13:37:21 -07:00
Xiao Chen
f6c0b7543f HDFS-10841. Remove duplicate or unused variable in appendFile(). Contributed by Kihwal Lee. 2016-09-06 11:48:35 -07:00
Xiao Chen
7c213c341d HDFS-10835. Fix typos in httpfs.sh. Contributed by John Zhuge. 2016-09-06 11:44:26 -07:00
Chris Nauroth
f0d5382ff3 HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth. 2016-09-06 11:02:39 -07:00
Chris Douglas
d37dc5d1b8 HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin 2016-09-06 10:38:04 -07:00
Andrew Wang
f388a20943 Add CHANGES and release notes for 3.0.0-alpha1 to site 2016-09-06 09:51:55 -07:00
Chris Nauroth
d152557cf7 HADOOP-13447. Refactor S3AFileSystem to support introduction of separate metadata repository and tests. Contributed by Chris Nauroth. 2016-09-06 09:36:21 -07:00
Kihwal Lee
39d1b1d747 HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp. 2016-09-06 10:02:42 -05:00
Varun Vasudev
e6fcfe28e3 YARN-5576. Allow resource localization while container is running. Contributed by Jian He. 2016-09-06 20:01:45 +05:30
Kai Zheng
62a9667136 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-07 17:05:33 +08:00
Rohith Sharma K S
f9557127b3 YARN-5608. TestAMRMClient.setup() fails with ArrayOutOfBoundsException. Contributed by Daniel Templeton. 2016-09-06 14:09:45 +05:30
Xiao Chen
07650bc37a HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-02 15:33:11 -07:00
Karthik Kambatla
f6ea9be547 YARN-5264. Store all queue-specific information in FSQueue. (Yufei Gu via kasha) 2016-09-02 14:56:29 -07:00
Andrew Wang
cbd909ce2a HDFS-10833. Fix JSON errors in WebHDFS.md examples. 2016-09-02 14:50:34 -07:00
Ray Chiang
378f624a39 YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang) 2016-09-02 11:14:35 -07:00
Lei Xu
5a8c5064d1 HDFS-10822. Log DataNodes in the write pipeline. John Zhuge via Lei Xu 2016-09-02 11:01:13 -07:00
Kihwal Lee
23abb09c1f HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp. 2016-09-02 11:03:18 -05:00
Varun Vasudev
05f5c0f631 YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne. 2016-09-02 16:02:01 +05:30
Xiao Chen
0690f0969e HDFS-10820. Reuse closeResponder to reset the response variable in DataStreamer#run. Contributed by Yiqun Lin. 2016-09-01 15:35:25 -07:00
Karthik Kambatla
74f4bae455 YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha) 2016-09-01 14:44:01 -07:00
Kihwal Lee
76cd81f4b6 HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp. 2016-09-01 15:44:44 -05:00