big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,030 Commits 2 Branches 2 Tags 264 MiB
b3befc021b
Commit Graph

4033 Commits

Author SHA1 Message Date
Kai Zheng
51e6c1cc3f HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen 2016-11-30 15:52:56 +08:00
Kai Zheng
cfd8076f81 Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen" 
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
 2016-11-30 15:44:52 +08:00
Akira Ajisaka
67d9f2808e HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project. 2016-11-29 14:07:19 +09:00
Robert Kanter
47ca9e26fb HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 2016-11-28 18:08:09 -08:00
Andrew Wang
a2b1ff0257 HADOOP-13828. Implement getFileChecksum(path, length) for ViewFileSystem. Contributed by Manoj Govindassamy. 2016-11-28 11:54:43 -08:00
Kai Zheng
5d5614f847 HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen 2016-11-28 14:34:44 +08:00
Akira Ajisaka
209e805430 HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki. 2016-11-28 14:34:57 +09:00
Harsh J
07825f2b49 HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J. 2016-11-25 22:22:23 +05:30
Brahma Reddy Battula
ee3d437a33 HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula. 2016-11-25 19:54:50 +05:30
Steve Loughran
01665e456d HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli 
Cherry picked from 24715cefe80fba531dd16a44ec1cead67c389eb1
 2016-11-24 17:54:10 +00:00
Steve Loughran
3df3fa396c HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula. 2016-11-24 17:44:36 +00:00
Brahma Reddy Battula
13501053dd HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula. 2016-11-24 22:23:22 +05:30
Steve Loughran
abb9fa7fc6 HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash 2016-11-24 16:41:59 +00:00
Andrew Wang
c7a5f2906f HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li. 2016-11-23 17:08:38 -08:00
Mingliang Liu
860d49aa6a HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran 2016-11-23 16:42:27 -08:00
Andrew Wang
de4894936a HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R. 2016-11-23 16:42:06 -08:00
Andrew Wang
dd98a8005a HDFS-11058. Implement 'hadoop fs -df' command for ViewFileSystem. Contributed by Manoj Govindassamy. 2016-11-23 16:40:39 -08:00
Jian He
3d94da1e00 HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth 2016-11-23 16:01:55 -08:00
Mingliang Liu
2bf9a15e8a HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran 2016-11-22 14:27:23 -08:00
Lei Xu
3a09e5970d HDFS-11145. Implement getTrashRoot() for ViewFileSystem. (Manoj Govindassamy via lei) 2016-11-22 13:52:09 -08:00
Mingliang Liu
beb70fed4f HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran 
This closes #131
 2016-11-22 13:12:23 -08:00
Brahma Reddy Battula
afcf8d38e7 HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula. 2016-11-22 19:45:45 +05:30
Wei-Chiu Chuang
c0b1a44f6c HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory. 2016-11-17 22:48:35 -06:00
Mingliang Liu
ae8849fe37 HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran 2016-11-17 14:11:38 -08:00
Kihwal Lee
bd3735554f HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula. 2016-11-17 12:16:38 -06:00
Mingliang Liu
aab9737a05 HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula 2016-11-16 20:08:48 -08:00
Mingliang Liu
5af572b644 HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu 2016-11-15 10:57:00 -08:00
Mingliang Liu
04014c4c73 HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran 
This closes #158
 2016-11-14 19:38:10 -08:00
Zhe Zhang
ff0b99eafe HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 11:05:29 -08:00
Chris Douglas
5c61ad2488 HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane 2016-11-11 11:15:07 -08:00
Yongjun Zhang
fd2f22adec HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang. 2016-11-10 22:42:59 -08:00
Yongjun Zhang
470bdaa27a HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang) 2016-11-10 22:38:38 -08:00
Akira Ajisaka
8848a8a76c HDFS-11116. Fix javac warnings caused by deprecation of APIs in TestViewFsDefaultValue. Contributed by Yiqun Lin. 2016-11-11 13:45:30 +09:00
Xiao Chen
822ae88f7d HADOOP-13346. DelegationTokenAuthenticationHandler writes via closed writer. Contributed by Gregory Chanan and Hrishikesh Gadre. 2016-11-09 09:33:00 -08:00
Xiao Chen
367c3d4121 HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception. 2016-11-09 09:07:12 -08:00
Akira Ajisaka
c074880096 HADOOP-13800. Remove unused HADOOP_AUDIT_LOGGER from hadoop-env.sh. Contributed by Yiqun Lin. 2016-11-09 22:02:40 +09:00
Andrew Wang
e1c6ef2efa HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey. 2016-11-08 16:33:55 -08:00
Zhe Zhang
77c13c3857 HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen. 2016-11-08 16:07:36 -08:00
Mingliang Liu
2a65eb121e HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn 2016-11-08 15:40:22 -08:00
Subru Krishnan
29e3b3417c YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru). 2016-11-08 14:38:18 -08:00
Brahma Reddy Battula
dbb133ccfc HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu. 2016-11-08 20:55:10 +05:30
Zhe Zhang
3dbad5d823 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen. 2016-11-07 16:08:10 -08:00
Steve Loughran
f76895573d HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt 2016-11-07 12:36:10 +00:00
Xiao Chen
d8bab3dcb6 HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu. 2016-11-04 18:06:55 -07:00
Akira Ajisaka
de0132748d MAPREDUCE-6796. Remove unused properties from JTConfig.java. Contributed by Haibo Chen. 2016-11-05 03:49:19 +09:00
Mingliang Liu
abfc15d5ef HADOOP-13792. Stackoverflow for schemeless defaultFS with trailing slash. Contributed by John Zhuge 2016-11-04 10:46:27 -07:00
Xiao Chen
7154a20bcb HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao. 2016-11-03 13:09:03 -07:00
Andrew Wang
7e521c5a49 HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:05 -07:00
Daniel Templeton
0dc2a6a3a5 HADOOP-13667. Fix typing mistake of inline document in hadoop-metrics2.properties (Contributed by Rui Gao via Daniel Templeton) 2016-11-02 06:53:33 -07:00
Arpit Agarwal
1b6ecaf016 HADOOP-13738. DiskChecker should perform some disk IO. 2016-11-01 18:02:23 -07:00