big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,996 Commits 2 Branches 2 Tags 264 MiB
95986dd2fb
Commit Graph

7996 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
b0456745f9 HDFS-5904. TestFileStatus fails intermittently. Contributed by Mit Desai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567946 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 15:06:17 +00:00
Tsz-wo Sze
a4f152db96 Merge r1555021 through r1566358 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1567874 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 09:53:52 +00:00
Tsz-wo Sze
4f9bbaa301 HDFS-5889. When starting rolling upgrade, create a fs image for rollback so that the standby namenode can create checkpoints during upgrade. Contributed by szetszwo & jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1567861 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 08:04:58 +00:00
Haohui Mai
9ee7c2a077 HDFS-5932. Ls should display the ACL bit. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567850 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 05:51:28 +00:00
Colin McCabe
f0d64a078d HDFS-5940. Minor cleanups to ShortCircuitReplica, FsDatasetCache, and DomainSocketWatcher (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567835 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 03:10:48 +00:00
Jian He
dab635980d YARN-1345. Remove FINAL_SAVING state from YarnApplicationAttemptState. Contributed by Zhijie Shen 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567820 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 00:59:19 +00:00
Zhijie Shen
0185a57847 YARN-1578. Fixed reading incomplete application attempt and container data in FileSystemApplicationHistoryStore. Contributed by Shinichi Yamashita. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567816 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 00:08:47 +00:00
Jing Zhao
2624b20291 HDFS-5847. Consolidate INodeReference into a separate section. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567812 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 00:00:42 +00:00
Brandon Li
256adb2106 HDFS-5891. webhdfs should not try connecting the DN during redirection. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567810 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 23:57:35 +00:00
Sanford Ryza
c6e2f4f07f Move YARN-1692 in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567793 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 23:13:52 +00:00
Sanford Ryza
bc939f7ae6 YARN-1692. ConcurrentModificationException in fair scheduler AppSchedulable (Sangjin Lee via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567788 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 23:04:42 +00:00
Chris Nauroth
ea0b21af15 HDFS-5933. Optimize the FSImage layout for ACLs. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567785 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 22:56:32 +00:00
Chris Nauroth
fc14360b03 HDFS-5923. Do not persist the ACL bit in the FsPermission. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567784 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 22:54:49 +00:00
Karthik Kambatla
ad6bc868b6 YARN-1531. True up yarn command documentation (Akira Ajisaka via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567775 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 22:31:16 +00:00
Colin McCabe
b3af8edc26 HDFS-5938. Make BlockReaderFactory#BlockReaderPeer a static class to avoid a findbugs warning (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567767 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 22:01:53 +00:00
Colin McCabe
beb0d25d2a HDFS-5810. Unify mmap cache and short-circuit file descriptor cache (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567720 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 19:08:52 +00:00
Suresh Srinivas
5efc9978dd HDFS-5879. Some TestHftpFileSystem tests do not close streams. Contributed by Gera Shegalov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567704 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 18:02:21 +00:00
Karthik Kambatla
308f5faf18 MAPREDUCE-5746. Job diagnostics can implicate wrong task for a failed job. (Jason Lowe via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567666 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 16:04:18 +00:00
Karthik Kambatla
41ec3cce76 YARN-1641. ZK store should attempt a write periodically to ensure it is still Active. (kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567628 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 14:09:13 +00:00
Sanford Ryza
d82bc78733 Fix YARN-1697 in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567553 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 08:06:14 +00:00
Konstantin Shvachko
fa78a7a99a HDFS-4858. HDFS DataNode to NameNode RPC should timeout. Contributed by Henry Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567535 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 07:01:29 +00:00
Zhijie Shen
1b5254a4de YARN-1719. Fixed the root path related Jersey warnings produced in ATSWebServices. Contributed by Billie Rinaldi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567498 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 02:13:23 +00:00
Colin McCabe
53fed66d91 HADOOP-10338. Cannot get the FileStatus of the root inode from the new Globber (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567497 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 02:12:11 +00:00
Sanford Ryza
98f5da5f58 Move YARN-1496, YARN-1498, YARN-1504, YARN-1499, and YARN-1497 under 2.4 in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567487 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 01:30:25 +00:00
Chris Nauroth
6d2a0aa1db HDFS-5925. ACL configuration flag must only reject ACL API calls, not ACLs present in fsimage or edits. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567450 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 23:13:48 +00:00
Chris Nauroth
ff0abf1929 HDFS-5625. Add documentation example for setting a default ACL. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567422 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 22:20:42 +00:00
Chris Nauroth
b0ab36ac01 HDFS-5625. Write end user documentation for HDFS ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567421 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 22:18:08 +00:00
Suresh Srinivas
93eafc8590 HDFS-5929. Add blockpool % usage to HDFS federated nn page. Contributed by Siqi Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567411 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 22:04:15 +00:00
Sanford Ryza
9024ad4aa0 YARN-1697. NodeManager reports negative running containers (Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567356 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 20:14:30 +00:00
Chris Nauroth
dd03cd1336 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567238 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 17:55:07 +00:00
Arun Murthy
1b9cef0fdd Release notes for hadoop-2.3.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567118 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 13:32:07 +00:00
Arun Murthy
c43c9dd7b5 Preparing to release hadoop-2.3.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567111 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 13:25:30 +00:00
Chris Nauroth
d03acc7560 HDFS-5914. Incorporate ACLs with the changes from HDFS-5698. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566991 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 06:25:13 +00:00
Chris Nauroth
3bf2f04bac Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566988 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 06:00:56 +00:00
Zhijie Shen
3587b6774c YARN-1706. Created an utility method to dump timeline records to JSON strings. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566982 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 04:39:37 +00:00
Aaron Myers
5c7b27bae0 HADOOP-10326. M/R jobs can not access S3 if Kerberos is enabled. Contributed by bc Wong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566965 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 02:47:05 +00:00
Vinod Kumar Vavilapalli
7fce641c49 YARN-1698. Fixed default TimelineStore in code to match what is documented in yarn-default.xml. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566937 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 01:05:16 +00:00
Aaron Myers
666684eb90 HDFS-5921. Cannot browse file system via NN web UI if any directory has the sticky bit set. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566916 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 00:46:45 +00:00
Chris Nauroth
5c978a43c3 HDFS-5915. Refactor FSImageFormatProtobuf to simplify cross section reads. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566824 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-10 23:13:06 +00:00
Vinod Kumar Vavilapalli
1fa6ab249b YARN-1459. Changed ResourceManager to depend its service initialization on the configuration-provider mechanism during startup too. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566791 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-10 22:50:15 +00:00
Zhijie Shen
e74e117ad3 YARN-1637. Implemented a client library for Java users to post timeline entities and events. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566752 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-10 21:31:34 +00:00
Suresh Srinivas
bfd158f323 HADOOP-10333. Fix grammatical error in overview.html document. Contributed by René Nyffenegger. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566709 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-10 19:34:54 +00:00
Sanford Ryza
1c151c31fa YARN-1497. Fix comment and remove accidental println 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566537 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-10 09:19:26 +00:00
Brandon Li
c7e265bf26 HDFS-5886. Potential null pointer deference in RpcProgramNfs3#readlink(). Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566468 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-09 23:15:48 +00:00
Konstantin Shvachko
ff24753aa7 HDFS-4370. Fix typo Blanacer in DataNode. Contributed by Chu Tong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566422 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-09 21:07:28 +00:00
Konstantin Shvachko
204704a92d HDFS-5837. dfs.namenode.replication.considerLoad should consider decommissioned nodes. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566410 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-09 20:49:18 +00:00
Haohui Mai
2ed075e1bb Merging r1566042 through r1566364 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566375 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-09 19:45:00 +00:00
Jing Zhao
a2edb11b68 HDFS-5698. Use protobuf to serialize / deserialize FSImage. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566359 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-09 19:18:51 +00:00
Chris Nauroth
c6505f0499 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566100 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-08 19:05:12 +00:00
Chris Nauroth
dd2eb97ddd HDFS-5899. Add configuration flag to disable/enable support for ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566041 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-08 16:20:29 +00:00