big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,865 Commits 2 Branches 2 Tags 264 MiB
39b8bbe663
Commit Graph

1865 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Konstantin Shvachko
22000ce96d HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195869 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:37:11 +00:00
Arun Murthy
a3a4ccfed7 Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 06:02:53 +00:00
Todd Lipcon
a6c110ebd0 HADOOP-7785. Add equals, hashcode, toString to DataChecksum. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195832 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 05:25:21 +00:00
Todd Lipcon
1c940637b1 HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195829 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 05:17:08 +00:00
Thomas White
8e04fa8b84 HADOOP-7782. Aggregate project javadocs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195817 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 04:47:10 +00:00
Mahadev Konar
adf58e70a0 MAPREDUCE-3317. Rumen TraceBuilder is emiting null as hostname. (Ravi Gummadi via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195814 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 04:32:03 +00:00
Mahadev Konar
68dfbff8db MAPREDUCE-3316. Rebooted link is not working properly. (Bhallamudi Venkata Siva Kamesh via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195805 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 04:06:39 +00:00
Arun Murthy
cfb6a9883d MAPREDUCE-3237. Move LocalJobRunner to hadoop-mapreduce-client-core. Contributed by Tom White. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195792 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 03:16:44 +00:00
Arun Murthy
e5badc0c1a Fixing CHANGES.txt to reflect 0.23 content. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195766 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 02:09:51 +00:00
Arun Murthy
d36f847b87 MAPREDUCE-3322. Added a better index.html and an brief overview of YARN architecture. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195764 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 02:00:58 +00:00
Mahadev Konar
68fa208b1c MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195761 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:51:56 +00:00
Tsz-wo Sze
8f9661da48 HADOOP-7771. FsShell -copyToLocal, -get, etc. commands throw NPE if the destination directory does not exist. Contributed by John George and Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195760 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:50:56 +00:00
Tsz-wo Sze
bb8fd6a267 TestHDFSCLI is failing due to HADOOP-7360. HDFS-2038 is going to fix it. Disable it for the moment. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195754 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:31:06 +00:00
Arun Murthy
b451dd7aaa MAPREDUCE-3220. Fixed TestCombineOutputCollector. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195745 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:04:15 +00:00
Arun Murthy
5f7e991659 MAPREDUCE-3321. Disabled a few MR tests for 0.23. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195743 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 00:57:22 +00:00
Tsz-wo Sze
8d1a09b741 HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195731 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 00:38:57 +00:00
Todd Lipcon
c46876982e HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195693 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 21:53:58 +00:00
Tsz-wo Sze
32cad9affe HDFS-2385. Support renew and cancel delegation tokens in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195656 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 20:37:16 +00:00
Jitendra Nath Pandey
7cb77a3b1b HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195620 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 19:03:55 +00:00
Arun Murthy
b3f90c7060 MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195579 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 17:33:29 +00:00
Arun Murthy
9db078212f MAPREDUCE-3035. Fixed MR JobHistory to ensure rack information is present. Contributed by chakravarthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195575 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 17:27:42 +00:00
Amar Kamat
7e056015ad MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195535 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 15:51:32 +00:00
Vinod Kumar Vavilapalli
21b1e1da49 MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195416 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 11:29:23 +00:00
Vinod Kumar Vavilapalli
a75c4cf4e4 MAPREDUCE-2696. Fixed NodeManager to cleanup logs in a thread when logs' aggregation is not enabled. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195383 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 09:55:29 +00:00
Vinod Kumar Vavilapalli
47a381e306 MAPREDUCE-3146. Added a MR specific command line to dump logs for a given TaskAttemptID. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195349 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 06:42:06 +00:00
Vinod Kumar Vavilapalli
5f9e67e226 MAPREDUCE-2766. Fixed NM to set secure permissions for files and directories in distributed-cache. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195340 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 05:51:33 +00:00
Arun Murthy
85fce9017c Adding executable svn prop on mock-container-executor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195336 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 05:29:13 +00:00
Vinod Kumar Vavilapalli
273e092c93 MAPREDUCE-3313. Fixed initialization of ClusterMetrics which was failing TestResourceTrackerService sometimes. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195319 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 03:30:56 +00:00
Vinod Kumar Vavilapalli
1c8d64f38a MAPREDUCE-3274. Fixed a race condition in MRAppMaster that was causing a task-scheduling deadlock. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195145 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-30 11:29:41 +00:00
Konstantin Shvachko
64c019cccc HDFS-2285. BackupNode should reject requests to modify namespace. Contributed by Konstantin Shvachko and Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195013 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 20:11:35 +00:00
Tsz-wo Sze
2eca60199a Revert 1190677 for HDFS-2509. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194986 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 19:31:06 +00:00
Arun Murthy
7f4dc27757 MAPREDUCE-3256. Added authorization checks for the protocol between NodeManager and ApplicationMaster. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194850 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 09:35:36 +00:00
Tsz-wo Sze
2dcd43c7b1 HDFS-2436. Change FSNamesystem.setTimes(..) for allowing setting times on directories. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190708 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 00:19:21 +00:00
Thomas White
cd77a1668f HADOOP-7763. Add top-level navigation to APT docs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190703 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 00:16:16 +00:00
Tsz-wo Sze
c8ac31e9a0 HDFS-2509. Add a test for DistributedFileSystem.getFileChecksum(..) on directories or non existing files. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190677 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 23:42:27 +00:00
Todd Lipcon
5839aa01c8 HADOOP-7446. Implement CRC32C native code using SSE4.2 instructions. Contributed by Kihwal Lee and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190650 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:51:47 +00:00
Todd Lipcon
6b0963c53b HDFS-2465. Add HDFS support for fadvise readahead and drop-behind. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190626 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:18:42 +00:00
Suresh Srinivas
c0c938f242 HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190620 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:06:04 +00:00
Suresh Srinivas
55d3dc50d1 HADOOP-7773. Add support for protocol buffer based RPC engine. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190611 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 21:55:05 +00:00
Alejandro Abdelnur
1bcff6860c Adding missing CHANGES.txt entry for MAPREDUCE-3014 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190585 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 21:27:08 +00:00
Jitendra Nath Pandey
dbe1e4de77 HADOOP-7770. ViewFS getFileChecksum throws FileNotFoundException for files in /tmp and /user. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190532 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 20:08:19 +00:00
Vinod Kumar Vavilapalli
c1e333f32f MAPREDUCE-3306. Fixed a bug in NodeManager ApplicationImpl that was causing NodeManager to crash. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190523 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 19:45:57 +00:00
Arun Murthy
b93abdcd66 MAPREDUCE-3304. Fixed intermittent test failure due to a race in TestRMContainerAllocator#testBlackListedNodes. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190495 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 18:45:48 +00:00
Tsz-wo Sze
9692cfc9ae HDFS-2493. Remove reference to FSNamesystem in blockmanagement classes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190491 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 18:28:26 +00:00
Vinod Kumar Vavilapalli
cbdb07f4ca MAPREDUCE-2775. Fixed ResourceManager and NodeManager to force a decommissioned node to shutdown. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190467 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 17:31:06 +00:00
Eric Yang
da1db28e93 HADOOP-7740. Fixed security audit logger configuration. (Arpit Gupta via Eric Yang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190452 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 17:08:09 +00:00
Vinod Kumar Vavilapalli
a39992ea63 MAPREDUCE-3296. Fixed the remaining nine FindBugs warnings. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190187 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 07:44:35 +00:00
Vinod Kumar Vavilapalli
670fa24b48 MAPREDUCE-2989. Modified JobHistory to link to task and AM logs from the JobHistoryServer. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190174 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 06:45:04 +00:00
Mahadev Konar
47c28ce14d MAPREDUCE-3292. In secure mode job submission fails with Provider org.apache.hadoop.mapreduce.security.token.JobTokenIndentifier not found. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190171 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 06:13:18 +00:00
Mahadev Konar
062876bed7 MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190165 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 06:04:51 +00:00