big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,706 Commits 2 Branches 2 Tags 264 MiB
1e346aa829
Commit Graph

1706 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsz-wo Sze
10dc6b0927 HDFS-1869. mkdirs should use the supplied permission for all of the created directories. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189546 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 00:02:19 +00:00
Arun Murthy
237154982b MAPREDUCE-3205. Fix memory specifications to be physical rather than virtual, allowing for a ratio between the two to be configurable. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189542 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 23:58:31 +00:00
Tsz-wo Sze
753c14cf4e Move webhdfs entries from trunk to 0.23 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189541 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 23:49:45 +00:00
Tsz-wo Sze
758194382c HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189360 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:24:29 +00:00
Jitendra Nath Pandey
2ce817aecf HADOOP-7766. The auth to local mappings are not being respected, with webhdfs and security enabled. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189357 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:20:07 +00:00
Jitendra Nath Pandey
8534e70044 HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189355 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:15:58 +00:00
Arun Murthy
46676b322b HADOOP-7764. Allow HttpServer to set both ACL list and path spec filters. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189314 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 17:04:45 +00:00
Arun Murthy
8aabd3d4e6 MAPREDUCE-2858. Added a WebApp Proxy for applications. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189036 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 06:29:21 +00:00
Tsz-wo Sze
8335995630 HDFS-2501. Add version prefix and root methods to webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189028 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 05:16:57 +00:00
Mahadev Konar
2adc51c618 MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. (vinodkv via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189023 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 04:31:28 +00:00
Arun Murthy
29c6c3ed32 MAPREDUCE-2977. Fix ResourceManager to renew HDFS delegation tokens for applications. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189012 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 02:53:22 +00:00
Arun Murthy
03659985a0 MAPREDUCE-3269. Fixed log4j properties to correctly set logging options for JobHistoryServer vis-a-vis JobSummary logs. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188999 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 02:16:19 +00:00
Arun Murthy
7dcef364a9 MAPREDUCE-3263. Fixed the MAPREDUCE-3028 commit which broke MR1. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188997 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 02:12:50 +00:00
Thomas White
029d86e1aa HADOOP-7769. TestJMXJsonServlet is failing. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188960 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 22:58:27 +00:00
Arun Murthy
2486e4eb09 MAPREDUCE-3253. Fixed ContextFactory to clone JobContext correctly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188842 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 18:14:12 +00:00
Arun Murthy
fffdf661e3 MAPREDUCE-2821. Added missing fields (resourcePerMap & resourcePerReduce) to JobSummary logs. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188528 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:26:14 +00:00
Mahadev Konar
d19cfe0164 MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188522 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:07:13 +00:00
Suresh Srinivas
a268a3c0e4 HDFS-2488. Separate datatypes for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188487 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 01:32:49 +00:00
Todd Lipcon
bccfd6a09f Amend MAPREDUCE-3159. Fix JavaDoc warnings in previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188479 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 01:14:17 +00:00
Arun Murthy
c70ee2488c MAPREDUCE-3248. Fixed log4j properties. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188476 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 01:03:08 +00:00
Arun Murthy
6217e54718 MAPREDUCE-3159. Ensure DefaultContainerExecutor doesn't delete application directories during app-init. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188466 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 00:36:19 +00:00
Suresh Srinivas
4846ca7863 HDFS-2497 Fix TestBackupNode failure. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188436 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 23:07:13 +00:00
Todd Lipcon
43553df4e3 MAPREDUCE-3252. Fix map tasks to not rewrite data an extra time when map output fits in spill buffer. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188424 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 22:33:02 +00:00
Arun Murthy
a503755990 MAPREDUCE-3249. Ensure shuffle-port is correctly used duringMR AM recovery. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188388 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 21:19:31 +00:00
Arun Murthy
6288dfa873 MAPREDUCE-3028. Added job-end notification support. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188377 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 21:02:43 +00:00
Sanjay Radia
0920056f04 HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188300 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 19:08:03 +00:00
Suresh Srinivas
8fe95d276d Added missing files for HDFS-2489 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188286 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 18:46:59 +00:00
Suresh Srinivas
2b35e8aa4f HDFS-2489. Move Finalize and Register to separate file out of DatanodeCommand.java. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188282 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 18:40:13 +00:00
Vinod Kumar Vavilapalli
7ce1c4ab35 MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed the configuration to use yarn names. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188236 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 17:09:37 +00:00
Vinod Kumar Vavilapalli
4086566144 MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188043 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 08:41:48 +00:00
Konstantin Shvachko
6e0991704f HDFS-2452. OutOfMemoryError in DataXceiverServer takes down the DataNode. Contributed by Uma Maheswara Rao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187965 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 20:17:04 +00:00
Steve Loughran
a54ccc0bde HDFS-2485 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187888 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 14:14:22 +00:00
Steve Loughran
2690d0db0e HDFS-2485 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187887 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 14:13:58 +00:00
Konstantin Shvachko
7dd869c2a9 HDFS-2491. TestBalancer can fail when datanode utilization and avgUtilization is exactly same. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187837 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 00:35:55 +00:00
Vinod Kumar Vavilapalli
977d7cc5b9 MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187669 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 08:11:47 +00:00
Vinod Kumar Vavilapalli
665a90cbf3 MAPREDUCE-3087. Fixed the mapreduce classpath to correctly include the generated-classpath file needed for tests. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187658 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 06:46:12 +00:00
Vinod Kumar Vavilapalli
5795fcfd99 MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187654 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 06:14:46 +00:00
Mahadev Konar
e175574635 MAPREDUCE-3242. Trunk compilation broken with bad interaction from MAPREDUCE-3070 and MAPREDUCE-3239. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187587 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 22:44:39 +00:00
Thomas White
49ab924cb5 HADOOP-7564. Remove test-patch SVN externals 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187570 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 21:58:27 +00:00
Mahadev Konar
4186121c08 MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better error messages on misconfig (Todd Lipcon via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187556 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 21:36:58 +00:00
Suresh Srinivas
d2e1a71918 HDFS-2480. Separate datatypes for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187505 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 19:03:18 +00:00
Arun Murthy
89e7ca6a52 MAPREDUCE-3070. Fix NodeManager to use ephemeral ports by default. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187496 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 18:47:39 +00:00
Mahadev Konar
45b2bce871 MAPREDUCE-3163. JobClient spews errors when killing MR2 job. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187491 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 18:35:35 +00:00
Todd Lipcon
5945a05eee MAPREDUCE-2629. Workaround a JVM class loading quirk which prevents JIT compilation of inner classes methods in ReduceContextImpl. Contributed by Eric Caspole. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187183 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 05:20:27 +00:00
Tsz-wo Sze
7c48130d41 HDFS-2427. Change the default permission in webhdfs to 755 and add range check/validation for all parameters. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187140 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 00:27:08 +00:00
Arun Murthy
02d5fa3e62 MAPREDUCE-3226. Fix shutdown of fetcher threads. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187116 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 22:44:38 +00:00
Todd Lipcon
6cd5a1b0f7 HADOOP-7749. Add a NetUtils createSocketAddr call which provides more help in exception messages. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187103 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 22:26:32 +00:00
Alejandro Abdelnur
49baada6cc MAPREDUCE-3204. mvn site:site fails on MapReduce. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187062 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 21:38:58 +00:00
Alejandro Abdelnur
0cbcc12a6e HADOOP-7758. Make GlobFilter class public. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186960 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 17:42:25 +00:00
Suresh Srinivas
520d2502c5 HDFS-2459. Separate datatypes for Journal Protocol. (suresh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186896 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 16:31:57 +00:00