Commit Graph

4074 Commits

Author SHA1 Message Date
Aaron Myers
fb95fce240 Fix issue with NN/DN re-registration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358347 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 18:59:55 +00:00
Robert Joseph Evans
0e7204c9e7 MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 17:19:13 +00:00
Thomas Graves
072292219e MAPREDUCE-4387. RM gets fatal error and exits during TestRM (Kihwal Lee via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358201 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 13:38:11 +00:00
Todd Lipcon
e0ef844280 HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357970 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 22:18:30 +00:00
Thomas Graves
3d5a44f919 MAPREDUCE-4384. Race conditions in IndexCache (Kihwal Lee via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357937 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 21:36:02 +00:00
Thomas Graves
9a43f05129 HADOOP-8563. don't package hadoop-pipes examples/bin (Colin Patrick McCabe via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357811 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 19:13:06 +00:00
Robert Joseph Evans
c1bf8a3f03 MAPREDUCE-4392. Counters.makeCompactString() changed behavior from 0.20 (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357776 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 18:09:09 +00:00
Alejandro Abdelnur
72fb517469 MAPREDUCE-4355. Add RunningJob.getJobStatus() (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357723 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 16:29:09 +00:00
Tsz-wo Sze
4d0cab2729 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 01:31:57 +00:00
Eli Collins
359b4efd19 HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356971 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 21:43:25 +00:00
Eli Collins
8188c1cb41 HADOOP-8547. Package hadoop-pipes examples/bin directory (again). Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356947 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 21:12:04 +00:00
Todd Lipcon
3728d16160 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356939 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:55:29 +00:00
Todd Lipcon
b8389e4c73 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:45:21 +00:00
Daryn Sharp
3c2101ae4a HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356897 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 19:59:56 +00:00
Suresh Srinivas
f5186dabb8 HADOOP-8434. Add tests for Configuration setter methods. Contributed by Madhukara Phatak.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356864 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 18:28:47 +00:00
Suresh Srinivas
4b2e0e15fd Moving HADOOP-8533 to release 2.0 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356857 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 18:18:46 +00:00
Todd Lipcon
8dd3148e73 HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356525 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 23:59:41 +00:00
Eli Collins
161ed29087 HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 22:46:55 +00:00
Suresh Srinivas
22822df7c3 HADOOP-8533. Remove parallel call ununsed capability in RPC. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356504 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 22:15:44 +00:00
Robert Joseph Evans
72a5f92e69 HADOOP-8548. test-patch.sh shows an incorrect link in Jekins builds (Kihwal Lee via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356430 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 19:35:07 +00:00
Robert Joseph Evans
eff5abb4f7 MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356414 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 19:02:51 +00:00
Todd Lipcon
7accbabdee HDFS-3573. Supply NamespaceInfo when instantiating JournalManagers. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356388 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 18:21:49 +00:00
Alejandro Abdelnur
2b2344a57e HDFS-3575. HttpFS does not log Exception Stacktraces (brocknoland via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356330 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 16:41:33 +00:00
Tsz-wo Sze
28e8151ad3 HDFS-3157. Fix a bug in the case that the generation stamps of the stored block in a namenode and the reported block from a datanode do not match. Contributed by Ashish Singhi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356086 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 07:26:03 +00:00
Eli Collins
dcc1d3b7f0 HADOOP-8538. CMake builds fail on ARM. Contributed by Trevor Robinson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356041 13f79535-47bb-0310-9956-ffa450edef68
2012-07-01 22:47:48 +00:00
Harsh J
511da1096a HADOOP-3450. Add tests to Local Directory Allocator for asserting their URI-returning capability. Contributed by Sho Shimauchi. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355789 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 18:51:26 +00:00
Harsh J
cb5867573e HADOOP-6802. Remove FS_CLIENT_BUFFER_DIR_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated). Contributed by Sho Shimauchi. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355784 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 18:40:34 +00:00
Harsh J
e967e98f74 MAPREDUCE-4253. Tests for mapreduce-client-core are lying under mapreduce-client-jobclient. Contributed by Tsuyoshi Ozawa. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355766 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 16:49:24 +00:00
Harsh J
06d0109314 HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355636 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 05:04:23 +00:00
Alejandro Abdelnur
5a8ea48c37 HDFS-3580. incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK (adi2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355593 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:58:32 +00:00
Todd Lipcon
802f885a55 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:24:29 +00:00
Alejandro Abdelnur
34605c9594 HDS-3491. HttpFs does not set permissions correctly (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355556 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 20:59:11 +00:00
Eli Collins
cd9ce99740 MAPREDUCE-4383. HadoopPipes.cc needs to include unistd.h. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355555 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 20:57:20 +00:00
Robert Joseph Evans
d1f05ce29f Reverting MAPREDUCE-4371 to address test failures.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355382 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 13:41:46 +00:00
Uma Maheswara Rao G
1a5978c561 HADOOP-8438. hadoop-validate-setup.sh refers to examples jar file which doesn't exist. Contributed by Devaraj K.
Submitted by: Devaraj K	
Reviewed by:	Uma Maheswara Rao G


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355211 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 02:38:37 +00:00
Suresh Srinivas
d8198d9273 Fixed CHANGES.txt name typo
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355190 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 23:01:00 +00:00
Suresh Srinivas
19dd66a3f6 HDFS-3510. Editlog pre-allocation is performed prior to writing edits to avoid partial edits case disk out of space. Contributed by Collin McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355189 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 23:00:10 +00:00
Todd Lipcon
1d54e2b331 HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355174 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 21:46:12 +00:00
Aaron Myers
9255cb83c8 HDFS-3559. DFSTestUtil: use Builder class to construct DFSTestUtil instances. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355141 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 20:04:49 +00:00
Robert Joseph Evans
78c27ca2e3 MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355139 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 19:59:19 +00:00
Robert Joseph Evans
aad2a6f0fc MAPREDUCE-4376. TestClusterMRNotification times out (Kihwal Lee via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355124 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 19:28:42 +00:00
Eli Collins
550853203b HDFS-3475. Make the replication monitor multipliers configurable. Contributed by Harsh J Chouraria
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355089 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 17:54:52 +00:00
Alejandro Abdelnur
32d3ed55d0 HADOOP-8168. empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() (ekoontz via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355085 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 17:42:44 +00:00
Robert Joseph Evans
46aad80001 HADOOP-8535. Cut hadoop build times in half (Job Eagles via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355019 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 14:22:23 +00:00
Tsz-wo Sze
f105784d6a svn merge -c -1354790 for reverting HDFS-3576 since it requires more changes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354792 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 01:25:32 +00:00
Tsz-wo Sze
44389399d4 HDFS-3576. Move the definition of the constant NameNode.DEFAULT_PORT to DFSConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354790 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 01:11:22 +00:00
Todd Lipcon
5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 22:41:41 +00:00
Suresh Srinivas
24c4216bf0 HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354684 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 19:32:21 +00:00
Alejandro Abdelnur
1b21c9836e Reverting MAPREDUCE-4346 r1353757
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354656 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 18:29:42 +00:00
Alejandro Abdelnur
c03f1dcf30 Re-amendment to previous commit JIRA was HDFS-3481
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354611 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:20:47 +00:00