Commit Graph

514 Commits

Author SHA1 Message Date
Alejandro Abdelnur
11312adedb HADOOP-8749. HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381703 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 18:15:37 +00:00
Eli Collins
91e832e7b4 HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 19:42:09 +00:00
Suresh Srinivas
4911d9b1ff HADOOP-8736. Add Builder for building RPC server. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379652 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 22:40:51 +00:00
Robert Joseph Evans
38d003a6db HADOOP-8727. Gracefully deprecate dfs.umaskmode in 2.x onwards (Harsh J via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379537 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 18:27:23 +00:00
Suresh Srinivas
e5a9d672f0 HADOOP-8684. Deadlock between WritableComparator and WritableComparable. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379506 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 17:01:25 +00:00
Robert Joseph Evans
6f6e170325 HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 19:58:07 +00:00
Tsz-wo Sze
ec94ea2658 HADOOP-8748. Refactor DFSClient retry utility methods to a new class in org.apache.hadoop.io.retry. Contributed by Arun C Murthy
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378969 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 14:50:18 +00:00
Suresh Srinivas
e7b12c89e1 HADOOP-8619. WritableComparator must implement no-arg constructor. Contributed by Chris Douglas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378120 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 13:05:31 +00:00
Suresh Srinivas
deead78e35 HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 01:03:22 +00:00
Suresh Srinivas
7a1dc1ab70 HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377001 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 17:36:22 +00:00
Robert Joseph Evans
cffee556e4 HADOOP-8725. MR is broken when security is off (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376929 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 14:16:41 +00:00
Alejandro Abdelnur
bbf1f55bee HADOOP-8031. Configuration class fails to find embedded .jar resources; should use URL.openStream() (genman via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376772 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 23:24:25 +00:00
Alejandro Abdelnur
fc1fab9084 HADOOP-4572. Can not access user logs - Jetty is not configured by default to serve aliases/symlinks (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376753 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 22:52:47 +00:00
Robert Joseph Evans
4f8e1f779b HADOOP-8709. globStatus changed behavior from 0.20/1.x (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376653 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 19:18:05 +00:00
Robert Joseph Evans
aeb364d8b5 HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 18:06:56 +00:00
Robert Joseph Evans
34bd9794f7 HADOOP-8655. Fix TextInputFormat for large deliminators. (Gelesh via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376592 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 16:58:36 +00:00
Robert Joseph Evans
42beb56a2e HADOOP-8632. Configuration leaking class-loaders (Costin Leau via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376543 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 15:24:46 +00:00
Eli Collins
5b790ab046 HADOOP-8075. Lower native-hadoop library log from info to debug. Contributed by Hızır Sefa İrken
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376322 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 00:01:00 +00:00
Aaron Myers
d66223fd99 HADOOP-8721. ZKFC should not retry 45 times when attempting a graceful fence during a failover. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376194 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 18:54:02 +00:00
Aaron Myers
de8b34a70e HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376188 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 18:47:07 +00:00
Suresh Srinivas
e8477759ac HADOOP-8711. IPC Server supports adding exceptions for which the message is printed and the stack trace is not printed to avoid chatter. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375790 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 21:01:28 +00:00
Tsz-wo Sze
f2dd818201 HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C. Contributed by Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375450 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 09:44:46 +00:00
Robert Joseph Evans
d5f080825c HADOOP-8611. Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails (Robert Parker via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375221 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 21:17:13 +00:00
Eli Collins
f58941f2ac HADOOP-8614. IOUtils#skipFully hangs forever on EOF. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375216 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 21:10:44 +00:00
Tsz-wo Sze
b0ea77303b HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374696 13f79535-47bb-0310-9956-ffa450edef68
2012-08-19 05:46:57 +00:00
Eli Collins
54621c3776 HADOOP-8710. Remove ability for users to easily run the trash emptire. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374476 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 23:26:55 +00:00
Eli Collins
18c5bc86ca HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374472 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 23:22:17 +00:00
Daryn Sharp
8fa10b184e HADOOP-7967. Need generalized multi-token filesystem support (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 14:05:11 +00:00
Robert Joseph Evans
2926ae6ead HADOOP-8654. TextInputFormat delimiter bug (Gelesh and Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373859 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 14:23:28 +00:00
Tsz-wo Sze
3cab01ba6e HADOOP-8700. Use enum to define the checksum constants in DataChecksum.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 01:32:10 +00:00
Alejandro Abdelnur
5aeabcdf6f HADOOP-7754. Expose file descriptors from Hadoop-wrapped local FileSystems (todd and ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373235 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 06:40:29 +00:00
Alejandro Abdelnur
fd8ce04dc5 HADOOP-8699. some common testcases create core-site.xml in test-classes making other testcases to fail. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373206 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 04:21:04 +00:00
Suresh Srinivas
28e87740c5 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 00:28:41 +00:00
Todd Lipcon
b38bd555e8 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:11:40 +00:00
Alejandro Abdelnur
4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 22:52:56 +00:00
Aaron Myers
9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 16:40:03 +00:00
Alejandro Abdelnur
5383694df9 HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370045 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 22:22:32 +00:00
Thomas Graves
12d0e02591 HADOOP-8633. Interrupted FsShell copies may leave tmp files (Daryn Sharp via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368002 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 14:02:22 +00:00
Robert Joseph Evans
75be1e0e76 HADOOP-8637. FilterFileSystem#setWriteChecksum is broken (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367702 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 18:58:43 +00:00
Robert Joseph Evans
7226dead1e HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367296 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 20:58:44 +00:00
Robert Joseph Evans
48a2e2b4e2 HADOOP-8550. hadoop fs -touchz automatically created parent directories (John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367202 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 18:11:32 +00:00
Robert Joseph Evans
d8584fde03 HADOOP-8634. Ensure FileSystem#close doesn't squawk for deleteOnExit paths (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367196 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 18:05:38 +00:00
Robert Joseph Evans
98f1523b20 HADOOP-8627. FS deleteOnExit may delete the wrong path (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367114 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 15:18:11 +00:00
Daryn Sharp
b3b72482e4 HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366440 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 16:39:51 +00:00
Aaron Myers
c1ea9b4490 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 00:26:21 +00:00
Todd Lipcon
2f478ac89c HADOOP-8642. ProtobufRpcEngine should log all RPCs if TRACE logging is enabled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366127 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 18:22:00 +00:00
Alejandro Abdelnur
9d16c9354b MAPREDUCE-4417. add support for encrypted shuffle (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 13:23:05 +00:00
Todd Lipcon
06b394dcf9 Amend previous commit of HDFS-3626: accidentally included a hunk from HADOOP-8621 in svn commit. Reverting that hunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365817 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 22:04:59 +00:00
Todd Lipcon
972953bd77 HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 21:52:38 +00:00
Robert Joseph Evans
0bfa7d79d0 HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365588 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 13:56:29 +00:00
Robert Joseph Evans
a2d5603106 HADOOP-8606. FileSystem.get may return the wrong filesystem (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365224 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 19:00:50 +00:00
Aaron Myers
80e2b4117b HADOOP-8609. IPC server logs a useless message when shutting down socket. Contributed by Jon Zuanich.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363950 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 20:50:30 +00:00
Robert Joseph Evans
4c51dacd52 Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363547 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 21:15:42 +00:00
Robert Joseph Evans
52c8271bf1 HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363435 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 17:46:47 +00:00
Todd Lipcon
30099efb35 HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362295 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 22:41:56 +00:00
Suresh Srinivas
2799d9659d HADOOP-8593. Add missed @Override annotations in Metric/Metrics2 package. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362294 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 22:38:29 +00:00
Eli Collins
4b519219de Amend HDFS-3666, applied earlier version of the patch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362278 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 21:49:35 +00:00
Eli Collins
527933f4f3 HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 21:26:58 +00:00
Robert Joseph Evans
612443951b MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 14:19:36 +00:00
Harsh J
0f122c209d HADOOP-8531. SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available. Contributed by Madhukara Phatak. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361933 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 08:33:13 +00:00
Eli Collins
64fc2cb03d HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 19:43:39 +00:00
Harsh J
7351a01259 HADOOP-7818. DiskChecker#checkDir should fail if the directory is not executable. Contributed by Madhukara Phatak. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361717 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 15:33:27 +00:00
Harsh J
385f31ad85 HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. Contributed by Madhukara Phatak and Suresh Srinivas (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361712 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 15:07:02 +00:00
Eli Collins
4a5ba3b7bd HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 19:01:49 +00:00
Aaron Myers
b5b0ac64a1 HADOOP-8541. Better high-percentile latency metrics. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360501 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 01:31:40 +00:00
Aaron Myers
96d77c17cc HADOOP-8585. Fix initialization circularity between UserGroupInformation and HadoopConfiguration. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360498 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 01:22:34 +00:00
Eli Collins
4c13b6f34e HADOOP-8587. HarFileSystem access of harMetaCache isn't threadsafe. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360448 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 22:28:54 +00:00
Eli Collins
cdae6953e8 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 17:58:02 +00:00
Harsh J
e5ea2aa765 HADOOP-3886. Error in javadoc of Reporter, Mapper and Progressable. Contributed by Jingguo Yao. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360222 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 15:06:42 +00:00
Eli Collins
43e37b96f8 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360056 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 08:21:22 +00:00
Eli Collins
151a1b0185 Revert previous commit, accidentally included HADOOP-8587.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360055 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 08:19:59 +00:00
Eli Collins
c41b97860d HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360048 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 08:10:00 +00:00
Thomas Graves
58a8826fb5 HADOOP-8573. Configuration tries to read from an inputstream resource multiple times (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359891 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 20:50:17 +00:00
Harsh J
caf9fe2f13 HADOOP-8423. MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data. Contributed by Todd Lipcon. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359866 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 19:58:49 +00:00
Aaron Myers
fb4a6ac9e9 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359824 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 18:28:13 +00:00
Robert Joseph Evans
0b7139d6bc HADOOP-8525. Provide Improved Traceability for Configuration (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359775 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 16:49:24 +00:00
Alejandro Abdelnur
820be7cbef MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 19:19:00 +00:00
Alejandro Abdelnur
0a2252bdda HADOOP-8566. AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays). (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358454 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 22:27:13 +00:00
Robert Joseph Evans
0e7204c9e7 MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 17:19:13 +00:00
Tsz-wo Sze
4d0cab2729 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 01:31:57 +00:00
Todd Lipcon
3728d16160 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356939 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:55:29 +00:00
Todd Lipcon
b8389e4c73 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:45:21 +00:00
Daryn Sharp
3c2101ae4a HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356897 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 19:59:56 +00:00
Eli Collins
161ed29087 HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 22:46:55 +00:00
Suresh Srinivas
22822df7c3 HADOOP-8533. Remove parallel call ununsed capability in RPC. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356504 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 22:15:44 +00:00
Harsh J
cb5867573e HADOOP-6802. Remove FS_CLIENT_BUFFER_DIR_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated). Contributed by Sho Shimauchi. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355784 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 18:40:34 +00:00
Harsh J
06d0109314 HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355636 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 05:04:23 +00:00
Todd Lipcon
802f885a55 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:24:29 +00:00
Alejandro Abdelnur
32d3ed55d0 HADOOP-8168. empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() (ekoontz via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355085 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 17:42:44 +00:00
Todd Lipcon
5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 22:41:41 +00:00
Siddharth Seth
a945336368 MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353038 13f79535-47bb-0310-9956-ffa450edef68
2012-06-22 21:40:35 +00:00
Harsh J
d1138f0914 HADOOP-8524. Allow users to get source of a Configuration parameter. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352689 13f79535-47bb-0310-9956-ffa450edef68
2012-06-21 21:12:31 +00:00
Tsz-wo Sze
ed7040f07b HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351445 13f79535-47bb-0310-9956-ffa450edef68
2012-06-18 18:23:10 +00:00
Tsz-wo Sze
9ab9bc9f37 Revert r1351163 for fixing the JIRA number; it should be HADOOP-8470 but not HADOOP-8468.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351444 13f79535-47bb-0310-9956-ffa450edef68
2012-06-18 18:20:41 +00:00
Tsz-wo Sze
19ac5c4e8b HADOOP-8468. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351163 13f79535-47bb-0310-9956-ffa450edef68
2012-06-17 21:12:25 +00:00
Eli Collins
07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 02:42:52 +00:00
Eli Collins
0199fe9763 HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349561 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 22:10:12 +00:00
Alejandro Abdelnur
4d4661802e HDFS-3228. Move DelegationTokenRenewer to common (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 21:52:46 +00:00
Eli Collins
797c8548d0 Revert HADOOP-8491
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349133 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 06:22:06 +00:00
Tsz-wo Sze
45fafc2b8f HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 05:27:15 +00:00