big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
12,620 Commits 2 Branches 2 Tags 264 MiB
64ae85fd2e
Commit Graph

1901 Commits

Author SHA1 Message Date
Eli Collins
2115bd2ec7 HADOOP-8886. Remove KFS support. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395820 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 00:16:26 +00:00
Aaron Myers
2b49b39f3c Revert initial commit of HADOOP-8884 per feedback from Todd. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395783 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 21:25:37 +00:00
Aaron Myers
2a32ba9f99 HADOOP-8884. DEBUG should be WARN for DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError. Contributed by Anthony Rojas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395714 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:44:59 +00:00
Eli Collins
c50033d0c8 HADOOP-8804. Improve Web UIs when the wildcard address is used. Contributed by Senthil Kumar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395703 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:17:39 +00:00
Alejandro Abdelnur
50b20477fd HADOOP-8881. FileBasedKeyStoresFactory initialization logging should be debug not info. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394165 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 17:32:01 +00:00
Daryn Sharp
a7d4f30131 HADOOP-8783. Improve RPC.Server's digest auth (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393483 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 13:43:53 +00:00
Eli Collins
fc54f57c59 HADOOP-8756. Fix SEGV when libsnappy is in java.library.path but not LD_LIBRARY_PATH. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393243 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 00:06:39 +00:00
Aaron Myers
ccabb684eb HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392707 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:28:17 +00:00
Aaron Myers
c808caea75 Revert an errant commit of HADOOP-8616. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392705 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:26:27 +00:00
Aaron Myers
d1f4ec4ac8 HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392703 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 01:17:00 +00:00
Aaron Myers
1ced82cc81 HADOOP-8866. SampleQuantiles#query is O(N^2) instead of O(N). Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391711 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 00:59:04 +00:00
Eli Collins
a33ae4020d HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390841 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 05:03:42 +00:00
Eli Collins
47dfcf45af HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 21:25:04 +00:00
Jason Darrell Lowe
6ddbb22567 HADOOP-8843. Old trash directories are never deleted on upgrade from 1.x. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390616 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-26 17:14:27 +00:00
Todd Lipcon
9270635f33 HADOOP-3957. Change MutableQuantiles to use a shared thread for rolling over metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390210 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 23:16:14 +00:00
Harsh J
a7e450c7cc HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured. Contributed by Brahma Reddy Battula. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389799 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 11:10:11 +00:00
Harsh J
d50e06d9e0 HADOOP-7930. Kerberos relogin interval in UserGroupInformation should be configurable. Contributed by Robert Kanter. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389783 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 10:17:11 +00:00
Suresh Srinivas
5308a0ecd5 HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 23:16:04 +00:00
Owen O'Malley
0187553d9a Fix the length of the secret key. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389194 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 03:45:07 +00:00
Harsh J
28379070d4 HADOOP-8588. SerializationFactory shouldn't throw a NullPointerException if the serializations list is empty. Contributed by Sho Shimauchi. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389002 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-23 10:32:13 +00:00
Harsh J
28023b7759 HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388893 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-22 20:34:16 +00:00
Harsh J
bd76d9a827 HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388869 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-22 18:56:07 +00:00
Eli Collins
7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-21 04:51:43 +00:00
Suresh Srinivas
4c56bccf5e HADOOP-8814. Replace string equals by String#isEmpty(). Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387853 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-20 04:06:11 +00:00
Alejandro Abdelnur
8bf6b80f2b Reverting HADOOP-8805 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387697 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 18:06:42 +00:00
Alejandro Abdelnur
9f6cfe32e4 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387298 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 18:15:37 +00:00
Eli Collins
ea6a36e2e7 HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387273 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:32:01 +00:00
Eli Collins
4d2e77bc1c Revert previous commit - accidentally included two changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386783 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:28:14 +00:00
Eli Collins
8a9debd0ef HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 19:25:05 +00:00
Suresh Srinivas
6afabd7e57 HADOOP-8819. Incorrectly & is used instead of && in some file system implementations. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386451 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 01:39:11 +00:00
Suresh Srinivas
5d37911882 HADOOP-8821. Fix findbugs warning related concatenating string in a for loop in Configuration#dumpDeprecatedKeys(). Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385389 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-16 22:33:13 +00:00
Suresh Srinivas
0c53ed4cd1 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-16 21:10:39 +00:00
Thomas White
d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 16:05:30 +00:00
Eli Collins
eb7f8a71e0 HADOOP-8801. ExitUtil#terminate should capture the exception stack trace. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384435 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 17:56:49 +00:00
Doug Cutting
de2efbe3ba HADOOP-8597. Permit FsShell's text command to read Avro files. Contributed by Ivan Vladimirov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383607 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 20:38:45 +00:00
Todd Lipcon
bdcbc2d1ef HADOOP-8786. HttpServer continues to start even if AuthenticationFilter fails to init. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383254 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 06:37:17 +00:00
Tsz-wo Sze
e8c193bf24 HADOOP-8754. Deprecate all the RPC.getServer() variants. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381845 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-07 03:09:53 +00:00
Alejandro Abdelnur
11312adedb HADOOP-8749. HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381703 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-06 18:15:37 +00:00
Eli Collins
91e832e7b4 HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-05 19:42:09 +00:00
Suresh Srinivas
4911d9b1ff HADOOP-8736. Add Builder for building RPC server. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379652 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 22:40:51 +00:00
Robert Joseph Evans
38d003a6db HADOOP-8727. Gracefully deprecate dfs.umaskmode in 2.x onwards (Harsh J via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379537 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 18:27:23 +00:00
Suresh Srinivas
e5a9d672f0 HADOOP-8684. Deadlock between WritableComparator and WritableComparable. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379506 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-31 17:01:25 +00:00
Robert Joseph Evans
6f6e170325 HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 19:58:07 +00:00
Tsz-wo Sze
ec94ea2658 HADOOP-8748. Refactor DFSClient retry utility methods to a new class in org.apache.hadoop.io.retry. Contributed by Arun C Murthy 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378969 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-30 14:50:18 +00:00
Suresh Srinivas
e7b12c89e1 HADOOP-8619. WritableComparator must implement no-arg constructor. Contributed by Chris Douglas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378120 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-28 13:05:31 +00:00
Suresh Srinivas
deead78e35 HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-25 01:03:22 +00:00
Suresh Srinivas
7a1dc1ab70 HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377001 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 17:36:22 +00:00
Robert Joseph Evans
cffee556e4 HADOOP-8725. MR is broken when security is off (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376929 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-24 14:16:41 +00:00
Alejandro Abdelnur
bbf1f55bee HADOOP-8031. Configuration class fails to find embedded .jar resources; should use URL.openStream() (genman via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376772 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 23:24:25 +00:00
Alejandro Abdelnur
fc1fab9084 HADOOP-4572. Can not access user logs - Jetty is not configured by default to serve aliases/symlinks (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376753 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 22:52:47 +00:00
Robert Joseph Evans
4f8e1f779b HADOOP-8709. globStatus changed behavior from 0.20/1.x (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376653 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 19:18:05 +00:00
Robert Joseph Evans
aeb364d8b5 HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 18:06:56 +00:00
Robert Joseph Evans
34bd9794f7 HADOOP-8655. Fix TextInputFormat for large deliminators. (Gelesh via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376592 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 16:58:36 +00:00
Robert Joseph Evans
42beb56a2e HADOOP-8632. Configuration leaking class-loaders (Costin Leau via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376543 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 15:24:46 +00:00
Eli Collins
5b790ab046 HADOOP-8075. Lower native-hadoop library log from info to debug. Contributed by Hızır Sefa İrken 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376322 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-23 00:01:00 +00:00
Aaron Myers
d66223fd99 HADOOP-8721. ZKFC should not retry 45 times when attempting a graceful fence during a failover. Contributed by Vinayakumar B. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376194 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:54:02 +00:00
Aaron Myers
de8b34a70e HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376188 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-22 18:47:07 +00:00
Suresh Srinivas
e8477759ac HADOOP-8711. IPC Server supports adding exceptions for which the message is printed and the stack trace is not printed to avoid chatter. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375790 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 21:01:28 +00:00
Tsz-wo Sze
f2dd818201 HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375450 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-21 09:44:46 +00:00
Robert Joseph Evans
d5f080825c HADOOP-8611. Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails (Robert Parker via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375221 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-20 21:17:13 +00:00
Eli Collins
f58941f2ac HADOOP-8614. IOUtils#skipFully hangs forever on EOF. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375216 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-20 21:10:44 +00:00
Tsz-wo Sze
b0ea77303b HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374696 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-19 05:46:57 +00:00
Eli Collins
54621c3776 HADOOP-8710. Remove ability for users to easily run the trash emptire. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374476 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 23:26:55 +00:00
Eli Collins
18c5bc86ca HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374472 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 23:22:17 +00:00
Daryn Sharp
8fa10b184e HADOOP-7967. Need generalized multi-token filesystem support (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-17 14:05:11 +00:00
Robert Joseph Evans
2926ae6ead HADOOP-8654. TextInputFormat delimiter bug (Gelesh and Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373859 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 14:23:28 +00:00
Tsz-wo Sze
3cab01ba6e HADOOP-8700. Use enum to define the checksum constants in DataChecksum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 01:32:10 +00:00
Alejandro Abdelnur
5aeabcdf6f HADOOP-7754. Expose file descriptors from Hadoop-wrapped local FileSystems (todd and ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373235 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 06:40:29 +00:00
Alejandro Abdelnur
fd8ce04dc5 HADOOP-8699. some common testcases create core-site.xml in test-classes making other testcases to fail. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373206 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 04:21:04 +00:00
Suresh Srinivas
28e87740c5 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:28:41 +00:00
Todd Lipcon
b38bd555e8 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:11:40 +00:00
Alejandro Abdelnur
4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:52:56 +00:00
Aaron Myers
9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 16:40:03 +00:00
Alejandro Abdelnur
5383694df9 HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370045 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 22:22:32 +00:00
Thomas Graves
12d0e02591 HADOOP-8633. Interrupted FsShell copies may leave tmp files (Daryn Sharp via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368002 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 14:02:22 +00:00
Robert Joseph Evans
75be1e0e76 HADOOP-8637. FilterFileSystem#setWriteChecksum is broken (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367702 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 18:58:43 +00:00
Robert Joseph Evans
7226dead1e HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367296 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 20:58:44 +00:00
Robert Joseph Evans
48a2e2b4e2 HADOOP-8550. hadoop fs -touchz automatically created parent directories (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367202 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 18:11:32 +00:00
Robert Joseph Evans
d8584fde03 HADOOP-8634. Ensure FileSystem#close doesn't squawk for deleteOnExit paths (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367196 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 18:05:38 +00:00
Robert Joseph Evans
98f1523b20 HADOOP-8627. FS deleteOnExit may delete the wrong path (daryn via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367114 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 15:18:11 +00:00
Daryn Sharp
b3b72482e4 HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366440 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 16:39:51 +00:00
Aaron Myers
c1ea9b4490 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 00:26:21 +00:00
Todd Lipcon
2f478ac89c HADOOP-8642. ProtobufRpcEngine should log all RPCs if TRACE logging is enabled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366127 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 18:22:00 +00:00
Alejandro Abdelnur
9d16c9354b MAPREDUCE-4417. add support for encrypted shuffle (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-26 13:23:05 +00:00
Todd Lipcon
06b394dcf9 Amend previous commit of HDFS-3626: accidentally included a hunk from HADOOP-8621 in svn commit. Reverting that hunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365817 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 22:04:59 +00:00
Todd Lipcon
972953bd77 HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:52:38 +00:00
Robert Joseph Evans
0bfa7d79d0 HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365588 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 13:56:29 +00:00
Robert Joseph Evans
a2d5603106 HADOOP-8606. FileSystem.get may return the wrong filesystem (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365224 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-24 19:00:50 +00:00
Aaron Myers
80e2b4117b HADOOP-8609. IPC server logs a useless message when shutting down socket. Contributed by Jon Zuanich. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363950 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 20:50:30 +00:00
Robert Joseph Evans
4c51dacd52 Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363547 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 21:15:42 +00:00
Robert Joseph Evans
52c8271bf1 HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363435 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 17:46:47 +00:00
Todd Lipcon
30099efb35 HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362295 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 22:41:56 +00:00
Suresh Srinivas
2799d9659d HADOOP-8593. Add missed @Override annotations in Metric/Metrics2 package. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362294 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 22:38:29 +00:00
Eli Collins
4b519219de Amend HDFS-3666, applied earlier version of the patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362278 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 21:49:35 +00:00
Eli Collins
527933f4f3 HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 21:26:58 +00:00
Robert Joseph Evans
612443951b MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 14:19:36 +00:00
Harsh J
0f122c209d HADOOP-8531. SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361933 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 08:33:13 +00:00
Eli Collins
64fc2cb03d HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 19:43:39 +00:00
Harsh J
7351a01259 HADOOP-7818. DiskChecker#checkDir should fail if the directory is not executable. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361717 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 15:33:27 +00:00
Harsh J
385f31ad85 HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. Contributed by Madhukara Phatak and Suresh Srinivas (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361712 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 15:07:02 +00:00
Eli Collins
4a5ba3b7bd HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 19:01:49 +00:00
Aaron Myers
b5b0ac64a1 HADOOP-8541. Better high-percentile latency metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360501 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 01:31:40 +00:00
Aaron Myers
96d77c17cc HADOOP-8585. Fix initialization circularity between UserGroupInformation and HadoopConfiguration. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360498 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 01:22:34 +00:00
Eli Collins
4c13b6f34e HADOOP-8587. HarFileSystem access of harMetaCache isn't threadsafe. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360448 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 22:28:54 +00:00
Eli Collins
cdae6953e8 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 17:58:02 +00:00
Harsh J
e5ea2aa765 HADOOP-3886. Error in javadoc of Reporter, Mapper and Progressable. Contributed by Jingguo Yao. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360222 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 15:06:42 +00:00
Eli Collins
43e37b96f8 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360056 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:21:22 +00:00
Eli Collins
151a1b0185 Revert previous commit, accidentally included HADOOP-8587. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360055 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:19:59 +00:00
Eli Collins
c41b97860d HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360048 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:10:00 +00:00
Thomas Graves
58a8826fb5 HADOOP-8573. Configuration tries to read from an inputstream resource multiple times (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359891 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 20:50:17 +00:00
Harsh J
caf9fe2f13 HADOOP-8423. MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data. Contributed by Todd Lipcon. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359866 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 19:58:49 +00:00
Aaron Myers
fb4a6ac9e9 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359824 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 18:28:13 +00:00
Robert Joseph Evans
0b7139d6bc HADOOP-8525. Provide Improved Traceability for Configuration (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359775 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 16:49:24 +00:00
Alejandro Abdelnur
820be7cbef MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-09 19:19:00 +00:00
Alejandro Abdelnur
0a2252bdda HADOOP-8566. AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays). (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358454 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 22:27:13 +00:00
Robert Joseph Evans
0e7204c9e7 MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 17:19:13 +00:00
Tsz-wo Sze
4d0cab2729 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 01:31:57 +00:00
Todd Lipcon
3728d16160 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356939 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:55:29 +00:00
Todd Lipcon
b8389e4c73 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:45:21 +00:00
Daryn Sharp
3c2101ae4a HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356897 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 19:59:56 +00:00
Eli Collins
161ed29087 HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 22:46:55 +00:00
Suresh Srinivas
22822df7c3 HADOOP-8533. Remove parallel call ununsed capability in RPC. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356504 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 22:15:44 +00:00
Harsh J
cb5867573e HADOOP-6802. Remove FS_CLIENT_BUFFER_DIR_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated). Contributed by Sho Shimauchi. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355784 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-30 18:40:34 +00:00
Harsh J
06d0109314 HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355636 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-30 05:04:23 +00:00
Todd Lipcon
802f885a55 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-29 22:24:29 +00:00
Alejandro Abdelnur
32d3ed55d0 HADOOP-8168. empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() (ekoontz via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355085 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 17:42:44 +00:00
Todd Lipcon
5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 22:41:41 +00:00
Siddharth Seth
a945336368 MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353038 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-22 21:40:35 +00:00
Harsh J
d1138f0914 HADOOP-8524. Allow users to get source of a Configuration parameter. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352689 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-21 21:12:31 +00:00
Tsz-wo Sze
ed7040f07b HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351445 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-18 18:23:10 +00:00
Tsz-wo Sze
9ab9bc9f37 Revert r1351163 for fixing the JIRA number; it should be HADOOP-8470 but not HADOOP-8468. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351444 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-18 18:20:41 +00:00
Tsz-wo Sze
19ac5c4e8b HADOOP-8468. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351163 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-17 21:12:25 +00:00
Eli Collins
07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 02:42:52 +00:00
Eli Collins
0199fe9763 HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349561 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 22:10:12 +00:00
Alejandro Abdelnur
4d4661802e HDFS-3228. Move DelegationTokenRenewer to common (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 21:52:46 +00:00
Eli Collins
797c8548d0 Revert HADOOP-8491 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349133 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 06:22:06 +00:00
Tsz-wo Sze
45fafc2b8f HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 05:27:15 +00:00
Eli Collins
6e3ebf4d73 HADOOP-8491. Check for short writes when using FileChannel#write and related methods. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349019 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-11 21:20:28 +00:00
Tsz-wo Sze
415ce38b82 HADOOP-8469. Make NetworkTopology class pluggable. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347867 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-08 02:29:40 +00:00
Robert Joseph Evans
8d559d2d9a HADOOP-8452. DN logs backtrace when running under jsvc and /jmx is loaded (Andy Isaacson via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344733 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 14:10:16 +00:00
Tsz-wo Sze
83cf475050 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 19:10:09 +00:00
Harsh J
d2b57e00bc HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343290 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 15:36:00 +00:00
Harsh J
4709160d75 HADOOP-6871. When the value of a configuration key is set to its unresolved form, it causes an IllegalStateException in Configuration.get() stating that substitution depth is too large. Contributed by Arvind Prabhakar (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342626 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 14:02:01 +00:00
Harsh J
ceaf168dc7 HADOOP-7659. fs -getmerge isn't guaranteed to work well over non-HDFS filesystems (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342600 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 12:46:22 +00:00
Harsh J
e62a76a40c HADOOP-8323. Add javadoc and tests for Text.clear() behavior (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342514 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:38:16 +00:00
Harsh J
458be39423 HADOOP-8415. Add getDouble() and setDouble() in org.apache.hadoop.conf.Configuration. Contributed by Jan van der Lugt. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342501 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:06:01 +00:00
Eli Collins
22cb0ec82a HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 04:10:15 +00:00
Todd Lipcon
6c544adeb3 Merge HDFS-3042 (automatic failover) to trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 00:56:20 +00:00
Sanjay Radia
266a0f1de9 HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers (Sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342051 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 21:16:39 +00:00
Aaron Myers
23b96766ad Amend HADOOP-8408 per Daryn's post-commit feedback. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341338 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-22 07:50:00 +00:00
Todd Lipcon
1a3bd5d42f Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 06:12:14 +00:00
Eli Collins
eae281c130 HADOOP-8408. MR doesn't work with a non-default ViewFS mount table and security enabled. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339970 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 04:20:28 +00:00
Aaron Myers
1377709b4c HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 10:23:18 +00:00
Todd Lipcon
026d0b4d53 HADOOP-8406. CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339476 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 04:28:35 +00:00
Todd Lipcon
7b1d347b43 HADOOP-8405. ZKFC tests leak ZK instances. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339435 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 00:38:59 +00:00
Todd Lipcon
0600e834be HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 00:36:13 +00:00
Todd Lipcon
e14e10fb86 Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339410 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 22:47:37 +00:00
Todd Lipcon
52ecdb751e HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1338817 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 18:16:49 +00:00
Eli Collins
b64cd82a34 HADOOP-8398. Cleanup BlockLocation. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338806 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 17:25:49 +00:00
Harsh J
f22276ee3f HADOOP-8297. Writable javadocs don't carry default constructor (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338557 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 06:42:42 +00:00
Todd Lipcon
4cd70e87be Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337645 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 20:52:34 +00:00
Harsh J
810ae618fd HADOOP-8395. Text shell command unnecessarily demands that a SequenceFile's key class be WritableComparable (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337449 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 06:03:39 +00:00
Sanjay Radia
2116f28d9e HADOOP-8366 Use ProtoBuf for RpcResponseHeader (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337283 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 16:56:52 +00:00
Thomas White
aea890f7d2 MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 15:00:48 +00:00
Eli Collins
dfd733401d HADOOP-8388. Remove unused BlockLocation serialization. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336966 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:48:12 +00:00
Eli Collins
1a4539abf7 Remove SHORT_STRING_MAX, left out of the previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336946 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:17:29 +00:00
Eli Collins
032216a3a7 HADOOP-8361. Avoid out-of-memory problems when deserializing strings. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336945 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:15:53 +00:00
Aaron Myers
f5960f71d9 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336690 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 13:49:06 +00:00
Todd Lipcon
b75f0187c8 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 00:30:53 +00:00
Suresh Srinivas
1ceecf2aa2 HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname starting with a numeric character. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336446 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-09 23:18:15 +00:00
Tsz-wo Sze
07280c9761 HADOOP-8359. Fix javadoc warnings in Configuration. Contributed by Anupam Seth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335258 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 21:11:01 +00:00
Thomas White
35a33067bb HADOOP-8328. Duplicate FileSystem Statistics object for 'file' scheme. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335085 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 16:00:56 +00:00
Harsh J
e7d03636a0 HADOOP-8323. Revert HADOOP-7940, cause it may cause a performance regression. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334603 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-06 11:20:16 +00:00
Aaron Myers
51e520c68a HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334231 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 22:14:10 +00:00
Eli Collins
5dbbe0e0a5 HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334216 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 21:58:44 +00:00
Alejandro Abdelnur
a70587f368 HADOOP-8343. Allow configuration of authorization for JmxJsonServlet and MetricsServlet (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333750 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 03:31:44 +00:00
Alejandro Abdelnur
af66607406 HADOOP-8356. FileSystem service loading mechanism should print the FileSystem impl it is failing to load (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333744 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 03:10:26 +00:00
Todd Lipcon
6b58fa6494 Amend previous commit of HADOOP-8350 (missed new SocketInputWrapper file) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333650 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 21:58:08 +00:00
Todd Lipcon
03181022ab HADOOP-8350. Improve NetUtils.getInputStream to return a stream which has a tunable timeout. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333649 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 21:57:10 +00:00
Eli Collins
d948998777 HADOOP-8347. Hadoop Common logs misspell 'successful'. Contributed by Philip Zeyliger 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333321 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 06:35:45 +00:00
Todd Lipcon
f6c01e2f8e Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 02:14:01 +00:00
Todd Lipcon
9d5799553f HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 01:56:33 +00:00
Alejandro Abdelnur
a5a2abbacc HADOOP-8342. HDFS command fails with exception following merge of HADOOP-8325 (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333224 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-02 21:48:39 +00:00
Thomas Graves
70c392df0e HADOOP-8339. jenkins complaining about 16 javadoc warnings (Tom White and Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332853 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 21:46:58 +00:00
Eli Collins
bbfda83044 HADOOP-8275. Range check DelegationKey length. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332839 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 21:25:36 +00:00
Robert Joseph Evans
7d1b804d3a HADOOP-8172. Configuration no longer sets all keys in a deprecated key list. (Anupam Seth via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332821 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 21:00:52 +00:00
Robert Joseph Evans
1e88c1f088 HADOOP-8335. Improve Configuration's address handling (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332427 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 21:55:26 +00:00
Alejandro Abdelnur
8a0c7323ce HADOOP-8325. Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332345 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 19:21:11 +00:00
Robert Joseph Evans
097a001b3f HADOOP-8334. HttpServer sometimes returns incorrect port (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332336 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 18:56:42 +00:00
Robert Joseph Evans
500dc61523 HADOOP-8305. distcp over viewfs is broken (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331440 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 14:39:35 +00:00
Alejandro Abdelnur
17e03547dc HADOOP-8321. TestUrlStreamHandler fails. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331073 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 20:35:58 +00:00
Aaron Myers
4b62c68292 HADOOP-8310. FileContext#checkPath should handle URIs with no port. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331007 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 18:19:01 +00:00
Thomas Graves
e84b552713 HADOOP-8296. hadoop/yarn daemonlog usage wrong (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330445 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 17:59:08 +00:00
Alejandro Abdelnur
e29ede3f72 HADOOP-8314. HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330086 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 03:20:53 +00:00
Alejandro Abdelnur
706e861a85 HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329994 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 20:33:05 +00:00
Todd Lipcon
c6e1321245 HADOOP-8306. ZKFC: improve error message when ZK is not running. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1329960 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 19:34:51 +00:00
Eli Collins
858887e289 HADOOP-8152. Expand public APIs for security library classes. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329541 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 03:59:35 +00:00
Sanjay Radia
589c68ae09 HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 16:34:21 +00:00
Thomas White
0363ca0489 HADOOP-7350. Use ServiceLoader to discover compression codec classes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328083 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 19:20:31 +00:00
Robert Joseph Evans
f6cadd8610 HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328018 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 16:05:34 +00:00
Todd Lipcon
ca49126e3d Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 23:35:30 +00:00
Aaron Myers
c21bd72a2f HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 17:06:38 +00:00
Aaron Myers
1675c18ded Revert HADOOP-8280 so it can be recommitted using `svn mv' 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 16:49:04 +00:00
Robert Joseph Evans
e8eed2f62d HADOOP-8227. Allow RPC to limit ephemeral port range. (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327127 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 15:04:20 +00:00
Robert Joseph Evans
a98ba41092 HADOOP-8286. Simplify getting a socket address from conf (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327108 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 14:21:11 +00:00
Aaron Myers
551468385c HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 18:28:36 +00:00
Robert Joseph Evans
047a7b276c HADOOP-7510. Tokens should use original hostname provided instead of ip (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325500 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 20:43:18 +00:00
Eli Collins
f01ede227f HADOOP-8144. pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325367 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 16:37:15 +00:00
Todd Lipcon
2bf19979b3 Merge trunk into auto-failover branch. 
Needs a few tweaks to fix compilation - will do in followup commit. This is just a straight merge


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324567 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:47:40 +00:00
Todd Lipcon
41a014c31b HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:40:26 +00:00
Robert Joseph Evans
482e0638e8 HADOOP-8264. Remove irritating double double quotes in front of hostname (Bernd Fondermann via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311738 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 14:12:02 +00:00
Todd Lipcon
4b0d4d54d9 HADOOP-8263. Stringification of IPC calls not useful. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311543 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 01:02:05 +00:00
Aaron Myers
909176c1fc HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311133 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 05:56:22 +00:00
Todd Lipcon
693ec453d2 HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310919 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 23:24:57 +00:00
Todd Lipcon
ca6f0940fd Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310905 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 22:53:55 +00:00
Robert Joseph Evans
fcb3ff5d18 HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310555 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 19:16:13 +00:00
Robert Joseph Evans
534591697c HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310507 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 17:54:40 +00:00
Todd Lipcon
30068a1d83 Merge trunk into auto-failover branch. 
Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 05:07:33 +00:00
Todd Lipcon
d483b6f3fc HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:56:26 +00:00
Todd Lipcon
04cc1d614d HADOOP-8251. Fix SecurityUtil.fetchServiceTicket after HADOOP-6941. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310168 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:47:05 +00:00
Todd Lipcon
844faefd08 HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:27:44 +00:00
Tsz-wo Sze
bf5b508074 HADOOP-6963. In FileUtil.getDU(..), neither include the size of directories nor follow symbolic links. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309994 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 18:28:34 +00:00
Aaron Myers
8a109ebebb HADOOP-8244. Improve comments on ByteBufferReadable.read. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309625 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 23:36:29 +00:00
Todd Lipcon
00a1548005 Merge trunk into auto-HA branch 
Resolved some trivial conflicts in NNHAServiceTarget


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:00:15 +00:00
Robert Joseph Evans
fcacb14a1e HADOOP-8179. risk of NPE in CopyCommands processArguments() (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309572 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:53:09 +00:00
Todd Lipcon
b74d742785 HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:21:01 +00:00
Todd Lipcon
dae6daba8c HADOOP-8007. Use substitution tokens for fencing argument. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309285 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 08:27:16 +00:00
Todd Lipcon
30e1b3bba8 HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 23:37:15 +00:00
Todd Lipcon
39a5fd5c71 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309164 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 21:48:23 +00:00
Todd Lipcon
84ff2d6d06 HADOOP-8243. Security support broken in CLI (manual) failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309135 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 20:41:26 +00:00
Eli Collins
9b1d2949ae HADOOP-8242. AbstractDelegationTokenIdentifier: add getter methods for owner and realuser. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308485 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:22:10 +00:00
Eli Collins
950273bde4 HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308457 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 18:49:06 +00:00
Todd Lipcon
2fd05aa597 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308260 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 07:28:42 +00:00
Todd Lipcon
a4ccb8f504 HADOOP-8236. haadmin should have configurable timeouts for failover commands. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308235 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 03:48:28 +00:00
Eli Collins
78e3568340 HADOOP-8238. NetUtils#getHostNameOfIP blows up if given ip:port string w/o port. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308192 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 20:07:03 +00:00
Todd Lipcon
543701387f HADOOP-8228. Auto HA: Refactor tests and add stress tests. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307599 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:30:47 +00:00
Todd Lipcon
6693167028 HADOOP-8220. ZKFailoverController doesn't handle failure to become active correctly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307596 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:23:59 +00:00
Todd Lipcon
04416861eb Amend HADOOP-8212 (Improve ActiveStandbyElector's behavior when session expires) 
Amendment patch incorporates following feedback from Bikas Saha:
- adds a new functional test for session expiration while in the standby state
- adds a safety check in the StatCallback for session expiration
- improves some comments


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307128 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:49:37 +00:00
Eli Collins
978404d1a8 HADOOP-8208. Disallow self failover. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306935 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:48:58 +00:00
Todd Lipcon
84a97fbcf6 HADOOP-8218. RPC.closeProxy shouldn't throw error when closing a mock. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306164 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 04:53:26 +00:00
Suresh Srinivas
600e327a56 HADOOP-8202. RPC stopProxy() does not close the proxy correctly. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305704 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 01:31:29 +00:00
Todd Lipcon
578f413778 HADOOP-8206. Common portion of a ZK-based failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305673 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 23:37:33 +00:00
Todd Lipcon
31c2e3f29c HADOOP-8212. Improve ActiveStandbyElector's behavior when session expires. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305510 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 19:31:43 +00:00
Todd Lipcon
1d5e7dde95 HADOOP-8204. TestHealthMonitor fails occasionally. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305199 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 01:57:03 +00:00
Todd Lipcon
840df19cee HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305195 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 01:54:14 +00:00
Todd Lipcon
39775dca68 Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305152 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-25 21:38:31 +00:00
Todd Lipcon
90ea037d21 HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304967 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 23:48:07 +00:00
Todd Lipcon
805c1280ce HADOOP-8163. Improve ActiveStandbyElector to provide hooks for fencing old active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304675 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 00:05:33 +00:00
Thomas White
1ff0359aa0 HADOOP-7030. Add TableMapping topology implementation to read host to rack mapping from a file. Contributed by Patrick Angeles and tomwhite. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304597 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:03:30 +00:00
Tsz-wo Sze
081eda94fe HADOOP-8184. ProtoBuf RPC engine uses the IPC layer reply packet. Contributed by Sanjay Radia 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304542 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 18:21:45 +00:00
Todd Lipcon
b795c65f49 HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 06:29:40 +00:00
Eli Collins
b5a8ccb75b HADOOP-8159. NetworkTopology: getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304118 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 22:43:28 +00:00
Alejandro Abdelnur
a8ebdaeb08 HADOOP-8197. Configuration logs WARNs on every use of a deprecated key (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303884 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 16:46:48 +00:00
Todd Lipcon
76817c28a2 HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303634 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 00:49:06 +00:00
Todd Lipcon
19495b2f4b HADOOP-7788. Add simple HealthMonitor class to watch an HAService. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303208 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 23:29:18 +00:00
Todd Lipcon
8fd473cf4c HADOOP-8191. SshFenceByTcpPort uses netcat incorrectly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303148 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 21:01:39 +00:00
Aaron Myers
4ceca97606 HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303098 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 19:00:56 +00:00
Aaron Myers
12fca4cf33 HADOOP-8189. LdapGroupsMapping shouldn't throw away IOException. Contributed by Jonathan Natkins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302783 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 06:32:49 +00:00
Aaron Myers
21426e6e42 HADOOP-8121. Active Directory Group Mapping Service. Contributed by Jonathan Natkins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302740 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 01:00:14 +00:00
Harsh J
978e2d662a HADOOP-8183. Stop using mapred.used.genericoptions.parser (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302598 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 19:06:48 +00:00
Uma Maheswara Rao G
a019a6f7c9 HADOOP-8177. MBeans shouldn't try to register when it fails to create MBeanName. (Contributed by Devaraj K). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302067 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-18 05:54:33 +00:00
Robert Joseph Evans
0ac5e89419 HADOOP-8088. User-group mapping cache incorrectly does negative caching on transient failures (Khiwal Lee via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302062 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-18 04:07:41 +00:00
Robert Joseph Evans
af3163d1d1 HADOOP-8176. Disambiguate the destination of FsShell copies (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301612 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 16:08:00 +00:00
Robert Joseph Evans
3e8c273f37 MAPREDUCE-4010. TestWritableJobConf fails on trunk (tucu via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301551 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 14:39:01 +00:00
Devaraj Das
2a0147f8f6 HADOOP-6941. Adds support for building Hadoop with IBM's JDK. Contributed by Stephen Watt, Eli Collins and Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301308 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 01:45:12 +00:00
Tsz-wo Sze
483ca92d9b HADOOP-8175. Add -p option to mkdir in FsShell. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301303 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 01:28:38 +00:00
Tsz-wo Sze
c7feccd7ed Revert previous commit r1301273 for HADOOP-8175. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301282 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 23:53:37 +00:00
Tsz-wo Sze
889a863da1 HADOOP-8175. FsShell: Add -p option to mkdir. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301273 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 23:42:38 +00:00
Tsz-wo Sze
dffd37926d HADOOP-8173. FsShell needs to handle quoted metachars. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301250 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 22:36:00 +00:00
Alejandro Abdelnur
9180eca592 HADOOP-8167. Configuration deprecation logic breaks backwards compatibility (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300642 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 17:07:26 +00:00
Suresh Srinivas
03e036b51e HADOOP-8164. Back slash as path separator is handled for Windows only. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300290 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 19:07:08 +00:00
Uma Maheswara Rao G
42900bd080 HADOOP-7900. LocalDirAllocator confChanged() accesses conf.get() twice. Contributed by Ravi Gummadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299434 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-11 19:23:45 +00:00
Uma Maheswara Rao G
3c373405e0 HADOOP-8146. FsShell commands cannot be interrupted. Contributed by Daryn Shar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298976 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 18:48:35 +00:00
Eli Collins
07c3b02281 HADOOP-7806. Support binding to sub-interfaces. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298700 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 04:43:06 +00:00
Eli Collins
d8cc362350 HADOOP-8154. DNS#getIPs shouldn't silently return the local host IP for bogus interface names. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298696 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 03:51:15 +00:00
Todd Lipcon
0aeed92a75 HADOOP-8141. Add method to SecurityUtil to init krb5 cipher suites. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298036 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 18:42:53 +00:00
Robert Joseph Evans
bb86825d49 HADOOP-8140. dfs -getmerge should process its argments better (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297771 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 22:44:26 +00:00
Aaron Myers
26cd2356e0 HADOOP-8135. Add ByteBufferReadable interface to FSDataInputStream. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296556 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 02:02:23 +00:00
Aaron Myers
ffa527138b Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296485 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 21:43:28 +00:00
Robert Joseph Evans
97d104767d HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296386 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 19:03:05 +00:00
Todd Lipcon
87d1c67944 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:48:32 +00:00
Aaron Myers
7be4e5bd22 HDFS-3039. Address findbugs and javadoc warnings on branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296017 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 01:32:49 +00:00
Tsz-wo Sze
b2f67b4704 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 23:51:19 +00:00
Todd Lipcon
1d3a0c9557 Fix two more issues from trunk merge just committed -- removal of VersionedProtocol 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295349 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 00:08:13 +00:00
Todd Lipcon
1ba357553a Merge trunk into HA branch. 
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 23:47:49 +00:00
Sanjay Radia
7ae04652a6 HADOOP-7557 Make IPC header be extensible (sanjay radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295261 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 20:43:21 +00:00
Tsz-wo Sze
2249e004d0 HADOOP-8118. In metrics2.util.MBeans, change log level to trace for the stack trace of InstanceAlreadyExistsException. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295240 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 19:57:43 +00:00
Harsh J
e478bc4384 HADOOP-7940. The Text.clear() method does not clear the bytes as intended. Contributed by Csaba Miklos. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295061 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 10:52:22 +00:00
Jitendra Nath Pandey
271654c6f5 HADOOP-7994. Remove getProtocolVersion and getProtocolSignature from the client side translator and server side implementation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295016 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 08:52:21 +00:00
Aaron Myers
978a8050e2 HDFS-2920. fix remaining TODO items. Contributed by Aaron T. Myers and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294923 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 01:09:07 +00:00
Aaron Myers
375c6b8f2e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294762 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 18:33:41 +00:00
Alejandro Abdelnur
e43656c711 HADOOP-8098. KerberosAuthenticatorHandler should use _HOST replacement to resolve principal name (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294757 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 18:26:53 +00:00
Aaron Myers
328702891e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293279 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 14:49:38 +00:00
Jitendra Nath Pandey
584a1ca1f7 HADOOP-8108. Move method getHostPortString() from NameNode to NetUtils. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293128 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 08:16:40 +00:00
Suresh Srinivas
22d5944c42 HADOOP-8085. Add RPC metrics to ProtobufRpcEngine. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293071 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-24 04:05:39 +00:00
Aaron Myers
60ab29759e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291893 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 16:24:40 +00:00
Devaraj Das
ae7e43139d HADOOP-8084. Updates ProtoBufRpc engine to not do an unnecessary copy for RPC request/response. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291602 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 05:19:53 +00:00
Aaron Myers
f0db867292 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-20 18:33:37 +00:00
Matthew Foley
def0ac8060 HADOOP-8050. Deadlock in metrics. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291084 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-19 22:45:12 +00:00
Steve Loughran
145338bc44 HADOOP-7680 TestHardLink fails on Mac OS X, when gnu stat is in path. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1290868 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 21:05:06 +00:00
Steve Loughran
3f8d7dbde3 HADOOP-8046 Revert StaticMapping semantics to the existing ones, add DNS mapping diagnostics in progress 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245911 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-18 12:57:49 +00:00
Aaron Myers
53b7d6c6bc Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 18:19:31 +00:00
Robert Joseph Evans
1425c65b5e HADOOP-8054. NPE with FilterFileSystem (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245637 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 16:27:27 +00:00
Aaron Myers
7933dc5838 HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245338 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 07:37:43 +00:00
Aaron Myers
833e96534f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-16 18:35:32 +00:00
Eli Collins
1ceb0eeaf4 HADOOP-8074. Small bug in hadoop error message for unknown commands. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244766 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:23:20 +00:00
Aaron Myers
1fb0ab92f8 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 19:04:17 +00:00
Todd Lipcon
cdc8146bd4 HADOOP-8068. void methods can swallow exceptions when going through failover path. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244628 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:20:11 +00:00
Todd Lipcon
063be5749d HADOOP-6502. Improve the performance of Configuration.getClassByName when the class is not found by caching negative results. Contributed by Sharad Agarwal and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244620 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 18:10:21 +00:00
Aaron Myers
011611c765 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 20:37:10 +00:00
Todd Lipcon
f42e58c381 HADOOP-8071. Avoid an extra packet in client code when nagling is disabled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244189 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 19:47:02 +00:00
Todd Lipcon
82ffe0e732 HADOOP-8070. Add a standalone benchmark for RPC call performance. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244185 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 19:29:42 +00:00
Todd Lipcon
db187cf40e Merge trunk into HA branch. 
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 21:00:37 +00:00
Matthew Foley
00ee0585ab HADOOP-8052. Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's gmetad core. Contributed by Varun Kapoor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243207 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-12 07:47:35 +00:00
Todd Lipcon
a626fa04f9 Revert HDFS-2922 via svn merge -c -1242572 
The patch broke a lot of unit tests in the nightly build. Will recommit after it is fixed.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242874 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 18:17:21 +00:00
Todd Lipcon
c14bb61a82 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 01:49:08 +00:00
Eli Collins
8af96c7b22 HDFS-2917. HA: haadmin should not work if run by regular user. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242626 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 00:46:17 +00:00
Thomas Graves
2a2faac0de HADOOP-8048. Allow merging of Credentials (Daryn Sharp via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242616 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 00:17:49 +00:00
Eli Collins
a63e12c4c8 HDFS-2922. HA: close out operation categories. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242572 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 22:33:20 +00:00
Todd Lipcon
1b4c990b61 HADOOP-8041. Log a warning when a failover is first attempted. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242441 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 18:25:44 +00:00
Todd Lipcon
5e26de982b HDFS-2924. Standby checkpointing fails to authenticate in secure cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242439 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 18:22:02 +00:00
Robert Joseph Evans
7f7b05226e HADOOP-8042. When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242389 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 16:41:44 +00:00
Todd Lipcon
e918b91e23 HDFS-2579. Starting delegation token manager during safemode fails. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242225 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 06:12:01 +00:00
Aaron Myers
2d1406e9e7 HADOOP-8027. Visiting /jmx on the daemon web interfaces may print unnecessary error in logs. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241303 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 01:09:34 +00:00
Eli Collins
c17b4f8eef HDFS-2819. Document new HA-related configs in hdfs-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240914 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 08:21:06 +00:00
Eli Collins
7b913180be HDFS-2808. HA: haadmin should use namenode ids. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240600 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 20:12:51 +00:00
Aaron Myers
ec6961b39c HDFS-2792. Make fsck work. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240449 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 03:10:39 +00:00
Robert Joseph Evans
da00476fca HADOOP-8013 ViewFileSystem does not honor setVerifyChecksum (Dayrn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240383 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 22:55:52 +00:00
Robert Joseph Evans
7e8bf2c7ee HADOOP-8015 ChRootFileSystem should extend FilterFileSystem (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239924 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 23:24:04 +00:00
Eli Collins
4324e1bcd7 HADOOP-7991. HA: the FailoverController should check the standby is ready before failing over. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239774 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 19:20:32 +00:00
Robert Joseph Evans
58ba16e85f HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum files (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239727 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 17:12:44 +00:00
Robert Joseph Evans
f8a245c273 HADOOP-8006 TestFSInputChecker is failing in trunk. (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238841 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 22:40:25 +00:00
Eli Collins
6884348444 HADOOP-7938. HA: the FailoverController should optionally fence the active during failover. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238058 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 22:42:46 +00:00
Eli Collins
5c156519df HADOOP-7983. HA: failover should be able to pass args to fencers. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238049 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 22:27:42 +00:00
Aaron Myers
6122357da5 HDFS-2841. HAAdmin does not work if security is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237534 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 02:52:27 +00:00
Aaron Myers
30dd704e6c Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237157 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 20:33:30 +00:00
Mahadev Konar
934047630a HADOOP-8002. SecurityUtil acquired token message should be a debug rather than info. (Arpit Gupta via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236976 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 04:05:19 +00:00
Todd Lipcon
327c216c2f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 02:50:23 +00:00
Jitendra Nath Pandey
ed6a73140e HADOOP-7988. Upper case in hostname part of the principals doesn't work with kerberos. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236960 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 02:24:08 +00:00
Aaron Myers
2b2e56056e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 00:21:07 +00:00
Robert Joseph Evans
cc8a2a29f1 HADOOP-7998 CheckFileSystem does not correctly honor setVerifyChecksum (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236911 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 22:42:47 +00:00
Mahadev Konar
c8bb6f59b8 HADOOP-7993. Hadoop ignores old-style config options for enabling compressed output. (Anupam Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236506 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 03:42:36 +00:00
Eli Collins
c5caed914d HADOOP-7997. SequenceFile.createWriter(...createParent...) no longer works on existing file. Contributed by Gregory Chanan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236456 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 00:09:10 +00:00
Jitendra Nath Pandey
12289efa2b HADOOP-7965. Support for protocol version and signature in PB. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236444 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 23:23:03 +00:00
Aaron Myers
1c95060a72 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 18:03:46 +00:00
Jitendra Nath Pandey
a00640a3db HADOOP-7987. Support setting the run-as user in unsecure mode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235945 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-25 21:02:47 +00:00
Suresh Srinivas
cbfe8fea0e HADOOP-7992. Add ZKClient library to facilitate leader election. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235841 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-25 17:26:20 +00:00
Jitendra Nath Pandey
0b2245a0f3 HDFS-2807. Service level authorizartion for HAServiceProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235431 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 19:31:49 +00:00
Todd Lipcon
fa4a33a566 Merge trunk into HA branch. 
- Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function
- testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon 


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 00:00:05 +00:00
Mahadev Konar
f07d91a1fc HADOOP-7981. Improve documentation for org.apache.hadoop.io.compress.Decompressor.getRemaining (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235007 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 21:44:49 +00:00
Aaron Myers
2abe5c818d Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 19:30:53 +00:00
Todd Lipcon
b7eb5334f5 HADOOP-7982. UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233751 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 03:33:50 +00:00
Todd Lipcon
212678f036 HDFS-2767. ConfiguredFailoverProxyProvider should support NameNodeProtocol. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232284 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 03:10:25 +00:00
Aaron Myers
940eeb866c Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 21:57:28 +00:00
Harsh J
a9002bfea1 HADOOP-7968. Errant println left in RPC.getHighestSupportedProtocol (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231732 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-15 19:15:04 +00:00
Suresh Srinivas
72207596be HADOOP-7972. HAServiceProtocol exceptions need to be unwrapped. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230861 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 02:30:29 +00:00
Aaron Myers
8610a9231a Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 18:40:50 +00:00
Suresh Srinivas
09e5af76f3 HADOOP-7970. HAServiceProtocol methods must throw IOException.Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230351 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 01:39:30 +00:00
Suresh Srinivas
8f83a2355b HADOOP-7964. Deadlock in NetUtils and SecurityUtil class initialization. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230249 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 21:02:04 +00:00
Aaron Myers
ede7f21278 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230248 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 20:53:50 +00:00
Todd Lipcon
44d070cd01 HDFS-2724. NN web UI can throw NPE after startup, before standby state is entered. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229466 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 03:46:05 +00:00
Vinod Kumar Vavilapalli
8feb26f116 HADOOP-7963. Fix ViewFS to catch a null canonical service-name and pass tests TestViewFileSystem* (Siddharth Seth via vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229379 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 21:52:53 +00:00
Eli Collins
fcf1039cdc Previous commit didn't fixup package statements. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228561 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 03:29:35 +00:00
Eli Collins
2d0b340c47 HADOOP-7961. Move HA fencing to common. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228510 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 00:17:42 +00:00
Aaron Myers
d680080da0 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 18:47:05 +00:00
Thomas White
a878bea3fe HADOOP-7937. Forward port SequenceFile#syncFs and friends from Hadoop 1.x. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228291 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 17:24:55 +00:00
Harsh J
574f0b4c0a HADOOP-4515. Configuration#getBoolean must not be case sensitive. (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227964 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 05:42:24 +00:00
Aaron Myers
20af88280a Fix bad merge which mixed up two configuration options. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227962 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 05:37:24 +00:00
Jitendra Nath Pandey
a230d19d99 HADOOP-7957. Classes deriving GetGroupsBase should be able to override proxy creation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227861 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 21:56:47 +00:00
Eli Collins
fb9cdcfa60 HADOOP-7924. 
FailoverController for client-based configuration. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227836 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 21:02:59 +00:00
Aaron Myers
3187a3ae05 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 19:21:01 +00:00
Suresh Srinivas
4bb572d336 HADOOP-7808. Port HADOOP-7510 - Add configurable option to use original hostname in token instead of IP to allow server IP change. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227737 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 18:41:59 +00:00
Eli Collins
85c4158074 HADOOP-7949. Updated maxIdleTime default in the code to match core-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227423 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:31:14 +00:00
Aaron Myers
cd81cc6664 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227260 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 18:47:51 +00:00
Siddharth Seth
7ee3e072b8 HADOOP-7933. Add a getDelegationTokens api to FileSystem which checks for known tokens in the passed Credentials object. (sseth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226916 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-03 18:58:57 +00:00
Aaron Myers
f216303598 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225612 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 18:25:48 +00:00
Harsh J
07027b80f3 HADOOP-7910. Add Configuration.getLongBytes to handle human readable byte size values. (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225489 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 10:27:14 +00:00
Aaron Myers
d619dee4ed Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225264 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 18:37:22 +00:00
Harsh J
1e0c51c66e HADOOP-7348. Change 'addnl' in getmerge util to be a flag '-nl' instead (XieXianshan via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225192 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 14:30:19 +00:00
Harsh J
9eb87574a3 HADOOP-7574. Improve FSShell -stat, add user/group elements (XieXianshan via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225114 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 06:48:31 +00:00
Aaron Myers
a500ba50c2 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1224965 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 18:18:36 +00:00
Alejandro Abdelnur
ae0d48854d HDFS-2707. HttpFS should read the hadoop-auth secret from a file instead inline from the configuration. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224794 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-26 19:37:25 +00:00
Todd Lipcon
009dfed8d7 HADOOP-7932. Make client connection retries on socket time outs configurable. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220957 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 21:32:55 +00:00
Todd Lipcon
8ff28f4549 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220616 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 05:34:51 +00:00
Todd Lipcon
45e81ae415 HADOOP-7925. Add interface and update CLI to query current state to HAServiceProtocol. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220611 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 05:21:24 +00:00
Todd Lipcon
191b56d802 HADOOP-7657. Add support for LZ4 compression. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220314 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 00:54:18 +00:00
Aaron Myers
08c9dc3780 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215367 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:31:46 +00:00
Aaron Myers
059290ce3a HADOOP-7931. o.a.h.ipc.WritableRpcEngine should have a way to force initialization. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215358 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:14:36 +00:00
Aaron Myers
116bf57bd6 HADOOP-7928. HA: Client failover policy is incorrectly trying to fail over all IOExceptions. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215019 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 01:54:44 +00:00
Todd Lipcon
b77c107ccb Committing rest of merge from trunk (accidentally only committed the HDFS portion before) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214546 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 23:34:04 +00:00
Suresh Srinivas
d9c9fb913e HADOOP-7920. Remove Avro Rpc. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214114 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:45:59 +00:00
Todd Lipcon
d5a658e7a4 HADOOP-7921. StandbyException should extend IOException. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214093 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:10:34 +00:00
Todd Lipcon
9cf3e0805f HADOOP-7922. Improve some logging for client IPC failovers and StandbyExceptions. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214082 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 07:51:30 +00:00
Aaron Myers
9818091a66 HADOOP-7896. HA: if both NNs are in Standby mode, client needs to try failing back and forth several times with sleeps. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214076 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 07:24:36 +00:00
Todd Lipcon
fac14e799a HADOOP-7892. IPC logs too verbose after "RpcKind" introduction. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213954 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 21:59:34 +00:00
Alejandro Abdelnur
0201be46c2 HADOOP-7810. move hadoop archive to core from tools. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213907 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 20:17:59 +00:00
Aaron Myers
a0fe4f476a Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213867 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 19:02:37 +00:00
Sanjay Radia
186df142cc HADOOP-7913 Fix bug in ProtoBufRpcEngine (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213619 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 09:18:04 +00:00
Aaron Myers
89379bc1a3 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213389 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 19:41:20 +00:00
Alejandro Abdelnur
ad7d537caa HADOOP-7899. Generate proto java files as part of the build. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212615 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 20:37:57 +00:00
Alejandro Abdelnur
66fce20802 HADOOP-7902. skipping name rules setting (if already set) should be done on UGI initialization only. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212591 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 19:28:25 +00:00
Amar Kamat
82d57ee7fe HADOOP-7851. Configuration.getClasses() never returns the default value. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212282 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 08:50:09 +00:00
Eli Collins
2deaca4415 HADOOP-6886. LocalFileSystem Needs createNonRecursive API. Contributed by Nicolas Spiegelberg and Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212073 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:57:14 +00:00
Eli Collins
dec526076f HADOOP-6840. Support non-recursive create() in FileSystem and SequenceFile.Writer. Contributed by Jitendra and Eli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212062 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:29:02 +00:00
Suresh Srinivas
4283ac6d7a HADOOP-7897. ProtobufRpcEngine client side exception mechanism is not consistent with WritableRpcEngine. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212004 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 17:47:06 +00:00
Aaron Myers
d9ea5bb489 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211749 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 02:57:47 +00:00
Aaron Myers
d9690b0922 HADOOP-7888. TestFailoverProxy fails intermittently on trunk. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211728 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 01:21:24 +00:00
Alejandro Abdelnur
58361d3f34 HADOOP-7887. KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211673 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 22:17:35 +00:00
Jakob Homan
788f28b679 HADOOP-7886. Add toString to FileStatus. Contributed by SreeHari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210793 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 06:35:02 +00:00
Aaron Myers
8a4db4d331 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210547 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 18:00:44 +00:00
Suresh Srinivas
0acc00bbab HADOOP-7876. Provided access to encoded key in DelegationKey for use in protobuf based RPCs. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210320 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 03:40:34 +00:00
Suresh Srinivas
560c8946ea HADOOP-7875. Add helper class to unwrap protobuf ServiceException. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210319 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 03:33:15 +00:00
Sanjay Radia
65200998c0 HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:44:36 +00:00
Aaron Myers
2033b52673 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209169 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 18:15:46 +00:00
Jitendra Nath Pandey
efc83da2a0 HADOOP-7854. UGI getCurrentUser is not synchronized. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208926 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 01:13:42 +00:00
Alejandro Abdelnur
d8930feeae HADOOP-7853. multiple javax security configurations cause conflicts. (daryn via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208751 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 20:26:36 +00:00
Aaron Myers
73b3de6204 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207490 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 18:21:46 +00:00
Eli Collins
229a3a2312 HADOOP-7858. Drop some info logging to DEBUG level in IPC, metrics, and HTTP. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206830 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 20:27:23 +00:00
Eli Collins
cb5c6c90c4 HADOOP-7859. TestViewFsHdfs.testgetFileLinkStatus is failing an assert. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206786 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 17:58:39 +00:00
Steve Loughran
783dbb4125 HADOOP-7777 a base class for DNSToSwitchMapping implementations 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206515 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-26 17:45:21 +00:00
Konstantin Shvachko
e3c6965519 HADOOP-7358. Improve log levels when exceptions caught in RPC handler. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205697 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 01:52:29 +00:00
Todd Lipcon
6a0671977b Merge trunk into HDFS-1623 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1204794 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 03:18:47 +00:00
Eli Collins
eec2782287 HADOOP-6614. RunJar should provide more diags when it can't create a temp file. Contributed by Jonathan Hsieh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204388 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 08:00:59 +00:00
Eli Collins
d4306d4bd1 HADOOP-7783. Add more symlink tests that cover intermediate links. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204376 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 07:11:07 +00:00
Eli Collins
5760d03c87 Revert accidental change in previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204372 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 07:06:05 +00:00
Eli Collins
9c2f4f634d HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204370 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 07:01:29 +00:00
Aaron Myers
0d171f6513 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1202013 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 02:39:13 +00:00
Tsz-wo Sze
a83753b735 HADOOP-7688. Add servlet handler check in HttpServer.start(). Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198924 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-07 20:51:15 +00:00
Sanjay Radia
072bdd85d1 HADOOP-7776 Make the Ipc-Header in a RPC-Payload an explicit header (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197885 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-05 05:06:44 +00:00
Aaron Myers
571d7990f4 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1196458 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 05:34:31 +00:00
Jitendra Nath Pandey
cd2a553fbd HADOOP-7792. Common component for HDFS-2416: Add verifyToken method to AbstractDelegationTokenSecretManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196386 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 23:15:13 +00:00
Eli Collins
1852c2c1da Remove FsConfig as intended in HADOOP-7786. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196143 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 17:08:53 +00:00
Eli Collins
877021eb50 HADOOP-7786. Remove HDFS-specific config keys defined in FsConfig. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196129 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 16:58:28 +00:00
Todd Lipcon
a6c110ebd0 HADOOP-7785. Add equals, hashcode, toString to DataChecksum. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195832 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 05:25:21 +00:00
Thomas White
8e04fa8b84 HADOOP-7782. Aggregate project javadocs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195817 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 04:47:10 +00:00
Tsz-wo Sze
8f9661da48 HADOOP-7771. FsShell -copyToLocal, -get, etc. commands throw NPE if the destination directory does not exist. Contributed by John George and Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195760 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:50:56 +00:00
Suresh Srinivas
55d3dc50d1 HADOOP-7773. Add support for protocol buffer based RPC engine. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190611 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 21:55:05 +00:00
Todd Lipcon
b4992f671d HADOOP-7774. HA: Administrative CLI to control HA daemons. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190584 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 21:24:04 +00:00
Jitendra Nath Pandey
dbe1e4de77 HADOOP-7770. ViewFS getFileChecksum throws FileNotFoundException for files in /tmp and /user. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190532 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 20:08:19 +00:00
Eli Collins
29b51cc116 HADOOP-7424. Log an error if the topology script doesn't handle multiple args. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190139 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 02:26:54 +00:00
Tsz-wo Sze
659ea4c540 HADOOP-7360. Preserve relative paths that do not contain globs in FsShell. Contributed by Daryn Sharp and Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190109 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:13:49 +00:00
Thomas White
101962e598 HADOOP-7778. FindBugs warning in Token.getKind(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190095 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 23:50:11 +00:00
Todd Lipcon
78336e717b HADOOP-7753. Support fadvise and sync_file_range in NativeIO. Add ReadaheadPool infrastructure for use in HDFS and MR. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190067 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 22:19:13 +00:00
Steve Loughran
a3c0a0e799 HADOOP-7772 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189847 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 16:29:44 +00:00
Todd Lipcon
0e75187199 HADOOP-7761. Improve the performance of raw comparisons. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189613 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 05:59:05 +00:00
Arun Murthy
46676b322b HADOOP-7764. Allow HttpServer to set both ACL list and path spec filters. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189314 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 17:04:45 +00:00
Thomas White
029d86e1aa HADOOP-7769. TestJMXJsonServlet is failing. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188960 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 22:58:27 +00:00
Mahadev Konar
d19cfe0164 MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188522 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:07:13 +00:00
Todd Lipcon
6cd5a1b0f7 HADOOP-7749. Add a NetUtils createSocketAddr call which provides more help in exception messages. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187103 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 22:26:32 +00:00
Alejandro Abdelnur
0cbcc12a6e HADOOP-7758. Make GlobFilter class public. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186960 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 17:42:25 +00:00
Alejandro Abdelnur
01d408d5b0 Reverted HDFS-2474 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186501 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:29:01 +00:00
Alejandro Abdelnur
2edd042f8a HDFS-2474. Make GlobFilter class public. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186498 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:17:35 +00:00
Todd Lipcon
a11f67fb78 HADOOP-7729. Send back valid HTTP response if user hits IPC port with HTTP GET. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183512 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 21:44:35 +00:00
Steve Loughran
65861ab51f HADOOP-7705 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183292 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 10:53:01 +00:00
Jitendra Nath Pandey
002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:24:20 +00:00
Suresh Srinivas
0c77d705be HADOOP-7545. Fix wrong variable name in exception message introduced in HADOOP-7509. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183132 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 22:05:37 +00:00
Suresh Srinivas
d15e60777b HADOOP-7664. Remove warmings when overriding final parameter configuration if the override value is same as the final parameter value. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182645 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 03:38:58 +00:00
Suresh Srinivas
3e6d128c83 HADOOP-7509. Improve exception message thrown when Authentication is required. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182641 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 03:23:34 +00:00
Harsh J
68328e29be HADOOP-7736. Remove duplicate Path#normalizePath call. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182214 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 06:20:23 +00:00
Harsh J
eba49b8b11 HADOOP-6490. Use StringUtils over String#replace in Path#normalizePath. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182189 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 03:19:01 +00:00
Aaron Myers
e95dfd8931 HADOOP-7695. RPC.stopProxy can throw unintended exception while logging error (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179512 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 06:08:16 +00:00
Aaron Myers
60dcc5f237 Merging trunk to HDFS-1623 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179484 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 01:16:48 +00:00
Aaron Myers
14569ab482 HADOOP-7717. Move handling of concurrent client fail-overs to RetryInvocationHandler (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179483 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 01:01:19 +00:00
Eric Yang
9b6671dc29 HADOOP-7704. Reduce number of object created by JMXJsonServlet. 
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179287 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 16:09:27 +00:00
Eric Yang
c90d7d649b HADOOP-7703. Improved excpetion handling of shutting down web server. 
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179286 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 16:06:05 +00:00
Sanjay Radia
2d45bfdffd HADOOP-7716 RPC protocol registration on SS does not log the protocol name 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178639 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 23:39:25 +00:00
Vinod Kumar Vavilapalli
4ee39ffe6a HADOOP-7542. Reverting the patch to address issues. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178308 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 06:45:10 +00:00
Steve Loughran
ebdc7f800a HADOOP-7469 Add a standard handler for socket connection problems 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177645 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 13:22:05 +00:00
Doug Cutting
47c8528bfa HADOOP-7693. Enhance AvroRpcEngine to support the new #addProtocol introduced in HADOOP-724. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177399 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 19:03:10 +00:00
Suresh Srinivas
ab0402bc1d Merging trunk to HDFS-1623 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177130 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 00:42:47 +00:00
Suresh Srinivas
9992cae541 Reverting the previous trunk merge since it added other unintended changes in addition 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177127 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 00:33:34 +00:00
Suresh Srinivas
122113922f Merging trunk to HDFS-1623 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177117 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 00:09:56 +00:00
Steve Loughran
c5179b16ec HADOOP-6220 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177051 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 20:37:37 +00:00
Steve Loughran
05aeb2d9fd HADOOP-7668 revert the System.out() calls 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177035 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 20:01:28 +00:00
Sanjay Radia
bfc830caa4 HADOOP-7687 Make getProtocolSignature public (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177002 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 18:33:00 +00:00
Suresh Srinivas
9799353ee8 HADOOP-7668. Add a NetUtils method that can tell if an InetAddress belongs to local host. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176986 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 17:47:20 +00:00
Vinod Kumar Vavilapalli
59586d8015 HADOOP-7662. Fixed logs servlet to use the pathspec '/*' instead of '/' for correct filtering. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176849 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 12:36:30 +00:00
Harsh J
36d7ab3489 HADOOP-7542. Change Configuration XML format to 1.1 to support for serializing additional characters Contributed by Christopher Egner. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174562 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-23 07:26:00 +00:00
Aaron Myers
83e4b2b469 HADOOP-7621. alfredo config should be in a file not readable by users (Alejandro Abdelnur via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173739 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 16:09:44 +00:00
Vinod Kumar Vavilapalli
d50ecc38a3 HADOOP-7575. Enhanced LocalDirAllocator to support fully-qualified paths. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173623 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 13:26:55 +00:00
Vinod Kumar Vavilapalli
e49ef2e6c5 HADOOP-7639. Enhance HttpServer to allow passing path-specs for filtering, so that servers like Yarn WebApp can get filtered the paths served by their own injected servlets. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173130 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-20 13:11:12 +00:00
Aaron Myers
70a180d0f5 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1171808 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 21:35:45 +00:00
Todd Lipcon
0d99429982 HADOOP-7608. SnappyCodec check for Hadoop native lib is wrong. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171719 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 18:52:38 +00:00
Aaron Myers
6af0c27930 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1171315 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 23:07:48 +00:00
Aaron Myers
e66d697a66 HADOOP-7635. RetryInvocationHandler should release underlying resources on close (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171221 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 18:45:36 +00:00
Todd Lipcon
29eadf1b8f HADOOP-7629. Allow immutable FsPermission objects to be used as IPC parameters. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170451 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-14 06:51:21 +00:00
Aaron Myers
f4b2b63807 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1170378 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 22:49:27 +00:00
Konstantin Shvachko
8332126c52 HADOOP-7568. SequenceFile should not print into stdout. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169925 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 21:04:51 +00:00
Todd Lipcon
592aaa1f06 HADOOP-7328. When a serializer class is missing, return null, not throw an NPE. Contributed by Harsh J Chouraria. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167363 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 21:18:06 +00:00
Aaron Myers
68cb2b01b6 HADOOP-7607 and MAPREDUCE-2934. Simplify the RPC proxy cleanup process. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167318 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 18:12:14 +00:00
Todd Lipcon
d10631f728 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1166495 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 01:39:07 +00:00
Todd Lipcon
2ca9c8d926 HADOOP-7507. Allow ganglia metrics to include the metrics system tags in the gmetric names. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166460 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 22:59:22 +00:00
Arun Murthy
c2e1756d7a HADOOP-7580. Add a version of getLocalPathForWrite to LocalDirAllocator which doesn't create dirs. Contributed by Chris Douglas & Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165473 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 01:36:34 +00:00
Sanjay Radia
b97a4d40c8 HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164771 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 00:31:05 +00:00
Eli Collins
07c5741c9a HADOOP-7552. FileUtil#fullyDelete doesn't throw IOE but lists it in the throws clause. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164339 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-02 03:20:12 +00:00
Tsz-wo Sze
19523b6a2b HADOOP-7594. Support HTTP REST in HttpServer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163858 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 22:58:03 +00:00
Tsz-wo Sze
2b016dac82 HADOOP-7579. Rename package names from alfredo to auth. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163852 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 22:40:03 +00:00
Tsz-wo Sze
f10c97d390 HADOOP-7593. Fix AssertionError in TestHttpServer.testMaxThreads(). Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163465 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 01:16:47 +00:00
Todd Lipcon
5116ea4487 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1162279 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 22:46:17 +00:00
Tsz-wo Sze
56dd8ba0b8 HADOOP-7547. Add generic type in WritableComparable subclasses. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162008 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 06:58:52 +00:00
Arun Murthy
cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 00:14:24 +00:00