big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,283 Commits 2 Branches 2 Tags 264 MiB
47f4c54106
Commit Graph

2320 Commits

Author SHA1 Message Date
Robert Kanter
6f0133039a HADOOP-11612. Workaround for Curator's ChildReaper requiring Guava 15+. (rkanter) 2015-02-20 19:47:28 -08:00
cnauroth
3c5ff0759c HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. Contributed by Chris Nauroth. 2015-02-20 13:07:16 -08:00
cnauroth
02e7dec79d HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. 2015-02-20 12:37:48 -08:00
Jason Lowe
f0f2992686 HADOOP-9087. Queue size metric for metric sinks isn't actually maintained. Contributed by Akira AJISAKA 2015-02-19 17:30:07 +00:00
yliu
64a8375635 HADOOP-11595. Add default implementation for AbstractFileSystem#truncate. (yliu) 2015-02-19 08:26:42 +08:00
Tsuyoshi Ozawa
946456c6d8 HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa) 2015-02-19 13:06:53 +09:00
Akira Ajisaka
18fb421fab HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing in ClientBaseWithFixes. Contributed by Kengo Seki. 2015-02-18 17:55:04 -08:00
Akira Ajisaka
1714609919 HADOOP-11545. ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider". Contributed by Brahma Reddy Battula. 2015-02-18 11:17:10 -08:00
Tsuyoshi Ozawa
3f56a4cb0c HADOOP-11599. Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured. Contributed by zhihai xu. 2015-02-18 17:35:11 +09:00
Kihwal Lee
685af8a3d0 HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma. 2015-02-17 17:14:58 -06:00
Steve Loughran
00b80958d8 HADOOP-11521. Make connection timeout configurable in s3a. (Thomas Demoor via stevel) 2015-02-17 20:06:27 +00:00
Steve Loughran
78a7e8d3a6 HADOOP-11522. Update S3A Documentation. (Thomas Demoor via stevel) 2015-02-17 18:15:02 +00:00
Allen Wittenauer
72389c78db HADOOP-11575. Daemon log documentation is misleading (Naganarasimha G R via aw) 2015-02-17 07:00:00 -10:00
Tsuyoshi Ozawa
2f0f756b26 HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa) 2015-02-17 21:56:20 +09:00
Vinayakumar B
cf4b7f506d HADOOP-11000. HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING (Contributed by Ming Ma) 2015-02-17 14:55:56 +05:30
Tsuyoshi Ozawa
ef950ea1c0 HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 2015-02-15 00:30:46 +09:00
Tsuyoshi Ozawa
b7d48286a9 Rvert "HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R." 
This reverts commit 965ce9e24e.
 2015-02-15 00:28:59 +09:00
Tsuyoshi Ozawa
965ce9e24e HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 2015-02-15 00:13:10 +09:00
Xuan
253035491c YARN-3164. RMAdmin command usage prints incorrect command name. 
Contributed by Bibin A Chundatt
 2015-02-12 21:39:16 -08:00
Allen Wittenauer
93b941c637 HADOOP-11565. Add --slaves shell option (aw) 2015-02-12 18:01:28 -08:00
Akira Ajisaka
9395c76697 HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use getTrimmed(). Contributed by Tsuyoshi Ozawa. 2015-02-12 15:50:48 -08:00
Haohui Mai
74f38d5917 HDFS-7711. Fix various typos in ClusterSetup.md. Contributed by Brahma Reddy Battula. 2015-02-12 15:39:35 -08:00
Akira Ajisaka
11d8934463 HADOOP-11586. Update use of Iterator to Iterable in AbstractMetricsContext.java. Contributed by Ray Chiang. 2015-02-12 14:41:03 -08:00
Allen Wittenauer
58cb9f5293 HDFS-7322. deprecate sbin/hadoop-daemon.sh (aw) 2015-02-12 11:51:35 -08:00
Colin Patrick Mccabe
6b39ad0865 HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 2015-02-12 10:40:46 -08:00
Haohui Mai
bc5aa7d0b1 HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root. Contributed by Xiaoyu Yao. 2015-02-12 10:30:39 -08:00
cnauroth
67efab935e HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R. 2015-02-11 16:36:09 -08:00
Allen Wittenauer
fe689d34a4 HADOOP-11585. Fix formatting in Tracing.md (Masatake Iwasaki via aw) 2015-02-11 16:14:58 -08:00
Allen Wittenauer
026dfddfa3 HADOOP-11583. Fix syntax error in SecureMode.md (Masatake Iwasaki via aw) 2015-02-11 12:13:48 -08:00
Konstantin V Shvachko
6f6737b3bf HADOOP-11579. Documentation for truncate. Contributed by Konstantin Shvachko. 2015-02-11 09:50:19 -08:00
Akira Ajisaka
22441ab7b2 HADOOP-11580. Remove SingleNodeSetup.md from trunk. (aajisaka) 2015-02-11 09:08:19 -08:00
Allen Wittenauer
b015fec601 HADOOP-11581. Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls (Brahma Reddy Battula via aw) 2015-02-11 07:49:05 -08:00
Allen Wittenauer
cfd8a2174a HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) 2015-02-11 07:40:39 -08:00
Steve Loughran
c3da2db48f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:37 +00:00
Allen Wittenauer
7eeca90daa HADOOP-11559. Add links to RackAwareness and InterfaceClassification to site index (Masatake Iwasaki via aw) 2015-02-10 17:06:03 -08:00
Allen Wittenauer
e9d26fe9eb HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) 2015-02-10 13:39:57 -08:00
Colin Patrick Mccabe
6338ce3ae8 HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without holding the netlock (Liang Xie via Colin P. McCabe) 2015-02-10 13:24:40 -08:00
Harsh J
e0ec0718d0 HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P. 2015-02-10 12:51:56 +05:30
yliu
1b56d1ce32 HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:45:29 +08:00
Allen Wittenauer
576459801c HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) (missed file) 2015-02-09 12:54:25 -08:00
Allen Wittenauer
30b797ee9d HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) 2015-02-09 12:50:44 -08:00
Arpit Agarwal
ab934e8594 HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai) 2015-02-09 12:17:40 -08:00
Allen Wittenauer
5c79439568 HADOOP-11485. Pluggable shell integration (aw) 2015-02-06 13:09:01 -08:00
Steve Loughran
1425e3d37c HADOOP-11535 TableMapping related tests failed due to 'successful' resolving of invalid test hostname 2015-02-06 13:03:43 +00:00
Gera Shegalov
644548f201 HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera) 2015-02-06 00:27:54 -08:00
yliu
7b10ef0c3b HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu) 2015-02-06 06:31:03 +08:00
Allen Wittenauer
af3aadf04f HADOOP-6964. Allow compact property description in xml (Kengo Seki via aw) 2015-02-05 19:09:37 -08:00
cnauroth
6583ad148b HADOOP-11526. Memory leak in Bzip2Compressor and Bzip2Decompressor. Contributed by Anu Engineer. 2015-02-05 16:55:20 -08:00
yliu
03f7ed382b HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:45:06 +08:00
Allen Wittenauer
276485e1de HADOOP-9044. add FindClass main class to provide classpath checking of installations (Steve Loughran via aw) 2015-02-05 11:31:56 -08:00
Allen Wittenauer
fb06c00837 HADOOP-7713. dfs -count -q should label output column (Jonathan Allen via aw) 2015-02-05 07:44:49 -08:00
Tsuyoshi Ozawa
ec950be173 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-05 15:49:36 +09:00
Junping Du
0b567f4246 HADOOP-10062. race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results. (Contributed by Sangjin Lee) 2015-02-04 19:10:52 -08:00
Allen Wittenauer
43d5caef5e HADOOP-11460. Deprecate shell vars (John Smith via aw) 2015-02-04 16:35:50 -08:00
Karthik Kambatla
55235d28c3 HADOOP-11492. Bump up curator version to 2.7.1. (Arun Suresh and Karthik Kambatla via kasha) 2015-02-04 13:05:11 -08:00
cnauroth
a35e86c670 HADOOP-11547. hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. Contributed by Chris Nauroth. 2015-02-04 12:07:05 -08:00
Andrew Wang
9175105eea HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu. 2015-02-04 11:31:38 -08:00
cnauroth
064e0770a0 HADOOP-11548. checknative should display a nicer error message when openssl support is not compiled in. Contributed by Anu Engineer. 2015-02-04 10:01:28 -08:00
Akira Ajisaka
42548f4dc2 HADOOP-11544. Remove unused configuration keys for tracing. Contributed by Masatake Iwasaki. 2015-02-04 04:18:17 -08:00
Robert Kanter
f7a77819a1 YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 2015-02-03 10:39:41 -08:00
cnauroth
8004a00230 HADOOP-10181. GangliaContext does not work with multicast ganglia setup. Contributed by Andrew Johnson. 2015-02-02 11:09:09 -08:00
Benoy Antony
3472e3bd6c HADOOP-11494. Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread. Contributed by Ted Yu. 2015-02-02 10:34:47 -08:00
Harsh J
ffc75d6ebe HADOOP-11488. Difference in default connection timeout for S3A FS. Contributed by Daisuke Kobayashi. 2015-02-01 00:17:04 +05:30
Gera Shegalov
26c2de36e2 HADOOP-11432. Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2. (Liang Xie via gera) 2015-01-30 18:40:40 -08:00
Colin Patrick Mccabe
09ad9a868a HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-01-30 16:01:59 -08:00
Kihwal Lee
8dc59cb9e0 HADOOP-9137. Support connection limiting in IPC server. Contributed by Kihwal Lee. 2015-01-30 17:21:36 -06:00
Colin Patrick Mccabe
e36ef3b402 HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it (Malcolm Kavalsky via Colin P. McCabe) 2015-01-29 15:43:57 -08:00
Akira Ajisaka
03a5e04d5b HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties (aajisaka) 2015-01-29 16:13:59 +09:00
Tsuyoshi Ozawa
9850e1584b HADOOP-11316. "mvn package -Pdist,docs -DskipTests -Dtar" fails because of non-ascii characters. (ozawa) 2015-01-28 22:01:16 +09:00
Aaron T. Myers
8bf6f0b703 HADOOP-10626. Limit Returning Attributes for LDAP search. Contributed by Jason Hubbard. 2015-01-27 13:53:35 -08:00
Jing Zhao
2848db814a HDFS-3689. Add support for variable length block. Contributed by Jing Zhao. 2015-01-27 12:58:10 -08:00
Haohui Mai
543064e89d HADOOP-4297. Enable Java assertions when running tests. Contributed by Tsz Wo Nicholas Sze. 2015-01-27 11:05:55 -08:00
Xuan
0bf333911c HADOOP-11509. Change parsing sequence in GenericOptionsParser to parse 
-D parameters before -files. Contributed by Xuan Gong
 2015-01-26 15:35:35 -08:00
Steve Loughran
1f2b6956c2 HADOOP-6221 RPC Client operations cannot be interrupted (stevel) 2015-01-26 22:04:56 +00:00
Jason Lowe
7574df1bba HADOOP-11499. Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisition. Contributed by Ted Yu 2015-01-26 16:56:14 +00:00
Andrew Wang
4b00935643 HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contributed by Arun Suresh. 2015-01-23 12:11:15 -08:00
Steve Loughran
56df5f41eb HADOOP-11507 Hadoop RPC Authentication problem with different user locale. (Talat UYARER via stevel) 2015-01-23 19:37:03 +00:00
Allen Wittenauer
fcf1058b45 HADOOP-11008. Remove duplicated description about proxy-user in site documents (Masatake Iwasaki via aw) 2015-01-22 14:30:21 -08:00
Tsuyoshi Ozawa
825923f7b9 HADOOP-11500. InputStream is left unclosed in ApplicationClassLoader. Contributed by Ted Yu. 2015-01-23 00:50:19 +09:00
Tsuyoshi Ozawa
786dbdfad8 HADOOP-11209. Configuration#updatingResource/finalParameters are not thread-safe. Contributed by Varun Saxena. 2015-01-22 14:15:59 +09:00
Colin Patrick Mccabe
ee7d22e90c HADOOP-11466. FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe) 2015-01-21 16:33:02 -08:00
Konstantin V Shvachko
a0521bc83a HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. 2015-01-21 16:00:49 -08:00
cnauroth
925c9fed33 HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 2015-01-21 11:52:48 -08:00
Jason Lowe
07b0806036 HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an incorrect filter. Contributed by Eric Payne 2015-01-21 19:04:29 +00:00
yliu
fc20129c56 HDFS-7623. Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace. (yliu) 2015-01-21 00:59:47 +08:00
cnauroth
7fc1f2f5cf HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 2015-01-19 11:28:30 -08:00
Karthik Kambatla
84198564ba YARN-2984. Metrics for container's actual memory usage. (kasha) 2015-01-17 05:44:04 +05:30
Haohui Mai
3ab3a64988 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:17:30 -08:00
Robert Kanter
b6ff9c03a4 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter) 2015-01-15 11:39:43 -08:00
Arpit Agarwal
a6efbb21c2 HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-15 11:02:17 -08:00
Akira Ajisaka
ce29074685 HADOOP-11318. Update the document for hadoop fs -stat 2015-01-16 00:55:20 +09:00
Akira Ajisaka
db51548f70 HADOOP-11483. HardLink.java should use the jdk7 createLink method 2015-01-15 20:54:44 +09:00
Colin Patrick Mccabe
a5a033c7ca HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) 2015-01-14 17:42:59 -08:00
Xuan
d15cbae73c YARN-2807. Option "--forceactive" not works as described in usage of 
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki
 2015-01-14 11:04:03 -08:00
Ravi Prakash
4d29142100 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe' 
(Kamil Gorlo via raviprak)
 2015-01-10 08:35:40 -08:00
Brandon Li
09d31bc630 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia 2015-01-09 17:24:22 -08:00
cnauroth
8c3e888dcd HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:50 -08:00
Benoy Antony
20625c8f04 HADOOP-10651. Add ability to restrict service access using IP addresses and hostnames. (Benoy Antony) 2015-01-08 10:06:48 -08:00
Tsuyoshi Ozawa
a6ed4894b5 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 2015-01-08 14:51:57 +09:00
Tsuyoshi Ozawa
9886396400 Revert "Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)" because of missing JIRA's number. 
This reverts commit 2eba7eb9af.
 2015-01-08 14:35:08 +09:00
Tsuyoshi Ozawa
2eba7eb9af Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 2015-01-08 14:21:30 +09:00
cnauroth
3ed0aed3cc HADOOP-11462. TestSocketIOWithTimeout needs change for PowerPC platform. Contributed by Ayappan. 2015-01-07 12:24:10 -08:00
Brandon Li
788ee35e2b HDFS-7564. NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map. Contributed by Yongjun Zhang 2015-01-06 16:19:39 -08:00
Jason Lowe
d02fb53750 HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split. Contributed by Ankit Kamboj 2015-01-06 21:19:10 +00:00
Allen Wittenauer
cd7d78914c HADOOP-11058. Missing HADOOP_CONF_DIR generates strange results (Masatake Iwasaki via aw) 2015-01-06 12:02:03 -08:00
Vinayakumar B
9803ae374f HADOOP-11459. Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMapping (Contributed by Vinayakumar B) 2015-01-06 09:15:23 +05:30
Benoy Antony
53caeaa16b HADOOP-11402. Negative user-to-group cache entries are never cleared for never-again-accessed users. Contributed by Varun Saxena. 2015-01-05 15:06:46 -08:00
Allen Wittenauer
94d342e607 HADOOP-10908. Common needs updates for shell rewrite (aw) 2015-01-05 14:26:41 -08:00
Steve Loughran
2403634de0 HADOOP-11390 Metrics 2 ganglia provider to include hostname in unresolved address problems. (Varun Saxena via stevel) 2015-01-05 16:09:36 +00:00
yliu
21c6f01831 HADOOP-11455. KMS and Credential CLI should request confirmation for deletion by default. (Charles Lamb via yliu) 2015-01-05 06:55:08 +08:00
Allen Wittenauer
0c45946e65 HADOOP-10788. Rewrite kms to use new shell framework (John Smith via aw) 2015-01-02 10:52:47 -08:00
Brandon Li
892b1bb746 HDFS-7563. NFS gateway parseStaticMap NumberFormatException. Contributed by Yongjun Zhang 2015-01-02 10:49:50 -08:00
Colin Patrick Mccabe
249cc90501 HADOOP-11039. ByteBufferReadable API doc is inconsistent with the implementations. (Yi Liu via Colin P. McCabe) 2014-12-29 13:37:45 -08:00
Tsuyoshi Ozawa
399d25884a HADOOP-11448. Fix findbugs warnings in FileBasedIPList. (ozawa) 2014-12-26 15:20:24 +09:00
Robert Kanter
66cfe1dc73 HADOOP-11399. Java Configuration file and .xml files should be automatically cross-compared (rchiang via rkanter) 2014-12-23 14:30:46 -08:00
Jing Zhao
5caebbae8c HDFS-7484. Make FSDirectory#addINode take existing INodes as its parameter. Contributed by Jing Zhao. 2014-12-22 23:19:20 -08:00
Tsuyoshi Ozawa
ecf1469fa5 HADOOP-11414. FileBasedIPList#readLines() can leak file descriptors. (ozawa) 2014-12-22 13:05:13 +09:00
Haohui Mai
2860eeb14a HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. Contributed by Haohui Mai. 2014-12-21 14:45:06 -08:00
Karthik Kambatla
6f1e3667cf HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha) 2014-12-19 15:00:28 -08:00
Colin Patrick Mccabe
e369d98ba2 HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream (Yi Liu via Colin P. McCabe) 2014-12-19 13:11:38 -08:00
Colin Patrick Mccabe
6635ccd217 HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe) 2014-12-18 19:39:04 -08:00
Jason Lowe
b9d49761f7 HADOOP-11409. FileContext.getFileContext can stack overflow if default fs misconfigured. Contributed by Gera Shegalov 2014-12-18 21:27:28 +00:00
Haohui Mai
ef1fc51852 HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. Contributed by Haohui Mai. 2014-12-18 11:33:09 -08:00
Colin Patrick Mccabe
07619aa516 HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe) 2014-12-18 11:05:06 -08:00
Haohui Mai
abb2ebbc3a HADOOP-11125. Remove redundant tests in TestOsSecureRandom. Contributed by Masanori Oyama. 2014-12-18 10:59:59 -08:00
yliu
1050d424a2 HADOOP-11358. Tests for encryption/decryption with IV calculation overflow. (yliu) 2014-12-18 00:49:25 +08:00
Colin Patrick Mccabe
9937eef7f7 HADOOP-11421. Add IOUtils#listDirectory (cmccabe) 2014-12-17 15:18:16 -08:00
Colin Patrick Mccabe
4281c96e24 HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) 2014-12-17 10:32:40 -08:00
Allen Wittenauer
bc21a1c07a HADOOP-11397. Can't override HADOOP_IDENT_STRING (Kengo Seki via aw) 2014-12-17 09:06:01 -08:00
cnauroth
e996a1bfd4 HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth. 2014-12-16 15:29:22 -08:00
Colin Patrick Mccabe
fb20797b62 HADOOP-11410. Make the rpath of libhadoop.so configurable (cmccabe) 2014-12-15 18:55:16 -08:00
Benoy Antony
a095622f36 HADOOP-10852 Fix thread safety issues in NetgroupCache. (Benoy Antony) 2014-12-15 14:00:25 -08:00
Allen Wittenauer
e8a67bed10 HADOOP-11380. Restore Rack Awareness documenation (aw) 2014-12-15 11:36:25 -08:00
Colin Patrick Mccabe
e5a6925199 HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe) 2014-12-12 16:30:52 -08:00
Haohui Mai
5b9fcedb4d HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. Contributed by Haohui Mai. 2014-12-11 16:42:38 -08:00
Gera Shegalov
0bcea111e5 HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera) 2014-12-11 13:12:13 -08:00
Allen Wittenauer
8e9a266819 HADOOP-11353. Add support for .hadooprc (aw) 2014-12-11 09:00:35 -08:00
Haohui Mai
84d50003f6 HADOOP-11386. Replace \n by %n in format hadoop-common format strings. Contributed by Li Lu. 2014-12-10 14:37:52 -08:00
Allen Wittenauer
c536142699 HADOOP-6590. Add a username check for hadoop sub-commands (John Smith via aw) 2014-12-10 13:41:28 -08:00
Allen Wittenauer
a7c6c710b2 HADOOP-10950. rework heap management vars (John Smith via aw) 2014-12-10 13:37:32 -08:00
Haohui Mai
44870dcf41 HADOOP-11388. Remove deprecated o.a.h.metrics.file.FileContext. Contributed by Li Lu. 2014-12-10 12:46:42 -08:00
Haohui Mai
bbd6a32776 HADOOP-10482. Fix various findbugs warnings in hadoop-common. Contributed by Haohui Mai. 2014-12-10 12:44:25 -08:00
Colin Patrick Mccabe
03867eb1bb HADOOP-11349. RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails. (Varun Saxena via Colin P. McCabe) 2014-12-09 14:31:44 -08:00
Jing Zhao
5776a41da0 HDFS-7498. Simplify the logic in INodesInPath. Contributed by Jing Zhao. 2014-12-09 11:37:39 -08:00
Andrew Wang
74d4bfded9 HADOOP-11368. Fix SSLFactory truststore reloader thread leak in KMSClientProvider. Contributed by Arun Suresh. 2014-12-09 10:47:24 -08:00
Haohui Mai
0ee41612bb HADOOP-11287. Simplify UGI#reloginFromKeytab for Java 7+. Contributed by Li Lu. 2014-12-08 21:10:32 -08:00
cnauroth
ffe942b82c HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B. 2014-12-08 10:23:09 -08:00
cnauroth
1b3bb9e7a3 HADOOP-11313. Adding a document about NativeLibraryChecker. Contributed by Tsuyoshi OZAWA. 2014-12-06 20:12:31 -08:00
Andrew Wang
0707e4eca9 HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen. 2014-12-05 18:20:19 -08:00
Haohui Mai
2829b7a96f HADOOP-11356. Removed deprecated o.a.h.fs.permission.AccessControlException. Contributed by Li Lu. 2014-12-05 10:49:43 -08:00
Colin Patrick Mccabe
565b0e60a8 HADOOP-11348. Remove unused variable from CMake error message for finding openssl (Dian Fu via Colin P. McCabe) 2014-12-04 12:52:39 -08:00
Vinayakumar B
92ce6eda92 HADOOP-11296. hadoop-daemons.sh throws 'host1: bash: host3: command not found...' (Contributed by Vinayakumar B) 2014-12-03 10:07:43 +05:30
stack
b36f292982 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY #2 2014-12-01 23:07:05 -08:00
stack
692d3b83e4 Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY" 
This reverts commit 74f4d8590d.

Refers to the wrong issue (HBASE rather than HADOOP)
 2014-12-01 23:04:00 -08:00
stack
74f4d8590d HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY 2014-12-01 22:46:57 -08:00
stack
4e312a4345 Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)" 
This reverts commit fb41615887.

Reverting because I over-changed CHANGES.txt white-space.
 2014-12-01 22:41:44 -08:00
stack
fb41615887 HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 2014-12-01 22:34:58 -08:00
Allen Wittenauer
031f980e7e HADOOP-11081. Document hadoop properties expected to be set by the shell code in *-env.sh (aw) 2014-12-01 16:21:20 -08:00
Colin Patrick Mccabe
86e3993def HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 2014-12-01 11:42:10 -08:00
Colin Patrick Mccabe
aa2f277256 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 12:17:48 -08:00
Steve Loughran
aa7dac3359 HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:44:03 +00:00
Andrew Wang
fae266bbf1 HADOOP-11173. Improve error messages for some KeyShell commands. 2014-11-25 16:13:32 -08:00
Colin Patrick Mccabe
f636f9d943 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe) 2014-11-24 10:55:21 -08:00
Andrew Wang
eb4045e765 HADOOP-11323. WritableComparator#compare keeps reference to byte array. Contributed by Wilfred Spiegelenburg. 2014-11-20 11:05:42 -08:00
Jian He
90a968d675 YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA 2014-11-18 16:12:39 -08:00
Jason Lowe
b4ca727690 HADOOP-11309. System class pattern package.Foo should match package.Foo$Bar, too. Contributed by Gera Shegalov 2014-11-18 17:22:21 +00:00
Andrew Wang
dcb8e24427 HDFS-6982. nntop: top­-like tool for name node users. (Maysam Yabandeh via wang) 2014-11-17 17:33:42 -08:00
Andrew Wang
48d62fad80 HADOOP-11311. Restrict uppercase key names from being created with JCEKS. 2014-11-17 13:59:46 -08:00
Brandon Li
351c5561c2 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 2014-11-17 13:23:53 -08:00
Aaron T. Myers
bd8196e85e HADOOP-11157. ZKDelegationTokenSecretManager never shuts down listenerThreadPool. Contributed by Arun Suresh. 2014-11-17 13:02:49 -08:00
Haohui Mai
bf8e4332cb HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. 2014-11-17 11:42:20 -08:00
cnauroth
1925e2a4ae HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang. 2014-11-14 16:43:09 -08:00
Colin Patrick Mccabe
f95017b3ea Revert HADOOP-11257 because it didn't get a jenkins run yet 2014-11-14 13:06:03 -08:00
Colin Patrick Mccabe
10c98aed38 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-14 12:53:09 -08:00
Ravi Prakash
1a1dcce827 MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times (Sergey Murylev via raviprak) 2014-11-14 03:45:53 -08:00
Arun C. Murthy
9ff7315cbe Preparing to release hadoop-2.6.0-rc1. 2014-11-13 13:02:55 -08:00
Allen Wittenauer
aee68b67f3 HADOOP-11150. hadoop command should show the reason on failure by invalid COMMAND or CLASSNAME (Masatake Iwasaki via aw) 2014-11-13 12:08:03 -08:00
Allen Wittenauer
b650e61a7f HADOOP-11298. slaves.sh and stop-all.sh are missing slashes (aw) 2014-11-13 12:01:38 -08:00
Allen Wittenauer
ba879a5dad HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2014-11-13 11:52:38 -08:00
cnauroth
7dae5b5a88 HADOOP-11291. Log the cause of SASL connection failures. Contributed by Stephen Chu. 2014-11-12 21:54:06 -08:00
cnauroth
0abb973f09 HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA. 2014-11-12 21:41:19 -08:00
Allen Wittenauer
d7150a1bc2 HADOOP-11284. Fix variable name mismatches in hadoop-functions.sh (Masatake Iwasaki via aw) 2014-11-12 15:58:51 -08:00
Allen Wittenauer
306f0c9cea HADOOP-11025. hadoop-daemons.sh should just call hdfs directly (Masatake Iwasaki via aw) 2014-11-12 15:46:58 -08:00
Jian He
86bf8c7193 HADOOP-9576. Changed NetUtils#wrapException to throw EOFException instead of wrapping it as IOException. Contributed by Steve Loughran 2014-11-10 17:25:29 -08:00
Arun C. Murthy
ab30d513b6 Release Notes for hadoop-2.6.0. 2014-11-09 19:15:03 -08:00
Haohui Mai
a37a993453 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 2014-11-09 17:48:26 -08:00
Arun C. Murthy
6caa8100d5 HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs. 2014-11-08 15:39:56 -08:00
cnauroth
68db5b3736 HADOOP-11282. Skip NFS TestShellBasedIdMapping tests that are irrelevant on Windows. Contributed by Chris Nauroth. 2014-11-07 14:30:29 -08:00
cnauroth
42bbe3794e HADOOP-11280. TestWinUtils#testChmod fails after removal of NO_PROPAGATE_INHERIT_ACE. Contributed by Chris Nauroth. 2014-11-07 00:02:17 -08:00
Jing Zhao
ba0a42cf67 Revert "HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du." 
This reverts commit 16b3482467.
 2014-11-06 18:27:59 -08:00
Jing Zhao
16b3482467 HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du. 2014-11-06 16:07:50 -08:00
Jason Lowe
10f9f5101c MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov 2014-11-06 15:10:40 +00:00
Aaron T. Myers
ef5af4f8de HADOOP-11187 NameNode - KMS communication fails after a long period of inactivity. Contributed by Arun Suresh. 2014-11-05 18:17:49 -08:00
Aaron T. Myers
8a261e68e4 HADOOP-11272. Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator client. Contributed by Arun Suresh. 2014-11-05 17:47:22 -08:00
Aaron T. Myers
6ba52d88ec HADOOP-10714. AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call. Contributed by Juan Yu. 2014-11-05 17:17:04 -08:00
Haohui Mai
8549fa5dc9 HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu. 2014-11-05 15:34:27 -08:00
cnauroth
a7fbd4e633 HADOOP-11265. Credential and Key Shell Commands not available on Windows. Contributed by Larry McCay. 2014-11-05 08:38:50 -08:00
Vinayakumar B
8e9502e05d HADOOP-11271. Use Time.monotonicNow() in Shell.java instead of Time.now() (Contributed by Vinayakumar B) 2014-11-05 14:47:52 +05:30
Karthik Kambatla
dbf30e3c0e HADOOP-11260. Patch up Jetty to disable SSLv3. (Mike Yoder via kasha) 2014-11-04 16:18:24 -08:00
Haohui Mai
1eed102023 HADOOP-10847. Remove the usage of sun.security.x509.* in testing code. Contributed by Pascal Oliva. 2014-11-04 10:52:05 -08:00
cnauroth
85da71c2d3 HADOOP-11165. TestUTF8 fails when run against java 8. Contributed by Stephen Chu. 2014-11-04 10:27:41 -08:00
Kihwal Lee
67f13b58e4 HADOOP-10987. Provide an iterator-based listing API for FileSystem. Contributed by Kihwal Lee. 2014-11-03 08:20:22 -06:00
Vinod Kumar Vavilapalli
b18e8a272e HADOOP-11254. Changed visibility of AccessControlList to be public for consumption by ecosystem. Contributed by Zhijie Shen. 2014-11-01 11:10:03 -07:00
Jian He
1b4be91866 YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen 2014-10-31 13:16:45 -07:00
cnauroth
5573b3476a HDFS-7313. Support optional configuration of AES cipher suite on DataTransferProtocol. Contributed by Chris Nauroth. 2014-10-30 22:48:25 -07:00
Tsz-Wo Nicholas Sze
a3dacc07e2 HADOOP-11221. IdentityHashStore assumes System.identityHashCode() is non-negative. Contributed by Jinghui Wang 2014-10-30 10:58:26 -07:00
Colin Patrick Mccabe
e488f0d93b HADOOP-11250. fix endmacro of set_find_shared_library_without_version in CMakeLists (Yi Liu via Colin P. McCabe) 2014-10-30 10:37:24 -07:00
yliu
2a6be65c8c HADOOP-11216. Improve Openssl library finding. (cmccabe via yliu) 2014-10-30 10:35:14 +08:00
Haohui Mai
05b66ca074 HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li. 2014-10-29 17:54:26 -07:00
Colin Patrick Mccabe
c2575fb046 HADOOP-11186: documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes (cmccabe) 2014-10-29 12:14:10 -07:00
Brandon Li
72a556d3b0 HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang 2014-10-29 11:05:29 -07:00
Kihwal Lee
b056048114 MAPREDUCE-6022. map_input_file is missing from streaming job 
environment. Contributed by Jason Lowe.
 2014-10-29 12:29:07 -05:00
Karthik Kambatla
3c5f5af118 HADOOP-11243. SSLFactory shouldn't allow SSLv3. (Wei Yan via kasha) 2014-10-28 18:03:00 -07:00
cnauroth
c6f04f391b HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao. 2014-10-28 14:06:27 -07:00
yliu
58c0bb9ed9 HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu) 2014-10-28 21:11:31 +08:00
yliu
e7859015bc HADOOP-11233. hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default. (Stephen Chu via yliu) 2014-10-28 14:21:26 +08:00
cnauroth
5b1dfe78b8 HDFS-6934. Revert files accidentally committed. 2014-10-27 12:15:10 -07:00
Jian He
c05b581a55 YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen 2014-10-27 10:45:53 -07:00
cnauroth
463aec1171 HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 2014-10-27 09:38:30 -07:00
Vinod Kumar Vavilapalli
0186645505 YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He. 2014-10-26 11:14:34 -07:00
Byron Wong
28051e4155 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong. 2014-10-25 12:31:41 -07:00
Haohui Mai
dc6e819ed8 HADOOP-11231. Remove dead code in ServletUtil. Contributed by Li Lu. 2014-10-24 14:19:52 -07:00
Jian He
f7e89bb349 HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu 2014-10-24 12:50:27 -07:00
Colin Patrick Mccabe
5b56ac4c72 HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe) 2014-10-23 19:14:00 -07:00
Karthik Kambatla
db45f047ab HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha) 2014-10-23 17:04:14 -07:00
Colin Patrick Mccabe
7ab754545d HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost (cmccabe) 2014-10-23 13:25:39 -07:00
Jian He
3b12fd6cfb YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu 2014-10-22 15:57:46 -07:00
Karthik Kambatla
70719e5c62 HADOOP-11122. Fix findbugs in ZK DelegationTokenSecretManagers. (Arun Suresh via kasha) 2014-10-22 14:26:27 -07:00
cnauroth
6637e3cf95 YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch. 2014-10-21 12:33:21 -07:00
Vinod Kumar Vavilapalli
1137557816 HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen. 2014-10-17 15:56:07 -07:00
Ravi Prakash
466f08792f HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) 2014-10-15 15:49:46 -07:00
Zhijie Shen
1220bb72d4 YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen. 2014-10-14 21:50:46 -07:00
Zhijie Shen
cdce88376a HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen. 2014-10-14 11:35:38 -07:00
Haohui Mai
5faaba0bd0 HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu. 2014-10-13 20:43:02 -07:00
Aaron T. Myers
0e57aa3bf6 HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh. 2014-10-13 18:09:39 -07:00
Karthik Kambatla
cc93e7e683 YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha) 2014-10-13 16:32:01 -07:00
cnauroth
1770bb942f HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao. 2014-10-13 10:56:32 -07:00
Haohui Mai
554250cf88 HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao. 2014-10-10 23:02:22 -07:00
Andrew Wang
d3d3d47202 HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang) 2014-10-10 13:40:37 -07:00
Colin Patrick Mccabe
1ceb326933 HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe) 2014-10-10 13:03:29 -07:00
Aaron T. Myers
cbd21fd13b HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang. 2014-10-09 18:52:48 -07:00
Colin Patrick Mccabe
d8d628d1e0 HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe) 2014-10-09 17:05:35 -07:00
Andrew Wang
8d94114495 HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang) 2014-10-09 13:21:19 -07:00
cnauroth
9097183983 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth. 2014-10-09 11:51:12 -07:00
cnauroth
1123a06e36 HADOOP-11175. Fix several issues of hadoop security configuration in user doc. Contributed by Yi Liu. 2014-10-09 11:10:23 -07:00
Uma Maheswara Rao G
8d7c54967d HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh) 2014-10-09 20:06:41 +05:30
Aaron T. Myers
2a51494ce1 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh. 2014-10-08 18:01:51 -07:00
Colin Patrick Mccabe
d996235285 HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe) 2014-10-08 17:55:46 -07:00
Zhijie Shen
a169051931 HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch. 2014-10-08 15:36:16 -07:00
Andrew Wang
4b2834898c HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang) 2014-10-07 14:57:03 -07:00