big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,450 Commits 2 Branches 2 Tags 264 MiB
228ae9aaa4
Commit Graph

2182 Commits

Author SHA1 Message Date
Tsuyoshi Ozawa
48c7ee7553 HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile. Contributed by Vinayakumar B. 2015-02-27 17:46:07 +09:00
cnauroth
2214dab60f HADOOP-9922. hadoop windows native build will fail in 32 bit machine. Contributed by Kiran Kumar M R. 2015-02-26 12:41:33 -08:00
Allen Wittenauer
dce8b9c4d0 HADOOP-11637. bash location hard-coded in shell scripts (aw) 2015-02-26 09:29:16 -08:00
Andrew Wang
71385f9b70 HADOOP-11620. Add support for load balancing across a group of KMS for HA. Contributed by Arun Suresh. 2015-02-25 21:16:37 -08:00
Tsuyoshi Ozawa
ad8ed3e802 HADOOP-11632. Cleanup Find.java to remove SupressWarnings annotations. Contributed by Akira AJISAKA. 2015-02-25 16:25:04 +09:00
Allen Wittenauer
d4ac6822e1 YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw) 2015-02-24 11:25:26 -08:00
Tsuyoshi Ozawa
9cedad11d8 Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)" 
This reverts commit 946456c6d8.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java
 2015-02-25 00:32:04 +09:00
Gera Shegalov
1dba57271f HADOOP-11619. FTPFileSystem should override getDefaultPort. (Brahma Reddy Battula via gera) 2015-02-23 21:05:59 -08:00
Akira Ajisaka
ab5976161f HADOOP-8642. Document that io.native.lib.available only controls native bz2 and zlib compression codecs. (aajisaka) 2015-02-23 17:34:43 -08:00
Allen Wittenauer
208430a15d HADOOP-11625. Minor fixes to command manual & SLA doc (aw) 2015-02-23 17:23:43 -08:00
cnauroth
769507bd7a HDFS-7009. Active NN and standby NN have different live nodes. Contributed by Ming Ma. 2015-02-23 15:12:27 -08:00
Arpit Agarwal
8b465b4b8c HDFS-7806. Refactor: move StorageType from hadoop-hdfs to hadoop-common. (Contributed by Xiaoyu Yao) 2015-02-21 15:38:35 -08:00
Robert Kanter
6f0133039a HADOOP-11612. Workaround for Curator's ChildReaper requiring Guava 15+. (rkanter) 2015-02-20 19:47:28 -08:00
cnauroth
3c5ff0759c HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. Contributed by Chris Nauroth. 2015-02-20 13:07:16 -08:00
cnauroth
02e7dec79d HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. 2015-02-20 12:37:48 -08:00
Jason Lowe
f0f2992686 HADOOP-9087. Queue size metric for metric sinks isn't actually maintained. Contributed by Akira AJISAKA 2015-02-19 17:30:07 +00:00
yliu
64a8375635 HADOOP-11595. Add default implementation for AbstractFileSystem#truncate. (yliu) 2015-02-19 08:26:42 +08:00
Tsuyoshi Ozawa
946456c6d8 HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa) 2015-02-19 13:06:53 +09:00
Akira Ajisaka
18fb421fab HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing in ClientBaseWithFixes. Contributed by Kengo Seki. 2015-02-18 17:55:04 -08:00
Akira Ajisaka
1714609919 HADOOP-11545. ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider". Contributed by Brahma Reddy Battula. 2015-02-18 11:17:10 -08:00
Tsuyoshi Ozawa
3f56a4cb0c HADOOP-11599. Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured. Contributed by zhihai xu. 2015-02-18 17:35:11 +09:00
Kihwal Lee
685af8a3d0 HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma. 2015-02-17 17:14:58 -06:00
Steve Loughran
00b80958d8 HADOOP-11521. Make connection timeout configurable in s3a. (Thomas Demoor via stevel) 2015-02-17 20:06:27 +00:00
Steve Loughran
78a7e8d3a6 HADOOP-11522. Update S3A Documentation. (Thomas Demoor via stevel) 2015-02-17 18:15:02 +00:00
Allen Wittenauer
72389c78db HADOOP-11575. Daemon log documentation is misleading (Naganarasimha G R via aw) 2015-02-17 07:00:00 -10:00
Tsuyoshi Ozawa
2f0f756b26 HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa) 2015-02-17 21:56:20 +09:00
Vinayakumar B
cf4b7f506d HADOOP-11000. HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING (Contributed by Ming Ma) 2015-02-17 14:55:56 +05:30
Tsuyoshi Ozawa
ef950ea1c0 HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 2015-02-15 00:30:46 +09:00
Tsuyoshi Ozawa
b7d48286a9 Rvert "HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R." 
This reverts commit 965ce9e24e.
 2015-02-15 00:28:59 +09:00
Tsuyoshi Ozawa
965ce9e24e HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 2015-02-15 00:13:10 +09:00
Xuan
253035491c YARN-3164. RMAdmin command usage prints incorrect command name. 
Contributed by Bibin A Chundatt
 2015-02-12 21:39:16 -08:00
Allen Wittenauer
93b941c637 HADOOP-11565. Add --slaves shell option (aw) 2015-02-12 18:01:28 -08:00
Akira Ajisaka
9395c76697 HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use getTrimmed(). Contributed by Tsuyoshi Ozawa. 2015-02-12 15:50:48 -08:00
Haohui Mai
74f38d5917 HDFS-7711. Fix various typos in ClusterSetup.md. Contributed by Brahma Reddy Battula. 2015-02-12 15:39:35 -08:00
Akira Ajisaka
11d8934463 HADOOP-11586. Update use of Iterator to Iterable in AbstractMetricsContext.java. Contributed by Ray Chiang. 2015-02-12 14:41:03 -08:00
Allen Wittenauer
58cb9f5293 HDFS-7322. deprecate sbin/hadoop-daemon.sh (aw) 2015-02-12 11:51:35 -08:00
Colin Patrick Mccabe
6b39ad0865 HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 2015-02-12 10:40:46 -08:00
Haohui Mai
bc5aa7d0b1 HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root. Contributed by Xiaoyu Yao. 2015-02-12 10:30:39 -08:00
cnauroth
67efab935e HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R. 2015-02-11 16:36:09 -08:00
Allen Wittenauer
fe689d34a4 HADOOP-11585. Fix formatting in Tracing.md (Masatake Iwasaki via aw) 2015-02-11 16:14:58 -08:00
Allen Wittenauer
026dfddfa3 HADOOP-11583. Fix syntax error in SecureMode.md (Masatake Iwasaki via aw) 2015-02-11 12:13:48 -08:00
Konstantin V Shvachko
6f6737b3bf HADOOP-11579. Documentation for truncate. Contributed by Konstantin Shvachko. 2015-02-11 09:50:19 -08:00
Akira Ajisaka
22441ab7b2 HADOOP-11580. Remove SingleNodeSetup.md from trunk. (aajisaka) 2015-02-11 09:08:19 -08:00
Allen Wittenauer
b015fec601 HADOOP-11581. Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls (Brahma Reddy Battula via aw) 2015-02-11 07:49:05 -08:00
Allen Wittenauer
cfd8a2174a HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) 2015-02-11 07:40:39 -08:00
Steve Loughran
c3da2db48f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:37 +00:00
Allen Wittenauer
7eeca90daa HADOOP-11559. Add links to RackAwareness and InterfaceClassification to site index (Masatake Iwasaki via aw) 2015-02-10 17:06:03 -08:00
Allen Wittenauer
e9d26fe9eb HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) 2015-02-10 13:39:57 -08:00
Colin Patrick Mccabe
6338ce3ae8 HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without holding the netlock (Liang Xie via Colin P. McCabe) 2015-02-10 13:24:40 -08:00
Harsh J
e0ec0718d0 HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P. 2015-02-10 12:51:56 +05:30
yliu
1b56d1ce32 HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:45:29 +08:00
Allen Wittenauer
576459801c HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) (missed file) 2015-02-09 12:54:25 -08:00
Allen Wittenauer
30b797ee9d HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) 2015-02-09 12:50:44 -08:00
Arpit Agarwal
ab934e8594 HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai) 2015-02-09 12:17:40 -08:00
Allen Wittenauer
5c79439568 HADOOP-11485. Pluggable shell integration (aw) 2015-02-06 13:09:01 -08:00
Steve Loughran
1425e3d37c HADOOP-11535 TableMapping related tests failed due to 'successful' resolving of invalid test hostname 2015-02-06 13:03:43 +00:00
Gera Shegalov
644548f201 HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera) 2015-02-06 00:27:54 -08:00
yliu
7b10ef0c3b HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu) 2015-02-06 06:31:03 +08:00
Allen Wittenauer
af3aadf04f HADOOP-6964. Allow compact property description in xml (Kengo Seki via aw) 2015-02-05 19:09:37 -08:00
cnauroth
6583ad148b HADOOP-11526. Memory leak in Bzip2Compressor and Bzip2Decompressor. Contributed by Anu Engineer. 2015-02-05 16:55:20 -08:00
yliu
03f7ed382b HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:45:06 +08:00
Allen Wittenauer
276485e1de HADOOP-9044. add FindClass main class to provide classpath checking of installations (Steve Loughran via aw) 2015-02-05 11:31:56 -08:00
Allen Wittenauer
fb06c00837 HADOOP-7713. dfs -count -q should label output column (Jonathan Allen via aw) 2015-02-05 07:44:49 -08:00
Tsuyoshi Ozawa
ec950be173 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-05 15:49:36 +09:00
Junping Du
0b567f4246 HADOOP-10062. race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results. (Contributed by Sangjin Lee) 2015-02-04 19:10:52 -08:00
Allen Wittenauer
43d5caef5e HADOOP-11460. Deprecate shell vars (John Smith via aw) 2015-02-04 16:35:50 -08:00
Karthik Kambatla
55235d28c3 HADOOP-11492. Bump up curator version to 2.7.1. (Arun Suresh and Karthik Kambatla via kasha) 2015-02-04 13:05:11 -08:00
cnauroth
a35e86c670 HADOOP-11547. hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. Contributed by Chris Nauroth. 2015-02-04 12:07:05 -08:00
Andrew Wang
9175105eea HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu. 2015-02-04 11:31:38 -08:00
cnauroth
064e0770a0 HADOOP-11548. checknative should display a nicer error message when openssl support is not compiled in. Contributed by Anu Engineer. 2015-02-04 10:01:28 -08:00
Akira Ajisaka
42548f4dc2 HADOOP-11544. Remove unused configuration keys for tracing. Contributed by Masatake Iwasaki. 2015-02-04 04:18:17 -08:00
Robert Kanter
f7a77819a1 YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 2015-02-03 10:39:41 -08:00
cnauroth
8004a00230 HADOOP-10181. GangliaContext does not work with multicast ganglia setup. Contributed by Andrew Johnson. 2015-02-02 11:09:09 -08:00
Benoy Antony
3472e3bd6c HADOOP-11494. Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread. Contributed by Ted Yu. 2015-02-02 10:34:47 -08:00
Harsh J
ffc75d6ebe HADOOP-11488. Difference in default connection timeout for S3A FS. Contributed by Daisuke Kobayashi. 2015-02-01 00:17:04 +05:30
Gera Shegalov
26c2de36e2 HADOOP-11432. Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2. (Liang Xie via gera) 2015-01-30 18:40:40 -08:00
Colin Patrick Mccabe
09ad9a868a HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-01-30 16:01:59 -08:00
Kihwal Lee
8dc59cb9e0 HADOOP-9137. Support connection limiting in IPC server. Contributed by Kihwal Lee. 2015-01-30 17:21:36 -06:00
Colin Patrick Mccabe
e36ef3b402 HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it (Malcolm Kavalsky via Colin P. McCabe) 2015-01-29 15:43:57 -08:00
Akira Ajisaka
03a5e04d5b HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties (aajisaka) 2015-01-29 16:13:59 +09:00
Tsuyoshi Ozawa
9850e1584b HADOOP-11316. "mvn package -Pdist,docs -DskipTests -Dtar" fails because of non-ascii characters. (ozawa) 2015-01-28 22:01:16 +09:00
Aaron T. Myers
8bf6f0b703 HADOOP-10626. Limit Returning Attributes for LDAP search. Contributed by Jason Hubbard. 2015-01-27 13:53:35 -08:00
Jing Zhao
2848db814a HDFS-3689. Add support for variable length block. Contributed by Jing Zhao. 2015-01-27 12:58:10 -08:00
Haohui Mai
543064e89d HADOOP-4297. Enable Java assertions when running tests. Contributed by Tsz Wo Nicholas Sze. 2015-01-27 11:05:55 -08:00
Xuan
0bf333911c HADOOP-11509. Change parsing sequence in GenericOptionsParser to parse 
-D parameters before -files. Contributed by Xuan Gong
 2015-01-26 15:35:35 -08:00
Steve Loughran
1f2b6956c2 HADOOP-6221 RPC Client operations cannot be interrupted (stevel) 2015-01-26 22:04:56 +00:00
Jason Lowe
7574df1bba HADOOP-11499. Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisition. Contributed by Ted Yu 2015-01-26 16:56:14 +00:00
Andrew Wang
4b00935643 HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contributed by Arun Suresh. 2015-01-23 12:11:15 -08:00
Steve Loughran
56df5f41eb HADOOP-11507 Hadoop RPC Authentication problem with different user locale. (Talat UYARER via stevel) 2015-01-23 19:37:03 +00:00
Allen Wittenauer
fcf1058b45 HADOOP-11008. Remove duplicated description about proxy-user in site documents (Masatake Iwasaki via aw) 2015-01-22 14:30:21 -08:00
Tsuyoshi Ozawa
825923f7b9 HADOOP-11500. InputStream is left unclosed in ApplicationClassLoader. Contributed by Ted Yu. 2015-01-23 00:50:19 +09:00
Tsuyoshi Ozawa
786dbdfad8 HADOOP-11209. Configuration#updatingResource/finalParameters are not thread-safe. Contributed by Varun Saxena. 2015-01-22 14:15:59 +09:00
Colin Patrick Mccabe
ee7d22e90c HADOOP-11466. FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe) 2015-01-21 16:33:02 -08:00
Konstantin V Shvachko
a0521bc83a HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. 2015-01-21 16:00:49 -08:00
cnauroth
925c9fed33 HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 2015-01-21 11:52:48 -08:00
Jason Lowe
07b0806036 HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an incorrect filter. Contributed by Eric Payne 2015-01-21 19:04:29 +00:00
yliu
fc20129c56 HDFS-7623. Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace. (yliu) 2015-01-21 00:59:47 +08:00
cnauroth
7fc1f2f5cf HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 2015-01-19 11:28:30 -08:00
Karthik Kambatla
84198564ba YARN-2984. Metrics for container's actual memory usage. (kasha) 2015-01-17 05:44:04 +05:30
Haohui Mai
3ab3a64988 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:17:30 -08:00