big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,388 Commits 2 Branches 2 Tags 264 MiB
05499b1093
Commit Graph

2843 Commits

Author SHA1 Message Date
Chris Douglas
790aa6790e HADOOP-11673. Skip using JUnit Assume in TestCodec. 
Contributed by Brahma Reddy Battula.
 2015-03-08 19:18:59 -07:00
Steve Loughran
64443490d7 HADOOP-11670. Regression: s3a auth setup broken. (Adam Budde via stevel) 2015-03-08 11:22:16 -07:00
cnauroth
608ebd52ba HADOOP-11642. Upgrade azure sdk version from 0.6.0 to 2.0.0. Contributed by Shashank Khandelwal and Ivan Mitic. 2015-03-06 15:25:01 -08:00
Jian He
21101c01f2 YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu 2015-03-06 14:18:11 -08:00
Allen Wittenauer
01bfe6f05b HADOOP-11653. shellprofiles should require .sh extension (Brahma Reddy Battula via aw) 2015-03-06 13:54:11 -08:00
yliu
5e9b8144d5 HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static. (Sean Busbey via yliu) 2015-03-05 06:38:45 +08:00
Tsuyoshi Ozawa
74a4754d1c HADOOP-11648. Set DomainSocketWatcher thread name explicitly. Contributed by Liang Xie. 2015-03-05 16:05:44 +09:00
Karthik Kambatla
8d88691d16 YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha) 2015-03-04 19:49:05 -08:00
Akira Ajisaka
29bb689865 Move HADOOP-6857 to 3.0.0. 2015-03-03 21:52:37 -08:00
Steve Loughran
15b7076ad5 HADOOP-11183. Memory-based S3AOutputstream. (Thomas Demoor via stevel) 2015-03-03 16:18:51 -08:00
Tsuyoshi Ozawa
d1c6accb6f HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa) 2015-03-03 14:17:52 +09:00
Gera Shegalov
b18d3830ac HADOOP-11605. FilterFileSystem#create with ChecksumOpt should propagate it to wrapped FS. (gera) 2015-03-02 18:09:23 -08:00
Akira Ajisaka
ca1c00bf81 HADOOP-11658. Externalize io.compression.codecs property. Contributed by Kai Zheng. 2015-03-02 01:12:44 -08:00
Akira Ajisaka
dd9cd0797c HADOOP-11615. Update ServiceLevelAuth.md for YARN. Contributed by Brahma Reddy Battula. 2015-03-01 22:16:06 -08:00
Akira Ajisaka
30e73ebc77 HADOOP-11657. Align the output of hadoop fs -du to be more Unix-like. (aajisaka) 2015-03-01 21:09:15 -08:00
Tsuyoshi Ozawa
e9ac88aac7 HADOOP-11634. Description of webhdfs' principal/keytab should switch places each other. Contributed by Brahma Reddy Battula. 2015-03-02 04:18:07 +09:00
Allen Wittenauer
b01d3433ae HADOOP-10774. Update KerberosTestUtils for hadoop-auth tests when using IBM Java (sangamesh via aw) 2015-02-28 23:22:06 -08:00
Akira Ajisaka
915bec3e84 move HADOOP-10976 to 2.7 2015-02-28 17:15:13 -08:00
Tsuyoshi Ozawa
48c7ee7553 HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile. Contributed by Vinayakumar B. 2015-02-27 17:46:07 +09:00
cnauroth
2214dab60f HADOOP-9922. hadoop windows native build will fail in 32 bit machine. Contributed by Kiran Kumar M R. 2015-02-26 12:41:33 -08:00
Allen Wittenauer
dce8b9c4d0 HADOOP-11637. bash location hard-coded in shell scripts (aw) 2015-02-26 09:29:16 -08:00
Andrew Wang
71385f9b70 HADOOP-11620. Add support for load balancing across a group of KMS for HA. Contributed by Arun Suresh. 2015-02-25 21:16:37 -08:00
cnauroth
5731c0e0d0 HADOOP-11629. WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to true. Contributed by Shanyu Zhao. 2015-02-25 09:08:55 -08:00
Tsuyoshi Ozawa
ad8ed3e802 HADOOP-11632. Cleanup Find.java to remove SupressWarnings annotations. Contributed by Akira AJISAKA. 2015-02-25 16:25:04 +09:00
Akira Ajisaka
1a625b8158 HADOOP-11480. Typo in hadoop-aws/index.md uses wrong scheme for test.fs.s3.name. Contributed by Ted Yu. 2015-02-24 17:11:46 -08:00
Colin Patrick Mccabe
ac3468add4 move HADOOP-11495 to 2.7 2015-02-24 15:54:58 -08:00
Allen Wittenauer
d4ac6822e1 YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw) 2015-02-24 11:25:26 -08:00
Tsuyoshi Ozawa
9cedad11d8 Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)" 
This reverts commit 946456c6d8.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java
 2015-02-25 00:32:04 +09:00
Gera Shegalov
1dba57271f HADOOP-11619. FTPFileSystem should override getDefaultPort. (Brahma Reddy Battula via gera) 2015-02-23 21:05:59 -08:00
Akira Ajisaka
ab5976161f HADOOP-8642. Document that io.native.lib.available only controls native bz2 and zlib compression codecs. (aajisaka) 2015-02-23 17:34:43 -08:00
Allen Wittenauer
208430a15d HADOOP-11625. Minor fixes to command manual & SLA doc (aw) 2015-02-23 17:23:43 -08:00
Haohui Mai
16bd79ee8e HADOOP-10478. Fix new findbugs warnings in hadoop-maven-plugins. Contributed by Li Lu. 2015-02-23 16:38:24 -08:00
cnauroth
769507bd7a HDFS-7009. Active NN and standby NN have different live nodes. Contributed by Ming Ma. 2015-02-23 15:12:27 -08:00
Arpit Agarwal
8b465b4b8c HDFS-7806. Refactor: move StorageType from hadoop-hdfs to hadoop-common. (Contributed by Xiaoyu Yao) 2015-02-21 15:38:35 -08:00
Steve Loughran
709ff99cff HADOOP-11584 s3a file block size set to 0 in getFileStatus. (Brahma Reddy Battula via stevel) 2015-02-21 12:03:03 +00:00
Robert Kanter
6f0133039a HADOOP-11612. Workaround for Curator's ChildReaper requiring Guava 15+. (rkanter) 2015-02-20 19:47:28 -08:00
cnauroth
3c5ff0759c HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. Contributed by Chris Nauroth. 2015-02-20 13:07:16 -08:00
Steve Loughran
aa1c437b6a HADOOP-11607. Reduce log spew in S3AFileSystem. (Lei (Eddy) Xu via stevel) 2015-02-20 20:51:24 +00:00
cnauroth
02e7dec79d HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer. 2015-02-20 12:37:48 -08:00
Jason Lowe
f0f2992686 HADOOP-9087. Queue size metric for metric sinks isn't actually maintained. Contributed by Akira AJISAKA 2015-02-19 17:30:07 +00:00
yliu
64a8375635 HADOOP-11595. Add default implementation for AbstractFileSystem#truncate. (yliu) 2015-02-19 08:26:42 +08:00
Tsuyoshi Ozawa
946456c6d8 HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa) 2015-02-19 13:06:53 +09:00
Akira Ajisaka
18fb421fab HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing in ClientBaseWithFixes. Contributed by Kengo Seki. 2015-02-18 17:55:04 -08:00
Akira Ajisaka
1714609919 HADOOP-11545. ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider". Contributed by Brahma Reddy Battula. 2015-02-18 11:17:10 -08:00
Tsuyoshi Ozawa
3f56a4cb0c HADOOP-11599. Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured. Contributed by zhihai xu. 2015-02-18 17:35:11 +09:00
Allen Wittenauer
b6fc1f3e43 HADOOP-11593. Convert site documentation from apt to markdown (stragglers) (Masatake Iwasaki via aw) 2015-02-17 21:30:24 -10:00
Kihwal Lee
685af8a3d0 HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma. 2015-02-17 17:14:58 -06:00
Steve Loughran
00b80958d8 HADOOP-11521. Make connection timeout configurable in s3a. (Thomas Demoor via stevel) 2015-02-17 20:06:27 +00:00
Steve Loughran
6be5670949 HADOOP-11596 moving entry in CHANGES.TXT up to improvements there, as it wasn't in 2.7 & it was confusing diffs 2015-02-17 20:06:05 +00:00
Ravi Prakash
13d1ba9965 HADOOP-11596. Allow smart-apply-patch.sh to add new files in binary git patches (raviprak) 2015-02-17 11:13:47 -08:00
Steve Loughran
78a7e8d3a6 HADOOP-11522. Update S3A Documentation. (Thomas Demoor via stevel) 2015-02-17 18:15:02 +00:00
Allen Wittenauer
72389c78db HADOOP-11575. Daemon log documentation is misleading (Naganarasimha G R via aw) 2015-02-17 07:00:00 -10:00
Steve Loughran
826267f789 HADOOP-11570. S3AInputStream.close() downloads the remaining bytes of the object from S3. (Dan Hecht via stevel). 2015-02-17 16:36:44 +00:00
Tsuyoshi Ozawa
2f0f756b26 HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa) 2015-02-17 21:56:20 +09:00
Vinayakumar B
cf4b7f506d HADOOP-11000. HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING (Contributed by Ming Ma) 2015-02-17 14:55:56 +05:30
Tsuyoshi Ozawa
ef950ea1c0 HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 2015-02-15 00:30:46 +09:00
Tsuyoshi Ozawa
b7d48286a9 Rvert "HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R." 
This reverts commit 965ce9e24e.
 2015-02-15 00:28:59 +09:00
Tsuyoshi Ozawa
965ce9e24e HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 2015-02-15 00:13:10 +09:00
Robert Kanter
875256834b HADOOP-11467. KerberosAuthenticator can connect to a non-secure cluster. (yzhangal via rkanter) 2015-02-13 14:01:46 -08:00
Xuan
253035491c YARN-3164. RMAdmin command usage prints incorrect command name. 
Contributed by Bibin A Chundatt
 2015-02-12 21:39:16 -08:00
Allen Wittenauer
93b941c637 HADOOP-11565. Add --slaves shell option (aw) 2015-02-12 18:01:28 -08:00
Akira Ajisaka
9395c76697 HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use getTrimmed(). Contributed by Tsuyoshi Ozawa. 2015-02-12 15:50:48 -08:00
Haohui Mai
04d09ecd56 HDFS-7711. Move the entry in CHANGE.txt to the right place. 2015-02-12 15:44:05 -08:00
Haohui Mai
74f38d5917 HDFS-7711. Fix various typos in ClusterSetup.md. Contributed by Brahma Reddy Battula. 2015-02-12 15:39:35 -08:00
Akira Ajisaka
11d8934463 HADOOP-11586. Update use of Iterator to Iterable in AbstractMetricsContext.java. Contributed by Ray Chiang. 2015-02-12 14:41:03 -08:00
Akira Ajisaka
3157d992b0 Move HADOOP-11543 section in CHANGES.txt to remove the conflict between trunk and branch-2. 2015-02-12 14:33:55 -08:00
Allen Wittenauer
58cb9f5293 HDFS-7322. deprecate sbin/hadoop-daemon.sh (aw) 2015-02-12 11:51:35 -08:00
Colin Patrick Mccabe
6b39ad0865 HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 2015-02-12 10:40:46 -08:00
Haohui Mai
bc5aa7d0b1 HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root. Contributed by Xiaoyu Yao. 2015-02-12 10:30:39 -08:00
cnauroth
67efab935e HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R. 2015-02-11 16:36:09 -08:00
Allen Wittenauer
fe689d34a4 HADOOP-11585. Fix formatting in Tracing.md (Masatake Iwasaki via aw) 2015-02-11 16:14:58 -08:00
Allen Wittenauer
7776847a59 HADOOP-11437. Remove the version and author information from distcp's README file (Brahma Reddy Battula via aw) 2015-02-11 15:47:36 -08:00
Allen Wittenauer
026dfddfa3 HADOOP-11583. Fix syntax error in SecureMode.md (Masatake Iwasaki via aw) 2015-02-11 12:13:48 -08:00
Konstantin V Shvachko
6f6737b3bf HADOOP-11579. Documentation for truncate. Contributed by Konstantin Shvachko. 2015-02-11 09:50:19 -08:00
Akira Ajisaka
22441ab7b2 HADOOP-11580. Remove SingleNodeSetup.md from trunk. (aajisaka) 2015-02-11 09:08:19 -08:00
Allen Wittenauer
b015fec601 HADOOP-11581. Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls (Brahma Reddy Battula via aw) 2015-02-11 07:49:05 -08:00
Allen Wittenauer
cfd8a2174a HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) 2015-02-11 07:40:39 -08:00
Steve Loughran
c3da2db48f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:37 +00:00
Allen Wittenauer
7eeca90daa HADOOP-11559. Add links to RackAwareness and InterfaceClassification to site index (Masatake Iwasaki via aw) 2015-02-10 17:06:03 -08:00
Allen Wittenauer
e9d26fe9eb HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) 2015-02-10 13:39:57 -08:00
Colin Patrick Mccabe
6338ce3ae8 HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without holding the netlock (Liang Xie via Colin P. McCabe) 2015-02-10 13:24:40 -08:00
Harsh J
e0ec0718d0 HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P. 2015-02-10 12:51:56 +05:30
yliu
1b56d1ce32 HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:45:29 +08:00
Allen Wittenauer
576459801c HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) (missed file) 2015-02-09 12:54:25 -08:00
Allen Wittenauer
30b797ee9d HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) 2015-02-09 12:50:44 -08:00
Arpit Agarwal
ab934e8594 HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai) 2015-02-09 12:17:40 -08:00
Allen Wittenauer
5c79439568 HADOOP-11485. Pluggable shell integration (aw) 2015-02-06 13:09:01 -08:00
Steve Loughran
17165d3df9 HADOOP-11520. Clean incomplete multi-part uploads in S3A tests. (Thomas Demoor via stevel) 2015-02-06 21:01:41 +00:00
Steve Loughran
1425e3d37c HADOOP-11535 TableMapping related tests failed due to 'successful' resolving of invalid test hostname 2015-02-06 13:03:43 +00:00
Gera Shegalov
644548f201 HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera) 2015-02-06 00:27:54 -08:00
yliu
7b10ef0c3b HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu) 2015-02-06 06:31:03 +08:00
Tsuyoshi Ozawa
9d91069118 Move HADOOP-11543 from BUG-FIX to IMPROVEMENT in CHANGES.txt. 2015-02-06 13:15:52 +09:00
Allen Wittenauer
af3aadf04f HADOOP-6964. Allow compact property description in xml (Kengo Seki via aw) 2015-02-05 19:09:37 -08:00
cnauroth
6583ad148b HADOOP-11526. Memory leak in Bzip2Compressor and Bzip2Decompressor. Contributed by Anu Engineer. 2015-02-05 16:55:20 -08:00
yliu
03f7ed382b HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:45:06 +08:00
Allen Wittenauer
276485e1de HADOOP-9044. add FindClass main class to provide classpath checking of installations (Steve Loughran via aw) 2015-02-05 11:31:56 -08:00
Allen Wittenauer
d27439f839 HADOOP-9044. add FindClass main class to provide classpath checking of installations (Steve Loughran via aw) 2015-02-05 10:45:10 -08:00
Allen Wittenauer
fb06c00837 HADOOP-7713. dfs -count -q should label output column (Jonathan Allen via aw) 2015-02-05 07:44:49 -08:00
Steve Loughran
4e7ad4f0a8 HADOOP-11463 Replace method-local TransferManager object with S3AFileSystem#transfers. (Ted Yu via stevel) 2015-02-05 12:20:23 +00:00
Tsuyoshi Ozawa
ec950be173 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-05 15:49:36 +09:00