big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
12,334 Commits 2 Branches 2 Tags 264 MiB
7ff280fca9
Commit Graph

3414 Commits

Author SHA1 Message Date
cnauroth
cb282d5b89 HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade. 2015-10-22 14:29:57 -07:00
Junping Du
0fce5f9a49 YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong. 2015-10-22 13:41:09 -07:00
cnauroth
47641fcbc9 HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade. 2015-10-22 12:21:32 -07:00
Allen Wittenauer
4c0bae240b HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw) 2015-10-22 08:19:56 -07:00
Tsuyoshi Ozawa
381610da62 HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong. 2015-10-22 11:59:12 +09:00
Tsuyoshi Ozawa
b5ca649bff HADOOP-9692. SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong. 2015-10-22 11:55:25 +09:00
Andrew Wang
d1cdce77fa HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. Contributed by Xiao Chen. 2015-10-21 15:21:01 -07:00
Allen Wittenauer
d759b4bd74 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 2015-10-21 11:30:59 -07:00
Ming Ma
e27c2ae8ba HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma) 2015-10-21 08:06:58 -07:00
Allen Wittenauer
b37c41fd6e HADOOP-12495. Fix posix_spawn error on OS X (aw) 2015-10-21 08:00:26 -07:00
Kihwal Lee
01b103f4ff HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee. 2015-10-20 15:09:15 -05:00
Allen Wittenauer
ded012e1d6 HADOOP-12493. bash unit tests are failing (aw) 2015-10-19 19:02:20 -07:00
Kihwal Lee
6144e0137b HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee. 2015-10-19 10:52:29 -05:00
Vinayakumar B
7f0e1eb43d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N) 2015-10-19 12:16:16 +05:30
yliu
476a251e5e HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 2015-10-19 09:54:11 +08:00
Steve Loughran
0ab3f9d564 HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel). 2015-10-18 14:05:28 +01:00
Steve Loughran
e286512a71 HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel) 2015-10-18 12:23:43 +01:00
Steve Loughran
bafeb6c7bc HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. (Daryn Sharp via stevel). 2015-10-18 11:45:41 +01:00
cnauroth
a121fa1d39 HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query String. Contributed by Larry McCay. 2015-10-15 16:44:59 -07:00
cnauroth
fdd7406224 HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation failure. Contributed by Chris Nauroth. 2015-10-15 15:54:48 -07:00
cnauroth
5f3f0e0f70 HADOOP-12475. Move attribution to 2.8.0 section of CHANGES.txt. 2015-10-15 15:53:57 -07:00
Sangjin Lee
8d2d3eb7bb HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee) 2015-10-15 11:43:07 -07:00
Allen Wittenauer
dc45a7a7c4 Revert "HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw)" 
This reverts commit 0d77e85f0a.
 2015-10-15 08:26:06 -07:00
Steve Loughran
dfa7848463 HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:47 +01:00
Allen Wittenauer
ab13aa30cb fix CHANGES.txt name typo 2015-10-14 11:48:28 -07:00
Allen Wittenauer
56dc7773f8 HADOOP-12364. Deleting pid file after stop is causing the daemons to keep restarting (Sigi Li via aw) 2015-10-14 11:16:10 -07:00
Allen Wittenauer
0d77e85f0a HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw) 2015-10-14 08:59:41 -07:00
Colin Patrick Mccabe
d286032b71 HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe) 2015-10-13 16:11:46 -07:00
Steve Loughran
c59af2fdf8 HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:49:28 +01:00
Tsuyoshi Ozawa
33fefa33e5 HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7. (stevel and ozawa) 2015-10-14 05:31:43 +09:00
Haohui Mai
d1e1925bf6 HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 2015-10-13 13:24:15 -07:00
Steve Loughran
59e9980117 HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) 2015-10-13 21:12:08 +01:00
Haohui Mai
7f00fcac77 HADOOP-12474. MiniKMS should use random ports for Jetty server by default. Contributed by Mingliang Liu. 2015-10-13 13:07:57 -07:00
Colin Patrick Mccabe
6716f15964 HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe) 2015-10-13 12:18:03 -07:00
Jitendra Pandey
84cbd72afd HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-10-13 09:12:04 -07:00
yliu
e617cf6dd1 HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) 2015-10-12 16:09:14 +08:00
Haohui Mai
7e2c971fed Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu." 
This reverts commit fa5a54cac7.
 2015-10-10 03:24:59 -07:00
Haohui Mai
fa5a54cac7 HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu. 2015-10-09 22:38:06 -07:00
Akira Ajisaka
e1bf8b3df6 HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 2015-10-09 11:10:29 +09:00
Andrew Wang
66e2cfa1a0 HDFS-8632. Add InterfaceAudience annotation to the erasure coding classes. Contributed by Rakesh R. 2015-10-07 18:12:26 -07:00
Akira Ajisaka
7fbf69bf47 HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 2015-10-08 06:08:28 +09:00
Uma Mahesh
8b7339312c HDFS-9182. Cleanup the findbugs and other issues after HDFS EC merged to trunk. Contributed by Uma Maheswara Rao G. 2015-10-06 22:22:32 -07:00
Steve Loughran
6d5713a8a8 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:53 +01:00
cnauroth
5f6edb30c2 HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth. 2015-10-05 20:11:41 -07:00
Allen Wittenauer
b59e434116 HADOOP-10949. metrics2 sink plugin for Apache Kafka (Babak Behzad via aw) 2015-10-05 14:02:07 -07:00
Colin Patrick Mccabe
3e1752f9fb HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe) 2015-10-05 11:35:31 -07:00
Vinod Kumar Vavilapalli
f1c19b9365 HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan. 2015-10-05 10:56:55 -07:00
Tsuyoshi Ozawa
30e2f836a2 HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8. 2015-10-05 08:15:06 +09:00
Harsh J
c918f7be5e HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian. 2015-10-03 18:37:58 +05:30
Jason Lowe
fdf02d1f26 YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu 2015-10-02 20:20:31 +00:00
Zhihai Xu
fd026f535c HADOOP-8437. getLocalPathForWrite should throw IOException for invalid paths. Contributed by Brahma Reddy Battula 2015-10-01 11:56:49 -07:00
Akira Ajisaka
ecbfd68974 HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). Contributed by Rahul Palamuttam and Kanaka Kumar Avvaru. 2015-10-01 18:25:31 +02:00
Zhe Zhang
6c17d31528 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java

Change-Id: I53ec1c426dc988d6c4a2c87b00caef49c4057010
 2015-09-30 08:39:13 -07:00
yliu
06abc57a90 HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test directory. (Contributed by Colin Patrick McCabe and Chris Nauroth) 2015-09-30 10:56:22 +08:00
Haohui Mai
8703301b46 HDFS-9174. Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread. Contributed by Yi Liu. 2015-09-29 14:56:06 -07:00
Colin Patrick Mccabe
a2efb945e3 Add HADOOP-12447 to CHANGES.txt 2015-09-29 09:37:13 -07:00
Colin Patrick Mccabe
850d679acb HADOOP-12447. Clean up some htrace integration issues (cmccabe) 2015-09-29 09:25:11 -07:00
Zhe Zhang
8fd5520246 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFS.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java

Change-Id: Ic7946c4ea35bed587fe879ce58b959b25ecc0823
 2015-09-29 01:39:16 -07:00
yliu
d6fa34e014 HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu) 2015-09-29 16:20:35 +08:00
Ming Ma
5c3b663bf9 HADOOP-12440. TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down. (Xiao Chen via mingma) 2015-09-28 18:12:51 -07:00
Kihwal Lee
3abbdc929b HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. 2015-09-28 17:31:51 -05:00
Colin Patrick Mccabe
892ade689f HDFS-9080. Update htrace version to 4.0.1 (cmccabe) 2015-09-28 07:42:12 -07:00
Vinayakumar B
f0f984e4e6 HADOOP-11984. Enable parallel JUnit tests in pre-commit (Contributed by Chris Nauroth) 2015-09-27 14:12:07 +05:30
Vinayakumar B
861b52db24 HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid (Contributed by nijel) 2015-09-26 21:36:17 +05:30
cnauroth
7fe521b1dd HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu. 2015-09-25 22:33:53 -07:00
Yongjun Zhang
3187dbd7a8 HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang) 2015-09-24 21:36:38 -07:00
Zhihai Xu
9cc9f8126b Update CHANGES.txt to reflect commit of HADOOP-8436 to 2.8.0 2015-09-24 12:52:07 -07:00
Zhihai Xu
52c1f272ec HADOOP-12252. LocalDirAllocator should not throw NPE with empty string configuration. Contributed by Zhihai Xu 2015-09-24 11:51:22 -07:00
Arpit Agarwal
df31c446bf HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal) 2015-09-24 11:41:48 -07:00
Haohui Mai
0ef7ff47d5 HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem. Contributed by Chris Nauroth. 2015-09-23 19:36:44 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
1f707ecffd Release process for 2.6.1: Set the release date for 2.6.1 2015-09-23 15:10:50 -07:00
Vinayakumar B
a2c76e5f26 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) 2015-09-23 15:28:41 +05:30
Zhe Zhang
1080c37300 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: I8511c4d64b0959e79129febc179845a3892fedcc
 2015-09-22 13:27:09 -07:00
Tsuyoshi Ozawa
dfd807afab HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 2015-09-22 12:54:29 +09:00
Steve Loughran
c39ddc306d HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) 2015-09-19 12:41:42 +01:00
Zhihai Xu
88d89267ff HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 2015-09-18 10:40:04 -07:00
Zhihai Xu
3732d5238a Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu" 
This reverts commit e690a32e57.
 2015-09-18 10:30:40 -07:00
Zhihai Xu
e690a32e57 Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 2015-09-18 08:24:53 -07:00
Wangda Tan
6b97fa6652 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda) 2015-09-17 17:46:28 -07:00
Jason Lowe
58d1a02b8d MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 2015-09-17 14:30:18 +00:00
Haohui Mai
0832b38d48 HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:37 -07:00
Eric Yang
2ffe2db95e HADOOP-12374. Updated expunge command description. 
(WeiWei Yang via eyang)
 2015-09-15 20:03:24 -07:00
Akira Ajisaka
77aaf4cf7d HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu. 2015-09-16 10:20:24 +09:00
Vinayakumar B
ce69c9b54c HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) 2015-09-16 00:18:29 +05:30
cnauroth
b2017d9b03 HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu. 2015-09-15 10:41:50 -07:00
Vinayakumar B
a440567491 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) 2015-09-15 17:30:46 +05:30
Steve Loughran
7269906254 HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:26 +01:00
Steve Loughran
3f685cd571 HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:56:42 +01:00
Steve Loughran
4992f075c8 syncing branch-2 and trunk CHANGES.TXT to be closer together 2015-09-12 18:51:37 +01:00
Steve Loughran
8c054412e1 fix trunk/hadoop-common CHANGES.TXT to be the reference across trunk & branch-2 2015-09-12 18:13:54 +01:00
Robert Kanter
9538af0e1a HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 2015-09-11 15:20:17 -07:00
Steve Loughran
ca0827a862 HADOOP-12324. Better exception reporting in SaslPlainServer. (Mike Yoder via stevel) 2015-09-11 15:58:53 +01:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
fbbb7ff1ed Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1.
 2015-09-10 13:45:57 -07:00
Vinayakumar B
94cf7ab9d2 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) 2015-09-09 11:03:57 +05:30
Zhihai Xu
d9c1fab2ec HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong. 2015-09-08 13:06:36 -07:00
Vinayakumar B
090d26652c HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina) 2015-09-08 19:11:18 +05:30
Andrew Wang
e1feaf6db0 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao. 2015-09-04 13:42:55 -07:00
Arpit Agarwal
524ba8708b HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:47 -07:00
Tsuyoshi Ozawa
0ebc658105 HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla. 2015-09-03 23:32:42 +09:00
Tsuyoshi Ozawa
355eaaa33d HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter error message. Contributed by Wei Yan. 2015-09-03 22:48:53 +09:00