big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,064 Commits 2 Branches 2 Tags 264 MiB
1714609919
Commit Graph

2750 Commits

Author SHA1 Message Date
Jing Zhao
57cb43be50 HADOOP-11354. ThrottledInputStream doesn't perform effective throttling. Contributed by Ted Yu. 2014-12-08 11:08:39 -08:00
cnauroth
ffe942b82c HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B. 2014-12-08 10:23:09 -08:00
Steve Loughran
144da2e465 HADOOP-10530 Make hadoop build on Java7+ only (stevel) 2014-12-08 15:31:00 +00:00
cnauroth
1b3bb9e7a3 HADOOP-11313. Adding a document about NativeLibraryChecker. Contributed by Tsuyoshi OZAWA. 2014-12-06 20:12:31 -08:00
Andrew Wang
0707e4eca9 HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen. 2014-12-05 18:20:19 -08:00
Andrew Wang
9cdaec6a6f HADOOP-11355. When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown. Contributed by Arun Suresh. 2014-12-05 12:01:23 -08:00
Haohui Mai
2829b7a96f HADOOP-11356. Removed deprecated o.a.h.fs.permission.AccessControlException. Contributed by Li Lu. 2014-12-05 10:49:43 -08:00
Colin Patrick Mccabe
565b0e60a8 HADOOP-11348. Remove unused variable from CMake error message for finding openssl (Dian Fu via Colin P. McCabe) 2014-12-04 12:52:39 -08:00
Aaron T. Myers
9d1a8f5897 HADOOP-11332. KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject. Contributed by Dian Fu. 2014-12-03 18:53:45 -08:00
Andrew Wang
1812241ee1 HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL. Contributed by Dian Fu. 2014-12-03 12:00:14 -08:00
Vinayakumar B
92ce6eda92 HADOOP-11296. hadoop-daemons.sh throws 'host1: bash: host3: command not found...' (Contributed by Vinayakumar B) 2014-12-03 10:07:43 +05:30
Andrew Wang
3d48ad7eb4 HADOOP-11344. KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup. Contributed by Arun Suresh. 2014-12-02 19:04:29 -08:00
stack
b36f292982 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY #2 2014-12-01 23:07:05 -08:00
stack
692d3b83e4 Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY" 
This reverts commit 74f4d8590d.

Refers to the wrong issue (HBASE rather than HADOOP)
 2014-12-01 23:04:00 -08:00
stack
74f4d8590d HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY 2014-12-01 22:46:57 -08:00
stack
4e312a4345 Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)" 
This reverts commit fb41615887.

Reverting because I over-changed CHANGES.txt white-space.
 2014-12-01 22:41:44 -08:00
stack
fb41615887 HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 2014-12-01 22:34:58 -08:00
Andrew Wang
31b4d2daa1 HADOOP-11341. KMS support for whitelist key ACLs. Contributed by Arun Suresh. 2014-12-01 21:53:37 -08:00
Andrew Wang
9fa2990257 HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done atomically. Contributed by Dian Fu. 2014-12-01 21:21:23 -08:00
Allen Wittenauer
031f980e7e HADOOP-11081. Document hadoop properties expected to be set by the shell code in *-env.sh (aw) 2014-12-01 16:21:20 -08:00
Colin Patrick Mccabe
86e3993def HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 2014-12-01 11:42:10 -08:00
Colin Patrick Mccabe
c1f2bb2d31 CHANGES.txt: add HADOOP-11257 2014-11-26 13:38:55 -08:00
Colin Patrick Mccabe
aa2f277256 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 12:17:48 -08:00
Steve Loughran
aa7dac3359 HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:44:03 +00:00
Andrew Wang
fae266bbf1 HADOOP-11173. Improve error messages for some KeyShell commands. 2014-11-25 16:13:32 -08:00
Andrew Wang
56f3eecc12 HADOOP-11300. KMS startup scripts must not display the keystore / truststore passwords. Contributed by Arun Suresh. 2014-11-25 15:12:04 -08:00
yliu
61a2510b55 HADOOP-11322. key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT. (Dian Fu via yliu) 2014-11-25 01:08:40 +08:00
Colin Patrick Mccabe
2967c17fef HADOOP-10926. Improve smart-apply-patch.sh to apply binary diffs (cmccabe) 2014-11-24 12:40:49 -08:00
Colin Patrick Mccabe
f636f9d943 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe) 2014-11-24 10:55:21 -08:00
Karthik Kambatla
1e9a3f42ff Update release date for 2.5.2 2014-11-21 14:34:23 -08:00
Andrew Wang
eb4045e765 HADOOP-11323. WritableComparator#compare keeps reference to byte array. Contributed by Wilfred Spiegelenburg. 2014-11-20 11:05:42 -08:00
Allen Wittenauer
72c141ba96 HADOOP-11208. Replace "daemon" with better name in script subcommands (aw) 2014-11-19 14:49:29 -08:00
cnauroth
79301e80d7 HADOOP-11201. Hadoop Archives should support globs resolving to files. Contributed by Gera Shegalov. 2014-11-18 17:05:48 -08:00
Jian He
90a968d675 YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA 2014-11-18 16:12:39 -08:00
Andrew Wang
bcd402ae38 HADOOP-11312. Fix unit tests to not use uppercase key names. 2014-11-18 10:47:46 -08:00
Jason Lowe
b4ca727690 HADOOP-11309. System class pattern package.Foo should match package.Foo$Bar, too. Contributed by Gera Shegalov 2014-11-18 17:22:21 +00:00
Andrew Wang
dcb8e24427 HDFS-6982. nntop: top­-like tool for name node users. (Maysam Yabandeh via wang) 2014-11-17 17:33:42 -08:00
Andrew Wang
48d62fad80 HADOOP-11311. Restrict uppercase key names from being created with JCEKS. 2014-11-17 13:59:46 -08:00
Brandon Li
351c5561c2 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 2014-11-17 13:23:53 -08:00
Aaron T. Myers
bd8196e85e HADOOP-11157. ZKDelegationTokenSecretManager never shuts down listenerThreadPool. Contributed by Arun Suresh. 2014-11-17 13:02:49 -08:00
Haohui Mai
bf8e4332cb HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. 2014-11-17 11:42:20 -08:00
cnauroth
1925e2a4ae HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang. 2014-11-14 16:43:09 -08:00
Karthik Kambatla
4fb96dbe3b HADOOP-11307. create-release script should run git clean first (kasha) 2014-11-14 15:35:50 -08:00
Colin Patrick Mccabe
f95017b3ea Revert HADOOP-11257 because it didn't get a jenkins run yet 2014-11-14 13:06:03 -08:00
Colin Patrick Mccabe
10c98aed38 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-14 12:53:09 -08:00
Ravi Prakash
1a1dcce827 MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times (Sergey Murylev via raviprak) 2014-11-14 03:45:53 -08:00
Arun C. Murthy
9ff7315cbe Preparing to release hadoop-2.6.0-rc1. 2014-11-13 13:02:55 -08:00
Allen Wittenauer
aee68b67f3 HADOOP-11150. hadoop command should show the reason on failure by invalid COMMAND or CLASSNAME (Masatake Iwasaki via aw) 2014-11-13 12:08:03 -08:00
Allen Wittenauer
b650e61a7f HADOOP-11298. slaves.sh and stop-all.sh are missing slashes (aw) 2014-11-13 12:01:38 -08:00
Allen Wittenauer
ba879a5dad HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2014-11-13 11:52:38 -08:00
cnauroth
7dae5b5a88 HADOOP-11291. Log the cause of SASL connection failures. Contributed by Stephen Chu. 2014-11-12 21:54:06 -08:00
cnauroth
0abb973f09 HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA. 2014-11-12 21:41:19 -08:00
Allen Wittenauer
d7150a1bc2 HADOOP-11284. Fix variable name mismatches in hadoop-functions.sh (Masatake Iwasaki via aw) 2014-11-12 15:58:51 -08:00
Allen Wittenauer
306f0c9cea HADOOP-11025. hadoop-daemons.sh should just call hdfs directly (Masatake Iwasaki via aw) 2014-11-12 15:46:58 -08:00
Arun C. Murthy
44feec7122 HADOOP-9576. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 09:55:28 -08:00
Jian He
86bf8c7193 HADOOP-9576. Changed NetUtils#wrapException to throw EOFException instead of wrapping it as IOException. Contributed by Steve Loughran 2014-11-10 17:25:29 -08:00
Haohui Mai
2cc868dede HADOOP-11296. Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor. Contributed by Brandon Li. 2014-11-10 15:42:58 -08:00
Karthik Kambatla
68a0508728 Set the release date for 2.5.2 2014-11-10 15:22:53 -08:00
Haohui Mai
eace218411 HADOOP-11289. Fix typo in RpcUtil log message. Contributed by Charles Lamb. 2014-11-10 11:06:20 -08:00
Arun C. Murthy
ab30d513b6 Release Notes for hadoop-2.6.0. 2014-11-09 19:15:03 -08:00
Arun C. Murthy
770cc14442 Updated CHANGES.txt to reflect hadoop-2.6.0 release dates. 2014-11-09 18:47:21 -08:00
Arun C. Murthy
14b87b70a8 HADOOP-10786. Moved to hadoop-2.7.X. 2014-11-09 18:18:22 -08:00
Haohui Mai
a37a993453 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 2014-11-09 17:48:26 -08:00
Arun C. Murthy
6caa8100d5 HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs. 2014-11-08 15:39:56 -08:00
cnauroth
68db5b3736 HADOOP-11282. Skip NFS TestShellBasedIdMapping tests that are irrelevant on Windows. Contributed by Chris Nauroth. 2014-11-07 14:30:29 -08:00
cnauroth
42bbe3794e HADOOP-11280. TestWinUtils#testChmod fails after removal of NO_PROPAGATE_INHERIT_ACE. Contributed by Chris Nauroth. 2014-11-07 00:02:17 -08:00
Jing Zhao
ba0a42cf67 Revert "HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du." 
This reverts commit 16b3482467.
 2014-11-06 18:27:59 -08:00
Jing Zhao
16b3482467 HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du. 2014-11-06 16:07:50 -08:00
Jason Lowe
10f9f5101c MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov 2014-11-06 15:10:40 +00:00
Aaron T. Myers
ef5af4f8de HADOOP-11187 NameNode - KMS communication fails after a long period of inactivity. Contributed by Arun Suresh. 2014-11-05 18:17:49 -08:00
Aaron T. Myers
8a261e68e4 HADOOP-11272. Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator client. Contributed by Arun Suresh. 2014-11-05 17:47:22 -08:00
Aaron T. Myers
6ba52d88ec HADOOP-10714. AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call. Contributed by Juan Yu. 2014-11-05 17:17:04 -08:00
Haohui Mai
8549fa5dc9 HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu. 2014-11-05 15:34:27 -08:00
Haohui Mai
bc80251b12 HADOOP-11266. Remove no longer supported activation properties for packaging from pom. Contributed by Masatake Iwasaki. 2014-11-05 11:15:28 -08:00
cnauroth
a7fbd4e633 HADOOP-11265. Credential and Key Shell Commands not available on Windows. Contributed by Larry McCay. 2014-11-05 08:38:50 -08:00
Vinayakumar B
8e9502e05d HADOOP-11271. Use Time.monotonicNow() in Shell.java instead of Time.now() (Contributed by Vinayakumar B) 2014-11-05 14:47:52 +05:30
Haohui Mai
0762b4a3fb HADOOP-11269. Add java 8 profile for hadoop-annotations. Contributed by Li Lu. 2014-11-04 18:01:14 -08:00
Haohui Mai
d794f785de HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN. Contributed by Robert Kanter. 2014-11-04 17:52:03 -08:00
Haohui Mai
d78191a716 HADOOP-11268. Update BUILDING.txt to remove the workaround for tools.jar. Contributed by Li Lu. 2014-11-04 16:51:11 -08:00
Karthik Kambatla
4de56d27fb Adding release 2.5.2 to CHANGES.txt 2014-11-04 16:50:40 -08:00
Karthik Kambatla
dbf30e3c0e HADOOP-11260. Patch up Jetty to disable SSLv3. (Mike Yoder via kasha) 2014-11-04 16:18:24 -08:00
Haohui Mai
2e1d9a4127 Update CHANGES.txt for committing HADOOP-10717 to branch-2. 2014-11-04 15:07:46 -08:00
Haohui Mai
ad21d28e07 Update CHANGES.txt for committing HADOOP-10563 to branch-2. 2014-11-04 14:57:08 -08:00
Haohui Mai
1eed102023 HADOOP-10847. Remove the usage of sun.security.x509.* in testing code. Contributed by Pascal Oliva. 2014-11-04 10:52:05 -08:00
cnauroth
85da71c2d3 HADOOP-11165. TestUTF8 fails when run against java 8. Contributed by Stephen Chu. 2014-11-04 10:27:41 -08:00
cnauroth
734eeb4f35 HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics collection. Contributed by Shanyu Zhao. 2014-11-03 14:29:18 -08:00
Kihwal Lee
67f13b58e4 HADOOP-10987. Provide an iterator-based listing API for FileSystem. Contributed by Kihwal Lee. 2014-11-03 08:20:22 -06:00
Vinod Kumar Vavilapalli
b18e8a272e HADOOP-11254. Changed visibility of AccessControlList to be public for consumption by ecosystem. Contributed by Zhijie Shen. 2014-11-01 11:10:03 -07:00
Zhijie Shen
260ab6d5f4 HADOOP-11241. Fixed intermittent TestNMSimulator failure due to timing issue. Contributed by Varun Vasudev. 2014-10-31 18:02:39 -07:00
Jian He
1b4be91866 YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen 2014-10-31 13:16:45 -07:00
Haohui Mai
f1a149e916 HADOOP-11253. Hadoop streaming test TestStreamXmlMultipleRecords fails on Windows. Contributed by Varun Vasudev. 2014-10-31 11:54:33 -07:00
cnauroth
5573b3476a HDFS-7313. Support optional configuration of AES cipher suite on DataTransferProtocol. Contributed by Chris Nauroth. 2014-10-30 22:48:25 -07:00
Brandon Li
5e3f42811f update CHANGES.txt to move HADOOP-11247 to 2.6 2014-10-30 13:29:43 -07:00
Tsz-Wo Nicholas Sze
a3dacc07e2 HADOOP-11221. IdentityHashStore assumes System.identityHashCode() is non-negative. Contributed by Jinghui Wang 2014-10-30 10:58:26 -07:00
Colin Patrick Mccabe
e488f0d93b HADOOP-11250. fix endmacro of set_find_shared_library_without_version in CMakeLists (Yi Liu via Colin P. McCabe) 2014-10-30 10:37:24 -07:00
yliu
2a6be65c8c HADOOP-11216. Improve Openssl library finding. (cmccabe via yliu) 2014-10-30 10:35:14 +08:00
Haohui Mai
05b66ca074 HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li. 2014-10-29 17:54:26 -07:00
Colin Patrick Mccabe
c2575fb046 HADOOP-11186: documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes (cmccabe) 2014-10-29 12:14:10 -07:00
cnauroth
5c900b522e HADOOP-11068. Match hadoop.auth cookie format to jetty output. Contributed by Gregory Chanan. 2014-10-29 11:18:44 -07:00
Brandon Li
72a556d3b0 HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang 2014-10-29 11:05:29 -07:00
Kihwal Lee
b056048114 MAPREDUCE-6022. map_input_file is missing from streaming job 
environment. Contributed by Jason Lowe.
 2014-10-29 12:29:07 -05:00
Karthik Kambatla
3c5f5af118 HADOOP-11243. SSLFactory shouldn't allow SSLv3. (Wei Yan via kasha) 2014-10-28 18:03:00 -07:00
Karthik Kambatla
1a78082338 HADOOP-11217. Disable SSLv3 in KMS. (Robert Kanter via kasha) 2014-10-28 17:18:24 -07:00
cnauroth
c6f04f391b HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao. 2014-10-28 14:06:27 -07:00
yliu
58c0bb9ed9 HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu) 2014-10-28 21:11:31 +08:00
Steve Loughran
c9bec46c92 Revert "HADOOP-10926. Improve test-patch.sh to apply binary diffs (cmccabe)" 
This reverts commit b0e19c9d54.
 2014-10-28 09:58:01 +00:00
yliu
e7859015bc HADOOP-11233. hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default. (Stephen Chu via yliu) 2014-10-28 14:21:26 +08:00
Colin Patrick Mccabe
b0e19c9d54 HADOOP-10926. Improve test-patch.sh to apply binary diffs (cmccabe) 2014-10-27 18:22:28 -07:00
cnauroth
5b1dfe78b8 HDFS-6934. Revert files accidentally committed. 2014-10-27 12:15:10 -07:00
Jian He
c05b581a55 YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen 2014-10-27 10:45:53 -07:00
cnauroth
463aec1171 HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 2014-10-27 09:38:30 -07:00
Harsh J
2429b31656 HADOOP-11236. NFS: Fix javadoc warning in RpcProgram.java. Contributed by Abhiraj Butala. (harsh) 2014-10-27 19:09:52 +05:30
Vinod Kumar Vavilapalli
9ada9284d8 HADOOP-11170. Pulling into branch-2.6 also, fixing CHANGES.txt. 2014-10-26 11:25:24 -07:00
Vinod Kumar Vavilapalli
0186645505 YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He. 2014-10-26 11:14:34 -07:00
Byron Wong
28051e4155 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong. 2014-10-25 12:31:41 -07:00
Haohui Mai
0ac698864d Fix CHANGES.txt for HADOOP-112321 and HADOOP-10748. 2014-10-24 14:23:43 -07:00
Haohui Mai
dc6e819ed8 HADOOP-11231. Remove dead code in ServletUtil. Contributed by Li Lu. 2014-10-24 14:19:52 -07:00
Jian He
501e49f2e1 Fix CHANGES.txt for HADOOP-11228 2014-10-24 12:56:39 -07:00
Jian He
f7e89bb349 HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu 2014-10-24 12:50:27 -07:00
Colin Patrick Mccabe
5b56ac4c72 HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe) 2014-10-23 19:14:00 -07:00
Karthik Kambatla
db45f047ab HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha) 2014-10-23 17:04:14 -07:00
Colin Patrick Mccabe
7ab754545d HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost (cmccabe) 2014-10-23 13:25:39 -07:00
Jian He
3b12fd6cfb YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu 2014-10-22 15:57:46 -07:00
Karthik Kambatla
70719e5c62 HADOOP-11122. Fix findbugs in ZK DelegationTokenSecretManagers. (Arun Suresh via kasha) 2014-10-22 14:26:27 -07:00
cnauroth
6637e3cf95 YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch. 2014-10-21 12:33:21 -07:00
Karthik Kambatla
d5084b9fa3 HADOOP-11194. Ignore .keep files (kasha) 2014-10-20 11:29:09 -04:00
Vinod Kumar Vavilapalli
1137557816 HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen. 2014-10-17 15:56:07 -07:00
Ravi Prakash
b0d6ac92fe HADOOP-11182. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) Fix CHANGES.txt 2014-10-16 16:49:48 -07:00
Ravi Prakash
466f08792f HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) 2014-10-15 15:49:46 -07:00
Zhijie Shen
1220bb72d4 YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen. 2014-10-14 21:50:46 -07:00
Zhijie Shen
cdce88376a HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen. 2014-10-14 11:35:38 -07:00
Haohui Mai
5faaba0bd0 HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu. 2014-10-13 20:43:02 -07:00
Aaron T. Myers
0e57aa3bf6 HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh. 2014-10-13 18:09:39 -07:00
Karthik Kambatla
cc93e7e683 YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha) 2014-10-13 16:32:01 -07:00
cnauroth
1770bb942f HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao. 2014-10-13 10:56:32 -07:00
Haohui Mai
554250cf88 HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao. 2014-10-10 23:02:22 -07:00
cnauroth
f4b7e99f4e HADOOP-11188. hadoop-azure: automatically expand page blobs when they become full. Contributed by Eric Hanson. 2014-10-10 15:05:52 -07:00
Andrew Wang
d3d3d47202 HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang) 2014-10-10 13:40:37 -07:00
Colin Patrick Mccabe
1ceb326933 HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe) 2014-10-10 13:03:29 -07:00
Aaron T. Myers
cbd21fd13b HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang. 2014-10-09 18:52:48 -07:00
Colin Patrick Mccabe
d8d628d1e0 HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe) 2014-10-09 17:05:35 -07:00
Andrew Wang
8d94114495 HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang) 2014-10-09 13:21:19 -07:00
Andrew Wang
d7b647f0ee HADOOP-11178. Fix findbugs exclude file. (Arun Suresh via wang) 2014-10-09 11:58:36 -07:00
cnauroth
9097183983 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth. 2014-10-09 11:51:12 -07:00
cnauroth
1123a06e36 HADOOP-11175. Fix several issues of hadoop security configuration in user doc. Contributed by Yi Liu. 2014-10-09 11:10:23 -07:00
Uma Maheswara Rao G
8d7c54967d HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh) 2014-10-09 20:06:41 +05:30
Aaron T. Myers
2a51494ce1 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh. 2014-10-08 18:01:51 -07:00
Colin Patrick Mccabe
d996235285 HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe) 2014-10-08 17:55:46 -07:00
Zhijie Shen
a169051931 HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch. 2014-10-08 15:36:16 -07:00
cnauroth
2217e2f8ff HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell. 2014-10-08 14:20:23 -07:00
Colin Patrick Mccabe
7b29f99ad2 CHANGES.txt: move HADOOP-10404 underneath branch 2.6 2014-10-08 14:02:23 -07:00
Andrew Wang
60f0f6fcde HADOOP-11166. Remove ulimit from test-patch.sh. 2014-10-07 17:30:07 -07:00
Andrew Wang
0263656247 Fixup for CHANGES.txt 2014-10-07 14:58:57 -07:00
Andrew Wang
4b2834898c HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang) 2014-10-07 14:57:03 -07:00
Andrew Wang
b2f6197523 HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang) 2014-10-07 14:46:59 -07:00
Kihwal Lee
99d7a452be HADOOP-11007. Reinstate building of ant tasks support. Contributed by 
Jason Lowe.
 2014-10-07 16:20:16 -05:00
Colin Patrick Mccabe
9196db9a08 HDFS-7186. Document the "hadoop trace" command. (Masatake Iwasaki via Colin P. McCabe) 2014-10-07 11:56:30 -07:00
Haohui Mai
0fb273570c HADOOP-11168. Remove duplicated entry dfs.webhdfs.enabled in the user doc. Contributed by Yi Liu. 2014-10-06 22:07:16 -06:00
Colin Patrick Mccabe
687d83c9e1 HADOOP-10404. Commit correct version of patch (cmccabe) 2014-10-06 14:44:13 -07:00
Colin Patrick Mccabe
8099de259f HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe) 2014-10-06 14:40:56 -07:00
Arun C. Murthy
16333b4fd8 HADOOP-10731. Sync-ing CHANGES.txt across branches. 2014-10-05 07:50:41 -07:00
Arun C. Murthy
8f9ab998e2 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan. 2014-10-05 07:38:21 -07:00
cnauroth
bbb3b1acc0 HADOOP-11163. Correct CHANGES.txt. 2014-10-03 21:07:01 -07:00
cnauroth
69c9af9103 HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu. 2014-10-03 21:01:28 -07:00
Colin Patrick Mccabe
7f6ed7fe36 HDFS-7055. Add tracing to DFSInputStream (cmccabe) 2014-10-03 13:35:43 -07:00
Andrew Wang
2d8e6e2c4a HADOOP-11151. Automatically refresh auth token and retry on auth failure. Contributed by Arun Suresh. 2014-10-02 19:54:57 -07:00
Haohui Mai
f679ca38ce HADOOP-11160. Fix typo in nfs3 server duplicate entry reporting. Contributed by Charles Lamb. 2014-10-02 14:07:36 -07:00
Andrew Wang
6ac10516e7 HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang) 2014-10-02 13:51:08 -07:00
Vinod Kumar Vavilapalli
5ca97f1e60 YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu. 
Committed as a YARN patch even though all the code changes are in common.
 2014-10-01 09:54:17 -07:00
arp
dde2ed13c2 Merge branch 'trunk' into HDFS-6581 2014-09-30 18:05:54 -07:00
Steve Loughran
a469833639 HADOOP-11117 UGI HadoopLoginModule doesn't catch & wrap all kerberos-related exceptions (stevel) 2014-09-30 17:30:06 -07:00
Andrew Wang
a4c9b80a7c HADOOP-11113. Namenode not able to reconnect to KMS after KMS restart. (Arun Suresh via wang) 2014-09-30 16:48:24 -07:00
Andrew Wang
d7075ada5d HADOOP-11156. DelegateToFileSystem should implement getFsStatus(final Path f). Contributed by Zhihai Xu. 2014-09-30 16:39:44 -07:00
Arun C. Murthy
ea32a66f7d Preparing to branch hadoop-2.6 2014-09-30 10:26:42 -07:00
cnauroth
b9158697a4 HADOOP-11145. TestFairCallQueue fails. Contributed by Akira AJISAKA. 2014-09-30 08:57:05 -07:00
cnauroth
8dc4e9408f HADOOP-11154. Update BUILDING.txt to state that CMake 3.0 or newer is required on Mac. Contributed by Chris Nauroth. 2014-09-30 08:30:44 -07:00
arp
bb84f1fccb HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal) 2014-09-29 22:27:59 -07:00
arp
7f0422be76 Merge branch 'trunk' into HDFS-6581 2014-09-29 16:29:43 -07:00
Brandon Li
c88c6c57aa HADOOP-11130. NFS updateMaps OS check is reversed. Contributed by Brandon Li 2014-09-29 15:05:59 -07:00
Andrew Wang
64aef18965 HADOOP-11153. Make number of KMS threads configurable. (wang) 2014-09-29 15:02:29 -07:00
Andrew Wang
c6c3247dc0 HDFS-7122. Use of ThreadLocal<Random> results in poor block placement. (wang) 2014-09-29 15:00:26 -07:00
arp
1e6b4b9b2e Merge branch 'trunk' into HDFS-6581 2014-09-29 14:01:47 -07:00
Andrew Wang
a45b331cc9 Move HDFS-7157 to HDFS CHANGES.txt 2014-09-29 13:17:21 -07:00
Andrew Wang
a78953c974 HADOOP-11110. JavaKeystoreProvider should not report a key as created if it was not flushed to the backing file. (Arun Suresh via wang) 2014-09-29 13:10:26 -07:00
Colin Patrick Mccabe
b3d5d269a7 HDFS-7157. Using Time.now() for recording start/end time of reconfiguration tasks (Lei Xu via Colin Patrick McCabe) 2014-09-29 11:29:54 -07:00
Jason Lowe
cf4631d7c9 HADOOP-11049. javax package system class default is too broad. Contributed by Sangjin Lee 2014-09-29 14:36:29 +00:00
arp
9cbb2c55d5 Merge branch 'trunk' into HDFS-6581 2014-09-27 20:28:03 -07:00
Steve Loughran
7f300bcdc7 HADOOP-11143 NetUtils.wrapException loses inner stack trace on BindException 2014-09-27 21:06:53 +01:00
Jian He
5f16c98ad6 MAPREDUCE-6087. Fixed wrong config name of MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by Akira AJISAKA 2014-09-26 18:05:26 -07:00
arp
d96396627f Merge branch 'trunk' into HDFS-6581 2014-09-26 16:31:08 -07:00
Allen Wittenauer
6b7673e3cd HADOOP-10552. Fix usage and example at FileSystemShell.apt.vm (Kenji Kikushima via aw) 2014-09-26 14:56:59 -07:00
Allen Wittenauer
aa5d9256fb HADOOP-10731. Remove @date JavaDoc comment in ProgramDriver class (Henry Saputra via aw) 2014-09-26 14:41:37 -07:00
Allen Wittenauer
c7c8e388a9 MAPREDUCE-5945. Update the description of GenericOptionsParser -jt option (Akira AJISAKA via aw) 2014-09-26 14:25:49 -07:00
Jason Lowe
f154ebe8c4 HADOOP-11048. user/custom LogManager fails to load if the client classloader is enabled. Contributed by Sangjin Lee 2014-09-26 19:49:23 +00:00
Allen Wittenauer
83264cf457 HADOOP-10954. Adding site documents of hadoop-tools (Masatake Iwasaki via aw) 2014-09-26 11:59:45 -07:00
Allen Wittenauer
df5fed5c0e HADOOP-8808. Update FsShell documentation to mention deprecation of some of the commands, and mention alternatives (Akira AJISAKA via aw) 2014-09-26 11:10:51 -07:00
arp
7060502edb Merge branch 'trunk' into HDFS-6581 2014-09-26 11:09:03 -07:00
Colin Patrick Mccabe
55302ccfba HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe) 2014-09-26 10:30:30 -07:00
Andrew Wang
4ea77efa3a HADOOP-11140. hadoop-aws only need test-scoped dependency on hadoop-common's tests jar. Contributed by Juan Yu. 2014-09-25 21:56:26 -07:00
arp
032e0eba6b Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-25 19:50:28 -07:00
Andrew Wang
e96ce6f3e3 HDFS-7077. Separate CipherSuite from crypto protocol version. (wang) 2014-09-25 18:40:40 -07:00
Colin Patrick Mccabe
1861b32eb5 HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe) 2014-09-25 13:11:59 -07:00
arp
e9edafc731 Merge branch 'trunk' into HDFS-6581 2014-09-25 11:06:25 -07:00
Vinayakumar B
dff95f7af8 HADOOP-11101. How about inputstream close statement from catch block to finally block in FileContext#copy() ( Contributed by skrho ) 2014-09-25 12:46:47 +05:30
arp
b1000fbba4 Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
 2014-09-24 20:08:32 -07:00
Allen Wittenauer
3cde37c991 HADOOP-11009. Add Timestamp Preservation to DistCp (Gary Steelman via aw) 2014-09-24 15:38:30 -07:00
cnauroth
cbf0ae742a HADOOP-11064. UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes. Contributed by Chris Nauroth. 2014-09-24 15:30:13 -07:00
Karthik Kambatla
ef784a2e08 HADOOP-11017. Addendum to fix RM HA. KMS delegation token secret manager should be able to use zookeeper as store. (Arun Suresh via kasha) 2014-09-23 17:07:48 -07:00
arp
bfc7b7e6a0 Merge branch 'trunk' into HDFS-6581 2014-09-23 16:40:35 -07:00
Allen Wittenauer
3dc28e2052 HADOOP-11092. hadoop shell commands should print usage if not given a class (aw) 2014-09-23 12:24:23 -07:00
Steve Loughran
7aa667eefa HADOOP-11111 MiniKDC to use locale EN_US for case conversions: hadoop-common/CHANGES.TXT 2014-09-23 10:57:15 +01:00
arp
889122bd55 Merge branch 'trunk' into HDFS-6581 2014-09-22 18:00:58 -07:00
Vinayakumar B
eab15af12c HADOOP-10131. NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree (Contributed by Vinayakumar B) 2014-09-22 11:25:56 +05:30
Andrew Wang
1737950d0f HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. Contributed by Zhe Zhang. 2014-09-21 21:29:46 -07:00
arp
09dab88d3e Merge branch 'trunk' into HDFS-6581 2014-09-20 10:34:45 -07:00
Alejandro Abdelnur
db890eef32 HADOOP-11017. KMS delegation token secret manager should be able to use zookeeper as store. (asuresh via tucu) 2014-09-20 08:21:44 -07:00
cnauroth
f85cc14eb4 HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth. 2014-09-19 21:23:26 -07:00
Andrew Wang
b6ceef90e5 HADOOP-11112. TestKMSWithZK does not use KEY_PROVIDER_URI. (tucu via wang) 2014-09-19 17:42:00 -07:00
Andrew Wang
adf0b67a71 HADOOP-10970. Cleanup KMS configuration keys. (wang) 2014-09-19 14:59:25 -07:00
Allen Wittenauer
9f03a7c018 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw) 2014-09-19 11:33:07 -07:00
arp
f8bbf80067 Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsLocatedFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2014-09-18 22:26:42 -07:00
Aaron T. Myers
6434572297 HADOOP-11109. Site build is broken. Contributed by Jian He. 2014-09-18 18:00:39 -07:00
Andrew Wang
8e73084491 HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang) 2014-09-18 17:49:17 -07:00
Tsz-Wo Nicholas Sze
98f7bfe993 Merge branch 'HDFS-6584' into trunk 2014-09-19 07:11:19 +08:00
Alejandro Abdelnur
fad4cd85b3 KMS: Support for multiple Kerberos principals. (tucu) 2014-09-18 16:03:38 -07:00
arp
22295b4783 Merge branch 'trunk' into HDFS-6581 2014-09-18 15:59:37 -07:00
cnauroth
1b4b46004a HADOOP-11105. Update CHANGES.txt. 2014-09-18 15:41:19 -07:00
cnauroth
1942364ef1 HADOOP-11105. MetricsSystemImpl could leak memory in registered callbacks. Contributed by Chuan Liu. 2014-09-18 15:36:43 -07:00
Andrew Wang
fe2f54d4cb HADOOP-11106. Document considerations of HAR and Encryption. (clamb via wang) 2014-09-18 14:51:08 -07:00
arp
849ccfa699 Merge branch 'trunk' into HDFS-6581 2014-09-18 11:06:40 -07:00
Tsz-Wo Nicholas Sze
2d2b0009e6 Merge branch 'trunk' into HDFS-6584 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2014-09-18 13:00:29 +08:00
Andrew Wang
bf38793ce1 Move some HDFS JIRAs to the correct CHANGES.txt 2014-09-17 18:08:34 -07:00
Andrew Wang
47e5e19831 HADOOP-11040. Return value of read(ByteBuffer buf) in CryptoInputStream is incorrect in some cases. (Yi Liu via wang) 2014-09-17 17:58:56 -07:00
Alejandro Abdelnur
123f20d42f HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu) 2014-09-17 15:29:17 -07:00
arp
a186d514bd Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2014-09-17 15:03:55 -07:00
Colin Patrick Mccabe
f230248525 HDFS-7075. hadoop-fuse-dfs fails because it cannot find JavaKeyStoreProvider$Factory. (cmccabe) 2014-09-17 14:27:32 -07:00
Colin Patrick Mccabe
f24ac429d1 HDFS-6843. Add to CHANGES.txt 2014-09-17 13:38:11 -07:00
Jing Zhao
911979c8ab Merge changes from trunk 2014-09-17 13:12:45 -07:00
Colin Patrick Mccabe
e3803d002c HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe) 2014-09-17 12:55:35 -07:00
arp
24f8156886 Merge branch 'trunk' into HDFS-6581 2014-09-17 12:10:50 -07:00
Alejandro Abdelnur
3f8f860cc6 Revert "HADOOP-10982" 
This reverts commit d9a86031a0.
 2014-09-17 11:11:15 -07:00
Alejandro Abdelnur
d9a86031a0 HADOOP-10982 2014-09-17 11:08:00 -07:00
Alejandro Abdelnur
e4ddb6da15 HADOOP-11099. KMS return HTTP UNAUTHORIZED 401 on ACL failure. (tucu) 2014-09-17 11:07:56 -07:00
Alejandro Abdelnur
c0c7e6fabd HADOOP-11062. CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used. (asuresh via tucu) 2014-09-16 23:36:36 -07:00
Alejandro Abdelnur
8cf1052beb HADOOP-11097. kms docs say proxyusers, not proxyuser for config params. (clamb via tucu) 2014-09-16 23:20:35 -07:00
Alejandro Abdelnur
e14e71d5fe HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu) 2014-09-16 23:20:35 -07:00
arp
dcbc467301 HDFS-7079. Few more unit test fixes for HDFS-6581. (Arpit Agarwal) 2014-09-16 18:19:57 -07:00
arp
a24a9331d4 Merge branch 'trunk' into HDFS-6581 2014-09-16 18:18:09 -07:00
Jing Zhao
432b863719 Merge changes from trunk 2014-09-16 17:58:39 -07:00
Jing Zhao
2e4033e872 HDFS-7052. Archival Storage: Add Mover into hdfs script. Contributed by Jing Zhao. 2014-09-16 17:52:28 -07:00