big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9,852 Commits 2 Branches 2 Tags 264 MiB
3472e3bd6c
Commit Graph

1818 Commits

Author SHA1 Message Date
Colin Patrick Mccabe
e369d98ba2 HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream (Yi Liu via Colin P. McCabe) 2014-12-19 13:11:38 -08:00
Jason Lowe
b9d49761f7 HADOOP-11409. FileContext.getFileContext can stack overflow if default fs misconfigured. Contributed by Gera Shegalov 2014-12-18 21:27:28 +00:00
Haohui Mai
ef1fc51852 HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. Contributed by Haohui Mai. 2014-12-18 11:33:09 -08:00
Colin Patrick Mccabe
07619aa516 HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe) 2014-12-18 11:05:06 -08:00
Colin Patrick Mccabe
9937eef7f7 HADOOP-11421. Add IOUtils#listDirectory (cmccabe) 2014-12-17 15:18:16 -08:00
Colin Patrick Mccabe
4281c96e24 HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) 2014-12-17 10:32:40 -08:00
Allen Wittenauer
bc21a1c07a HADOOP-11397. Can't override HADOOP_IDENT_STRING (Kengo Seki via aw) 2014-12-17 09:06:01 -08:00
cnauroth
e996a1bfd4 HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth. 2014-12-16 15:29:22 -08:00
Benoy Antony
a095622f36 HADOOP-10852 Fix thread safety issues in NetgroupCache. (Benoy Antony) 2014-12-15 14:00:25 -08:00
Colin Patrick Mccabe
e5a6925199 HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe) 2014-12-12 16:30:52 -08:00
Haohui Mai
5b9fcedb4d HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. Contributed by Haohui Mai. 2014-12-11 16:42:38 -08:00
Gera Shegalov
0bcea111e5 HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera) 2014-12-11 13:12:13 -08:00
Allen Wittenauer
8e9a266819 HADOOP-11353. Add support for .hadooprc (aw) 2014-12-11 09:00:35 -08:00
Haohui Mai
84d50003f6 HADOOP-11386. Replace \n by %n in format hadoop-common format strings. Contributed by Li Lu. 2014-12-10 14:37:52 -08:00
Allen Wittenauer
c536142699 HADOOP-6590. Add a username check for hadoop sub-commands (John Smith via aw) 2014-12-10 13:41:28 -08:00
Allen Wittenauer
a7c6c710b2 HADOOP-10950. rework heap management vars (John Smith via aw) 2014-12-10 13:37:32 -08:00
Haohui Mai
44870dcf41 HADOOP-11388. Remove deprecated o.a.h.metrics.file.FileContext. Contributed by Li Lu. 2014-12-10 12:46:42 -08:00
Haohui Mai
bbd6a32776 HADOOP-10482. Fix various findbugs warnings in hadoop-common. Contributed by Haohui Mai. 2014-12-10 12:44:25 -08:00
Colin Patrick Mccabe
03867eb1bb HADOOP-11349. RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails. (Varun Saxena via Colin P. McCabe) 2014-12-09 14:31:44 -08:00
Jing Zhao
5776a41da0 HDFS-7498. Simplify the logic in INodesInPath. Contributed by Jing Zhao. 2014-12-09 11:37:39 -08:00
Andrew Wang
74d4bfded9 HADOOP-11368. Fix SSLFactory truststore reloader thread leak in KMSClientProvider. Contributed by Arun Suresh. 2014-12-09 10:47:24 -08:00
Haohui Mai
0ee41612bb HADOOP-11287. Simplify UGI#reloginFromKeytab for Java 7+. Contributed by Li Lu. 2014-12-08 21:10:32 -08:00
cnauroth
ffe942b82c HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B. 2014-12-08 10:23:09 -08:00
Andrew Wang
0707e4eca9 HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen. 2014-12-05 18:20:19 -08:00
Haohui Mai
2829b7a96f HADOOP-11356. Removed deprecated o.a.h.fs.permission.AccessControlException. Contributed by Li Lu. 2014-12-05 10:49:43 -08:00
Vinayakumar B
92ce6eda92 HADOOP-11296. hadoop-daemons.sh throws 'host1: bash: host3: command not found...' (Contributed by Vinayakumar B) 2014-12-03 10:07:43 +05:30
stack
b36f292982 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY #2 2014-12-01 23:07:05 -08:00
stack
692d3b83e4 Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY" 
This reverts commit 74f4d8590d.

Refers to the wrong issue (HBASE rather than HADOOP)
 2014-12-01 23:04:00 -08:00
stack
74f4d8590d HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY 2014-12-01 22:46:57 -08:00
stack
4e312a4345 Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)" 
This reverts commit fb41615887.

Reverting because I over-changed CHANGES.txt white-space.
 2014-12-01 22:41:44 -08:00
stack
fb41615887 HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 2014-12-01 22:34:58 -08:00
Allen Wittenauer
031f980e7e HADOOP-11081. Document hadoop properties expected to be set by the shell code in *-env.sh (aw) 2014-12-01 16:21:20 -08:00
Colin Patrick Mccabe
86e3993def HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 2014-12-01 11:42:10 -08:00
Colin Patrick Mccabe
aa2f277256 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 12:17:48 -08:00
Andrew Wang
fae266bbf1 HADOOP-11173. Improve error messages for some KeyShell commands. 2014-11-25 16:13:32 -08:00
Colin Patrick Mccabe
f636f9d943 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe) 2014-11-24 10:55:21 -08:00
Andrew Wang
eb4045e765 HADOOP-11323. WritableComparator#compare keeps reference to byte array. Contributed by Wilfred Spiegelenburg. 2014-11-20 11:05:42 -08:00
Jason Lowe
b4ca727690 HADOOP-11309. System class pattern package.Foo should match package.Foo$Bar, too. Contributed by Gera Shegalov 2014-11-18 17:22:21 +00:00
Andrew Wang
dcb8e24427 HDFS-6982. nntop: top­-like tool for name node users. (Maysam Yabandeh via wang) 2014-11-17 17:33:42 -08:00
Andrew Wang
48d62fad80 HADOOP-11311. Restrict uppercase key names from being created with JCEKS. 2014-11-17 13:59:46 -08:00
Brandon Li
351c5561c2 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 2014-11-17 13:23:53 -08:00
Aaron T. Myers
bd8196e85e HADOOP-11157. ZKDelegationTokenSecretManager never shuts down listenerThreadPool. Contributed by Arun Suresh. 2014-11-17 13:02:49 -08:00
Haohui Mai
bf8e4332cb HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. 2014-11-17 11:42:20 -08:00
cnauroth
1925e2a4ae HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang. 2014-11-14 16:43:09 -08:00
Colin Patrick Mccabe
f95017b3ea Revert HADOOP-11257 because it didn't get a jenkins run yet 2014-11-14 13:06:03 -08:00
Colin Patrick Mccabe
10c98aed38 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-14 12:53:09 -08:00
Ravi Prakash
1a1dcce827 MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times (Sergey Murylev via raviprak) 2014-11-14 03:45:53 -08:00
Arun C. Murthy
9ff7315cbe Preparing to release hadoop-2.6.0-rc1. 2014-11-13 13:02:55 -08:00
Allen Wittenauer
aee68b67f3 HADOOP-11150. hadoop command should show the reason on failure by invalid COMMAND or CLASSNAME (Masatake Iwasaki via aw) 2014-11-13 12:08:03 -08:00
Allen Wittenauer
b650e61a7f HADOOP-11298. slaves.sh and stop-all.sh are missing slashes (aw) 2014-11-13 12:01:38 -08:00
Allen Wittenauer
ba879a5dad HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2014-11-13 11:52:38 -08:00
cnauroth
7dae5b5a88 HADOOP-11291. Log the cause of SASL connection failures. Contributed by Stephen Chu. 2014-11-12 21:54:06 -08:00
cnauroth
0abb973f09 HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA. 2014-11-12 21:41:19 -08:00
Allen Wittenauer
d7150a1bc2 HADOOP-11284. Fix variable name mismatches in hadoop-functions.sh (Masatake Iwasaki via aw) 2014-11-12 15:58:51 -08:00
Allen Wittenauer
306f0c9cea HADOOP-11025. hadoop-daemons.sh should just call hdfs directly (Masatake Iwasaki via aw) 2014-11-12 15:46:58 -08:00
Jian He
86bf8c7193 HADOOP-9576. Changed NetUtils#wrapException to throw EOFException instead of wrapping it as IOException. Contributed by Steve Loughran 2014-11-10 17:25:29 -08:00
Arun C. Murthy
ab30d513b6 Release Notes for hadoop-2.6.0. 2014-11-09 19:15:03 -08:00
Haohui Mai
a37a993453 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 2014-11-09 17:48:26 -08:00
Arun C. Murthy
6caa8100d5 HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs. 2014-11-08 15:39:56 -08:00
Jing Zhao
ba0a42cf67 Revert "HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du." 
This reverts commit 16b3482467.
 2014-11-06 18:27:59 -08:00
Jing Zhao
16b3482467 HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du. 2014-11-06 16:07:50 -08:00
Jason Lowe
10f9f5101c MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov 2014-11-06 15:10:40 +00:00
Aaron T. Myers
ef5af4f8de HADOOP-11187 NameNode - KMS communication fails after a long period of inactivity. Contributed by Arun Suresh. 2014-11-05 18:17:49 -08:00
Aaron T. Myers
8a261e68e4 HADOOP-11272. Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator client. Contributed by Arun Suresh. 2014-11-05 17:47:22 -08:00
cnauroth
a7fbd4e633 HADOOP-11265. Credential and Key Shell Commands not available on Windows. Contributed by Larry McCay. 2014-11-05 08:38:50 -08:00
Vinayakumar B
8e9502e05d HADOOP-11271. Use Time.monotonicNow() in Shell.java instead of Time.now() (Contributed by Vinayakumar B) 2014-11-05 14:47:52 +05:30
Karthik Kambatla
dbf30e3c0e HADOOP-11260. Patch up Jetty to disable SSLv3. (Mike Yoder via kasha) 2014-11-04 16:18:24 -08:00
Kihwal Lee
67f13b58e4 HADOOP-10987. Provide an iterator-based listing API for FileSystem. Contributed by Kihwal Lee. 2014-11-03 08:20:22 -06:00
Vinod Kumar Vavilapalli
b18e8a272e HADOOP-11254. Changed visibility of AccessControlList to be public for consumption by ecosystem. Contributed by Zhijie Shen. 2014-11-01 11:10:03 -07:00
Jian He
1b4be91866 YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen 2014-10-31 13:16:45 -07:00
Tsz-Wo Nicholas Sze
a3dacc07e2 HADOOP-11221. IdentityHashStore assumes System.identityHashCode() is non-negative. Contributed by Jinghui Wang 2014-10-30 10:58:26 -07:00
Haohui Mai
05b66ca074 HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li. 2014-10-29 17:54:26 -07:00
Brandon Li
72a556d3b0 HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang 2014-10-29 11:05:29 -07:00
Kihwal Lee
b056048114 MAPREDUCE-6022. map_input_file is missing from streaming job 
environment. Contributed by Jason Lowe.
 2014-10-29 12:29:07 -05:00
Karthik Kambatla
3c5f5af118 HADOOP-11243. SSLFactory shouldn't allow SSLv3. (Wei Yan via kasha) 2014-10-28 18:03:00 -07:00
cnauroth
c6f04f391b HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao. 2014-10-28 14:06:27 -07:00
yliu
58c0bb9ed9 HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu) 2014-10-28 21:11:31 +08:00
yliu
e7859015bc HADOOP-11233. hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default. (Stephen Chu via yliu) 2014-10-28 14:21:26 +08:00
cnauroth
5b1dfe78b8 HDFS-6934. Revert files accidentally committed. 2014-10-27 12:15:10 -07:00
Jian He
c05b581a55 YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen 2014-10-27 10:45:53 -07:00
cnauroth
463aec1171 HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 2014-10-27 09:38:30 -07:00
Vinod Kumar Vavilapalli
0186645505 YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He. 2014-10-26 11:14:34 -07:00
Byron Wong
28051e4155 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong. 2014-10-25 12:31:41 -07:00
Haohui Mai
dc6e819ed8 HADOOP-11231. Remove dead code in ServletUtil. Contributed by Li Lu. 2014-10-24 14:19:52 -07:00
Jian He
f7e89bb349 HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu 2014-10-24 12:50:27 -07:00
Colin Patrick Mccabe
5b56ac4c72 HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe) 2014-10-23 19:14:00 -07:00
Karthik Kambatla
db45f047ab HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha) 2014-10-23 17:04:14 -07:00
Colin Patrick Mccabe
7ab754545d HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost (cmccabe) 2014-10-23 13:25:39 -07:00
Jian He
3b12fd6cfb YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu 2014-10-22 15:57:46 -07:00
Karthik Kambatla
70719e5c62 HADOOP-11122. Fix findbugs in ZK DelegationTokenSecretManagers. (Arun Suresh via kasha) 2014-10-22 14:26:27 -07:00
cnauroth
6637e3cf95 YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch. 2014-10-21 12:33:21 -07:00
Vinod Kumar Vavilapalli
1137557816 HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen. 2014-10-17 15:56:07 -07:00
Ravi Prakash
466f08792f HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) 2014-10-15 15:49:46 -07:00
Zhijie Shen
1220bb72d4 YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen. 2014-10-14 21:50:46 -07:00
Zhijie Shen
cdce88376a HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen. 2014-10-14 11:35:38 -07:00
Haohui Mai
5faaba0bd0 HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu. 2014-10-13 20:43:02 -07:00
Aaron T. Myers
0e57aa3bf6 HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh. 2014-10-13 18:09:39 -07:00
Karthik Kambatla
cc93e7e683 YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha) 2014-10-13 16:32:01 -07:00
cnauroth
1770bb942f HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao. 2014-10-13 10:56:32 -07:00
Haohui Mai
554250cf88 HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao. 2014-10-10 23:02:22 -07:00