big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,322 Commits 2 Branches 2 Tags 264 MiB
05fa3368f1
Commit Graph

2039 Commits

Author SHA1 Message Date
cnauroth
0e80d51983 HDFS-8554. TestDatanodeLayoutUpgrade fails on Windows. Contributed by Chris Nauroth. 2015-06-08 08:39:02 -07:00
Steve Loughran
18f6809776 HADOOP-12052 IPC client downgrades all exception types to IOE, breaks callers trying to use them. (Brahma Reddy Battula via stevel) 2015-06-08 13:02:56 +01:00
cnauroth
e46cb80002 HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. 2015-06-06 09:17:03 -07:00
Jason Lowe
b3ffa87003 MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li 2015-06-05 22:38:31 +00:00
Andrew Wang
bc11e158b1 HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory. Contributed by Zhihai Xu. 2015-06-05 13:52:21 -07:00
Andrew Wang
2dbc40e608 HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey. 2015-06-05 13:11:01 -07:00
Gera Shegalov
9f6d67844d HADOOP-11924. Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) 2015-06-04 11:38:28 -07:00
Andrew Wang
374ddd9f9e HADOOP-12043. Display warning if defaultFs is not set when running fs commands. Contributed by Eddy Xu. 2015-05-29 17:15:58 -07:00
Vinayakumar B
7366e42563 HADOOP-12042. Users may see TrashPolicy if hdfs dfs -rm is run (Contributed by Andreina J) 2015-05-29 16:51:23 +05:30
cnauroth
860b8373c3 HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay. 2015-05-28 15:01:42 -07:00
Allen Wittenauer
ae14543420 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits (aw) 2015-05-28 13:24:01 -07:00
Colin Patrick Mccabe
a1140959da HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-05-28 12:00:55 -07:00
Colin Patrick Mccabe
246cefa089 HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread. (zhouyingchao via cmccabe) 2015-05-28 11:52:28 -07:00
Allen Wittenauer
08ae87f6ba HADOOP-11983. HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is supposed to do (Sangjin Lee via aw) 2015-05-28 11:29:58 -07:00
Allen Wittenauer
5df1fadf87 HADOOP-7947. Validate XMLs if a relevant tool is available, when using scripts (Kengo Seki via aw) 2015-05-28 11:01:00 -07:00
Allen Wittenauer
5504a261f8 HADOOP-11406. xargs -P is not portable (Kengo Seki via aw) 2015-05-28 10:36:40 -07:00
Allen Wittenauer
bf500d9798 HDFS-5033. Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source (Darrell Taylor via aw) 2015-05-27 16:51:34 -07:00
Akira Ajisaka
bb1816328a HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki. 2015-05-27 18:04:40 +09:00
Colin Patrick Mccabe
7dba7005b7 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) 2015-05-26 12:15:46 -07:00
Akira Ajisaka
56996a685e HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru. 2015-05-26 16:16:21 +09:00
Akira Ajisaka
c7fea088f7 HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki. 2015-05-22 14:15:08 +09:00
Jakob Homan
4fc942a84f HADOOP-12016. Typo in FileSystem::listStatusIterator. Contributed by Arthur Vigil. 2015-05-21 14:50:03 -07:00
Akira Ajisaka
0e4f1081c7 HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru. 2015-05-21 17:52:03 +09:00
Haohui Mai
fb6b38d67d HADOOP-11772. RPC Invoker relies on static ClientCache which has synchronized(this) blocks. Contributed by Haohui Mai. 2015-05-20 20:10:50 -07:00
Arun Suresh
fd3cb533d2 HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) 2015-05-19 11:35:57 -07:00
Colin Patrick Mccabe
470c87dbc6 HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 2015-05-19 10:50:15 -07:00
Vinayakumar B
d4a2830b63 HADOOP-11103. Clean up RemoteException (Contributed by Sean Busbey) 2015-05-19 14:41:05 +05:30
Akira Ajisaka
3b50dcdce4 HADOOP-10971. Add -C flag to make hadoop fs -ls print filenames only. Contributed by Kengo Seki. 2015-05-19 17:25:27 +09:00
Arpit Agarwal
a2190bf15d HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:36:29 -07:00
cnauroth
09fe16f166 HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R. 2015-05-14 14:55:58 -07:00
Vinayakumar B
ffbb574623 HADOOP-10993. Dump java command line to *.out file (Contributed by Kengo Seki) 2015-05-14 15:24:35 +05:30
Vinayakumar B
0daa5ada68 HADOOP-8174. Remove confusing comment in Path#isAbsolute() (Contributed by Suresh Srinivas) 2015-05-14 14:17:36 +05:30
Tsuyoshi Ozawa
4356e8a5ef HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula. 2015-05-14 10:20:45 +09:00
Akira Ajisaka
2463666ecb HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 2015-05-13 11:37:22 +09:00
Haohui Mai
2f4b6d1157 HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out even in debug level. Contributed by Junping Du. 2015-05-12 10:30:32 -07:00
Junping Du
7e543c27fa YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 2015-05-11 05:27:07 -07:00
Jason Lowe
ec2748dedb HADOOP-9729. The example code of org.apache.hadoop.util.Tool is incorrect. Contributed by hellojinjie 2015-05-08 21:28:38 +00:00
Jason Lowe
c4bd2cdded HADOOP-7165. listLocatedStatus(path, filter) is not redefined in FilterFs. Contributed by Hairong Kuang 2015-05-08 20:36:07 +00:00
Colin Patrick Mccabe
8f7c2364d7 HDFS-8284. Update documentation about how to use HTrace with HDFS (Masatake Iwasaki via Colin P. McCabe) 2015-05-08 12:30:03 -07:00
Arpit Agarwal
a0fae8dcae HADOOP-10356. Corrections in winutils/chmod.c (Contributed by René Nyffenegger) 2015-05-08 11:42:50 -07:00
cnauroth
26f61d41df HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R. 2015-05-08 11:20:55 -07:00
Robert (Bobby) Evans
cc17c83585 HADOOP-6842. "hadoop fs -text" does not give a useful text representation of MapWritable objects 2015-05-08 11:57:14 -05:00
Vinayakumar B
1ffb7fa42e HADOOP-11877. SnappyDecompressor's Logger class name is wrong ( Contributed by surendra singh lilhore) 2015-05-08 16:52:14 +05:30
Colin Patrick Mccabe
90b3845648 HADOOP-11912. Extra configuration key used in TraceUtils should respect prefix (Masatake Iwasaki via Colin P. McCabe) 2015-05-05 17:40:31 -07:00
Andrew Wang
05adc76ace HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland. 2015-05-05 08:37:37 -07:00
Wangda Tan
71f4de220c YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda) 2015-05-04 15:49:19 -07:00
Tsuyoshi Ozawa
bb9ddef0e7 HADOOP-11328. ZKFailoverController does not log Exception when doRun raises errors. Contributed by Tianyin Xu. 2015-05-04 17:47:37 +09:00
Tsuyoshi Ozawa
76fa606e2d HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen. 2015-05-04 17:05:00 +09:00
Gera Shegalov
f343f8657e HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) 2015-05-01 18:18:55 -07:00
Wangda Tan
7d46a806e7 YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda) 2015-05-01 16:40:55 -07:00
Colin Patrick Mccabe
b82567d455 HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 2015-05-01 11:19:40 -07:00
Arun Suresh
f0db797be2 HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) 2015-04-30 13:59:43 -07:00
Akira Ajisaka
e89fc53a1d HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 2015-04-30 19:11:22 +09:00
Jing Zhao
7947e5b53b HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 2015-04-29 10:41:46 -07:00
Arpit Agarwal
0d5b0143cc HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:23:34 -07:00
Jakob Homan
1a2459bd4b HADOOP-11857. Fix CommandFormat#commandFormat java doc annotation. Contributed by J.Andreina. 2015-04-26 18:35:01 -07:00
Colin Patrick Mccabe
a0e0a63209 HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 2015-04-23 19:00:24 -07:00
Haohui Mai
bcf89ddc7d HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:33:45 -07:00
Akira Ajisaka
ac281e3fc8 HADOOP-11627. Remove io.native.lib.available. Contributed by Brahma Reddy Battula. 2015-04-24 08:08:55 +09:00
Andrew Wang
26971e52ae HADOOP-11852. Disable symlinks in trunk. 2015-04-23 11:47:01 -07:00
Arpit Agarwal
49f6e3d35e HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 2015-04-23 09:35:04 -07:00
Jakob Homan
e54a3e1f4f HADOOP-11850: Typos in hadoop-common java docs. Contributed by Surendra Singh Lilhore. 2015-04-22 13:48:16 -07:00
Colin Patrick Mccabe
a3b1d8c902 HADOOP-11848. Incorrect arguments to sizeof in DomainSocket.c (Malcolm Kavalsky via Colin P. McCabe) 2015-04-22 12:36:37 -07:00
Gera Shegalov
6d2cf9fbbd HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 2015-04-21 13:57:23 -07:00
Arun Suresh
424a00daa0 HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) 2015-04-21 11:31:51 -07:00
Arpit Agarwal
dfc1c4c303 HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:05 -07:00
Arpit Agarwal
c92f6f3605 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:42 -07:00
Allen Wittenauer
d4e8c09593 HADOOP-9642. Configuration to resolve environment variables via ${env.VARIABLE} references (Kengo Seki via aw) 2015-04-14 08:20:13 +02:00
Arpit Agarwal
18a3dad44a HDFS-7701. Support reporting per storage type quota and usage with hadoop/hdfs shell. (Contributed by Peter Shi) 2015-04-13 21:01:15 -07:00
Haohui Mai
63c659ddd0 HADOOP-11815. HttpServer2 should destroy SignerSecretProvider when it stops. Contributed by Rohith. 2015-04-09 10:58:12 -07:00
Wangda Tan
bad070fe15 YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda) 2015-04-02 17:23:20 -07:00
cnauroth
5763b173d3 HADOOP-9805. Refactor RawLocalFileSystem#rename for improved testability. Contributed by Jean-Pierre Matsumoto. 2015-04-02 16:13:00 -07:00
Colin Patrick Mccabe
c94d594a57 HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe) 2015-04-01 14:10:10 -07:00
cnauroth
a3a96a07fa HADOOP-11787. OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac. Contributed by Kiran Kumar M R. 2015-04-01 11:40:09 -07:00
Colin Patrick Mccabe
d9ac5ee2c4 HADOOP-11660. Add support for hardware crc of HDFS checksums on ARM aarch64 architecture (Edward Nevill via Colin P. McCabe) 2015-03-30 13:55:02 -07:00
Haohui Mai
90e07d55ac HADOOP-11754. RM fails to start in non-secure mode due to authentication filter failure. Contributed by Haohui Mai. 2015-03-30 11:44:22 -07:00
cnauroth
3836ad6c0b HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu. 2015-03-27 15:03:41 -07:00
cnauroth
af618f23a7 HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R. 2015-03-26 21:56:31 -07:00
Allen Wittenauer
b30ca8ce0e HADOOP-11553. Foramlize the shell API (aw) 2015-03-26 15:09:51 -07:00
Arpit Agarwal
3d0708bdb0 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:24:11 -07:00
Harsh J
b4b4fe9056 HADOOP-11719.[Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text. Contributed by Brahma Reddy Battula. 2015-03-26 11:29:54 +05:30
cnauroth
4528eb9fb2 HADOOP-11524. hadoop_do_classpath_subcommand throws a shellcheck warning. Contributed by Chris Nauroth. 2015-03-25 22:36:09 -07:00
Haohui Mai
e4b8d9e72d HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 11:12:42 -07:00
Tsuyoshi Ozawa
b351086ff6 HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa) 2015-03-25 16:59:40 +09:00
Tsuyoshi Ozawa
5582b0f1d4 HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). Contributed by Walter Su. 2015-03-25 16:36:10 +09:00
Tsuyoshi Ozawa
6e891a921e HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena. 2015-03-24 20:57:39 +09:00
Karthik Kambatla
fe5c23b670 HADOOP-11447. Add a more meaningful toString method to SampleStat and MutableStat. (kasha) 2015-03-20 17:03:03 -07:00
Tsuyoshi Ozawa
43dde502b3 HADOOP-11709. Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variable. Contributed by Ajith S. 2015-03-21 00:54:20 +09:00
Haohui Mai
19b298f612 HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:31:59 -07:00
Akira Ajisaka
34117325b2 HADOOP-11659. o.a.h.FileSystem.Cache#remove should use a single hash map lookup. Contributed by Brahma Reddy Battula. 2015-03-18 15:43:10 +09:00
Aaron T. Myers
fc90bf7b27 HADOOP-11722. Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted. Contributed by Arun Suresh. 2015-03-17 19:41:36 -07:00
cnauroth
72cd4e4a4e HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R. 2015-03-16 14:04:40 -07:00
Colin Patrick Mccabe
bf3275dbaa HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe) 2015-03-16 12:02:10 -07:00
Andrew Wang
387f271c81 HADOOP-11711. Provide a default value for AES/CTR/NoPadding CryptoCodec classes. 2015-03-12 21:40:58 -07:00
yliu
a85291003c HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu) 2015-03-13 02:25:02 +08:00
Yongjun Zhang
8212877415 HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang) 2015-03-12 14:52:36 -07:00
cnauroth
ff83ae7231 HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField. Contributed by Hui Zheng. 2015-03-11 23:27:49 -07:00
Gera Shegalov
64eb068ee8 DelegateToFileSystem erroneously uses default FS's port in constructor. (Brahma Reddy Battula via gera) 2015-03-10 13:52:06 -07:00
cnauroth
8d5b01e005 Revert "HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux (Kiran Kumar M R via Colin P. McCabe)" 
This reverts commit 3241fc2b17.
 2015-03-10 11:02:07 -07:00
Allen Wittenauer
7711049837 HADOOP-11668. hadoop-daemons.sh bw compat broke with --slaves change (Vinayakumar B via aw) 2015-03-09 22:31:50 -07:00