big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,599 Commits 2 Branches 2 Tags 264 MiB
6a50689705
Commit Graph

3224 Commits

Author SHA1 Message Date
Allen Wittenauer
a890a31529 HADOOP-10854. unit tests for the shell scripts (aw) 2015-07-31 14:34:48 -07:00
Allen Wittenauer
666cafca8d HADOOP-12249. pull argument parsing into a function (aw) 2015-07-31 14:32:21 -07:00
Harsh J
2087eaf684 HADOOP-12271. Hadoop Jar Error Should Be More Explanatory. Contributed by Josh Elser. 2015-07-31 10:12:32 +05:30
Jason Lowe
6f0a35724f HADOOP-10945. 4-digit octal umask permissions throws a parse error. Contributed by Chang Li 2015-07-29 15:25:10 +00:00
Akira Ajisaka
2a1d656196 Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)" 
This reverts commit 02c01815ec.
 2015-07-29 16:48:30 +09:00
Jakob Homan
0712a8103f HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. 2015-07-28 21:03:31 -07:00
Colin Patrick Mccabe
69b095730b HADOOP-12175. FsShell must load SpanReceierHost to support tracing (Masatake Iwasaki via Colin P. McCabe) 2015-07-28 12:56:15 -07:00
Arun Suresh
030fcfa99c HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh) 2015-07-27 23:02:03 -07:00
Akira Ajisaka
e21dde501a HADOOP-12245. References to misspelled REMAINING_QUATA in FileSystemShell.md. Contributed by Gabor Liptak. 2015-07-28 11:33:10 +09:00
Allen Wittenauer
098ba450cc HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw) 
(cherry picked from commit 8e657fba2fd33f7550597ea9c4c6e9a87aa1ef1c)
 2015-07-24 18:31:23 -07:00
Colin Patrick Mccabe
e4b0c74434 HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be removed (Alan Burlison via Colin P. McCabe) 2015-07-24 13:03:31 -07:00
Robert Kanter
ee233ec95c HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) 2015-07-24 09:41:53 -07:00
Akira Ajisaka
02c01815ec HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka) 2015-07-24 11:37:23 +09:00
Jakob Homan
ab3197c204 HADOOP-12009: Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via jghoman) 2015-07-23 17:46:13 -07:00
Andrew Wang
6736a1ab70 HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu. 2015-07-23 14:42:35 -07:00
Arpit Agarwal
adfa34ff99 HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula) 2015-07-23 10:13:04 -07:00
Colin Patrick Mccabe
1b3bceb58c HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin Walsh via Colin P. McCabe) 2015-07-22 11:34:10 -07:00
cnauroth
efa97243ec HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 2015-07-22 11:16:49 -07:00
Vinayakumar B
94c6a4aa85 HADOOP-12017. Hadoop archives command should use configurable replication factor when closing (Contributed by Bibin A Chundatt) 2015-07-22 10:25:49 +05:30
cnauroth
a26cc66f38 HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R. 2015-07-21 14:12:03 -07:00
cnauroth
cb03768b1b HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. 2015-07-21 13:55:58 -07:00
Allen Wittenauer
68d1f4bfe8 HADOOP-11762. Enable swift distcp to secure HDFS (Chen He via aw) 2015-07-21 11:19:29 -07:00
Vinayakumar B
87f29c6b8a HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B) 2015-07-21 13:12:46 +05:30
Akira Ajisaka
773c670943 HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. (aajisaka) 2015-07-21 11:21:49 +09:00
Steve Loughran
98c2bc87b1 HADOOP-11893. Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public. (Brahma Reddy Battula via stevel) 2015-07-20 13:22:14 +01:00
Steve Loughran
a9431425d1 HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage() in logging/span events. (Varun Saxena via stevel) 2015-07-20 13:13:23 +01:00
Steve Loughran
05fa3368f1 HADOOP-12088. KMSClientProvider uses equalsIgnoreCase("application/json"). (Brahma Reddy Battula via stevel) 2015-07-20 13:03:03 +01:00
Steve Loughran
9141e1aa16 HADOOP-12209 Comparable type should be in FileStatus. (Yong Zhang via stevel) 2015-07-20 12:32:44 +01:00
Steve Loughran
05130e94c5 HADOOP-12235 hadoop-openstack junit & mockito dependencies should be "provided". (Ted Yu via stevel) 2015-07-20 11:22:39 +01:00
Allen Wittenauer
ee36f4f9b8 HADOOP-10979. Auto-entries in hadoop_usage (aw) 2015-07-16 16:58:11 -07:00
Haohui Mai
d96bbe152c HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. Contributed by kanaka kumar avvaru. 2015-07-16 15:21:53 -07:00
Tsuyoshi Ozawa
90bda9c611 HADOOP-12240. Fix tests requiring native library to be skipped in non-native profile. Contributed by Masatake Iwasaki. 2015-07-16 16:04:55 +09:00
Tsuyoshi Ozawa
111e6a3fdf HADOOP-10615. FileInputStream in JenkinsHash#main() is never closed. Contributed by Chen He. 2015-07-16 14:08:31 +09:00
Tsuyoshi Ozawa
cec1d43db0 HADOOP-12153. ByteBufferReadable doesn't declare @InterfaceAudience and @InterfaceStability. Contributed by Brahma Reddy Battula. 2015-07-15 14:19:17 +09:00
cnauroth
0a16ee6017 HADOOP-12232. Upgrade Tomcat dependency to 6.0.44. Contributed by Chris Nauroth. 2015-07-14 15:22:33 -07:00
Tsuyoshi Ozawa
4084eaf943 HADOOP-12191. Bzip2Factory is not thread safe. Contributed by Brahma Reddy Battula. 2015-07-14 19:14:42 +09:00
Chris Douglas
a431ed9075 HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl 2015-07-13 15:36:11 -07:00
Akira Ajisaka
d6675606dc YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang. 2015-07-13 12:57:01 +09:00
Chris Douglas
1a0752d85a HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl 2015-07-09 17:48:43 -07:00
Karthik Kambatla
ac6048372a HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. (Chris Douglas via kasha) 2015-07-09 09:56:40 -07:00
Akira Ajisaka
6b7692c468 HADOOP-12200. TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profile. Contributed by Masatake Iwasaki. 2015-07-09 13:14:53 +09:00
Colin Patrick Mccabe
b8832fcf1e HADOOP-12201. Add tracing to FileSystem#createFileSystem and Globber#glob (cmccabe) 2015-07-08 20:07:21 -07:00
Karthik Kambatla
2e3d83f97b HADOOP-11878. FileContext#fixRelativePart should check for not null for a more informative exception. (Brahma Reddy Battula via kasha) 2015-07-08 11:34:34 -07:00
Andrew Wang
625d7ed9eb HADOOP-12194. Support for incremental generation in the protoc plugin. 2015-07-08 11:09:43 -07:00
Allen Wittenauer
98e59261b7 Revert "HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw)" 
This reverts commit 79ed0f959f.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-07-08 08:06:30 -07:00
Andrew Wang
3dc92e84c2 HADOOP-12195. Add annotation to package-info.java file to workaround MCOMPILER-205. 2015-07-07 11:14:12 -07:00
Andrew Wang
aa96a8c0c5 HADOOP-12193. Rename Touchz.java to Touch.java. 2015-07-07 11:12:56 -07:00
Chris Douglas
559425dcb9 HADOOP-5732. Add SFTPFileSystem. Contributed by Ramtin Boustani and Inigo Goiri 2015-07-07 10:08:59 -07:00
Vinayakumar B
e0febce0e7 HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu) 
Moved CHANGES.txt entry to 2.7.2
 2015-07-07 18:13:35 +05:30
Varun Vasudev
c40bdb56a7 YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan. 2015-07-07 16:59:29 +05:30
Vinayakumar B
99c8c5839b HADOOP-12117. Potential NPE from Configuration#loadProperty with allowNullValueProperties set. (Contributed by zhihai xu) 2015-07-07 16:11:27 +05:30
Colin Patrick Mccabe
81f3644376 HADOOP-11974. Fix FIONREAD #include on Solaris (Alan Burlison via Colin P. McCabe) 2015-07-06 17:17:59 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
bf89ddb9b8 Release process for 2.7.1: Set the release date for 2.7.1. 2015-07-06 16:39:59 -07:00
Chris Douglas
47a69ec7a5 HADOOP-12185. NetworkTopology is not efficient adding/getting/removing nodes. Contributed by Inigo Goiri 2015-07-06 15:03:22 -07:00
cnauroth
ed1e3ce482 HADOOP-12045. Enable LocalFileSystem#setTimes to change atime. Contributed by Kazuho Fujii. 2015-07-06 13:40:15 -07:00
Vinayakumar B
233cab89ad HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu) 2015-07-06 15:39:43 +05:30
Chris Douglas
e59f6fad6a HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri 2015-07-02 21:39:48 -07:00
cnauroth
f3796224bf HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence of the parent. Contributed by Chris Nauroth. 2015-07-01 19:47:58 -07:00
Colin Patrick Mccabe
a78d5074fb HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) 2015-07-01 17:57:11 -07:00
Lei Xu
532e38cb7f HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. (Lei Xu) 2015-06-30 17:41:59 -07:00
cnauroth
b8e792cba2 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:54:30 -07:00
Robert Kanter
aaafa0b2ee HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter) 2015-06-30 16:49:27 -07:00
Colin Patrick Mccabe
ad60807238 HADOOP-12124. Add HTrace support for FsShell (cmccabe) 2015-06-30 16:46:25 -07:00
Colin Patrick Mccabe
68e588cbee HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 2015-06-30 16:40:21 -07:00
Andrew Wang
9ee7b6e6c4 HADOOP-12158. Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed. 2015-06-30 15:04:33 -07:00
Gera Shegalov
6f2a41e37d YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera) 2015-06-30 14:59:33 -07:00
Allen Wittenauer
147e020c7a HADOOP-12149. copy all of test-patch BINDIR prior to re-exec (aw) 2015-06-30 11:31:26 -07:00
Steve Loughran
076948d9a4 Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)" 
This reverts commit 3dfa8161f9.
 2015-06-30 11:54:12 +01:00
Vinayakumar B
6d99017f38 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 2015-06-30 15:25:20 +05:30
Ming Ma
8e1bdc17d9 HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma) 2015-06-29 14:37:38 -07:00
cnauroth
460e98f7b3 HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 2015-06-29 13:48:02 -07:00
Colin Patrick Mccabe
fad291ea6d HADOOP-12112. Make hadoop-common-project Native code -Wall-clean (alanburlison via cmccabe) 2015-06-29 12:35:16 -07:00
Colin Patrick Mccabe
5a27c3fd76 HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework (Alan Burlison via Colin P. McCabe) 2015-06-29 12:31:26 -07:00
Vinayakumar B
c815344e2e HADOOP-12119. hadoop fs -expunge does not work for federated namespace (Contributed by J.Andreina) 2015-06-29 15:58:54 +05:30
Vinod Kumar Vavilapalli
aad6a7d5db Adding release 2.7.2 to CHANGES.txt. 2015-06-28 16:29:12 -07:00
Steve Loughran
3dfa8161f9 HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel) 2015-06-28 19:14:00 +01:00
Allen Wittenauer
79ed0f959f HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw) 2015-06-27 08:59:50 -07:00
Colin Patrick Mccabe
aa07dea357 HADOOP-12036. Consolidate all of the cmake extensions in one directory (alanburlison via cmccabe) 2015-06-26 12:32:31 -07:00
Amareshwari Sriramadasu
8ef07f767f HADOOP-11203. Allow ditscp to accept bandwitdh in fraction MegaBytes. Contributed by Raju Bairishetti 2015-06-26 09:52:06 +05:30
Benoy Antony
a815cc157c HADOOP-12049. Control http authentication cookie persistence via configuration. Contributed by Huizhi Lu. 2015-06-24 15:59:39 -07:00
Jonathan Eagles
2236b577a3 HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error occurs (Jason Lowe via jeagles) 2015-06-24 14:51:04 -05:00
Aaron T. Myers
49dfad9429 HDFS-6440. Support more than 2 NameNodes. Contributed by Jesse Yates. 2015-06-23 17:26:11 -07:00
Jason Lowe
077250d8d7 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 2015-06-22 21:59:20 +00:00
Colin Patrick Mccabe
d112d18324 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) 2015-06-19 19:14:05 -07:00
Yongjun Zhang
49f5d20efe HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang. 2015-06-19 14:06:17 -07:00
Colin Patrick Mccabe
6e0a9f92fe HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe) 2015-06-18 11:39:05 -07:00
Vinayakumar B
295d678be8 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 2015-06-18 14:39:00 +05:30
Yongjun Zhang
74351af3b7 HADOOP-11965. determine-flaky-tests needs a summary mode. Contributed by Yufei Gu, 2015-06-17 20:58:17 -07:00
cnauroth
fbf55dcaf4 HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay. 2015-06-16 14:44:03 -07:00
Akira Ajisaka
b578807b99 HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. Contributed by Brahma Reddy Battula. 2015-06-16 13:38:03 -07:00
Tsz-Wo Nicholas Sze
175e6d120f HDFS-8361. Choose SSD over DISK in block placement. 2015-06-15 17:12:01 -07:00
Vinod Kumar Vavilapalli
04c9a077c8 HADOOP-12001. Moving CHANGES.txt up into 2.8. 2015-06-15 14:29:07 -07:00
Vinod Kumar Vavilapalli
722aa1db1f HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and GID attributes during the search. Contributed by Patrick White. 2015-06-15 14:22:34 -07:00
Akira Ajisaka
e4489d97e5 HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to hadoop-common. Contributed by Masatake Iwasaki. 2015-06-12 07:25:15 -07:00
Vinayakumar B
95c73d49b1 HADOOP-12074. in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException (Contributed by Lavkesh Lahngir) 2015-06-11 11:51:14 +05:30
Vinayakumar B
48ca23def1 HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() (Contributed by kanaka kumar avvaru) 2015-06-10 11:05:58 +05:30
Arpit Agarwal
3107434031 HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal) 2015-06-09 20:58:39 -07:00
cnauroth
c45784bc90 HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic. 2015-06-08 22:42:14 -07:00
Xiaoyu Yao
927577c87c HDFS-8552. Fix hdfs CLI usage message for namenode and zkfc. Contributed by Brahma Reddy Battula 2015-06-08 21:57:26 -07:00
Colin Patrick Mccabe
fc2ed4a1f9 HADOOP-11347. RawLocalFileSystem#mkdir and create should honor umask (Varun Saxena via Colin P. McCabe) 2015-06-08 17:49:31 -07:00