big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,410 Commits 2 Branches 2 Tags 264 MiB
454da959c7
Commit Graph

2353 Commits

Author SHA1 Message Date
Lei Xu
532e38cb7f HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. (Lei Xu) 2015-06-30 17:41:59 -07:00
Robert Kanter
aaafa0b2ee HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter) 2015-06-30 16:49:27 -07:00
Colin Patrick Mccabe
ad60807238 HADOOP-12124. Add HTrace support for FsShell (cmccabe) 2015-06-30 16:46:25 -07:00
Colin Patrick Mccabe
68e588cbee HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 2015-06-30 16:40:21 -07:00
Andrew Wang
9ee7b6e6c4 HADOOP-12158. Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed. 2015-06-30 15:04:33 -07:00
Gera Shegalov
6f2a41e37d YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera) 2015-06-30 14:59:33 -07:00
Steve Loughran
076948d9a4 Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)" 
This reverts commit 3dfa8161f9.
 2015-06-30 11:54:12 +01:00
Vinayakumar B
6d99017f38 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 2015-06-30 15:25:20 +05:30
Ming Ma
8e1bdc17d9 HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma) 2015-06-29 14:37:38 -07:00
Colin Patrick Mccabe
fad291ea6d HADOOP-12112. Make hadoop-common-project Native code -Wall-clean (alanburlison via cmccabe) 2015-06-29 12:35:16 -07:00
Vinayakumar B
c815344e2e HADOOP-12119. hadoop fs -expunge does not work for federated namespace (Contributed by J.Andreina) 2015-06-29 15:58:54 +05:30
Steve Loughran
3dfa8161f9 HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel) 2015-06-28 19:14:00 +01:00
Colin Patrick Mccabe
aa07dea357 HADOOP-12036. Consolidate all of the cmake extensions in one directory (alanburlison via cmccabe) 2015-06-26 12:32:31 -07:00
Benoy Antony
a815cc157c HADOOP-12049. Control http authentication cookie persistence via configuration. Contributed by Huizhi Lu. 2015-06-24 15:59:39 -07:00
Jonathan Eagles
2236b577a3 HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error occurs (Jason Lowe via jeagles) 2015-06-24 14:51:04 -05:00
Aaron T. Myers
49dfad9429 HDFS-6440. Support more than 2 NameNodes. Contributed by Jesse Yates. 2015-06-23 17:26:11 -07:00
Jason Lowe
077250d8d7 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 2015-06-22 21:59:20 +00:00
Colin Patrick Mccabe
d112d18324 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) 2015-06-19 19:14:05 -07:00
Yongjun Zhang
49f5d20efe HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang. 2015-06-19 14:06:17 -07:00
Colin Patrick Mccabe
6e0a9f92fe HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe) 2015-06-18 11:39:05 -07:00
Vinayakumar B
295d678be8 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 2015-06-18 14:39:00 +05:30
cnauroth
fbf55dcaf4 HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay. 2015-06-16 14:44:03 -07:00
Akira Ajisaka
b578807b99 HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. Contributed by Brahma Reddy Battula. 2015-06-16 13:38:03 -07:00
Tsz-Wo Nicholas Sze
175e6d120f HDFS-8361. Choose SSD over DISK in block placement. 2015-06-15 17:12:01 -07:00
Vinod Kumar Vavilapalli
722aa1db1f HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and GID attributes during the search. Contributed by Patrick White. 2015-06-15 14:22:34 -07:00
Akira Ajisaka
e4489d97e5 HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to hadoop-common. Contributed by Masatake Iwasaki. 2015-06-12 07:25:15 -07:00
Vinayakumar B
95c73d49b1 HADOOP-12074. in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException (Contributed by Lavkesh Lahngir) 2015-06-11 11:51:14 +05:30
Vinayakumar B
48ca23def1 HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() (Contributed by kanaka kumar avvaru) 2015-06-10 11:05:58 +05:30
Arpit Agarwal
3107434031 HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal) 2015-06-09 20:58:39 -07:00
Xiaoyu Yao
927577c87c HDFS-8552. Fix hdfs CLI usage message for namenode and zkfc. Contributed by Brahma Reddy Battula 2015-06-08 21:57:26 -07:00
Colin Patrick Mccabe
fc2ed4a1f9 HADOOP-11347. RawLocalFileSystem#mkdir and create should honor umask (Varun Saxena via Colin P. McCabe) 2015-06-08 17:49:31 -07:00
Arpit Agarwal
84ba1a75b6 HADOOP-12054. RPC client should not retry for InvalidToken exceptions. (Contributed by Varun Saxena) 2015-06-08 15:45:23 -07:00
cnauroth
0e80d51983 HDFS-8554. TestDatanodeLayoutUpgrade fails on Windows. Contributed by Chris Nauroth. 2015-06-08 08:39:02 -07:00
Steve Loughran
18f6809776 HADOOP-12052 IPC client downgrades all exception types to IOE, breaks callers trying to use them. (Brahma Reddy Battula via stevel) 2015-06-08 13:02:56 +01:00
cnauroth
e46cb80002 HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. 2015-06-06 09:17:03 -07:00
Jason Lowe
b3ffa87003 MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li 2015-06-05 22:38:31 +00:00
Andrew Wang
bc11e158b1 HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory. Contributed by Zhihai Xu. 2015-06-05 13:52:21 -07:00
Andrew Wang
2dbc40e608 HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey. 2015-06-05 13:11:01 -07:00
Gera Shegalov
9f6d67844d HADOOP-11924. Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) 2015-06-04 11:38:28 -07:00
Akira Ajisaka
dbed757cba HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii. 2015-06-05 01:45:34 +09:00
Andrew Wang
374ddd9f9e HADOOP-12043. Display warning if defaultFs is not set when running fs commands. Contributed by Eddy Xu. 2015-05-29 17:15:58 -07:00
Vinayakumar B
7366e42563 HADOOP-12042. Users may see TrashPolicy if hdfs dfs -rm is run (Contributed by Andreina J) 2015-05-29 16:51:23 +05:30
cnauroth
860b8373c3 HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay. 2015-05-28 15:01:42 -07:00
Allen Wittenauer
ae14543420 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits (aw) 2015-05-28 13:24:01 -07:00
Colin Patrick Mccabe
a1140959da HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-05-28 12:00:55 -07:00
Colin Patrick Mccabe
246cefa089 HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread. (zhouyingchao via cmccabe) 2015-05-28 11:52:28 -07:00
Allen Wittenauer
08ae87f6ba HADOOP-11983. HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is supposed to do (Sangjin Lee via aw) 2015-05-28 11:29:58 -07:00
Allen Wittenauer
5df1fadf87 HADOOP-7947. Validate XMLs if a relevant tool is available, when using scripts (Kengo Seki via aw) 2015-05-28 11:01:00 -07:00
Allen Wittenauer
cbba7d68f0 HADOOP-11142. Remove hdfs dfs reference from file system shell documentation (Kengo Seki via aw) 2015-05-28 10:57:04 -07:00
Allen Wittenauer
5504a261f8 HADOOP-11406. xargs -P is not portable (Kengo Seki via aw) 2015-05-28 10:36:40 -07:00
Allen Wittenauer
bf500d9798 HDFS-5033. Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source (Darrell Taylor via aw) 2015-05-27 16:51:34 -07:00
Allen Wittenauer
4d8fb8c19c HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException (Darrell Taylor via aw) 2015-05-27 16:36:55 -07:00
Akira Ajisaka
bb1816328a HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki. 2015-05-27 18:04:40 +09:00
Colin Patrick Mccabe
7dba7005b7 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) 2015-05-26 12:15:46 -07:00
Akira Ajisaka
56996a685e HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru. 2015-05-26 16:16:21 +09:00
Akira Ajisaka
b2a40942c1 HADOOP-11955. Fix a typo in the cluster setup doc. Contributed by Yanjun Wang. 2015-05-22 16:09:01 +09:00
Akira Ajisaka
c7fea088f7 HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki. 2015-05-22 14:15:08 +09:00
Jakob Homan
4fc942a84f HADOOP-12016. Typo in FileSystem::listStatusIterator. Contributed by Arthur Vigil. 2015-05-21 14:50:03 -07:00
Akira Ajisaka
0e4f1081c7 HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru. 2015-05-21 17:52:03 +09:00
Haohui Mai
fb6b38d67d HADOOP-11772. RPC Invoker relies on static ClientCache which has synchronized(this) blocks. Contributed by Haohui Mai. 2015-05-20 20:10:50 -07:00
cnauroth
e422e76fca HADOOP-11963. Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. Contributed by Anu Engineer. 2015-05-19 11:50:27 -07:00
Arun Suresh
fd3cb533d2 HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) 2015-05-19 11:35:57 -07:00
Colin Patrick Mccabe
470c87dbc6 HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 2015-05-19 10:50:15 -07:00
Vinayakumar B
d4a2830b63 HADOOP-11103. Clean up RemoteException (Contributed by Sean Busbey) 2015-05-19 14:41:05 +05:30
Akira Ajisaka
3b50dcdce4 HADOOP-10971. Add -C flag to make hadoop fs -ls print filenames only. Contributed by Kengo Seki. 2015-05-19 17:25:27 +09:00
Arpit Agarwal
a2190bf15d HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:36:29 -07:00
Akira Ajisaka
a46506d99c HADOOP-10582. Fix the test case for copying to non-existent dir in TestFsShellCopy. Contributed by Kousuke Saruta. 2015-05-18 16:31:41 +09:00
Akira Ajisaka
cab0dadbd8 HADOOP-11988. Fix typo in the document for hadoop fs -find. Contributed by Kengo Seki. 2015-05-17 13:35:51 +09:00
cnauroth
09fe16f166 HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R. 2015-05-14 14:55:58 -07:00
Vinayakumar B
ffbb574623 HADOOP-10993. Dump java command line to *.out file (Contributed by Kengo Seki) 2015-05-14 15:24:35 +05:30
Vinayakumar B
0daa5ada68 HADOOP-8174. Remove confusing comment in Path#isAbsolute() (Contributed by Suresh Srinivas) 2015-05-14 14:17:36 +05:30
Tsuyoshi Ozawa
4356e8a5ef HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula. 2015-05-14 10:20:45 +09:00
Zhijie Shen
fcd0702c10 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran. 2015-05-12 21:13:22 -07:00
Akira Ajisaka
2463666ecb HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 2015-05-13 11:37:22 +09:00
Haohui Mai
2f4b6d1157 HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out even in debug level. Contributed by Junping Du. 2015-05-12 10:30:32 -07:00
Junping Du
7e543c27fa YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 2015-05-11 05:27:07 -07:00
Robert Kanter
315074bb08 HADOOP-9737. JarFinder#getJar should delete the jar file upon destruction of the JVM (jbonofre via rkanter) 2015-05-08 16:05:04 -07:00
Allen Wittenauer
c945c20483 HADOOP-11590. Update sbin commands and documentation to use new --slaves option (aw) 2015-05-08 15:27:25 -07:00
Jason Lowe
ec2748dedb HADOOP-9729. The example code of org.apache.hadoop.util.Tool is incorrect. Contributed by hellojinjie 2015-05-08 21:28:38 +00:00
Jason Lowe
c4bd2cdded HADOOP-7165. listLocatedStatus(path, filter) is not redefined in FilterFs. Contributed by Hairong Kuang 2015-05-08 20:36:07 +00:00
Colin Patrick Mccabe
8f7c2364d7 HDFS-8284. Update documentation about how to use HTrace with HDFS (Masatake Iwasaki via Colin P. McCabe) 2015-05-08 12:30:03 -07:00
Arpit Agarwal
a0fae8dcae HADOOP-10356. Corrections in winutils/chmod.c (Contributed by René Nyffenegger) 2015-05-08 11:42:50 -07:00
cnauroth
26f61d41df HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R. 2015-05-08 11:20:55 -07:00
Robert (Bobby) Evans
cc17c83585 HADOOP-6842. "hadoop fs -text" does not give a useful text representation of MapWritable objects 2015-05-08 11:57:14 -05:00
Vinayakumar B
1ffb7fa42e HADOOP-11877. SnappyDecompressor's Logger class name is wrong ( Contributed by surendra singh lilhore) 2015-05-08 16:52:14 +05:30
Akira Ajisaka
305e4733d6 HADOOP-10387. Misspelling of threshold in log4j.properties for tests in hadoop-common-project. Contributed by Brahma Reddy Battula. 2015-05-07 16:53:57 +09:00
Xiaoyu Yao
7a26d174af HDFS-8310. Fix TestCLI.testAll 'help: help for find' on Windows. (Kiran Kumar M R via Xiaoyu Yao) 2015-05-06 10:24:46 -07:00
Colin Patrick Mccabe
90b3845648 HADOOP-11912. Extra configuration key used in TraceUtils should respect prefix (Masatake Iwasaki via Colin P. McCabe) 2015-05-05 17:40:31 -07:00
Robert Kanter
9809a16d3c MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter) 2015-05-05 14:43:28 -07:00
Andrew Wang
05adc76ace HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland. 2015-05-05 08:37:37 -07:00
Tsuyoshi Ozawa
338e88a19e HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug. Contributed by Ming Ma. 2015-05-05 12:39:24 +09:00
Wangda Tan
71f4de220c YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda) 2015-05-04 15:49:19 -07:00
Tsuyoshi Ozawa
bb9ddef0e7 HADOOP-11328. ZKFailoverController does not log Exception when doRun raises errors. Contributed by Tianyin Xu. 2015-05-04 17:47:37 +09:00
Tsuyoshi Ozawa
76fa606e2d HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen. 2015-05-04 17:05:00 +09:00
Gera Shegalov
f343f8657e HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) 2015-05-01 18:18:55 -07:00
Wangda Tan
7d46a806e7 YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda) 2015-05-01 16:40:55 -07:00
Colin Patrick Mccabe
b82567d455 HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 2015-05-01 11:19:40 -07:00
Jonathan Eagles
2d7363b273 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 2015-05-01 13:11:50 -05:00
Arun Suresh
f0db797be2 HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) 2015-04-30 13:59:43 -07:00
Akira Ajisaka
e89fc53a1d HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 2015-04-30 19:11:22 +09:00