Commit Graph

3306 Commits

Author SHA1 Message Date
Jason Lowe
b3ffa87003 MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li 2015-06-05 22:38:31 +00:00
Andrew Wang
bc11e158b1 HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory. Contributed by Zhihai Xu. 2015-06-05 13:52:21 -07:00
Andrew Wang
2dbc40e608 HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey. 2015-06-05 13:11:01 -07:00
Gera Shegalov
9f6d67844d HADOOP-11924. Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) 2015-06-04 11:38:28 -07:00
Arpit Agarwal
8266dae0e9 HADOOP-11994. smart-apply-patch wrongly assumes that git is infallible. (Contributed by Kengo Seki) 2015-06-04 10:54:18 -07:00
Akira Ajisaka
dbed757cba HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii. 2015-06-05 01:45:34 +09:00
Vinayakumar B
1bb79c9d01 HADOOP-12019. update BUILDING.txt to include python for 'mvn site' in windows (Contributed by Vinayakumar B) 2015-06-04 10:42:52 +05:30
Akira Ajisaka
b5f0d294f8 HADOOP-12018. smart-apply-patch.sh fails if the patch edits CR+LF files and is created by 'git diff --no-prefix'. Contributed by Kengo Seki. 2015-06-04 11:14:55 +09:00
Akira Ajisaka
a6a8ee3c24 HADOOP-11991. test-patch.sh isn't re-executed even if smart-apply-patch.sh is modified. Contributed by Kengo Seki. 2015-06-03 15:01:02 +09:00
Kai Zheng
0799e1e4b6 HADOOP-12011 Allow to dump verbose information to ease debugging in raw erasure coders. Contributed by Kai Zheng 2015-06-02 22:05:16 +08:00
Andrew Wang
990078b927 HADOOP-12037. Fix wrong classname in example configuration of hadoop-auth documentation. Contributed by Masatake Iwasaki. 2015-06-01 18:04:52 -07:00
Vinayakumar B
63e3fee5f6 HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) 2015-06-01 17:47:02 +05:30
Andrew Wang
374ddd9f9e HADOOP-12043. Display warning if defaultFs is not set when running fs commands. Contributed by Eddy Xu. 2015-05-29 17:15:58 -07:00
Andrew Wang
7673d4f205 HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang) 2015-05-29 14:54:18 -07:00
Vinayakumar B
7366e42563 HADOOP-12042. Users may see TrashPolicy if hdfs dfs -rm is run (Contributed by Andreina J) 2015-05-29 16:51:23 +05:30
cnauroth
860b8373c3 HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay. 2015-05-28 15:01:42 -07:00
Allen Wittenauer
ae14543420 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits (aw) 2015-05-28 13:24:01 -07:00
cnauroth
94e7d49a6d HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic. 2015-05-28 12:31:06 -07:00
Allen Wittenauer
7ebe80ec12 HADOOP-11930. test-patch in offline mode should tell maven to be in offline mode (Sean Busbey via aw) 2015-05-28 12:11:48 -07:00
Colin Patrick Mccabe
a1140959da HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-05-28 12:00:55 -07:00
Colin Patrick Mccabe
246cefa089 HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread. (zhouyingchao via cmccabe) 2015-05-28 11:52:28 -07:00
Allen Wittenauer
08ae87f6ba HADOOP-11983. HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is supposed to do (Sangjin Lee via aw) 2015-05-28 11:29:58 -07:00
Allen Wittenauer
5df1fadf87 HADOOP-7947. Validate XMLs if a relevant tool is available, when using scripts (Kengo Seki via aw) 2015-05-28 11:01:00 -07:00
Allen Wittenauer
cbba7d68f0 HADOOP-11142. Remove hdfs dfs reference from file system shell documentation (Kengo Seki via aw) 2015-05-28 10:57:04 -07:00
Allen Wittenauer
5504a261f8 HADOOP-11406. xargs -P is not portable (Kengo Seki via aw) 2015-05-28 10:36:40 -07:00
Allen Wittenauer
b01d33cf86 HADOOP-12030. test-patch should only report on newly introduced findbugs warnings. (Sean Busbey via aw) 2015-05-28 09:53:50 -07:00
Allen Wittenauer
f1cea9c6bf HADOOP-12035. shellcheck plugin displays a wrong version potentially (Kengo Seki via aw) 2015-05-28 09:11:08 -07:00
Allen Wittenauer
87c26f8b7d HADOOP-12004. test-patch breaks with reexec in certain situations (Sean Busbey via aw) 2015-05-28 08:15:17 -07:00
Allen Wittenauer
bf500d9798 HDFS-5033. Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source (Darrell Taylor via aw) 2015-05-27 16:51:34 -07:00
Allen Wittenauer
4d8fb8c19c HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException (Darrell Taylor via aw) 2015-05-27 16:36:55 -07:00
Akira Ajisaka
bb1816328a HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki. 2015-05-27 18:04:40 +09:00
Colin Patrick Mccabe
7dba7005b7 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) 2015-05-26 12:15:46 -07:00
Kai Zheng
4ad484883f HADOOP-11847 Enhance raw coder allowing to read least required inputs in decoding. Contributed by Kai Zheng 2015-05-26 12:07:16 -07:00
Vinayakumar B
5a391e1d25 HADOOP-12029. Remove chunkSize from ECSchema as its not required for coders (Contributed by Vinayakumar B) 2015-05-26 12:07:16 -07:00
Kai Zheng
b30e96bfb4 HDFS-8382 Remove chunkSize and initialize from erasure coder. Contributed by Kai Zheng 2015-05-26 12:07:15 -07:00
Kai Zheng
4ae32abdf4 HADOOP-12013 Generate fixed data to perform erasure coder test. Contributed by Kai Zheng 2015-05-26 12:07:14 -07:00
Zhe Zhang
343c0e76fc HADOOP-11938. Enhance ByteBuffer version encode/decode API of raw erasure coder. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
b64f6745a4 HADOOP-11566. Add tests and fix for erasure coders to recover erased parity units. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
09c3a375ba HADOOP-11920. Refactor some codes for erasure coders. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
9c7a78c874 HADOOP-11921. Enhance tests for erasure coders. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Jing Zhao
3f2c6938f1 HDFS-8223. Should calculate checksum for parity blocks in DFSStripedOutputStream. Contributed by Yi Liu. 2015-05-26 11:59:54 -07:00
Zhe Zhang
e8df2581c3 HDFS-8156. Add/implement necessary APIs even we just have the system default schema. Contributed by Kai Zheng. 2015-05-26 11:59:53 -07:00
Uma Maheswara Rao G
014d8675c5 HDFS-8024. Erasure Coding: ECworker frame, basics, bootstraping and configuration. (Contributed by Uma Maheswara Rao G) 2015-05-26 11:59:52 -07:00
Tsz-Wo Nicholas Sze
909632dd90 HADOOP-11841. Remove unused ecschema-def.xml files. 2015-05-26 11:59:12 -07:00
Vinayakumar B
ceb3d1c170 HDFS-7349. Support DFS command for the EC encoding (Contributed by Vinayakumar B) 2015-05-26 11:59:11 -07:00
Vinayakumar B
f53e402635 HDFS-8090. Erasure Coding: Add RPC to client-namenode to list all ECSchemas loaded in Namenode. (Contributed by Vinayakumar B) 2015-05-26 11:58:40 -07:00
Kai Zheng
971bd5e885 HADOOP-11818 Minor improvements for erasurecode classes. Contributed by Rakesh R 2015-05-26 11:55:17 -07:00
Kai Zheng
1a37b0fe9a HDFS-8074 Define a system-wide default EC schema. Contributed by Kai Zheng 2015-05-26 11:55:16 -07:00
Vinayakumar B
99502cbbe2 HADOOP-11645. Erasure Codec API covering the essential aspects for an erasure code ( Contributed by Kai Zheng) 2015-05-26 11:55:15 -07:00
Vinayakumar B
aac73c21c3 HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang.
Updated CHANGES-HDFS-EC-7285.txt
2015-05-26 11:55:15 -07:00
Kai Zheng
d43102d2c5 Updated CHANGES-HDFS-EC-7285.txt 2015-05-26 11:55:14 -07:00
Kai Zheng
17f7cdc047 HADOOP-11805 Better to rename some raw erasure coders. Contributed by Kai Zheng 2015-05-26 11:55:14 -07:00
Zhe Zhang
e54a74b566 HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang. 2015-05-26 11:55:13 -07:00
Kai Zheng
98ea3ec0da HADOOP-11782 Correct two thrown messages in ECSchema class. Contributed by Xinwei Qin 2015-05-26 11:44:47 -07:00
Zhe Zhang
d9af36b9bd HADOOP-11664. Loading predefined EC schemas from configuration. Contributed by Kai Zheng. 2015-05-26 11:43:43 -07:00
Kai Zheng
df297245a7 HADOOP-11647. Reed-Solomon ErasureCoder. Contributed by Kai Zheng 2015-05-26 11:43:41 -07:00
Kai Zheng
90d332d6be HADOOP-11707. Add factory to create raw erasure coder. Contributed by Kai Zheng 2015-05-26 11:43:41 -07:00
Kai Zheng
e3dbfeb138 Updated CHANGES-HDFS-EC-7285.txt accordingly 2015-05-26 11:42:05 -07:00
Kai Zheng
c3bc083405 HADOOP-11706 Refine a little bit erasure coder API 2015-05-26 11:42:04 -07:00
Kai Zheng
68caf8728e Fixed a compiling issue introduced by HADOOP-11705. 2015-05-26 11:32:26 -07:00
drankye
292e367d07 HADOOP-11705. Make erasure coder configurable. Contributed by Kai Zheng 2015-05-26 11:32:25 -07:00
Vinayakumar B
8f89d7489d HADOOP-11646. Erasure Coder API for encoding and decoding of block group ( Contributed by Kai Zheng ) 2015-05-26 11:32:25 -07:00
drankye
c0945a8971 HADOOP-11643. Define EC schema API for ErasureCodec. Contributed by Kai Zheng 2015-05-26 11:32:24 -07:00
drankye
dae27f6dd1 HADOOP-11542. Raw Reed-Solomon coder in pure Java. Contributed by Kai Zheng 2015-05-26 11:07:15 -07:00
Kai Zheng
b29f3bde4d HADOOP-11541. Raw XOR coder 2015-05-26 11:03:35 -07:00
Vinayakumar B
9f19eb9fcf HADOOP-11534. Minor improvements for raw erasure coders ( Contributed by Kai Zheng ) 2015-05-26 11:03:35 -07:00
Uma Maheswara Rao G
e50bcea83d HADOOP-11514. Raw Erasure Coder API for concrete encoding and decoding (Kai Zheng via umamahesh) 2015-05-26 11:03:35 -07:00
Akira Ajisaka
56996a685e HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru. 2015-05-26 16:16:21 +09:00
Colin Patrick Mccabe
f34638399a HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe) 2015-05-22 12:51:03 -07:00
Vinayakumar B
55ed6558ba HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin) 2015-05-22 16:45:19 +05:30
Akira Ajisaka
ab7958f227 HADOOP-11594. Improve the readability of site index of documentation. Contributed by Masatake Iwasaki. 2015-05-22 16:51:05 +09:00
Akira Ajisaka
b2a40942c1 HADOOP-11955. Fix a typo in the cluster setup doc. Contributed by Yanjun Wang. 2015-05-22 16:09:01 +09:00
Akira Ajisaka
c7fea088f7 HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki. 2015-05-22 14:15:08 +09:00
Jakob Homan
4fc942a84f HADOOP-12016. Typo in FileSystem::listStatusIterator. Contributed by Arthur Vigil. 2015-05-21 14:50:03 -07:00
Akira Ajisaka
0e4f1081c7 HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru. 2015-05-21 17:52:03 +09:00
Haohui Mai
fb6b38d67d HADOOP-11772. RPC Invoker relies on static ClientCache which has synchronized(this) blocks. Contributed by Haohui Mai. 2015-05-20 20:10:50 -07:00
Akira Ajisaka
4aa730ce85 HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. 2015-05-20 19:25:45 +09:00
Haohui Mai
ce53c8eb0c HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. 2015-05-19 18:28:20 -07:00
Allen Wittenauer
12d6c5ce4f HADOOP-12000. cannot use --java-home in test-patch (aw) 2015-05-19 15:24:23 -07:00
cnauroth
e422e76fca HADOOP-11963. Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. Contributed by Anu Engineer. 2015-05-19 11:50:27 -07:00
Arun Suresh
fd3cb533d2 HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) 2015-05-19 11:35:57 -07:00
Colin Patrick Mccabe
470c87dbc6 HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 2015-05-19 10:50:15 -07:00
Akira Ajisaka
eb4c9ddeb5 Move HADOOP-11581 in CHANGES.txt from 3.0.0 to 2.8.0. 2015-05-19 18:38:35 +09:00
Vinayakumar B
d4a2830b63 HADOOP-11103. Clean up RemoteException (Contributed by Sean Busbey) 2015-05-19 14:41:05 +05:30
Akira Ajisaka
f889a49271 Move HADOOP-8934 in CHANGES.txt from 3.0.0 to 2.8.0. 2015-05-19 18:02:10 +09:00
Akira Ajisaka
3b50dcdce4 HADOOP-10971. Add -C flag to make hadoop fs -ls print filenames only. Contributed by Kengo Seki. 2015-05-19 17:25:27 +09:00
Jing Zhao
0790275f05 HADOOP-1540. Support file exclusion list in distcp. Contributed by Rich Haase. 2015-05-18 13:24:35 -07:00
Arpit Agarwal
a2190bf15d HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:36:29 -07:00
Allen Wittenauer
060c84ea86 HADOOP-11949. Add user-provided plugins to test-patch (Sean Busbey via aw) 2015-05-18 17:06:31 +00:00
Allen Wittenauer
bcc17866dd HADOOP-11944. add option to test-patch to avoid relocating patch process directory (Sean Busbey via aw) 2015-05-18 16:13:50 +00:00
Allen Wittenauer
182d86dac0 HADOOP-11884. test-patch.sh should pull the real findbugs version (Kengo Seki via aw) 2015-05-18 16:08:49 +00:00
Akira Ajisaka
a46506d99c HADOOP-10582. Fix the test case for copying to non-existent dir in TestFsShellCopy. Contributed by Kousuke Saruta. 2015-05-18 16:31:41 +09:00
Akira Ajisaka
f5c48238d5 HADOOP-11939. Deprecate DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. 2015-05-18 16:13:16 +09:00
Akira Ajisaka
cab0dadbd8 HADOOP-11988. Fix typo in the document for hadoop fs -find. Contributed by Kengo Seki. 2015-05-17 13:35:51 +09:00
cnauroth
cb8e69a80c HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth. 2015-05-14 22:22:24 -07:00
cnauroth
09fe16f166 HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R. 2015-05-14 14:55:58 -07:00
Vinayakumar B
ffbb574623 HADOOP-10993. Dump java command line to *.out file (Contributed by Kengo Seki) 2015-05-14 15:24:35 +05:30
Vinayakumar B
0daa5ada68 HADOOP-8174. Remove confusing comment in Path#isAbsolute() (Contributed by Suresh Srinivas) 2015-05-14 14:17:36 +05:30
Tsuyoshi Ozawa
4356e8a5ef HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula. 2015-05-14 10:20:45 +09:00
cnauroth
93b770f7e7 HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth. 2015-05-13 12:25:06 -07:00
Akira Ajisaka
92c38e41e1 HADOOP-9723. Improve error message when hadoop archive output path already exists. Contributed by Jean-Baptiste Onofré and Yongjun Zhang. 2015-05-13 17:28:57 +09:00
Zhijie Shen
fcd0702c10 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran. 2015-05-12 21:13:22 -07:00
Akira Ajisaka
2463666ecb HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 2015-05-13 11:37:22 +09:00
Haohui Mai
2f4b6d1157 HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out even in debug level. Contributed by Junping Du. 2015-05-12 10:30:32 -07:00
Allen Wittenauer
a83eaeaa2e HADOOP-11947. test-patch should return early from determine-issue when run in jenkins mode. (Sean Busbey via aw) 2015-05-11 12:07:48 -07:00
Allen Wittenauer
d4f422612a HADOOP-11948. test-patch's issue matching regex should be configurable. (Sean Busbey via aw) 2015-05-11 11:53:54 -07:00
Allen Wittenauer
2d671e5b3d HADOOP-11950. Add cli option to test-patch to set the project-under-test (Sean Busbey via aw) 2015-05-11 11:50:01 -07:00
Allen Wittenauer
baeb479aef HADOOP-11951. test-patch should give better info about failures to handle dev-support updates without resetrepo option (Sean Busbey via aw) 2015-05-11 11:45:47 -07:00
Allen Wittenauer
32cc3139e3 HADOOP-11928. Test-patch check for @author tags incorrectly flags removal of @author tags (Kengo Seki via aw) 2015-05-11 11:35:02 -07:00
Akira Ajisaka
b9cebfc0ba HADOOP-11663. Remove description about Java 6 from docs. Contributed by Masatake Iwasaki. 2015-05-12 00:30:59 +09:00
Junping Du
7e543c27fa YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 2015-05-11 05:27:07 -07:00
Allen Wittenauer
ed0f4db0dd HADOOP-11775. Fix Javadoc typos in hadoop-openstack module (Yanjun Wang via aw) 2015-05-08 17:01:08 -07:00
Robert Kanter
315074bb08 HADOOP-9737. JarFinder#getJar should delete the jar file upon destruction of the JVM (jbonofre via rkanter) 2015-05-08 16:05:04 -07:00
Allen Wittenauer
c945c20483 HADOOP-11590. Update sbin commands and documentation to use new --slaves option (aw) 2015-05-08 15:27:25 -07:00
Allen Wittenauer
effcc5cbb7 HADOOP-11906. test-patch.sh should use file command for patch determinism (Sean Busbey via aw) 2015-05-08 15:13:38 -07:00
Xiaoyu Yao
e8f66c449c HADOOP-11942. Add links to SLGUserGuide to site index (Masatake Iwasaki via xyao) 2015-05-08 14:34:34 -07:00
Jason Lowe
ec2748dedb HADOOP-9729. The example code of org.apache.hadoop.util.Tool is incorrect. Contributed by hellojinjie 2015-05-08 21:28:38 +00:00
Jason Lowe
c4bd2cdded HADOOP-7165. listLocatedStatus(path, filter) is not redefined in FilterFs. Contributed by Hairong Kuang 2015-05-08 20:36:07 +00:00
Colin Patrick Mccabe
8f7c2364d7 HDFS-8284. Update documentation about how to use HTrace with HDFS (Masatake Iwasaki via Colin P. McCabe) 2015-05-08 12:30:03 -07:00
Arpit Agarwal
a0fae8dcae HADOOP-10356. Corrections in winutils/chmod.c (Contributed by René Nyffenegger) 2015-05-08 11:42:50 -07:00
cnauroth
26f61d41df HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R. 2015-05-08 11:20:55 -07:00
Robert (Bobby) Evans
cc17c83585 HADOOP-6842. "hadoop fs -text" does not give a useful text representation of MapWritable objects 2015-05-08 11:57:14 -05:00
Vinayakumar B
1ffb7fa42e HADOOP-11877. SnappyDecompressor's Logger class name is wrong ( Contributed by surendra singh lilhore) 2015-05-08 16:52:14 +05:30
Vinayakumar B
f33efbc827 HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak) 2015-05-08 10:22:11 +05:30
Allen Wittenauer
ab5058de8e HADOOP-11936. Dockerfile references a removed image (aw) 2015-05-07 11:46:32 -07:00
Akira Ajisaka
305e4733d6 HADOOP-10387. Misspelling of threshold in log4j.properties for tests in hadoop-common-project. Contributed by Brahma Reddy Battula. 2015-05-07 16:53:57 +09:00
Allen Wittenauer
f325522c14 HADOOP-11813. releasedocmaker.py should use today's date instead of unreleased (Darrell Taylor via aw) 2015-05-06 10:34:09 -07:00
Xiaoyu Yao
7a26d174af HDFS-8310. Fix TestCLI.testAll 'help: help for find' on Windows. (Kiran Kumar M R via Xiaoyu Yao) 2015-05-06 10:24:46 -07:00
Colin Patrick Mccabe
90b3845648 HADOOP-11912. Extra configuration key used in TraceUtils should respect prefix (Masatake Iwasaki via Colin P. McCabe) 2015-05-05 17:40:31 -07:00
Allen Wittenauer
4402e4c633 HADOOP-11926. test-patch.sh mv does wrong math (aw) 2015-05-05 17:01:42 -07:00
Robert Kanter
9809a16d3c MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter) 2015-05-05 14:43:28 -07:00
Allen Wittenauer
d33419ae01 HADOOP-11917. test-patch.sh should work with ${BASEDIR}/patchprocess setups (aw) 2015-05-05 11:26:31 -07:00
Allen Wittenauer
3ff91e9e93 HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven builds (aw) 2015-05-05 11:02:15 -07:00
Allen Wittenauer
9b01f81eb8 HADOOP-11911. test-patch should allow configuration of default branch (Sean Busbey via aw) 2015-05-05 09:59:31 -07:00
Andrew Wang
05adc76ace HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland. 2015-05-05 08:37:37 -07:00
Tsuyoshi Ozawa
338e88a19e HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug. Contributed by Ming Ma. 2015-05-05 12:39:24 +09:00
Wangda Tan
71f4de220c YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda) 2015-05-04 15:49:19 -07:00
Tsuyoshi Ozawa
bb9ddef0e7 HADOOP-11328. ZKFailoverController does not log Exception when doRun raises errors. Contributed by Tianyin Xu. 2015-05-04 17:47:37 +09:00
Tsuyoshi Ozawa
76fa606e2d HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen. 2015-05-04 17:05:00 +09:00
Gera Shegalov
3ddb260e30 HADOOP-11900. Add failIfNoTests=false to hadoop-build-tools pom. (gera) 2015-05-01 18:18:55 -07:00
Gera Shegalov
f343f8657e HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) 2015-05-01 18:18:55 -07:00
Wangda Tan
7d46a806e7 YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda) 2015-05-01 16:40:55 -07:00
Colin Patrick Mccabe
b82567d455 HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 2015-05-01 11:19:40 -07:00
Jonathan Eagles
2d7363b273 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 2015-05-01 13:11:50 -05:00
Allen Wittenauer
5f8112ffd2 HADOOP-11866. increase readability and reliability of checkstyle, shellcheck, and whitespace reports (aw) 2015-04-30 15:15:32 -07:00
Arun Suresh
f0db797be2 HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) 2015-04-30 13:59:43 -07:00
Akira Ajisaka
f384a063a6 HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula. 2015-04-30 19:34:41 +09:00
Akira Ajisaka
e89fc53a1d HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 2015-04-30 19:11:22 +09:00
Jing Zhao
7947e5b53b HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 2015-04-29 10:41:46 -07:00
Allen Wittenauer
eccf709a61 HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via aw) 2015-04-28 10:32:32 -07:00
Robert Kanter
9fec02c069 HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter) 2015-04-27 13:25:11 -07:00
Arpit Agarwal
0d5b0143cc HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:23:34 -07:00
Jakob Homan
1a2459bd4b HADOOP-11857. Fix CommandFormat#commandFormat java doc annotation. Contributed by J.Andreina. 2015-04-26 18:35:01 -07:00
Allen Wittenauer
8847777ae4 HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) 2015-04-26 15:51:08 -07:00
Allen Wittenauer
8b69c825e5 HADOOP-11865. Incorrect path mentioned in document for accessing script files (J.Andreina via aw) 2015-04-26 09:55:46 -07:00
Ravi Prakash
a287d2fb77 HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak) 2015-04-24 13:39:07 -07:00
cnauroth
80935268f5 HADOOP-11843. Make setting up the build environment easier. Contributed by Niels Basjes. 2015-04-24 13:05:18 -07:00
Colin Patrick Mccabe
a0e0a63209 HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 2015-04-23 19:00:24 -07:00
Haohui Mai
bcf89ddc7d HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:33:45 -07:00
Akira Ajisaka
ac281e3fc8 HADOOP-11627. Remove io.native.lib.available. Contributed by Brahma Reddy Battula. 2015-04-24 08:08:55 +09:00
Steve Loughran
19262d99eb HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel) 2015-04-23 21:41:51 +01:00
Andrew Wang
26971e52ae HADOOP-11852. Disable symlinks in trunk. 2015-04-23 11:47:01 -07:00
Arpit Agarwal
49f6e3d35e HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 2015-04-23 09:35:04 -07:00
Steve Loughran
08d4386162 HADOOP-11864. JWTRedirectAuthenticationHandler breaks java8 javadocs. (Larry McCay via stevel) 2015-04-23 09:06:22 +01:00
cnauroth
18eb5e7934 HADOOP-11861. test-patch.sh rewrite addendum patch. Contributed by Allen Wittenauer. 2015-04-22 22:23:31 -07:00
Jason Lowe
0ebe84d30a HADOOP-11868. Invalid user logins trigger large backtraces in server log. Contributed by Chang Li 2015-04-22 20:56:29 +00:00
Jakob Homan
e54a3e1f4f HADOOP-11850: Typos in hadoop-common java docs. Contributed by Surendra Singh Lilhore. 2015-04-22 13:48:16 -07:00
Colin Patrick Mccabe
a3b1d8c902 HADOOP-11848. Incorrect arguments to sizeof in DomainSocket.c (Malcolm Kavalsky via Colin P. McCabe) 2015-04-22 12:36:37 -07:00
Jitendra Pandey
1f4767c7f2 HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. Contributed by Eugene Koifman. 2015-04-22 10:00:14 -07:00
Ravi Prakash
cfba355052 HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak) 2015-04-21 16:49:37 -07:00
Steve Loughran
2c14690368 HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. (Larry McCay via stevel) 2015-04-21 22:38:41 +01:00
Gera Shegalov
6d2cf9fbbd HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 2015-04-21 13:57:23 -07:00
Allen Wittenauer
73ddb6b4f8 HADOOP-11746. rewrite test-patch.sh (aw) 2015-04-21 21:29:45 +01:00
Arun Suresh
424a00daa0 HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) 2015-04-21 11:31:51 -07:00
Arpit Agarwal
dfc1c4c303 HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:05 -07:00
Vinod Kumar Vavilapalli
d52de61544 Set the release date for 2.7.0 2015-04-20 20:16:58 -07:00
Arpit Agarwal
c92f6f3605 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:42 -07:00
Haohui Mai
c6b5203cfd HADOOP-11837. AuthenticationFilter should destroy SignerSecretProvider in Tomcat deployments. Contributed by Bowen Zhang. 2015-04-17 10:59:47 -07:00
Vinayakumar B
b5a0b24643 HADOOP-11819. HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist. (Contributed by Rohith) 2015-04-14 11:58:12 +05:30
Allen Wittenauer
d4e8c09593 HADOOP-9642. Configuration to resolve environment variables via ${env.VARIABLE} references (Kengo Seki via aw) 2015-04-14 08:20:13 +02:00
Arpit Agarwal
b9b832a0d8 HADOOP-7713. Update CHANGES.txt 2015-04-13 21:20:16 -07:00
Arpit Agarwal
18a3dad44a HDFS-7701. Support reporting per storage type quota and usage with hadoop/hdfs shell. (Contributed by Peter Shi) 2015-04-13 21:01:15 -07:00
Tsuyoshi Ozawa
174d8b3a10 HADOOP-11811. Fix typos in hadoop-project/pom.xml. Contributed by Brahma Reddy Battula. 2015-04-13 06:59:51 -05:00
Akira Ajisaka
83979e61a4 MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina. 2015-04-10 20:21:00 +09:00
Vinod Kumar Vavilapalli
623fd46c1e Adding release 2.7.1 to CHANGES.txt 2015-04-09 13:54:20 -07:00
Haohui Mai
63c659ddd0 HADOOP-11815. HttpServer2 should destroy SignerSecretProvider when it stops. Contributed by Rohith. 2015-04-09 10:58:12 -07:00
Haohui Mai
dc0282d64c HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu. 2015-04-08 17:56:23 -07:00
Allen Wittenauer
f4b3fc5621 HADOOP-11781. fix race conditions and add URL support to smart-apply-patch.sh (Raymie Stata via aw) 2015-04-08 10:05:25 -07:00
Arpit Agarwal
5449adc9e5 HADOOP-11801. Update BUILDING.txt for Ubuntu. (Contributed by Gabor Liptak) 2015-04-07 18:06:05 -07:00
cnauroth
bd77a7c4d9 HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. Contributed by Xiaoyu Yao. 2015-04-07 14:47:21 -07:00
Owen O'Malley
ce63573314 HADOOP-11717. Support JWT tokens for web single sign on to the Hadoop
servers. (Larry McCay via omalley)
2015-04-07 08:09:41 -07:00
Vinod Kumar Vavilapalli
4b3948ea36 HADOOP-11776. Fixed the broken JDiff support in Hadoop 2. Contributed by Li Lu. 2015-04-04 13:52:01 -07:00
Vinod Kumar Vavilapalli
5370e7128b HADOOP-11377. Added Null.java without which jdiff completely flops. Contributed by Tsuyoshi Ozawa. 2015-04-04 13:47:08 -07:00
Colin Patrick Mccabe
932730df7d HADOOP-11785. Reduce the number of listStatus operation in distcp buildListing (Zoran Dimitrijevic via Colin P. McCabe) 2015-04-03 14:08:25 -07:00
Akira Ajisaka
228ae9aaa4 HADOOP-11800. Clean up some test methods in TestCodec.java. Contributed by Brahma Reddy Battula. 2015-04-04 00:32:18 +09:00
Allen Wittenauer
8d3c0f601d HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) 2015-04-02 20:50:36 -07:00
Wangda Tan
bad070fe15 YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda) 2015-04-02 17:23:20 -07:00
cnauroth
5763b173d3 HADOOP-9805. Refactor RawLocalFileSystem#rename for improved testability. Contributed by Jean-Pierre Matsumoto. 2015-04-02 16:13:00 -07:00
Allen Wittenauer
f383fd9b6c HADOOP-11731. Rework the changelog and releasenotes (aw) 2015-04-01 17:52:22 -07:00
Brandon Li
60ce825a71 HADOOP-11757. NFS gateway should shutdown when it can't start UDP or TCP server. Contributed by Brandon Li 2015-04-01 17:04:44 -07:00
Colin Patrick Mccabe
c94d594a57 HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe) 2015-04-01 14:10:10 -07:00
cnauroth
a3a96a07fa HADOOP-11787. OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac. Contributed by Kiran Kumar M R. 2015-04-01 11:40:09 -07:00
Colin Patrick Mccabe
d9ac5ee2c4 HADOOP-11660. Add support for hardware crc of HDFS checksums on ARM aarch64 architecture (Edward Nevill via Colin P. McCabe) 2015-03-30 13:55:02 -07:00
Haohui Mai
90e07d55ac HADOOP-11754. RM fails to start in non-secure mode due to authentication filter failure. Contributed by Haohui Mai. 2015-03-30 11:44:22 -07:00
Haohui Mai
82fa3adfd8 HADOOP-11761. Fix findbugs warnings in org.apache.hadoop.security.authentication. Contributed by Li Lu. 2015-03-30 11:08:54 -07:00
cnauroth
3836ad6c0b HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu. 2015-03-27 15:03:41 -07:00
Tsuyoshi Ozawa
e074952bd6 HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula. 2015-03-27 23:15:51 +09:00
cnauroth
af618f23a7 HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R. 2015-03-26 21:56:31 -07:00
Haohui Mai
47782cbf4a HADOOP-11748. The secrets of auth cookies should not be specified in configuration in clear text. Contributed by Li Lu and Haohui Mai. 2015-03-26 17:35:37 -07:00
Allen Wittenauer
5695c7a541 HADOOP-11553 addendum fix the typo in the changes file 2015-03-26 15:18:03 -07:00
Allen Wittenauer
b30ca8ce0e HADOOP-11553. Foramlize the shell API (aw) 2015-03-26 15:09:51 -07:00
Arpit Agarwal
3d0708bdb0 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:24:11 -07:00
Harsh J
b4b4fe9056 HADOOP-11719.[Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text. Contributed by Brahma Reddy Battula. 2015-03-26 11:29:54 +05:30
cnauroth
4528eb9fb2 HADOOP-11524. hadoop_do_classpath_subcommand throws a shellcheck warning. Contributed by Chris Nauroth. 2015-03-25 22:36:09 -07:00
Yongjun Zhang
44809b8081 HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) 2015-03-25 15:45:45 -07:00
Haohui Mai
3807884263 Addendum for HADOOP-10670. 2015-03-25 12:29:54 -07:00
Haohui Mai
e4b8d9e72d HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 11:12:42 -07:00
Tsuyoshi Ozawa
323945b33a HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. (ozawa) 2015-03-25 18:02:32 +09:00
Tsuyoshi Ozawa
b351086ff6 HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa) 2015-03-25 16:59:40 +09:00
Tsuyoshi Ozawa
5582b0f1d4 HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). Contributed by Walter Su. 2015-03-25 16:36:10 +09:00
Tsuyoshi Ozawa
3ca5bd1632 Fix CHANGES.txt for HADOOP-11602. 2015-03-24 21:06:26 +09:00
Tsuyoshi Ozawa
6e891a921e HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena. 2015-03-24 20:57:39 +09:00
Brandon Li
36af4a913c HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li 2015-03-23 10:06:47 -07:00
Tsuyoshi Ozawa
0b9f12c847 HADOOP-11737. mockito's version in hadoop-nfs’ pom.xml shouldn't be specified. Contributed by Kengo Seki. 2015-03-23 13:56:24 +09:00
Karthik Kambatla
fe5c23b670 HADOOP-11447. Add a more meaningful toString method to SampleStat and MutableStat. (kasha) 2015-03-20 17:03:03 -07:00
Tsuyoshi Ozawa
43dde502b3 HADOOP-11709. Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variable. Contributed by Ajith S. 2015-03-21 00:54:20 +09:00
Tsuyoshi Ozawa
522c897146 HADOOP-11729. Fix link to cgroups doc in site.xml. Contributed by Masatake Iwasaki. 2015-03-19 23:08:18 +09:00
Haohui Mai
19b298f612 HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:31:59 -07:00
Colin Patrick Mccabe
bf6295bed8 HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe) 2015-03-18 19:14:21 -07:00
Akira Ajisaka
34117325b2 HADOOP-11659. o.a.h.FileSystem.Cache#remove should use a single hash map lookup. Contributed by Brahma Reddy Battula. 2015-03-18 15:43:10 +09:00
Aaron T. Myers
fc90bf7b27 HADOOP-11722. Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted. Contributed by Arun Suresh. 2015-03-17 19:41:36 -07:00
Tsuyoshi Ozawa
ef9946cd52 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA. 2015-03-17 16:09:21 +09:00
cnauroth
2681ed9698 HADOOP-8059. Update CHANGES.txt to target 2.7.0. 2015-03-16 14:17:25 -07:00
cnauroth
72cd4e4a4e HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R. 2015-03-16 14:04:40 -07:00
Colin Patrick Mccabe
bf3275dbaa HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe) 2015-03-16 12:02:10 -07:00
Yongjun Zhang
d1eebd9c9c HADOOP-9477. Amendment to CHANGES.txt. 2015-03-16 09:16:57 -07:00
Yongjun Zhang
03b77ede92 HADOOP-11692. Amendment to CHANGES.txt. 2015-03-16 09:08:41 -07:00
Tsuyoshi Ozawa
79426f3334 HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Jean-Pierre Matsumoto. 2015-03-15 14:29:49 +09:00
Tsuyoshi Ozawa
b308a8d181 Revert "HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki."
This reverts commit 7da136ecca.
2015-03-15 14:27:38 +09:00
Tsuyoshi Ozawa
7da136ecca HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki. 2015-03-15 14:17:35 +09:00
Andrew Wang
387f271c81 HADOOP-11711. Provide a default value for AES/CTR/NoPadding CryptoCodec classes. 2015-03-12 21:40:58 -07:00
yliu
a85291003c HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu) 2015-03-13 02:25:02 +08:00
Yongjun Zhang
8212877415 HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang) 2015-03-12 14:52:36 -07:00
cnauroth
ff83ae7231 HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField. Contributed by Hui Zheng. 2015-03-11 23:27:49 -07:00
cnauroth
7a346bcb4f HADOOP-11693. Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. Contributed by Duo Xu. 2015-03-11 14:36:51 -07:00
cnauroth
fb34f45727 HDFS-7491. Add incremental blockreport latency to DN metrics. Contributed by Ming Ma. 2015-03-11 14:11:19 -07:00
Allen Wittenauer
344d7cb6dc HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw) 2015-03-11 13:19:12 -07:00
Gera Shegalov
64eb068ee8 DelegateToFileSystem erroneously uses default FS's port in constructor. (Brahma Reddy Battula via gera) 2015-03-10 13:52:06 -07:00
cnauroth
8d5b01e005 Revert "HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux (Kiran Kumar M R via Colin P. McCabe)"
This reverts commit 3241fc2b17.
2015-03-10 11:02:07 -07:00
Allen Wittenauer
7711049837 HADOOP-11668. hadoop-daemons.sh bw compat broke with --slaves change (Vinayakumar B via aw) 2015-03-09 22:31:50 -07:00