big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
12,376 Commits 2 Branches 2 Tags 264 MiB
4c061e607e
Commit Graph

1196 Commits

Author SHA1 Message Date
Akira Ajisaka
3b50dcdce4 HADOOP-10971. Add -C flag to make hadoop fs -ls print filenames only. Contributed by Kengo Seki. 2015-05-19 17:25:27 +09:00
Arpit Agarwal
a2190bf15d HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:36:29 -07:00
Akira Ajisaka
a46506d99c HADOOP-10582. Fix the test case for copying to non-existent dir in TestFsShellCopy. Contributed by Kousuke Saruta. 2015-05-18 16:31:41 +09:00
cnauroth
09fe16f166 HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R. 2015-05-14 14:55:58 -07:00
Robert Kanter
315074bb08 HADOOP-9737. JarFinder#getJar should delete the jar file upon destruction of the JVM (jbonofre via rkanter) 2015-05-08 16:05:04 -07:00
Robert (Bobby) Evans
cc17c83585 HADOOP-6842. "hadoop fs -text" does not give a useful text representation of MapWritable objects 2015-05-08 11:57:14 -05:00
Akira Ajisaka
305e4733d6 HADOOP-10387. Misspelling of threshold in log4j.properties for tests in hadoop-common-project. Contributed by Brahma Reddy Battula. 2015-05-07 16:53:57 +09:00
Xiaoyu Yao
7a26d174af HDFS-8310. Fix TestCLI.testAll 'help: help for find' on Windows. (Kiran Kumar M R via Xiaoyu Yao) 2015-05-06 10:24:46 -07:00
Colin Patrick Mccabe
90b3845648 HADOOP-11912. Extra configuration key used in TraceUtils should respect prefix (Masatake Iwasaki via Colin P. McCabe) 2015-05-05 17:40:31 -07:00
Robert Kanter
9809a16d3c MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter) 2015-05-05 14:43:28 -07:00
Andrew Wang
05adc76ace HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland. 2015-05-05 08:37:37 -07:00
Tsuyoshi Ozawa
338e88a19e HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug. Contributed by Ming Ma. 2015-05-05 12:39:24 +09:00
Gera Shegalov
f343f8657e HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) 2015-05-01 18:18:55 -07:00
Colin Patrick Mccabe
b82567d455 HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 2015-05-01 11:19:40 -07:00
Jonathan Eagles
2d7363b273 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 2015-05-01 13:11:50 -05:00
Arpit Agarwal
0d5b0143cc HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:23:34 -07:00
Akira Ajisaka
ac281e3fc8 HADOOP-11627. Remove io.native.lib.available. Contributed by Brahma Reddy Battula. 2015-04-24 08:08:55 +09:00
Andrew Wang
26971e52ae HADOOP-11852. Disable symlinks in trunk. 2015-04-23 11:47:01 -07:00
Arpit Agarwal
49f6e3d35e HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 2015-04-23 09:35:04 -07:00
Gera Shegalov
6d2cf9fbbd HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 2015-04-21 13:57:23 -07:00
Arun Suresh
424a00daa0 HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) 2015-04-21 11:31:51 -07:00
Vinayakumar B
b5a0b24643 HADOOP-11819. HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist. (Contributed by Rohith) 2015-04-14 11:58:12 +05:30
Allen Wittenauer
d4e8c09593 HADOOP-9642. Configuration to resolve environment variables via ${env.VARIABLE} references (Kengo Seki via aw) 2015-04-14 08:20:13 +02:00
Arpit Agarwal
18a3dad44a HDFS-7701. Support reporting per storage type quota and usage with hadoop/hdfs shell. (Contributed by Peter Shi) 2015-04-13 21:01:15 -07:00
Tsuyoshi Ozawa
174d8b3a10 HADOOP-11811. Fix typos in hadoop-project/pom.xml. Contributed by Brahma Reddy Battula. 2015-04-13 06:59:51 -05:00
cnauroth
bd77a7c4d9 HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. Contributed by Xiaoyu Yao. 2015-04-07 14:47:21 -07:00
Akira Ajisaka
228ae9aaa4 HADOOP-11800. Clean up some test methods in TestCodec.java. Contributed by Brahma Reddy Battula. 2015-04-04 00:32:18 +09:00
cnauroth
5763b173d3 HADOOP-9805. Refactor RawLocalFileSystem#rename for improved testability. Contributed by Jean-Pierre Matsumoto. 2015-04-02 16:13:00 -07:00
Colin Patrick Mccabe
d9ac5ee2c4 HADOOP-11660. Add support for hardware crc of HDFS checksums on ARM aarch64 architecture (Edward Nevill via Colin P. McCabe) 2015-03-30 13:55:02 -07:00
Arpit Agarwal
3d0708bdb0 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:24:11 -07:00
Haohui Mai
e4b8d9e72d HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 11:12:42 -07:00
Andrew Wang
387f271c81 HADOOP-11711. Provide a default value for AES/CTR/NoPadding CryptoCodec classes. 2015-03-12 21:40:58 -07:00
Yongjun Zhang
8212877415 HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang) 2015-03-12 14:52:36 -07:00
cnauroth
ff83ae7231 HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField. Contributed by Hui Zheng. 2015-03-11 23:27:49 -07:00
Gera Shegalov
64eb068ee8 DelegateToFileSystem erroneously uses default FS's port in constructor. (Brahma Reddy Battula via gera) 2015-03-10 13:52:06 -07:00
Chris Douglas
790aa6790e HADOOP-11673. Skip using JUnit Assume in TestCodec. 
Contributed by Brahma Reddy Battula.
 2015-03-08 19:18:59 -07:00
Jian He
21101c01f2 YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu 2015-03-06 14:18:11 -08:00
Tsuyoshi Ozawa
74a4754d1c HADOOP-11648. Set DomainSocketWatcher thread name explicitly. Contributed by Liang Xie. 2015-03-05 16:05:44 +09:00
Karthik Kambatla
8d88691d16 YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha) 2015-03-04 19:49:05 -08:00
Tsuyoshi Ozawa
d1c6accb6f HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa) 2015-03-03 14:17:52 +09:00
Akira Ajisaka
ca1c00bf81 HADOOP-11658. Externalize io.compression.codecs property. Contributed by Kai Zheng. 2015-03-02 01:12:44 -08:00
Tsuyoshi Ozawa
48c7ee7553 HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile. Contributed by Vinayakumar B. 2015-02-27 17:46:07 +09:00
Andrew Wang
71385f9b70 HADOOP-11620. Add support for load balancing across a group of KMS for HA. Contributed by Arun Suresh. 2015-02-25 21:16:37 -08:00
Allen Wittenauer
d4ac6822e1 YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw) 2015-02-24 11:25:26 -08:00
Tsuyoshi Ozawa
9cedad11d8 Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)" 
This reverts commit 946456c6d8.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java
 2015-02-25 00:32:04 +09:00
Gera Shegalov
1dba57271f HADOOP-11619. FTPFileSystem should override getDefaultPort. (Brahma Reddy Battula via gera) 2015-02-23 21:05:59 -08:00
Robert Kanter
6f0133039a HADOOP-11612. Workaround for Curator's ChildReaper requiring Guava 15+. (rkanter) 2015-02-20 19:47:28 -08:00
cnauroth
3c5ff0759c HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. Contributed by Chris Nauroth. 2015-02-20 13:07:16 -08:00
Jason Lowe
f0f2992686 HADOOP-9087. Queue size metric for metric sinks isn't actually maintained. Contributed by Akira AJISAKA 2015-02-19 17:30:07 +00:00
yliu
64a8375635 HADOOP-11595. Add default implementation for AbstractFileSystem#truncate. (yliu) 2015-02-19 08:26:42 +08:00
Tsuyoshi Ozawa
946456c6d8 HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa) 2015-02-19 13:06:53 +09:00
Akira Ajisaka
18fb421fab HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing in ClientBaseWithFixes. Contributed by Kengo Seki. 2015-02-18 17:55:04 -08:00
Akira Ajisaka
1714609919 HADOOP-11545. ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider". Contributed by Brahma Reddy Battula. 2015-02-18 11:17:10 -08:00
Tsuyoshi Ozawa
3f56a4cb0c HADOOP-11599. Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured. Contributed by zhihai xu. 2015-02-18 17:35:11 +09:00
Kihwal Lee
685af8a3d0 HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma. 2015-02-17 17:14:58 -06:00
Vinayakumar B
cf4b7f506d HADOOP-11000. HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING (Contributed by Ming Ma) 2015-02-17 14:55:56 +05:30
Tsuyoshi Ozawa
ef950ea1c0 HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 2015-02-15 00:30:46 +09:00
Tsuyoshi Ozawa
b7d48286a9 Rvert "HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R." 
This reverts commit 965ce9e24e.
 2015-02-15 00:28:59 +09:00
Tsuyoshi Ozawa
965ce9e24e HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R. 2015-02-15 00:13:10 +09:00
Akira Ajisaka
9395c76697 HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use getTrimmed(). Contributed by Tsuyoshi Ozawa. 2015-02-12 15:50:48 -08:00
Haohui Mai
bc5aa7d0b1 HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root. Contributed by Xiaoyu Yao. 2015-02-12 10:30:39 -08:00
Harsh J
e0ec0718d0 HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P. 2015-02-10 12:51:56 +05:30
yliu
1b56d1ce32 HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:45:29 +08:00
Allen Wittenauer
576459801c HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) (missed file) 2015-02-09 12:54:25 -08:00
Allen Wittenauer
30b797ee9d HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) 2015-02-09 12:50:44 -08:00
Steve Loughran
1425e3d37c HADOOP-11535 TableMapping related tests failed due to 'successful' resolving of invalid test hostname 2015-02-06 13:03:43 +00:00
Gera Shegalov
644548f201 HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera) 2015-02-06 00:27:54 -08:00
Allen Wittenauer
af3aadf04f HADOOP-6964. Allow compact property description in xml (Kengo Seki via aw) 2015-02-05 19:09:37 -08:00
yliu
03f7ed382b HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:45:06 +08:00
Allen Wittenauer
276485e1de HADOOP-9044. add FindClass main class to provide classpath checking of installations (Steve Loughran via aw) 2015-02-05 11:31:56 -08:00
Allen Wittenauer
fb06c00837 HADOOP-7713. dfs -count -q should label output column (Jonathan Allen via aw) 2015-02-05 07:44:49 -08:00
Junping Du
0b567f4246 HADOOP-10062. race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results. (Contributed by Sangjin Lee) 2015-02-04 19:10:52 -08:00
Robert Kanter
f7a77819a1 YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 2015-02-03 10:39:41 -08:00
cnauroth
8004a00230 HADOOP-10181. GangliaContext does not work with multicast ganglia setup. Contributed by Andrew Johnson. 2015-02-02 11:09:09 -08:00
Gera Shegalov
26c2de36e2 HADOOP-11432. Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2. (Liang Xie via gera) 2015-01-30 18:40:40 -08:00
Colin Patrick Mccabe
09ad9a868a HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-01-30 16:01:59 -08:00
Kihwal Lee
8dc59cb9e0 HADOOP-9137. Support connection limiting in IPC server. Contributed by Kihwal Lee. 2015-01-30 17:21:36 -06:00
Haohui Mai
543064e89d HADOOP-4297. Enable Java assertions when running tests. Contributed by Tsz Wo Nicholas Sze. 2015-01-27 11:05:55 -08:00
Steve Loughran
1f2b6956c2 HADOOP-6221 RPC Client operations cannot be interrupted (stevel) 2015-01-26 22:04:56 +00:00
Tsuyoshi Ozawa
786dbdfad8 HADOOP-11209. Configuration#updatingResource/finalParameters are not thread-safe. Contributed by Varun Saxena. 2015-01-22 14:15:59 +09:00
cnauroth
925c9fed33 HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 2015-01-21 11:52:48 -08:00
Jason Lowe
07b0806036 HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an incorrect filter. Contributed by Eric Payne 2015-01-21 19:04:29 +00:00
cnauroth
7fc1f2f5cf HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 2015-01-19 11:28:30 -08:00
Haohui Mai
3ab3a64988 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:17:30 -08:00
Robert Kanter
b6ff9c03a4 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter) 2015-01-15 11:39:43 -08:00
Akira Ajisaka
ce29074685 HADOOP-11318. Update the document for hadoop fs -stat 2015-01-16 00:55:20 +09:00
Akira Ajisaka
db51548f70 HADOOP-11483. HardLink.java should use the jdk7 createLink method 2015-01-15 20:54:44 +09:00
Colin Patrick Mccabe
a5a033c7ca HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) 2015-01-14 17:42:59 -08:00
Ravi Prakash
4d29142100 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe' 
(Kamil Gorlo via raviprak)
 2015-01-10 08:35:40 -08:00
Brandon Li
09d31bc630 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia 2015-01-09 17:24:22 -08:00
Benoy Antony
20625c8f04 HADOOP-10651. Add ability to restrict service access using IP addresses and hostnames. (Benoy Antony) 2015-01-08 10:06:48 -08:00
Tsuyoshi Ozawa
a6ed4894b5 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 2015-01-08 14:51:57 +09:00
Tsuyoshi Ozawa
9886396400 Revert "Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)" because of missing JIRA's number. 
This reverts commit 2eba7eb9af.
 2015-01-08 14:35:08 +09:00
Tsuyoshi Ozawa
2eba7eb9af Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 2015-01-08 14:21:30 +09:00
cnauroth
3ed0aed3cc HADOOP-11462. TestSocketIOWithTimeout needs change for PowerPC platform. Contributed by Ayappan. 2015-01-07 12:24:10 -08:00
Brandon Li
788ee35e2b HDFS-7564. NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map. Contributed by Yongjun Zhang 2015-01-06 16:19:39 -08:00
Benoy Antony
53caeaa16b HADOOP-11402. Negative user-to-group cache entries are never cleared for never-again-accessed users. Contributed by Varun Saxena. 2015-01-05 15:06:46 -08:00
yliu
21c6f01831 HADOOP-11455. KMS and Credential CLI should request confirmation for deletion by default. (Charles Lamb via yliu) 2015-01-05 06:55:08 +08:00
Brandon Li
892b1bb746 HDFS-7563. NFS gateway parseStaticMap NumberFormatException. Contributed by Yongjun Zhang 2015-01-02 10:49:50 -08:00
Robert Kanter
66cfe1dc73 HADOOP-11399. Java Configuration file and .xml files should be automatically cross-compared (rchiang via rkanter) 2014-12-23 14:30:46 -08:00
Jing Zhao
5caebbae8c HDFS-7484. Make FSDirectory#addINode take existing INodes as its parameter. Contributed by Jing Zhao. 2014-12-22 23:19:20 -08:00
Haohui Mai
2860eeb14a HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. Contributed by Haohui Mai. 2014-12-21 14:45:06 -08:00
Colin Patrick Mccabe
6635ccd217 HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe) 2014-12-18 19:39:04 -08:00
Jason Lowe
b9d49761f7 HADOOP-11409. FileContext.getFileContext can stack overflow if default fs misconfigured. Contributed by Gera Shegalov 2014-12-18 21:27:28 +00:00
Haohui Mai
ef1fc51852 HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. Contributed by Haohui Mai. 2014-12-18 11:33:09 -08:00
Colin Patrick Mccabe
07619aa516 HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe) 2014-12-18 11:05:06 -08:00
Haohui Mai
abb2ebbc3a HADOOP-11125. Remove redundant tests in TestOsSecureRandom. Contributed by Masanori Oyama. 2014-12-18 10:59:59 -08:00
yliu
1050d424a2 HADOOP-11358. Tests for encryption/decryption with IV calculation overflow. (yliu) 2014-12-18 00:49:25 +08:00
Colin Patrick Mccabe
9937eef7f7 HADOOP-11421. Add IOUtils#listDirectory (cmccabe) 2014-12-17 15:18:16 -08:00
Colin Patrick Mccabe
4281c96e24 HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) 2014-12-17 10:32:40 -08:00
Colin Patrick Mccabe
e5a6925199 HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li via Colin P. McCabe) 2014-12-12 16:30:52 -08:00
Gera Shegalov
0bcea111e5 HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera) 2014-12-11 13:12:13 -08:00
Andrew Wang
0707e4eca9 HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen. 2014-12-05 18:20:19 -08:00
stack
b36f292982 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY #2 2014-12-01 23:07:05 -08:00
stack
692d3b83e4 Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY" 
This reverts commit 74f4d8590d.

Refers to the wrong issue (HBASE rather than HADOOP)
 2014-12-01 23:04:00 -08:00
stack
74f4d8590d HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) -- REAPPLY 2014-12-01 22:46:57 -08:00
stack
4e312a4345 Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)" 
This reverts commit fb41615887.

Reverting because I over-changed CHANGES.txt white-space.
 2014-12-01 22:41:44 -08:00
stack
fb41615887 HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 2014-12-01 22:34:58 -08:00
Colin Patrick Mccabe
f636f9d943 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe) 2014-11-24 10:55:21 -08:00
Jason Lowe
b4ca727690 HADOOP-11309. System class pattern package.Foo should match package.Foo$Bar, too. Contributed by Gera Shegalov 2014-11-18 17:22:21 +00:00
Andrew Wang
48d62fad80 HADOOP-11311. Restrict uppercase key names from being created with JCEKS. 2014-11-17 13:59:46 -08:00
Brandon Li
351c5561c2 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 2014-11-17 13:23:53 -08:00
Aaron T. Myers
bd8196e85e HADOOP-11157. ZKDelegationTokenSecretManager never shuts down listenerThreadPool. Contributed by Arun Suresh. 2014-11-17 13:02:49 -08:00
Ravi Prakash
1a1dcce827 MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times (Sergey Murylev via raviprak) 2014-11-14 03:45:53 -08:00
Allen Wittenauer
ba879a5dad HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2014-11-13 11:52:38 -08:00
Jian He
86bf8c7193 HADOOP-9576. Changed NetUtils#wrapException to throw EOFException instead of wrapping it as IOException. Contributed by Steve Loughran 2014-11-10 17:25:29 -08:00
Haohui Mai
a37a993453 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 2014-11-09 17:48:26 -08:00
cnauroth
68db5b3736 HADOOP-11282. Skip NFS TestShellBasedIdMapping tests that are irrelevant on Windows. Contributed by Chris Nauroth. 2014-11-07 14:30:29 -08:00
cnauroth
42bbe3794e HADOOP-11280. TestWinUtils#testChmod fails after removal of NO_PROPAGATE_INHERIT_ACE. Contributed by Chris Nauroth. 2014-11-07 00:02:17 -08:00
Aaron T. Myers
6ba52d88ec HADOOP-10714. AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call. Contributed by Juan Yu. 2014-11-05 17:17:04 -08:00
Haohui Mai
8549fa5dc9 HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu. 2014-11-05 15:34:27 -08:00
Haohui Mai
1eed102023 HADOOP-10847. Remove the usage of sun.security.x509.* in testing code. Contributed by Pascal Oliva. 2014-11-04 10:52:05 -08:00
cnauroth
85da71c2d3 HADOOP-11165. TestUTF8 fails when run against java 8. Contributed by Stephen Chu. 2014-11-04 10:27:41 -08:00
Kihwal Lee
67f13b58e4 HADOOP-10987. Provide an iterator-based listing API for FileSystem. Contributed by Kihwal Lee. 2014-11-03 08:20:22 -06:00
cnauroth
5573b3476a HDFS-7313. Support optional configuration of AES cipher suite on DataTransferProtocol. Contributed by Chris Nauroth. 2014-10-30 22:48:25 -07:00
Brandon Li
72a556d3b0 HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang 2014-10-29 11:05:29 -07:00
cnauroth
c6f04f391b HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao. 2014-10-28 14:06:27 -07:00
cnauroth
5b1dfe78b8 HDFS-6934. Revert files accidentally committed. 2014-10-27 12:15:10 -07:00
cnauroth
463aec1171 HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth. 2014-10-27 09:38:30 -07:00
Byron Wong
28051e4155 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong. 2014-10-25 12:31:41 -07:00
Karthik Kambatla
db45f047ab HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha) 2014-10-23 17:04:14 -07:00
cnauroth
6637e3cf95 YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch. 2014-10-21 12:33:21 -07:00
Vinod Kumar Vavilapalli
1137557816 HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen. 2014-10-17 15:56:07 -07:00
Ravi Prakash
466f08792f HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) 2014-10-15 15:49:46 -07:00
Zhijie Shen
cdce88376a HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen. 2014-10-14 11:35:38 -07:00
cnauroth
1770bb942f HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao. 2014-10-13 10:56:32 -07:00
Uma Maheswara Rao G
8d7c54967d HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh) 2014-10-09 20:06:41 +05:30
Zhijie Shen
a169051931 HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch. 2014-10-08 15:36:16 -07:00
Arun C. Murthy
8f9ab998e2 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan. 2014-10-05 07:38:21 -07:00
cnauroth
69c9af9103 HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu. 2014-10-03 21:01:28 -07:00
Vinod Kumar Vavilapalli
5ca97f1e60 YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu. 
Committed as a YARN patch even though all the code changes are in common.
 2014-10-01 09:54:17 -07:00
arp
dde2ed13c2 Merge branch 'trunk' into HDFS-6581 2014-09-30 18:05:54 -07:00
Steve Loughran
a469833639 HADOOP-11117 UGI HadoopLoginModule doesn't catch & wrap all kerberos-related exceptions (stevel) 2014-09-30 17:30:06 -07:00
cnauroth
b9158697a4 HADOOP-11145. TestFairCallQueue fails. Contributed by Akira AJISAKA. 2014-09-30 08:57:05 -07:00
arp
bb84f1fccb HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal) 2014-09-29 22:27:59 -07:00
arp
1e6b4b9b2e Merge branch 'trunk' into HDFS-6581 2014-09-29 14:01:47 -07:00
Andrew Wang
a78953c974 HADOOP-11110. JavaKeystoreProvider should not report a key as created if it was not flushed to the backing file. (Arun Suresh via wang) 2014-09-29 13:10:26 -07:00
Jason Lowe
cf4631d7c9 HADOOP-11049. javax package system class default is too broad. Contributed by Sangjin Lee 2014-09-29 14:36:29 +00:00
arp
032e0eba6b Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-25 19:50:28 -07:00
Colin Patrick Mccabe
1861b32eb5 HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe) 2014-09-25 13:11:59 -07:00
arp
b1000fbba4 Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
 2014-09-24 20:08:32 -07:00
cnauroth
cbf0ae742a HADOOP-11064. UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes. Contributed by Chris Nauroth. 2014-09-24 15:30:13 -07:00
arp
889122bd55 Merge branch 'trunk' into HDFS-6581 2014-09-22 18:00:58 -07:00
Vinayakumar B
eab15af12c HADOOP-10131. NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree (Contributed by Vinayakumar B) 2014-09-22 11:25:56 +05:30
arp
09dab88d3e Merge branch 'trunk' into HDFS-6581 2014-09-20 10:34:45 -07:00
Alejandro Abdelnur
db890eef32 HADOOP-11017. KMS delegation token secret manager should be able to use zookeeper as store. (asuresh via tucu) 2014-09-20 08:21:44 -07:00
cnauroth
f85cc14eb4 HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth. 2014-09-19 21:23:26 -07:00
arp
f8bbf80067 Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsLocatedFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2014-09-18 22:26:42 -07:00
Andrew Wang
8e73084491 HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang) 2014-09-18 17:49:17 -07:00
arp
849ccfa699 Merge branch 'trunk' into HDFS-6581 2014-09-18 11:06:40 -07:00
Andrew Wang
47e5e19831 HADOOP-11040. Return value of read(ByteBuffer buf) in CryptoInputStream is incorrect in some cases. (Yi Liu via wang) 2014-09-17 17:58:56 -07:00
arp
a186d514bd Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2014-09-17 15:03:55 -07:00
Colin Patrick Mccabe
e3803d002c HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe) 2014-09-17 12:55:35 -07:00
arp
24f8156886 Merge branch 'trunk' into HDFS-6581 2014-09-17 12:10:50 -07:00
Alejandro Abdelnur
c0c7e6fabd HADOOP-11062. CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used. (asuresh via tucu) 2014-09-16 23:36:36 -07:00
Alejandro Abdelnur
e14e71d5fe HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu) 2014-09-16 23:20:35 -07:00
arp
ebdd5e50d5 Merge branch 'trunk' into HDFS-6581 2014-09-12 20:53:18 -07:00
cnauroth
957414d4cb HADOOP-11088. Unittest TestKeyShell, TestCredShell and TestKMS assume UNIX path separator for JECKS key store path. Contributed by Xiaoyu Yao. 2014-09-12 14:50:07 -07:00
arp
7aeda47bd9 Merge branch 'trunk' into HDFS-6581 2014-09-12 11:45:11 -07:00
Alejandro Abdelnur
c656d7d6e5 HADOOP-11083. After refactoring of HTTP proxyuser to common, doAs param is case sensitive. (tucu) 2014-09-11 13:53:31 -07:00
Colin Patrick Mccabe
5ec7fcd9dd HADOOP-11074. Move s3-related FS connector code to hadoop-aws. (David S. Wang via Colin Patrick McCabe) 2014-09-10 16:14:53 -07:00
Alejandro Abdelnur
b100949404 HADOOP-9989. Bug introduced in HADOOP-9374, which parses the -tokenCacheFile as binary file but set it to the configuration as JSON file. (zxu via tucu) 2014-09-09 22:19:42 -07:00
Alejandro Abdelnur
9ee891aa90 HADOOP-11077. NPE if hosts not specified in ProxyUsers. (gchanan via tucu) 2014-09-09 22:18:03 -07:00
cnauroth
6dae4b430c HADOOP-11057. checknative command to probe for winutils.exe on windows. Contributed by Xiaoyu Yao. 2014-09-09 21:38:29 -07:00
arp
4ff128af12 Merge branch 'trunk' into HDFS-6581 2014-09-08 15:00:01 -07:00
Allen Wittenauer
d989ac0444 MAPREDUCE-5972. Fix typo 'programatically' in job.xml (and a few other places) (Akira AJISAKA via aw) 2014-09-08 13:15:46 -07:00
Alejandro Abdelnur
df8c84cba8 HADOOP-11071. KMSClientProvider should drain the local generated EEK cache on key rollover. (tucu) 2014-09-08 11:31:30 -07:00
arp
6e5f780d1d Merge branch 'trunk' into HDFS-6581 2014-09-08 10:37:26 -07:00
cnauroth
302d9a0a0d Credential Provider related Unit Test Failure on Windows. Contributed by Xiaoyu Yao. 2014-09-08 09:29:19 -07:00
arp
339d21f273 Merge trunk into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
 2014-09-05 21:36:25 -07:00
Alejandro Abdelnur
b69a48c988 HADOOP-11060. Create a CryptoCodec test that verifies interoperability between the JCE and OpenSSL implementations. (hitliuyi via tucu) 2014-09-04 09:22:00 -07:00
Alejandro Abdelnur
70b218748b HADOOP-11015. Http server/client utils to propagate and recreate Exceptions from server to client. (tucu) 2014-09-04 09:11:10 -07:00
Alejandro Abdelnur
41f1662d46 HADOOP-11054. Add a KeyProvider instantiation based on a URI. (tucu) 2014-09-04 09:09:39 -07:00
Colin Patrick Mccabe
8f1a668575 HADOOP-11056. OsSecureRandom.setConf() might leak file descriptors. Contributed by Yongjun Zhang. 2014-09-03 19:35:39 -07:00
arp
a6b32a3e78 Merge trunk into HDFS-6581 2014-09-02 16:25:32 -07:00
Jason Lowe
01e8f056d9 HADOOP-11012. hadoop fs -text of zero-length file causes EOFException. Contributed by Eric Payne 2014-09-02 18:15:38 +00:00
arp
217dea7794 Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581 2014-09-01 11:52:59 -07:00
Alejandro Abdelnur
c60da4d3b3 HADOOP-10994. KeyProviderCryptoExtension should use CryptoCodec for generation/decryption of keys. (tucu) 2014-08-29 14:21:58 -07:00
Alejandro Abdelnur
6bf16d1156 HADOOP-10880. Move HTTP delegation tokens out of URL querystring to a header. (tucu) 2014-08-28 19:05:57 -07:00
arp
bbaa7dc28d HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal) 2014-08-28 15:53:12 -07:00