big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13,445 Commits 2 Branches 2 Tags 264 MiB
829a2e4d27
Commit Graph

3671 Commits

Author SHA1 Message Date
Haohui Mai
7e2c971fed Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu." 
This reverts commit fa5a54cac7.
 2015-10-10 03:24:59 -07:00
Haohui Mai
fa5a54cac7 HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu. 2015-10-09 22:38:06 -07:00
Akira Ajisaka
e1bf8b3df6 HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 2015-10-09 11:10:29 +09:00
Andrew Wang
66e2cfa1a0 HDFS-8632. Add InterfaceAudience annotation to the erasure coding classes. Contributed by Rakesh R. 2015-10-07 18:12:26 -07:00
Akira Ajisaka
7fbf69bf47 HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 2015-10-08 06:08:28 +09:00
Uma Mahesh
8b7339312c HDFS-9182. Cleanup the findbugs and other issues after HDFS EC merged to trunk. Contributed by Uma Maheswara Rao G. 2015-10-06 22:22:32 -07:00
Steve Loughran
6d5713a8a8 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:53 +01:00
cnauroth
5f6edb30c2 HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth. 2015-10-05 20:11:41 -07:00
Allen Wittenauer
b59e434116 HADOOP-10949. metrics2 sink plugin for Apache Kafka (Babak Behzad via aw) 2015-10-05 14:02:07 -07:00
Colin Patrick Mccabe
3e1752f9fb HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe) 2015-10-05 11:35:31 -07:00
Vinod Kumar Vavilapalli
f1c19b9365 HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan. 2015-10-05 10:56:55 -07:00
Tsuyoshi Ozawa
30e2f836a2 HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8. 2015-10-05 08:15:06 +09:00
Harsh J
c918f7be5e HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian. 2015-10-03 18:37:58 +05:30
Jason Lowe
fdf02d1f26 YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu 2015-10-02 20:20:31 +00:00
Zhihai Xu
fd026f535c HADOOP-8437. getLocalPathForWrite should throw IOException for invalid paths. Contributed by Brahma Reddy Battula 2015-10-01 11:56:49 -07:00
Akira Ajisaka
ecbfd68974 HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). Contributed by Rahul Palamuttam and Kanaka Kumar Avvaru. 2015-10-01 18:25:31 +02:00
Zhe Zhang
6c17d31528 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java

Change-Id: I53ec1c426dc988d6c4a2c87b00caef49c4057010
 2015-09-30 08:39:13 -07:00
yliu
06abc57a90 HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test directory. (Contributed by Colin Patrick McCabe and Chris Nauroth) 2015-09-30 10:56:22 +08:00
Haohui Mai
8703301b46 HDFS-9174. Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread. Contributed by Yi Liu. 2015-09-29 14:56:06 -07:00
Colin Patrick Mccabe
a2efb945e3 Add HADOOP-12447 to CHANGES.txt 2015-09-29 09:37:13 -07:00
Colin Patrick Mccabe
850d679acb HADOOP-12447. Clean up some htrace integration issues (cmccabe) 2015-09-29 09:25:11 -07:00
Zhe Zhang
8fd5520246 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFS.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java

Change-Id: Ic7946c4ea35bed587fe879ce58b959b25ecc0823
 2015-09-29 01:39:16 -07:00
yliu
d6fa34e014 HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu) 2015-09-29 16:20:35 +08:00
Ming Ma
5c3b663bf9 HADOOP-12440. TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down. (Xiao Chen via mingma) 2015-09-28 18:12:51 -07:00
Kihwal Lee
3abbdc929b HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. 2015-09-28 17:31:51 -05:00
Colin Patrick Mccabe
892ade689f HDFS-9080. Update htrace version to 4.0.1 (cmccabe) 2015-09-28 07:42:12 -07:00
Vinayakumar B
f0f984e4e6 HADOOP-11984. Enable parallel JUnit tests in pre-commit (Contributed by Chris Nauroth) 2015-09-27 14:12:07 +05:30
Vinayakumar B
861b52db24 HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid (Contributed by nijel) 2015-09-26 21:36:17 +05:30
cnauroth
7fe521b1dd HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu. 2015-09-25 22:33:53 -07:00
Yongjun Zhang
3187dbd7a8 HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang) 2015-09-24 21:36:38 -07:00
Zhihai Xu
9cc9f8126b Update CHANGES.txt to reflect commit of HADOOP-8436 to 2.8.0 2015-09-24 12:52:07 -07:00
Zhihai Xu
52c1f272ec HADOOP-12252. LocalDirAllocator should not throw NPE with empty string configuration. Contributed by Zhihai Xu 2015-09-24 11:51:22 -07:00
Arpit Agarwal
df31c446bf HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal) 2015-09-24 11:41:48 -07:00
Haohui Mai
0ef7ff47d5 HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem. Contributed by Chris Nauroth. 2015-09-23 19:36:44 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
1f707ecffd Release process for 2.6.1: Set the release date for 2.6.1 2015-09-23 15:10:50 -07:00
Vinayakumar B
a2c76e5f26 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) 2015-09-23 15:28:41 +05:30
Zhe Zhang
1080c37300 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: I8511c4d64b0959e79129febc179845a3892fedcc
 2015-09-22 13:27:09 -07:00
Tsuyoshi Ozawa
dfd807afab HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 2015-09-22 12:54:29 +09:00
Steve Loughran
c39ddc306d HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) 2015-09-19 12:41:42 +01:00
Zhihai Xu
88d89267ff HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 2015-09-18 10:40:04 -07:00
Zhihai Xu
3732d5238a Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu" 
This reverts commit e690a32e57.
 2015-09-18 10:30:40 -07:00
Zhihai Xu
e690a32e57 Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 2015-09-18 08:24:53 -07:00
Wangda Tan
6b97fa6652 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda) 2015-09-17 17:46:28 -07:00
Jason Lowe
58d1a02b8d MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 2015-09-17 14:30:18 +00:00
Haohui Mai
0832b38d48 HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:37 -07:00
Eric Yang
2ffe2db95e HADOOP-12374. Updated expunge command description. 
(WeiWei Yang via eyang)
 2015-09-15 20:03:24 -07:00
Akira Ajisaka
77aaf4cf7d HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu. 2015-09-16 10:20:24 +09:00
Vinayakumar B
ce69c9b54c HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) 2015-09-16 00:18:29 +05:30
cnauroth
b2017d9b03 HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu. 2015-09-15 10:41:50 -07:00
Vinayakumar B
a440567491 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) 2015-09-15 17:30:46 +05:30
Steve Loughran
7269906254 HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:26 +01:00
Steve Loughran
3f685cd571 HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:56:42 +01:00
Steve Loughran
4992f075c8 syncing branch-2 and trunk CHANGES.TXT to be closer together 2015-09-12 18:51:37 +01:00
Steve Loughran
8c054412e1 fix trunk/hadoop-common CHANGES.TXT to be the reference across trunk & branch-2 2015-09-12 18:13:54 +01:00
Robert Kanter
9538af0e1a HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 2015-09-11 15:20:17 -07:00
Steve Loughran
ca0827a862 HADOOP-12324. Better exception reporting in SaslPlainServer. (Mike Yoder via stevel) 2015-09-11 15:58:53 +01:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
fbbb7ff1ed Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1.
 2015-09-10 13:45:57 -07:00
Vinayakumar B
94cf7ab9d2 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) 2015-09-09 11:03:57 +05:30
Zhihai Xu
d9c1fab2ec HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong. 2015-09-08 13:06:36 -07:00
Vinayakumar B
090d26652c HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina) 2015-09-08 19:11:18 +05:30
Andrew Wang
e1feaf6db0 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao. 2015-09-04 13:42:55 -07:00
Arpit Agarwal
524ba8708b HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:47 -07:00
Tsuyoshi Ozawa
0ebc658105 HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla. 2015-09-03 23:32:42 +09:00
Tsuyoshi Ozawa
355eaaa33d HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter error message. Contributed by Wei Yan. 2015-09-03 22:48:53 +09:00
Jian He
09c64ba1ba YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 2015-09-02 17:45:23 -07:00
Akira Ajisaka
65ccf2b125 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 2015-09-02 14:28:38 +09:00
Zhe Zhang
53358fe680 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 2015-09-01 14:48:37 -07:00
Zhe Zhang
ab56fcdb12 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 2015-09-01 14:30:25 -07:00
Andrew Wang
0eb9b19325 HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder. 2015-09-01 10:57:32 -07:00
Tsuyoshi Ozawa
dd149adeac HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun. 2015-09-02 02:01:51 +09:00
Akira Ajisaka
2e251a7674 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N. 2015-09-01 20:55:33 +09:00
yliu
f4d96be6c6 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:20:56 +08:00
Andrew Wang
7ad3556ed3 HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. 2015-08-31 18:17:14 -07:00
Lei Xu
6ab2d19f5c HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:59:30 -07:00
Arpit Agarwal
bdbe53c676 HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:52:37 -07:00
Andrew Wang
90fe7bcc3b HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin. 2015-08-27 10:17:00 -07:00
Andrew Wang
50fa383704 Revert "MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha)" 
This reverts commit 61bf9cae6f.
 2015-08-27 10:15:19 -07:00
Walter Su
067ec8c2b1 HDFS-8838. Erasure Coding: Tolerate datanode failures in DFSStripedOutputStream when the data length is small. Contributed by Tsz Wo Nicholas Sze. 2015-08-27 09:11:23 +08:00
Jing Zhao
f44b599003 HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su. 2015-08-26 16:27:34 -07:00
Harsh J
af78767870 HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals before deleting. Contributed by Casey Brotherton. 2015-08-25 11:21:19 +05:30
Xiaoyu Yao
48774d0a45 HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer 2015-08-24 14:31:24 -07:00
Zhe Zhang
6b6a63bbbd Merge commit '456e901a4c5c639267ee87b8e5f1319f256d20c2' (HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai.) into HDFS-7285-merge 2015-08-24 12:59:26 -07:00
Xuan
37e1c3d82a YARN-221. NM should provide a way for AM to tell it not to aggregate 
logs. Contributed by Ming Ma
 2015-08-22 16:25:24 -07:00
Karthik Kambatla
61bf9cae6f MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha) 2015-08-22 00:39:04 -07:00
Xiaoyu Yao
caa636bf10 HADOOP-12347. Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives. Contributed by Xiaoyu Yao 2015-08-21 16:32:57 -07:00
Vinod Kumar Vavilapalli
33474939a0 Creating 2.6.2 entries in CHANGES.txt files. 2015-08-20 17:21:06 -07:00
Akira Ajisaka
36b1a1e784 HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki. 2015-08-20 11:09:45 +09:00
Robert Kanter
1e06299df8 HADOOP-12317. Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST (adhoot via rkanter) 2015-08-19 19:00:51 -07:00
Arpit Agarwal
9c3571ea60 HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer) 2015-08-19 09:42:35 -07:00
Tsz-Wo Nicholas Sze
7ecbfd44aa HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes. 2015-08-18 19:25:50 -07:00
Chris Douglas
30e342a5d3 HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan 2015-08-18 17:32:48 -07:00
Benoy Antony
71aedfabf3 hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu. 2015-08-18 13:43:34 -07:00
Arpit Agarwal
a88f31ebf3 HDFS-8880. NameNode metrics logging. (Arpit Agarwal) 2015-08-17 16:55:46 -07:00
Xiaoyu Yao
a7862d5fe4 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer. 2015-08-17 10:15:56 -07:00
Vinayakumar B
fc508b41a9 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 
Moved to 2.6.1
 2015-08-14 15:55:29 +05:30
Vinayakumar B
05ed69058f HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
Moved to 2.6.1
 2015-08-14 12:53:46 +05:30
Vinayakumar B
e7aa81394d HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1
 2015-08-14 12:23:51 +05:30
Vinayakumar B
24a11e3996 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
 2015-08-14 12:09:56 +05:30
Arpit Agarwal
6b1cefc561 HADOOP-12322. Typos in rpcmetrics.java. (Contributed by Anu Engineer) 2015-08-13 21:17:30 -07:00
Allen Wittenauer
b73181f187 HADOOP-12244. recover broken rebase during precommit (aw) 2015-08-13 12:29:19 -07:00
Zhe Zhang
1d37a88121 HDFS-8854. Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs. Contributed by Walter Su. 2015-08-13 10:04:45 -07:00
yliu
53bef9c5b9 HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu) 2015-08-13 16:45:20 +08:00
cnauroth
6cc8e38db5 HADOOP-12258. Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression. Contributed by Zhihai Xu. 2015-08-12 16:44:53 -07:00
Aaron T. Myers
820f864a26 HADOOP-12318. Expose underlying LDAP exceptions in SaslPlainServer. Contributed by Mike Yoder. 2015-08-12 15:24:16 -07:00
Andrew Wang
1ea1a8334e HDFS-8887. Expose storage type and storage ID in BlockLocation. 2015-08-11 23:25:33 -07:00
Xuan
3ae716fa69 YARN-3999. RM hangs on draing events. Contributed by Jian He 2015-08-11 18:25:11 -07:00
Jian He
f59612edd7 HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy Battula 2015-08-05 16:12:45 -07:00
cnauroth
3da0bedaec HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. 2015-08-05 14:56:41 -07:00
Colin Patrick Mccabe
4ab49a4365 HADOOP-12302. Fix native compilation on Windows after HADOOP-7824 (Vinayakumar B via Colin P. McCabe) 2015-08-05 09:46:51 -07:00
Colin Patrick Mccabe
6f83274afc HADOOP-12280. Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded (Masatake Iwasaki via Colin P. McCabe) 2015-08-05 09:42:38 -07:00
Akira Ajisaka
52f3525586 HADOOP-12274. Remove direct download link from BULIDING.txt. Contributed by Caleb Severn. 2015-08-05 17:45:55 +09:00
Lei Xu
d5403747b5 HADOOP-12269. Update aws-sdk dependency to 1.10.6 (Thomas Demoor via Lei (Eddy) Xu) 2015-08-04 18:51:52 -07:00
Zhihai Xu
a628a6f126 HADOOP-12268. AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation. Contributed by Zhihai Xu 2015-07-31 21:32:45 -07:00
Colin Patrick Mccabe
454da959c7 HADOOP-12183. Annotate the HTrace span created by FsShell with the command-line arguments passed by the user (Masatake Iwasaki via Colin P. McCabe) 2015-07-31 15:14:18 -07:00
Colin Patrick Mccabe
21d10ccc6e HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe) 2015-07-31 15:01:34 -07:00
Allen Wittenauer
a890a31529 HADOOP-10854. unit tests for the shell scripts (aw) 2015-07-31 14:34:48 -07:00
Allen Wittenauer
666cafca8d HADOOP-12249. pull argument parsing into a function (aw) 2015-07-31 14:32:21 -07:00
Harsh J
2087eaf684 HADOOP-12271. Hadoop Jar Error Should Be More Explanatory. Contributed by Josh Elser. 2015-07-31 10:12:32 +05:30
Jason Lowe
6f0a35724f HADOOP-10945. 4-digit octal umask permissions throws a parse error. Contributed by Chang Li 2015-07-29 15:25:10 +00:00
Akira Ajisaka
2a1d656196 Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)" 
This reverts commit 02c01815ec.
 2015-07-29 16:48:30 +09:00
Jakob Homan
0712a8103f HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. 2015-07-28 21:03:31 -07:00
Colin Patrick Mccabe
69b095730b HADOOP-12175. FsShell must load SpanReceierHost to support tracing (Masatake Iwasaki via Colin P. McCabe) 2015-07-28 12:56:15 -07:00
Arun Suresh
030fcfa99c HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh) 2015-07-27 23:02:03 -07:00
Akira Ajisaka
e21dde501a HADOOP-12245. References to misspelled REMAINING_QUATA in FileSystemShell.md. Contributed by Gabor Liptak. 2015-07-28 11:33:10 +09:00
Allen Wittenauer
098ba450cc HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw) 
(cherry picked from commit 8e657fba2fd33f7550597ea9c4c6e9a87aa1ef1c)
 2015-07-24 18:31:23 -07:00
Colin Patrick Mccabe
e4b0c74434 HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be removed (Alan Burlison via Colin P. McCabe) 2015-07-24 13:03:31 -07:00
Robert Kanter
ee233ec95c HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) 2015-07-24 09:41:53 -07:00
Akira Ajisaka
02c01815ec HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka) 2015-07-24 11:37:23 +09:00
Jakob Homan
ab3197c204 HADOOP-12009: Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via jghoman) 2015-07-23 17:46:13 -07:00
Andrew Wang
6736a1ab70 HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu. 2015-07-23 14:42:35 -07:00
Arpit Agarwal
adfa34ff99 HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula) 2015-07-23 10:13:04 -07:00
Colin Patrick Mccabe
1b3bceb58c HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin Walsh via Colin P. McCabe) 2015-07-22 11:34:10 -07:00
cnauroth
efa97243ec HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 2015-07-22 11:16:49 -07:00
Vinayakumar B
94c6a4aa85 HADOOP-12017. Hadoop archives command should use configurable replication factor when closing (Contributed by Bibin A Chundatt) 2015-07-22 10:25:49 +05:30
cnauroth
a26cc66f38 HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R. 2015-07-21 14:12:03 -07:00
cnauroth
cb03768b1b HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. 2015-07-21 13:55:58 -07:00
Allen Wittenauer
68d1f4bfe8 HADOOP-11762. Enable swift distcp to secure HDFS (Chen He via aw) 2015-07-21 11:19:29 -07:00
Vinayakumar B
87f29c6b8a HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B) 2015-07-21 13:12:46 +05:30
Akira Ajisaka
773c670943 HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. (aajisaka) 2015-07-21 11:21:49 +09:00
Jing Zhao
29495cb8f6 HADOOP-12060. Fix ByteBuffer usage for raw erasure coders. Contributed by Kai Zheng. 2015-07-20 10:15:14 -07:00
Steve Loughran
98c2bc87b1 HADOOP-11893. Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public. (Brahma Reddy Battula via stevel) 2015-07-20 13:22:14 +01:00
Steve Loughran
a9431425d1 HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage() in logging/span events. (Varun Saxena via stevel) 2015-07-20 13:13:23 +01:00
Steve Loughran
05fa3368f1 HADOOP-12088. KMSClientProvider uses equalsIgnoreCase("application/json"). (Brahma Reddy Battula via stevel) 2015-07-20 13:03:03 +01:00
Steve Loughran
9141e1aa16 HADOOP-12209 Comparable type should be in FileStatus. (Yong Zhang via stevel) 2015-07-20 12:32:44 +01:00
Steve Loughran
05130e94c5 HADOOP-12235 hadoop-openstack junit & mockito dependencies should be "provided". (Ted Yu via stevel) 2015-07-20 11:22:39 +01:00
Allen Wittenauer
ee36f4f9b8 HADOOP-10979. Auto-entries in hadoop_usage (aw) 2015-07-16 16:58:11 -07:00
Haohui Mai
d96bbe152c HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. Contributed by kanaka kumar avvaru. 2015-07-16 15:21:53 -07:00
Tsuyoshi Ozawa
90bda9c611 HADOOP-12240. Fix tests requiring native library to be skipped in non-native profile. Contributed by Masatake Iwasaki. 2015-07-16 16:04:55 +09:00
Tsuyoshi Ozawa
111e6a3fdf HADOOP-10615. FileInputStream in JenkinsHash#main() is never closed. Contributed by Chen He. 2015-07-16 14:08:31 +09:00
Tsuyoshi Ozawa
cec1d43db0 HADOOP-12153. ByteBufferReadable doesn't declare @InterfaceAudience and @InterfaceStability. Contributed by Brahma Reddy Battula. 2015-07-15 14:19:17 +09:00
cnauroth
0a16ee6017 HADOOP-12232. Upgrade Tomcat dependency to 6.0.44. Contributed by Chris Nauroth. 2015-07-14 15:22:33 -07:00
Tsuyoshi Ozawa
4084eaf943 HADOOP-12191. Bzip2Factory is not thread safe. Contributed by Brahma Reddy Battula. 2015-07-14 19:14:42 +09:00
Chris Douglas
a431ed9075 HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl 2015-07-13 15:36:11 -07:00
Akira Ajisaka
d6675606dc YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang. 2015-07-13 12:57:01 +09:00
Chris Douglas
1a0752d85a HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl 2015-07-09 17:48:43 -07:00
Karthik Kambatla
ac6048372a HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. (Chris Douglas via kasha) 2015-07-09 09:56:40 -07:00
Akira Ajisaka
6b7692c468 HADOOP-12200. TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profile. Contributed by Masatake Iwasaki. 2015-07-09 13:14:53 +09:00
Colin Patrick Mccabe
b8832fcf1e HADOOP-12201. Add tracing to FileSystem#createFileSystem and Globber#glob (cmccabe) 2015-07-08 20:07:21 -07:00
Karthik Kambatla
2e3d83f97b HADOOP-11878. FileContext#fixRelativePart should check for not null for a more informative exception. (Brahma Reddy Battula via kasha) 2015-07-08 11:34:34 -07:00
Andrew Wang
625d7ed9eb HADOOP-12194. Support for incremental generation in the protoc plugin. 2015-07-08 11:09:43 -07:00
Allen Wittenauer
98e59261b7 Revert "HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw)" 
This reverts commit 79ed0f959f.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-07-08 08:06:30 -07:00
Andrew Wang
3dc92e84c2 HADOOP-12195. Add annotation to package-info.java file to workaround MCOMPILER-205. 2015-07-07 11:14:12 -07:00
Andrew Wang
aa96a8c0c5 HADOOP-12193. Rename Touchz.java to Touch.java. 2015-07-07 11:12:56 -07:00
Chris Douglas
559425dcb9 HADOOP-5732. Add SFTPFileSystem. Contributed by Ramtin Boustani and Inigo Goiri 2015-07-07 10:08:59 -07:00
Vinayakumar B
e0febce0e7 HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu) 
Moved CHANGES.txt entry to 2.7.2
 2015-07-07 18:13:35 +05:30
Varun Vasudev
c40bdb56a7 YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan. 2015-07-07 16:59:29 +05:30
Vinayakumar B
99c8c5839b HADOOP-12117. Potential NPE from Configuration#loadProperty with allowNullValueProperties set. (Contributed by zhihai xu) 2015-07-07 16:11:27 +05:30
Colin Patrick Mccabe
81f3644376 HADOOP-11974. Fix FIONREAD #include on Solaris (Alan Burlison via Colin P. McCabe) 2015-07-06 17:17:59 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
bf89ddb9b8 Release process for 2.7.1: Set the release date for 2.7.1. 2015-07-06 16:39:59 -07:00
Chris Douglas
47a69ec7a5 HADOOP-12185. NetworkTopology is not efficient adding/getting/removing nodes. Contributed by Inigo Goiri 2015-07-06 15:03:22 -07:00
cnauroth
ed1e3ce482 HADOOP-12045. Enable LocalFileSystem#setTimes to change atime. Contributed by Kazuho Fujii. 2015-07-06 13:40:15 -07:00
Vinayakumar B
233cab89ad HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu) 2015-07-06 15:39:43 +05:30
Chris Douglas
e59f6fad6a HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri 2015-07-02 21:39:48 -07:00
cnauroth
f3796224bf HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence of the parent. Contributed by Chris Nauroth. 2015-07-01 19:47:58 -07:00
Colin Patrick Mccabe
a78d5074fb HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) 2015-07-01 17:57:11 -07:00
Lei Xu
532e38cb7f HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. (Lei Xu) 2015-06-30 17:41:59 -07:00
cnauroth
b8e792cba2 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:54:30 -07:00
Robert Kanter
aaafa0b2ee HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter) 2015-06-30 16:49:27 -07:00
Colin Patrick Mccabe
ad60807238 HADOOP-12124. Add HTrace support for FsShell (cmccabe) 2015-06-30 16:46:25 -07:00
Colin Patrick Mccabe
68e588cbee HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 2015-06-30 16:40:21 -07:00
Andrew Wang
9ee7b6e6c4 HADOOP-12158. Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed. 2015-06-30 15:04:33 -07:00
Gera Shegalov
6f2a41e37d YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera) 2015-06-30 14:59:33 -07:00
Allen Wittenauer
147e020c7a HADOOP-12149. copy all of test-patch BINDIR prior to re-exec (aw) 2015-06-30 11:31:26 -07:00
Steve Loughran
076948d9a4 Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)" 
This reverts commit 3dfa8161f9.
 2015-06-30 11:54:12 +01:00
Vinayakumar B
6d99017f38 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 2015-06-30 15:25:20 +05:30
Ming Ma
8e1bdc17d9 HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma) 2015-06-29 14:37:38 -07:00
cnauroth
460e98f7b3 HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 2015-06-29 13:48:02 -07:00
Colin Patrick Mccabe
fad291ea6d HADOOP-12112. Make hadoop-common-project Native code -Wall-clean (alanburlison via cmccabe) 2015-06-29 12:35:16 -07:00
Colin Patrick Mccabe
5a27c3fd76 HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework (Alan Burlison via Colin P. McCabe) 2015-06-29 12:31:26 -07:00
Vinayakumar B
c815344e2e HADOOP-12119. hadoop fs -expunge does not work for federated namespace (Contributed by J.Andreina) 2015-06-29 15:58:54 +05:30
Vinod Kumar Vavilapalli
aad6a7d5db Adding release 2.7.2 to CHANGES.txt. 2015-06-28 16:29:12 -07:00
Steve Loughran
3dfa8161f9 HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel) 2015-06-28 19:14:00 +01:00
Allen Wittenauer
79ed0f959f HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw) 2015-06-27 08:59:50 -07:00
Colin Patrick Mccabe
aa07dea357 HADOOP-12036. Consolidate all of the cmake extensions in one directory (alanburlison via cmccabe) 2015-06-26 12:32:31 -07:00
Amareshwari Sriramadasu
8ef07f767f HADOOP-11203. Allow ditscp to accept bandwitdh in fraction MegaBytes. Contributed by Raju Bairishetti 2015-06-26 09:52:06 +05:30
Benoy Antony
a815cc157c HADOOP-12049. Control http authentication cookie persistence via configuration. Contributed by Huizhi Lu. 2015-06-24 15:59:39 -07:00
Jonathan Eagles
2236b577a3 HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error occurs (Jason Lowe via jeagles) 2015-06-24 14:51:04 -05:00
Aaron T. Myers
49dfad9429 HDFS-6440. Support more than 2 NameNodes. Contributed by Jesse Yates. 2015-06-23 17:26:11 -07:00
Jason Lowe
077250d8d7 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 2015-06-22 21:59:20 +00:00
Colin Patrick Mccabe
d112d18324 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) 2015-06-19 19:14:05 -07:00
Yongjun Zhang
49f5d20efe HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang. 2015-06-19 14:06:17 -07:00
Colin Patrick Mccabe
6e0a9f92fe HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe) 2015-06-18 11:39:05 -07:00
Vinayakumar B
295d678be8 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 2015-06-18 14:39:00 +05:30
Yongjun Zhang
74351af3b7 HADOOP-11965. determine-flaky-tests needs a summary mode. Contributed by Yufei Gu, 2015-06-17 20:58:17 -07:00
cnauroth
fbf55dcaf4 HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay. 2015-06-16 14:44:03 -07:00
Akira Ajisaka
b578807b99 HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. Contributed by Brahma Reddy Battula. 2015-06-16 13:38:03 -07:00
Tsz-Wo Nicholas Sze
175e6d120f HDFS-8361. Choose SSD over DISK in block placement. 2015-06-15 17:12:01 -07:00
Vinod Kumar Vavilapalli
04c9a077c8 HADOOP-12001. Moving CHANGES.txt up into 2.8. 2015-06-15 14:29:07 -07:00
Vinod Kumar Vavilapalli
722aa1db1f HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and GID attributes during the search. Contributed by Patrick White. 2015-06-15 14:22:34 -07:00
Akira Ajisaka
e4489d97e5 HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to hadoop-common. Contributed by Masatake Iwasaki. 2015-06-12 07:25:15 -07:00
Vinayakumar B
95c73d49b1 HADOOP-12074. in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException (Contributed by Lavkesh Lahngir) 2015-06-11 11:51:14 +05:30
Vinayakumar B
48ca23def1 HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() (Contributed by kanaka kumar avvaru) 2015-06-10 11:05:58 +05:30
Kai Zheng
e299fe86b8 HDFS-8557 Allow to configure RS and XOR raw coders. Contributed by Kai Zheng 2015-06-10 15:35:26 +08:00
Arpit Agarwal
3107434031 HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal) 2015-06-09 20:58:39 -07:00
cnauroth
c45784bc90 HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic. 2015-06-08 22:42:14 -07:00
Xiaoyu Yao
927577c87c HDFS-8552. Fix hdfs CLI usage message for namenode and zkfc. Contributed by Brahma Reddy Battula 2015-06-08 21:57:26 -07:00
Colin Patrick Mccabe
fc2ed4a1f9 HADOOP-11347. RawLocalFileSystem#mkdir and create should honor umask (Varun Saxena via Colin P. McCabe) 2015-06-08 17:49:31 -07:00
Arpit Agarwal
84ba1a75b6 HADOOP-12054. RPC client should not retry for InvalidToken exceptions. (Contributed by Varun Saxena) 2015-06-08 15:45:23 -07:00
cnauroth
0e80d51983 HDFS-8554. TestDatanodeLayoutUpgrade fails on Windows. Contributed by Chris Nauroth. 2015-06-08 08:39:02 -07:00
Kai Zheng
c41b02cc00 HADOOP-12065 Using more meaningful keys in EC schema. Contributed by Kai Zheng 2015-06-08 20:24:17 +08:00
Steve Loughran
18f6809776 HADOOP-12052 IPC client downgrades all exception types to IOE, breaks callers trying to use them. (Brahma Reddy Battula via stevel) 2015-06-08 13:02:56 +01:00
cnauroth
e46cb80002 HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. 2015-06-06 09:17:03 -07:00
Jason Lowe
b3ffa87003 MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li 2015-06-05 22:38:31 +00:00
Andrew Wang
bc11e158b1 HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory. Contributed by Zhihai Xu. 2015-06-05 13:52:21 -07:00
Andrew Wang
2dbc40e608 HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey. 2015-06-05 13:11:01 -07:00
Gera Shegalov
9f6d67844d HADOOP-11924. Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) 2015-06-04 11:38:28 -07:00
Arpit Agarwal
8266dae0e9 HADOOP-11994. smart-apply-patch wrongly assumes that git is infallible. (Contributed by Kengo Seki) 2015-06-04 10:54:18 -07:00
Akira Ajisaka
dbed757cba HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii. 2015-06-05 01:45:34 +09:00
Vinayakumar B
1bb79c9d01 HADOOP-12019. update BUILDING.txt to include python for 'mvn site' in windows (Contributed by Vinayakumar B) 2015-06-04 10:42:52 +05:30
Akira Ajisaka
b5f0d294f8 HADOOP-12018. smart-apply-patch.sh fails if the patch edits CR+LF files and is created by 'git diff --no-prefix'. Contributed by Kengo Seki. 2015-06-04 11:14:55 +09:00
Akira Ajisaka
a6a8ee3c24 HADOOP-11991. test-patch.sh isn't re-executed even if smart-apply-patch.sh is modified. Contributed by Kengo Seki. 2015-06-03 15:01:02 +09:00
Kai Zheng
0799e1e4b6 HADOOP-12011 Allow to dump verbose information to ease debugging in raw erasure coders. Contributed by Kai Zheng 2015-06-02 22:05:16 +08:00
Andrew Wang
990078b927 HADOOP-12037. Fix wrong classname in example configuration of hadoop-auth documentation. Contributed by Masatake Iwasaki. 2015-06-01 18:04:52 -07:00
Vinayakumar B
63e3fee5f6 HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) 2015-06-01 17:47:02 +05:30
Andrew Wang
374ddd9f9e HADOOP-12043. Display warning if defaultFs is not set when running fs commands. Contributed by Eddy Xu. 2015-05-29 17:15:58 -07:00
Andrew Wang
7673d4f205 HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang) 2015-05-29 14:54:18 -07:00
Vinayakumar B
7366e42563 HADOOP-12042. Users may see TrashPolicy if hdfs dfs -rm is run (Contributed by Andreina J) 2015-05-29 16:51:23 +05:30
cnauroth
860b8373c3 HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay. 2015-05-28 15:01:42 -07:00
Allen Wittenauer
ae14543420 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits (aw) 2015-05-28 13:24:01 -07:00
cnauroth
94e7d49a6d HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic. 2015-05-28 12:31:06 -07:00
Allen Wittenauer
7ebe80ec12 HADOOP-11930. test-patch in offline mode should tell maven to be in offline mode (Sean Busbey via aw) 2015-05-28 12:11:48 -07:00
Colin Patrick Mccabe
a1140959da HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-05-28 12:00:55 -07:00
Colin Patrick Mccabe
246cefa089 HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread. (zhouyingchao via cmccabe) 2015-05-28 11:52:28 -07:00
Allen Wittenauer
08ae87f6ba HADOOP-11983. HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is supposed to do (Sangjin Lee via aw) 2015-05-28 11:29:58 -07:00
Allen Wittenauer
5df1fadf87 HADOOP-7947. Validate XMLs if a relevant tool is available, when using scripts (Kengo Seki via aw) 2015-05-28 11:01:00 -07:00
Allen Wittenauer
cbba7d68f0 HADOOP-11142. Remove hdfs dfs reference from file system shell documentation (Kengo Seki via aw) 2015-05-28 10:57:04 -07:00
Allen Wittenauer
5504a261f8 HADOOP-11406. xargs -P is not portable (Kengo Seki via aw) 2015-05-28 10:36:40 -07:00
Allen Wittenauer
b01d33cf86 HADOOP-12030. test-patch should only report on newly introduced findbugs warnings. (Sean Busbey via aw) 2015-05-28 09:53:50 -07:00
Allen Wittenauer
f1cea9c6bf HADOOP-12035. shellcheck plugin displays a wrong version potentially (Kengo Seki via aw) 2015-05-28 09:11:08 -07:00
Allen Wittenauer
87c26f8b7d HADOOP-12004. test-patch breaks with reexec in certain situations (Sean Busbey via aw) 2015-05-28 08:15:17 -07:00
Allen Wittenauer
bf500d9798 HDFS-5033. Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source (Darrell Taylor via aw) 2015-05-27 16:51:34 -07:00
Allen Wittenauer
4d8fb8c19c HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException (Darrell Taylor via aw) 2015-05-27 16:36:55 -07:00
Akira Ajisaka
bb1816328a HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki. 2015-05-27 18:04:40 +09:00
Colin Patrick Mccabe
7dba7005b7 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) 2015-05-26 12:15:46 -07:00
Kai Zheng
4ad484883f HADOOP-11847 Enhance raw coder allowing to read least required inputs in decoding. Contributed by Kai Zheng 2015-05-26 12:07:16 -07:00
Vinayakumar B
5a391e1d25 HADOOP-12029. Remove chunkSize from ECSchema as its not required for coders (Contributed by Vinayakumar B) 2015-05-26 12:07:16 -07:00
Kai Zheng
b30e96bfb4 HDFS-8382 Remove chunkSize and initialize from erasure coder. Contributed by Kai Zheng 2015-05-26 12:07:15 -07:00
Kai Zheng
4ae32abdf4 HADOOP-12013 Generate fixed data to perform erasure coder test. Contributed by Kai Zheng 2015-05-26 12:07:14 -07:00
Zhe Zhang
343c0e76fc HADOOP-11938. Enhance ByteBuffer version encode/decode API of raw erasure coder. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
b64f6745a4 HADOOP-11566. Add tests and fix for erasure coders to recover erased parity units. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
09c3a375ba HADOOP-11920. Refactor some codes for erasure coders. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
9c7a78c874 HADOOP-11921. Enhance tests for erasure coders. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Jing Zhao
3f2c6938f1 HDFS-8223. Should calculate checksum for parity blocks in DFSStripedOutputStream. Contributed by Yi Liu. 2015-05-26 11:59:54 -07:00
Zhe Zhang
e8df2581c3 HDFS-8156. Add/implement necessary APIs even we just have the system default schema. Contributed by Kai Zheng. 2015-05-26 11:59:53 -07:00
Uma Maheswara Rao G
014d8675c5 HDFS-8024. Erasure Coding: ECworker frame, basics, bootstraping and configuration. (Contributed by Uma Maheswara Rao G) 2015-05-26 11:59:52 -07:00
Tsz-Wo Nicholas Sze
909632dd90 HADOOP-11841. Remove unused ecschema-def.xml files. 2015-05-26 11:59:12 -07:00
Vinayakumar B
ceb3d1c170 HDFS-7349. Support DFS command for the EC encoding (Contributed by Vinayakumar B) 2015-05-26 11:59:11 -07:00
Vinayakumar B
f53e402635 HDFS-8090. Erasure Coding: Add RPC to client-namenode to list all ECSchemas loaded in Namenode. (Contributed by Vinayakumar B) 2015-05-26 11:58:40 -07:00
Kai Zheng
971bd5e885 HADOOP-11818 Minor improvements for erasurecode classes. Contributed by Rakesh R 2015-05-26 11:55:17 -07:00
Kai Zheng
1a37b0fe9a HDFS-8074 Define a system-wide default EC schema. Contributed by Kai Zheng 2015-05-26 11:55:16 -07:00
Vinayakumar B
99502cbbe2 HADOOP-11645. Erasure Codec API covering the essential aspects for an erasure code ( Contributed by Kai Zheng) 2015-05-26 11:55:15 -07:00
Vinayakumar B
aac73c21c3 HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang. 
Updated CHANGES-HDFS-EC-7285.txt
 2015-05-26 11:55:15 -07:00
Kai Zheng
d43102d2c5 Updated CHANGES-HDFS-EC-7285.txt 2015-05-26 11:55:14 -07:00
Kai Zheng
17f7cdc047 HADOOP-11805 Better to rename some raw erasure coders. Contributed by Kai Zheng 2015-05-26 11:55:14 -07:00
Zhe Zhang
e54a74b566 HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang. 2015-05-26 11:55:13 -07:00
Kai Zheng
98ea3ec0da HADOOP-11782 Correct two thrown messages in ECSchema class. Contributed by Xinwei Qin 2015-05-26 11:44:47 -07:00
Zhe Zhang
d9af36b9bd HADOOP-11664. Loading predefined EC schemas from configuration. Contributed by Kai Zheng. 2015-05-26 11:43:43 -07:00
Kai Zheng
df297245a7 HADOOP-11647. Reed-Solomon ErasureCoder. Contributed by Kai Zheng 2015-05-26 11:43:41 -07:00
Kai Zheng
90d332d6be HADOOP-11707. Add factory to create raw erasure coder. Contributed by Kai Zheng 2015-05-26 11:43:41 -07:00
Kai Zheng
e3dbfeb138 Updated CHANGES-HDFS-EC-7285.txt accordingly 2015-05-26 11:42:05 -07:00
Kai Zheng
c3bc083405 HADOOP-11706 Refine a little bit erasure coder API 2015-05-26 11:42:04 -07:00
Kai Zheng
68caf8728e Fixed a compiling issue introduced by HADOOP-11705. 2015-05-26 11:32:26 -07:00
drankye
292e367d07 HADOOP-11705. Make erasure coder configurable. Contributed by Kai Zheng 2015-05-26 11:32:25 -07:00
Vinayakumar B
8f89d7489d HADOOP-11646. Erasure Coder API for encoding and decoding of block group ( Contributed by Kai Zheng ) 2015-05-26 11:32:25 -07:00
drankye
c0945a8971 HADOOP-11643. Define EC schema API for ErasureCodec. Contributed by Kai Zheng 2015-05-26 11:32:24 -07:00
drankye
dae27f6dd1 HADOOP-11542. Raw Reed-Solomon coder in pure Java. Contributed by Kai Zheng 2015-05-26 11:07:15 -07:00
Kai Zheng
b29f3bde4d HADOOP-11541. Raw XOR coder 2015-05-26 11:03:35 -07:00
Vinayakumar B
9f19eb9fcf HADOOP-11534. Minor improvements for raw erasure coders ( Contributed by Kai Zheng ) 2015-05-26 11:03:35 -07:00
Uma Maheswara Rao G
e50bcea83d HADOOP-11514. Raw Erasure Coder API for concrete encoding and decoding (Kai Zheng via umamahesh) 2015-05-26 11:03:35 -07:00
Akira Ajisaka
56996a685e HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru. 2015-05-26 16:16:21 +09:00
Colin Patrick Mccabe
f34638399a HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe) 2015-05-22 12:51:03 -07:00
Vinayakumar B
55ed6558ba HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin) 2015-05-22 16:45:19 +05:30
Akira Ajisaka
ab7958f227 HADOOP-11594. Improve the readability of site index of documentation. Contributed by Masatake Iwasaki. 2015-05-22 16:51:05 +09:00
Akira Ajisaka
b2a40942c1 HADOOP-11955. Fix a typo in the cluster setup doc. Contributed by Yanjun Wang. 2015-05-22 16:09:01 +09:00
Akira Ajisaka
c7fea088f7 HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki. 2015-05-22 14:15:08 +09:00
Jakob Homan
4fc942a84f HADOOP-12016. Typo in FileSystem::listStatusIterator. Contributed by Arthur Vigil. 2015-05-21 14:50:03 -07:00
Akira Ajisaka
0e4f1081c7 HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru. 2015-05-21 17:52:03 +09:00
Haohui Mai
fb6b38d67d HADOOP-11772. RPC Invoker relies on static ClientCache which has synchronized(this) blocks. Contributed by Haohui Mai. 2015-05-20 20:10:50 -07:00
Akira Ajisaka
4aa730ce85 HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. 2015-05-20 19:25:45 +09:00
Haohui Mai
ce53c8eb0c HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. 2015-05-19 18:28:20 -07:00
Allen Wittenauer
12d6c5ce4f HADOOP-12000. cannot use --java-home in test-patch (aw) 2015-05-19 15:24:23 -07:00
cnauroth
e422e76fca HADOOP-11963. Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. Contributed by Anu Engineer. 2015-05-19 11:50:27 -07:00
Arun Suresh
fd3cb533d2 HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) 2015-05-19 11:35:57 -07:00
Colin Patrick Mccabe
470c87dbc6 HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 2015-05-19 10:50:15 -07:00
Akira Ajisaka
eb4c9ddeb5 Move HADOOP-11581 in CHANGES.txt from 3.0.0 to 2.8.0. 2015-05-19 18:38:35 +09:00
Vinayakumar B
d4a2830b63 HADOOP-11103. Clean up RemoteException (Contributed by Sean Busbey) 2015-05-19 14:41:05 +05:30
Akira Ajisaka
f889a49271 Move HADOOP-8934 in CHANGES.txt from 3.0.0 to 2.8.0. 2015-05-19 18:02:10 +09:00
Akira Ajisaka
3b50dcdce4 HADOOP-10971. Add -C flag to make hadoop fs -ls print filenames only. Contributed by Kengo Seki. 2015-05-19 17:25:27 +09:00
Jing Zhao
0790275f05 HADOOP-1540. Support file exclusion list in distcp. Contributed by Rich Haase. 2015-05-18 13:24:35 -07:00
Arpit Agarwal
a2190bf15d HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:36:29 -07:00
Allen Wittenauer
060c84ea86 HADOOP-11949. Add user-provided plugins to test-patch (Sean Busbey via aw) 2015-05-18 17:06:31 +00:00
Allen Wittenauer
bcc17866dd HADOOP-11944. add option to test-patch to avoid relocating patch process directory (Sean Busbey via aw) 2015-05-18 16:13:50 +00:00
Allen Wittenauer
182d86dac0 HADOOP-11884. test-patch.sh should pull the real findbugs version (Kengo Seki via aw) 2015-05-18 16:08:49 +00:00
Akira Ajisaka
a46506d99c HADOOP-10582. Fix the test case for copying to non-existent dir in TestFsShellCopy. Contributed by Kousuke Saruta. 2015-05-18 16:31:41 +09:00
Akira Ajisaka
f5c48238d5 HADOOP-11939. Deprecate DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. 2015-05-18 16:13:16 +09:00
Akira Ajisaka
cab0dadbd8 HADOOP-11988. Fix typo in the document for hadoop fs -find. Contributed by Kengo Seki. 2015-05-17 13:35:51 +09:00
cnauroth
cb8e69a80c HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth. 2015-05-14 22:22:24 -07:00
cnauroth
09fe16f166 HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R. 2015-05-14 14:55:58 -07:00
Vinayakumar B
ffbb574623 HADOOP-10993. Dump java command line to *.out file (Contributed by Kengo Seki) 2015-05-14 15:24:35 +05:30
Vinayakumar B
0daa5ada68 HADOOP-8174. Remove confusing comment in Path#isAbsolute() (Contributed by Suresh Srinivas) 2015-05-14 14:17:36 +05:30
Tsuyoshi Ozawa
4356e8a5ef HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula. 2015-05-14 10:20:45 +09:00
cnauroth
93b770f7e7 HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth. 2015-05-13 12:25:06 -07:00
Akira Ajisaka
92c38e41e1 HADOOP-9723. Improve error message when hadoop archive output path already exists. Contributed by Jean-Baptiste Onofré and Yongjun Zhang. 2015-05-13 17:28:57 +09:00
Zhijie Shen
fcd0702c10 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran. 2015-05-12 21:13:22 -07:00
Akira Ajisaka
2463666ecb HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 2015-05-13 11:37:22 +09:00
Haohui Mai
2f4b6d1157 HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out even in debug level. Contributed by Junping Du. 2015-05-12 10:30:32 -07:00
Allen Wittenauer
a83eaeaa2e HADOOP-11947. test-patch should return early from determine-issue when run in jenkins mode. (Sean Busbey via aw) 2015-05-11 12:07:48 -07:00
Allen Wittenauer
d4f422612a HADOOP-11948. test-patch's issue matching regex should be configurable. (Sean Busbey via aw) 2015-05-11 11:53:54 -07:00
Allen Wittenauer
2d671e5b3d HADOOP-11950. Add cli option to test-patch to set the project-under-test (Sean Busbey via aw) 2015-05-11 11:50:01 -07:00
Allen Wittenauer
baeb479aef HADOOP-11951. test-patch should give better info about failures to handle dev-support updates without resetrepo option (Sean Busbey via aw) 2015-05-11 11:45:47 -07:00
Allen Wittenauer
32cc3139e3 HADOOP-11928. Test-patch check for @author tags incorrectly flags removal of @author tags (Kengo Seki via aw) 2015-05-11 11:35:02 -07:00
Akira Ajisaka
b9cebfc0ba HADOOP-11663. Remove description about Java 6 from docs. Contributed by Masatake Iwasaki. 2015-05-12 00:30:59 +09:00
Junping Du
7e543c27fa YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 2015-05-11 05:27:07 -07:00
Allen Wittenauer
ed0f4db0dd HADOOP-11775. Fix Javadoc typos in hadoop-openstack module (Yanjun Wang via aw) 2015-05-08 17:01:08 -07:00
Robert Kanter
315074bb08 HADOOP-9737. JarFinder#getJar should delete the jar file upon destruction of the JVM (jbonofre via rkanter) 2015-05-08 16:05:04 -07:00
Allen Wittenauer
c945c20483 HADOOP-11590. Update sbin commands and documentation to use new --slaves option (aw) 2015-05-08 15:27:25 -07:00
Allen Wittenauer
effcc5cbb7 HADOOP-11906. test-patch.sh should use file command for patch determinism (Sean Busbey via aw) 2015-05-08 15:13:38 -07:00
Xiaoyu Yao
e8f66c449c HADOOP-11942. Add links to SLGUserGuide to site index (Masatake Iwasaki via xyao) 2015-05-08 14:34:34 -07:00
Jason Lowe
ec2748dedb HADOOP-9729. The example code of org.apache.hadoop.util.Tool is incorrect. Contributed by hellojinjie 2015-05-08 21:28:38 +00:00
Jason Lowe
c4bd2cdded HADOOP-7165. listLocatedStatus(path, filter) is not redefined in FilterFs. Contributed by Hairong Kuang 2015-05-08 20:36:07 +00:00
Colin Patrick Mccabe
8f7c2364d7 HDFS-8284. Update documentation about how to use HTrace with HDFS (Masatake Iwasaki via Colin P. McCabe) 2015-05-08 12:30:03 -07:00
Arpit Agarwal
a0fae8dcae HADOOP-10356. Corrections in winutils/chmod.c (Contributed by René Nyffenegger) 2015-05-08 11:42:50 -07:00
cnauroth
26f61d41df HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R. 2015-05-08 11:20:55 -07:00
Robert (Bobby) Evans
cc17c83585 HADOOP-6842. "hadoop fs -text" does not give a useful text representation of MapWritable objects 2015-05-08 11:57:14 -05:00
Vinayakumar B
1ffb7fa42e HADOOP-11877. SnappyDecompressor's Logger class name is wrong ( Contributed by surendra singh lilhore) 2015-05-08 16:52:14 +05:30
Vinayakumar B
f33efbc827 HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak) 2015-05-08 10:22:11 +05:30
Allen Wittenauer
ab5058de8e HADOOP-11936. Dockerfile references a removed image (aw) 2015-05-07 11:46:32 -07:00
Akira Ajisaka
305e4733d6 HADOOP-10387. Misspelling of threshold in log4j.properties for tests in hadoop-common-project. Contributed by Brahma Reddy Battula. 2015-05-07 16:53:57 +09:00
Allen Wittenauer
f325522c14 HADOOP-11813. releasedocmaker.py should use today's date instead of unreleased (Darrell Taylor via aw) 2015-05-06 10:34:09 -07:00
Xiaoyu Yao
7a26d174af HDFS-8310. Fix TestCLI.testAll 'help: help for find' on Windows. (Kiran Kumar M R via Xiaoyu Yao) 2015-05-06 10:24:46 -07:00
Colin Patrick Mccabe
90b3845648 HADOOP-11912. Extra configuration key used in TraceUtils should respect prefix (Masatake Iwasaki via Colin P. McCabe) 2015-05-05 17:40:31 -07:00
Allen Wittenauer
4402e4c633 HADOOP-11926. test-patch.sh mv does wrong math (aw) 2015-05-05 17:01:42 -07:00
Robert Kanter
9809a16d3c MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter) 2015-05-05 14:43:28 -07:00
Allen Wittenauer
d33419ae01 HADOOP-11917. test-patch.sh should work with ${BASEDIR}/patchprocess setups (aw) 2015-05-05 11:26:31 -07:00
Allen Wittenauer
3ff91e9e93 HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven builds (aw) 2015-05-05 11:02:15 -07:00
Allen Wittenauer
9b01f81eb8 HADOOP-11911. test-patch should allow configuration of default branch (Sean Busbey via aw) 2015-05-05 09:59:31 -07:00
Andrew Wang
05adc76ace HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland. 2015-05-05 08:37:37 -07:00
Tsuyoshi Ozawa
338e88a19e HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug. Contributed by Ming Ma. 2015-05-05 12:39:24 +09:00
Wangda Tan
71f4de220c YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda) 2015-05-04 15:49:19 -07:00
Tsuyoshi Ozawa
bb9ddef0e7 HADOOP-11328. ZKFailoverController does not log Exception when doRun raises errors. Contributed by Tianyin Xu. 2015-05-04 17:47:37 +09:00
Tsuyoshi Ozawa
76fa606e2d HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen. 2015-05-04 17:05:00 +09:00
Gera Shegalov
3ddb260e30 HADOOP-11900. Add failIfNoTests=false to hadoop-build-tools pom. (gera) 2015-05-01 18:18:55 -07:00
Gera Shegalov
f343f8657e HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) 2015-05-01 18:18:55 -07:00
Wangda Tan
7d46a806e7 YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda) 2015-05-01 16:40:55 -07:00
Colin Patrick Mccabe
b82567d455 HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 2015-05-01 11:19:40 -07:00
Jonathan Eagles
2d7363b273 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 2015-05-01 13:11:50 -05:00
Allen Wittenauer
5f8112ffd2 HADOOP-11866. increase readability and reliability of checkstyle, shellcheck, and whitespace reports (aw) 2015-04-30 15:15:32 -07:00
Arun Suresh
f0db797be2 HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) 2015-04-30 13:59:43 -07:00
Akira Ajisaka
f384a063a6 HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula. 2015-04-30 19:34:41 +09:00
Akira Ajisaka
e89fc53a1d HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 2015-04-30 19:11:22 +09:00
Jing Zhao
7947e5b53b HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 2015-04-29 10:41:46 -07:00
Allen Wittenauer
eccf709a61 HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via aw) 2015-04-28 10:32:32 -07:00
Robert Kanter
9fec02c069 HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter) 2015-04-27 13:25:11 -07:00
Arpit Agarwal
0d5b0143cc HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:23:34 -07:00
Jakob Homan
1a2459bd4b HADOOP-11857. Fix CommandFormat#commandFormat java doc annotation. Contributed by J.Andreina. 2015-04-26 18:35:01 -07:00
Allen Wittenauer
8847777ae4 HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) 2015-04-26 15:51:08 -07:00
Allen Wittenauer
8b69c825e5 HADOOP-11865. Incorrect path mentioned in document for accessing script files (J.Andreina via aw) 2015-04-26 09:55:46 -07:00
Ravi Prakash
a287d2fb77 HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak) 2015-04-24 13:39:07 -07:00
cnauroth
80935268f5 HADOOP-11843. Make setting up the build environment easier. Contributed by Niels Basjes. 2015-04-24 13:05:18 -07:00
Colin Patrick Mccabe
a0e0a63209 HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 2015-04-23 19:00:24 -07:00
Haohui Mai
bcf89ddc7d HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:33:45 -07:00
Akira Ajisaka
ac281e3fc8 HADOOP-11627. Remove io.native.lib.available. Contributed by Brahma Reddy Battula. 2015-04-24 08:08:55 +09:00
Steve Loughran
19262d99eb HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel) 2015-04-23 21:41:51 +01:00
Andrew Wang
26971e52ae HADOOP-11852. Disable symlinks in trunk. 2015-04-23 11:47:01 -07:00
Arpit Agarwal
49f6e3d35e HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma) 2015-04-23 09:35:04 -07:00
Steve Loughran
08d4386162 HADOOP-11864. JWTRedirectAuthenticationHandler breaks java8 javadocs. (Larry McCay via stevel) 2015-04-23 09:06:22 +01:00
cnauroth
18eb5e7934 HADOOP-11861. test-patch.sh rewrite addendum patch. Contributed by Allen Wittenauer. 2015-04-22 22:23:31 -07:00
Jason Lowe
0ebe84d30a HADOOP-11868. Invalid user logins trigger large backtraces in server log. Contributed by Chang Li 2015-04-22 20:56:29 +00:00
Jakob Homan
e54a3e1f4f HADOOP-11850: Typos in hadoop-common java docs. Contributed by Surendra Singh Lilhore. 2015-04-22 13:48:16 -07:00
Colin Patrick Mccabe
a3b1d8c902 HADOOP-11848. Incorrect arguments to sizeof in DomainSocket.c (Malcolm Kavalsky via Colin P. McCabe) 2015-04-22 12:36:37 -07:00
Jitendra Pandey
1f4767c7f2 HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. Contributed by Eugene Koifman. 2015-04-22 10:00:14 -07:00
Ravi Prakash
cfba355052 HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak) 2015-04-21 16:49:37 -07:00
Steve Loughran
2c14690368 HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. (Larry McCay via stevel) 2015-04-21 22:38:41 +01:00
Gera Shegalov
6d2cf9fbbd HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 2015-04-21 13:57:23 -07:00
Allen Wittenauer
73ddb6b4f8 HADOOP-11746. rewrite test-patch.sh (aw) 2015-04-21 21:29:45 +01:00
Arun Suresh
424a00daa0 HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) 2015-04-21 11:31:51 -07:00
Arpit Agarwal
dfc1c4c303 HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:05 -07:00
Vinod Kumar Vavilapalli
d52de61544 Set the release date for 2.7.0 2015-04-20 20:16:58 -07:00
Arpit Agarwal
c92f6f3605 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:42 -07:00
Haohui Mai
c6b5203cfd HADOOP-11837. AuthenticationFilter should destroy SignerSecretProvider in Tomcat deployments. Contributed by Bowen Zhang. 2015-04-17 10:59:47 -07:00
Vinayakumar B
b5a0b24643 HADOOP-11819. HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist. (Contributed by Rohith) 2015-04-14 11:58:12 +05:30
Allen Wittenauer
d4e8c09593 HADOOP-9642. Configuration to resolve environment variables via ${env.VARIABLE} references (Kengo Seki via aw) 2015-04-14 08:20:13 +02:00
Arpit Agarwal
b9b832a0d8 HADOOP-7713. Update CHANGES.txt 2015-04-13 21:20:16 -07:00
Arpit Agarwal
18a3dad44a HDFS-7701. Support reporting per storage type quota and usage with hadoop/hdfs shell. (Contributed by Peter Shi) 2015-04-13 21:01:15 -07:00
Tsuyoshi Ozawa
174d8b3a10 HADOOP-11811. Fix typos in hadoop-project/pom.xml. Contributed by Brahma Reddy Battula. 2015-04-13 06:59:51 -05:00
Akira Ajisaka
83979e61a4 MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina. 2015-04-10 20:21:00 +09:00
Vinod Kumar Vavilapalli
623fd46c1e Adding release 2.7.1 to CHANGES.txt 2015-04-09 13:54:20 -07:00
Haohui Mai
63c659ddd0 HADOOP-11815. HttpServer2 should destroy SignerSecretProvider when it stops. Contributed by Rohith. 2015-04-09 10:58:12 -07:00
Haohui Mai
dc0282d64c HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu. 2015-04-08 17:56:23 -07:00
Allen Wittenauer
f4b3fc5621 HADOOP-11781. fix race conditions and add URL support to smart-apply-patch.sh (Raymie Stata via aw) 2015-04-08 10:05:25 -07:00
Arpit Agarwal
5449adc9e5 HADOOP-11801. Update BUILDING.txt for Ubuntu. (Contributed by Gabor Liptak) 2015-04-07 18:06:05 -07:00
cnauroth
bd77a7c4d9 HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. Contributed by Xiaoyu Yao. 2015-04-07 14:47:21 -07:00
Owen O'Malley
ce63573314 HADOOP-11717. Support JWT tokens for web single sign on to the Hadoop 
servers. (Larry McCay via omalley)
 2015-04-07 08:09:41 -07:00
Vinod Kumar Vavilapalli
4b3948ea36 HADOOP-11776. Fixed the broken JDiff support in Hadoop 2. Contributed by Li Lu. 2015-04-04 13:52:01 -07:00
Vinod Kumar Vavilapalli
5370e7128b HADOOP-11377. Added Null.java without which jdiff completely flops. Contributed by Tsuyoshi Ozawa. 2015-04-04 13:47:08 -07:00
Colin Patrick Mccabe
932730df7d HADOOP-11785. Reduce the number of listStatus operation in distcp buildListing (Zoran Dimitrijevic via Colin P. McCabe) 2015-04-03 14:08:25 -07:00
Akira Ajisaka
228ae9aaa4 HADOOP-11800. Clean up some test methods in TestCodec.java. Contributed by Brahma Reddy Battula. 2015-04-04 00:32:18 +09:00
Allen Wittenauer
8d3c0f601d HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) 2015-04-02 20:50:36 -07:00
Wangda Tan
bad070fe15 YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda) 2015-04-02 17:23:20 -07:00
cnauroth
5763b173d3 HADOOP-9805. Refactor RawLocalFileSystem#rename for improved testability. Contributed by Jean-Pierre Matsumoto. 2015-04-02 16:13:00 -07:00
Allen Wittenauer
f383fd9b6c HADOOP-11731. Rework the changelog and releasenotes (aw) 2015-04-01 17:52:22 -07:00
Brandon Li
60ce825a71 HADOOP-11757. NFS gateway should shutdown when it can't start UDP or TCP server. Contributed by Brandon Li 2015-04-01 17:04:44 -07:00
Colin Patrick Mccabe
c94d594a57 HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe) 2015-04-01 14:10:10 -07:00
cnauroth
a3a96a07fa HADOOP-11787. OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac. Contributed by Kiran Kumar M R. 2015-04-01 11:40:09 -07:00
Colin Patrick Mccabe
d9ac5ee2c4 HADOOP-11660. Add support for hardware crc of HDFS checksums on ARM aarch64 architecture (Edward Nevill via Colin P. McCabe) 2015-03-30 13:55:02 -07:00
Haohui Mai
90e07d55ac HADOOP-11754. RM fails to start in non-secure mode due to authentication filter failure. Contributed by Haohui Mai. 2015-03-30 11:44:22 -07:00
Haohui Mai
82fa3adfd8 HADOOP-11761. Fix findbugs warnings in org.apache.hadoop.security.authentication. Contributed by Li Lu. 2015-03-30 11:08:54 -07:00
cnauroth
3836ad6c0b HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu. 2015-03-27 15:03:41 -07:00
Tsuyoshi Ozawa
e074952bd6 HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula. 2015-03-27 23:15:51 +09:00
cnauroth
af618f23a7 HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R. 2015-03-26 21:56:31 -07:00
Haohui Mai
47782cbf4a HADOOP-11748. The secrets of auth cookies should not be specified in configuration in clear text. Contributed by Li Lu and Haohui Mai. 2015-03-26 17:35:37 -07:00
Allen Wittenauer
5695c7a541 HADOOP-11553 addendum fix the typo in the changes file 2015-03-26 15:18:03 -07:00
Allen Wittenauer
b30ca8ce0e HADOOP-11553. Foramlize the shell API (aw) 2015-03-26 15:09:51 -07:00
Arpit Agarwal
3d0708bdb0 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:24:11 -07:00
Harsh J
b4b4fe9056 HADOOP-11719.[Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text. Contributed by Brahma Reddy Battula. 2015-03-26 11:29:54 +05:30
cnauroth
4528eb9fb2 HADOOP-11524. hadoop_do_classpath_subcommand throws a shellcheck warning. Contributed by Chris Nauroth. 2015-03-25 22:36:09 -07:00
Yongjun Zhang
44809b8081 HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) 2015-03-25 15:45:45 -07:00
Haohui Mai
e4b8d9e72d HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 11:12:42 -07:00
Tsuyoshi Ozawa
323945b33a HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. (ozawa) 2015-03-25 18:02:32 +09:00
Tsuyoshi Ozawa
b351086ff6 HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa) 2015-03-25 16:59:40 +09:00
Tsuyoshi Ozawa
5582b0f1d4 HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). Contributed by Walter Su. 2015-03-25 16:36:10 +09:00
Tsuyoshi Ozawa
3ca5bd1632 Fix CHANGES.txt for HADOOP-11602. 2015-03-24 21:06:26 +09:00
Tsuyoshi Ozawa
6e891a921e HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena. 2015-03-24 20:57:39 +09:00
Tsuyoshi Ozawa
0b9f12c847 HADOOP-11737. mockito's version in hadoop-nfs’ pom.xml shouldn't be specified. Contributed by Kengo Seki. 2015-03-23 13:56:24 +09:00
Karthik Kambatla
fe5c23b670 HADOOP-11447. Add a more meaningful toString method to SampleStat and MutableStat. (kasha) 2015-03-20 17:03:03 -07:00
Tsuyoshi Ozawa
43dde502b3 HADOOP-11709. Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variable. Contributed by Ajith S. 2015-03-21 00:54:20 +09:00
Tsuyoshi Ozawa
522c897146 HADOOP-11729. Fix link to cgroups doc in site.xml. Contributed by Masatake Iwasaki. 2015-03-19 23:08:18 +09:00
Haohui Mai
19b298f612 HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:31:59 -07:00
Colin Patrick Mccabe
bf6295bed8 HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe) 2015-03-18 19:14:21 -07:00
Akira Ajisaka
34117325b2 HADOOP-11659. o.a.h.FileSystem.Cache#remove should use a single hash map lookup. Contributed by Brahma Reddy Battula. 2015-03-18 15:43:10 +09:00