big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9,143 Commits 2 Branches 2 Tags 264 MiB
86ac0d40b8
Commit Graph

3634 Commits

Author SHA1 Message Date
cnauroth
9b8a35aff6 HDFS-7128. Decommission slows way down when it gets towards the end. Contributed by Ming Ma. 2014-10-07 15:01:09 -07:00
Andrew Wang
0263656247 Fixup for CHANGES.txt 2014-10-07 14:58:57 -07:00
Kihwal Lee
99d7a452be HADOOP-11007. Reinstate building of ant tasks support. Contributed by 
Jason Lowe.
 2014-10-07 16:20:16 -05:00
Colin Patrick Mccabe
8dc6abf2f4 HDFS-7194 Fix findbugs "inefficient new String constructor" warning in DFSClient#PATH (yzhang via cmccabe) 2014-10-06 15:29:09 -07:00
Tsz-Wo Nicholas Sze
3affad9ebd HDFS-7169. Add SE_BAD_FIELD to findbugsExcludeFile.xml. 2014-10-06 13:29:56 -07:00
Vinayakumar B
ed841dd9a9 HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb) 2014-10-06 14:31:15 +05:30
Colin Patrick Mccabe
7f6ed7fe36 HDFS-7055. Add tracing to DFSInputStream (cmccabe) 2014-10-03 13:35:43 -07:00
Andrew Wang
6ac10516e7 HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang) 2014-10-02 13:51:08 -07:00
Andrew Wang
d2d5a0ea03 HDFS-7179. DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtension. (wang) 2014-10-02 13:50:05 -07:00
Colin Patrick Mccabe
a56f3ecf86 HDFS-7162. Fix CHANGES.txt (should have Chenging Liu's name) 2014-10-02 12:45:54 -07:00
Colin Patrick Mccabe
03db9cc839 HDFS-7162. Wrong path when deleting through fuse-dfs a file which already exists in trash (cmccabe) 2014-10-02 12:42:19 -07:00
arp
c2fa5d1c42 HDFS-7178. Additional unit test for replica write with full disk. (Arpit Agarwal) 2014-10-02 09:28:26 -07:00
Haohui Mai
8dfe54f6d3 Addendum patch for HDFS-7172. Contributed by Chris Nauroth. 2014-10-01 16:09:30 -07:00
Colin Patrick Mccabe
dd1b8f2ed8 HDFS-7176. The namenode usage message doesn't include "-rollingupgrade started" (cmccabe) 2014-10-01 14:53:44 -07:00
Haohui Mai
875aa797ca HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li. 2014-10-01 13:18:56 -07:00
Haohui Mai
1f5b42ac48 HDFS-7158. Reduce the memory usage of WebImageViewer. Contributed by Haohui Mai. 2014-10-01 10:53:38 -07:00
Haohui Mai
737f280dde HDFS-7172. Test data files may be checked out of git with incorrect line endings, causing test failures in TestHDFSCLI. Contributed by Chris Nauroth. 2014-10-01 10:46:33 -07:00
arp
04b08431a3 HDFS-6581. Update CHANGES.txt in preparation for trunk merge 2014-10-01 09:01:08 -07:00
arp
e431d054cb Merge branch 'trunk' into HDFS-6581 2014-10-01 08:52:21 -07:00
Kihwal Lee
3f25d916d5 HDFS-6754. TestNamenodeCapacityReport.testXceiverCount may sometimes fail due to lack of retry. Contributed by Mit Desai. 2014-10-01 09:53:01 -05:00
arp
a45ad330fa HDFS-7171. Fix Jenkins failures in HDFS-6581 branch. (Arpit Agarwal) 2014-09-30 18:25:20 -07:00
arp
65ef35bbab Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/resources/editsStored.xml
 2014-09-30 18:20:13 -07:00
arp
9e9e9cf711 HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal) 2014-09-30 18:10:13 -07:00
arp
dde2ed13c2 Merge branch 'trunk' into HDFS-6581 2014-09-30 18:05:54 -07:00
Jing Zhao
cdf1af0e5a HDFS-7167. NPE while running Mover if the given path is for a file. Contributed by Jing Zhao. 2014-09-30 11:13:35 -07:00
Arun C. Murthy
ea32a66f7d Preparing to branch hadoop-2.6 2014-09-30 10:26:42 -07:00
arp
5e8b697352 HDFS-7129. Metrics to track usage of memory for writes. (Contributed by Xiaoyu Yao) 2014-09-30 00:53:18 -07:00
arp
bb84f1fccb HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal) 2014-09-29 22:27:59 -07:00
arp
368e2423a5 Merge branch 'trunk' into HDFS-6581 2014-09-29 20:09:06 -07:00
Haohui Mai
0577eb32fc HDFS-6779. Add missing version subcommand for hdfs. Contributed by Sasaki Toru. 2014-09-29 18:10:47 -07:00
arp
7f0422be76 Merge branch 'trunk' into HDFS-6581 2014-09-29 16:29:43 -07:00
Andrew Wang
c6c3247dc0 HDFS-7122. Use of ThreadLocal<Random> results in poor block placement. (wang) 2014-09-29 15:00:26 -07:00
Andrew Wang
7f0efe96f8 HDFS-7124. Remove EncryptionZoneManager.NULL_EZ. (clamb via wang) 2014-09-29 14:14:22 -07:00
arp
1e6b4b9b2e Merge branch 'trunk' into HDFS-6581 2014-09-29 14:01:47 -07:00
Andrew Wang
a45b331cc9 Move HDFS-7157 to HDFS CHANGES.txt 2014-09-29 13:17:21 -07:00
Andrew Wang
f0293f11a8 HDFS-7104. Fix and clarify INodeInPath getter functions. Contributed by Zhe Zhang. 2014-09-29 12:58:37 -07:00
arp
d45e7c7e85 HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal) 2014-09-29 12:36:27 -07:00
Andrew Wang
371ef4cefc Move HDFS-4165 from trunk to 2.6.0 in CHANGES.txt. 2014-09-29 11:06:44 -07:00
Allen Wittenauer
84b9c632bf HDFS-4227. Document dfs.namenode.resource.* (Daisuke Kobayashi via aw) 2014-09-29 09:01:43 -07:00
Allen Wittenauer
9829f9fa58 HDFS-6519. Document oiv_legacy command (Akira AJISAKA via aw) 2014-09-29 08:51:41 -07:00
arp
9a53c3699b Merge branch 'trunk' into HDFS-6581 2014-09-28 20:42:56 -07:00
arp
b38e52b5e8 HDFS-7093. Add config key to restrict setStoragePolicy. (Arpit Agarwal) 2014-09-28 19:28:51 -07:00
Konstantin V Shvachko
400e1bb4ef HDFS-7156. Update fsck documentation. Contributed by Masahiro Yamaguch. 2014-09-27 21:04:23 -07:00
arp
d96396627f Merge branch 'trunk' into HDFS-6581 2014-09-26 16:31:08 -07:00
arp
a2d4edacea HDFS-7155. Bugfix in createLocatedFileStatus caused by bad merge. (Arpit Agarwal) 2014-09-26 16:30:47 -07:00
Allen Wittenauer
3a1f981686 HDFS-6664. HDFS permissions guide documentation states incorrect default group mapping class. (Ray Chiang via aw) 2014-09-26 12:20:40 -07:00
arp
7060502edb Merge branch 'trunk' into HDFS-6581 2014-09-26 11:09:03 -07:00
Colin Patrick Mccabe
55302ccfba HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe) 2014-09-26 10:30:30 -07:00
Tsz-Wo Nicholas Sze
a6049aa994 CHANGES.txt: move HDFS-6584 and its subtasks to Release 2.6.0. 2014-09-26 23:51:00 +08:00
Andrew Wang
840825d819 Add HDFS-7148 to CHANGES.txt, branch-2 only commit. 2014-09-25 21:50:24 -07:00
arp
263977969b Fix test build break after merging from trunk 2014-09-25 20:29:24 -07:00
arp
032e0eba6b Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-25 19:50:28 -07:00
Andrew Wang
e96ce6f3e3 HDFS-7077. Separate CipherSuite from crypto protocol version. (wang) 2014-09-25 18:40:40 -07:00
Jing Zhao
e9c37de485 HDFS-7131. During HA upgrade, JournalNode should create a new committedTxnId file in the current directory. Contributed by Jing Zhao. 2014-09-25 17:15:33 -07:00
cnauroth
9f9a2222a2 HDFS-7119. Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics. Contributed by Chris Nauroth. 2014-09-25 13:33:37 -07:00
Colin Patrick Mccabe
1861b32eb5 HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe) 2014-09-25 13:11:59 -07:00
arp
5a5a7da3a3 Merge branch 'trunk' into HDFS-6581 2014-09-25 12:55:59 -07:00
cnauroth
b607c3c363 HDFS-7127. TestLeaseRecovery leaks MiniDFSCluster instances. Contributed by Chris Nauroth. 2014-09-25 11:24:31 -07:00
cnauroth
dc2ebf88a8 HDFS-7111. TestSafeMode assumes Unix line endings in safe mode tip. Contributed by Chris Nauroth. 2014-09-25 11:17:46 -07:00
arp
364e60b169 HDFS-7144. Fix findbugs warnings in RamDiskReplicaTracker. (Contributed by Tsz Wo Nicholas Sze) 2014-09-25 11:14:24 -07:00
arp
e9edafc731 Merge branch 'trunk' into HDFS-6581 2014-09-25 11:06:25 -07:00
cnauroth
e0b1dc514f HDFS-7118. Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename. Contributed by Chris Nauroth. 2014-09-25 10:03:59 -07:00
arp
e8e7fbe81a HDFS-6932. Balancer and Mover tools should ignore replicas on RAM_DISK. (Contributed by Xiaoyu Yao) 2014-09-24 21:08:59 -07:00
arp
feda4733a8 HDFS-7143. Fix findbugs warnings in HDFS-6581 branch. (Contributed by Tsz Wo Nicholas Sze) 2014-09-24 21:06:56 -07:00
arp
b1000fbba4 Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
 2014-09-24 20:08:32 -07:00
Jing Zhao
428a76663a HDFS-7140. Add a tool to list all the existing block storage policies. Contributed by Jing Zhao. 2014-09-24 19:11:16 -07:00
Andrew Wang
116f83157a Add branch-2 only commit HDFS-7138 to CHANGES.txt 2014-09-24 16:47:09 -07:00
Andrew Wang
63198bfba7 HDFS-7139. Unit test for creating encryption zone on root path. (Zhe Zhang via wang) 2014-09-24 16:40:20 -07:00
Andrew Wang
9fa5a89be3 Move HDFS-6987 from trunk to branch-2 in CHANGES.txt 2014-09-24 12:11:58 -07:00
Jing Zhao
073bbd805c HDFS-7081. Add new DistributedFileSystem API for getting all the existing storage policies. Contributed by Jing Zhao. 2014-09-24 10:05:40 -07:00
Allen Wittenauer
cb74f39697 HDFS-6534. Fix build on macosx: HDFS parts (Binglin Chang via aw) 2014-09-24 08:22:02 -07:00
arp
bfc7b7e6a0 Merge branch 'trunk' into HDFS-6581 2014-09-23 16:40:35 -07:00
cnauroth
b93d9603a2 HDFS-7130. TestDataTransferKeepalive fails intermittently on Windows. Contributed by Chris Nauroth. 2014-09-23 14:35:33 -07:00
Andrew Wang
f48686a1ad HDFS-7132. hdfs namenode -metadataVersion command does not honor configured name dirs. Contributed by Charles Lamb. 2014-09-23 14:10:02 -07:00
Allen Wittenauer
3dc28e2052 HADOOP-11092. hadoop shell commands should print usage if not given a class (aw) 2014-09-23 12:24:23 -07:00
cnauroth
a1fd804a31 HDFS-7126. TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao. 2014-09-23 08:21:46 -07:00
arp
8b139b0800 HDFS-6990. Add unit test for evict/delete RAM_DISK block with open handle. (Contributed by Xiaoyu Yao) 2014-09-22 18:10:28 -07:00
arp
889122bd55 Merge branch 'trunk' into HDFS-6581 2014-09-22 18:00:58 -07:00
Colin Patrick Mccabe
7b8df93ce1 HDFS-7001. Tests in TestTracing should not depend on the order of execution. (iwasakims via cmccabe) 2014-09-22 17:21:58 -07:00
Colin Patrick Mccabe
912ad32b03 HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe) 2014-09-22 11:51:31 -07:00
cnauroth
26cba7f35f HDFS-7115. TestEncryptionZones assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao. 2014-09-22 09:07:07 -07:00
Andrew Wang
1737950d0f HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. Contributed by Zhe Zhang. 2014-09-21 21:29:46 -07:00
cnauroth
b6fd5ccbce HDFS-7110. Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read. Contributed by Chris Nauroth. 2014-09-21 12:36:57 -07:00
cnauroth
0795fe3721 HDFS-7109. TestDataStorage does not release file locks between tests. Contributed by Chris Nauroth. 2014-09-20 21:01:13 -07:00
cnauroth
47491f9a11 HDFS-7107. Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris Nauroth. 2014-09-20 20:53:09 -07:00
arp
8c9860f7c9 HDFS-7071. Undo accidental commit of binary file editsStored. 2014-09-20 17:11:11 -07:00
arp
486a76a39b HDFS-7071. Updated editsStored and editsStored.xml to bump layout version and add LazyPersist flag. (Contributed by Xiaoyu Yao and Arpit Agarwal) 2014-09-20 16:58:58 -07:00
arp
e257b6dbb1 Merge branch 'trunk' into HDFS-6581 2014-09-20 16:13:17 -07:00
arp
50b321068d HDFS-7108. Fix unit test failures in SimulatedFsDataset. (Arpit Agarwal) 2014-09-20 16:12:17 -07:00
Jing Zhao
84a0a629d3 HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. Contributed by Jing Zhao. 2014-09-20 13:44:53 -07:00
arp
b2d5ed36bc HDFS-7100. Make eviction scheme pluggable. (Arpit Agarwal) 2014-09-20 13:25:23 -07:00
arp
09dab88d3e Merge branch 'trunk' into HDFS-6581 2014-09-20 10:34:45 -07:00
cnauroth
f85cc14eb4 HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth. 2014-09-19 21:23:26 -07:00
cnauroth
332e2e23ba HDFS-7105. Fix TestJournalNode#testFailToStartWithBadConfig to match log output change. Contributed by Ray Chiang. 2014-09-19 21:04:55 -07:00
Kihwal Lee
9e35571965 HDFS-7046. HA NN can NPE upon transition to active. Contributed by 
Kihwal Lee.
 2014-09-19 17:07:06 -05:00
arp
222bf0fe67 Merge branch 'trunk' into HDFS-6581 2014-09-19 10:02:27 -07:00
Colin Patrick Mccabe
25fd69a8f9 HDFS-7096. Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI (clamb via cmccabe) 2014-09-19 09:20:25 -07:00
Kihwal Lee
bf27b9ca57 HDFS-7065. Pipeline close recovery race can cause block corruption. 
Contributed by Kihwal Lee.
 2014-09-19 09:00:13 -05:00
Kihwal Lee
f02d934fed HDFS-6948. DN rejects blocks if it has older UC block. Contributed by 
Eric Payne.
 2014-09-19 08:50:43 -05:00
arp
f8bbf80067 Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsLocatedFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2014-09-18 22:26:42 -07:00