big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,212 Commits 2 Branches 2 Tags 264 MiB
6083e9cf8f
Commit Graph

1390 Commits

Author SHA1 Message Date
Tsz-wo Sze
2c15726999 HDFS-4270. Introduce soft and hard limits for max replication so that replications of the highest priority are allowed to choose a source datanode that has reached its soft limit but not the hard limit. Contributed by Derek Dagit 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428739 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 08:09:43 +00:00
Todd Lipcon
32052a1e3a HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428729 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 06:59:12 +00:00
Todd Lipcon
228de3c987 HDFS-4302. Fix fatal exception when starting NameNode with DEBUG logs. Contributed by Eugene Koontz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428590 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 20:55:05 +00:00
Tsz-wo Sze
36c5fe9961 HDFS-4346. Add SequentialNumber as a base class for INodeId and GenerationStamp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428167 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 05:12:40 +00:00
Aaron Myers
6f0eb6f5b1 HDFS-4338. TestNameNodeMetrics#testCorruptBlock is flaky. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428144 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 02:25:08 +00:00
Konstantin Shvachko
7b70a688ac HDFS-4349. Add test for reading files from BackupNode. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1427290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-01 03:39:31 +00:00
Konstantin Shvachko
df09a85ca9 HDFS-4347. Avoid infinite waiting checkpoint to complete in TestBackupNode. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426705 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-29 04:26:54 +00:00
Konstantin Shvachko
fc105796d1 HDFS-4308. addBlock() should persist file blocks once. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426700 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-29 04:11:58 +00:00
Tsz-wo Sze
0fa9c7a825 HDFS-4334. Add a unique id to INode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426429 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-28 08:26:33 +00:00
Arun Murthy
8a576d67a1 HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425560 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-24 00:14:59 +00:00
Arun Murthy
30cb35bd35 Reverting HDFS-4326 since it caused 'mvn package' to break. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425399 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-23 03:51:36 +00:00
Alejandro Abdelnur
b324a6134e HADOOP-8427. Convert Forrest docs to APT, incremental. (adi2 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424459 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-20 13:41:43 +00:00
Alejandro Abdelnur
4e73119e1a HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424062 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-19 20:00:03 +00:00
Aaron Myers
a1279e68bf HDFS-4140. fuse-dfs handles open(O_TRUNC) poorly. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423257 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 02:38:14 +00:00
Aaron Myers
721095474d HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422778 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-17 07:52:32 +00:00
Suresh Srinivas
3363c45d69 HDFS-4275. MiniDFSCluster-based tests fail on Windows due to failure to delete test namenode directory. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422278 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 15:50:52 +00:00
Suresh Srinivas
8aee71d1bc HDFS-4274. BlockPoolSliceScanner does not close verification log during shutdown. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422276 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 15:31:18 +00:00
Aaron Myers
f6f7152995 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421572 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-13 22:09:02 +00:00
Aaron Myers
23586e1ae5 HDFS-4310. fix test org.apache.hadoop.hdfs.server.datanode.TestStartSecureDataNode Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421560 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-13 21:45:15 +00:00
Sanjay Radia
cd80628ec4 HADOOP-8957 AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420965 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 20:54:30 +00:00
Suresh Srinivas
aa208941d1 HDFS-4296. Reserve layout version for release 1.2.0. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420700 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 14:26:15 +00:00
Suresh Srinivas
f31b8270db HDFS-4269. Datanode rejects all datanode registrations from localhost in single-node developer setup on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420492 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 00:14:26 +00:00
Tsz-wo Sze
99d072d072 svn -c -1419192 . for reverting HDFS-4261 since TestBalancerWithNodeGroup failed in the recent Jenkins builds. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420010 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 06:17:35 +00:00
Aaron Myers
47ae6831e9 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419949 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 00:52:17 +00:00
Aaron Myers
6e82da0dea HDFS-4294. Backwards compatibility is not maintained for TestVolumeId. Contributed by Ivan A. Veselovsky and Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419875 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 23:46:10 +00:00
Todd Lipcon
64cbb3c2ff HDFS-4295. Using port 1023 should be valid when starting Secure DataNode. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419854 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 22:46:46 +00:00
Todd Lipcon
cb9f516756 HDFS-4292. Sanity check not correct in RemoteBlockReader2.newBlockReader. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419675 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 19:13:03 +00:00
Todd Lipcon
8114bcc6d3 HDFS-4291. edit log unit tests leave stray test_edit_log_file around. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419663 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 18:54:59 +00:00
Uma Maheswara Rao G
103eff1fad HDFS-4130. BKJM: The reading for editlog at NN starting using bkjm is not efficient. Contributed by Han Xiao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419649 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 18:42:53 +00:00
Tsz-wo Sze
8f5bd5f1bc HDFS-4261. Fix bugs in Balancer that it does not terminate in some cases and it checks BlockPlacementPolicy instance incorrectly. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419192 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 03:31:34 +00:00
Aaron Myers
e7cb3fd39c HDFS-4279. NameNode does not initialize generic conf keys when started with -recover. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418559 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 23:52:08 +00:00
Sanjay Radia
ad619d34d0 HDFS-4260 Fix HDFS tests to set test dir to a valid HDFS path as opposed to the local build path (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418424 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 18:32:27 +00:00
Suresh Srinivas
e1ba3f8158 HDFS-4236. Remove artificial limit on username length introduced in HDFS-4171. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418356 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 15:23:49 +00:00
Todd Lipcon
6681523c87 HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418214 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 08:18:14 +00:00
Aaron Myers
df2fb006b2 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418114 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 22:27:27 +00:00
Konstantin Shvachko
8bb0dc34e4 HDFS-4268. Remove redundant enum NNHAStatusHeartbeat.State. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417752 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 07:20:20 +00:00
Todd Lipcon
adb8941cc2 HDFS-4238. Standby namenode should not do purging of shared storage edits. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417651 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 21:18:06 +00:00
Todd Lipcon
d6c50b4a67 Move QJM-related backports into 2.0.3 release section in CHANGES.txt after backport to branch-2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417601 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 19:33:05 +00:00
Aaron Myers
6cc49f1a8b HDFS-4199. Provide test for HdfsVolumeId. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417263 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 01:45:29 +00:00
Tsz-wo Sze
1f4b135b1f HDFS-4234. Use generic code for choosing datanode in Balancer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417130 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-04 19:22:51 +00:00
Tsz-wo Sze
c0a8957c2b HDFS-4243. When replacing an INodeDirectory, the parent pointers of the children of the child have to be updated to the new child. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416709 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 22:38:33 +00:00
Tsz-wo Sze
8f7c92094d HDFS-4240. For nodegroup-aware block placement, when a node is excluded, the nodes in the same nodegroup should also be excluded. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416691 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 21:59:36 +00:00
Konstantin Shvachko
cbed126eec HDFS-4231. BackupNode: Introduce BackupState. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416288 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-02 23:17:03 +00:00
Harsh J
5954e4f1ac HDFS-3358. Specify explicitly that the NN UI status total is talking of persistent objects on heap. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416245 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-02 20:05:54 +00:00
Tsz-wo Sze
88eea21572 HDFS-4248. Renaming directories may incorrectly remove the paths in leases under the tree. Contributed by daryn 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416064 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-01 22:29:54 +00:00
Daryn Sharp
64fe19e0d4 HDFS-4247. saveNamespace should be tolerant of dangling lease (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416034 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-01 18:18:58 +00:00
Tsz-wo Sze
571da54179 HDFS-4213. Add an API to hsync for updating the last block length at the namenode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415799 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:24:30 +00:00
Aaron Myers
d866f81edb Reverting initial commit of HDFS-3680 pending further comments. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415797 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:19:01 +00:00
Aaron Myers
a85a0293c7 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415794 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:11:24 +00:00
Tsz-wo Sze
6b08d7de5f HDFS-4242. Map.Entry is incorrectly used in LeaseManager since the behavior of it is undefined after the iteration or modifications of the map. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415480 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 02:51:25 +00:00