big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,296 Commits 2 Branches 2 Tags 264 MiB
89bd14913a
Commit Graph

948 Commits

Author SHA1 Message Date
Todd Lipcon
89bd14913a HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1436568 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-21 19:29:06 +00:00
Todd Lipcon
52c5b8ea9f HDFS-4418. increase default FileInputStreamCache size. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1434953 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 23:11:30 +00:00
Todd Lipcon
2f4e2c607e Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433249 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:42:06 +00:00
Todd Lipcon
2fd41b3b42 HDFS-4402. Some small DomainSocket fixes: avoid findbugs warning, change log level, etc. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433242 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:31:35 +00:00
Suresh Srinivas
8767a37b9b HDFS-4375. Use token request messages defined in hadoop common. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433235 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:26:23 +00:00
Suresh Srinivas
6dbc7e03e5 HDFS-4369. GetBlockKeysResponseProto does not handle null response. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433206 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:13:27 +00:00
Suresh Srinivas
0671176111 HDFS-4364. GetLinkTargetResponseProto does not handle null path. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433194 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:01:39 +00:00
Todd Lipcon
d08b1af26a HDFS-4400. DFSInputStream#getBlockReader: last retries should ignore the cache. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433144 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 21:34:22 +00:00
Todd Lipcon
12bf674e8e Merge trunk into branch. 
Fixed a couple trivial conflicts due to HDFS-4363, which moved some methods
from HdfsProtoUtil to PBHelper


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433133 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 21:12:16 +00:00
Todd Lipcon
3052ad1f00 HDFS-3429. DataNode reads checksums even if client does not need them. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433117 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 20:47:08 +00:00
Thomas Graves
e26da77544 HDFS-4385. Maven RAT plugin is not checking all source files (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432933 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 14:36:40 +00:00
Konstantin Shvachko
06406d7056 HDFS-1245. Plugable block id generation. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432539 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-13 01:13:29 +00:00
Todd Lipcon
9a4030e0e8 HDFS-4356. BlockReaderLocal should use passed file descriptors rather than paths. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432335 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 23:52:22 +00:00
Suresh Srinivas
bbc21ad5d4 HDFS-4381. Document fsimage format details in FSImageFormat class javadoc. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432149 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 16:57:12 +00:00
Aaron Myers
91c28d4409 HDFS-4328. TestLargeBlock#testLargeBlockSize is timing out. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431867 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 03:44:36 +00:00
Eli Collins
82b218c605 HDFS-4377. Some trivial DN comment cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431753 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 00:09:37 +00:00
Suresh Srinivas
be5509c537 HDFS-4382. Fix typo MAX_NOT_CHANGED_INTERATIONS. Contributed by Ted Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431726 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 23:20:46 +00:00
Suresh Srinivas
2bd35d8de3 HDFS-4367. GetDataEncryptionKeyResponseProto does not handle null response. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431459 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 16:03:37 +00:00
Eli Collins
6449f52455 HDFS-4032. Specify the charset explicitly rather than rely on the default. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431179 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 02:30:05 +00:00
Aaron Myers
7e599d9e3b HADOOP-9155. FsPermission should have different default value, 777 for directory and 666 for file. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431148 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 23:30:41 +00:00
Aaron Myers
3555e7c574 HDFS-4306. PBHelper.convertLocatedBlock miss convert BlockToken. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431117 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 22:29:41 +00:00
Todd Lipcon
d94621a0cd HDFS-4354. Create DomainSocket and DomainPeer and associated unit tests. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431102 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:37:34 +00:00
Todd Lipcon
c9db06f2e4 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431097 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:34:13 +00:00
Suresh Srinivas
3cd17b614e HDFS-4363. Combine PBHelper and HdfsProtoUtil and remove redundant methods. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431088 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:20:38 +00:00
Tsz-wo Sze
eae2a30462 HDFS-4261. Fix bugs in Balaner causing infinite loop and TestBalancerWithNodeGroup timeing out. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430917 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 15:55:49 +00:00
Tsz-wo Sze
fab2cbc2c1 svn merge -c -1428729 . for reverting HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430663 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 02:41:34 +00:00
Tsz-wo Sze
837e17b2ea svn merge -c -1430507 . for reverting HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430662 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 02:39:15 +00:00
Eli Collins
6d4a091567 HDFS-4034. Remove redundant null checks. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430585 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 22:38:36 +00:00
Eli Collins
5cdb7e5ce7 HDFS-4033. Miscellaneous findbugs 2 fixes. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430534 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 21:05:33 +00:00
Todd Lipcon
239b2742d0 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430507 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 20:44:09 +00:00
Eli Collins
43295b9f7b HDFS-4030. BlockManager excessBlocksCount and postponedMisreplicatedBlocksCount should be AtomicLongs. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430462 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 19:41:04 +00:00
Suresh Srinivas
18e731074e HDFS-4362. GetDelegationTokenResponseProto does not handle null token. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430137 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 04:28:45 +00:00
Aaron Myers
d3949058b8 HDFS-3970. Fix bug causing rollback of HDFS upgrade to result in bad VERSION file. Contributed by Vinay and Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430037 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 21:47:41 +00:00
Tsz-wo Sze
6a76ec14ad HDFS-4351. In BlockPlacementPolicyDefault.chooseTarget(..), numOfReplicas needs to be updated when avoiding stale nodes. Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429653 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 03:05:08 +00:00
Suresh Srinivas
251b485af5 HADOOP-9173. Add security token protobuf definition to common and use it in hdfs. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428972 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 16:49:49 +00:00
Tsz-wo Sze
2c15726999 HDFS-4270. Introduce soft and hard limits for max replication so that replications of the highest priority are allowed to choose a source datanode that has reached its soft limit but not the hard limit. Contributed by Derek Dagit 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428739 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 08:09:43 +00:00
Todd Lipcon
32052a1e3a HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428729 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 06:59:12 +00:00
Todd Lipcon
228de3c987 HDFS-4302. Fix fatal exception when starting NameNode with DEBUG logs. Contributed by Eugene Koontz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428590 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 20:55:05 +00:00
Tsz-wo Sze
36c5fe9961 HDFS-4346. Add SequentialNumber as a base class for INodeId and GenerationStamp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428167 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 05:12:40 +00:00
Konstantin Shvachko
7b70a688ac HDFS-4349. Add test for reading files from BackupNode. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1427290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-01 03:39:31 +00:00
Konstantin Shvachko
fc105796d1 HDFS-4308. addBlock() should persist file blocks once. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426700 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-29 04:11:58 +00:00
Tsz-wo Sze
0fa9c7a825 HDFS-4334. Add a unique id to INode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426429 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-28 08:26:33 +00:00
Aaron Myers
721095474d HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422778 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-17 07:52:32 +00:00
Suresh Srinivas
8aee71d1bc HDFS-4274. BlockPoolSliceScanner does not close verification log during shutdown. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422276 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 15:31:18 +00:00
Aaron Myers
f6f7152995 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421572 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-13 22:09:02 +00:00
Suresh Srinivas
aa208941d1 HDFS-4296. Reserve layout version for release 1.2.0. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420700 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 14:26:15 +00:00
Suresh Srinivas
f31b8270db HDFS-4269. Datanode rejects all datanode registrations from localhost in single-node developer setup on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420492 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 00:14:26 +00:00
Tsz-wo Sze
99d072d072 svn -c -1419192 . for reverting HDFS-4261 since TestBalancerWithNodeGroup failed in the recent Jenkins builds. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420010 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 06:17:35 +00:00
Aaron Myers
47ae6831e9 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419949 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 00:52:17 +00:00
Todd Lipcon
64cbb3c2ff HDFS-4295. Using port 1023 should be valid when starting Secure DataNode. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419854 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 22:46:46 +00:00