big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,517 Commits 2 Branches 2 Tags 264 MiB
9d62cdd680
Commit Graph

984 Commits

Author SHA1 Message Date
Aaron Myers
9d62cdd680 HDFS-4391. TestDataTransferKeepalive fails when tests are executed in a certain order. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455343 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 21:44:25 +00:00
Kihwal Lee
140076fb57 HDFS-4577. Webhdfs operations should declare if authentication is required. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454517 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 20:01:58 +00:00
Alejandro Abdelnur
a549d6fa2c HDFS-4571. WebHDFS should not set the service hostname on the server side. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454475 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 17:23:47 +00:00
Kihwal Lee
94a22114b9 HDFS-4567. Webhdfs does not need a token for token operations. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454460 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 16:56:34 +00:00
Suresh Srinivas
4909821aa9 HDFS-4569. Small image transfer related cleanups. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454233 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 03:37:21 +00:00
Daryn Sharp
8a4f03cb70 HDFS-4566. Webdhfs token cancelation should use authentication (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454059 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:58:04 +00:00
Suresh Srinivas
301079b4bf HDFS-4546. Use DFSUtil.getSpnegoKeytabKey() to get the spnego keytab key in secondary namenode and namenode http server. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454021 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:23:13 +00:00
Daryn Sharp
97c4668312 HDFS-4560. Webhdfs cannot use tokens obtained by another user (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453955 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 16:56:19 +00:00
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 19:15:18 +00:00
Suresh Srinivas
456064d899 HDFS-4544. Error in deleting blocks should not do check disk, for all types of errors. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453436 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 17:18:46 +00:00
Suresh Srinivas
a82e67af6c HDFS-4540. Namenode http server should use the web authentication keytab for spnego principal. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453025 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 21:47:22 +00:00
Kihwal Lee
97ccd64401 HDFS-4542. Webhdfs doesn't support secure proxy users. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452978 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 20:17:56 +00:00
Daryn Sharp
d8ca9c655b HDFS-4532. RPC call queue may fill due to current user lookup (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452435 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 18:36:30 +00:00
Daryn Sharp
cfa86e6110 HDFS-4128. 2NN gets stuck in inconsistent state if edit log replay fails in the middle (kihwal via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452384 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 16:44:23 +00:00
Suresh Srinivas
2e02b92664 HDFS-4518. Finer grained metrics for HDFS capacity. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451348 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 21:13:59 +00:00
Aaron Myers
7e2d98da40 HDFS-4235. When outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449984 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 00:44:52 +00:00
Aaron Myers
019d6a22b1 HDFS-4304. Make FSEditLogOp.MAX_OP_SIZE configurable. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449218 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-22 21:21:16 +00:00
Suresh Srinivas
cdb292f44c HDFS-4222. NN is unresponsive and loses heartbeats from DNs when configured to use LDAP and LDAP has issues. Contributed by Xiaobo Peng and Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448801 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 21:02:39 +00:00
Uma Maheswara Rao G
bf44d16ef4 HDFS-4482. ReplicationMonitor thread can exit with NPE due to the race between delete and replication of same file. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448708 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 16:25:12 +00:00
Tsz-wo Sze
567ab4335f HDFS-4502. JsonUtil.toFileStatus(..) should check if the fileId property exists. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448502 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 03:19:16 +00:00
Kihwal Lee
a9974c791a HDFS-4495. Allow client-side lease renewal to be retried beyond soft-limit. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445965 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 22:51:21 +00:00
Tsz-wo Sze
969e84decb HDFS-4342. Directories configured in dfs.namenode.edits.dir.required but not in dfs.namenode.edits.dir are silently ignored. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445006 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-12 00:50:00 +00:00
Aaron Myers
6f0c56cb95 HDFS-4471. Namenode WebUI file browsing does not work with wildcard addresses configured. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443807 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-08 00:28:00 +00:00
Tsz-wo Sze
90c3700c52 HDFS-4458. In DFSUtil.getNameServiceUris(..), convert default fs URI using NetUtils.createSocketAddr(..) for being consistent with other addresses. Contributed by Binglin Chang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443297 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 03:04:18 +00:00
Suresh Srinivas
4525c4a25b HDFS-4340. Update addBlock() to inculde inode id as additional argument. Contributed Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443169 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 19:52:34 +00:00
Tsz-wo Sze
e28edbffe1 HDFS-4468. Use the new StringUtils methods added by HADOOP-9252 and fix TestHDFSCLI and TestQuota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442824 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 01:13:16 +00:00
Aaron Myers
ef8dd606ab HDFS-4344. dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442465 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-05 04:07:31 +00:00
Aaron Myers
a8e39feed2 HDFS-4462. 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442375 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-04 21:29:39 +00:00
Suresh Srinivas
8590564dc5 HDFS-4350. Make enabling of stale marking on read and write paths independent. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441819 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 22:18:50 +00:00
Konstantin Shvachko
61a262757c HDFS-4452. getAdditionalBlock() can create multiple blocks if the client times out and retries. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441681 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-02 02:07:26 +00:00
Alejandro Abdelnur
bbdae834d2 HDFS-4456. Add concat to HttpFS and WebHDFS REST API docs. (plamenj2003 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441603 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-01 19:42:06 +00:00
Suresh Srinivas
6ecbb35019 HDFS-4151. hdfs balancer command returns exit code 1 on success instead of 0. Contributed by Joshua Blatt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441113 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 18:44:37 +00:00
Aaron Myers
e7380b4f9c HDFS-4428. FsDatasetImpl should disclose what the error is when a rename fails. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440865 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-31 07:29:46 +00:00
Konstantin Shvachko
481b6cccf0 HDFS-3598. WebHDFS support for file concat. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 06:51:57 +00:00
Kihwal Lee
8acfa66897 HDFS-4288. NN accepts incremental BR as IBR in safemode. contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440192 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 22:44:35 +00:00
Suresh Srinivas
58c0c6f069 HDFS-4444. Add space between total transaction time and number of transactions in FSEditLog#printStatistics. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439559 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 18:56:37 +00:00
Harsh J
9639f37ee2 HDFS-4259. Improve pipeline DN replacement failure message. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439126 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-27 17:42:25 +00:00
Tsz-wo Sze
86f6dfb338 HDFS-4443. Remove a trailing '`' character from the HTML code generated by NamenodeJspHelper.generateNodeData(..). Contributed by Christian Rohling 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438808 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-26 01:17:45 +00:00
Suresh Srinivas
a1e6df6bc4 HDFS-4426. Secondary namenode shuts down immediately after startup. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437627 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 19:00:39 +00:00
Todd Lipcon
cfae13306a HDFS-4403. DFSClient can infer checksum type when not provided by reading first byte. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436730 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 02:59:25 +00:00
Aaron Myers
d3d350ef0f HDFS-4359. Slow RPC responses from NN can prevent metrics collection on DNs. Contributed by liang xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435299 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 18:39:24 +00:00
Suresh Srinivas
8f70a25b1c HDFS-4393. Make empty request and responses in protocol translators can be static final members. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434844 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 18:21:29 +00:00
Todd Lipcon
5b0187dcd3 Revert r1433755: HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp. 
This commit caused TestBlockManager to fail.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433820 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 04:22:38 +00:00
Todd Lipcon
27d068b684 HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433755 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 00:09:54 +00:00
Eli Collins
e6dbad4f6f HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433275 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 03:25:12 +00:00
Suresh Srinivas
8767a37b9b HDFS-4375. Use token request messages defined in hadoop common. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433235 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:26:23 +00:00
Suresh Srinivas
6dbc7e03e5 HDFS-4369. GetBlockKeysResponseProto does not handle null response. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433206 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:13:27 +00:00
Suresh Srinivas
0671176111 HDFS-4364. GetLinkTargetResponseProto does not handle null path. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433194 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:01:39 +00:00
Todd Lipcon
3052ad1f00 HDFS-3429. DataNode reads checksums even if client does not need them. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433117 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 20:47:08 +00:00
Thomas Graves
e26da77544 HDFS-4385. Maven RAT plugin is not checking all source files (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432933 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 14:36:40 +00:00