big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,639 Commits 2 Branches 2 Tags 264 MiB
77f7bfa9ef
Commit Graph

1192 Commits

Author SHA1 Message Date
Tsz-wo Sze
77f7bfa9ef HDFS-4556. Add snapshotdiff and LsSnapshottableDir tools to hdfs script. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1457712 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 11:36:59 +00:00
Suresh Srinivas
719c313be1 HDFS-4144. Create test for all snapshot-related metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455805 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 06:05:00 +00:00
Tsz-wo Sze
3b3ea5c422 HDFS-4563. Update namespace/diskspace usage after deleting snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455396 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 02:41:25 +00:00
Tsz-wo Sze
f35cd45811 Merge r1454237 through r1455388 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455390 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 01:58:43 +00:00
Suresh Srinivas
9daa958c5a HDFS-4572. Fix TestJournal failures on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455360 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 23:13:55 +00:00
Aaron Myers
9d62cdd680 HDFS-4391. TestDataTransferKeepalive fails when tests are executed in a certain order. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455343 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 21:44:25 +00:00
Tsz-wo Sze
43f8d0b9c9 HDFS-4574. Move Diff to the util package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454988 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 03:45:52 +00:00
Kihwal Lee
140076fb57 HDFS-4577. Webhdfs operations should declare if authentication is required. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454517 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 20:01:58 +00:00
Alejandro Abdelnur
a549d6fa2c HDFS-4571. WebHDFS should not set the service hostname on the server side. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454475 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 17:23:47 +00:00
Kihwal Lee
94a22114b9 HDFS-4567. Webhdfs does not need a token for token operations. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454460 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 16:56:34 +00:00
Suresh Srinivas
82230367ba Merging trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454238 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 04:13:41 +00:00
Suresh Srinivas
4909821aa9 HDFS-4569. Small image transfer related cleanups. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454233 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 03:37:21 +00:00
Tsz-wo Sze
8d95784bf1 HDFS-4557. Fix FSDirectory#delete when INode#cleanSubtree returns 0. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454138 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 22:34:51 +00:00
Daryn Sharp
8a4f03cb70 HDFS-4566. Webdhfs token cancelation should use authentication (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454059 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:58:04 +00:00
Suresh Srinivas
301079b4bf HDFS-4546. Use DFSUtil.getSpnegoKeytabKey() to get the spnego keytab key in secondary namenode and namenode http server. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454021 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:23:13 +00:00
Daryn Sharp
97c4668312 HDFS-4560. Webhdfs cannot use tokens obtained by another user (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453955 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 16:56:19 +00:00
Tsz-wo Sze
3145cf1ab2 Merge r1449958 through r1453659 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1453669 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 02:57:40 +00:00
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 19:15:18 +00:00
Suresh Srinivas
456064d899 HDFS-4544. Error in deleting blocks should not do check disk, for all types of errors. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453436 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 17:18:46 +00:00
Suresh Srinivas
56c7e7a12e HDFS-4519. Support overriding jsvc binary and log file locations when launching secure datanode. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453050 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 22:37:04 +00:00
Suresh Srinivas
a82e67af6c HDFS-4540. Namenode http server should use the web authentication keytab for spnego principal. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453025 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 21:47:22 +00:00
Kihwal Lee
97ccd64401 HDFS-4542. Webhdfs doesn't support secure proxy users. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452978 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 20:17:56 +00:00
Tsz-wo Sze
b1333e5b56 HDFS-4545. With snapshots, FSDirectory.unprotectedSetReplication(..) always changes file replication but it may or may not changes block replication. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1452636 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 02:23:34 +00:00
Suresh Srinivas
3ea26d3408 HDFS-4541. Set hadoop.log.dir and hadoop.id.str when starting secure datanode to write the logs to right dir by default. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452461 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 19:34:15 +00:00
Daryn Sharp
d8ca9c655b HDFS-4532. RPC call queue may fill due to current user lookup (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452435 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 18:36:30 +00:00
Daryn Sharp
cfa86e6110 HDFS-4128. 2NN gets stuck in inconsistent state if edit log replay fails in the middle (kihwal via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452384 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 16:44:23 +00:00
Suresh Srinivas
2e02b92664 HDFS-4518. Finer grained metrics for HDFS capacity. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451348 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 21:13:59 +00:00
Tsz-wo Sze
c7cf85ccb4 HDFS-4507. Update quota verification for snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1451081 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 03:08:08 +00:00
Tsz-wo Sze
e2a618e1cc HDFS-4523. Fix INodeFile replacement, TestQuota and javac errors from trunk merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1450477 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 22:04:35 +00:00
Aaron Myers
7e2d98da40 HDFS-4235. When outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449984 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 00:44:52 +00:00
Tsz-wo Sze
aa82b03823 Merge r1448505 through r1449957 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449976 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 00:10:17 +00:00
Tsz-wo Sze
59e968a114 HDFS-4514. Add CLI for supporting snapshot rename, diff report, and snapshottable directory listing. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449956 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-25 23:14:58 +00:00
Tsz-wo Sze
5ddbbd9d65 HDFS-4520. Support listing snapshots under a snapshottable directory using ls. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449862 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-25 19:49:05 +00:00
Tsz-wo Sze
0deff1727e HDFS-4524. Update SnapshotManager#snapshottables when loading fsimage. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449265 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-23 02:44:05 +00:00
Aaron Myers
019d6a22b1 HDFS-4304. Make FSEditLogOp.MAX_OP_SIZE configurable. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449218 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-22 21:21:16 +00:00
Aaron Myers
8271fae921 HADOOP-9267. hadoop -help, -h, --help should show usage instructions. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449161 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-22 18:36:24 +00:00
Suresh Srinivas
cdb292f44c HDFS-4222. NN is unresponsive and loses heartbeats from DNs when configured to use LDAP and LDAP has issues. Contributed by Xiaobo Peng and Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448801 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 21:02:39 +00:00
Uma Maheswara Rao G
bf44d16ef4 HDFS-4482. ReplicationMonitor thread can exit with NPE due to the race between delete and replication of same file. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448708 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 16:25:12 +00:00
Tsz-wo Sze
89d05b53d9 Merge r1446505 through r1448504 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1448505 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 03:30:10 +00:00
Tsz-wo Sze
f29fa9e820 HDFS-4499. Fix file/directory/snapshot deletion for file diff. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1448504 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 03:27:36 +00:00
Tsz-wo Sze
567ab4335f HDFS-4502. JsonUtil.toFileStatus(..) should check if the fileId property exists. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1448502 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 03:19:16 +00:00
Tsz-wo Sze
fac3883188 HDFS-4503. Update computeContentSummary(..), spaceConsumedInTree(..) and diskspaceConsumed(..) in INode for snapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1448373 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-20 20:02:24 +00:00
Tsz-wo Sze
14eaab6778 HDFS-4431. Support snapshot in OfflineImageViewer. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446993 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-17 02:58:31 +00:00
Suresh Srinivas
a9f6a27e93 Merge trunk to HDFS-2802 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446507 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-15 10:57:34 +00:00
Tsz-wo Sze
d9e2514d21 HDFS-4487. Fix snapshot diff report for HDFS-4446. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446385 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 23:07:49 +00:00
Tsz-wo Sze
d42d0860cb HDFS-4500. Refactor snapshot INode methods. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446355 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 22:00:36 +00:00
Tsz-wo Sze
02e6b72ae1 HDFS-4481. Change fsimage to support snapshot file diffs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446000 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 00:43:28 +00:00
Kihwal Lee
a9974c791a HDFS-4495. Allow client-side lease renewal to be retried beyond soft-limit. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445965 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 22:51:21 +00:00
Tsz-wo Sze
969e84decb HDFS-4342. Directories configured in dfs.namenode.edits.dir.required but not in dfs.namenode.edits.dir are silently ignored. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445006 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-12 00:50:00 +00:00
Tsz-wo Sze
fa8bafbd46 Merge r1441206 through r1444434 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1444439 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-09 21:29:44 +00:00