big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,613 Commits 2 Branches 2 Tags 264 MiB
df801074c9
Commit Graph

761 Commits

Author SHA1 Message Date
Tsz-wo Sze
3cab01ba6e HADOOP-8700. Use enum to define the checksum constants in DataChecksum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-16 01:32:10 +00:00
Eli Collins
f75deca0f9 HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373664 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 22:43:01 +00:00
Todd Lipcon
d5abe22844 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373573 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 19:04:24 +00:00
Todd Lipcon
42cdc1b083 HDFS-3797. QJM: add segment txid as a parameter to journal() RPC. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373571 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 18:58:51 +00:00
Todd Lipcon
89153a9c68 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373567 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 18:53:13 +00:00
Tsz-wo Sze
9dff7876d9 HDFS-3802. StartupOption.name in HdfsServerConstants should be final. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373253 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 08:07:29 +00:00
Tsz-wo Sze
f41497c141 HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373193 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 02:23:21 +00:00
Todd Lipcon
c95a1674b6 HDFS-3799. QJM: handle empty log segments during recovery. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373183 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:57:24 +00:00
Todd Lipcon
4a9b3c693d HDFS-3798. Avoid throwing NPE when finalizeSegment() is called on invalid segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373179 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:54:49 +00:00
Todd Lipcon
160bfcd6c2 HDFS-3795. QJM: validate journal dir at startup. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373178 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:52:24 +00:00
Todd Lipcon
f765fdb657 HDFS-3793. Implement genericized format() in QJM. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373177 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:48:11 +00:00
Suresh Srinivas
6c96039693 HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373174 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:33:53 +00:00
Suresh Srinivas
28e87740c5 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:28:41 +00:00
Suresh Srinivas
231a52a7df Reverting previous incomplete change r1373170 for HDFS-3723 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373172 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:25:07 +00:00
Suresh Srinivas
f026d8bb1b HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373170 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:03:19 +00:00
Eli Collins
f98d8eb291 HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373094 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:59:54 +00:00
Daryn Sharp
f46b6ea55c HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373090 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:56:49 +00:00
Todd Lipcon
b38bd555e8 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 20:11:40 +00:00
Tsz-wo Sze
0c27c77080 HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372707 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 03:02:43 +00:00
Todd Lipcon
ab3ab17a43 HDFS-3792. Fix two findbugs introduced by HDFS-3695. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372690 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-14 00:52:10 +00:00
Todd Lipcon
4b67401565 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1372630 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:31:44 +00:00
Todd Lipcon
c93185df66 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372628 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:26:39 +00:00
Todd Lipcon
7aacfd5a08 HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372566 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 19:36:31 +00:00
Alejandro Abdelnur
4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:52:56 +00:00
Todd Lipcon
302f1e96ce Merge trunk into branch. 
Branch will not build after this commit: need to implement new JournalManager
interfaces in QuorumJournalManager in a follow-up.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1371518 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:29:36 +00:00
Todd Lipcon
9d0f8792a9 HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371513 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:13:54 +00:00
Aaron Myers
9ea7c06468 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371495 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 21:31:12 +00:00
Todd Lipcon
6dcf2e4815 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370937 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 20:15:40 +00:00
Aaron Myers
bc88c7b043 HDFS-3773. TestNNWithQJM fails after HDFS-3741. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370846 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 17:21:27 +00:00
Aaron Myers
34554d1e11 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370649 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 02:53:56 +00:00
Todd Lipcon
3a53ef4a80 HDFS-3741. Exhaustive failure injection test for skipped RPCs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370497 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 20:24:01 +00:00
Eli Collins
c12e994eda HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370495 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 20:17:59 +00:00
Aaron Myers
9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 16:40:03 +00:00
Alejandro Abdelnur
42d071ab6f HDFS-3756. DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368733 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-02 22:10:51 +00:00
Tsz-wo Sze
cb787968c5 HDFS-3667. Add retry support to WebHdfsFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367841 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 01:41:23 +00:00
Tsz-wo Sze
556be2af92 svn merge -c -1366601 for reverting HDFS-3667. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367407 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-31 04:33:59 +00:00
Todd Lipcon
e08604907c HDFS-3725. Fix QJM startup when individual JNs have gaps. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1367366 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 23:35:22 +00:00
Todd Lipcon
e1dff3df99 Merge trunk into QJM branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1367365 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-30 23:31:42 +00:00
Tsz-wo Sze
e4eec269d9 HDFS-3667. Add retry support to WebHdfsFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366601 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-28 05:57:47 +00:00
Daryn Sharp
cbd59c1c50 HDFS-3553. Hftp proxy tokens are broken (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366471 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 18:02:56 +00:00
Daryn Sharp
b3b72482e4 HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366440 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 16:39:51 +00:00
Aaron Myers
c1ea9b4490 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-27 00:26:21 +00:00
Tsz-wo Sze
8f395c2f78 HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations to get around a Java library bug causing OutOfMemoryError. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365839 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 23:37:25 +00:00
Todd Lipcon
972953bd77 HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:52:38 +00:00
Todd Lipcon
b17018e4b8 HDFS-3693. JNStorage should read its storage info even before a writer becomes active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365794 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:47:19 +00:00
Todd Lipcon
d2d0736de4 HDFS-3692. Support purgeEditLogs() call to remotely purge logs on JNs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365792 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:44:26 +00:00
Todd Lipcon
939f4a9f92 HDFS-3694. Fix getEditLogManifest to fetch httpPort if necessary. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365788 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-25 21:40:17 +00:00
Todd Lipcon
b7b8db51de HDFS-3697. Enable fadvise readahead by default. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364698 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-23 16:27:59 +00:00
Todd Lipcon
9833468302 HDFS-3597. SNN fails to start after DFS upgrade. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363899 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 18:58:58 +00:00
Todd Lipcon
74d4573a23 HDFS-3077. Quorum-based protocol for reading and writing edit logs. Contributed by Todd Lipcon based on initial work from Brandon Li and Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1363596 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-20 00:25:50 +00:00
Eli Collins
6383679872 HDFS-3690. BlockPlacementPolicyDefault incorrectly casts LOG. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363576 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-19 23:04:01 +00:00
Todd Lipcon
23b6ed973e HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363175 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 23:42:13 +00:00
Daryn Sharp
0a6806ce8c HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363170 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 23:21:30 +00:00
Tsz-wo Sze
6e56376023 HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362976 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 15:12:47 +00:00
Eli Collins
d61c5bcb0b Revert HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362760 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 05:11:01 +00:00
Eli Collins
6981b14003 Revert HDFS-3654. TestJspHelper#testGetUgi fails with NPE. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362759 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-18 05:05:50 +00:00
Eli Collins
527933f4f3 HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 21:26:58 +00:00
Todd Lipcon
6df36b58e1 HDFS-3625. Fix TestBackupNode by properly initializing edit log during startup. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362189 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 18:54:46 +00:00
Harsh J
0e8e499ff4 HDFS-3659. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361894 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 02:58:03 +00:00
Eli Collins
32d4c148df HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361463 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 01:07:57 +00:00
Eli Collins
06d635cd2c HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361449 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:18:56 +00:00
Harsh J
d9911e923d HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361059 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 07:20:27 +00:00
Eli Collins
4a5ba3b7bd HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 19:01:49 +00:00
Eli Collins
8ced7381a4 HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360485 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 00:12:15 +00:00
Eli Collins
cdae6953e8 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 17:58:02 +00:00
Aaron Myers
664ca6b75e HDFS-3615. Two BlockTokenSecretManager findbugs warnings. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360255 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 16:09:18 +00:00
Harsh J
2c27b5826d HDFS-3611. NameNode prints unnecessary WARNs about edit log normally skipping a few bytes. Contributed by Colin Patrick McCabe. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360001 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 03:37:07 +00:00
Harsh J
c81aed0271 HDFS-3613. GSet prints some INFO level values, which aren't really very useful to all. Contributed by Andrew Wang. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359999 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 03:15:03 +00:00
Harsh J
3b5ea87502 HDFS-3629. Fix the typo in the error message about inconsistent storage layout version. Contributed by Brandon Li. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359905 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 21:14:27 +00:00
Harsh J
e0f96aa249 HDFS-3555. idle client socket triggers DN ERROR log (should be INFO or DEBUG). Contributed by Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359619 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 11:52:13 +00:00
Eli Collins
21fdf16b0d HDFS-3548. NamenodeFsck.copyBlock fails to create a Block Reader. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358822 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 19:41:55 +00:00
Uma Maheswara Rao G
07295260b1 HDFS-3482. hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified without values. Contributed by Madhukara Phatak. 
Submitted by:	Madhukara Phatak.
Reviewed by:	Uma Maheswara Rao G.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358812 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 18:39:09 +00:00
Uma Maheswara Rao G
d4fb882163 HDFS-3541. Deadlock between recovery, xceiver and packet responder. Contributed by Vinay. 
Submitted by:	Vinay
Reviewed by:	Uma Maheswara Rao G


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358794 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 17:42:19 +00:00
Harsh J
e5b00f1bdc HDFS-2988. Improve error message when storage directory lock fails. Contributed by Miomir Boljanovic. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358683 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-08 00:36:38 +00:00
Aaron Myers
fb95fce240 Fix issue with NN/DN re-registration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358347 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-06 18:59:55 +00:00
Todd Lipcon
e0ef844280 HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357970 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 22:18:30 +00:00
Tsz-wo Sze
4d0cab2729 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-05 01:31:57 +00:00
Eli Collins
359b4efd19 HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356971 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 21:43:25 +00:00
Todd Lipcon
3728d16160 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356939 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:55:29 +00:00
Todd Lipcon
b8389e4c73 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-03 20:45:21 +00:00
Todd Lipcon
8dd3148e73 HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356525 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 23:59:41 +00:00
Todd Lipcon
7accbabdee HDFS-3573. Supply NamespaceInfo when instantiating JournalManagers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356388 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 18:21:49 +00:00
Tsz-wo Sze
28e8151ad3 HDFS-3157. Fix a bug in the case that the generation stamps of the stored block in a namenode and the reported block from a datanode do not match. Contributed by Ashish Singhi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356086 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-02 07:26:03 +00:00
Suresh Srinivas
19dd66a3f6 HDFS-3510. Editlog pre-allocation is performed prior to writing edits to avoid partial edits case disk out of space. Contributed by Collin McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355189 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 23:00:10 +00:00
Todd Lipcon
1d54e2b331 HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355174 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 21:46:12 +00:00
Eli Collins
550853203b HDFS-3475. Make the replication monitor multipliers configurable. Contributed by Harsh J Chouraria 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355089 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 17:54:52 +00:00
Tsz-wo Sze
f105784d6a svn merge -c -1354790 for reverting HDFS-3576 since it requires more changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354792 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 01:25:32 +00:00
Tsz-wo Sze
44389399d4 HDFS-3576. Move the definition of the constant NameNode.DEFAULT_PORT to DFSConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354790 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-28 01:11:22 +00:00
Todd Lipcon
5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 22:41:41 +00:00
Tsz-wo Sze
bf1649d5fd HDFS-3551. WebHDFS CREATE should use client location for HTTP redirection. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354316 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-27 02:51:39 +00:00
Eli Collins
0270889b4e HDFS-3535. Audit logging should log denied accesses. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354144 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-26 18:14:09 +00:00
Tsz-wo Sze
bbab35e6d8 HDFS-3498. Support replica removal in BlockPlacementPolicy and make BlockPlacementPolicyDefault extensible for reusing code in subclasses. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353807 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-26 03:25:47 +00:00
Tsz-wo Sze
361ea9a62c HDFS-3516. Check content-type in WebHdfsFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353800 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-26 01:58:13 +00:00
Scott Chun-Yang Chen
277b3dd736 MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351548 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-19 00:55:28 +00:00
Tsz-wo Sze
5572f73d45 HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350825 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-15 23:00:36 +00:00
Aaron Myers
9cabf93e7a HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349639 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 05:29:57 +00:00
Eli Collins
6702d5dbd4 HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349628 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 03:31:47 +00:00
Eli Collins
07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-13 02:42:52 +00:00
Alejandro Abdelnur
4d4661802e HDFS-3228. Move DelegationTokenRenewer to common (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 21:52:46 +00:00
Eli Collins
797c8548d0 Revert HADOOP-8491 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349133 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-12 06:22:06 +00:00