1144 Commits

Author	SHA1	Message	Date
Todd Lipcon	e9f4de5ced	Merge trunk into branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387449 13f79535-47bb-0310-9956-ffa450edef68	2012-09-19 04:34:55 +00:00
Alejandro Abdelnur	9f6cfe32e4	HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387298 13f79535-47bb-0310-9956-ffa450edef68	2012-09-18 18:15:37 +00:00
Eli Collins	a8e4bb81b2	HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387278 13f79535-47bb-0310-9956-ffa450edef68	2012-09-18 17:42:09 +00:00
Eli Collins	ea6a36e2e7	HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387273 13f79535-47bb-0310-9956-ffa450edef68	2012-09-18 17:32:01 +00:00
Eli Collins	7e3776ca6e	HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387255 13f79535-47bb-0310-9956-ffa450edef68	2012-09-18 16:59:47 +00:00
Todd Lipcon	83c14fbd24	HDFS-3943. QJM: remove currently-unused md5sum field. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1386863 13f79535-47bb-0310-9956-ffa450edef68	2012-09-17 21:51:40 +00:00
Eli Collins	4d2e77bc1c	Revert previous commit - accidentally included two changes. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386783 13f79535-47bb-0310-9956-ffa450edef68	2012-09-17 19:28:14 +00:00
Eli Collins	8a9debd0ef	HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386780 13f79535-47bb-0310-9956-ffa450edef68	2012-09-17 19:25:05 +00:00
Todd Lipcon	40d56f1741	HDFS-3894. QJM: testRecoverAfterDoubleFailures can be flaky due to IPC client caching. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1384592 13f79535-47bb-0310-9956-ffa450edef68	2012-09-13 23:00:22 +00:00
Suresh Srinivas	d543140089	HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384209 13f79535-47bb-0310-9956-ffa450edef68	2012-09-13 05:46:18 +00:00
Eli Collins	4f312cfa70	HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384092 13f79535-47bb-0310-9956-ffa450edef68	2012-09-12 19:15:38 +00:00
Eli Collins	2ba149f85c	HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68	2012-09-12 18:36:01 +00:00
Eli Collins	f0c3ed79dd	HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383759 13f79535-47bb-0310-9956-ffa450edef68	2012-09-12 04:21:31 +00:00
Eli Collins	dc1fd84bd1	HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68	2012-09-11 21:24:12 +00:00
Todd Lipcon	a93ba1648a	HDFS-3840. JournalNodes log JournalNotFormattedException backtrace error before being formatted. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383252 13f79535-47bb-0310-9956-ffa450edef68	2012-09-11 06:33:47 +00:00
Todd Lipcon	8a8c9c18d3	HDFS-3906. QJM: quorum timeout on failover with large log segment. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383251 13f79535-47bb-0310-9956-ffa450edef68	2012-09-11 06:31:42 +00:00
Todd Lipcon	959afc0fd3	HDFS-3901. QJM: send 'heartbeat' messages to JNs even when they are out-of-sync. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383137 13f79535-47bb-0310-9956-ffa450edef68	2012-09-10 22:30:52 +00:00
Todd Lipcon	60c20e559b	HDFS-3900. QJM: avoid validating log segments on log rolls. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383041 13f79535-47bb-0310-9956-ffa450edef68	2012-09-10 18:53:41 +00:00
Todd Lipcon	ca4582222e	HDFS-3885. QJM: optimize log sync when JN is lagging behind. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383039 13f79535-47bb-0310-9956-ffa450edef68	2012-09-10 18:51:15 +00:00
Todd Lipcon	aa65777ef0	HDFS-3898. QJM: enable TCP_NODELAY for IPC. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383033 13f79535-47bb-0310-9956-ffa450edef68	2012-09-10 18:46:58 +00:00
Eli Collins	e1ffefa860	HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68	2012-09-10 18:46:13 +00:00
Todd Lipcon	1cea56d6ef	Merge trunk into QJM branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383030 13f79535-47bb-0310-9956-ffa450edef68	2012-09-10 18:45:45 +00:00
Aaron Myers	16234cbd5f	HDFS-3897. QJM: TestBlockToken fails after HDFS-3893. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381842 13f79535-47bb-0310-9956-ffa450edef68	2012-09-07 02:01:21 +00:00
Aaron Myers	df801074c9	HDFS-3893. QJM: Make QJM work with security enabled. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381770 13f79535-47bb-0310-9956-ffa450edef68	2012-09-06 21:42:14 +00:00
Daryn Sharp	82b981cca4	HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381606 13f79535-47bb-0310-9956-ffa450edef68	2012-09-06 14:06:58 +00:00
Todd Lipcon	cae8116a14	HDFS-3726. If a logger misses an RPC, don't retry that logger until next segment. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381482 13f79535-47bb-0310-9956-ffa450edef68	2012-09-06 07:03:57 +00:00
Todd Lipcon	437948ea1c	HDFS-3891. Make selectInputStreams throw IOE instead of RTE. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381481 13f79535-47bb-0310-9956-ffa450edef68	2012-09-06 06:57:18 +00:00
Eli Collins	01db4d2bb2	HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381472 13f79535-47bb-0310-9956-ffa450edef68	2012-09-06 06:19:30 +00:00
Eli Collins	91e832e7b4	HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68	2012-09-05 19:42:09 +00:00
Todd Lipcon	99ec5bd8d3	Merge trunk into QJM branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380990 13f79535-47bb-0310-9956-ffa450edef68	2012-09-05 04:57:47 +00:00
Todd Lipcon	31142aa892	HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380988 13f79535-47bb-0310-9956-ffa450edef68	2012-09-05 04:53:15 +00:00
Todd Lipcon	c334cc89a8	HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380982 13f79535-47bb-0310-9956-ffa450edef68	2012-09-05 04:40:23 +00:00
Todd Lipcon	13daca1ef6	HDFS-3870. Add metrics to JournalNode. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380980 13f79535-47bb-0310-9956-ffa450edef68	2012-09-05 04:30:51 +00:00
Todd Lipcon	f6b7f067c3	HDFS-3884. Journal format() should reset cached values. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380979 13f79535-47bb-0310-9956-ffa450edef68	2012-09-05 04:27:49 +00:00
Todd Lipcon	72485f3112	HDFS-3869. Expose non-file journal manager details in web UI. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380978 13f79535-47bb-0310-9956-ffa450edef68	2012-09-05 04:16:02 +00:00
Todd Lipcon	8021d9199f	HDFS-3863. Track last "committed" txid in QJM. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380976 13f79535-47bb-0310-9956-ffa450edef68	2012-09-05 04:13:19 +00:00
Tsz-wo Sze	f3927595cc	HDFS-3887. Remove redundant chooseTarget methods in BlockPlacementPolicy. Contributed by Jing Zhao ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380934 13f79535-47bb-0310-9956-ffa450edef68	2012-09-04 23:48:01 +00:00
Suresh Srinivas	da3bd67138	HDFS-3880. Use Builder to build RPC server in HDFS. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379917 13f79535-47bb-0310-9956-ffa450edef68	2012-09-02 06:20:41 +00:00
Daryn Sharp	94c69f2c82	HDFS-3852. TestHftpDelegationToken is broken after HADOOP-8225 (daryn) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379623 13f79535-47bb-0310-9956-ffa450edef68	2012-08-31 21:31:55 +00:00
Daryn Sharp	3819c964fa	HDFS-3873. Hftp assumes security is disabled if token fetch fails (daryn) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379615 13f79535-47bb-0310-9956-ffa450edef68	2012-08-31 21:24:48 +00:00
Suresh Srinivas	2fd49f5a57	HDFS-3833. TestDFSShell fails on windows due to concurrent file read/write. Contributed by Brandon Li ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379525 13f79535-47bb-0310-9956-ffa450edef68	2012-08-31 17:43:35 +00:00
Eli Collins	7d1c8d92f9	HDFS-3733. Audit logs should include WebHDFS access. Contributed by Andy Isaacson ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379278 13f79535-47bb-0310-9956-ffa450edef68	2012-08-31 04:08:23 +00:00
Aaron Myers	b2d186d865	HDFS-3864. NN does not update internal file mtime for OP_CLOSE when reading from the edit log. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378413 13f79535-47bb-0310-9956-ffa450edef68	2012-08-29 01:19:07 +00:00
Aaron Myers	d4d2bf73a9	HDFS-3849. When re-loading the FSImage, we should clear the existing genStamp and leases. Contributed by Colin Patrick McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378364 13f79535-47bb-0310-9956-ffa450edef68	2012-08-28 22:09:27 +00:00
Todd Lipcon	1e68d4726b	HDFS-3845. Fixes for edge cases in QJM recovery protocol. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1377809 13f79535-47bb-0310-9956-ffa450edef68	2012-08-27 19:55:01 +00:00
Suresh Srinivas	deead78e35	HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68	2012-08-25 01:03:22 +00:00
Eli Collins	a11042365f	HDFS-3731. 2.0 release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377137 13f79535-47bb-0310-9956-ffa450edef68	2012-08-24 22:10:38 +00:00
Aaron Myers	a8ff292669	Merge trunk into HDFS-3077 branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1377092 13f79535-47bb-0310-9956-ffa450edef68	2012-08-24 20:38:08 +00:00
Aaron Myers	92cb6b093c	HDFS-3678. Edit log files are never being purged from 2NN. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377046 13f79535-47bb-0310-9956-ffa450edef68	2012-08-24 18:52:59 +00:00
Tsz-wo Sze	c46de830da	HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation. Contributed by Kihwal Lee ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376928 13f79535-47bb-0310-9956-ffa450edef68	2012-08-24 14:15:14 +00:00
Eli Collins	26c259a638	Ammend previous commit to remove TestFileCreationNamenodeRestart. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376698 13f79535-47bb-0310-9956-ffa450edef68	2012-08-23 21:02:57 +00:00
Eli Collins	6885d03501	HDFS-3715. Fix TestFileCreation#testFileCreationNamenodeRestart. Contributed by Andrew Whang ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376689 13f79535-47bb-0310-9956-ffa450edef68	2012-08-23 20:49:55 +00:00
Aaron Myers	de8b34a70e	HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376188 13f79535-47bb-0310-9956-ffa450edef68	2012-08-22 18:47:07 +00:00
Jitendra Nath Pandey	901b1739c6	HDFS-3819. Should check whether invalidate work percentage default value is not greater than 1.0f. Contributed by Jing Zhao. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376185 13f79535-47bb-0310-9956-ffa450edef68	2012-08-22 18:44:44 +00:00
Suresh Srinivas	557b937f47	HDFS-3827. TestHASafeMode#assertSafemode method should be made static. Contributed by Jing Zhao ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375828 13f79535-47bb-0310-9956-ffa450edef68	2012-08-21 22:25:49 +00:00
Suresh Srinivas	6c0ccb5989	HDFS-2686. Remove DistributedUpgrade related code. Contributed by Suresh Srinivas ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375800 13f79535-47bb-0310-9956-ffa450edef68	2012-08-21 21:18:40 +00:00
Eli Collins	97bb7b180e	HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375336 13f79535-47bb-0310-9956-ffa450edef68	2012-08-21 00:00:33 +00:00
Tsz-wo Sze	b0ea77303b	HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374696 13f79535-47bb-0310-9956-ffa450edef68	2012-08-19 05:46:57 +00:00
Suresh Srinivas	086c855198	HDFS-3816. Invalidate work percentage default value should be 0.32f. Contributed by Jing Zhao ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374645 13f79535-47bb-0310-9956-ffa450edef68	2012-08-18 19:50:15 +00:00
Eli Collins	18c5bc86ca	HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374472 13f79535-47bb-0310-9956-ffa450edef68	2012-08-17 23:22:17 +00:00
Aaron Myers	fccace6116	HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374355 13f79535-47bb-0310-9956-ffa450edef68	2012-08-17 16:52:07 +00:00
Daryn Sharp	8fa10b184e	HADOOP-7967. Need generalized multi-token filesystem support (daryn) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68	2012-08-17 14:05:11 +00:00
Eli Collins	cf93dfba4e	HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374040 13f79535-47bb-0310-9956-ffa450edef68	2012-08-16 20:35:50 +00:00
Tsz-wo Sze	3cab01ba6e	HADOOP-8700. Use enum to define the checksum constants in DataChecksum. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68	2012-08-16 01:32:10 +00:00
Todd Lipcon	5789de83a7	HDFS-3800. improvements to QJM fault testing. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373587 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 19:18:57 +00:00
Thomas White	4e09b481e7	HADOOP-8278. Make sure components declare correct set of dependencies. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373574 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 19:10:52 +00:00
Todd Lipcon	d5abe22844	Merge trunk into branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373573 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 19:04:24 +00:00
Todd Lipcon	42cdc1b083	HDFS-3797. QJM: add segment txid as a parameter to journal() RPC. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373571 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 18:58:51 +00:00
Todd Lipcon	89153a9c68	HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373567 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 18:53:13 +00:00
Todd Lipcon	c95a1674b6	HDFS-3799. QJM: handle empty log segments during recovery. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373183 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 00:57:24 +00:00
Todd Lipcon	4a9b3c693d	HDFS-3798. Avoid throwing NPE when finalizeSegment() is called on invalid segment. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373179 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 00:54:49 +00:00
Todd Lipcon	160bfcd6c2	HDFS-3795. QJM: validate journal dir at startup. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373178 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 00:52:24 +00:00
Todd Lipcon	f765fdb657	HDFS-3793. Implement genericized format() in QJM. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373177 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 00:48:11 +00:00
Suresh Srinivas	28e87740c5	HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 00:28:41 +00:00
Suresh Srinivas	231a52a7df	Reverting previous incomplete change r1373170 for HDFS-3723 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373172 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 00:25:07 +00:00
Suresh Srinivas	f026d8bb1b	HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373170 13f79535-47bb-0310-9956-ffa450edef68	2012-08-15 00:03:19 +00:00
Eli Collins	f98d8eb291	HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373094 13f79535-47bb-0310-9956-ffa450edef68	2012-08-14 20:59:54 +00:00
Todd Lipcon	b38bd555e8	HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68	2012-08-14 20:11:40 +00:00
Tsz-wo Sze	0c27c77080	HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372707 13f79535-47bb-0310-9956-ffa450edef68	2012-08-14 03:02:43 +00:00
Todd Lipcon	4b67401565	Merge trunk into branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1372630 13f79535-47bb-0310-9956-ffa450edef68	2012-08-13 21:31:44 +00:00
Todd Lipcon	7aacfd5a08	HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372566 13f79535-47bb-0310-9956-ffa450edef68	2012-08-13 19:36:31 +00:00
Aaron Myers	bbe0e823db	Revert HDFS-3719. See discussion there and HDFS-3770 for more info. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372544 13f79535-47bb-0310-9956-ffa450edef68	2012-08-13 18:42:51 +00:00
Todd Lipcon	302f1e96ce	Merge trunk into branch. ... Branch will not build after this commit: need to implement new JournalManager interfaces in QuorumJournalManager in a follow-up. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1371518 13f79535-47bb-0310-9956-ffa450edef68	2012-08-09 22:29:36 +00:00
Todd Lipcon	9d0f8792a9	HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371513 13f79535-47bb-0310-9956-ffa450edef68	2012-08-09 22:13:54 +00:00
Todd Lipcon	6dcf2e4815	HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370937 13f79535-47bb-0310-9956-ffa450edef68	2012-08-08 20:15:40 +00:00
Todd Lipcon	3a53ef4a80	HDFS-3741. Exhaustive failure injection test for skipped RPCs. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370497 13f79535-47bb-0310-9956-ffa450edef68	2012-08-07 20:24:01 +00:00
Aaron Myers	9b4a7900c7	HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68	2012-08-07 16:40:03 +00:00
Aaron Myers	294b514596	HDFS-3719. Re-enable append-related tests in TestFileConcurrentReader. Contributed by Andrew Wang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369848 13f79535-47bb-0310-9956-ffa450edef68	2012-08-06 13:59:00 +00:00
Aaron Myers	8ea7112595	HDFS-3738. TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367844 13f79535-47bb-0310-9956-ffa450edef68	2012-08-01 02:16:57 +00:00
Tsz-wo Sze	cb787968c5	HDFS-3667. Add retry support to WebHdfsFileSystem. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367841 13f79535-47bb-0310-9956-ffa450edef68	2012-08-01 01:41:23 +00:00
Tsz-wo Sze	556be2af92	svn merge -c -1366601 for reverting HDFS-3667. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367407 13f79535-47bb-0310-9956-ffa450edef68	2012-07-31 04:33:59 +00:00
Todd Lipcon	e08604907c	HDFS-3725. Fix QJM startup when individual JNs have gaps. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1367366 13f79535-47bb-0310-9956-ffa450edef68	2012-07-30 23:35:22 +00:00
Todd Lipcon	e1dff3df99	Merge trunk into QJM branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1367365 13f79535-47bb-0310-9956-ffa450edef68	2012-07-30 23:31:42 +00:00
Robert Joseph Evans	48a2e2b4e2	HADOOP-8550. hadoop fs -touchz automatically created parent directories (John George via bobby) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367202 13f79535-47bb-0310-9956-ffa450edef68	2012-07-30 18:11:32 +00:00
Tsz-wo Sze	e4eec269d9	HDFS-3667. Add retry support to WebHdfsFileSystem. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366601 13f79535-47bb-0310-9956-ffa450edef68	2012-07-28 05:57:47 +00:00
Daryn Sharp	cbd59c1c50	HDFS-3553. Hftp proxy tokens are broken (daryn) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366471 13f79535-47bb-0310-9956-ffa450edef68	2012-07-27 18:02:56 +00:00
Aaron Myers	c1ea9b4490	HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68	2012-07-27 00:26:21 +00:00
Tsz-wo Sze	8f395c2f78	HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations to get around a Java library bug causing OutOfMemoryError. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365839 13f79535-47bb-0310-9956-ffa450edef68	2012-07-25 23:37:25 +00:00
Todd Lipcon	972953bd77	HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68	2012-07-25 21:52:38 +00:00
Todd Lipcon	b17018e4b8	HDFS-3693. JNStorage should read its storage info even before a writer becomes active. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365794 13f79535-47bb-0310-9956-ffa450edef68	2012-07-25 21:47:19 +00:00
Todd Lipcon	d2d0736de4	HDFS-3692. Support purgeEditLogs() call to remotely purge logs on JNs. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365792 13f79535-47bb-0310-9956-ffa450edef68	2012-07-25 21:44:26 +00:00
Todd Lipcon	939f4a9f92	HDFS-3694. Fix getEditLogManifest to fetch httpPort if necessary. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365788 13f79535-47bb-0310-9956-ffa450edef68	2012-07-25 21:40:17 +00:00
Robert Joseph Evans	0bfa7d79d0	HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365588 13f79535-47bb-0310-9956-ffa450edef68	2012-07-25 13:56:29 +00:00
Aaron Myers	d8f3913856	HDFS-3711. Manually convert remaining tests to JUnit4. Contributed by Andrew Wang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365119 13f79535-47bb-0310-9956-ffa450edef68	2012-07-24 15:19:08 +00:00
Eli Collins	1fd21078d8	HDFS-3709. TestStartup tests still binding to the ephemeral port. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364865 13f79535-47bb-0310-9956-ffa450edef68	2012-07-24 01:53:29 +00:00
Todd Lipcon	9833468302	HDFS-3597. SNN fails to start after DFS upgrade. Contributed by Andy Isaacson. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363899 13f79535-47bb-0310-9956-ffa450edef68	2012-07-20 18:58:58 +00:00
Todd Lipcon	74d4573a23	HDFS-3077. Quorum-based protocol for reading and writing edit logs. Contributed by Todd Lipcon based on initial work from Brandon Li and Hari Mankude. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1363596 13f79535-47bb-0310-9956-ffa450edef68	2012-07-20 00:25:50 +00:00
Robert Joseph Evans	4c51dacd52	Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363547 13f79535-47bb-0310-9956-ffa450edef68	2012-07-19 21:15:42 +00:00
Robert Joseph Evans	52c8271bf1	HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363435 13f79535-47bb-0310-9956-ffa450edef68	2012-07-19 17:46:47 +00:00
Todd Lipcon	23b6ed973e	HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363175 13f79535-47bb-0310-9956-ffa450edef68	2012-07-18 23:42:13 +00:00
Daryn Sharp	0a6806ce8c	HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever (Kihwal Lee via daryn) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363170 13f79535-47bb-0310-9956-ffa450edef68	2012-07-18 23:21:30 +00:00
Tsz-wo Sze	6e56376023	HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362976 13f79535-47bb-0310-9956-ffa450edef68	2012-07-18 15:12:47 +00:00
Eli Collins	6981b14003	Revert HDFS-3654. TestJspHelper#testGetUgi fails with NPE. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362759 13f79535-47bb-0310-9956-ffa450edef68	2012-07-18 05:05:50 +00:00
Aaron Myers	e2253b539e	HDFS-3583. Convert remaining tests to Junit4. Contributed by Andrew Wang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362753 13f79535-47bb-0310-9956-ffa450edef68	2012-07-18 03:46:28 +00:00
Eli Collins	527933f4f3	HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68	2012-07-16 21:26:58 +00:00
Eli Collins	18f1feb64b	MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362204 13f79535-47bb-0310-9956-ffa450edef68	2012-07-16 19:09:33 +00:00
Eli Collins	572823c82c	HDFS-3665. Add a test for renaming across file systems via a symlink. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362177 13f79535-47bb-0310-9956-ffa450edef68	2012-07-16 18:29:25 +00:00
Harsh J	0e8e499ff4	HDFS-3659. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361894 13f79535-47bb-0310-9956-ffa450edef68	2012-07-16 02:58:03 +00:00
Eli Collins	64fc2cb03d	HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68	2012-07-15 19:43:39 +00:00
Eli Collins	32d4c148df	HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361463 13f79535-47bb-0310-9956-ffa450edef68	2012-07-14 01:07:57 +00:00
Eli Collins	06d635cd2c	HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361449 13f79535-47bb-0310-9956-ffa450edef68	2012-07-14 00:18:56 +00:00
Sanjay Radia	6a59f08a15	HDFS-3630 Modify TestPersistBlocks to use both flush and hflush (sanjay) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360991 13f79535-47bb-0310-9956-ffa450edef68	2012-07-12 22:46:53 +00:00
Eli Collins	4a5ba3b7bd	HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68	2012-07-12 19:01:49 +00:00
Eli Collins	cdae6953e8	HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68	2012-07-11 17:58:02 +00:00
Aaron Myers	fb4a6ac9e9	HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359824 13f79535-47bb-0310-9956-ffa450edef68	2012-07-10 18:28:13 +00:00
Eli Collins	5952c7bb62	HDFS-3614. Revert unused MiniDFSCluster constructor from HDFS-3049. Contributed by Arun Murthy ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358825 13f79535-47bb-0310-9956-ffa450edef68	2012-07-08 19:53:14 +00:00
Eli Collins	21fdf16b0d	HDFS-3548. NamenodeFsck.copyBlock fails to create a Block Reader. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358822 13f79535-47bb-0310-9956-ffa450edef68	2012-07-08 19:41:55 +00:00
Uma Maheswara Rao G	07295260b1	HDFS-3482. hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified without values. Contributed by Madhukara Phatak. ... Submitted by: Madhukara Phatak. Reviewed by: Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358812 13f79535-47bb-0310-9956-ffa450edef68	2012-07-08 18:39:09 +00:00
Eli Collins	6dcf42262d	HDFS-3603. Decouple TestHDFSTrash from TestTrash. Contributed by Jason Lowe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358804 13f79535-47bb-0310-9956-ffa450edef68	2012-07-08 18:15:30 +00:00
Uma Maheswara Rao G	d4fb882163	HDFS-3541. Deadlock between recovery, xceiver and packet responder. Contributed by Vinay. ... Submitted by: Vinay Reviewed by: Uma Maheswara Rao G git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358794 13f79535-47bb-0310-9956-ffa450edef68	2012-07-08 17:42:19 +00:00
Harsh J	e5b00f1bdc	HDFS-2988. Improve error message when storage directory lock fails. Contributed by Miomir Boljanovic. (harsh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358683 13f79535-47bb-0310-9956-ffa450edef68	2012-07-08 00:36:38 +00:00
Aaron Myers	fb95fce240	Fix issue with NN/DN re-registration. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358347 13f79535-47bb-0310-9956-ffa450edef68	2012-07-06 18:59:55 +00:00
Todd Lipcon	e0ef844280	HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357970 13f79535-47bb-0310-9956-ffa450edef68	2012-07-05 22:18:30 +00:00
Tsz-wo Sze	4d0cab2729	HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68	2012-07-05 01:31:57 +00:00
Eli Collins	359b4efd19	HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356971 13f79535-47bb-0310-9956-ffa450edef68	2012-07-03 21:43:25 +00:00
Todd Lipcon	b8389e4c73	HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68	2012-07-03 20:45:21 +00:00
Eli Collins	161ed29087	HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68	2012-07-02 22:46:55 +00:00
Todd Lipcon	7accbabdee	HDFS-3573. Supply NamespaceInfo when instantiating JournalManagers. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356388 13f79535-47bb-0310-9956-ffa450edef68	2012-07-02 18:21:49 +00:00
Tsz-wo Sze	28e8151ad3	HDFS-3157. Fix a bug in the case that the generation stamps of the stored block in a namenode and the reported block from a datanode do not match. Contributed by Ashish Singhi ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356086 13f79535-47bb-0310-9956-ffa450edef68	2012-07-02 07:26:03 +00:00
Harsh J	06d0109314	HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension. (harsh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355636 13f79535-47bb-0310-9956-ffa450edef68	2012-06-30 05:04:23 +00:00
Todd Lipcon	802f885a55	HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68	2012-06-29 22:24:29 +00:00
Suresh Srinivas	19dd66a3f6	HDFS-3510. Editlog pre-allocation is performed prior to writing edits to avoid partial edits case disk out of space. Contributed by Collin McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355189 13f79535-47bb-0310-9956-ffa450edef68	2012-06-28 23:00:10 +00:00
Todd Lipcon	1d54e2b331	HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355174 13f79535-47bb-0310-9956-ffa450edef68	2012-06-28 21:46:12 +00:00
Aaron Myers	9255cb83c8	HDFS-3559. DFSTestUtil: use Builder class to construct DFSTestUtil instances. Contributed by Colin Patrick McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355141 13f79535-47bb-0310-9956-ffa450edef68	2012-06-28 20:04:49 +00:00
Tsz-wo Sze	f105784d6a	svn merge -c -1354790 for reverting HDFS-3576 since it requires more changes. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354792 13f79535-47bb-0310-9956-ffa450edef68	2012-06-28 01:25:32 +00:00
Tsz-wo Sze	44389399d4	HDFS-3576. Move the definition of the constant NameNode.DEFAULT_PORT to DFSConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT. Contributed by Brandon Li ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354790 13f79535-47bb-0310-9956-ffa450edef68	2012-06-28 01:11:22 +00:00
Tsz-wo Sze	bf1649d5fd	HDFS-3551. WebHDFS CREATE should use client location for HTTP redirection. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354316 13f79535-47bb-0310-9956-ffa450edef68	2012-06-27 02:51:39 +00:00
Eli Collins	0270889b4e	HDFS-3535. Audit logging should log denied accesses. Contributed by Andy Isaacson ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354144 13f79535-47bb-0310-9956-ffa450edef68	2012-06-26 18:14:09 +00:00
Tsz-wo Sze	bbab35e6d8	HDFS-3498. Support replica removal in BlockPlacementPolicy and make BlockPlacementPolicyDefault extensible for reusing code in subclasses. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353807 13f79535-47bb-0310-9956-ffa450edef68	2012-06-26 03:25:47 +00:00
Tsz-wo Sze	361ea9a62c	HDFS-3516. Check content-type in WebHdfsFileSystem. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353800 13f79535-47bb-0310-9956-ffa450edef68	2012-06-26 01:58:13 +00:00
Tsz-wo Sze	ed7040f07b	HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351445 13f79535-47bb-0310-9956-ffa450edef68	2012-06-18 18:23:10 +00:00
Tsz-wo Sze	9ab9bc9f37	Revert r1351163 for fixing the JIRA number; it should be HADOOP-8470 but not HADOOP-8468. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351444 13f79535-47bb-0310-9956-ffa450edef68	2012-06-18 18:20:41 +00:00
Tsz-wo Sze	19ac5c4e8b	HADOOP-8468. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351163 13f79535-47bb-0310-9956-ffa450edef68	2012-06-17 21:12:25 +00:00
Tsz-wo Sze	5572f73d45	HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350825 13f79535-47bb-0310-9956-ffa450edef68	2012-06-15 23:00:36 +00:00
Tsz-wo Sze	9d2b1b2ee8	HDFS-3524. Update TestFileLengthOnClusterRestart for HDFS-3522. Contributed by Brandon Li ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350384 13f79535-47bb-0310-9956-ffa450edef68	2012-06-14 20:17:54 +00:00
Aaron Myers	9cabf93e7a	HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349639 13f79535-47bb-0310-9956-ffa450edef68	2012-06-13 05:29:57 +00:00
Eli Collins	fda95a6a3d	HDFS-3478. Test quotas with Long.Max_Value. Contributed by Sujay Rau ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349634 13f79535-47bb-0310-9956-ffa450edef68	2012-06-13 05:04:20 +00:00
Eli Collins	6702d5dbd4	HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349628 13f79535-47bb-0310-9956-ffa450edef68	2012-06-13 03:31:47 +00:00
Tsz-wo Sze	45fafc2b8f	HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68	2012-06-12 05:27:15 +00:00
Todd Lipcon	9947d8054c	HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349114 13f79535-47bb-0310-9956-ffa450edef68	2012-06-12 04:15:18 +00:00
Tsz-wo Sze	543f86631b	HDFS-3522. If a namenode is in safemode, it should throw SafeModeException when getBlockLocations has zero locations. Contributed by Brandon Li ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349088 13f79535-47bb-0310-9956-ffa450edef68	2012-06-12 01:55:51 +00:00
Eli Collins	9e7334a8fe	HDFS-3517. TestStartup should bind ephemeral ports. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349004 13f79535-47bb-0310-9956-ffa450edef68	2012-06-11 20:52:45 +00:00
Tsz-wo Sze	ca39e780c4	HDFS-3052. Change INodeFile and INodeFileUnderConstruction to package private. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348998 13f79535-47bb-0310-9956-ffa450edef68	2012-06-11 20:38:46 +00:00
Eli Collins	56d2ef6f5e	HDFS-2797. Fix misuses of InputStream#skip in the edit log code. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348945 13f79535-47bb-0310-9956-ffa450edef68	2012-06-11 18:01:38 +00:00
Tsz-wo Sze	5991ed9cbd	HDFS-3490. DatanodeWebHdfsMethods throws NullPointerException if NamenodeRpcAddressParam is not set. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348287 13f79535-47bb-0310-9956-ffa450edef68	2012-06-09 00:54:10 +00:00
Aaron Myers	bc367be4ef	HDFS-3514. Add missing TestParallelLocalRead. Contributed by Henry Robinson. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348207 13f79535-47bb-0310-9956-ffa450edef68	2012-06-08 19:50:24 +00:00
Aaron Myers	b98e26af58	HDFS-2914. HA: Standby should not enter safemode when resources are low. Contributed by Vinay. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347895 13f79535-47bb-0310-9956-ffa450edef68	2012-06-08 06:57:52 +00:00
Aaron Myers	072ae08a00	HDFS-3040. TestMulitipleNNDataBlockScanner is misspelled. Contributed by Madhukara Phatak. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347891 13f79535-47bb-0310-9956-ffa450edef68	2012-06-08 06:38:14 +00:00
Todd Lipcon	05a73a3a1e	Revert HDFS-3492 from r1347192: patch broke TestShortCircuitLocalRead ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347796 13f79535-47bb-0310-9956-ffa450edef68	2012-06-07 21:06:13 +00:00
Todd Lipcon	6d8efb7378	HDFS-3485. DataTransferThrottler will over-throttle when currentTimeMillis jumps. Contributed by Andy Isaacson. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347751 13f79535-47bb-0310-9956-ffa450edef68	2012-06-07 18:41:24 +00:00
Todd Lipcon	bef65d0601	HDFS-3492. Fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347192 13f79535-47bb-0310-9956-ffa450edef68	2012-06-06 22:48:48 +00:00
Aaron Myers	a4b1793df0	HDFS-3266. DFSTestUtil#waitCorruptReplicas doesn't sleep between checks. Contributed by Madhukara Phatak. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346192 13f79535-47bb-0310-9956-ffa450edef68	2012-06-04 23:06:19 +00:00
Eli Collins	30807fec82	HADOOP-8450. Remove src/test/system. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345794 13f79535-47bb-0310-9956-ffa450edef68	2012-06-03 22:14:16 +00:00
Uma Maheswara Rao G	28ca281cd6	HDFS-2025. Go Back to File View link is not working in tail.jsp. Contributed by Ashish and Sravan. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345563 13f79535-47bb-0310-9956-ffa450edef68	2012-06-02 19:41:33 +00:00
Aaron Myers	d1207cbd88	HDFS-3442. Incorrect count for Missing Replicas in FSCK report. Contributed by Andrew Wang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345408 13f79535-47bb-0310-9956-ffa450edef68	2012-06-02 00:39:34 +00:00
Eli Collins	4eb6d65eef	HDFS-3486. offlineimageviewer can't read fsimage files that contain persistent delegation tokens. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344970 13f79535-47bb-0310-9956-ffa450edef68	2012-06-01 02:31:29 +00:00
Eli Collins	675a7e4acb	HDFS-3484. hdfs fsck doesn't work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured. Contributed by Aaron T. Myers ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344908 13f79535-47bb-0310-9956-ffa450edef68	2012-05-31 21:02:08 +00:00
Tsz-wo Sze	83cf475050	HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68	2012-05-30 19:10:09 +00:00
Harsh J	f2c3d3ac52	HDFS-3476. Correct the default used in TestDFSClientRetries.busyTest() after HDFS-3462. (harsh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344394 13f79535-47bb-0310-9956-ffa450edef68	2012-05-30 18:33:41 +00:00
Harsh J	5cf21e4383	HDFS-3462. TestDFSClientRetries.busyTest() should restore default xceiver count in the config. Contributed by Madhukara Phatak. (harsh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343798 13f79535-47bb-0310-9956-ffa450edef68	2012-05-29 16:01:44 +00:00
Uma Maheswara Rao G	e767845c36	HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342534 13f79535-47bb-0310-9956-ffa450edef68	2012-05-25 08:56:59 +00:00
Konstantin Shvachko	2e0a15c488	HDFS-3368. Missing blocks due to bad DataNodes coming up and down. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342512 13f79535-47bb-0310-9956-ffa450edef68	2012-05-25 06:29:17 +00:00
Eli Collins	22cb0ec82a	HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68	2012-05-25 04:10:15 +00:00
Eli Collins	39661c06f7	Revert HDFS-3058 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342493 13f79535-47bb-0310-9956-ffa450edef68	2012-05-25 03:56:12 +00:00
Uma Maheswara Rao G	64ec449010	HDFS-3058. HA: Bring BookKeeperJournalManager up to date with HA changes. Contributed by Ivan Kelly. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342483 13f79535-47bb-0310-9956-ffa450edef68	2012-05-25 01:31:23 +00:00
Todd Lipcon	6c544adeb3	Merge HDFS-3042 (automatic failover) to trunk. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68	2012-05-24 00:56:20 +00:00
Todd Lipcon	74dfa8f1f2	HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342042 13f79535-47bb-0310-9956-ffa450edef68	2012-05-23 20:42:48 +00:00
Tsz-wo Sze	ade42bce10	HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341961 13f79535-47bb-0310-9956-ffa450edef68	2012-05-23 17:59:30 +00:00
Eli Collins	260dfa367e	HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68	2012-05-20 21:13:17 +00:00
Todd Lipcon	1a3bd5d42f	Merge trunk into auto-HA branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68	2012-05-20 06:12:14 +00:00
Todd Lipcon	d1a54b872d	HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340343 13f79535-47bb-0310-9956-ffa450edef68	2012-05-19 05:13:38 +00:00
Todd Lipcon	7d1f97b821	HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339978 13f79535-47bb-0310-9956-ffa450edef68	2012-05-18 05:28:18 +00:00
Todd Lipcon	5258d6bf3f	HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339897 13f79535-47bb-0310-9956-ffa450edef68	2012-05-17 22:30:46 +00:00
Todd Lipcon	15ddb6634f	HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339745 13f79535-47bb-0310-9956-ffa450edef68	2012-05-17 17:49:48 +00:00
Eli Collins	5ef725eb53	HDFS-3434. InvalidProtocolBufferException when visiting DN browseDirectory.jsp. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339712 13f79535-47bb-0310-9956-ffa450edef68	2012-05-17 17:01:13 +00:00
Aaron Myers	1377709b4c	HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68	2012-05-17 10:23:18 +00:00
Todd Lipcon	ba1e4a823a	HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339452 13f79535-47bb-0310-9956-ffa450edef68	2012-05-17 02:45:47 +00:00
Todd Lipcon	0600e834be	HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68	2012-05-17 00:36:13 +00:00
Todd Lipcon	e14e10fb86	Merge trunk into auto-HA branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339410 13f79535-47bb-0310-9956-ffa450edef68	2012-05-16 22:47:37 +00:00
Aaron Myers	7286e8a9da	HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339250 13f79535-47bb-0310-9956-ffa450edef68	2012-05-16 16:24:38 +00:00
Eli Collins	dac828de0f	HDFS-3197. Incorrect class comments in a few tests. Contributed by Andy Isaacson ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338880 13f79535-47bb-0310-9956-ffa450edef68	2012-05-15 20:37:12 +00:00
Eli Collins	7428aeca86	HDFS-3418. Rename BlockWithLocationsProto datanodeIDs field to storageIDs. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338830 13f79535-47bb-0310-9956-ffa450edef68	2012-05-15 19:03:14 +00:00
Todd Lipcon	52ecdb751e	HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1338817 13f79535-47bb-0310-9956-ffa450edef68	2012-05-15 18:16:49 +00:00
Eli Collins	e9a7648f62	HDFS-3416. Cleanup DatanodeID and DatanodeRegistration constructors used by testing. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338784 13f79535-47bb-0310-9956-ffa450edef68	2012-05-15 16:23:52 +00:00
Todd Lipcon	95710c15b7	HDFS-3335. check for edit log corruption at the end of the log. Contributed by Colin Patrick McCabe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338492 13f79535-47bb-0310-9956-ffa450edef68	2012-05-15 00:41:37 +00:00
Aaron Myers	a8eef98f41	HDFS-3163. TestHDFSCLI.testAll fails if the user name is not all lowercase. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338486 13f79535-47bb-0310-9956-ffa450edef68	2012-05-15 00:14:51 +00:00
Todd Lipcon	bcdb125643	HDFS-3031. Fix complete() and getAdditionalBlock() RPCs to be idempotent. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338466 13f79535-47bb-0310-9956-ffa450edef68	2012-05-14 22:35:25 +00:00
Aaron Myers	05c5fcfb42	HDFS-3414. Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338275 13f79535-47bb-0310-9956-ffa450edef68	2012-05-14 16:25:17 +00:00
Todd Lipcon	4cd70e87be	Merge trunk into auto-HA branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337645 13f79535-47bb-0310-9956-ffa450edef68	2012-05-12 20:52:34 +00:00
Aaron Myers	5dbd09ee76	HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337030 13f79535-47bb-0310-9956-ffa450edef68	2012-05-11 05:57:37 +00:00
Tsz-wo Sze	ba6360e493	HDFS-3385. The last block of INodeFileUnderConstruction is not necessarily a BlockInfoUnderConstruction, so do not cast it in FSNamesystem.recoverLeaseInternal(..). ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336976 13f79535-47bb-0310-9956-ffa450edef68	2012-05-11 00:25:48 +00:00
Eli Collins	fcb4b1995b	HDFS-3401. Cleanup DatanodeDescriptor creation in the tests. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336972 13f79535-47bb-0310-9956-ffa450edef68	2012-05-11 00:03:37 +00:00
Eli Collins	98b00d7cc0	HDFS-3134. harden edit log loader against malformed or malicious input. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336943 13f79535-47bb-0310-9956-ffa450edef68	2012-05-10 23:13:02 +00:00
Tsz-wo Sze	7e8e983620	HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336909 13f79535-47bb-0310-9956-ffa450edef68	2012-05-10 21:41:25 +00:00
Eli Collins	6a0865440e	HDFS-3230. Cleanup DatanodeID creation in the tests. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336815 13f79535-47bb-0310-9956-ffa450edef68	2012-05-10 17:58:55 +00:00
Uma Maheswara Rao G	f1ff05bf47	Reverting (Need to re-do the patch. new BlockInfo does not set iNode ) HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336572 13f79535-47bb-0310-9956-ffa450edef68	2012-05-10 09:59:39 +00:00
Uma Maheswara Rao G	408e558d8d	HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. Contributed by Ashish Singhi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335719 13f79535-47bb-0310-9956-ffa450edef68	2012-05-08 19:45:38 +00:00
Tsz-wo Sze	f0f9a3631f	HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileUnderConstruction do not have to be used in block management. Contributed by John George ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335304 13f79535-47bb-0310-9956-ffa450edef68	2012-05-08 00:06:09 +00:00
Todd Lipcon	567aed4f2c	HDFS-3365. Enable users to disable socket caching in DFS client configuration. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335222 13f79535-47bb-0310-9956-ffa450edef68	2012-05-07 19:56:23 +00:00
Todd Lipcon	eca2c850a5	HDFS-3376. DFSClient fails to make connection to DN if there are many unusable cached sockets. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335115 13f79535-47bb-0310-9956-ffa450edef68	2012-05-07 16:42:19 +00:00
Aaron Myers	51e520c68a	HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334231 13f79535-47bb-0310-9956-ffa450edef68	2012-05-04 22:14:10 +00:00
Todd Lipcon	a701c792f8	HDFS-3357. DataXceiver reads from client socket with incorrect/no timeout. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334116 13f79535-47bb-0310-9956-ffa450edef68	2012-05-04 18:50:54 +00:00
Todd Lipcon	25882b199b	HDFS-3359. DFSClient.close should close cached sockets. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333624 13f79535-47bb-0310-9956-ffa450edef68	2012-05-03 21:13:43 +00:00
Aaron Myers	470b1197be	HDFS-3351. NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333299 13f79535-47bb-0310-9956-ffa450edef68	2012-05-03 03:00:10 +00:00
Todd Lipcon	f6c01e2f8e	Merge trunk into auto-HA branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68	2012-05-03 02:14:01 +00:00
Todd Lipcon	9d5799553f	HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68	2012-05-03 01:56:33 +00:00
Todd Lipcon	cbc2424290	HDFS-3330. If GetImageServlet throws an Error or RTE, response should not have HTTP "OK" status. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333286 13f79535-47bb-0310-9956-ffa450edef68	2012-05-03 01:44:22 +00:00
Uma Maheswara Rao G	d37ec9d09e	HDFS-3286. When the threshold value for balancer is zero, unexpected output is displayed. Contributed by Ashish Singhi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332531 13f79535-47bb-0310-9956-ffa450edef68	2012-05-01 06:44:12 +00:00
Uma Maheswara Rao G	086fa860c0	HDFS-3275. Skip format for non-file based directories. Contributed by Amith D K. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332527 13f79535-47bb-0310-9956-ffa450edef68	2012-05-01 05:47:27 +00:00
Tsz-wo Sze	920b8fac18	HDFS-3334. Fix ByteRangeInputStream stream leakage. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331570 13f79535-47bb-0310-9956-ffa450edef68	2012-04-27 20:13:17 +00:00
Tsz-wo Sze	3e835c47d1	HDFS-3181. Fix a test case in TestLeaseRecovery2. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331138 13f79535-47bb-0310-9956-ffa450edef68	2012-04-26 22:44:34 +00:00
Tsz-wo Sze	1a76c82a31	HDFS-3322. Use HdfsDataInputStream and HdfsDataOutputStream in Hdfs. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331114 13f79535-47bb-0310-9956-ffa450edef68	2012-04-26 21:50:50 +00:00
Uma Maheswara Rao G	d28b982428	HDFS-3222. DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. Contributed by Uma Maheswara Rao G. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331061 13f79535-47bb-0310-9956-ffa450edef68	2012-04-26 20:18:01 +00:00
Eli Collins	2b254dad2e	HDFS-3258. Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node). Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330613 13f79535-47bb-0310-9956-ffa450edef68	2012-04-26 00:47:16 +00:00
Tsz-wo Sze	3b773da036	HDFS-3319. Change DFSOutputStream to not to start a thread in constructors. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330535 13f79535-47bb-0310-9956-ffa450edef68	2012-04-25 20:17:20 +00:00
Tsz-wo Sze	2584779166	HDFS-3321. Fix safe mode turn off tip message. Contributed by Ravi Prakash ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330506 13f79535-47bb-0310-9956-ffa450edef68	2012-04-25 19:34:36 +00:00
Tsz-wo Sze	f86352c2df	HDFS-3318. Use BoundedInputStream in ByteRangeInputStream, otherwise, it hangs on transfers >2 GB. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330500 13f79535-47bb-0310-9956-ffa450edef68	2012-04-25 19:24:00 +00:00
Tsz-wo Sze	ea32198db4	HDFS-3298. Add HdfsDataOutputStream as a public API. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330064 13f79535-47bb-0310-9956-ffa450edef68	2012-04-24 23:39:43 +00:00
Tsz-wo Sze	93c5585d31	HDFS-3312. In HftpFileSystem, the namenode URI is non-secure but the delegation tokens have to use secure URI. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329462 13f79535-47bb-0310-9956-ffa450edef68	2012-04-23 21:27:01 +00:00
Sanjay Radia	589c68ae09	HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68	2012-04-23 16:34:21 +00:00
Tsz-wo Sze	cdbe15ccdc	HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328541 13f79535-47bb-0310-9956-ffa450edef68	2012-04-20 23:59:19 +00:00
Tsz-wo Sze	201af20406	Revert r1328482 for HDFS-3308. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328487 13f79535-47bb-0310-9956-ffa450edef68	2012-04-20 19:32:23 +00:00
Tsz-wo Sze	ab8f458742	HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328482 13f79535-47bb-0310-9956-ffa450edef68	2012-04-20 19:16:58 +00:00
Aaron Myers	49ed783a3a	HDFS-3305. GetImageServlet should consider SBN a valid requestor in a secure HA setup. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328115 13f79535-47bb-0310-9956-ffa450edef68	2012-04-19 20:43:03 +00:00
Eli Collins	4550627cab	HDFS-3169. TestFsck should test multiple -move operations in a row. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327776 13f79535-47bb-0310-9956-ffa450edef68	2012-04-19 01:51:13 +00:00
Eli Collins	54e61ffdc0	HDFS-3206. Miscellaneous xml cleanups for OEV. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327768 13f79535-47bb-0310-9956-ffa450edef68	2012-04-19 01:31:53 +00:00
Todd Lipcon	ca49126e3d	Merge trunk into auto-HA branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68	2012-04-18 23:35:30 +00:00
Tsz-wo Sze	c80dbe5e09	HDFS-2652. Add support for host-based delegation tokens. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327309 13f79535-47bb-0310-9956-ffa450edef68	2012-04-17 22:21:33 +00:00
Aaron Myers	c21bd72a2f	HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68	2012-04-17 17:06:38 +00:00
Aaron Myers	1675c18ded	Revert HADOOP-8280 so it can be recommitted using `svn mv' ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68	2012-04-17 16:49:04 +00:00
Tsz-wo Sze	f1667dee14	HDFS-3279. Move the FSEditLog constructor with @VisibleForTesting to TestEditLog. Contributed by Arpit Gupta ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326762 13f79535-47bb-0310-9956-ffa450edef68	2012-04-16 19:31:34 +00:00
Todd Lipcon	258da66cc7	HDFS-3268. FileContext API mishandles token service and incompatible with HA. Contributed by Daryn Sharp. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326747 13f79535-47bb-0310-9956-ffa450edef68	2012-04-16 19:08:29 +00:00
Aaron Myers	551468385c	HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68	2012-04-16 18:28:36 +00:00
Aaron Myers	15fe3ae61b	HDFS-2708. Stats for the # of blocks per DN. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326039 13f79535-47bb-0310-9956-ffa450edef68	2012-04-14 01:51:03 +00:00
Tsz-wo Sze	841fdc5628	HDFS-3273. Refactor BackupImage and FSEditLog, and rename JournalListener.rollLogs(..) to startLogSegment(..). ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326016 13f79535-47bb-0310-9956-ffa450edef68	2012-04-13 23:41:01 +00:00
Eli Collins	5a20d446cf	HDFS-2799. Trim fs.checkpoint.dir values. Contributed by Amith D K ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325963 13f79535-47bb-0310-9956-ffa450edef68	2012-04-13 21:31:27 +00:00
Aaron Myers	4f230adc13	HDFS-3256. HDFS considers blocks under-replicated if topology script is configured with only 1 rack. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325531 13f79535-47bb-0310-9956-ffa450edef68	2012-04-12 21:28:44 +00:00
Aaron Myers	07a4367445	HDFS-3259. NameNode#initializeSharedEdits should populate shared edits dir with edit log segments. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325518 13f79535-47bb-0310-9956-ffa450edef68	2012-04-12 21:11:32 +00:00
Todd Lipcon	72406e940a	HDFS-3255. HA DFS returns wrong token service. Contributed by Daryn Sharp. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325414 13f79535-47bb-0310-9956-ffa450edef68	2012-04-12 18:08:00 +00:00
Todd Lipcon	989d65ab97	HDFS-3261. TestHASafeMode fails on HDFS-3042 branch. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325140 13f79535-47bb-0310-9956-ffa450edef68	2012-04-12 07:05:36 +00:00
Aaron Myers	4ea042666c	HDFS-3260. TestDatanodeRegistration should set minimum DN version in addition to minimum NN version. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325119 13f79535-47bb-0310-9956-ffa450edef68	2012-04-12 05:27:03 +00:00
Aaron Myers	7f427646df	HDFS-2983. Relax the build version check to permit rolling upgrades within a release. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325110 13f79535-47bb-0310-9956-ffa450edef68	2012-04-12 03:36:13 +00:00
Tsz-wo Sze	ed678e52ce	HDFS-3179. Improve the exception message thrown by DataStreamer when it failed to add a datanode. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324892 13f79535-47bb-0310-9956-ffa450edef68	2012-04-11 17:49:28 +00:00
Todd Lipcon	2bf19979b3	Merge trunk into auto-failover branch. ... Needs a few tweaks to fix compilation - will do in followup commit. This is just a straight merge git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324567 13f79535-47bb-0310-9956-ffa450edef68	2012-04-11 05:47:40 +00:00
Todd Lipcon	41a014c31b	HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68	2012-04-11 05:40:26 +00:00
Todd Lipcon	21824d8232	HDFS-3247. Improve bootstrapStandby behavior when original NN is not active. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324558 13f79535-47bb-0310-9956-ffa450edef68	2012-04-11 05:16:06 +00:00
Eli Collins	80447bd35a	HDFS-3244. Remove dead writable code from hdfs/protocol. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312061 13f79535-47bb-0310-9956-ffa450edef68	2012-04-11 01:10:38 +00:00
Todd Lipcon	58228e4e7b	HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry Robinson. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312029 13f79535-47bb-0310-9956-ffa450edef68	2012-04-10 22:31:18 +00:00
Todd Lipcon	3ffdb9152e	HDFS-3094. add -nonInteractive and -force option to namenode -format command. Contributed by Arpit Gupta. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312025 13f79535-47bb-0310-9956-ffa450edef68	2012-04-10 22:22:38 +00:00
Aaron Myers	53dc8546d4	HDFS-3235. MiniDFSClusterManager doesn't correctly support -format option. Contributed by Henry Robinson. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311556 13f79535-47bb-0310-9956-ffa450edef68	2012-04-10 02:25:40 +00:00
Aaron Myers	9597c81f35	HDFS-3236. NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311554 13f79535-47bb-0310-9956-ffa450edef68	2012-04-10 02:17:17 +00:00
Eli Collins	706394d039	HDFS-3004. Implement Recovery Mode. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311394 13f79535-47bb-0310-9956-ffa450edef68	2012-04-09 19:39:58 +00:00
Uma Maheswara Rao G	3ced5ea066	HDFS-3119. Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file. Contributed by Ashish Singhi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311380 13f79535-47bb-0310-9956-ffa450edef68	2012-04-09 19:11:58 +00:00
Aaron Myers	909176c1fc	HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311133 13f79535-47bb-0310-9956-ffa450edef68	2012-04-09 05:56:22 +00:00
Todd Lipcon	ee5daee1b7	HDFS-3214. InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311125 13f79535-47bb-0310-9956-ffa450edef68	2012-04-09 03:22:41 +00:00
Todd Lipcon	ca6f0940fd	Merge trunk into auto-failover branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310905 13f79535-47bb-0310-9956-ffa450edef68	2012-04-07 22:53:55 +00:00
Tsz-wo Sze	74b4b45651	HDFS-3211. Add fence(..) and replace NamenodeRegistration with JournalInfo and epoch in JournalProtocol. Contributed by suresh ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310649 13f79535-47bb-0310-9956-ffa450edef68	2012-04-07 00:52:12 +00:00
Todd Lipcon	2ab67dce11	HDFS-3226. Allow GetConf tool to print arbitrary keys. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310648 13f79535-47bb-0310-9956-ffa450edef68	2012-04-07 00:15:30 +00:00
Suresh Srinivas	02f5e43686	HDFS-3121. Add HDFS tests for HADOOP-8014 change. Contributed by John George. Missed adding the file in the earlier commit. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310631 13f79535-47bb-0310-9956-ffa450edef68	2012-04-06 23:03:54 +00:00
Tsz-wo Sze	58e920d1a0	HDFS-2505. Add a test to verify getFileChecksum(..) with ViewFS. Contributed by Ravi Prakash ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310522 13f79535-47bb-0310-9956-ffa450edef68	2012-04-06 18:04:05 +00:00
Todd Lipcon	30068a1d83	Merge trunk into auto-failover branch. ... Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68	2012-04-06 05:07:33 +00:00
Todd Lipcon	d483b6f3fc	HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68	2012-04-06 04:56:26 +00:00
Todd Lipcon	844faefd08	HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68	2012-04-06 04:27:44 +00:00
Eli Collins	e505b7e704	HDFS-3208. Bogus entries in hosts files are incorrectly displayed in the report. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310138 13f79535-47bb-0310-9956-ffa450edef68	2012-04-06 00:20:55 +00:00
Eli Collins	112c324151	HDFS-3210. JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name". Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310135 13f79535-47bb-0310-9956-ffa450edef68	2012-04-06 00:10:54 +00:00
Tsz-wo Sze	80bbefafaf	HDFS-3178. Add states and state handler for journal synchronization in JournalService. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310115 13f79535-47bb-0310-9956-ffa450edef68	2012-04-05 22:35:53 +00:00
Eli Collins	663fbd46a8	HDFS-3199. TestValidateConfigurationSettings is failing. Contributed by Todd Lipcon ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309641 13f79535-47bb-0310-9956-ffa450edef68	2012-04-05 03:31:03 +00:00
Eli Collins	4f6e0a5a65	HDFS-3050. rework OEV to share more code with the NameNode. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309629 13f79535-47bb-0310-9956-ffa450edef68	2012-04-05 00:02:11 +00:00
Aaron Myers	ba688e11c1	HDFS-3102. Add CLI tool to initialize the shared-edits dir. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309580 13f79535-47bb-0310-9956-ffa450edef68	2012-04-04 20:15:08 +00:00
Todd Lipcon	00a1548005	Merge trunk into auto-HA branch ... Resolved some trivial conflicts in NNHAServiceTarget git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68	2012-04-04 20:00:15 +00:00
Todd Lipcon	b74d742785	HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68	2012-04-04 19:21:01 +00:00
Todd Lipcon	a7d6bdc63b	HDFS-3084. FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309526 13f79535-47bb-0310-9956-ffa450edef68	2012-04-04 18:40:43 +00:00
Aaron Myers	7525ee5b67	HDFS-3000. Add a public API for setting quotas. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309227 13f79535-47bb-0310-9956-ffa450edef68	2012-04-04 03:18:49 +00:00
Tsz-wo Sze	8c0366bf10	HDFS-3168. Remove unnecessary "throw IOException" and change fields to final in FSNamesystem and BlockManager. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309218 13f79535-47bb-0310-9956-ffa450edef68	2012-04-04 02:51:34 +00:00
Todd Lipcon	9972a9633d	HDFS-3187. Upgrade guava to 11.0.2. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309181 13f79535-47bb-0310-9956-ffa450edef68	2012-04-03 22:30:29 +00:00
Todd Lipcon	39a5fd5c71	Merge trunk into auto-failover branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309164 13f79535-47bb-0310-9956-ffa450edef68	2012-04-03 21:48:23 +00:00
Tsz-wo Sze	0db8003e2e	HDFS-3166. Add timeout to Hftp connections. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309103 13f79535-47bb-0310-9956-ffa450edef68	2012-04-03 19:26:57 +00:00
Todd Lipcon	789ed57e71	HDFS-2185. HDFS portion of ZK-based FailoverController. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308637 13f79535-47bb-0310-9956-ffa450edef68	2012-04-03 00:59:02 +00:00
Suresh Srinivas	e449de0526	HDFS-3126. Journal stream from Namenode to BackupNode needs to have timeout. Contributed by Hari Mankude. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308636 13f79535-47bb-0310-9956-ffa450edef68	2012-04-03 00:55:08 +00:00
Eli Collins	4f15b9dfed	HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308617 13f79535-47bb-0310-9956-ffa450edef68	2012-04-02 23:20:34 +00:00
Eli Collins	72b3f302dc	HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308614 13f79535-47bb-0310-9956-ffa450edef68	2012-04-02 23:13:06 +00:00
Tsz-wo Sze	bc13dfb142	HDFS-3130. Move fsdataset implementation to a package. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308437 13f79535-47bb-0310-9956-ffa450edef68	2012-04-02 17:38:56 +00:00
Eli Collins	be8a0d1e62	HDFS-3174. Fix assert in TestPendingDataNodeMessages. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308226 13f79535-47bb-0310-9956-ffa450edef68	2012-04-02 01:45:11 +00:00
Eli Collins	be7dd8333a	HDFS-3144. Refactor DatanodeID#getName by use. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308205 13f79535-47bb-0310-9956-ffa450edef68	2012-04-01 22:12:12 +00:00
Aaron Myers	a232d5c791	HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308159 13f79535-47bb-0310-9956-ffa450edef68	2012-04-01 17:27:54 +00:00
Eli Collins	0663dbaac0	HDFS-3171. The DatanodeID "name" field is overloaded. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308014 13f79535-47bb-0310-9956-ffa450edef68	2012-04-01 03:41:41 +00:00
Eli Collins	8bd825bb6f	HDFS-3164. Move DatanodeInfo#hostName to DatanodeID. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307890 13f79535-47bb-0310-9956-ffa450edef68	2012-03-31 19:58:51 +00:00
Eli Collins	64641c28b5	HDFS-3137. Bump LAST_UPGRADABLE_LAYOUT_VERSION to -16. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307173 13f79535-47bb-0310-9956-ffa450edef68	2012-03-30 00:11:14 +00:00
Aaron Myers	51908783be	HDFS-3142. TestHDFSCLI.testAll is failing. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307134 13f79535-47bb-0310-9956-ffa450edef68	2012-03-29 22:00:39 +00:00
Aaron Myers	17d22e6dc4	HDFS-3158. LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306635 13f79535-47bb-0310-9956-ffa450edef68	2012-03-28 22:59:52 +00:00
Tsz-wo Sze	99a68a1423	HDFS-3155. Clean up FSDataset implemenation related code. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306582 13f79535-47bb-0310-9956-ffa450edef68	2012-03-28 20:37:34 +00:00
Eli Collins	0475795066	HDFS-3139. Minor Datanode logging improvement. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306549 13f79535-47bb-0310-9956-ffa450edef68	2012-03-28 19:33:22 +00:00
Aaron Myers	aa8cb2287f	HDFS-3143. TestGetBlocks.testGetBlocks is failing. Contributed by Arpit Gupta. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306542 13f79535-47bb-0310-9956-ffa450edef68	2012-03-28 19:02:16 +00:00
Aaron Myers	1427468a72	HDFS-3156. TestDFSHAAdmin is failing post HADOOP-8202. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306517 13f79535-47bb-0310-9956-ffa450edef68	2012-03-28 17:58:23 +00:00
Arun Murthy	67a74198b1	Changed version in trunk to 3.0.0-SNAPSHOT. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306200 13f79535-47bb-0310-9956-ffa450edef68	2012-03-28 07:37:06 +00:00
Suresh Srinivas	940dac52a7	HDFS-3125. Add JournalService to enable Journal Daemon. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305726 13f79535-47bb-0310-9956-ffa450edef68	2012-03-27 04:02:03 +00:00
Aaron Myers	466908e67b	HDFS-3131. Improve TestStorageRestore. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305688 13f79535-47bb-0310-9956-ffa450edef68	2012-03-27 00:13:42 +00:00
Tsz-wo Sze	525ceb99ad	HDFS-2413. Add an API DistributedFileSystem.isInSafeMode() and change DistributedFileSystem to @InterfaceAudience.LimitedPrivate. Contributed by harsh ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305632 13f79535-47bb-0310-9956-ffa450edef68	2012-03-26 22:18:04 +00:00
Eli Collins	99a321419f	HDFS-3129. NetworkTopology: add test that getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305628 13f79535-47bb-0310-9956-ffa450edef68	2012-03-26 22:07:30 +00:00
Tsz-wo Sze	67bdbd60cd	(recommit) HDFS-3089. Move FSDatasetInterface and the related classes to a package. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305603 13f79535-47bb-0310-9956-ffa450edef68	2012-03-26 21:14:12 +00:00
Tsz-wo Sze	5e38a9acea	Revert 1305590 for HDFS-3089. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305598 13f79535-47bb-0310-9956-ffa450edef68	2012-03-26 21:09:14 +00:00
Tsz-wo Sze	1ebcc378af	HDFS-3089. Move FSDatasetInterface and the related classes to a package. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305590 13f79535-47bb-0310-9956-ffa450edef68	2012-03-26 21:01:47 +00:00
Aaron Myers	ce1a7ec975	HDFS-2941. Add an administrative command to download a copy of the fsimage from the NN. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305447 13f79535-47bb-0310-9956-ffa450edef68	2012-03-26 17:02:40 +00:00
Todd Lipcon	840df19cee	HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305195 13f79535-47bb-0310-9956-ffa450edef68	2012-03-26 01:54:14 +00:00
Todd Lipcon	39775dca68	Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305152 13f79535-47bb-0310-9956-ffa450edef68	2012-03-25 21:38:31 +00:00
Todd Lipcon	90ea037d21	HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304967 13f79535-47bb-0310-9956-ffa450edef68	2012-03-24 23:48:07 +00:00
Todd Lipcon	b795c65f49	HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68	2012-03-23 06:29:40 +00:00
Eli Collins	4feef86372	HDFS-3044. fsck move should be non-destructive by default. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304063 13f79535-47bb-0310-9956-ffa450edef68	2012-03-22 21:11:18 +00:00
Tsz-wo Sze	0c4acdc176	HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303628 13f79535-47bb-0310-9956-ffa450edef68	2012-03-22 00:10:20 +00:00
Todd Lipcon	2f820dde17	HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303485 13f79535-47bb-0310-9956-ffa450edef68	2012-03-21 18:14:09 +00:00
Todd Lipcon	f55a1c0876	HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68	2012-03-21 17:30:37 +00:00
Tsz-wo Sze	9e108e61fb	HDFS-3086. Change Datanode not to send storage list in registration. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303318 13f79535-47bb-0310-9956-ffa450edef68	2012-03-21 09:07:33 +00:00
Tsz-wo Sze	6326605acb	HDFS-3105. Add DatanodeStorage information to block recovery. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302683 13f79535-47bb-0310-9956-ffa450edef68	2012-03-19 22:09:14 +00:00
Uma Maheswara Rao G	875080ce10	HDFS-3111. Missing license headers in trunk. Deleted this file from svn repositiry as this file was already empty. (Contributed by Uma MAheswara Rao G). ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301876 13f79535-47bb-0310-9956-ffa450edef68	2012-03-17 07:06:42 +00:00
Tsz-wo Sze	2a0024403a	HDFS-3104. Add tests for HADOOP-8175. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301665 13f79535-47bb-0310-9956-ffa450edef68	2012-03-16 17:48:33 +00:00
Tsz-wo Sze	662b1887af	HDFS-3088. Move FSDatasetInterface inner classes to a package. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301661 13f79535-47bb-0310-9956-ffa450edef68	2012-03-16 17:32:57 +00:00
Tsz-wo Sze	9b2a324ba5	HDFS-3098. Update and add tests for HADOOP-8173. Contributed by Daryn Sharp ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301295 13f79535-47bb-0310-9956-ffa450edef68	2012-03-16 00:27:40 +00:00
Tsz-wo Sze	7e5b60116e	HDFS-3101. Cannot read empty file using WebHDFS. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301287 13f79535-47bb-0310-9956-ffa450edef68	2012-03-16 00:01:23 +00:00
Todd Lipcon	49619e8997	HDFS-3062. Fix bug which prevented MR job submission from creating delegation tokens on an HA cluster. Contributed by Mingjie Lai. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301285 13f79535-47bb-0310-9956-ffa450edef68	2012-03-16 00:00:29 +00:00
Aaron Myers	65425b0961	HDFS-3099. SecondaryNameNode does not properly initialize metrics system. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301222 13f79535-47bb-0310-9956-ffa450edef68	2012-03-15 21:51:23 +00:00
Aaron Myers	6d96a28a08	HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301182 13f79535-47bb-0310-9956-ffa450edef68	2012-03-15 20:26:29 +00:00
Tsz-wo Sze	3e582c690c	HDFS-3082. Clean up FSDatasetInterface and change DataNode.data to package private. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300392 13f79535-47bb-0310-9956-ffa450edef68	2012-03-13 22:52:17 +00:00
Todd Lipcon	1a75ec8288	HDFS-2731. Add command to bootstrap the Standby Node's name directories from the Active NameNode. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299807 13f79535-47bb-0310-9956-ffa450edef68	2012-03-12 19:41:21 +00:00
Tsz-wo Sze	501a283986	HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299139 13f79535-47bb-0310-9956-ffa450edef68	2012-03-10 01:52:17 +00:00
Steve Loughran	381a9b2d58	HDFS-2966 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298820 13f79535-47bb-0310-9956-ffa450edef68	2012-03-09 13:17:04 +00:00
Tsz-wo Sze	22738ae1d0	HDFS-2038. Update TestHDFSCLI to handle relative paths with globs. Contributed by Kihwal Lee ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298066 13f79535-47bb-0310-9956-ffa450edef68	2012-03-07 19:44:47 +00:00
Eli Collins	0a2b413dff	HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298044 13f79535-47bb-0310-9956-ffa450edef68	2012-03-07 19:16:03 +00:00
Tsz-wo Sze	0ee71adeb4	HDFS-3032. Change DFSClient.renewLease() so that it only retries up to the lease soft-limit. Contributed by Kihwal Lee ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297328 13f79535-47bb-0310-9956-ffa450edef68	2012-03-06 02:42:46 +00:00
Todd Lipcon	87d1c67944	Merge trunk into HA branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68	2012-03-02 01:48:32 +00:00
Aaron Myers	6da670ce6a	HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296016 13f79535-47bb-0310-9956-ffa450edef68	2012-03-02 01:26:54 +00:00
Aaron Myers	f22677ef8e	HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295961 13f79535-47bb-0310-9956-ffa450edef68	2012-03-01 22:52:05 +00:00
Tsz-wo Sze	9e31bf675d	HDFS-3021. Use generic type to declare FSDatasetInterface. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295929 13f79535-47bb-0310-9956-ffa450edef68	2012-03-01 21:58:39 +00:00
Todd Lipcon	55832c6c96	HDFS-3035. Fix failure of TestFileAppendRestart due to OP_UPDATE_BLOCKS. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295740 13f79535-47bb-0310-9956-ffa450edef68	2012-03-01 18:57:58 +00:00
Aaron Myers	0d7de507a5	HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295473 13f79535-47bb-0310-9956-ffa450edef68	2012-03-01 08:50:10 +00:00
Aaron Myers	9318ff4250	Revert commit of HDFS-2979. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295435 13f79535-47bb-0310-9956-ffa450edef68	2012-03-01 07:03:40 +00:00
Todd Lipcon	30cffeb388	HDFS-3023. Optimize entries in edits log for persistBlocks call. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295356 13f79535-47bb-0310-9956-ffa450edef68	2012-03-01 00:37:09 +00:00
Todd Lipcon	1ba357553a	Merge trunk into HA branch. ... Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk. Resolved some conflicts around removal of VersionedProtocol, etc. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68	2012-02-29 23:47:49 +00:00
Aaron Myers	01b17c40cf	HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295340 13f79535-47bb-0310-9956-ffa450edef68	2012-02-29 23:42:52 +00:00
Aaron Myers	7b6b204924	HDFS-3027. Implement a simple NN health check. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295300 13f79535-47bb-0310-9956-ffa450edef68	2012-02-29 21:57:56 +00:00
Todd Lipcon	28de3628f5	HDFS-3020. Fix editlog to automatically sync when buffer is full. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295239 13f79535-47bb-0310-9956-ffa450edef68	2012-02-29 19:57:18 +00:00
Eli Collins	fbf3a9ee3d	HDFS-2992. Edit log failure trace should include transaction ID of error. Contributed by Colin Patrick McCabe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295227 13f79535-47bb-0310-9956-ffa450edef68	2012-02-29 19:31:36 +00:00
Todd Lipcon	34c73db5e1	HDFS-2991. Fix case where OP_ADD would not be logged in append(). Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295214 13f79535-47bb-0310-9956-ffa450edef68	2012-02-29 18:52:00 +00:00
Jitendra Nath Pandey	e57fd85fd4	HDFS-3030. Remove getProtocolVersion and getProtocolSignature from translators. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295017 13f79535-47bb-0310-9956-ffa450edef68	2012-02-29 08:52:45 +00:00
Aaron Myers	978a8050e2	HDFS-2920. fix remaining TODO items. Contributed by Aaron T. Myers and Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294923 13f79535-47bb-0310-9956-ffa450edef68	2012-02-29 01:09:07 +00:00
Aaron Myers	c69dfdd5e1	HDFS-2958. Sweep for remaining proxy construction which doesn't go through failover path. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294811 13f79535-47bb-0310-9956-ffa450edef68	2012-02-28 20:09:18 +00:00
Jitendra Nath Pandey	daf782ca7e	HDFS-3016. Security in unit tests. Contributed by Jaimin Jetly. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294773 13f79535-47bb-0310-9956-ffa450edef68	2012-02-28 18:41:25 +00:00
Todd Lipcon	da9aa34bec	HDFS-3013. HA: NameNode format doesn't pick up dfs.namenode.name.dir.NameServiceId configuration. Contributed by Mingjie Lai. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294425 13f79535-47bb-0310-9956-ffa450edef68	2012-02-28 00:43:54 +00:00
Aaron Myers	ae9014ef6a	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293742 13f79535-47bb-0310-9956-ffa450edef68	2012-02-26 04:57:17 +00:00
Aaron Myers	b57260f848	HDFS-2978. The NameNode should expose name dir statuses via JMX. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293707 13f79535-47bb-0310-9956-ffa450edef68	2012-02-25 22:14:53 +00:00
Tsz-wo Sze	dacbeb5f67	HDFS-3006. In WebHDFS, when the return body is empty, set the Content-Type to application/octet-stream instead of application/json. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293487 13f79535-47bb-0310-9956-ffa450edef68	2012-02-25 00:15:37 +00:00
Todd Lipcon	481f84597b	HDFS-2904. Client support for getting delegation tokens. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293486 13f79535-47bb-0310-9956-ffa450edef68	2012-02-25 00:03:26 +00:00
Suresh Srinivas	5293e5d1c5	HDFS-3002. TestNameNodeMetrics need not wait for metrics update. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293482 13f79535-47bb-0310-9956-ffa450edef68	2012-02-24 23:52:20 +00:00
Aaron Myers	62c7e2edfc	HDFS-3003. Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString(). Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293338 13f79535-47bb-0310-9956-ffa450edef68	2012-02-24 17:03:17 +00:00
Aaron Myers	f3026e1085	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292838 13f79535-47bb-0310-9956-ffa450edef68	2012-02-23 16:06:53 +00:00
Todd Lipcon	90a14f89e1	HDFS-2973. Re-enable NO_ACK optimization for block deletion. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292611 13f79535-47bb-0310-9956-ffa450edef68	2012-02-23 01:25:14 +00:00
Todd Lipcon	475db83b87	HDFS-2985. Improve logging when replicas are marked as corrupt. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292609 13f79535-47bb-0310-9956-ffa450edef68	2012-02-23 01:16:33 +00:00
Todd Lipcon	c14912785d	HDFS-2929. Stress test and fixes for block synchronization. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292494 13f79535-47bb-0310-9956-ffa450edef68	2012-02-22 20:31:52 +00:00
Tsz-wo Sze	efbc58f30c	HDFS-2907. Add a conf property dfs.datanode.fsdataset.factory to make FSDataset in Datanode pluggable. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292419 13f79535-47bb-0310-9956-ffa450edef68	2012-02-22 17:47:39 +00:00
Aaron Myers	d03dac7432	HDFS-2974. MiniDFSCluster does not delete standby NN name dirs during format. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291126 13f79535-47bb-0310-9956-ffa450edef68	2012-02-20 04:12:01 +00:00
Aaron Myers	41e56dfece	HDFS-2952. NN should not start with upgrade option or with a pending an unfinalized upgrade. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245875 13f79535-47bb-0310-9956-ffa450edef68	2012-02-18 07:12:27 +00:00
Todd Lipcon	ef5d7156db	Merge trunk into HA branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68	2012-02-18 01:27:51 +00:00
Todd Lipcon	9ae4fac8dd	HDFS-2968. Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245832 13f79535-47bb-0310-9956-ffa450edef68	2012-02-18 01:18:01 +00:00
Todd Lipcon	a8e7f745cd	HDFS-2969. ExtendedBlock.equals is incorrectly implemented. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245830 13f79535-47bb-0310-9956-ffa450edef68	2012-02-18 01:13:09 +00:00
Eli Collins	dd732d5a24	Fix TestViewFsFileStatusHdfs per previous commit. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245762 13f79535-47bb-0310-9956-ffa450edef68	2012-02-17 21:04:20 +00:00
Aaron Myers	53b7d6c6bc	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68	2012-02-17 18:19:31 +00:00
Aaron Myers	7933dc5838	HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245338 13f79535-47bb-0310-9956-ffa450edef68	2012-02-17 07:37:43 +00:00
Suresh Srinivas	1a03127385	HDFS-2937. TestDFSHAAdmin needs tests with MiniDFSCluster. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245326 13f79535-47bb-0310-9956-ffa450edef68	2012-02-17 06:40:40 +00:00
Aaron Myers	153e0cc37a	HDFS-2955. IllegalStateException during standby startup in getCurSegmentTxId. Contributed by Hari Mankude. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245230 13f79535-47bb-0310-9956-ffa450edef68	2012-02-16 22:45:40 +00:00
Jitendra Nath Pandey	b8448dea82	HDFS-2655. BlockReaderLocal#skip performs unnecessary IO. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245118 13f79535-47bb-0310-9956-ffa450edef68	2012-02-16 18:58:19 +00:00
Aaron Myers	833e96534f	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68	2012-02-16 18:35:32 +00:00
Todd Lipcon	05151ecf79	HDFS-2934. Allow configs to be scoped to all NNs in the nameservice. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244759 13f79535-47bb-0310-9956-ffa450edef68	2012-02-15 22:19:12 +00:00
Jitendra Nath Pandey	3c145d3492	HDFS-2909. HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error. Contributed by Bikas Saha. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244753 13f79535-47bb-0310-9956-ffa450edef68	2012-02-15 22:00:18 +00:00
Suresh Srinivas	ff91453227	HDFS-2938. Recursive delete of a large directory make namenode unresponsive. Contributed by Hari Mankude. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244752 13f79535-47bb-0310-9956-ffa450edef68	2012-02-15 22:00:08 +00:00
Aaron Myers	1fb0ab92f8	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68	2012-02-15 19:04:17 +00:00
Jitendra Nath Pandey	f82e862e1f	HDFS-2525. Race between BlockPoolSliceScanner and append. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244640 13f79535-47bb-0310-9956-ffa450edef68	2012-02-15 18:43:01 +00:00
Aaron Myers	011611c765	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68	2012-02-14 20:37:10 +00:00
Aaron Myers	a87328dfab	HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243822 13f79535-47bb-0310-9956-ffa450edef68	2012-02-14 08:27:15 +00:00
Todd Lipcon	db187cf40e	Merge trunk into HA branch. ... Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68	2012-02-13 21:00:37 +00:00
Tsz-wo Sze	52004aa8e9	HDFS-776. Fix exception handling in Balancer. Contributed by Uma Maheswara Rao G ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243654 13f79535-47bb-0310-9956-ffa450edef68	2012-02-13 19:07:04 +00:00
Aaron Myers	f6e407b436	HDFS-2939. TestHAStateTransitions fails on Windows. Contributed by Uma Maheswara Rao G. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243293 13f79535-47bb-0310-9956-ffa450edef68	2012-02-12 18:43:39 +00:00
Todd Lipcon	8be9441b9b	HDFS-2878. Fix TestBlockRecovery and move it back into main test directory. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242995 13f79535-47bb-0310-9956-ffa450edef68	2012-02-11 01:20:59 +00:00
Todd Lipcon	c14bb61a82	Merge trunk into HA branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68	2012-02-10 01:49:08 +00:00
Aaron Myers	467059b4ab	HDFS-2912. Namenode not shutting down when shared edits dir is inaccessible. Contributed by Bikas Saha. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242564 13f79535-47bb-0310-9956-ffa450edef68	2012-02-09 22:23:47 +00:00
Jitendra Nath Pandey	b5d02a63cb	HDFS-2915. HA: TestFailureOfSharedDir.testFailureOfSharedDir() has race condition. Contributed by Bikas Saha. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242522 13f79535-47bb-0310-9956-ffa450edef68	2012-02-09 21:08:17 +00:00
Aaron Myers	bad0a2a4a1	HDFS-2510. Add HA-related metrics. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242410 13f79535-47bb-0310-9956-ffa450edef68	2012-02-09 17:39:50 +00:00
Todd Lipcon	e918b91e23	HDFS-2579. Starting delegation token manager during safemode fails. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242225 13f79535-47bb-0310-9956-ffa450edef68	2012-02-09 06:12:01 +00:00
Tsz-wo Sze	b6ffb08a46	HDFS-2887. FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated. (szetszwo) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242087 13f79535-47bb-0310-9956-ffa450edef68	2012-02-08 20:58:29 +00:00
Aaron Myers	4d3dc530e8	HDFS-2764. TestBackupNode is racy. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241780 13f79535-47bb-0310-9956-ffa450edef68	2012-02-08 05:38:29 +00:00
Jitendra Nath Pandey	b9e74da41b	HDFS-2905. HA: Standby NN NPE when shared edits dir is deleted. Contributed by Bikas Saha. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241757 13f79535-47bb-0310-9956-ffa450edef68	2012-02-08 03:17:09 +00:00
Jitendra Nath Pandey	acacde55e6	HDFS-2901. Improvements for SBN web UI - not show under-replicated/missing blocks. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241568 13f79535-47bb-0310-9956-ffa450edef68	2012-02-07 19:29:39 +00:00
Suresh Srinivas	28eadb7cd7	HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241519 13f79535-47bb-0310-9956-ffa450edef68	2012-02-07 16:59:48 +00:00
Todd Lipcon	7f0a99f6e6	HDFS-2794. Active NN may purge edit log files before standby NN has a chance to read them. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241317 13f79535-47bb-0310-9956-ffa450edef68	2012-02-07 01:39:14 +00:00
Konstantin Shvachko	7e4bd89590	HDFS-2886. CreateEditLogs should generate a realistic edit log. Contributed by Konstantin Shvachko. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241296 13f79535-47bb-0310-9956-ffa450edef68	2012-02-07 00:44:27 +00:00
Suresh Srinivas	2a9e430ff9	HDS-2895. Remove Writable wire protocol types and translators to complete transition to protocol buffers. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241007 13f79535-47bb-0310-9956-ffa450edef68	2012-02-06 13:33:35 +00:00
Eli Collins	296b6c0063	HDFS-2894. HA: automatically determine the nameservice Id if only one nameservice is configured. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240917 13f79535-47bb-0310-9956-ffa450edef68	2012-02-06 08:25:52 +00:00
Eli Collins	2e4cf977ae	HDFS-2752. HA: exit if multiple shared dirs are configured. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240916 13f79535-47bb-0310-9956-ffa450edef68	2012-02-06 08:24:11 +00:00
Eli Collins	c17b4f8eef	HDFS-2819. Document new HA-related configs in hdfs-default.xml. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240914 13f79535-47bb-0310-9956-ffa450edef68	2012-02-06 08:21:06 +00:00
Harsh J	da7b0d90c6	HDFS-2868. Expose xceiver counts via the DataNode MXBean. (harsh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240897 13f79535-47bb-0310-9956-ffa450edef68	2012-02-06 05:25:12 +00:00
Eli Collins	a660c5dd2c	Add missing file from previous commit. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240601 13f79535-47bb-0310-9956-ffa450edef68	2012-02-04 20:13:48 +00:00
Eli Collins	7b913180be	HDFS-2808. HA: haadmin should use namenode ids. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240600 13f79535-47bb-0310-9956-ffa450edef68	2012-02-04 20:12:51 +00:00
Aaron Myers	ec6961b39c	HDFS-2792. Make fsck work. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240449 13f79535-47bb-0310-9956-ffa450edef68	2012-02-04 03:10:39 +00:00
Todd Lipcon	11df1c2561	HDFS-2874. Edit log should log to shared dirs before local dirs. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240445 13f79535-47bb-0310-9956-ffa450edef68	2012-02-04 02:52:53 +00:00
Aaron Myers	969318cfc2	HDFS-2863. Failures observed if dfs.edits.dir and shared.edits.dir have same directories. Contributed by Bikas Saha. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240267 13f79535-47bb-0310-9956-ffa450edef68	2012-02-03 18:04:21 +00:00
Tsz-wo Sze	38ad4b5036	HDFS-2879. Change FSDataset to package private. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240020 13f79535-47bb-0310-9956-ffa450edef68	2012-02-03 07:26:02 +00:00
Eli Collins	d2b5531b0f	HDFS-2769. HA: When HA is enabled with a shared edits dir, that dir should be marked required. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239988 13f79535-47bb-0310-9956-ffa450edef68	2012-02-03 03:10:57 +00:00
Aaron Myers	05ab55b705	HDFS-2860. TestDFSRollback#testRollback is failing. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239968 13f79535-47bb-0310-9956-ffa450edef68	2012-02-03 01:09:05 +00:00
Todd Lipcon	32c313d51c	HDFS-2861. checkpointing should verify that the dfs.http.address has been configured to a non-loopback for peer NN. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239886 13f79535-47bb-0310-9956-ffa450edef68	2012-02-02 22:21:57 +00:00
Jitendra Nath Pandey	9eb8f4d267	HDFS-2784. Update hftp and hdfs for host-based token support. Contributed by Kihwal Lee. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239763 13f79535-47bb-0310-9956-ffa450edef68	2012-02-02 19:04:40 +00:00
Konstantin Shvachko	191db6a907	HDFS-2718. Optimize OP_ADD in edits loading. Contributed by Konstantin Shvachko. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239760 13f79535-47bb-0310-9956-ffa450edef68	2012-02-02 18:57:49 +00:00
Jitendra Nath Pandey	c909aedbc1	HDFS-2814 NamenodeMXBean does not account for svn revision in the version information. Contributed by Hitesh Shah. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239464 13f79535-47bb-0310-9956-ffa450edef68	2012-02-02 05:31:46 +00:00
Tsz-wo Sze	dbbfaebb71	HDFS-2864. Remove some redundant methods and the constant METADATA_VERSION from FSDataset. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238969 13f79535-47bb-0310-9956-ffa450edef68	2012-02-01 07:46:50 +00:00
Eli Collins	cf611255d6	HDFS-2742. HA: observed dataloss in replication stress test. Contributed by Todd Lipcon ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238940 13f79535-47bb-0310-9956-ffa450edef68	2012-02-01 05:16:49 +00:00
Aaron Myers	43679fcccd	HDFS-2845. SBN should not allow browsing of the file system via web UI. Contributed by Bikas Saha. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238897 13f79535-47bb-0310-9956-ffa450edef68	2012-02-01 01:29:06 +00:00
Tsz-wo Sze	8dfef7d2dc	HDFS-2827. When the parent of a directory is the root, renaming the directory results in leases updated incorrectly. Contributed by Uma Maheswara Rao G ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238700 13f79535-47bb-0310-9956-ffa450edef68	2012-01-31 17:36:42 +00:00
Eli Collins	6be13332db	HDFS-2853. HA: NN fails to start if the shared edits dir is marked required. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238134 13f79535-47bb-0310-9956-ffa450edef68	2012-01-31 02:17:53 +00:00
Todd Lipcon	641f79a325	HDFS-2824. Fix failover when prior NN died just after creating an edit log segment. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238069 13f79535-47bb-0310-9956-ffa450edef68	2012-01-30 23:05:18 +00:00
Eli Collins	6884348444	HADOOP-7938. HA: the FailoverController should optionally fence the active during failover. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238058 13f79535-47bb-0310-9956-ffa450edef68	2012-01-30 22:42:46 +00:00
Todd Lipcon	846f97312c	HDFS-2691. Fixes for pipeline recovery in an HA cluster: report RBW replicas immediately upon pipeline creation. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237935 13f79535-47bb-0310-9956-ffa450edef68	2012-01-30 19:16:15 +00:00
Jitendra Nath Pandey	98302971c2	HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237192 13f79535-47bb-0310-9956-ffa450edef68	2012-01-29 02:01:24 +00:00
Aaron Myers	30dd704e6c	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237157 13f79535-47bb-0310-9956-ffa450edef68	2012-01-28 20:33:30 +00:00
Aaron Myers	976c07696d	HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237153 13f79535-47bb-0310-9956-ffa450edef68	2012-01-28 20:26:13 +00:00
Todd Lipcon	327c216c2f	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68	2012-01-28 02:50:23 +00:00
Todd Lipcon	da91e0d427	HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236945 13f79535-47bb-0310-9956-ffa450edef68	2012-01-28 00:42:34 +00:00
Jitendra Nath Pandey	e7775e0b3b	HDFS-2805. Add a test for a federated cluster with HA NNs. Contributed by Brandon Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236471 13f79535-47bb-0310-9956-ffa450edef68	2012-01-27 00:34:37 +00:00
Eli Collins	fdf7b18247	HDFS-2838. NPE in FSNamesystem when in safe mode. Contributed by Gregory Chanan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236450 13f79535-47bb-0310-9956-ffa450edef68	2012-01-26 23:48:08 +00:00
Jitendra Nath Pandey	dea3164e00	HDFS-2809. Add test to verify that delegation tokens are honored after failover. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235495 13f79535-47bb-0310-9956-ffa450edef68	2012-01-24 21:06:27 +00:00
Jitendra Nath Pandey	0b2245a0f3	HDFS-2807. Service level authorizartion for HAServiceProtocol. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235431 13f79535-47bb-0310-9956-ffa450edef68	2012-01-24 19:31:49 +00:00
Aaron Myers	83bcb1bbf4	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235380 13f79535-47bb-0310-9956-ffa450edef68	2012-01-24 17:59:14 +00:00
Harsh J	7c69883917	HDFS-442. dfsthroughput in test jar throws NPE (harsh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235137 13f79535-47bb-0310-9956-ffa450edef68	2012-01-24 06:10:28 +00:00
Eli Collins	5dfe62d845	HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68	2012-01-24 06:05:52 +00:00
Todd Lipcon	fa4a33a566	Merge trunk into HA branch. ... - Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function - testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68	2012-01-24 00:00:05 +00:00
Todd Lipcon	1525aae4b3	HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235067 13f79535-47bb-0310-9956-ffa450edef68	2012-01-23 23:42:17 +00:00
Todd Lipcon	465663afbf	HDFS-2804. Should not mark blocks under-replicated when exiting safemode. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235033 13f79535-47bb-0310-9956-ffa450edef68	2012-01-23 22:22:46 +00:00
Todd Lipcon	c0016ba85f	HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235025 13f79535-47bb-0310-9956-ffa450edef68	2012-01-23 22:07:49 +00:00
Todd Lipcon	8d1c996242	HDFS-2688. Add tests for quota tracking in an HA cluster. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235017 13f79535-47bb-0310-9956-ffa450edef68	2012-01-23 21:57:00 +00:00
Todd Lipcon	12645ff6c0	HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234925 13f79535-47bb-0310-9956-ffa450edef68	2012-01-23 18:11:09 +00:00
Aaron Myers	e42bbfbca2	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234924 13f79535-47bb-0310-9956-ffa450edef68	2012-01-23 18:07:27 +00:00
Aaron Myers	c3e62de9ce	HDFS-2737. Automatically trigger log rolls periodically on the active NN. Contributed by Todd Lipcon and Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234256 13f79535-47bb-0310-9956-ffa450edef68	2012-01-21 03:17:26 +00:00
Todd Lipcon	c840548d6b	HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234221 13f79535-47bb-0310-9956-ffa450edef68	2012-01-21 00:42:35 +00:00
Aaron Myers	2abe5c818d	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68	2012-01-20 19:30:53 +00:00
Todd Lipcon	520a39ac2d	HDFS-2810. Leases not getting renewed properly by clients. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233794 13f79535-47bb-0310-9956-ffa450edef68	2012-01-20 07:26:19 +00:00
Todd Lipcon	1aed1296dd	HDFS-2812. When becoming active, the NN should treat all leases as freshly renewed. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233612 13f79535-47bb-0310-9956-ffa450edef68	2012-01-19 22:35:04 +00:00
Aaron Myers	02919e61f6	HDFS-2367. Enable the configuration of multiple HA cluster addresses. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233549 13f79535-47bb-0310-9956-ffa450edef68	2012-01-19 19:41:48 +00:00
Todd Lipcon	a380dc8732	HDFS-2592. Balancer support for HA namenodes. Contributed by Uma Maheswara Rao G. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232531 13f79535-47bb-0310-9956-ffa450edef68	2012-01-17 18:39:09 +00:00
Todd Lipcon	0c1450ca5d	HDFS-2795. Standby NN takes a long time to recover from a dead DN starting up. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232285 13f79535-47bb-0310-9956-ffa450edef68	2012-01-17 03:21:08 +00:00
Aaron Myers	d880c7cc78	HDFS-2772. On transition to active, standby should not swallow ELIE. Contributed by Aaron T. Myers ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232197 13f79535-47bb-0310-9956-ffa450edef68	2012-01-16 22:16:15 +00:00
Todd Lipcon	2f26475a39	HDFS-2747. Entering safe mode after starting SBN can NPE. Contributed by Uma Maheswara Rao G. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232176 13f79535-47bb-0310-9956-ffa450edef68	2012-01-16 21:46:05 +00:00
Suresh Srinivas	72207596be	HADOOP-7972. HAServiceProtocol exceptions need to be unwrapped. Contributed by Hari Mankude. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230861 13f79535-47bb-0310-9956-ffa450edef68	2012-01-13 02:30:29 +00:00
Aaron Myers	3e76f00baa	Fix expected error text in assertion. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230254 13f79535-47bb-0310-9956-ffa450edef68	2012-01-11 21:14:30 +00:00
Aaron Myers	4f1bf2fe23	HDFS-2738. FSEditLog.selectinputStreams is reading through in-progress streams even when non-in-progress are requested. Contributed by Aaron T. Myers ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229931 13f79535-47bb-0310-9956-ffa450edef68	2012-01-11 08:32:10 +00:00
Aaron Myers	a339836bbc	HDFS-2766. Test for case where standby partially reads log and then performs checkpoint. Contributed by Aaron T. Myers ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229929 13f79535-47bb-0310-9956-ffa450edef68	2012-01-11 08:26:18 +00:00
Todd Lipcon	a4f4becf52	HDFS-2775. Fix TestStandbyCheckpoints.testBothNodesInStandbyState failing intermittently. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229901 13f79535-47bb-0310-9956-ffa450edef68	2012-01-11 06:14:13 +00:00
Todd Lipcon	298e867673	HDFS-2773. Reading edit logs from an earlier version should not leave blocks in under-construction state. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229900 13f79535-47bb-0310-9956-ffa450edef68	2012-01-11 06:08:13 +00:00
Todd Lipcon	190dc1c91b	HDFS-2753. Fix standby getting stuck in safemode when blocks are written while SBN is down. Contributed by Hari Mankude and Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229898 13f79535-47bb-0310-9956-ffa450edef68	2012-01-11 05:55:32 +00:00
Todd Lipcon	526efb48a6	HDFS-2762. Fix TestCheckpoint timing out on HA branch. Contributed by Uma Maheswara Rao G. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229464 13f79535-47bb-0310-9956-ffa450edef68	2012-01-10 03:29:02 +00:00
Aaron Myers	ade897636d	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229279 13f79535-47bb-0310-9956-ffa450edef68	2012-01-09 18:01:55 +00:00
Aaron Myers	a7195bdd14	HDFS-2765. TestNameEditsConfigs is incorrectly swallowing IOE. Contributed by Aaron T. Myers ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229028 13f79535-47bb-0310-9956-ffa450edef68	2012-01-09 04:53:20 +00:00
Todd Lipcon	736b1860ab	HDFS-2730. Refactor shared HA-related test code into HATestUtil class. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229023 13f79535-47bb-0310-9956-ffa450edef68	2012-01-09 04:12:37 +00:00
Eli Collins	2d0b340c47	HADOOP-7961. Move HA fencing to common. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228510 13f79535-47bb-0310-9956-ffa450edef68	2012-01-07 00:17:42 +00:00
Todd Lipcon	9a07ba8945	HDFS-2709. Appropriately handle error conditions in EditLogTailer. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228390 13f79535-47bb-0310-9956-ffa450edef68	2012-01-06 20:44:05 +00:00
Aaron Myers	3187a3ae05	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68	2012-01-05 19:21:01 +00:00
Suresh Srinivas	472e971891	HDFS-2710. Add HDFS tests related to HADOOP-7933. Contributed by Siddarth Seth. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227756 13f79535-47bb-0310-9956-ffa450edef68	2012-01-05 18:57:01 +00:00
Todd Lipcon	5b8dcb20a2	HDFS-2291. Allow the StandbyNode to make checkpoints in an HA setup. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227411 13f79535-47bb-0310-9956-ffa450edef68	2012-01-05 00:22:54 +00:00
Todd Lipcon	d004ddee76	HDFS-2720. Fix MiniDFSCluster HA support to work properly on Windows. Contributed by Uma Maheswara Rao G. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227284 13f79535-47bb-0310-9956-ffa450edef68	2012-01-04 19:50:41 +00:00
Aaron Myers	cd81cc6664	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227260 13f79535-47bb-0310-9956-ffa450edef68	2012-01-04 18:47:51 +00:00
Harsh J	075122690c	HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227165 13f79535-47bb-0310-9956-ffa450edef68	2012-01-04 14:15:15 +00:00
Todd Lipcon	737df8b67b	HDFS-2716. Configuration needs to allow different dfs.http.addresses for each HA NN. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1226020 13f79535-47bb-0310-9956-ffa450edef68	2011-12-31 01:53:23 +00:00
Todd Lipcon	20a6560bdf	HDFS-2692. Fix bugs related to failover from/into safe mode. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225709 13f79535-47bb-0310-9956-ffa450edef68	2011-12-30 00:30:27 +00:00
Todd Lipcon	15ebdd5664	HDFS-2714. Fix test cases which use standalone FSNamesystems. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225708 13f79535-47bb-0310-9956-ffa450edef68	2011-12-30 00:25:21 +00:00
Todd Lipcon	31c91706f7	HDFS-1972. Fencing mechanism for block invalidations and replications. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1221608 13f79535-47bb-0310-9956-ffa450edef68	2011-12-21 04:32:40 +00:00
Todd Lipcon	36d1c49486	HDFS-2693. Fix synchronization issues around state transition. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1221582 13f79535-47bb-0310-9956-ffa450edef68	2011-12-21 03:03:23 +00:00
Todd Lipcon	8ff28f4549	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220616 13f79535-47bb-0310-9956-ffa450edef68	2011-12-19 05:34:51 +00:00
Eli Collins	5e185702ea	HDFS-2335. DataNodeCluster and NNStorage always pull fresh entropy. Contributed by Uma Maheswara Rao G ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220510 13f79535-47bb-0310-9956-ffa450edef68	2011-12-18 18:12:48 +00:00
Todd Lipcon	371f4228e8	HDFS-2684. Fix up some failing unit tests on HA branch. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215241 13f79535-47bb-0310-9956-ffa450edef68	2011-12-16 18:36:24 +00:00
Todd Lipcon	cdb9f01ad4	HDFS-2667. Fix transition from active to standby. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215037 13f79535-47bb-0310-9956-ffa450edef68	2011-12-16 04:25:13 +00:00
Aaron Myers	71071b904d	HDFS-2602. NN should log newly-allocated blocks without losing BlockInfo. Contributed by Aaron T. Myers ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215036 13f79535-47bb-0310-9956-ffa450edef68	2011-12-16 04:18:58 +00:00
Todd Lipcon	afd0333196	HDFS-2683. Authority-based lookup of proxy provider fails if path becomes canonicalized. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214579 13f79535-47bb-0310-9956-ffa450edef68	2011-12-15 00:42:50 +00:00
Todd Lipcon	8134b1c870	Merge trunk into HA branch. ... Several conflicts around introduction of protobuf translator for DatanodeProtocol - mostly trivial resolutions. NB: this does not successfully pass any tests since the HAStatus field needs to be integrated into the HeartbeatResponse Protobuf implementation. That will be a separate commit for clearer history. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214518 13f79535-47bb-0310-9956-ffa450edef68	2011-12-14 22:47:41 +00:00
Suresh Srinivas	95bdb29aaf	r1214102 should have removed the file. Committing this to remove empty file. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214103 13f79535-47bb-0310-9956-ffa450edef68	2011-12-14 08:25:47 +00:00
Suresh Srinivas	60dd76c6ab	HDFS-2676. Remove Avro RPC. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214102 13f79535-47bb-0310-9956-ffa450edef68	2011-12-14 08:20:23 +00:00
Jitendra Nath Pandey	3cffe34177	HDFS-2661. Enable protobuf RPC for DatanodeProtocol. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214033 13f79535-47bb-0310-9956-ffa450edef68	2011-12-14 02:15:37 +00:00
Tsz-wo Sze	433a6e78f6	HDFS-2545. Change WebHDFS to support multiple namenodes in federation. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214027 13f79535-47bb-0310-9956-ffa450edef68	2011-12-14 01:47:57 +00:00
Suresh Srinivas	6a609cb471	Reverting the patch r1213981 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213984 13f79535-47bb-0310-9956-ffa450edef68	2011-12-13 23:27:58 +00:00
Suresh Srinivas	b5229fd19b	HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213981 13f79535-47bb-0310-9956-ffa450edef68	2011-12-13 23:22:28 +00:00
Suresh Srinivas	3001a172c8	Reverting r1213512 because it committed changes that were not part of the patch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213980 13f79535-47bb-0310-9956-ffa450edef68	2011-12-13 23:17:02 +00:00
Aaron Myers	a0fe4f476a	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213867 13f79535-47bb-0310-9956-ffa450edef68	2011-12-13 19:02:37 +00:00
Eli Collins	43100e9c0e	HDFS-1765. Block Replication should respect under-replication block priority. Contributed by Uma Maheswara Rao G ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213537 13f79535-47bb-0310-9956-ffa450edef68	2011-12-13 01:58:25 +00:00
Suresh Srinivas	13345f3a85	HDFS-2663. Handle protobuf optional parameters correctly. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213512 13f79535-47bb-0310-9956-ffa450edef68	2011-12-13 00:21:48 +00:00
Aaron Myers	89379bc1a3	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213389 13f79535-47bb-0310-9956-ffa450edef68	2011-12-12 19:41:20 +00:00
Sanjay Radia	48da033901	HDFS-2651 ClientNameNodeProtocol Translators for Protocol Buffers (sanjay) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213143 13f79535-47bb-0310-9956-ffa450edef68	2011-12-12 05:36:35 +00:00
Suresh Srinivas	2740112bb6	HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213040 13f79535-47bb-0310-9956-ffa450edef68	2011-12-11 18:53:21 +00:00
Jitendra Nath Pandey	38a19bc293	HDFS-2642. Protobuf translators for DatanodeProtocol. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212606 13f79535-47bb-0310-9956-ffa450edef68	2011-12-09 20:02:33 +00:00
Tsz-wo Sze	9b1f47226b	HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68	2011-12-09 09:26:33 +00:00
Todd Lipcon	2481474bd9	HDFS-2634. Standby needs to ingest latest edit logs before transitioning to active. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1212187 13f79535-47bb-0310-9956-ffa450edef68	2011-12-08 23:55:40 +00:00
Aaron Myers	d9ea5bb489	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211749 13f79535-47bb-0310-9956-ffa450edef68	2011-12-08 02:57:47 +00:00
Todd Lipcon	6016e95fee	HDFS-2627. Determine DN's view of which NN is active based on heartbeat responses. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211735 13f79535-47bb-0310-9956-ffa450edef68	2011-12-08 02:00:20 +00:00
Aaron Myers	a27adf3de4	HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. Contributed by Aaron T. Myers ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211650 13f79535-47bb-0310-9956-ffa450edef68	2011-12-07 21:47:13 +00:00
Suresh Srinivas	c17bb83644	HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211249 13f79535-47bb-0310-9956-ffa450edef68	2011-12-07 01:05:56 +00:00
Suresh Srinivas	7a59150bff	HDFS-2629. Implement protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211206 13f79535-47bb-0310-9956-ffa450edef68	2011-12-06 22:19:10 +00:00
Jitendra Nath Pandey	b981daa07f	HDFS-1580. Committing the test case, it was missed in earlier commit. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210749 13f79535-47bb-0310-9956-ffa450edef68	2011-12-06 02:15:56 +00:00
Suresh Srinivas	0a713035f2	HDFS-2618. Implement protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210719 13f79535-47bb-0310-9956-ffa450edef68	2011-12-06 00:25:25 +00:00
Todd Lipcon	f39aac60e0	Merge trunk into branch. ... Resolved conflicts generated by commit of HDFS-1580 in trunk: - made EditLogInputStream.isInProgress public - fixed trivial conflict in DFSConfigKeys git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210666 13f79535-47bb-0310-9956-ffa450edef68	2011-12-05 22:10:35 +00:00
Suresh Srinivas	c256f8266d	HDFS-2581. Implement protobuf service for JournalProtocol. Contributed Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210657 13f79535-47bb-0310-9956-ffa450edef68	2011-12-05 21:52:23 +00:00
Aaron Myers	8a4db4d331	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210547 13f79535-47bb-0310-9956-ffa450edef68	2011-12-05 18:00:44 +00:00
Sanjay Radia	65200998c0	HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68	2011-12-04 20:44:36 +00:00
Todd Lipcon	74b1f069cc	Amend HDFS-2616 to fix mocking in TestBPOfferService ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209315 13f79535-47bb-0310-9956-ffa450edef68	2011-12-02 00:03:17 +00:00
Todd Lipcon	28dbd56de0	HDFS-2623. Add test case for hot standby capability. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209256 13f79535-47bb-0310-9956-ffa450edef68	2011-12-01 21:37:08 +00:00
Todd Lipcon	f4fa76719e	HDFS-2612. Handle refreshNameNodes in federated HA clusters. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209249 13f79535-47bb-0310-9956-ffa450edef68	2011-12-01 21:26:08 +00:00
Todd Lipcon	4cbead8484	HDFS-2622. Fix TestDFSUpgrade in HA branch. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209230 13f79535-47bb-0310-9956-ffa450edef68	2011-12-01 20:38:46 +00:00
Suresh Srinivas	8dbb523768	HDFS-2616. Change DatanodeProtocol#sendHeartbeat() to return HeartbeatResponse. (suresh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208987 13f79535-47bb-0310-9956-ffa450edef68	2011-12-01 08:03:41 +00:00
Suresh Srinivas	1e346aa829	HDFS-1971. Send block report from datanode to both active and standby namenodes. (sanjay, todd via suresh) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208925 13f79535-47bb-0310-9956-ffa450edef68	2011-12-01 01:10:28 +00:00
Todd Lipcon	f87a4b40bc	HDFS-1975. Support for sharing the namenode state from active to standby. Contributed by Jitendra Nath Pandey, Aaron T Myers, and Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208813 13f79535-47bb-0310-9956-ffa450edef68	2011-11-30 21:46:22 +00:00
Aaron Myers	0eec2218a1	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208644 13f79535-47bb-0310-9956-ffa450edef68	2011-11-30 18:27:04 +00:00
Todd Lipcon	bb91ebb53c	HDFS-2591. MiniDFSCluster support to mix and match federation with HA. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208297 13f79535-47bb-0310-9956-ffa450edef68	2011-11-30 06:49:30 +00:00
Tsz-wo Sze	0398a9e88d	HDFS-2604. Add a log message to show if WebHDFS is enabled and a configuration section in the forrest doc. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208140 13f79535-47bb-0310-9956-ffa450edef68	2011-11-29 23:38:59 +00:00
Aaron Myers	ee97365f58	Merge trunk into HA branch. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208002 13f79535-47bb-0310-9956-ffa450edef68	2011-11-29 17:55:28 +00:00
Todd Lipcon	9146ad23f3	HDFS-2582. Scope dfs.ha.namenodes config by nameservice. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207738 13f79535-47bb-0310-9956-ffa450edef68	2011-11-29 02:27:45 +00:00
Konstantin Shvachko	68f56ca906	HDFS-2287. Fix second assert. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207710 13f79535-47bb-0310-9956-ffa450edef68	2011-11-29 00:03:49 +00:00
Eli Collins	b32543d9ae	HDFS-2596. TestDirectoryScanner doesn't test parallel scans. (eli) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207694 13f79535-47bb-0310-9956-ffa450edef68	2011-11-28 23:20:16 +00:00
Todd Lipcon	5f5b3bbdcd	HDFS-2577. NN fails to start since it tries to start secret manager in safemode. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1205689 13f79535-47bb-0310-9956-ffa450edef68	2011-11-24 00:55:37 +00:00
Todd Lipcon	6a0671977b	Merge trunk into HDFS-1623 branch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1204794 13f79535-47bb-0310-9956-ffa450edef68	2011-11-22 03:18:47 +00:00
Tsz-wo Sze	2ab10e29d9	HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204792 13f79535-47bb-0310-9956-ffa450edef68	2011-11-22 02:57:04 +00:00
Konstantin Boudnik	a2e66776a9	HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204781 13f79535-47bb-0310-9956-ffa450edef68	2011-11-22 02:15:49 +00:00
Suresh Srinivas	5293760973	HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204753 13f79535-47bb-0310-9956-ffa450edef68	2011-11-21 23:49:44 +00:00
Todd Lipcon	39ce694d05	HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204659 13f79535-47bb-0310-9956-ffa450edef68	2011-11-21 19:27:00 +00:00
Todd Lipcon	68173af69d	HDFS-2575. DFSTestUtil may create empty files. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204652 13f79535-47bb-0310-9956-ffa450edef68	2011-11-21 19:03:31 +00:00
Eli Collins	9c2f4f634d	HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204370 13f79535-47bb-0310-9956-ffa450edef68	2011-11-21 07:01:29 +00:00
Todd Lipcon	5bc66c4c86	HDFS-2532. TestDfsOverAvroRpc timing out in trunk. Contributed by Uma Maheswara Rao G. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204366 13f79535-47bb-0310-9956-ffa450edef68	2011-11-21 06:41:56 +00:00
Eli Collins	b2313021fd	HDFS-2536. Remove unused imports. Contributed by Harsh J ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204120 13f79535-47bb-0310-9956-ffa450edef68	2011-11-20 03:58:50 +00:00
Todd Lipcon	1f92266516	HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203943 13f79535-47bb-0310-9956-ffa450edef68	2011-11-19 01:31:59 +00:00