hadoop

Author	SHA1	Message	Date
cnauroth	9f9a2222a2	HDFS-7119. Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics. Contributed by Chris Nauroth.	2014-09-25 13:33:37 -07:00
Colin Patrick Mccabe	1861b32eb5	HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe)	2014-09-25 13:11:59 -07:00
arp	5a5a7da3a3	Merge branch 'trunk' into HDFS-6581	2014-09-25 12:55:59 -07:00
cnauroth	b607c3c363	HDFS-7127. TestLeaseRecovery leaks MiniDFSCluster instances. Contributed by Chris Nauroth.	2014-09-25 11:24:31 -07:00
cnauroth	dc2ebf88a8	HDFS-7111. TestSafeMode assumes Unix line endings in safe mode tip. Contributed by Chris Nauroth.	2014-09-25 11:17:46 -07:00
arp	e9edafc731	Merge branch 'trunk' into HDFS-6581	2014-09-25 11:06:25 -07:00
cnauroth	e0b1dc514f	HDFS-7118. Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename. Contributed by Chris Nauroth.	2014-09-25 10:03:59 -07:00
arp	e8e7fbe81a	HDFS-6932. Balancer and Mover tools should ignore replicas on RAM_DISK. (Contributed by Xiaoyu Yao)	2014-09-24 21:08:59 -07:00
arp	b1000fbba4	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java	2014-09-24 20:08:32 -07:00
Jing Zhao	428a76663a	HDFS-7140. Add a tool to list all the existing block storage policies. Contributed by Jing Zhao.	2014-09-24 19:11:16 -07:00
Andrew Wang	63198bfba7	HDFS-7139. Unit test for creating encryption zone on root path. (Zhe Zhang via wang)	2014-09-24 16:40:20 -07:00
Jing Zhao	073bbd805c	HDFS-7081. Add new DistributedFileSystem API for getting all the existing storage policies. Contributed by Jing Zhao.	2014-09-24 10:05:40 -07:00
arp	bfc7b7e6a0	Merge branch 'trunk' into HDFS-6581	2014-09-23 16:40:35 -07:00
cnauroth	b93d9603a2	HDFS-7130. TestDataTransferKeepalive fails intermittently on Windows. Contributed by Chris Nauroth.	2014-09-23 14:35:33 -07:00
Andrew Wang	f48686a1ad	HDFS-7132. hdfs namenode -metadataVersion command does not honor configured name dirs. Contributed by Charles Lamb.	2014-09-23 14:10:02 -07:00
cnauroth	a1fd804a31	HDFS-7126. TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.	2014-09-23 08:21:46 -07:00
arp	8b139b0800	HDFS-6990. Add unit test for evict/delete RAM_DISK block with open handle. (Contributed by Xiaoyu Yao)	2014-09-22 18:10:28 -07:00
arp	889122bd55	Merge branch 'trunk' into HDFS-6581	2014-09-22 18:00:58 -07:00
Colin Patrick Mccabe	7b8df93ce1	HDFS-7001. Tests in TestTracing should not depend on the order of execution. (iwasakims via cmccabe)	2014-09-22 17:21:58 -07:00
Colin Patrick Mccabe	912ad32b03	HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe)	2014-09-22 11:51:31 -07:00
cnauroth	26cba7f35f	HDFS-7115. TestEncryptionZones assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.	2014-09-22 09:07:07 -07:00
cnauroth	b6fd5ccbce	HDFS-7110. Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read. Contributed by Chris Nauroth.	2014-09-21 12:36:57 -07:00
cnauroth	0795fe3721	HDFS-7109. TestDataStorage does not release file locks between tests. Contributed by Chris Nauroth.	2014-09-20 21:01:13 -07:00
arp	8c9860f7c9	HDFS-7071. Undo accidental commit of binary file editsStored.	2014-09-20 17:11:11 -07:00
arp	486a76a39b	HDFS-7071. Updated editsStored and editsStored.xml to bump layout version and add LazyPersist flag. (Contributed by Xiaoyu Yao and Arpit Agarwal)	2014-09-20 16:58:58 -07:00
arp	e257b6dbb1	Merge branch 'trunk' into HDFS-6581	2014-09-20 16:13:17 -07:00
arp	50b321068d	HDFS-7108. Fix unit test failures in SimulatedFsDataset. (Arpit Agarwal)	2014-09-20 16:12:17 -07:00
Jing Zhao	84a0a629d3	HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. Contributed by Jing Zhao.	2014-09-20 13:44:53 -07:00
arp	b2d5ed36bc	HDFS-7100. Make eviction scheme pluggable. (Arpit Agarwal)	2014-09-20 13:25:23 -07:00
arp	09dab88d3e	Merge branch 'trunk' into HDFS-6581	2014-09-20 10:34:45 -07:00
cnauroth	f85cc14eb4	HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth.	2014-09-19 21:23:26 -07:00
cnauroth	332e2e23ba	HDFS-7105. Fix TestJournalNode#testFailToStartWithBadConfig to match log output change. Contributed by Ray Chiang.	2014-09-19 21:04:55 -07:00
arp	222bf0fe67	Merge branch 'trunk' into HDFS-6581	2014-09-19 10:02:27 -07:00
Kihwal Lee	f02d934fed	HDFS-6948. DN rejects blocks if it has older UC block. Contributed by Eric Payne.	2014-09-19 08:50:43 -05:00
arp	f8bbf80067	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsFileStatus.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsLocatedFileStatus.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java	2014-09-18 22:26:42 -07:00
arp	e79c98c11f	HDFS-7091. Add forwarding constructor for INodeFile for existing callers. (Arpit Agarwal)	2014-09-18 19:20:25 -07:00
Andrew Wang	8e73084491	HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang)	2014-09-18 17:49:17 -07:00
Andrew Wang	20a076bafc	HDFS-6970. Move startFile EDEK retries to the DFSClient. (wang)	2014-09-18 17:35:24 -07:00
Colin Patrick Mccabe	fe38d2e9b5	HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe)	2014-09-18 16:52:46 -07:00
arp	849ccfa699	Merge branch 'trunk' into HDFS-6581	2014-09-18 11:06:40 -07:00
Jing Zhao	76ccb80fad	HDFS-7088. Archival Storage: fix TestBalancer and TestBalancerWithMultipleNameNodes. Contributed by Tsz Wo Nicholas Sze.	2014-09-18 10:54:01 -07:00
Tsz-Wo Nicholas Sze	2d2b0009e6	Merge branch 'trunk' into HDFS-6584 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java	2014-09-18 13:00:29 +08:00
Andrew Wang	0ecefe6017	HDFS-7078. Fix listEZs to work correctly with snapshots. (wang)	2014-09-17 21:28:05 -07:00
Andrew Wang	10e8602f32	HDFS-7004. Update KeyProvider instantiation to create by URI. (wang)	2014-09-17 20:14:40 -07:00
arp	4eab083b1b	HDFS-7080. Fix finalize and upgrade unit test failures. (Arpit Agarwal)	2014-09-17 15:25:04 -07:00
arp	a186d514bd	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java	2014-09-17 15:03:55 -07:00
Jing Zhao	911979c8ab	Merge changes from trunk	2014-09-17 13:12:45 -07:00
Colin Patrick Mccabe	e3803d002c	HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe)	2014-09-17 12:55:35 -07:00
arp	24f8156886	Merge branch 'trunk' into HDFS-6581	2014-09-17 12:10:50 -07:00
Andrew Wang	ea4e2e843e	HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang)	2014-09-17 11:23:47 -07:00
Tsz-Wo Nicholas Sze	bd2e409de1	HDFS-7072. Fix TestBlockManager and TestStorageMover. Contributed by Jing Zhao	2014-09-17 13:48:32 +08:00
arp	a24a9331d4	Merge branch 'trunk' into HDFS-6581	2014-09-16 18:18:09 -07:00
Jing Zhao	432b863719	Merge changes from trunk	2014-09-16 17:58:39 -07:00
Andrew Wang	a044407b5c	HDFS-6789. TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7. Contributed by Akira Ajisaka.	2014-09-16 17:02:06 -07:00
Benoy Antony	02adf7185d	HDFS-6799. The invalidate method in SimulatedFSDataset failed to remove (invalidate) blocks from the file system. Contributed by Megasthenis Asteris.	2014-09-16 16:24:23 -07:00
arp	4603e4481f	HDFS-7064. Fix unit test failures in HDFS-6581 branch. (Contributed by Xiaoyu Yao)	2014-09-16 15:45:07 -07:00
Alejandro Abdelnur	3e85f5b605	HDFS-7006. Test encryption zones with KMS. (Anthony Young-Garner and tucu)	2014-09-16 14:36:07 -07:00
arp	e0d7fb48fb	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/Receiver.java	2014-09-16 14:32:57 -07:00
Colin Patrick Mccabe	56119fec96	HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe)	2014-09-16 13:59:32 -07:00
Kihwal Lee	0c26412be4	HDFS-6965. NN continues to issue block locations for DNs with full disks. Contributed by Rushabh Shah.	2014-09-16 09:04:54 -05:00
arp	a7814e1aa4	Merge branch 'trunk' into HDFS-6581	2014-09-15 15:30:19 -07:00
Kihwal Lee	2f847b3357	HDFS-7059. HAadmin transtionToActive with forceActive option can show confusing message. Contributed by Rushabh Shah.	2014-09-15 16:27:22 -05:00
Jing Zhao	ece3ecabdf	Merge remote-tracking branch 'origin/trunk' into HDFS-6584	2014-09-15 10:45:45 -07:00
Andrew Wang	43b0303008	HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb.	2014-09-15 10:23:57 -07:00
Jing Zhao	2689b6ca72	HDFS-7062. Archival Storage: skip under construction block for migration. Contributed by Jing Zhao.	2014-09-15 10:16:56 -07:00
Andrew Wang	fc741b5d78	HDFS-7061. Add test to verify encryption zone creation after NameNode restart without saving namespace. Contributed by Stephen Chu.	2014-09-14 23:49:01 -07:00
Tsz-Wo Nicholas Sze	dba52ce0bb	Merge branch 'trunk' into HDFS-6584	2014-09-13 14:56:48 +08:00
arp	9f22fb8c9a	HDFS-6978. Directory scanner should correctly reconcile blocks on RAM disk. (Arpit Agarwal)	2014-09-12 22:13:18 -07:00
arp	7aeda47bd9	Merge branch 'trunk' into HDFS-6581	2014-09-12 11:45:11 -07:00
cnauroth	d6ce26986e	HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator. Contributed by Chris Nauroth.	2014-09-11 20:58:15 -07:00
Jing Zhao	8de20a1987	Merge trunk into HDFS-6584	2014-09-11 13:04:35 -07:00
Jing Zhao	0d85f7e591	HDFS-7034. Archival Storage: Fix TestBlockPlacement and TestStorageMover. Contributed by Jing Zhao.	2014-09-11 13:00:43 -07:00
Andrew Wang	1e684995d7	HDFS-7045. Fix NameNode deadlock when opening file under /.reserved path. Contributed by Yi Liu.	2014-09-11 10:59:09 -07:00
Andrew Wang	bf64fce78c	HDFS-6966. Add additional unit tests for encryption zones. Contributed by Stephen Chu.	2014-09-11 10:26:13 -07:00
Tsz-Wo Nicholas Sze	70dfe9cfab	Merge branch 'trunk' into HDFS-6584	2014-09-11 15:23:38 +08:00
Jing Zhao	db41a1b7b9	Merge changes from trunk	2014-09-09 22:47:50 -07:00
Alejandro Abdelnur	bbff44cb03	HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu)	2014-09-09 22:16:42 -07:00
arp	0d2f6b4600	Merge branch 'trunk' into HDFS-6581	2014-09-09 18:07:18 -07:00
Konstantin V Shvachko	05af0ff4be	Revert HDFS-6940.	2014-09-09 17:30:10 -07:00
cnauroth	2749fc677c	Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang.	2014-09-09 11:32:54 -07:00
arp	61ccd50362	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java	2014-09-08 22:44:04 -07:00
arp	f949f6b548	HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal)	2014-09-08 21:20:55 -07:00
Andrew Wang	04915a0814	HDFS-6951. Correctly persist raw namespace xattrs to edit log and fsimage. Contributed by Charles Lamb.	2014-09-08 16:59:30 -07:00
Jing Zhao	6997c1c658	Merge remote-tracking branch 'origin/trunk' into HDFS-6584	2014-09-08 15:15:34 -07:00
arp	4ff128af12	Merge branch 'trunk' into HDFS-6581	2014-09-08 15:00:01 -07:00
Jing Zhao	867f0f141c	HDFS-7029. Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem. Contributed by Tsz Wo Nicholas Sze.	2014-09-08 14:57:27 -07:00
arp	a18caf7753	HDFS-6991. Notify NN of evicted block before deleting it from RAM disk. (Arpit Agarwal)	2014-09-08 14:29:30 -07:00
Jing Zhao	74a7e227c8	HDFS-7027. Archival Storage: Mover does not terminate when some storage type is out of space. Contributed by Tsz Wo Nicholas Sze.	2014-09-08 14:21:26 -07:00
Jing Zhao	2b5c528a73	HDFS-6875. Archival Storage: support migration for a list of specified paths. Contributed by Jing Zhao.	2014-09-08 14:10:00 -07:00
Colin Patrick Mccabe	cad14aa916	HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe)	2014-09-08 12:51:56 -07:00
Kihwal Lee	6a84f88c11	HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp.	2014-09-08 14:41:44 -05:00
arp	ccdf0054a3	HDFS-6977. Delete all copies when a block is deleted from the block space. (Arpit Agarwal)	2014-09-08 10:35:54 -07:00
Tsz-Wo Nicholas Sze	f1432e2424	Merge branch 'trunk' into HDFS-6584 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java	2014-09-08 10:54:48 +08:00
arp	eb8284d50e	Merge trunk into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java	2014-09-07 14:46:46 -07:00
cnauroth	a23144fd8a	HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao.	2014-09-07 08:39:20 -07:00
arp	d1fa58292e	HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal)	2014-09-06 21:04:29 -07:00
Tsz-Wo Nicholas Sze	22a41dce4a	HDFS-6997: add more tests for data migration and replicaion.	2014-09-07 07:44:28 +08:00
arp	31bbeaf383	Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581	2014-09-06 12:28:22 -07:00
Konstantin V Shvachko	88209ce181	HDFS-6940. Refactoring to allow ConsensusNode implementation. Contributed by Konstantin Shvachko.	2014-09-06 12:07:52 -07:00
Alejandro Abdelnur	3b35f81603	HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu)	2014-09-05 22:33:48 -07:00
arp	339d21f273	Merge trunk into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java	2014-09-05 21:36:25 -07:00
arp	c5ef9c9e69	HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)	2014-09-05 13:50:42 -07:00
Jing Zhao	54767d3ff4	Fix TestOfflineEditsViewer after merging.	2014-09-05 12:05:22 -07:00
Jing Zhao	300cb12bef	Merge trunk into HDFS-6584	2014-09-05 11:37:22 -07:00
arp	9609b7303a	HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)	2014-09-05 11:10:58 -07:00
arp	9e941d9f99	HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao)	2014-09-05 10:45:54 -07:00
Jing Zhao	c6107f566f	HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai.	2014-09-05 10:40:02 -07:00
Vinayakumar B	772d1fb01e	HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb)	2014-09-05 10:25:09 +05:30
Jing Zhao	185200e709	HDFS-6876. Archival Storage: support set/get storage policy in DFSAdmin. Contributed by Jing Zhao.	2014-09-04 20:14:46 -07:00
Jing Zhao	6104520369	HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu.	2014-09-04 18:54:38 -07:00
Jing Zhao	f7df24bb1b	HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao.	2014-09-04 16:12:44 -07:00
Jing Zhao	e08701ec71	HDFS-6961. Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round.	2014-09-04 14:19:32 -07:00
Colin Patrick Mccabe	f4caedfcbf	HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang	2014-09-03 19:30:30 -07:00
Jing Zhao	45d5b13256	Merge changes from trunk	2014-09-03 15:36:47 -07:00
arp	08a8f2be81	Merge trunk into HDFS-6581	2014-09-03 10:53:37 -07:00
arp	762b04e994	HDFS-6950. Add Additional unit tests for HDFS-6581. (Contributed by Xiaoyu Yao)	2014-09-03 10:51:26 -07:00
Uma Maheswara Rao G	3425ae5d7e	HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh)	2014-09-03 18:53:51 +05:30
arp	a6b32a3e78	Merge trunk into HDFS-6581	2014-09-02 16:25:32 -07:00
Haohui Mai	08a9ac7098	HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang.	2014-09-02 16:22:18 -07:00
Colin Patrick Mccabe	727331becc	HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo.	2014-09-02 15:14:33 -07:00
Andrew Wang	faa4455be5	HDFS-6634. inotify in HDFS. Contributed by James Thomas.	2014-09-02 14:02:29 -07:00
Jing Zhao	3e2a0b5446	HDFS-6969. Archival Storage: INode#getStoragePolicyID should always return the latest storage policy. Contributed by Jing Zhao.	2014-09-01 17:56:04 -07:00
arp	217dea7794	Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581	2014-09-01 11:52:59 -07:00
Andrew Wang	6066b1a455	HDFS-6972. TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctly. Contributed by Yongjun Zhang.	2014-08-29 15:47:01 -07:00
arp	f65183eba3	Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java	2014-08-29 13:37:17 -07:00
Aaron T. Myers	7eab2a29a5	HDFS-6774. Make FsDataset and DataStore support removing volumes. Contributed by Lei Xu.	2014-08-29 13:00:17 -07:00
arp	c92837aeab	HDFS-6931. Move lazily persisted replicas to finalized directory on DN startup. (Arpit Agarwal)	2014-08-28 23:13:46 -07:00
arp	4cf9afacbe	HDFS-6960. Bugfix in LazyWriter, fix test case and some refactoring. (Arpit Agarwal)	2014-08-28 23:05:32 -07:00
arp	7e32be8768	Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581 Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt	2014-08-28 19:06:46 -07:00
Todd Lipcon	ab638e77b8	HDFS-6865. Byte array native checksumming on client side. Contributed by James Thomas.	2014-08-28 16:44:09 -07:00
arp	bbaa7dc28d	HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal)	2014-08-28 15:53:12 -07:00
arp	2e987148e0	HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace. (Arpit Agarwal)	2014-08-27 21:47:19 -07:00
arp	3f64c4aaf0	HDFS-6927. Initial unit tests for Lazy Persist files. (Arpit Agarwal)	2014-08-27 21:47:19 -07:00
arp	eb448e1439	HDFS-6926. DN support for saving replicas to persistent storage and evicting in-memory replicas. (Arpit Agarwal)	2014-08-27 21:47:19 -07:00
arp	a317bd7b02	HDFS-6925. DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received. (Arpit Agarwal)	2014-08-27 21:47:19 -07:00
arp	c2354a7f81	HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol. (Arpit Agarwal)	2014-08-27 21:47:18 -07:00
arp	042b33f20b	HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and edit logs. (Arpit Agarwal)	2014-08-27 21:47:18 -07:00
arp	7f49537ba1	HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)	2014-08-27 21:47:18 -07:00
arp	a7bcc95358	HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal)	2014-08-27 21:47:18 -07:00
Colin Patrick Mccabe	7a16731191	HADOOP-10957. The globber will sometimes erroneously return a permission denied exception when there is a non-terminal wildcard.	2014-08-27 19:47:10 -07:00
Jing Zhao	a26aa6bd07	HDFS-6944. Archival Storage: add retry and termination logic for Mover. Contributed by Jing Zhao.	2014-08-27 14:20:54 -07:00
Colin Patrick Mccabe	6962510f72	HDFS-6879. Adding tracing to Hadoop RPC. Contributed by Masatake Iwasaki.	2014-08-27 14:12:05 -07:00
Jing Zhao	b7ded466b0	HDFS-6920. Archival Storage: check the storage type of delNodeHintStorage when deleting a replica. Contributed by Tsz Wo Nicholas Sze.	2014-08-27 14:08:02 -07:00
Colin Patrick Mccabe	d805cc27a9	HDFS-6773. MiniDFSCluster should skip edit log fsync by default. Contributed by Stephen Chu.	2014-08-27 13:33:02 -07:00
Jing Zhao	8ea20b53a8	HDFS-6911. Archival Storage: check if a block is already scheduled in Mover. Contributed by Tsz Wo Nicholas Sze.	2014-08-27 10:38:10 -07:00
Jing Zhao	555900a9dc	Merge branch 'trunk' into HDFS-6584	2014-08-27 10:32:30 -07:00
Jing Zhao	6b441d227a	HDFS-6908. Incorrect snapshot directory diff generated by snapshot deletion. Contributed by Juan Yu and Jing Zhao.	2014-08-27 10:26:22 -07:00
arp	c5d9a4a91e	HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms - debugging patch (Contributed by Yongjun Zhang)	2014-08-27 09:52:33 -07:00
Arpit Agarwal	e871955765	HDFS-6899. Allow changing MiniDFSCluster volumes per DN and capacity per volume. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619970 13f79535-47bb-0310-9956-ffa450edef68	2014-08-23 06:01:17 +00:00
Jing Zhao	e69954d22c	HDFS-6906. Archival Storage: Add more tests for BlockStoragePolicy. Contributed by Tsz Wo Nicholas Sze. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619628 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 23:42:33 +00:00
Tsz-wo Sze	c92d869d02	Merge r1609845 through r1619277 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619293 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 05:22:10 +00:00
Arpit Agarwal	6824abc19e	HDFS-6758. Block writer should pass the expected block size to DataXceiverServer (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619275 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 01:13:49 +00:00
Arpit Agarwal	8f00897a4b	HDFS-6878. Change MiniDFSCluster to support StorageType configuration for individual directories. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619271 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 00:42:27 +00:00
Andrew Wang	834fccf02b	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619194 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 18:19:13 +00:00
Jing Zhao	f20d363126	HDFS-6870. Blocks and INodes could leak for Rename with overwrite flag. Contributed by Yi Liu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619192 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 18:13:03 +00:00
Andrew Wang	d2a39b61aa	Merge from trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619018 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 01:22:42 +00:00
Tsz-wo Sze	4e324bcd3d	Merge r1609845 through r1618763 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618764 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 23:41:53 +00:00
Brandon Li	2fb04d2a30	HDFS-6569. OOB message can't be sent to the client when DataNode shuts down for upgrade. Contributed by Brandon Li git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618742 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 21:23:08 +00:00
Andrew Wang	0cc08f6da4	Merge from trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618700 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 18:41:31 +00:00
Andrew Wang	bd616552cc	HDFS-6825. Edit log corruption due to delayed block removal. Contributed by Yongjun Zhang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618684 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 18:08:42 +00:00
Tsz-wo Sze	cb75b6b07d	Merge r1609845 through r1618416 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618417 13f79535-47bb-0310-9956-ffa450edef68	2014-08-16 21:02:21 +00:00
Tsz-wo Sze	9b250d74f0	HDFS-6847. Support storage policy on directories and include storage policy in HdfsFileStatus. Contributed by Jing Zhao git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618416 13f79535-47bb-0310-9956-ffa450edef68	2014-08-16 20:58:20 +00:00
Charles Lamb	20dcb841ce	HDFS-6546. Add non-superuser capability to get the encryption zone for a specific path. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618022 13f79535-47bb-0310-9956-ffa450edef68	2014-08-14 19:11:06 +00:00
Vinayakumar B	195961a7c1	HDFS-6247. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (vinayakumarb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617799 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 18:43:05 +00:00
Vinayakumar B	6554994fab	Reverted Merged revision(s) 1617784 from hadoop/common/trunk: HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.) ........ git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617794 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 18:36:51 +00:00
Vinayakumar B	471b1368e2	HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617784 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 18:06:33 +00:00
Allen Wittenauer	a34dafe325	HADOOP-8944. Shell command fs -count should include human readable option (Jonathan Allen via aw) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617775 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 17:30:26 +00:00
Arpit Agarwal	662c5bb3af	HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617598 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 21:42:21 +00:00
Jing Zhao	37207b75d4	HDFS-6835. Archival Storage: Add a new API to set storage policy. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617568 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 19:32:09 +00:00
Charles Lamb	74f7be0887	merge from trunk r1617527 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1617532 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 17:02:07 +00:00
Jing Zhao	04884cd530	Merging r1616894 through r1617376 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617377 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 22:27:50 +00:00
Jing Zhao	e60673697d	HDFS-6837. Code cleanup for Balancer and Dispatcher. Contributed by Tsz Wo Nicholas Sze. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617337 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 18:01:14 +00:00
Jing Zhao	9d5f8fa68d	Merging r1616428 through r1616893 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616897 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 22:21:35 +00:00
Jing Zhao	c3cf331dc9	HDFS-6828. Separate block replica dispatching from Balancer. Contributed by Tsz Wo Nicholas Sze. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616889 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:33:57 +00:00
Arpit Agarwal	05d1bf4157	HDFS-6830. Revert accidental checkin git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616884 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:22:48 +00:00
Arpit Agarwal	a70c9de3f1	HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616883 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:20:19 +00:00
Charles Lamb	e6bdb33784	HADOOP-10919. Copy command should preserve raw.* namespace extended attributes. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616840 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 17:58:01 +00:00
Arpit Agarwal	d3a2fe2807	HDFS-6772. Get DN storages out of blockContentsStale state faster after NN restarts. (Contributed by Ming Ma) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616680 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 05:41:38 +00:00
Haohui Mai	2ac640ec75	HDFS-6722. Display readable last contact time for dead nodes on NN webUI. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616669 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 04:27:47 +00:00
Aaron Myers	d758be1f35	HDFS-6740. Make FSDataset support adding data volumes dynamically. Contributed by Lei Xu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616623 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 22:59:59 +00:00
Aaron Myers	eca80dca3e	HDFS-6728. Dynamically add new volumes to DataStorage, formatted if necessary. Contributed by Lei Xu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616615 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 22:46:51 +00:00
Andrew Wang	311d2f0773	Merge from trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616589 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 20:26:52 +00:00
Tsz-wo Sze	b50cb5e056	Merge r1609845 through r1616427 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616428 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 07:38:23 +00:00
Tsz-wo Sze	0ed8732fee	HDFS-6812. Remove addBlock and replaceBlock from DatanodeDescriptor. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616426 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 07:30:53 +00:00
Jing Zhao	efc73a0f13	HDFS-6791. A block could remain under replicated if all of its replicas are on decommissioned nodes. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616306 13f79535-47bb-0310-9956-ffa450edef68	2014-08-06 19:03:07 +00:00
Brandon Li	812ac91add	HDFS-6790. DFSUtil Should Use configuration.getPassword for SSL passwords. Contributed by Larry McCay git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616058 13f79535-47bb-0310-9956-ffa450edef68	2014-08-06 00:50:07 +00:00
Andrew Wang	ac73d416f3	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615844 13f79535-47bb-0310-9956-ffa450edef68	2014-08-05 02:30:54 +00:00
Uma Maheswara Rao G	10db613389	HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not loaded. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615523 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 09:56:57 +00:00
Vinayakumar B	33518e5613	HDFS-5185. DN fails to startup if one of the data dir is full. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615504 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 08:43:51 +00:00
Vinayakumar B	30a9ec26f7	HDFS-5723. Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615491 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 06:44:06 +00:00
Colin McCabe	1ba3f89714	HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 20:41:05 +00:00
Andrew Wang	70c99278a9	HDFS-6780. Batch the encryption zones listing API. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615189 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 18:47:01 +00:00
Charles Lamb	3d9e39e51f	HDFS-6807. Fix TestReservedRawPaths. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615188 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 18:36:32 +00:00
Andrew Wang	da2ce46fbe	HDFS-6802. Some tests in TestDFSClientFailover are missing @Test annotation. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615183 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 17:58:14 +00:00
Arpit Agarwal	45db4d204b	HDFS-6794. Update BlockManager methods to use DatanodeStorageInfo where possible. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615169 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 16:58:06 +00:00
Tsz-wo Sze	7e12b1912f	HDFS-6796. Improve the argument check during balancer command line parsing. Contributed by Benoy Antony git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615107 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 14:12:35 +00:00
Arpit Agarwal	397c882362	HDFS-6798. Add test case for incorrect data node condition during balancing. (Contributed by Benoy Antony) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615044 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 07:12:39 +00:00
Tsz-wo Sze	dc7744d2e5	Merge r1609845 through r1615019 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1615020 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 01:29:49 +00:00
Tsz-wo Sze	b8597e6a10	HDFS-6685. Balancer should preserve storage type of replicas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615015 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 01:05:33 +00:00
Arpit Agarwal	b8b8f3f5e7	HDFS-6441. Add ability to exclude/include specific datanodes while balancing. (Contributed by Benoy Antony and Yu Li) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614812 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 06:02:46 +00:00
Charles Lamb	ab47b666d0	HDFS-6785. Should not be able to create encryption zone using path to a non-directory file. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614755 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 20:00:24 +00:00
Andrew Wang	7405953692	HDFS-6692. Add more HDFS encryption tests. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614735 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 18:39:48 +00:00
Arpit Agarwal	18360e71f1	HDFS-6768. Fix a few unit tests that use hard-coded port numbers. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614732 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 18:37:41 +00:00
Chris Nauroth	535fe14ded	HDFS-6570. add api that enables checking if a user has certain permissions on a file. Contributed by Jitendra Pandey. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614723 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 17:49:09 +00:00
Andrew Wang	c3fa0b5884	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614553 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 06:09:33 +00:00
Andrew Wang	12241908ad	HDFS-6665. Add tests for XAttrs in combination with viewfs. Contributed by Stephen Chu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614545 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 05:53:20 +00:00
Charles Lamb	9ca2f34c8f	HDFS-6730. Create a .RAW extended attribute namespace. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614535 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 01:35:04 +00:00
Andrew Wang	415223548d	HDFS-6771. Require specification of an encryption key when creating an encryption zone. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614519 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 23:39:38 +00:00
Andrew Wang	3a90228c30	HDFS-6509 addendum, extra file git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614491 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 21:11:52 +00:00
Andrew Wang	407bb3d3e4	HDFS-6509. Create a special /.reserved/raw directory for raw access to encrypted data. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614490 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 21:11:26 +00:00
Tsz-wo Sze	10d6210322	Merge r1609845 through r1614231 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1614234 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 00:49:14 +00:00
Tsz-wo Sze	4f9ffc7455	HDFS-6739. Add getDatanodeStorageReport to ClientProtocol. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614215 13f79535-47bb-0310-9956-ffa450edef68	2014-07-28 23:43:39 +00:00
Charles Lamb	1d3e9ec935	merge from trunk r1613787 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613788 13f79535-47bb-0310-9956-ffa450edef68	2014-07-27 13:32:51 +00:00
Chris Nauroth	9bce3eca42	HDFS-6749. FSNamesystem methods should call resolvePath. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613561 13f79535-47bb-0310-9956-ffa450edef68	2014-07-26 04:18:28 +00:00
Colin McCabe	e85a3fecc6	HDFS-6750. The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613537 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 23:56:47 +00:00
Andrew Wang	b9e4be4523	HDFS-6724. Decrypt EDEK before creating CryptoInputStream/CryptoOutputStream. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613490 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 18:33:10 +00:00
Vinayakumar B	cc0464f4fe	HDFS-6752. Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit (vinayakumarb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613486 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 18:17:50 +00:00
Vinayakumar B	2bb650146d	HDFS-5919. FileJournalManager doesn't purge empty and corrupt inprogress edits files (vinayakumarb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613355 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 07:02:53 +00:00
Andrew Wang	e670641bbf	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613334 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 23:55:15 +00:00
Andrew Wang	e171254d56	Name node cannot start if the path of a file under construction contains .snapshot. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613329 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 23:42:06 +00:00
Jing Zhao	8c6e172a0a	HDFS-6715. Webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613237 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 18:28:00 +00:00
Todd Lipcon	2054453a39	HADOOP-10882. Move DirectBufferPool into common util. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613006 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 06:22:02 +00:00
Andrew Wang	552b4fb9f9	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612928 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 19:26:29 +00:00
Uma Maheswara Rao G	5343b43fd9	HDFS-6422. getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist. (Charles Lamb via umamahesh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612922 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 19:05:11 +00:00
Tsz-wo Sze	48dc486672	Merge r1609845 through r1612880 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612883 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 17:30:06 +00:00
Charles Lamb	687ce1a5fc	HDFS-6733. Creating encryption zone results in NPE when KeyProvider is null. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612843 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 14:51:06 +00:00
Andrew Wang	69b75fca7a	HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612632 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 17:57:06 +00:00
Andrew Wang	c83c5b868e	HDFS-6701. Make seed optional in NetworkTopology#sortByDistance. Contributed by Ashwin Shankar. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612625 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 17:47:49 +00:00
Tsz-wo Sze	ee13f8bf3e	Merge r1609845 through r1612502 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612505 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 08:23:34 +00:00
Tsz-wo Sze	25b0e8471e	HDFS-6702. Change DFSClient to pass the StorageType from the namenode to datanodes and change datanode to write block replicas using the specified storage type. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612493 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 07:41:24 +00:00
Andrew Wang	7b466b3b70	HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612438 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 00:27:51 +00:00
Tsz-wo Sze	3de6c61f86	Merge r1609845 through r1612431 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612432 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 23:37:54 +00:00
Tsz-wo Sze	44d9bb26d6	HDFS-6680. BlockPlacementPolicyDefault does not choose favored nodes correctly. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612427 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 23:21:12 +00:00
Andrew Wang	cb20bb6117	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612403 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 21:44:50 +00:00
Tsz-wo Sze	ee3a32784f	Merge r1609845 through r1612268 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612270 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 13:48:02 +00:00
Tsz-wo Sze	0a736fbc17	HDFS-6679. Bump NameNodeLayoutVersion and update editsStored test files. Contributed by vinayakumarb git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612266 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 13:38:06 +00:00
Tsz-wo Sze	014be2510f	HDFS-6710. Change BlockPlacementPolicy to consider block storage policy in replica deletion. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612265 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 13:34:10 +00:00
Alejandro Abdelnur	64ed72a047	HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611780 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 19:42:01 +00:00
Tsz-wo Sze	7c18f8d55b	HDFS-6616. Add exclude-datanodes feature to WebHDFS redirection so that it will not redirect retries to the same datanode. Contributed by zhaoyunjiong git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611750 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 18:20:20 +00:00
Daryn Sharp	551024915d	HDFS-6599. 2.4 addBlock is 10 to 20 times slower compared to 0.23 (daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611737 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:58:07 +00:00
Tsz-wo Sze	2b07af0c59	Merge r1609845 through r1611734 from tunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611736 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:57:51 +00:00
Tsz-wo Sze	08466eaa00	HDFS-6700. BlockPlacementPolicy shoud choose storage but not datanode for deletion. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611731 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:40:03 +00:00
Chris Nauroth	5f9e52f745	HDFS-6597. Add a new option to NN upgrade to terminate the process after upgrade on NN is completed. Contributed by Danilo Vunjak. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611723 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:14:22 +00:00
Tsz-wo Sze	04fd2012fd	Merge r1609845 through r1611528 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611531 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 02:21:21 +00:00
Jing Zhao	7ba5913797	HDFS-6667. In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611508 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 23:11:27 +00:00
Vinayakumar B	ce1659f070	HDFS-6693. TestDFSAdminWithHA fails on windows ( Contributed by Vinayakumar B ) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611441 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 19:17:51 +00:00
Jing Zhao	f4151bbf4f	HDFS-6478. RemoteException can't be retried properly for non-HA scenario. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611410 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 17:37:22 +00:00
Tsz-wo Sze	38af6101d8	HDFS-6671. Change BlockPlacementPolicy to consider block storage policy in replicaiton. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611334 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 11:56:22 +00:00
Andrew Wang	77f0e2cca5	HDFS-6405. Test Crypto streams in HDFS. (yliu via wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1611140 13f79535-47bb-0310-9956-ffa450edef68	2014-07-16 19:04:06 +00:00
Chris Nauroth	43fe48d9e2	HDFS-5624. Add HDFS tests for ACLs in combination with viewfs. Contributed by Stephen Chu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611068 13f79535-47bb-0310-9956-ffa450edef68	2014-07-16 16:27:38 +00:00
Andrew Wang	56c0bd4d37	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610853 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 21:10:24 +00:00
Andrew Wang	b066be8115	HDFS-6619. Clean up encryption-related tests. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610849 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 20:59:40 +00:00
Colin McCabe	7fe6ab7f91	HDFS-5809. BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610790 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 18:17:13 +00:00
Chris Nauroth	97b5fbc281	HDFS-6678. MiniDFSCluster may still be partially running after initialization fails. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610549 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 22:49:08 +00:00
Tsz-wo Sze	395c763aef	Merge r1609845 through r1610532 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610533 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 21:23:20 +00:00
Tsz-wo Sze	4f1fae88f8	HDFS-6670. Add block storage policy support with default HOT, WARM and COLD policies. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610529 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 21:11:22 +00:00
Tsz-wo Sze	6f41baa623	HDFS-6677. Change INodeFile and FSImage to support storage policy ID. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610525 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 20:57:15 +00:00
Chris Nauroth	3b54223c0f	HDFS-2856. Fix block protocol so that Datanodes don't require root or jsvc. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610474 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 18:10:03 +00:00
Andrew Wang	d79f27b429	HDFS-6474. Namenode needs to get the actual keys and iv from the KeyProvider. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609833 13f79535-47bb-0310-9956-ffa450edef68	2014-07-11 20:54:47 +00:00
Chris Nauroth	81930b75bd	HDFS-5202. Support Centralized Cache Management on Windows. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609618 13f79535-47bb-0310-9956-ffa450edef68	2014-07-11 03:06:11 +00:00
Kihwal Lee	8f520386fb	HDFS-6647. Edit log corruption when pipeline recovery occurs for deleted file present in snapshot. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609543 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 18:18:22 +00:00
Chris Nauroth	cce02e3bef	HDFS-6631. TestPread#testHedgedReadLoopTooManyTimes fails intermittently. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609534 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 18:03:32 +00:00
Tsz-wo Sze	e67b80ec3a	HDFS-6643. Refactor INodeWithAdditionalFields.PermissionStatusFormat and INodeFile.HeaderFormat. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609401 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 06:16:34 +00:00
Jing Zhao	36492f084b	HDFS-6645. Add test for successive Snapshots between XAttr modifications. Contributed by Stephen Chu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609388 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 05:01:41 +00:00
Colin McCabe	d9c5f20333	HDFS-6622. Rename and AddBlock may race and produce invalid edits (kihwal via cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609384 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 04:03:02 +00:00
Chris Nauroth	f62e93d591	HDFS-6638. Shorten test run time with a smaller retry timeout setting. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608905 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 19:16:48 +00:00
Chris Nauroth	3470dd9a2f	HDFS-6614. Addendum patch to shorten TestPread run time with smaller retry timeout setting. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608846 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 16:43:16 +00:00
Haohui Mai	76a621ffd2	HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 00:08:18 +00:00
Andrew Wang	dda85637df	Merge trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608603 13f79535-47bb-0310-9956-ffa450edef68	2014-07-07 20:43:56 +00:00
Chris Nauroth	93c1bc8114	HDFS-6617. Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608522 13f79535-47bb-0310-9956-ffa450edef68	2014-07-07 17:37:04 +00:00
Andrew Wang	f881f0e923	HDFS-6493. Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond. Contributed by Juan Yu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607732 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 20:02:14 +00:00
Andrew Wang	93e23a9915	HDFS-6613. Improve logging in caching classes. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607697 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 17:13:59 +00:00
Uma Maheswara Rao G	160c912ee6	HDFS-6620. Snapshot docs should specify about preserve options with cp command. Contributed by Stephen Chu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607685 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 16:08:44 +00:00
Steve Loughran	b6fbaba8e9	HADOOP-9361: Strictly define FileSystem APIs - HDFS portion git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607597 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 12:09:45 +00:00
Charles Lamb	2a3bccddd9	HDFS-6625. Remove the Delete Encryption Zone function (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607507 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 00:58:45 +00:00
Andrew Wang	51b97a1396	HDFS-6605.Client server negotiation of cipher suite. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607499 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 23:08:29 +00:00
Andrew Wang	9b5d551ad9	HDFS-6610. TestShortCircuitLocalRead tests sometimes timeout on slow machines. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607496 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 23:02:24 +00:00
Colin McCabe	297e3c72fb	HDFS-6604. The short-circuit cache doesn't correctly time out replicas that haven't been used in a while (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607456 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 19:43:36 +00:00
Chris Nauroth	130182df1b	HDFS-6614. shorten TestPread run time with a smaller retry timeout setting. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607447 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 18:57:25 +00:00
Andrew Wang	9dfe9cf400	HDFS-6612. MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID. Contributed by Juan Yu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607442 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 18:37:00 +00:00
Chris Nauroth	c89bf0184d	HDFS-6603. Add XAttr with ACL test. Contributed by Stephen Chu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607239 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 03:20:25 +00:00
Chris Nauroth	0ca41a8f35	HDFS-6591. while loop is executed tens of thousands of times in Hedged Read. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606927 13f79535-47bb-0310-9956-ffa450edef68	2014-06-30 20:46:44 +00:00
Kihwal Lee	94a1462bd5	HDFS-6601. Issues in finalizing rolling upgrade when there is a layout version change. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606371 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 15:21:46 +00:00
Uma Maheswara Rao G	78cafe34e6	HDFS-6556. Refine XAttr permissions. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606320 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 11:40:02 +00:00
Charles Lamb	31617733ac	HDFS-6389. Rename restrictions for encryption zones. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1606253 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 21:45:18 +00:00
Andrew Wang	2efea95213	HDFS-6391. Get the Key/IV from the NameNode for encrypted files in DFSClient. Contributed by Charles Lamb and Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1606220 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 20:43:41 +00:00
Chris Nauroth	280bdb9a16	HDFS-6572. Add an option to the NameNode that prints the software and on-disk image versions. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605928 13f79535-47bb-0310-9956-ffa450edef68	2014-06-26 23:12:45 +00:00
Chris Nauroth	c3e26735a6	HADOOP-9705. FsShell cp -p does not preserve directory attibutes. Contributed by Akira AJISAKA. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605672 13f79535-47bb-0310-9956-ffa450edef68	2014-06-26 05:36:54 +00:00
Tsz-wo Sze	e3612e4428	HDFS-6595. Allow the maximum threads for balancing on datanodes to be configurable. Contributed by Benoy Antony git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605565 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 19:27:29 +00:00
Charles Lamb	2676365799	HDFS-6387. HDFS CLI admin tool for creating & deleting an encryption zone. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1605518 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 17:42:03 +00:00
Aaron Myers	55a1defa50	HDFS-6475. WebHdfs clients fail without retry because incorrect handling of StandbyException. Contributed by Yongjun Zhang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605217 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 23:07:49 +00:00
Arpit Agarwal	9ddedbf3df	HDFS-6587. Bug in TestBPOfferService can cause test failure. (Contributed by Zhilei Xu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604899 13f79535-47bb-0310-9956-ffa450edef68	2014-06-23 18:21:00 +00:00
Vinayakumar B	e8ca648005	HDFS-6507. Improve DFSAdmin to support HA cluster better. (Contributd by Zesheng Wu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604692 13f79535-47bb-0310-9956-ffa450edef68	2014-06-23 05:16:05 +00:00
Haohui Mai	1e89eba47d	HDFS-6583. Remove clientNode in FileUnderConstructionFeature. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604541 13f79535-47bb-0310-9956-ffa450edef68	2014-06-22 07:39:36 +00:00
Jing Zhao	8a83bb7ad6	HDFS-4667. Capture renamed files/directories in snapshot diff report. Contributed by Jing Zhao and Binglin Chang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604488 13f79535-47bb-0310-9956-ffa450edef68	2014-06-21 22:59:34 +00:00
Chris Nauroth	0c51289695	HDFS-6222. Remove background token renewer from webhdfs. Contributed by Rushabh Shah and Daryn Sharp. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604300 13f79535-47bb-0310-9956-ffa450edef68	2014-06-20 23:58:23 +00:00
Haohui Mai	9ca79e8d32	HDFS-6557. Move the reference of fsimage to FSNamesystem. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604242 13f79535-47bb-0310-9956-ffa450edef68	2014-06-20 18:54:19 +00:00
Jing Zhao	d9eb18bb2e	HDFS-6535. HDFS quota update is wrong when file is appended. Contributed by George Wong. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604226 13f79535-47bb-0310-9956-ffa450edef68	2014-06-20 18:25:09 +00:00
Kihwal Lee	0da148dae7	HDFS-3848. A Bug in recoverLeaseInternal method of FSNameSystem class. Contributed by Hooman Peiro Sajjad and Chen He. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604011 13f79535-47bb-0310-9956-ffa450edef68	2014-06-19 19:05:25 +00:00
Andrew Wang	97583dbb0a	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603993 13f79535-47bb-0310-9956-ffa450edef68	2014-06-19 18:32:13 +00:00
Andrew Wang	d417e49ce4	HDFS-6492. Support create-time xattrs and atomically setting multiple xattrs. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603971 13f79535-47bb-0310-9956-ffa450edef68	2014-06-19 17:37:31 +00:00
Aaron Myers	3f82484218	HDFS-6563. NameNode cannot save fsimage in certain circumstances when snapshots are in use. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603712 13f79535-47bb-0310-9956-ffa450edef68	2014-06-19 05:17:58 +00:00
Haohui Mai	a4e0ff5e05	HDFS-6480. Move waitForReady() from FSDirectory to FSNamesystem. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603705 13f79535-47bb-0310-9956-ffa450edef68	2014-06-19 04:13:56 +00:00
Andrew Wang	5e5e1a6202	Merge trunk r1603663 to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603664 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 23:15:04 +00:00
Charles Lamb	6ef3a9e746	HDFS-6386. HDFS Encryption Zones (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603658 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 22:33:50 +00:00
Jing Zhao	4cf94aaf80	HDFS-6551. Rename with OVERWRITE option may throw NPE when the target file/directory is a reference INode. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603612 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 19:57:00 +00:00
Arpit Agarwal	52d18aa217	HDFS-6552. add DN storage to a BlockInfo will not replace the different storage from same DN. (Contributed by Amir Langer) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603602 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 19:37:18 +00:00
Jing Zhao	8e8a769e7f	HDFS-6527. Edit log corruption due to defered INode removal. Contributed by Kihwal Lee and Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603340 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 01:00:32 +00:00
Chris Nauroth	6e37dd331b	HADOOP-10557. FsShell -cp -pa option for preserving extended ACLs. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603222 13f79535-47bb-0310-9956-ffa450edef68	2014-06-17 17:08:07 +00:00
Andrew Wang	f4b1c44415	HDFS-6528. Add XAttrs to TestOfflineImageViewer. Contributed by Stephen Chu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603020 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 23:07:31 +00:00
Andrew Wang	45c52ef924	HDFS-6518. TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603016 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 22:47:58 +00:00
Charles Lamb	c5b7236d9c	merge from trunk r1602933 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1602947 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 18:13:57 +00:00
Andrew Wang	70db2ec417	HDFS-6470. TestBPOfferService.testBPInitErrorHandling is flaky. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602490 13f79535-47bb-0310-9956-ffa450edef68	2014-06-13 19:00:03 +00:00
Haohui Mai	02f3ff3387	HDFS-6330. Move mkdirs() to FSNamesystem. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602484 13f79535-47bb-0310-9956-ffa450edef68	2014-06-13 18:04:45 +00:00
Andrew Wang	be01103af7	HDFS-3493. Invalidate corrupted blocks as long as minimum replication is satisfied. Contributed by Juan Yu and Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602291 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 21:06:31 +00:00
Andrew Wang	befa4bb1ed	HDFS-6395. Skip checking xattr limits for non-user-visible namespaces. Contributed by Yi Liu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602288 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 20:55:06 +00:00
Chris Nauroth	2368332138	HADOOP-10561. Copy command with preserve option should handle Xattrs. Contributed by Yi Liu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602225 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 16:34:02 +00:00
Konstantin Boudnik	2f4f261cda	HDFS-6471. Make moveFromLocal CLI testcases to be non-disruptive (Contributed by Dasha Boudnik) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602064 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 05:48:26 +00:00
Arpit Agarwal	34e9173c00	HADOOP-10376. Refactor refresh*Protocols into a single generic refreshConfigProtocol. (Contributed by Chris Li) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602055 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 01:27:39 +00:00
Haohui Mai	e98529858e	HDFS-6315. Decouple recording edit logs from FSDirectory. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601960 13f79535-47bb-0310-9956-ffa450edef68	2014-06-11 17:22:44 +00:00
Andrew Wang	123c563fe6	HDFS-6460. Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance. Contributed by Yongjun Zhang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601535 13f79535-47bb-0310-9956-ffa450edef68	2014-06-10 00:39:20 +00:00
Colin McCabe	8b2b7ff0ae	HDFS-6257. TestCacheDirectives#testExceedsCapacity fails occasionally (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601473 13f79535-47bb-0310-9956-ffa450edef68	2014-06-09 18:39:37 +00:00
Junping Du	cc9bc8eef7	HDFS-6500. Snapshot shouldn't be removed silently after renaming to an existing snapshot. (Contributed by Nicholas SZE) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601199 13f79535-47bb-0310-9956-ffa450edef68	2014-06-08 07:06:35 +00:00
Konstantin Boudnik	fb7ea6d8bc	HDFS-6297. Add CLI testcases to reflect new features of dfs and dfsadmin (Contributed by Dasha Boudnik) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601059 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 05:22:34 +00:00
Colin McCabe	9528ed939d	HDFS-6497. Make TestAvailableSpaceVolumeChoosingPolicy deterministic (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601035 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 23:40:39 +00:00
Andrew Wang	14394eed00	HDFS-6487. TestStandbyCheckpoint#testSBNCheckpoints is racy. Contributed by Mit Desai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601016 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 21:36:56 +00:00
Uma Maheswara Rao G	6a4f6d6b3e	HDFS-6464. Support multiple xattr.name parameters for WebHDFS getXAttrs. Contributed by Yi Liu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600810 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 03:48:43 +00:00
Charles Lamb	bdee397e95	HADOOP-6392. Wire crypto streams for encrypted files in DFSClient. (clamb and yliu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600582 13f79535-47bb-0310-9956-ffa450edef68	2014-06-05 10:10:48 +00:00
Andrew Wang	02fcb6b6ba	HDFS-6268. Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599734 13f79535-47bb-0310-9956-ffa450edef68	2014-06-03 18:33:09 +00:00
Jing Zhao	a29d2d3371	HDFS-6424. blockReport doesn't need to invalidate blocks on SBN. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599397 13f79535-47bb-0310-9956-ffa450edef68	2014-06-03 00:47:11 +00:00
Michael Stack	f15ff5e4f4	HDFS-6109 let sync_file_range() system call run in background (Liang Xie via stack) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599347 13f79535-47bb-0310-9956-ffa450edef68	2014-06-02 20:27:15 +00:00
Andrew Wang	880a0c673c	HDFS-6375. Listing extended attributes with the search permission. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598788 13f79535-47bb-0310-9956-ffa450edef68	2014-05-31 00:12:02 +00:00
Arpit Agarwal	4a4868e523	HADOOP-10448. Support pluggable mechanism to specify proxy user settings (Contributed by Benoy Antony) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598396 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 20:52:01 +00:00
Andrew Wang	66c5bcfc6d	HDFS-6453. Use Time#monotonicNow to avoid system clock reset. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598144 13f79535-47bb-0310-9956-ffa450edef68	2014-05-28 21:24:49 +00:00
Arpit Agarwal	e976652a6e	HDFS-6442. Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts. (Contributed by Zesheng Wu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598078 13f79535-47bb-0310-9956-ffa450edef68	2014-05-28 17:38:25 +00:00
Jing Zhao	8d9e8cec9f	HDFS-6227. ShortCircuitCache#unref should purge ShortCircuitReplicas whose streams have been closed by java interrupts. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597829 13f79535-47bb-0310-9956-ffa450edef68	2014-05-27 17:21:41 +00:00
Arpit Agarwal	978e3a6813	HDFS-6443. Fix MiniQJMHACluster related test failures. (Contributed by Zesheng Wu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597238 13f79535-47bb-0310-9956-ffa450edef68	2014-05-24 05:09:04 +00:00
Jing Zhao	3671a5e16f	MAPREDUCE-5899. Support incremental data copy in DistCp. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596931 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 18:17:11 +00:00
Jing Zhao	5b1e88b6d2	HDFS-6423. Diskspace quota usage should be updated when appending data to partial block. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596774 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 08:07:16 +00:00
Uma Maheswara Rao G	ac23a55547	Merge HDFS-2006 HDFS XAttrs branch to Trunk git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596575 13f79535-47bb-0310-9956-ffa450edef68	2014-05-21 13:57:33 +00:00
Kihwal Lee	cb5682b859	HDFS-6419. TestBookKeeperHACheckpoints.TestSBNCheckpoints fails on trunk. Contributed by Akira AJISAKA. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596344 13f79535-47bb-0310-9956-ffa450edef68	2014-05-20 18:13:01 +00:00
Jing Zhao	44e9d346e9	HDFS-6432. Add snapshot related APIs to webhdfs. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596334 13f79535-47bb-0310-9956-ffa450edef68	2014-05-20 17:33:31 +00:00
Kihwal Lee	35058fc020	HDFS-6397. NN shows inconsistent value in deadnode count. Contributed by Mohammad Kamrul Islam. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595978 13f79535-47bb-0310-9956-ffa450edef68	2014-05-19 17:52:55 +00:00
Konstantin Boudnik	9a0ed1c4af	HDFS-6325. Append should fail if the last block has insufficient number of replicas (Keith Pak via cos) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595744 13f79535-47bb-0310-9956-ffa450edef68	2014-05-19 05:24:24 +00:00
Junping Du	0fb47dbe4e	HDFS-6250. Fix test failed in TestBalancerWithNodeGroup.testBalancerWithRackLocality (Contributed by Binglin Chang and Chen He) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595145 13f79535-47bb-0310-9956-ffa450edef68	2014-05-16 09:56:24 +00:00
Andrew Wang	8f48760663	HDFS-6345. DFS.listCacheDirectives() should allow filtering based on cache directive ID. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595086 13f79535-47bb-0310-9956-ffa450edef68	2014-05-16 01:18:03 +00:00
Chris Nauroth	65158e478f	HDFS-6326. WebHdfs ACL compatibility is broken. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594743 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 22:35:56 +00:00
Kihwal Lee	88e76f9c45	HDFS-2949. Add check to active state transition to prevent operator-induced split brain. Contributed by Rushabh S Shah. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594709 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 20:45:07 +00:00
Kihwal Lee	97f58955a6	HDFS-6293. Issues with OIV processing PB-based fsimages. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594439 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 01:15:16 +00:00
Colin McCabe	dac9028ef9	HDFS-6355. Fix divide-by-zero, improper use of wall-clock time in BlockPoolSliceScanner (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594338 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 19:24:22 +00:00
Jing Zhao	8e5b5165c1	HDFS-6186. Pause deletion of blocks when the namenode starts up. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594314 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 18:22:33 +00:00
Suresh Srinivas	0077999972	HADOOP-10566. Refactor proxyservers out of ProxyUsers. Contributed by Benoy Antony. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594280 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 16:53:38 +00:00
Jonathan Turner Eagles	e4ee1d111b	HDFS-6305. WebHdfs response decoding may throw RuntimeExceptions (Daryn Sharp via jeagles) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594273 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 16:40:15 +00:00
Kihwal Lee	33ade356b3	HDFS-6334. Client failover proxy provider for IP failover based NN HA. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594263 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 16:19:07 +00:00
Uma Maheswara Rao G	4f399bb4ba	HDFS-6367. EnumSetParam$Domain#parse fails for parameter containing more than one enum. Contributed by Yi Liu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594150 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 07:34:32 +00:00
Kihwal Lee	e9459baec5	HDFS-5522. Datanode disk error check may be incorrectly skipped. Contributed by Rushabh Shah. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594055 13f79535-47bb-0310-9956-ffa450edef68	2014-05-12 19:08:06 +00:00
Andrew Wang	e9c6840b24	Command hdfs dfs -rm -r can't remove empty directory. Contributed by Yongjun Zhang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594036 13f79535-47bb-0310-9956-ffa450edef68	2014-05-12 17:54:35 +00:00
Colin McCabe	f131dba8a3	HDFS-6294. Use INode IDs to avoid conflicts when a file open for write is renamed (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593634 13f79535-47bb-0310-9956-ffa450edef68	2014-05-09 22:36:04 +00:00
Haohui Mai	ed6f32c540	HDFS-6240. WebImageViewer returns 404 if LISTSTATUS to an empty directory. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593591 13f79535-47bb-0310-9956-ffa450edef68	2014-05-09 18:43:46 +00:00
Kihwal Lee	5323d5e388	HDFS-6313. WebHdfs may use the wrong NN when configured for multiple HA NNs. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593475 13f79535-47bb-0310-9956-ffa450edef68	2014-05-09 02:01:37 +00:00
Kihwal Lee	eac832f92d	HDFS-6329. WebHdfs does not work if HA is enabled on NN but logical URI is not configured. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593470 13f79535-47bb-0310-9956-ffa450edef68	2014-05-09 01:46:42 +00:00
Arpit Agarwal	63fadf0abd	HDFS-6340.DN can't finalize upgrade. (Contributed by Rahul Singhal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593436 13f79535-47bb-0310-9956-ffa450edef68	2014-05-08 22:20:37 +00:00
Colin McCabe	280c764f54	HDFS-5381. ExtendedBlock#hashCode should use both blockId and block pool ID (Benoy Antony via Colin Patrick McCabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593346 13f79535-47bb-0310-9956-ffa450edef68	2014-05-08 17:49:52 +00:00
Haohui Mai	2d5362073c	HADOOP-10471. Reduce the visibility of constants in ProxyUsers. Contributed by Benoy Antony. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592915 13f79535-47bb-0310-9956-ffa450edef68	2014-05-06 22:38:02 +00:00
Uma Maheswara Rao G	8b0acf4b1f	HDFS-6337. Setfacl testcase is failing due to dash character in username in TestAclCLI. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592489 13f79535-47bb-0310-9956-ffa450edef68	2014-05-05 11:53:33 +00:00
Andrew Wang	9445859930	HDFS-6295. Add decommissioning state and node state filtering to dfsadmin. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592438 13f79535-47bb-0310-9956-ffa450edef68	2014-05-05 03:38:29 +00:00
Tsz-wo Sze	b2f65c276d	HDFS-5168. Add cross node dependency support to BlockPlacementPolicy. Contributed by Nikola Vujic git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592179 13f79535-47bb-0310-9956-ffa450edef68	2014-05-03 11:02:44 +00:00
Haohui Mai	d777cb8996	HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592069 13f79535-47bb-0310-9956-ffa450edef68	2014-05-02 22:26:02 +00:00
Haohui Mai	6420249d47	HDFS-6252. Phase out the old web UI in HDFS. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591732 13f79535-47bb-0310-9956-ffa450edef68	2014-05-01 18:46:18 +00:00
Aaron Myers	e5d6fba47d	HDFS-6289. HA failover can fail if there are pending DN messages for DNs which no longer exist. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591413 13f79535-47bb-0310-9956-ffa450edef68	2014-04-30 17:46:15 +00:00
Haohui Mai	0689363343	HDFS-6304. Consolidate the logic of path resolution in FSDirectory. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591411 13f79535-47bb-0310-9956-ffa450edef68	2014-04-30 17:44:17 +00:00
Jonathan Turner Eagles	0532b8bad1	HDFS-6269. NameNode Audit Log should differentiate between webHDFS open and HDFS open. (Eric Payne via jeagles) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591117 13f79535-47bb-0310-9956-ffa450edef68	2014-04-29 21:51:14 +00:00
Vinayakumar B	9d21180c1a	HDFS-2882. DN continues to start up, even if block pool fails to initialize (Contributed by Vinayakumar B) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590941 13f79535-47bb-0310-9956-ffa450edef68	2014-04-29 10:27:29 +00:00
Haohui Mai	02d28907be	HADOOP-10508. RefreshCallQueue fails when authorization is enabled. Contributed by Chris Li. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590876 13f79535-47bb-0310-9956-ffa450edef68	2014-04-29 06:04:14 +00:00
Andrew Wang	71aa608b84	HDFS-6288. DFSInputStream Pread doesn't update ReadStatistics. Contributed by Juan Yu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590776 13f79535-47bb-0310-9956-ffa450edef68	2014-04-28 20:20:10 +00:00
Kihwal Lee	02d0f0ba54	HDFS-6218. Audit log should use true client IP for proxied webhdfs operations. Contributed by Daryn Sharp. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590640 13f79535-47bb-0310-9956-ffa450edef68	2014-04-28 14:00:32 +00:00
Haohui Mai	b8a3e2bb20	HDFS-6270. Secondary namenode status page shows transaction count in bytes. Contributed by Benoy Antony. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590197 13f79535-47bb-0310-9956-ffa450edef68	2014-04-25 23:49:10 +00:00
Haohui Mai	bce5a92c54	HDFS-6210. Support GETACLSTATUS operation in WebImageViewer. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589933 13f79535-47bb-0310-9956-ffa450edef68	2014-04-25 05:55:11 +00:00
Uma Maheswara Rao G	0931bd94be	HDFS-6246. Remove 'dfs.support.append' flag from trunk code. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589927 13f79535-47bb-0310-9956-ffa450edef68	2014-04-25 05:19:50 +00:00
Jing Zhao	10a037cccb	HDFS-6266. Identify full path for a given INode. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589920 13f79535-47bb-0310-9956-ffa450edef68	2014-04-25 02:05:42 +00:00
Colin McCabe	fbc0a8bef0	HDFS-6282. Re-add testIncludeByRegistrationName (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589907 13f79535-47bb-0310-9956-ffa450edef68	2014-04-24 23:08:37 +00:00
Arpit Agarwal	730e0675da	HDFS-6273. Add file missed in previous checkin. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589808 13f79535-47bb-0310-9956-ffa450edef68	2014-04-24 18:04:45 +00:00
Jing Zhao	24d1cf9ac6	HDFS-5693. Few NN metrics data points were collected via JMX when NN is under heavy load. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589620 13f79535-47bb-0310-9956-ffa450edef68	2014-04-24 07:24:51 +00:00
Haohui Mai	140f4542b6	HDFS-6278. Create HTML5-based UI for SNN. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589613 13f79535-47bb-0310-9956-ffa450edef68	2014-04-24 07:15:31 +00:00
Kihwal Lee	53cb787d48	HDFS-6217. Webhdfs PUT operations may not work via a http proxy. Contributed by Daryn Sharp. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589528 13f79535-47bb-0310-9956-ffa450edef68	2014-04-23 22:00:46 +00:00
Suresh Srinivas	7f635b8f53	HDFS-6275. Fix warnings - type arguments can be inferred and redudant local variable. Contributed by Suresh Srinivas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589510 13f79535-47bb-0310-9956-ffa450edef68	2014-04-23 20:20:16 +00:00
Suresh Srinivas	876fd8ab79	HDFS-6274. Cleanup javadoc warnings in HDFS code. Contributed by Suresh Srinivas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589506 13f79535-47bb-0310-9956-ffa450edef68	2014-04-23 20:13:32 +00:00
Andrew Wang	ee8a152520	HDFS-5213. TestDataNodeConfig failing on Jenkins runs due to DN web port in use. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589474 13f79535-47bb-0310-9956-ffa450edef68	2014-04-23 18:06:21 +00:00
Jing Zhao	1be4ddef9e	HDFS-6178. Decommission on standby NN couldn't finish. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589002 13f79535-47bb-0310-9956-ffa450edef68	2014-04-21 23:35:09 +00:00
Chris Nauroth	a4475406f8	HDFS-6265. Prepare HDFS codebase for JUnit 4.11. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588995 13f79535-47bb-0310-9956-ffa450edef68	2014-04-21 22:49:08 +00:00
Haohui Mai	bc0b7c6145	HDFS-6256. Clean up ImageVisitor and SpotCheckImageVisitor. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588524 13f79535-47bb-0310-9956-ffa450edef68	2014-04-18 17:35:51 +00:00
Chris Nauroth	dd7d032457	HADOOP-10499. Remove unused parameter from ProxyUsers.authorize(). Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588098 13f79535-47bb-0310-9956-ffa450edef68	2014-04-16 23:09:08 +00:00
Kihwal Lee	ef68759382	HDFS-6219. Proxy superuser configuration should use true client IP for address checks. Contributed by Daryn Sharp. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587962 13f79535-47bb-0310-9956-ffa450edef68	2014-04-16 16:22:36 +00:00
Chris Nauroth	9887d7f250	HDFS-5409. TestOfflineEditsViewer#testStored fails on Windows due to CRLF line endings in editsStored.xml from git checkout. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587759 13f79535-47bb-0310-9956-ffa450edef68	2014-04-16 00:05:45 +00:00
Haohui Mai	5833efc6e4	HDFS-6194. Create new tests for ByteRangeInputStream. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587660 13f79535-47bb-0310-9956-ffa450edef68	2014-04-15 18:09:04 +00:00
Chris Nauroth	01af3a3177	HDFS-6243. HA NameNode transition to active or shutdown may leave lingering image transfer thread. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587410 13f79535-47bb-0310-9956-ffa450edef68	2014-04-15 04:49:09 +00:00
Chris Nauroth	8a9eff3919	HDFS-6238. TestDirectoryScanner leaks file descriptors. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587148 13f79535-47bb-0310-9956-ffa450edef68	2014-04-14 04:46:26 +00:00
Chris Nauroth	7aed74b3d0	HDFS-6237. TestDFSShell#testGet fails on Windows due to invalid file system path. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587146 13f79535-47bb-0310-9956-ffa450edef68	2014-04-14 04:38:46 +00:00
Chris Nauroth	193f11a7ab	HDFS-6236. ImageServlet should use Time#monotonicNow to measure latency. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586902 13f79535-47bb-0310-9956-ffa450edef68	2014-04-12 21:38:35 +00:00
Colin McCabe	2f72888896	HDFS-6232. OfflineEditsViewer throws a NPE on edits containing ACL modifications (ajisakaa via cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586790 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 22:42:48 +00:00
Chris Nauroth	6d45bb54d2	HDFS-6235. TestFileJournalManager can fail on Windows due to file locking if tests run out of order. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586692 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 15:45:39 +00:00
Chris Nauroth	76ea55caeb	HDFS-6234. TestDatanodeConfig#testMemlockLimit fails on Windows due to invalid file path. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586682 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 15:30:18 +00:00
Chris Nauroth	f8904ad299	HDFS-6231. DFSClient hangs infinitely if using hedged reads and all eligible datanodes die. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586551 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 03:48:29 +00:00
Andrew Wang	fad8620a71	HDFS-6224. Add a unit test to TestAuditLogger for file permissions passed to logAuditEvent. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586490 13f79535-47bb-0310-9956-ffa450edef68	2014-04-10 22:35:07 +00:00
Haohui Mai	7af48dd355	HDFS-6225. Remove the o.a.h.hdfs.server.common.UpgradeStatusReport. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586181 13f79535-47bb-0310-9956-ffa450edef68	2014-04-10 00:20:28 +00:00
Chris Nauroth	5c48f379ab	HDFS-6208. DataNode caching can leak file descriptors. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586154 13f79535-47bb-0310-9956-ffa450edef68	2014-04-09 21:45:57 +00:00
Haohui Mai	8af0708580	HDFS-6170. Support GETFILESTATUS operation in WebImageViewer. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586152 13f79535-47bb-0310-9956-ffa450edef68	2014-04-09 21:29:55 +00:00
Tsz-wo Sze	5c18d45224	HDFS-6209. TestValidateConfigurationSettings should use random ports. Contributed by Arpit Agarwal git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586079 13f79535-47bb-0310-9956-ffa450edef68	2014-04-09 18:50:05 +00:00
Tsz-wo Sze	0b977049cf	HDFS-6204. Fix TestRBWBlockInvalidation: change the last sleep to a loop. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586039 13f79535-47bb-0310-9956-ffa450edef68	2014-04-09 17:01:08 +00:00
Arpit Agarwal	6cc92bf8fc	HDFS-6160. TestSafeMode occasionally fails. (Contributed by Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586007 13f79535-47bb-0310-9956-ffa450edef68	2014-04-09 16:13:40 +00:00
Haohui Mai	7915b36225	HDFS-6169. Move the address in WebImageViewer. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585802 13f79535-47bb-0310-9956-ffa450edef68	2014-04-08 18:14:19 +00:00
Haohui Mai	bcf1f33acd	HDFS-6143. WebHdfsFileSystem open should throw FileNotFoundException for non-existing paths. Contributed by Gera Shegalov. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585639 13f79535-47bb-0310-9956-ffa450edef68	2014-04-08 01:39:23 +00:00
Chris Nauroth	5bbf271712	HDFS-6198. DataNode rolling upgrade does not correctly identify current block pool directory and replace with trash on Windows. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585627 13f79535-47bb-0310-9956-ffa450edef68	2014-04-08 00:00:33 +00:00
Haohui Mai	2002dc63c9	HDFS-6180. Dead node count / listing is very broken in JMX and old GUI. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585625 13f79535-47bb-0310-9956-ffa450edef68	2014-04-07 23:55:06 +00:00
Chris Nauroth	79bd50f91b	HDFS-6197. Rolling upgrade rollback on Windows can fail attempting to rename edit log segment files to a destination that already exists. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585586 13f79535-47bb-0310-9956-ffa450edef68	2014-04-07 21:21:46 +00:00
Brandon Li	a5b37c6ed1	HDFS-6181. Fix the wrong property names in NFS user guide. Contributed by Brandon Li git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585563 13f79535-47bb-0310-9956-ffa450edef68	2014-04-07 18:55:49 +00:00
Kihwal Lee	fe328621d4	HDFS-6191. Disable quota checks when replaying edit log. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585544 13f79535-47bb-0310-9956-ffa450edef68	2014-04-07 18:25:12 +00:00
Kihwal Lee	4e979f5dea	HDFS-6159. TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success. Contributed by Chen He. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584900 13f79535-47bb-0310-9956-ffa450edef68	2014-04-04 20:38:22 +00:00
Tsz-wo Sze	4147a52143	HDFS-6189. Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon. Contributed by cnauroth git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584763 13f79535-47bb-0310-9956-ffa450edef68	2014-04-04 15:50:46 +00:00
Haohui Mai	5b3481a750	HDFS-5570. Addendum commit for r1584100. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584174 13f79535-47bb-0310-9956-ffa450edef68	2014-04-02 20:53:01 +00:00
Haohui Mai	fb1d7fb596	HDFS-5570. Deprecate hftp / hsftp and replace them with webhdfs / swebhdfs. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584100 13f79535-47bb-0310-9956-ffa450edef68	2014-04-02 17:28:08 +00:00
Andrew Wang	64c50d9dfb	HDFS-5591. Checkpointing should use monotonic time when calculating period. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583926 13f79535-47bb-0310-9956-ffa450edef68	2014-04-02 08:33:25 +00:00
Tsz-wo Sze	f93d99990a	HDFS-6167. Relocate the non-public API classes in the hdfs.client package. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583878 13f79535-47bb-0310-9956-ffa450edef68	2014-04-02 05:09:35 +00:00
Arun Murthy	004d0854b7	HDFS-4564. Ensure webhdfs returns correct HTTP response codes for denied operations. Contributed by Daryn Sharp. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583241 13f79535-47bb-0310-9956-ffa450edef68	2014-03-31 07:25:53 +00:00
Tsz-wo Sze	3f7aa79e58	HDFS-6168. Remove a deprecated constructor and the deprecated methods reportChecksumFailure, getDelegationToken(Text), renewDelegationToken and cancelDelegationToken from DistributedFileSystem. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582856 13f79535-47bb-0310-9956-ffa450edef68	2014-03-28 18:29:31 +00:00
Haohui Mai	2e799e5984	HDFS-6156. Simplify the JMX API that provides snapshot information. Contributed by Shinichi Yamashita. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582847 13f79535-47bb-0310-9956-ffa450edef68	2014-03-28 18:10:21 +00:00
Haohui Mai	9d2d55e490	HDFS-6164. Remove lsr in OfflineImageViewer. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582533 13f79535-47bb-0310-9956-ffa450edef68	2014-03-27 23:11:02 +00:00
Haohui Mai	54c1daa580	HDFS-5978. Create a tool to take fsimage and expose read-only WebHDFS API. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582433 13f79535-47bb-0310-9956-ffa450edef68	2014-03-27 18:15:47 +00:00
Haohui Mai	fd3d5ab792	HDFS-6158. Clean up dead code for OfflineImageViewer. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582164 13f79535-47bb-0310-9956-ffa450edef68	2014-03-27 02:58:10 +00:00
Suresh Srinivas	14556cc5d8	HDFS-6155. Fix Boxing/unboxing to parse a primitive findbugs warnings. Contributed by Suresh Srinivas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582068 13f79535-47bb-0310-9956-ffa450edef68	2014-03-26 21:27:33 +00:00
Jing Zhao	fe8c3dc2b8	HDFS-5672. TestHASafeMode#testSafeBlockTracking fails in trunk. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581994 13f79535-47bb-0310-9956-ffa450edef68	2014-03-26 18:36:08 +00:00
Suresh Srinivas	c00703dd08	HDFS-6150. Add inode id information in the logs to make debugging easier. Contributed by Suresh Srinivas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581914 13f79535-47bb-0310-9956-ffa450edef68	2014-03-26 16:32:44 +00:00
Arpit Agarwal	1fbb04e367	HDFS-5910. Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-text. (Contributed by Benoy Antony) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581688 13f79535-47bb-0310-9956-ffa450edef68	2014-03-26 04:11:18 +00:00
Haohui Mai	867e0f8ea9	HDFS-5196. Provide more snapshot information in WebUI. Contributed by Shinichi Yamashita. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581427 13f79535-47bb-0310-9956-ffa450edef68	2014-03-25 17:53:51 +00:00
Jing Zhao	56205ca7d7	HDFS-5840. Follow-up to HDFS-5138 to improve error handling during partial upgrade failures. Contributed by Aaron T. Myers, Suresh Srinivas, and Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581260 13f79535-47bb-0310-9956-ffa450edef68	2014-03-25 06:48:15 +00:00
Suresh Srinivas	3a61d25457	HDFS-6125. Cleanup unnecessary cast in HDFS code base. Contributed by Suresh Srinivas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581242 13f79535-47bb-0310-9956-ffa450edef68	2014-03-25 05:51:11 +00:00
Arpit Agarwal	c2ef7e239e	HDFS-6124. Add final modifier to class members. (Contributed by Suresh Srinivas) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581124 13f79535-47bb-0310-9956-ffa450edef68	2014-03-24 23:32:37 +00:00
Chris Nauroth	328fc86bdb	HDFS-5846. Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently. Contributed by Nikola Vujic. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581091 13f79535-47bb-0310-9956-ffa450edef68	2014-03-24 22:16:48 +00:00
Kihwal Lee	7a18c4a199	HDFS-3087. Decomissioning on NN restart can complete without blocks being replicated. Contributed by Rushabh S Shah. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580886 13f79535-47bb-0310-9956-ffa450edef68	2014-03-24 15:39:00 +00:00
Chris Nauroth	00ceaade05	HDFS-6140. WebHDFS cannot create a file with spaces in the name after HA failover changes. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580173 13f79535-47bb-0310-9956-ffa450edef68	2014-03-22 05:32:24 +00:00
Arpit Agarwal	fc53af9c4c	HDFS-6120. Fix and improve safe mode log messages. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580047 13f79535-47bb-0310-9956-ffa450edef68	2014-03-21 20:57:13 +00:00
Jing Zhao	9dab514b22	HDFS-6038. Allow JournalNode to handle editlog produced by new release with future layoutversion. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579813 13f79535-47bb-0310-9956-ffa450edef68	2014-03-20 23:06:06 +00:00
Haohui Mai	aa4a045925	HDFS-6127. WebHDFS tokens cannot be renewed in HA setup. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579546 13f79535-47bb-0310-9956-ffa450edef68	2014-03-20 06:47:58 +00:00
Jing Zhao	7817245d88	HDFS-6100. DataNodeWebHdfsMethods does not failover in HA mode. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579301 13f79535-47bb-0310-9956-ffa450edef68	2014-03-19 17:29:23 +00:00
Chris Nauroth	2b03ae9421	HDFS-6099. HDFS file system limits not enforced on renames. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579122 13f79535-47bb-0310-9956-ffa450edef68	2014-03-19 03:46:52 +00:00
Tsz-wo Sze	534a5ee346	Add TestSnapshotNameWithInvalidCharacters.java for HDFS-6068. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579005 13f79535-47bb-0310-9956-ffa450edef68	2014-03-18 18:35:19 +00:00
Tsz-wo Sze	02b25ce4ef	HDFS-6068. Disallow snapshot names that are also invalid directory names. Contributed by sathish git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579004 13f79535-47bb-0310-9956-ffa450edef68	2014-03-18 18:34:19 +00:00
Chris Nauroth	6318afe3b9	HDFS-5516. WebHDFS does not require user name when anonymous http requests are disallowed. Contributed by Miodrag Radulovic. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578549 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 20:25:10 +00:00
Colin McCabe	7096c290ed	HDFS-6107: fix comment (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578511 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 18:54:03 +00:00
Colin McCabe	d265dd9eb0	HDFS-6107. When a block cannot be cached due to limited space on the DataNode, it becomes uncacheable (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578508 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 18:46:33 +00:00
Arpit Agarwal	809e8bf5b7	HDFS-6094. The same block can be counted twice towards safe mode threshold. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578478 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 17:37:55 +00:00
Andrew Wang	d37c31a2db	HDFS-6102. Lower the default maximum items per directory to fix PB fsimage loading. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577426 13f79535-47bb-0310-9956-ffa450edef68	2014-03-14 04:52:03 +00:00
Colin McCabe	f730fa919e	HDFS-6097. Zero-copy reads are incorrectly disabled on file offsets above 2GB (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577350 13f79535-47bb-0310-9956-ffa450edef68	2014-03-13 22:30:42 +00:00
Suresh Srinivas	70aba7ffcf	HDFS-5244. TestNNStorageRetentionManager#testPurgeMultipleDirs fails. Contributed bye Jinghui Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577254 13f79535-47bb-0310-9956-ffa450edef68	2014-03-13 17:21:09 +00:00
Arpit Agarwal	f0fa038c7e	HDFS-6096. TestWebHdfsTokens may timeout. (Contributed by szetszwo) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576999 13f79535-47bb-0310-9956-ffa450edef68	2014-03-12 23:24:32 +00:00
Andrew Wang	b849dd5df9	HDFS-6079. Timeout for getFileBlockStorageLocations does not work. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576979 13f79535-47bb-0310-9956-ffa450edef68	2014-03-12 22:54:57 +00:00
Colin McCabe	a3616c58dd	HDFS-6086. Fix a case where zero-copy or no-checksum reads were not allowed even when the block was cached. (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576533 13f79535-47bb-0310-9956-ffa450edef68	2014-03-11 22:41:05 +00:00
Chris Nauroth	8d29768704	HDFS-5638. HDFS implementation of FileContext API for ACLs. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576405 13f79535-47bb-0310-9956-ffa450edef68	2014-03-11 16:13:43 +00:00
Chris Nauroth	5bb794566e	HDFS-6055. Change default configuration to limit file name length in HDFS. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576095 13f79535-47bb-0310-9956-ffa450edef68	2014-03-10 21:41:38 +00:00
Haohui Mai	a06b21cf67	HDFS-5892. TestDeleteBlockPool fails in branch-2. Contributed by Ted Yu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576035 13f79535-47bb-0310-9956-ffa450edef68	2014-03-10 18:16:57 +00:00
Colin McCabe	d59dbc9e38	HDFS-6071. BlockReaderLocal does not return -1 on EOF when doing a zero-length read on a short file. (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575797 13f79535-47bb-0310-9956-ffa450edef68	2014-03-10 02:41:45 +00:00
Andrew Wang	94a1632fcb	HDFS-3405. Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575611 13f79535-47bb-0310-9956-ffa450edef68	2014-03-08 21:25:13 +00:00
Andrew Wang	dbd22b23c2	Revert HDFS-3405 for recommit with correct renamed files git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575610 13f79535-47bb-0310-9956-ffa450edef68	2014-03-08 21:15:41 +00:00
Arpit Agarwal	596004ac73	HDFS-6078. TestIncrementalBlockReports is flaky. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575559 13f79535-47bb-0310-9956-ffa450edef68	2014-03-08 16:38:36 +00:00
Andrew Wang	0f595915a3	HDFS-3405. Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575457 13f79535-47bb-0310-9956-ffa450edef68	2014-03-08 00:39:23 +00:00
Andrew Wang	90b399c4bd	HDFS-5064. Standby checkpoints should not block concurrent readers. Contributed by Aaron Twining Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575448 13f79535-47bb-0310-9956-ffa450edef68	2014-03-07 23:35:47 +00:00
Chris Nauroth	b1f87bbabd	HDFS-5986. Capture the number of blocks pending deletion on namenode webUI. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575384 13f79535-47bb-0310-9956-ffa450edef68	2014-03-07 19:37:15 +00:00
Chris Nauroth	12711177d3	HDFS-6063. TestAclCLI fails intermittently when running test 24: copyFromLocal. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575171 13f79535-47bb-0310-9956-ffa450edef68	2014-03-07 05:44:57 +00:00
Colin McCabe	173c115951	HDFS-6065. HDFS zero-copy reads should return null on EOF when doing ZCR (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575109 13f79535-47bb-0310-9956-ffa450edef68	2014-03-07 01:18:32 +00:00
Colin McCabe	591be56052	HDFS-6067. TestPread.testMaxOutHedgedReadPool is flaky (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575100 13f79535-47bb-0310-9956-ffa450edef68	2014-03-06 23:48:23 +00:00
Colin McCabe	115e60b0dc	HDFS-6059. TestBlockReaderLocal fails if native library not available (ajisakaa via cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574998 13f79535-47bb-0310-9956-ffa450edef68	2014-03-06 18:52:22 +00:00
Haohui Mai	e65084b616	HDFS-6062. TestRetryCacheWithHA#testConcat is flaky. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574997 13f79535-47bb-0310-9956-ffa450edef68	2014-03-06 18:51:04 +00:00
Colin McCabe	5a3f614794	HDFS-6061. Allow dfs.datanode.shared.file.descriptor.path to contain multiple entries and fall back when needed (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574796 13f79535-47bb-0310-9956-ffa450edef68	2014-03-06 08:21:16 +00:00
Haohui Mai	9192f8446d	HDFS-6058. Fix TestHDFSCLI failures after HADOOP-8691 change. Contributed by Akira Ajisaka and Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574792 13f79535-47bb-0310-9956-ffa450edef68	2014-03-06 08:13:40 +00:00
Colin McCabe	95e0f616b9	HDFS-6057. DomainSocketWatcher.watcherThread should be marked as a daemon thread (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574787 13f79535-47bb-0310-9956-ffa450edef68	2014-03-06 07:57:19 +00:00
Jing Zhao	e1162ebb1f	HDFS-5167. Add metrics about the NameNode retry cache. Contributed by Tsuyoshi OZAWA. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574603 13f79535-47bb-0310-9956-ffa450edef68	2014-03-05 18:22:04 +00:00
Haohui Mai	e90687f90e	HDFS-5321. Clean up the HTTP-related configuration in HDFS. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574270 13f79535-47bb-0310-9956-ffa450edef68	2014-03-05 00:28:21 +00:00
Jing Zhao	f9ebdea446	Merging r1573814 through r1574170 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1574171 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 18:22:26 +00:00
Colin McCabe	c94e43c6df	HDFS-6046. add dfs.client.mmap.enabled (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573887 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 06:46:08 +00:00
Colin McCabe	33500fd304	HDFS-6040. fix DFSClient issue without libhadoop.so and some other ShortCircuitShm cleanups (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573883 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 06:31:43 +00:00
Chris Nauroth	2cfe554980	HDFS-6039. Uploading a File under a Dir with default acls throws "Duplicated ACLFeature". Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573879 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 06:08:25 +00:00
Jing Zhao	5d29338017	HDFS-6041. Downgrade/Finalize should rename the rollback image instead of purging it. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573851 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 04:42:58 +00:00
Tsz-wo Sze	9ad8dd1e8a	Merge r1569890 through r1573813 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573821 13f79535-47bb-0310-9956-ffa450edef68	2014-03-03 23:51:58 +00:00
Haohui Mai	146bf6c01e	HDFS-5866. '-maxSize' and '-step' option fail in OfflineImageViewer. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573694 13f79535-47bb-0310-9956-ffa450edef68	2014-03-03 19:40:45 +00:00
Colin McCabe	dd049a2f60	HDFS-5950. The DFSClient and DataNode should use shared memory segments to communicate short-circuit information (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573433 13f79535-47bb-0310-9956-ffa450edef68	2014-03-03 03:58:37 +00:00
Tsz-wo Sze	0a7db7f179	Merge r1569890 through r1573119 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573120 13f79535-47bb-0310-9956-ffa450edef68	2014-03-01 01:14:38 +00:00
Haohui Mai	fec1e2eed9	HDFS-5956. A file size is multiplied by the replication factor in 'hdfs oiv -p FileDistribution' option. Contributed by Akira Ajisaka. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573078 13f79535-47bb-0310-9956-ffa450edef68	2014-02-28 21:07:03 +00:00
Arpit Agarwal	44c5c778f0	HDFS-5821. TestHDFSCLI fails for user names with the dash character. (Contributed by Gera Shegalov) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573076 13f79535-47bb-0310-9956-ffa450edef68	2014-02-28 21:05:16 +00:00
Arpit Agarwal	d00605f8f0	HADOOP-10285. Admin interface to swap callqueue at runtime. (Contributed by Chris Li) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573052 13f79535-47bb-0310-9956-ffa450edef68	2014-02-28 19:48:31 +00:00
Tsz-wo Sze	ee663fad14	Merge r1569890 through r1573042 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1573043 13f79535-47bb-0310-9956-ffa450edef68	2014-02-28 19:37:47 +00:00
Jing Zhao	5c381ade4e	HDFS-5339. WebHDFS URI does not accept logical nameservices when security is enabled. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573026 13f79535-47bb-0310-9956-ffa450edef68	2014-02-28 18:39:01 +00:00
Jing Zhao	5409908026	HDFS-6032. -rollingUpgrade query hits NPE after the NN restarts. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572801 13f79535-47bb-0310-9956-ffa450edef68	2014-02-28 01:23:52 +00:00
Jing Zhao	e9a17c8ce0	HDFS-6029. Secondary NN fails to checkpoint after -rollingUpgrade prepare. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572800 13f79535-47bb-0310-9956-ffa450edef68	2014-02-28 01:21:53 +00:00
Tsz-wo Sze	9b81883952	Merge r1569890 through r1572722 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572723 13f79535-47bb-0310-9956-ffa450edef68	2014-02-27 20:39:34 +00:00
Chris Nauroth	e5ccaa5d03	HADOOP-10353. FsUrlStreamHandlerFactory is not thread safe. Contributed by Tudor Scurtu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572679 13f79535-47bb-0310-9956-ffa450edef68	2014-02-27 18:53:54 +00:00
Jing Zhao	e1084736b2	Add TestRollingUpgradeDowngrade.java for HDFS-6024 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572434 13f79535-47bb-0310-9956-ffa450edef68	2014-02-27 05:04:13 +00:00
Tsz-wo Sze	58bccdbc04	Merge r1569890 through r1572417 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572418 13f79535-47bb-0310-9956-ffa450edef68	2014-02-27 03:11:07 +00:00
Tsz-wo Sze	9a114bebd8	HDFS-6026. Fix TestDFSUpgrade and TestDataNodeRollingUpgrade. Contributed by jing9 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572417 13f79535-47bb-0310-9956-ffa450edef68	2014-02-27 03:10:25 +00:00
Jing Zhao	aee7b449e2	HDFS-6024. Test whether the NN will reject the downgrade if it has a fsimage from a newer release. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572338 13f79535-47bb-0310-9956-ffa450edef68	2014-02-26 23:20:42 +00:00
Jing Zhao	ccf0744243	HDFS-6023. Test whether the standby NN continues to checkpoint after the prepare stage. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1572337 13f79535-47bb-0310-9956-ffa450edef68	2014-02-26 23:17:53 +00:00

... 8 9 10 11 12 ...

2503 Commits