big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,532 Commits 2 Branches 2 Tags 264 MiB
744208431f
Commit Graph

3330 Commits

Author SHA1 Message Date
Kihwal Lee
744208431f HDFS-10940. Reduce performance penalty of block caching when not used. Contributed by Daryn Sharp. 2016-10-03 11:27:23 -05:00
Arpit Agarwal
fe9ebe20ab Revert "HDFS-10923. Make InstrumentedLock require ReentrantLock." 
This reverts commit c7ce6fdc20.
 2016-09-30 23:11:51 -07:00
Arpit Agarwal
c7ce6fdc20 HDFS-10923. Make InstrumentedLock require ReentrantLock. 2016-09-30 23:00:06 -07:00
Zhe Zhang
434c5ea75d HDFS-10896. Move lock logging logic from FSNamesystem into FSNamesystemLock. Contributed by Erik Krogen. 2016-09-30 13:16:08 -07:00
Kihwal Lee
a0730aa5ce HDFS-10851. FSDirStatAndListingOp: stop passing path as string. Contributed by Daryn Sharp. 2016-09-30 13:03:24 -05:00
Kihwal Lee
0670149c88 HDFS-10850. getEZForPath should NOT throw FNF. Contributed by Andrew Wang. 2016-09-30 08:44:18 -05:00
Mingliang Liu
84c6264079 HDFS-10892. Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'. Contributed by Mingliang Liu 2016-09-28 16:03:51 -07:00
Arpit Agarwal
c3b235e565 HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real capacity. Contributed by Xiaobing Zhou. 2016-09-28 11:47:37 -07:00
Anu Engineer
03f519a757 HDFS-9850. DiskBalancer: Explore removing references to FsVolumeSpi. Contributed by Manoj Govindassamy. 2016-09-27 21:35:06 -07:00
Mingliang Liu
6437ba18c5 HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 2016-09-27 20:40:17 -07:00
Yongjun Zhang
2acfb1e1e4 HDFS-10376. Enhance setOwner testing. (John Zhuge via Yongjun Zhang) 2016-09-27 14:55:28 -07:00
Arpit Agarwal
8ae4729107 HDFS-10828. Fix usage of FsDatasetImpl object lock in ReplicaMap. (Arpit Agarwal) 2016-09-27 10:02:15 -07:00
Masatake Iwasaki
f55eb981dd HDFS-10426. TestPendingInvalidateBlock failed in trunk. Contributed by Yiqun Lin. 2016-09-28 01:29:24 +09:00
Brahma Reddy Battula
edf0d0f8b2 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 2016-09-27 07:04:37 +05:30
Arpit Agarwal
059058f961 HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 2016-09-26 17:09:47 -07:00
Wei-Chiu Chuang
8e06d865c4 Addendum patch for HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. 2016-09-26 14:41:04 -07:00
Wei-Chiu Chuang
3ae652f821 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 2016-09-26 13:11:32 -07:00
Konstantin V Shvachko
6eb700ee74 HDFS-10866. Fix Eclipse Java compile errors related to generic parameters. Contributed by Konstantin Shvachko. 2016-09-23 14:10:11 -07:00
Konstantin V Shvachko
a5bb88c8e0 HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen. 2016-09-23 10:37:46 -07:00
Andrew Wang
40acacee08 HDFS-10877. Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers. Contributed by Sean Mackrory. 2016-09-22 11:43:11 -07:00
Masatake Iwasaki
964e546ab1 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 2016-09-21 10:35:25 +09:00
Xiao Chen
0e918dff59 HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 2016-09-20 16:56:52 -07:00
Kai Zheng
734d54c1a8 HDFS-10861. Refactor StripeReaders and use ECChunk version decode API. Contributed by Sammi Chen 2016-09-21 21:34:48 +08:00
Andrew Wang
c54f6ef30f HDFS-10868. Remove stray references to DFS_HDFS_BLOCKS_METADATA_ENABLED. 2016-09-19 11:17:03 -07:00
Xiao Chen
ea839bd48e HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 2016-09-17 22:25:39 -07:00
Arpit Agarwal
ec3ea18875 HDFS-9895. Remove unnecessary conf cache from DataNode. Contributed by Xiaobing Zhou. 2016-09-15 15:25:47 -07:00
Arpit Agarwal
2a8f55a0cf HDFS-10805. Reduce runtime for append test. Contributed by Gergely Novak. 2016-09-14 09:31:17 -07:00
Kai Zheng
ea0c2b8b05 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-15 10:46:00 +08:00
Lei Xu
86c9862bec HDFS-10636. Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File. (Virajith Jalaparti via lei) 2016-09-13 12:54:14 -07:00
Anu Engineer
e3f7f58a5f HDFS-10599. DiskBalancer: Execute CLI via Shell. Contributed by Manoj Govindassamy. 2016-09-13 09:38:12 -07:00
Yongjun Zhang
d2466ec3e0 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang) 2016-09-12 21:25:06 -07:00
Jing Zhao
72dfb048a9 HDFS-10858. FBR processing may generate incorrect reportedBlock-blockGroup mapping. Contributed by Jing Zhao. 2016-09-12 16:40:11 -07:00
Anu Engineer
8a93f45a80 HDFS-10821. DiskBalancer: Report command support with multiple nodes. Contributed by Yiqun Lin. 2016-09-12 15:45:26 -07:00
Arpit Agarwal
a99bf26a08 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:22:25 -07:00
Anu Engineer
bee9f57f5c HDFS-10808. DiskBalancer does not execute multi-steps plan-redux. Contributed by Anu Engineer. 2016-09-09 15:00:39 -07:00
Xiao Chen
a0b0383677 Addendum patch for HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-09 10:54:14 -07:00
Anu Engineer
35c5943b8b HDFS-10553. DiskBalancer: Rename Tools/DiskBalancer class to Tools/DiskBalancerCLI. Contributed by Manoj Govindassamy. 2016-09-08 19:26:56 -07:00
Chris Douglas
011f3b24d4 HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang 2016-09-08 17:53:40 -07:00
Zhe Zhang
401db4fc65 HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng. 2016-09-08 11:54:33 -07:00
Akira Ajisaka
63f594892e HDFS-10778. Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer. 2016-09-08 15:13:43 +09:00
Kai Zheng
d355573f56 Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng" 
This reverts commit 62a9667136
 2016-09-08 05:50:17 +08:00
Arpit Agarwal
5f23abfa30 HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-06 13:37:21 -07:00
Chris Nauroth
f0d5382ff3 HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth. 2016-09-06 11:02:39 -07:00
Kai Zheng
62a9667136 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-07 17:05:33 +08:00
Xiao Chen
07650bc37a HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-02 15:33:11 -07:00
Zhe Zhang
6c600360ca Addendum fix for HDFS-10817 to fix failure of the added testFSReadLockLongHoldingReport in branch-2. 2016-08-31 23:43:59 -07:00
Zhe Zhang
6f4b0d33ca HDFS-10817. Add Logging for Long-held NN Read Locks. Contributed by Erik Krogen. 2016-08-31 15:40:09 -07:00
Andrew Wang
85bab5fb57 HDFS-10784. Implement WebHdfsFileSystem#listStatusIterator. 2016-08-31 14:29:37 -07:00
Anu Engineer
20ae1fa259 HDFS-10813. DiskBalancer: Add the getNodeList method in Command. Contributed by Yiqun Lin. 2016-08-30 18:42:55 -07:00
Ming Ma
9dcbdbdb5a HDFS-9392. Admins support for maintenance state. Contributed by Ming Ma. 2016-08-30 14:00:13 -07:00