big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,675 Commits 2 Branches 2 Tags 264 MiB
2ff6faf954
Commit Graph

2628 Commits

Author SHA1 Message Date
Haohui Mai
df1e8ce44a HDFS-7483. Display information per tier on the Namenode UI. Contributed by Benoy Antony and Haohui Mai. 2015-07-20 20:13:12 -07:00
yliu
d6d58606b8 HDFS-8794. Improve CorruptReplicasMap#corruptReplicasMap. (yliu) 2015-07-21 09:20:22 +08:00
Ravi Prakash
e4f756260f HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak) 2015-07-20 14:03:34 -07:00
Ming Ma
fbd88f1062 HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient. (mingma) 2015-07-16 12:33:57 -07:00
Arpit Agarwal
3ec0a0444f HDFS-8778. TestBlockReportRateLimiting#testLeaseExpiration can deadlock. (Contributed by Arpit Agarwal) 2015-07-15 14:08:58 -07:00
Akira Ajisaka
979c9ca2ca HDFS-8742. Inotify: Support event for OP_TRUNCATE. Contributed by Surendra Singh Lilhore. 2015-07-15 04:42:08 +09:00
Colin Patrick Mccabe
1d74ccecec HDFS-7608: hdfs dfsclient newConnectedPeer has no write timeout (Xiaoyu Yao via Colin P. McCabe) 2015-07-14 10:57:59 -07:00
Tsz-Wo Nicholas Sze
9ef03a4c5b HDFS-8541. Mover should exit with NO_MOVE_PROGRESS if there is no move progress. Contributed by Surendra Singh Lilhore 2015-07-13 15:12:26 -07:00
Jing Zhao
47f4c54106 HDFS-8751. Remove setBlocks API from INodeFile and misc code cleanup. Contributed by Zhe Zhang 2015-07-10 14:15:22 -07:00
Vinayakumar B
b48908033f HDFS-2956. calling fetchdt without a --renewer argument throws NPE (Contributed by Vinayakumar B)HDFS-2956. calling fetchdt without a --renewer argument throws NPE (Contributed by Vinayakumar B) 2015-07-10 15:47:04 +05:30
Jing Zhao
f4ca530c1c HDFS-8729. Fix TestFileTruncate#testTruncateWithDataNodesRestartImmediately which occasionally failed. Contributed by Walter Su. 2015-07-09 13:17:52 -07:00
Arpit Agarwal
4119ad3112 HDFS-8642. Make TestFileTruncate more reliable. (Contributed by Rakesh R) 2015-07-08 09:31:02 -07:00
Xiaoyu Yao
b68701b7b2 HDFS-8711. setSpaceQuota command should print the available storage type when input storage type is wrong. Contributed by Brahma Reddy Battula. 2015-07-07 13:50:49 -07:00
Jing Zhao
bc99aaffe7 Revert "HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao." 
This reverts commit d62b63d297.
 2015-07-07 10:13:41 -07:00
Jing Zhao
d62b63d297 HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao. 2015-07-06 15:54:25 -07:00
Vinayakumar B
fc92d3e651 HDFS-8686. WebHdfsFileSystem#getXAttr(Path p, final String name) doesn't work if namespace is in capitals (Contributed by kanaka kumar avvaru) 2015-07-06 16:09:24 +05:30
Vinayakumar B
2eae130ab9 HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina) 2015-07-03 13:35:48 +05:30
Vinayakumar B
bff5999d07 HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B) 2015-07-02 16:11:50 +05:30
Colin Patrick Mccabe
a78d5074fb HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) 2015-07-01 17:57:11 -07:00
Jing Zhao
152e5df3b6 HDFS-8666. Speedup the TestMover test. Contributed by Walter Su. 2015-07-01 14:59:50 -07:00
Colin Patrick Mccabe
68e588cbee HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 2015-06-30 16:40:21 -07:00
Vinayakumar B
7ba5bbac02 HDFS-8627. NPE thrown if unable to fetch token from Namenode (Contributed by J.Andreina) 2015-06-30 15:42:59 +05:30
Vinayakumar B
6d99017f38 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 2015-06-30 15:25:20 +05:30
Haohui Mai
d3797f9f3c HDFS-8493. Consolidate truncate() related implementation in a single class. Contributed by Rakesh R. 2015-06-29 16:45:35 -07:00
Benoy Antony
d3fed8e653 HDFS-7390. Provide JMX metrics per storage type. (Benoy Antony) 2015-06-29 11:00:22 -07:00
Vinayakumar B
88ceb382ef HDFS-8586. Dead Datanode is allocated for write when client is from deadnode (Contributed by Brahma Reddy Battula) 2015-06-29 15:25:03 +05:30
Arpit Agarwal
c6793dd8cc HDFS-8681. BlockScanner is incorrectly disabled by default. (Contributed by Arpit Agarwal) 2015-06-28 14:51:36 -07:00
Andrew Wang
60b858bfa6 HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization. 2015-06-26 11:30:59 -07:00
Jing Zhao
de480d6c89 HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang. 2015-06-26 10:49:01 -07:00
Andrew Wang
ff0e5e572f HDFS-8665. Fix replication check in DFSTestUtils#waitForReplication. 2015-06-25 17:29:24 -07:00
Arpit Agarwal
67a62da5c5 HDFS-8640. Make reserved RBW space visible through JMX. (Contributed by kanaka kumar avvaru) 2015-06-25 10:13:22 -07:00
Akira Ajisaka
bc433908d3 HDFS-8462. Implement GETXATTRS and LISTXATTRS operations for WebImageViewer. Contributed by Jagadesh Kiran N. 2015-06-26 00:20:12 +09:00
Andrew Wang
afe9ea3c12 HDFS-8646. Prune cached replicas from DatanodeDescriptor state on replica invalidation. 2015-06-24 14:42:33 -07:00
Jing Zhao
2ba6465721 HDFS-8639. Add Option for NameNode HTTP port in MiniDFSClusterManager. Contributed by Kai Sasaki. 2015-06-23 22:16:16 -07:00
Aaron T. Myers
49dfad9429 HDFS-6440. Support more than 2 NameNodes. Contributed by Jesse Yates. 2015-06-23 17:26:11 -07:00
Jakob Homan
fac4e04dd3 HDFS-8542. WebHDFS getHomeDirectory behavior does not match specification. Contributed by Kanaka Kumar Avvaru. 2015-06-22 16:30:45 -07:00
Colin Patrick Mccabe
7b424f938c HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe) 2015-06-22 14:37:10 -07:00
Arpit Agarwal
c7d022b66f HDFS-8192. Eviction should key off used locked memory instead of ram disk free space. (Contributed by Arpit Agarwal) 2015-06-20 13:27:52 -07:00
Colin Patrick Mccabe
d112d18324 HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe) 2015-06-19 19:14:05 -07:00
Arpit Agarwal
55278c012f HDFS-8626. Reserved RBW space is not released if creation of RBW File fails. (Contributed by kanaka kumar avvaru) 2015-06-19 18:23:34 -07:00
Akira Ajisaka
cc432885ad HDFS-6249. Output AclEntry in PBImageXmlWriter. Contributed by surendra singh lilhore. 2015-06-17 17:41:10 -07:00
Haohui Mai
015535dc0a HDFS-8446. Separate safemode related operations in GetBlockLocations(). Contributed by Haohui Mai. 2015-06-17 16:38:43 -07:00
Andrew Wang
6e3fcffe29 HDFS-8608. Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks). Contributed by Zhe Zhang. 2015-06-17 08:05:44 -07:00
Andrew Wang
a3990ca414 HDFS-8591. Remove support for deprecated configuration key dfs.namenode.decommission.nodes.per.interval. 2015-06-16 10:03:34 -07:00
Haohui Mai
32e39d8a29 HDFS-8592. SafeModeException never get unwrapped. Contributed by Haohui Mai. 2015-06-15 22:07:24 -07:00
Tsz-Wo Nicholas Sze
175e6d120f HDFS-8361. Choose SSD over DISK in block placement. 2015-06-15 17:12:01 -07:00
Tsz-Wo Nicholas Sze
321940cf19 HDFS-8540. Mover should exit with NO_MOVE_BLOCK if no block can be moved. Contributed by surendra singh lilhore 2015-06-15 16:26:53 -07:00
Tsz-Wo Nicholas Sze
2cb09e98e3 HDFS-8576. Lease recovery should return true if the lease can be released and the file can be closed. Contributed by J.Andreina 2015-06-15 16:07:38 -07:00
Arpit Agarwal
32ffda1266 HDFS-8607. TestFileCorruption doesn't work as expected. (Contributed by Walter Su) 2015-06-15 10:11:53 -07:00
Arpit Agarwal
4c5da9bd94 HDFS-8595. TestCommitBlockSynchronization fails in branch-2.7. (Patch applies to all branches). (Contributed by Arpit Agarwal) 2015-06-14 16:24:30 -07:00
cnauroth
b8341f1cd8 HDFS-8593. Calculation of effective layout version mishandles comparison to current layout version in storage. Contributed by Chris Nauroth. 2015-06-13 10:37:52 -07:00
Andrew Wang
c17439c2dd HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang. 2015-06-12 11:38:39 -07:00
Colin Patrick Mccabe
12b5b06c06 HDFS-7923. The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages (cmccabe) 2015-06-12 11:17:51 -07:00
Akira Ajisaka
e4489d97e5 HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to hadoop-common. Contributed by Masatake Iwasaki. 2015-06-12 07:25:15 -07:00
Andrew Wang
b258b344bb HDFS-8573. Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline. Contributed by Eddy Xu. 2015-06-11 10:12:31 -07:00
Andrew Wang
a7a7768341 HDFS-8549. Abort the balancer if an upgrade is in progress. 2015-06-10 13:42:57 -07:00
Xiaoyu Yao
3c2397cb04 HDFS-8568. TestClusterId#testFormatWithEmptyClusterIdOption is failing. Contributed by Rakesh R. 2015-06-09 12:16:24 -07:00
cnauroth
0e80d51983 HDFS-8554. TestDatanodeLayoutUpgrade fails on Windows. Contributed by Chris Nauroth. 2015-06-08 08:39:02 -07:00
cnauroth
71de367c5e HDFS-8432. Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases. Contributed by Chris Nauroth. 2015-06-06 09:43:47 -07:00
Kihwal Lee
ade6d9a61e HDFS-8463. Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException. Contributed by Masatake Iwasaki. 2015-06-04 12:51:00 -05:00
Vinayakumar B
c59e745630 HDFS-3716. Purger should remove stale fsimage ckpt files (Contributed by J.Andreina) 2015-06-03 15:30:40 +05:30
Vinayakumar B
54f83d9bd9 HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 2015-06-03 12:11:46 +05:30
Andrew Wang
c1d50a91f7 HDFS-8513. Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant. (wang) 2015-06-02 15:48:26 -07:00
Colin Patrick Mccabe
03fb5c6425 HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) 2015-06-02 11:40:37 -07:00
Jing Zhao
cdc13efb1a HDFS-8489. Subclass BlockInfo to represent contiguous blocks. Contributed by Zhe Zhang. 2015-06-01 11:42:58 -07:00
Jing Zhao
7817674a3a HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by Ming Ma. 2015-05-29 11:05:13 -07:00
Allen Wittenauer
bf500d9798 HDFS-5033. Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source (Darrell Taylor via aw) 2015-05-27 16:51:34 -07:00
Andrew Wang
4928f54733 HDFS-8482. Rename BlockInfoContiguous to BlockInfo. Contributed by Zhe Zhang. 2015-05-27 15:42:07 -07:00
Akira Ajisaka
bb1816328a HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki. 2015-05-27 18:04:40 +09:00
Haohui Mai
ada233b7cd HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang. 2015-05-24 22:30:32 -07:00
Arpit Agarwal
cf2b5694d6 HDFS-8454. Remove unnecessary throttling in TestDatanodeDeath. (Arpit Agarwal) 2015-05-21 20:43:57 -07:00
Xiaoyu Yao
05e04f34f2 HDFS-8451. DFSClient probe for encryption testing interprets empty URI property for enabled. Contributed by Steve Loughran. 2015-05-21 11:58:00 -07:00
Kihwal Lee
8860e352c3 HDFS-8404. Pending block replication can get stuck using older genstamp. Contributed by Nathan Roberts. 2015-05-19 13:05:15 -05:00
Colin Patrick Mccabe
470c87dbc6 HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 2015-05-19 10:50:15 -07:00
Kihwal Lee
de30d66b26 HDFS-8131. Implement a space balanced block placement policy. Contributed by Liu Shaohui. 2015-05-19 08:04:38 -05:00
Vinayakumar B
d4a2830b63 HADOOP-11103. Clean up RemoteException (Contributed by Sean Busbey) 2015-05-19 14:41:05 +05:30
Vinayakumar B
93972a332a HDFS-6348. SecondaryNameNode not terminating properly on runtime exceptions (Contributed by Rakesh R) 2015-05-19 12:24:25 +05:30
Ravi Prakash
cdfae446ad HDFS-4185. Add a metric for number of active leases (Rakesh R via raviprak) 2015-05-18 12:37:21 -07:00
Tsz-Wo Nicholas Sze
0c590e1c09 HDFS-8405. Fix a typo in NamenodeFsck. Contributed by Takanobu Asanuma 2015-05-19 02:57:54 +08:00
Arpit Agarwal
a2190bf15d HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal) 2015-05-18 11:36:29 -07:00
Arpit Agarwal
e453989a57 HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit Agarwal) 2015-05-16 09:05:35 -07:00
Haohui Mai
ac742c762d HDFS-8403. Eliminate retries in TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal. 2015-05-15 19:12:40 -07:00
Haohui Mai
e5afac5896 HDFS-8394. Move getAdditionalBlock() and related functionalities into a separate class. Contributed by Haohui Mai. 2015-05-15 19:09:59 -07:00
Vinayakumar B
3bef7c80a9 HDFS-6888. Allow selectively audit logging ops (Contributed by Chen He) 2015-05-15 11:07:51 +05:30
Akira Ajisaka
cbc01ed08e HDFS-8371. Fix test failure in TestHdfsConfigFields for spanreceiver properties. Contributed by Ray Chiang. 2015-05-15 12:14:47 +09:00
Vinayakumar B
def9136e02 HDFS-8150. Make getFileChecksum fail for blocks under construction (Contributed by J.Andreina) 2015-05-14 15:54:51 +05:30
Haohui Mai
b2c85db86c HDFS-7728. Avoid updating quota usage while loading edits. Contributed by Jing Zhao. 2015-05-13 21:50:35 -07:00
Arpit Agarwal
54fa9b4217 HDFS-8243. Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. (Contributed by Ruth Wisniewski) 2015-05-13 19:43:53 -07:00
Colin Patrick Mccabe
281d47a969 HDFS-8380. Always call addStoredBlock on blocks which have been shifted from one storage to another (cmccabe) 2015-05-13 14:29:05 -07:00
Kihwal Lee
f9a46a00d2 HDFS-8358. TestTraceAdmin fails. Contributed by Masatake Iwasaki. 2015-05-13 14:15:27 -05:00
Tsz-Wo Nicholas Sze
cdec12d1b8 HDFS-8143. Mover should exit after some retry when failed to move blocks. Contributed by surendra singh lilhore 2015-05-13 11:57:49 -07:00
Vinayakumar B
065d8f2a34 HDFS-6300. Prevent multiple balancers from running simultaneously (Contributed by Rakesh R) 2015-05-13 17:27:34 +05:30
Akira Ajisaka
2463666ecb HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma. 2015-05-13 11:37:22 +09:00
yliu
6d5da94841 HDFS-8255. Rename getBlockReplication to getPreferredBlockReplication. (Contributed by Zhe Zhang) 2015-05-12 21:29:22 +08:00
Vinayakumar B
987abc99b0 HDFS-8362. Java Compilation Error in TestHdfsConfigFields.java (Contributed by Arshad Mohammad) 2015-05-12 12:09:13 +05:30
Kihwal Lee
ea11590aad HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop. Contributed by Rushabh Shah. 2015-05-11 14:31:58 -05:00
Akira Ajisaka
1dd79ffaca HDFS-8241. Remove unused NameNode startup option -finalize. Contributed by Brahma Reddy Battula. 2015-05-12 00:18:18 +09:00
Haohui Mai
4536399d47 HDFS-8357. Consolidate parameters of INode.CleanSubtree() into a parameter objects. Contributed by Li Lu. 2015-05-09 22:51:58 -07:00
Haohui Mai
02a4a22b9c HDFS-8327. Compute storage type quotas in INodeFile.computeQuotaDeltaForTruncate(). Contributed by Haohui Mai. 2015-05-08 23:09:25 -07:00
Haohui Mai
00fe1ed3a4 HDFS-6757. Simplify lease manager with INodeID. Contributed by Haohui Mai. 2015-05-08 23:04:31 -07:00
Arpit Agarwal
59995cec4a HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) 2015-05-08 16:28:24 -07:00
Kihwal Lee
2d4ae3d18b HDFS-8245. Standby namenode doesn't process DELETED_BLOCK if the addblock request is in edit log. Contributed by Rushabh S Shah. 2015-05-08 16:36:41 -05:00
Colin Patrick Mccabe
f523e963e4 HDFS-8113. Add check for null BlockCollection pointers in BlockInfoContiguous structures (Chengbing Liu via Colin P. McCabe) 2015-05-08 13:50:51 -07:00
cnauroth
26f61d41df HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R. 2015-05-08 11:20:55 -07:00
Arun Suresh
3cefc02af7 HDFS-7559. Create unit test to automatically compare HDFS related classes and hdfs-default.xml. (Ray Chiang via asuresh) 2015-05-08 10:29:38 -07:00
Vinayakumar B
c648317a68 HDFS-3384. DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery (Contributed by Uma Maheswara Rao G) 2015-05-08 17:18:14 +05:30
Vinayakumar B
4c6816faf8 HDFS-8209. Support different number of datanode directories in MiniDFSCluster. (Contributed by surendra singh lilhore) 2015-05-08 15:03:44 +05:30
Uma Maheswara Rao G
e16f4b7f70 HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R. 2015-05-08 12:26:47 +05:30
Haohui Mai
4d9f9e546f HDFS-8037. CheckAccess in WebHDFS silently accepts malformed FsActions parameters. Contributed by Walter Su. 2015-05-07 15:25:26 -07:00
Tsz-Wo Nicholas Sze
f9427f1760 HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contributed by Walter Su 2015-05-07 11:36:35 -07:00
Akira Ajisaka
449e4426a5 HDFS-8325. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula. 2015-05-07 15:14:20 +09:00
cnauroth
6633a8474d HDFS-7833. DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated. Contributed by Lei (Eddy) Xu. 2015-05-06 21:11:30 -07:00
Konstantin V Shvachko
c75cfa29cf HDFS-2484. checkLease should throw FileNotFoundException when file does not exist. Contributed by Rakesh R. 2015-05-06 16:06:04 -07:00
Haohui Mai
4da8490b51 HDFS-8314. Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users. Contributed by Li Lu. 2015-05-05 15:41:22 -07:00
Xiaoyu Yao
0100b15501 HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao) 2015-05-05 13:41:14 -07:00
Colin Patrick Mccabe
ffce9a3413 HDFS-7847. Modify NNThroughputBenchmark to be able to operate on a remote NameNode (Charles Lamb via Colin P. McCabe) 2015-05-05 11:34:58 -07:00
Colin Patrick Mccabe
24d3a2d4fd HDFS-7758. Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead (Lei (Eddy) Xu via Colin P. McCabe) 2015-05-05 11:08:59 -07:00
Colin Patrick Mccabe
fcd4cb7516 HDFS-8305: HDFS INotify: the destination field of RenameOp should always end with the file name (cmccabe) 2015-05-05 10:50:09 -07:00
cnauroth
c4578760b6 HDFS-8290. WebHDFS calls before namesystem initialization can cause NullPointerException. Contributed by Chris Nauroth. 2015-05-04 11:35:04 -07:00
Xiaoyu Yao
a319771d1d HDFS-8309. Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows. (xyao) 2015-05-02 22:15:24 -07:00
Haohui Mai
6ae2a0d048 HDFS-8249. Separate HdfsConstants into the client and the server side class. Contributed by Haohui Mai. 2015-05-02 10:03:23 -07:00
Arpit Agarwal
6f541edce0 HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed by Surendra Singh Lilhore) 2015-05-01 16:42:19 -07:00
Tsz-Wo Nicholas Sze
d3d019c337 HDFS-8086. Move LeaseRenewer to the hdfs.client.impl package. Contributed by Takanobu 2015-05-01 15:12:18 -07:00
Arpit Agarwal
64d30a6186 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 14:43:09 -07:00
Colin Patrick Mccabe
b82567d455 HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 2015-05-01 11:19:40 -07:00
Yongjun Zhang
279958b772 HDFS-7281. Missing block is marked as corrupted block (Ming Ma via Yongjun Zhang) 2015-05-01 08:42:00 -07:00
Jing Zhao
98a6176628 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao. 2015-04-30 19:27:07 -07:00
Akira Ajisaka
e89fc53a1d HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 2015-04-30 19:11:22 +09:00
Haohui Mai
3dd6395bb2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:45 -07:00
Jing Zhao
7947e5b53b HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 2015-04-29 10:41:46 -07:00
Tsz-Wo Nicholas Sze
5639bf02da HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:05:33 -07:00
cnauroth
feb68cb547 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer. 2015-04-27 16:48:13 -07:00
Arpit Agarwal
0d5b0143cc HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:23:34 -07:00
cnauroth
a00e001a1a HDFS-8247. TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing. Contributed by Xiaoyu Yao. 2015-04-25 11:37:27 -07:00
Arpit Agarwal
dcc5455e07 HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:48 -07:00
Andrew Wang
c7d9ad68e3 HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang. 2015-04-24 11:54:25 -07:00
Colin Patrick Mccabe
a8898445dc HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe) 2015-04-23 19:13:27 -07:00
Colin Patrick Mccabe
a0e0a63209 HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 2015-04-23 19:00:24 -07:00
Haohui Mai
bcf89ddc7d HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:33:45 -07:00
Tsz-Wo Nicholas Sze
416b84354e HDFS-8147. StorageGroup in Dispatcher should override equals nad hashCode. Contributed by surendra singh lilhore 2015-04-23 11:55:06 -07:00
Andrew Wang
26971e52ae HADOOP-11852. Disable symlinks in trunk. 2015-04-23 11:47:01 -07:00
Haohui Mai
6f8003dc7b HDFS-8185. Separate client related routines in HAUtil into a new class. Contributed by Haohui Mai. 2015-04-21 21:59:47 -07:00
Colin Patrick Mccabe
997408eaac HDFS-8133. Improve readability of deleted block check (Daryn Sharp via Colin P. McCabe) 2015-04-21 11:43:24 -07:00
Arpit Agarwal
dfc1c4c303 HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:05 -07:00
Vinayakumar B
8ddbb8dd43 HDFS-7993. Provide each Replica details in fsck (Contributed by J.Andreina) 2015-04-21 15:24:49 +05:30
Arpit Agarwal
c92f6f3605 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:42 -07:00
Haohui Mai
5c97db07fb HDFS-8169. Move LocatedBlocks and related classes to hdfs-client. Contributed by Haohui Mai. 2015-04-20 00:36:46 -07:00
Arpit Agarwal
8511d80804 HDFS-8152. Refactoring of lazy persist storage cases. (Arpit Agarwal) 2015-04-19 16:09:06 -07:00
Tsuyoshi Ozawa
5459b241c8 HDFS-8043. NPE in MiniDFSCluster teardown. Contributed by Brahma Reddy Battula. 2015-04-19 18:19:36 +09:00
Haohui Mai
76e7264e8d HDFS-8165. Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client. Contributed by Haohui Mai. 2015-04-16 22:49:30 -07:00