big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,806 Commits 2 Branches 2 Tags 264 MiB
2d4ae3d18b
Commit Graph

2859 Commits

Author SHA1 Message Date
Kihwal Lee
2d4ae3d18b HDFS-8245. Standby namenode doesn't process DELETED_BLOCK if the addblock request is in edit log. Contributed by Rushabh S Shah. 2015-05-08 16:36:41 -05:00
Colin Patrick Mccabe
f523e963e4 HDFS-8113. Add check for null BlockCollection pointers in BlockInfoContiguous structures (Chengbing Liu via Colin P. McCabe) 2015-05-08 13:50:51 -07:00
Kihwal Lee
7a7960be41 HDFS-7433. Optimize performance of DatanodeManager's node map. Contributed by Daryn Sharp. 2015-05-08 15:18:29 -05:00
Yongjun Zhang
730f9930a4 HDFS-8311. DataStreamer.transfer() should timeout the socket InputStream. (Esteban Gutierrez via Yongjun Zhang) 2015-05-08 00:11:46 -07:00
cnauroth
26f61d41df HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R. 2015-05-08 11:20:55 -07:00
Kihwal Lee
6f622672b6 HDFS-7894. Rolling upgrade readiness is not updated in jmx until query command is issued. Contributed by Brahma Reddy Battula. 2015-05-08 09:30:38 -05:00
Uma Maheswara Rao G
7b1ea9c481 HDFS-6285. tidy an error log inside BlockReceiver. Contributed by Liang Xie. 2015-05-08 17:22:52 +05:30
Vinayakumar B
c648317a68 HDFS-3384. DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery (Contributed by Uma Maheswara Rao G) 2015-05-08 17:18:14 +05:30
Tsuyoshi Ozawa
888e630990 HDFS-8207. Improper log message when blockreport interval compared with initial delay. Contributed by Brahma Reddy Battula and Ashish Singhi. 2015-05-08 18:13:09 +09:00
Uma Maheswara Rao G
4b00ae5c11 HDFS-8108. Fsck should provide the info on mandatory option to be used along with -blocks ,-locations and -racks. Contributed by J.Andreina. 2015-05-08 14:00:45 +05:30
Uma Maheswara Rao G
e16f4b7f70 HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R. 2015-05-08 12:26:47 +05:30
Vinayakumar B
e5e492a963 HDFS-6291. FSImage may be left unclosed in BootstrapStandby#doRun() ( Contributed by Sanghyun Yun) 2015-05-08 11:25:24 +05:30
Uma Maheswara Rao G
2ea0f2fc93 HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina 2015-05-08 11:01:51 +05:30
Vinayakumar B
66988476d0 HDFS-8067. haadmin prints out stale help messages (Contributed by Ajith S) 2015-05-08 10:45:21 +05:30
Haohui Mai
767b91cd83 HDFS-8321. CacheDirectives and CachePool operations should throw RetriableException in safemode. Contributed by Haohui Mai. 2015-05-07 15:17:11 -07:00
Tsz-Wo Nicholas Sze
f9427f1760 HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contributed by Walter Su 2015-05-07 11:36:35 -07:00
cnauroth
6633a8474d HDFS-7833. DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated. Contributed by Lei (Eddy) Xu. 2015-05-06 21:11:30 -07:00
Konstantin V Shvachko
c75cfa29cf HDFS-2484. checkLease should throw FileNotFoundException when file does not exist. Contributed by Rakesh R. 2015-05-06 16:06:04 -07:00
Haohui Mai
4da8490b51 HDFS-8314. Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users. Contributed by Li Lu. 2015-05-05 15:41:22 -07:00
Xiaoyu Yao
0100b15501 HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao) 2015-05-05 13:41:14 -07:00
Colin Patrick Mccabe
24d3a2d4fd HDFS-7758. Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead (Lei (Eddy) Xu via Colin P. McCabe) 2015-05-05 11:08:59 -07:00
Colin Patrick Mccabe
fcd4cb7516 HDFS-8305: HDFS INotify: the destination field of RenameOp should always end with the file name (cmccabe) 2015-05-05 10:50:09 -07:00
Vinayakumar B
318081ccd7 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 
Reverted earlier commit
 2015-05-05 11:05:37 +05:30
Haohui Mai
0d6aa5d609 HDFS-8237. Move all protocol classes used by ClientProtocol to hdfs-client. Contributed by Haohui Mai. 2015-05-04 15:00:29 -07:00
cnauroth
c4578760b6 HDFS-8290. WebHDFS calls before namesystem initialization can cause NullPointerException. Contributed by Chris Nauroth. 2015-05-04 11:35:04 -07:00
Haohui Mai
6ae2a0d048 HDFS-8249. Separate HdfsConstants into the client and the server side class. Contributed by Haohui Mai. 2015-05-02 10:03:23 -07:00
Arpit Agarwal
6f541edce0 HDFS-8229. LAZY_PERSIST file gets deleted after NameNode restart. (Contributed by Surendra Singh Lilhore) 2015-05-01 16:42:19 -07:00
Tsz-Wo Nicholas Sze
d3d019c337 HDFS-8086. Move LeaseRenewer to the hdfs.client.impl package. Contributed by Takanobu 2015-05-01 15:12:18 -07:00
Arpit Agarwal
64d30a6186 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 14:43:09 -07:00
Colin Patrick Mccabe
b82567d455 HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe) 2015-05-01 11:19:40 -07:00
Yongjun Zhang
279958b772 HDFS-7281. Missing block is marked as corrupted block (Ming Ma via Yongjun Zhang) 2015-05-01 08:42:00 -07:00
Jing Zhao
98a6176628 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao. 2015-04-30 19:27:07 -07:00
Haohui Mai
c55d609053 HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 2015-04-30 13:41:46 -07:00
Akira Ajisaka
e89fc53a1d HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 2015-04-30 19:11:22 +09:00
Andrew Wang
aa22450442 HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb. 2015-04-29 17:37:56 -07:00
Haohui Mai
3dd6395bb2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:45 -07:00
Jing Zhao
7947e5b53b HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 2015-04-29 10:41:46 -07:00
Haohui Mai
439614b0c8 HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao. 2015-04-28 18:11:59 -07:00
Haohui Mai
c79e7f7d99 HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai. 2015-04-28 18:05:46 -07:00
Tsz-Wo Nicholas Sze
5639bf02da HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:05:33 -07:00
cnauroth
feb68cb547 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer. 2015-04-27 16:48:13 -07:00
Arpit Agarwal
0d5b0143cc HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:23:34 -07:00
Arpit Agarwal
dcc5455e07 HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:48 -07:00
Jing Zhao
cf6c8a1b4e HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina. 2015-04-24 10:23:32 -07:00
Vinayakumar B
c8d72907ff HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao) 2015-04-24 12:51:04 +05:30
Vinayakumar B
262c1bc339 HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B) 2015-04-24 12:16:41 +05:30
Colin Patrick Mccabe
a8898445dc HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe) 2015-04-23 19:13:27 -07:00
Colin Patrick Mccabe
a0e0a63209 HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 2015-04-23 19:00:24 -07:00
Haohui Mai
bcf89ddc7d HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:33:45 -07:00
Tsz-Wo Nicholas Sze
ef4e9963b2 HDFS-8215. Refactor NamenodeFsck#check method. Contributed by Takanobu Asanuma 2015-04-23 14:19:33 -07:00