big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,407 Commits 2 Branches 2 Tags 264 MiB
72dfb048a9
Commit Graph

5791 Commits

Author SHA1 Message Date
Jing Zhao
72dfb048a9 HDFS-10858. FBR processing may generate incorrect reportedBlock-blockGroup mapping. Contributed by Jing Zhao. 2016-09-12 16:40:11 -07:00
Anu Engineer
8a93f45a80 HDFS-10821. DiskBalancer: Report command support with multiple nodes. Contributed by Yiqun Lin. 2016-09-12 15:45:26 -07:00
Allen Wittenauer
58ed4fa544 HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS 
This commit includes the following changes:

	HADOOP-13356. Add a function to handle command_subcommand_OPTS
	HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
	HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
	HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
	HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
	HADOOP-13357. Modify common to use hadoop_subcommand_opts
	HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
	HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
	HADOOP-13564. modify mapred to use hadoop_subcommand_opts
	HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
	HADOOP-13360. Documentation for HADOOP_subcommand_OPTS

This closes apache/hadoop#126
 2016-09-12 11:10:00 -07:00
Xiao Chen
cc01ed7026 HDFS-10855. Fix typos in HDFS documents. Contributed by Yiqun Lin. 2016-09-10 23:24:49 -07:00
Arpit Agarwal
a99bf26a08 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:22:25 -07:00
Anu Engineer
bee9f57f5c HDFS-10808. DiskBalancer does not execute multi-steps plan-redux. Contributed by Anu Engineer. 2016-09-09 15:00:39 -07:00
Andrew Wang
cba973f036 HDFS-10832. Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions. 2016-09-09 12:12:29 -07:00
Xiao Chen
a0b0383677 Addendum patch for HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-09 10:54:14 -07:00
Anu Engineer
baab48922a HDFS-9849. DiskBalancer: reduce lock path in shutdown code. Contributed by Yuanbo Liu. 2016-09-08 20:00:42 -07:00
Anu Engineer
35c5943b8b HDFS-10553. DiskBalancer: Rename Tools/DiskBalancer class to Tools/DiskBalancerCLI. Contributed by Manoj Govindassamy. 2016-09-08 19:26:56 -07:00
Andrew Wang
b07c266dca HDFS-10831. Add log when URLConnectionFactory.openConnection failed. Contributed by yunjiong zhao. 2016-09-08 18:30:18 -07:00
Chris Douglas
011f3b24d4 HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang 2016-09-08 17:53:40 -07:00
Chris Douglas
b6d839a60c HDFS-10845. Change defaults in hdfs-site.xml to match timeunit type. Contributed by Yiqun Lin 2016-09-08 13:29:30 -07:00
Zhe Zhang
401db4fc65 HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng. 2016-09-08 11:54:33 -07:00
Akira Ajisaka
20a20c2f6e HDFS-10847. Complete the document for FileDistribution processor in OfflineImageViewer. Contributed by Yiqun Lin. 2016-09-09 01:34:34 +09:00
Akira Ajisaka
2d1bf53c7e HDFS-10844. test_libhdfs_threaded_hdfs_static and test_libhdfs_zerocopy_hdfs_static are failing. 2016-09-09 00:49:22 +09:00
Akira Ajisaka
63f594892e HDFS-10778. Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewer. 2016-09-08 15:13:43 +09:00
Kai Zheng
d355573f56 Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng" 
This reverts commit 62a9667136
 2016-09-08 05:50:17 +08:00
Arpit Agarwal
5f23abfa30 HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-06 13:37:21 -07:00
Xiao Chen
f6c0b7543f HDFS-10841. Remove duplicate or unused variable in appendFile(). Contributed by Kihwal Lee. 2016-09-06 11:48:35 -07:00
Xiao Chen
7c213c341d HDFS-10835. Fix typos in httpfs.sh. Contributed by John Zhuge. 2016-09-06 11:44:26 -07:00
Chris Nauroth
f0d5382ff3 HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth. 2016-09-06 11:02:39 -07:00
Chris Douglas
d37dc5d1b8 HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin 2016-09-06 10:38:04 -07:00
Kai Zheng
62a9667136 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-07 17:05:33 +08:00
Xiao Chen
07650bc37a HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy. 2016-09-02 15:33:11 -07:00
Andrew Wang
cbd909ce2a HDFS-10833. Fix JSON errors in WebHDFS.md examples. 2016-09-02 14:50:34 -07:00
Lei Xu
5a8c5064d1 HDFS-10822. Log DataNodes in the write pipeline. John Zhuge via Lei Xu 2016-09-02 11:01:13 -07:00
Xiao Chen
0690f0969e HDFS-10820. Reuse closeResponder to reset the response variable in DataStreamer#run. Contributed by Yiqun Lin. 2016-09-01 15:35:25 -07:00
Zhe Zhang
6c600360ca Addendum fix for HDFS-10817 to fix failure of the added testFSReadLockLongHoldingReport in branch-2. 2016-08-31 23:43:59 -07:00
Zhe Zhang
6f4b0d33ca HDFS-10817. Add Logging for Long-held NN Read Locks. Contributed by Erik Krogen. 2016-08-31 15:40:09 -07:00
Andrew Wang
85bab5fb57 HDFS-10784. Implement WebHdfsFileSystem#listStatusIterator. 2016-08-31 14:29:37 -07:00
Kihwal Lee
01721dd88e HDFS-10729. Improve log message for edit loading failures caused by FS limit checks. Contributed by Wei-Chiu Chuang. 2016-08-31 14:02:37 -05:00
Anu Engineer
20ae1fa259 HDFS-10813. DiskBalancer: Add the getNodeList method in Command. Contributed by Yiqun Lin. 2016-08-30 18:42:55 -07:00
Ming Ma
9dcbdbdb5a HDFS-9392. Admins support for maintenance state. Contributed by Ming Ma. 2016-08-30 14:00:13 -07:00
Wei-Chiu Chuang
c4ee6915a1 HDFS-10760. DataXceiver#run() should not log InvalidToken exception as an error. Contributed by Pan Yuxuan. 2016-08-30 10:43:20 -07:00
Zhe Zhang
4bd45f54ee HDFS-10814. Add assertion for getNumEncryptionZones when no EZ is created. Contributed by Vinitha Reddy Gankidi. 2016-08-29 23:37:26 -07:00
Xiao Chen
cd5e10ccca HDFS-4210. Throw helpful exception when DNS entry for JournalNode cannot be resolved. Contributed by Charles Lamb and John Zhuge. 2016-08-29 17:48:08 -07:00
Yongjun Zhang
5d1609ddf2 HDFS-10625. VolumeScanner to report why a block is found bad. Contributed by Rushabh S Shah and Yiqun Lin. 2016-08-29 13:59:54 -07:00
Mingliang Liu
6742fb6e68 HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu) 2016-08-29 10:15:34 -07:00
Yongjun Zhang
c25817159a HDFS-10652. Add a unit test for HDFS-4660. Contributed by Vinayakumar B., Wei-Chiu Chuang, Yongjun Zhang. 2016-08-27 22:51:31 -07:00
Zhe Zhang
e806db7190 HDFS-10584. Allow long-running Mover tool to login with keytab. Contributed by Rakesh R. 2016-08-26 16:43:45 -07:00
Andrew Wang
a445b82baa HDFS-10793. Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184. Contributed by Manoj Govindassamy. 2016-08-26 15:39:18 -07:00
Zhe Zhang
407b519fb1 HDFS-10798. Make the threshold of reporting FSNamesystem lock contention configurable. Contributed by Erik Krogen. 2016-08-26 14:19:55 -07:00
Kihwal Lee
8b7adf4ddf HDFS-10768. Optimize mkdir ops. Contributed by Daryn Sharp. 2016-08-26 15:39:56 -05:00
Kihwal Lee
13fb1b50e6 HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 2016-08-26 09:53:10 -05:00
Kai Zheng
f4a21d3aba HDFS-10795. Fix an error in ReaderStrategy#ByteBufferStrategy. Contributed by Sammi Chen 2016-08-27 10:54:25 +08:00
Xiaoyu Yao
4da5000dd3 HDFS-10748. TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout. Contributed by Yiqun Lin. 2016-08-25 09:00:44 -07:00
Kihwal Lee
a1f3293762 HDFS-10772. Reduce byte/string conversions for get listing. Contributed by Daryn Sharp. 2016-08-24 15:21:08 -05:00
Kai Zheng
793447f799 HDFS-8905. Refactor DFSInputStream#ReaderStrategy. Contributed by Kai Zheng and Sammi Chen 2016-08-24 21:57:23 +08:00
Daryn Sharp
ec252ce0fc HDFS-10762. Pass IIP for file status related methods 2016-08-24 08:46:47 -05:00