Commit Graph

16888 Commits

Author SHA1 Message Date
Subru Krishnan
d4d2fd1acd YARN-2037. Add work preserving restart support for Unmanaged AMs. (Botong Huang via Subru). 2017-10-02 18:14:44 -07:00
Anu Engineer
015abcd8ce HDFS-12576. JournalNodes are getting started, even though dfs.namenode.shared.edits.dir is not configured. Contributed by Bharat Viswanadham. 2017-10-02 15:40:00 -07:00
Lei Xu
27ffd43b64 HDFS-12569. Unset EC policy logs empty payload in edit log. (Lei (Eddy) Xu) 2017-10-02 15:35:49 -07:00
Wangda Tan
280080fad0 YARN-7259. Add size-based rolling policy to LogAggregationIndexedFileController. (xgong via wangda)
Change-Id: Ifaf82c0aee6b73b9b6ebf103aa72e131e3942f31
2017-10-02 15:30:22 -07:00
Chen Liang
2c62ff7fd4 HDFS-12271. Incorrect statement in Downgrade section of HDFS Rolling Upgrade document. Contributed by Nandakumar. 2017-10-02 13:18:00 -07:00
Anu Engineer
442ea85545 HADOOP-14752. TestCopyFromLocal#testCopyFromLocalWithThreads is fleaky. Contributed by Andras Bokor. 2017-10-02 13:11:47 -07:00
Carlo Curino
ceca9694f9 YARN-3661. Basic Federation UI. (Contributed by Inigo Goiri via curino) 2017-10-02 13:03:32 -07:00
Chen Liang
5a68c2cef3 HDFS-12552. Use slf4j instead of log4j in FSNamesystem. Contributed by Ajay Kumar. 2017-10-02 11:26:53 -07:00
Chen Liang
563dcdfc1d HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham. 2017-10-02 10:58:19 -07:00
Xiao Chen
06df6ab254 HADOOP-14095. Document caveats about the default JavaKeyStoreProvider in KMS. 2017-09-29 19:34:29 -07:00
Yufei Gu
66c417167a YARN-6333. Improve doc for minSharePreemptionTimeout, fairSharePreemptionTimeout and fairSharePreemptionThreshold. (Contributed by Chetna Chaudhari via Yufei Gu) 2017-09-29 18:07:33 -07:00
Wangda Tan
ec2ae3060a YARN-6509. Add a size threshold beyond which yarn logs will require a force option. (Xuan Gong via wangda)
Change-Id: I755fe903337d4ff9ec35dae5b9cce638794e1d0f
2017-09-29 16:42:56 -07:00
Wangda Tan
febeead5f9 YARN-6550. Capture launch_container.sh logs to a separate log file. (Suma Shivaprasad via wangda)
Change-Id: I0ee0b1bb459437432a22cf68861a6354f0decabb
2017-09-29 16:39:46 -07:00
Andrew Wang
373d0a5195 HADOOP-14909. Fix the word of erasure encoding in the top page. Contributed by Takanobu Asanuma. 2017-09-29 13:34:36 -07:00
John Zhuge
8aca46e53f HADOOP-14651. Update okhttp version to 2.7.5. Contributed by Ray Chiang and John Zhuge. 2017-09-29 12:15:06 -07:00
Lei Xu
f40dbc170e HDFS-12453. TestDataNodeHotSwapVolumes fails in trunk Jenkins runs. (Lei (Eddy) Xu) 2017-09-29 10:46:17 -07:00
Eric Payne
7f6118f918 YARN-7084. TestSchedulingMonitor#testRMStarts fails sporadically. Contributed by Jason Lowe. 2017-09-29 10:33:57 -05:00
Wangda Tan
d3b1c63195 YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda)
Change-Id: I76aec68cbfb42d239279d7245a03290d691e87a4
2017-09-28 16:41:09 -07:00
Chris Trezzo
c114da5e64 YARN-7250. Update Shared cache client api to use URLs. 2017-09-28 15:28:06 -07:00
Jason Lowe
6f789fe057 HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru 2017-09-28 16:38:30 -05:00
Subru Krishnan
ca669f9f8b YARN-6962. Add support for updateContainers when allocating using FederationInterceptor. (Botong Huang via Subru). 2017-09-28 13:04:03 -07:00
Jason Lowe
85d81ae58e YARN-7248. NM returns new SCHEDULED container status to older clients. Contributed by Arun Suresh 2017-09-28 14:10:15 -05:00
Steve Loughran
a530e7ab3b
HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB
Contributed by Varada Hemeswari
2017-09-28 19:52:56 +01:00
Chen Liang
8e1bd114ee HDFS-12560. Remove the extra word it in HdfsUserGuide.md. Contributed by fang zhenyi. 2017-09-28 10:22:27 -07:00
Wei-Chiu Chuang
7c34ceaf4f HDFS-12458. TestReencryptionWithKMS fails regularly. Contributed by Xiao Chen. 2017-09-28 05:10:26 -07:00
Xuan
28c4957fcc YARN-7257. AggregatedLogsBlock reports a bad 'end' value as a bad
'start' value. Contributed by Jason Lowe
2017-09-27 15:46:18 -07:00
Chris Trezzo
c87db8d154 YARN-7253. Shared Cache Manager daemon command listed as admin subcmd in yarn script. 2017-09-27 11:32:09 -07:00
Sunil G
8facf1f976 YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. Contributed by Tanuj Nayak. 2017-09-27 14:37:32 +05:30
Akira Ajisaka
dd378775df
HADOOP-14822. hadoop-project/pom.xml is executable. Contributed by Ajay Kumar. 2017-09-27 14:25:07 +09:00
Daryn Sharp
0da29cbeea [HDFS-12386] Add fsserver defaults call to WebhdfsFileSystem. (Rushabh Shah via daryn) 2017-09-26 15:15:24 -05:00
Jason Lowe
9df05005ac MAPREDUCE-6968. Staging directory erasure coding config property has a typo. Contributed by Jason Lowe 2017-09-26 14:52:27 -05:00
Lei Xu
1267ff22ce HDFS-12523. Thread pools in ErasureCodingWorker do not shutdown. (Huafeng Wang via Lei) 2017-09-26 10:08:16 -07:00
Brahma Reddy Battula
9d3e4cccf9 HDFS-5040.Audit log for admin commands/ logging output of all DFS admin commands. Contributed by Kuhu Shukla. 2017-09-26 21:59:22 +05:30
Jason Lowe
14fec04ed3 Revert "YARN-6570. No logs were found for running application, running"
This reverts commit 7c732924a8.
2017-09-26 10:38:03 -05:00
Yiqun Lin
e9b790db9d HDFS-12495. TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently. Contributed by Eric Badger. 2017-09-26 17:21:42 +08:00
Rohith Sharma K S
06e5a7b5cf YARN-65. Reduce RM app memory footprint once app has completed. Contributed by Manikandan R. 2017-09-26 14:34:09 +05:30
Akira Ajisaka
d08b8c801a
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari. 2017-09-26 16:46:03 +09:00
Aaron Fabbri
a2b31e355a
HADOOP-14890 Move up to AWS SDK 1.11.199. Contributed by Steve Loughran. 2017-09-25 17:12:01 -07:00
Arun Suresh
df800f6cf3 YARN-7240. Add more states and transitions to stabilize the NM Container state machine. (Kartheek Muthyala via asuresh) 2017-09-25 16:02:55 -07:00
Aaron Fabbri
47011d7dd3
HADOOP-14220 Enhance S3GuardTool with bucket-info and set-capacity commands, tests. Contributed by Steve Loughran 2017-09-25 15:59:38 -07:00
Ray Chiang
cde804b91f HADOOP-14903. Add json-smart explicitly to pom.xml. (rchiang) 2017-09-25 15:30:51 -07:00
Anu Engineer
0889e5a8b7 HDFS-12529. Get source for config tags from file name. Contributed by Ajay Kumar. 2017-09-25 13:55:09 -07:00
Jason Lowe
ac05a51bbb HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham 2017-09-25 15:35:44 -05:00
Akira Ajisaka
e928ee583c
YARN-7153. Remove duplicated code in AMRMClientAsyncImpl.java. Contributed by Sen Zhao. 2017-09-26 02:03:30 +09:00
Akira Ajisaka
3a10367a17
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 2017-09-26 01:47:02 +09:00
Akira Ajisaka
02e2a9b115
HDFS-12304. Remove unused parameter from FsDatasetImpl#addVolume. Contributed by Chen Liang. 2017-09-26 01:25:07 +09:00
Daniel Templeton
0807470808 HADOOP-14897. Loosen compatibility guidelines for native dependencies 2017-09-25 14:12:25 +02:00
Anu Engineer
d0b2c5850b HDFS-12516. Suppress the fsnamesystem lock warning on nn startup. Contributed by Ajay Kumar. 2017-09-24 21:03:06 -07:00
Anu Engineer
415e5a157a HDFS-12375. Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh. Contributed by Bharat Viswanadham. 2017-09-23 15:05:25 -07:00
Anu Engineer
ecc85620e8 HDFS-12339. NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper. Contributed by Mukul Kumar Singh. 2017-09-23 12:27:34 -07:00