big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,730 Commits 2 Branches 2 Tags 264 MiB
8e779a151e
Commit Graph

22730 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Doroszlai, Attila
83e452ecea HDDS-1965. Compile error due to leftover ScmBlockLocationTestIngClient file (#1293) 2019-08-14 18:39:45 +05:30
Steve Loughran
0e4b757955 HADOOP-16500 S3ADelegationTokens to only log at debug on startup (#1269). Contributed by Steve Loughran. 
Change-Id: Ifafc15f32791911976d7ebc36fb6e8853f59ed41
 2019-08-14 10:50:26 +02:00
bibinchundatt
89a53c7eb4 YARN-9747. Reduce additional namenode call by EntityGroupFSTimelineStore#cleanLogs. Contributed by Prabhu Joseph. 2019-08-14 13:46:23 +05:30
Márton Elek
846848ac4c HDDS-1914. Ozonescript example docker-compose cluster can't be started 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 23:26:47 -07:00
Doroszlai, Attila
48dc441864 HDDS-1929. OM started on recon host in ozonesecure compose 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 23:12:44 -07:00
Anu Engineer
5a248de511 HDDS-1947. fix naming issue for ScmBlockLocationTestingClient. 
Contributed by star.
 2019-08-13 23:07:02 -07:00
Aravindan Vijayan
fc229b6490 HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (Change to Error logging) 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 22:04:31 -07:00
Márton Elek
15545c8bf1 HDDS-1915. Remove hadoop script from ozone distribution 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 22:02:54 -07:00
Doroszlai, Attila
78b714af9c HDDS-1956. Aged IO Thread exits on first read 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 20:34:06 -07:00
Siyao Meng
bf457797f6 HDDS-1920. Place ozone.om.address config key default value in ozone-site.xml 
Change-Id: Ic5970b383357147b74a01680aedf40bed4d3e176
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 20:27:37 -07:00
Akira Ajisaka
0f8add8a60
HADOOP-16495. Fix invalid metric types in PrometheusMetricsSink (#1244) 2019-08-14 12:24:03 +09:00
Doroszlai, Attila
e6d240dc91 HDDS-1928. Cannot run ozone-recon compose due to syntax error 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 17:27:04 -07:00
Wei-Chiu Chuang
c13ec7ab66 HDFS-14491. More Clarity on Namenode UI Around Blocks and Replicas. Contributed by Siyao Meng. 2019-08-13 17:15:26 -07:00
Elek, Márton
50a22b66c0 HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject (#950) 
* HDDS-1659. Define the process to add proposal/design docs to the Ozone subproject
     * Remove Site improvements to display proposals
     * adding license header
     * clarify the support of the existing method
 2019-08-13 17:10:36 -07:00
Doroszlai, Attila
9691117099 HDDS-1916. Only contract tests are run in ozonefs module 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 16:56:59 -07:00
Wei-Chiu Chuang
633b7c1cfe HDFS-14625. Make DefaultAuditLogger class in FSnamesystem to Abstract. Contributed by hemanthboyina. 2019-08-13 16:50:49 -07:00
Masatake Iwasaki
da0006fe04 HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS. 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-08-14 08:39:40 +09:00
Siyao Meng
6ae8bc3a4a HDFS-14665. HttpFS: LISTSTATUS response is missing HDFS-specific fields (#1267) Contributed by Siyao Meng. 2019-08-13 16:27:57 -07:00
Nanda kumar
3cff73aff4 HDDS-1917. TestOzoneRpcClientAbstract is failing. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 16:03:31 -07:00
Nanda kumar
cb390dff87 HDDS-1961. TestStorageContainerManager#testScmProcessDatanodeHeartbeat is flaky. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 15:57:24 -07:00
Siyao Meng
68c818415a HDDS-1891. Ozone fs shell command should work with default port when port number is not specified 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 15:30:53 -07:00
Nanda kumar
69b74e9016 HDDS-1488. Scm cli command to start/stop replication manager. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 14:57:05 -07:00
dchitlangia
689a80d3ce HDDS-1886. Use ArrayList#clear to address audit failure scenario 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 14:37:32 -07:00
Eric Badger
2ac029b949 YARN-9442. container working directory has group read permissions. Contributed by Jim Brennan. 2019-08-13 16:21:18 +00:00
Erik Krogen
274966e675 HDFS-14717. [Dynamometer] Remove explicit search for JUnit dependency JAR from Dynamometer Client as it is packaged in the primary JAR. Contributed by Kevin Su. 2019-08-13 08:52:59 -07:00
Ayush Saxena
e9b6b81de4 HDFS-13505. Turn on HDFS ACLs by default. Contributed by Siyao Meng. 2019-08-13 19:17:10 +05:30
Doroszlai, Attila
3dc22d6ef1 HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh. (#1284) 
Signed-off-by: Nanda kumar <nanda@apache.org>
 2019-08-13 19:09:01 +05:30
Abhishek Modi
b4097b96a3 YARN-9744. RollingLevelDBTimelineStore.getEntityByTime fails with NPE. Contributed by Prabhu Joseph. 2019-08-13 19:04:00 +05:30
Doroszlai, Attila
0b507d2ddf HDDS-1908. TestMultiBlockWritesWithDnFailures is failing (#1282) 2019-08-13 15:38:55 +05:30
Ayush Saxena
454420e4f2 HDFS-14708. TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk. Contributed by Lisheng Sun. 2019-08-13 08:27:20 +05:30
Siyao Meng
c92b49876a HDFS-14148. HDFS OIV ReverseXML SnapshotSection parser throws exception when there are more than one snapshottable directory (#1274) Contributed by Siyao Meng. 2019-08-12 17:26:20 -07:00
Eric Yang
201dc667e9 YARN-9719. Fixed YARN service restart bug when application ID no longer exist in RM. 
Contributed by kyungwan nam
 2019-08-12 18:24:00 -04:00
Szilard Nemeth
e4b538bbda YARN-9723. ApplicationPlacementContext is not required for terminated jobs during recovery. Contributed by Prabhu Joseph 2019-08-12 15:15:43 +02:00
Szilard Nemeth
b91099efd6 YARN-9451. AggregatedLogsBlock shows wrong NM http port. Contributed by Prabhu Joseph 2019-08-12 15:05:28 +02:00
Szilard Nemeth
e0517fea33 YARN-9134. No test coverage for redefining FPGA / GPU resource types in TestResourceUtils. Contributed by Peter Bacsko 2019-08-12 14:36:07 +02:00
Szilard Nemeth
ac6c4f0b29 MAPREDUCE-7197. Fix order of actual and expected expression in assert statements. Contributed by Adam Antal 2019-08-12 13:54:28 +02:00
Márton Elek
dfe772d234
HDDS-1912. start-ozone.sh fail due to ozone-config.sh not found. Contributed by kevin su. 2019-08-12 13:03:39 +02:00
Abhishek Modi
13a5803ccf YARN-9464. Support pending resource metrics in RM's RESTful API. Contributed by Prabhu Joseph. 2019-08-12 14:31:24 +05:30
Abhishek Modi
8fbf8b2eb0 YARN-9722. PlacementRule logs object ID in place of queue name. Contributed by Prabhu Joseph. 2019-08-12 10:44:46 +05:30
Inigo Goiri
6b4564f1d5 HADOOP-16453. Update how exceptions are handled in NetUtils. Contributed by Lisheng Sun. 2019-08-11 20:34:36 -07:00
Abhishek Modi
cf5d8957ee YARN-9657. AbstractLivelinessMonitor add serviceName to PingChecker thread. Contributed by Bilwa S T. 2019-08-11 15:41:56 +05:30
Sunil G
1c5b28659f YARN-9729. [UI2] Fix error message for logs when ATSv2 is offline. Contributed by Zoltan Siegl. 2019-08-11 11:47:07 +05:30
Shweta Yakkali
d29007fb35 HDDS-1366. Add ability in Recon to track the number of small files in an Ozone Cluster (#1146) 2019-08-10 10:14:55 -07:00
Sunil G
e69db45e50 Revert "YARN-9729. [UI2] Fix error message for logs without ATSv2. Contributed by Zoltan Siegl." 
This reverts commit 50cec5a704.
 2019-08-10 21:10:22 +05:30
Sunil G
50cec5a704 YARN-9729. [UI2] Fix error message for logs without ATSv2. Contributed by Zoltan Siegl. 2019-08-10 21:06:25 +05:30
Xiaoyu Yao
fba222a856
HDDS-1943. TestKeyManagerImpl.testLookupKeyWithLocation is failing. Contributed by Xiaoyu Yao. (#1262) 2019-08-09 22:09:50 -07:00
Bharat Viswanadham
bd4be6e168 HDDS-1895. Support Key ACL operations for OM HA. (#1230) 2019-08-09 20:32:01 -07:00
Yiqun Lin
8a77a224c7 HDFS-13359. DataXceiver hung due to the lock in FsDatasetImpl#getBlockInputStream. Contributed by Yiqun Lin. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-09 18:40:28 -07:00
Siyao Meng
e02ffed1b1 HDFS-12125. Document the missing EC removePolicy command (#1258) Contributed by Wenxin He, Siyao Meng. 
Co-authored-by: Wenxin He <wenxin.he@gmail.com>
 2019-08-09 18:00:22 -07:00
Wei-Chiu Chuang
ce3c5a3e3b HDFS-14623. In NameNode Web UI, for Head the file (first 32K) old data is showing. Contributed by hemanthboyina. 2019-08-09 15:41:37 -07:00