big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,988 Commits 2 Branches 2 Tags 264 MiB
3d94da1e00
Commit Graph

1492 Commits

Author SHA1 Message Date
Kai Zheng
58bae35447 YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng 2016-09-18 08:43:36 +08:00
Andrew Wang
8a40953058 HDFS-10823. Implement HttpFSFileSystem#listStatusIterator. 2016-09-16 15:37:36 -07:00
Kai Zheng
ea0c2b8b05 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-15 10:46:00 +08:00
Jing Zhao
08d8e0ba25 HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou. 2016-09-13 11:12:52 -07:00
Yongjun Zhang
d2466ec3e0 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang) 2016-09-12 21:25:06 -07:00
Mingliang Liu
59d59667a8 HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang 2016-09-12 16:17:08 -07:00
Allen Wittenauer
58ed4fa544 HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS 
This commit includes the following changes:

	HADOOP-13356. Add a function to handle command_subcommand_OPTS
	HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
	HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
	HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
	HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
	HADOOP-13357. Modify common to use hadoop_subcommand_opts
	HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
	HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
	HADOOP-13564. modify mapred to use hadoop_subcommand_opts
	HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
	HADOOP-13360. Documentation for HADOOP_subcommand_OPTS

This closes apache/hadoop#126
 2016-09-12 11:10:00 -07:00
Chris Douglas
9f192cc5ac MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan 2016-09-09 11:12:44 -07:00
Kihwal Lee
d4d076876a HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp. 2016-09-09 10:39:35 -05:00
Chris Douglas
1192781a78 HADOOP-13519. Make Path Serializable. Contributed by Steve Loughran 2016-09-08 17:46:12 -07:00
Allen Wittenauer
cae331186d Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)" 
This reverts commit 05ede00386.
 2016-09-08 12:40:30 -07:00
Kai Zheng
d355573f56 Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng" 
This reverts commit 62a9667136
 2016-09-08 05:50:17 +08:00
Anu Engineer
f414d5e118 HADOOP-13388. Clean up TestLocalFileSystemPermission. Contributed by Andras Bokor. 2016-09-07 11:09:41 -07:00
Xiao Chen
680be58aac HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen. 2016-09-06 20:54:17 -07:00
Chris Douglas
d37dc5d1b8 HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin 2016-09-06 10:38:04 -07:00
Kai Zheng
62a9667136 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-07 17:05:33 +08:00
Chris Douglas
3069df7551 FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria 2016-09-01 11:32:26 -07:00
Mingliang Liu
dcd21d083a HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang) 2016-09-01 11:03:06 -07:00
Ray Chiang
05ede00386 YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang) 2016-08-29 15:55:33 -07:00
Anu Engineer
e1ad598cef HADOOP-7363. TestRawLocalFileSystemContract is needed. Contributed by Andras Bokor. 2016-08-29 09:26:46 -07:00
Akira Ajisaka
ab3b727b5f HADOOP-13534. Remove unused TrashPolicy#getInstance and initialize code. Contributed by Yiqun Lin. 2016-08-25 13:54:57 +09:00
Wei-Chiu Chuang
f0efea490e HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-23 04:14:24 -07:00
Xiao Chen
f4d4d3474c HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen. 2016-08-22 14:42:13 -07:00
Chris Nauroth
763f0497bb HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran. 2016-08-19 10:48:10 -07:00
Junping Du
0da69c324d YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi. 
(cherry picked from commit d464483bf7f0b3e3be3ba32cd6c3eee546747ab5)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
 2016-08-18 07:27:23 -07:00
Mingliang Liu
23532716fc HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-16 17:33:04 -07:00
Mingliang Liu
27a6e09c4e Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)" 
This reverts commit 9336a0495f.
 2016-08-16 16:25:37 -07:00
Andrew Wang
4b689e7a75 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 2016-08-16 15:01:18 -07:00
Mingliang Liu
9336a0495f HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-15 20:24:54 -07:00
Varun Saxena
d714030b5d HADOOP-13333. testConf.xml ls comparators in wrong order (Vrushali C via Varun Saxena) 2016-08-16 03:03:44 +05:30
Kai Zheng
8fbb57fbd9 HADOOP-11588. Benchmark framework and test for erasure coders. Contributed by Rui Li 2016-08-12 15:05:52 +08:00
Xiao Chen
e83be44af5 HADOOP-13461. NPE in KeyProvider.rollNewVersion. Contributed by Colm O hEigeartaigh. 2016-08-10 16:28:02 -07:00
Karthik Kambatla
85422bb7c5 HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha) 2016-08-09 13:42:32 -07:00
Masatake Iwasaki
8f9b61852b HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang. 2016-08-09 09:54:44 +09:00
Sangjin Lee
0ad48aa2c8 HADOOP-12747. support wildcard in libjars argument (sjlee) 2016-08-08 17:34:56 -07:00
Lei Xu
6418edd6fe HADOOP-13380. TestBasicDiskValidator should not write data to /tmp (Yufei Gu via lei) 2016-08-08 15:06:03 -07:00
Jitendra Pandey
625585950a HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu. 2016-08-08 11:00:19 -07:00
Wei-Chiu Chuang
49ba09a922 HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang. 2016-08-05 16:32:44 -07:00
Arpit Agarwal
331ef25152 HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang) 2016-08-04 12:25:39 -07:00
Arpit Agarwal
b8ca84ac99 HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal) 2016-08-04 10:07:53 -07:00
Kihwal Lee
9422515239 HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp. 2016-08-04 10:45:55 -05:00
Xiao Chen
05db64913d HADOOP-13443. KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default. Contributed by Anthony Young-Garner. 2016-08-04 15:57:34 +08:00
Jason Lowe
c82745432a HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger 2016-08-03 20:17:30 +00:00
Kihwal Lee
580a833496 HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp. 2016-08-03 13:22:22 -05:00
Kihwal Lee
2d8227605f HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp. 2016-08-03 09:31:49 -05:00
Arpit Agarwal
954465e7ba HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-02 13:40:33 -07:00
Chris Nauroth
0458a2af6e HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin. 2016-08-02 12:43:30 -07:00
Kihwal Lee
b3018e73cc HADOOP-13429. Dispose of unnecessary SASL servers. Contributed by Daryn Sharp. 2016-08-02 10:40:28 -05:00
Akira Ajisaka
770b5eb2db HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon. 2016-08-01 17:35:59 +09:00
Kai Zheng
34ccaa8367 HADOOP-11540. Raw Reed-Solomon coder using Intel ISA-L library. Contributed by Kai Zheng 2016-08-01 06:34:26 +08:00
Akira Ajisaka
54fe17a607 HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák. 2016-07-27 19:41:09 +09:00
Kai Zheng
f1a4863dfc HADOOP-13041. Adding tests for coder utilities. Contributed by Kai Sasaki 2016-07-26 21:53:37 +08:00
Chris Douglas
22a9a6b0d4 HADOOP-13272. ViewFileSystem should support storage policy related API. Contributed by Peter Shi 2016-07-22 18:08:12 -07:00
Chris Nauroth
5fda66e4a3 HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran. 2016-07-22 15:38:18 -07:00
Chris Nauroth
43cf6b101d HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge. 2016-07-21 14:12:31 -07:00
Akira Ajisaka
dc065dd64c HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki. 2016-07-19 16:05:48 -07:00
Akira Ajisaka
c2bcffb34e HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki. 2016-07-18 11:48:23 -07:00
Steve Loughran
76be82bc04 HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor 2016-07-18 14:38:35 +01:00
Robert Kanter
442162048a HADOOP-13254. Create framework for configurable disk checkers (yufeigu via rkanter) 2016-07-15 13:41:26 -07:00
Akira Ajisaka
1381483233 HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou. 2016-07-14 23:13:55 -07:00
Steve Loughran
be26c1b9b0 Revert "HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor" 
This reverts commit 45af585e7a.
 2016-07-14 10:30:36 +01:00
Steve Loughran
45af585e7a HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor 2016-07-14 10:29:29 +01:00
Zhe Zhang
728bf7f698 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung. 2016-07-13 16:37:40 -07:00
Jitendra Pandey
ef30bf3c3f HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer. 2016-07-08 14:17:14 -07:00
Jitendra Pandey
6e597600f7 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 14:58:19 -07:00
Vinayakumar B
c25021fb71 HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B) 2016-07-01 12:09:59 +05:30
Steve Loughran
96fa0f848b HADOOP-12709 Cut s3:// from trunk. Contributed by Mingliang Liu. 2016-06-29 16:04:50 +01:00
Allen Wittenauer
b3649adf6a HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw) 2016-06-28 20:47:05 -07:00
Allen Wittenauer
6103635591 HADOOP-9330. Add custom JUnit4 test runner with configurable timeout (Steve Loughran via aw) 2016-06-28 20:40:41 -07:00
Allen Wittenauer
1faaa69078 HADOOP-9321. fix coverage org.apache.hadoop.net (Ivan A. Veselovsky via aw) 2016-06-28 20:37:42 -07:00
Allen Wittenauer
23c3ff85a9 HADOOP-13209. replace slaves with workers (John Smith via aw) 2016-06-28 05:53:03 -07:00
Andrew Wang
7d2070493e HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen. 2016-06-27 18:46:33 -07:00
Arpit Agarwal
9683eab0e1 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:36:05 -07:00
Tsz-Wo Nicholas Sze
d328e66706 HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:45:16 +08:00
Zhe Zhang
0b9edf6e0f HADOOP-13019. Implement ErasureCodec for HitchHiker XOR coding. Contributed by Kai Sasaki. 2016-06-23 15:52:51 -07:00
Andrew Wang
e98c0c7a1c Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen." 
This reverts commit 35356de1ba.
 2016-06-23 11:08:02 -07:00
Steve Loughran
4ee3543625 HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:45:25 +01:00
Masatake Iwasaki
67089875f0 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims) 2016-06-22 23:38:20 +09:00
Colin Patrick Mccabe
5370a6ffae HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe) 2016-06-20 10:46:18 -07:00
Akira Ajisaka
fc6b50cc57 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde. 2016-06-20 17:07:26 +09:00
Xiaoyu Yao
0761379fe4 HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao. 2016-06-17 15:25:14 -07:00
Akira Ajisaka
51d497fa93 MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 2016-06-17 11:03:54 +09:00
Konstantin V Shvachko
a2a5cb60b0 HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 18:20:49 -07:00
Colin Patrick Mccabe
bf780406f2 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe) 2016-06-16 16:48:05 -07:00
Vinayakumar B
cc6c265171 HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B) 2016-06-16 16:47:06 +05:30
Jitendra Pandey
6f0aa75121 HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin. 2016-06-15 11:41:49 -07:00
Masatake Iwasaki
20b13d109a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki. 2016-06-14 19:20:46 +09:00
Andrew Wang
0accc3306d HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 2016-06-13 11:43:46 -07:00
Karthik Kambatla
49b4064644 HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha) 2016-06-12 14:12:31 -07:00
Jing Zhao
0bbb4ddd79 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. 2016-06-10 10:38:13 -07:00
Chris Nauroth
9581fb715c HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane. 2016-06-09 14:33:31 -07:00
Tsz-Wo Nicholas Sze
35f255b03b Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 5360da8bd9.
 2016-06-06 16:31:43 +08:00
Tsz-Wo Nicholas Sze
574dcd34c0 Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit e4450d47f1.
 2016-06-06 16:31:23 +08:00
Tsz-Wo Nicholas Sze
aa20fa150d Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 4d36b221a2.
 2016-06-06 16:28:47 +08:00
Tsz-Wo Nicholas Sze
eded3d109e Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit 106234d873.
 2016-06-06 16:28:21 +08:00
Andrew Wang
106234d873 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit fc94810d3f.
 2016-06-03 18:09:55 -07:00
Andrew Wang
4d36b221a2 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit 1b9f18623a.
 2016-06-03 18:09:18 -07:00
Andrew Wang
e4450d47f1 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit 42c22f7e3d.
 2016-06-03 18:09:16 -07:00
Andrew Wang
5360da8bd9 Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit 83f2f78c11.
 2016-06-03 18:09:09 -07:00
Chris Nauroth
d82bc85018 HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu. 2016-06-03 16:38:30 -07:00