big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9,232 Commits 2 Branches 2 Tags 264 MiB
1cd088fd9d
Commit Graph

2514 Commits

Author SHA1 Message Date
Andrew Wang
d3d3d47202 HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang) 2014-10-10 13:40:37 -07:00
Colin Patrick Mccabe
1ceb326933 HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe) 2014-10-10 13:03:29 -07:00
Aaron T. Myers
cbd21fd13b HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang. 2014-10-09 18:52:48 -07:00
Colin Patrick Mccabe
d8d628d1e0 HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe) 2014-10-09 17:05:35 -07:00
Andrew Wang
8d94114495 HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang) 2014-10-09 13:21:19 -07:00
Andrew Wang
d7b647f0ee HADOOP-11178. Fix findbugs exclude file. (Arun Suresh via wang) 2014-10-09 11:58:36 -07:00
cnauroth
9097183983 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth. 2014-10-09 11:51:12 -07:00
cnauroth
1123a06e36 HADOOP-11175. Fix several issues of hadoop security configuration in user doc. Contributed by Yi Liu. 2014-10-09 11:10:23 -07:00
Uma Maheswara Rao G
8d7c54967d HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh) 2014-10-09 20:06:41 +05:30
Aaron T. Myers
2a51494ce1 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh. 2014-10-08 18:01:51 -07:00
Colin Patrick Mccabe
d996235285 HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe) 2014-10-08 17:55:46 -07:00
Zhijie Shen
a169051931 HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch. 2014-10-08 15:36:16 -07:00
cnauroth
2217e2f8ff HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell. 2014-10-08 14:20:23 -07:00
Colin Patrick Mccabe
7b29f99ad2 CHANGES.txt: move HADOOP-10404 underneath branch 2.6 2014-10-08 14:02:23 -07:00
Andrew Wang
60f0f6fcde HADOOP-11166. Remove ulimit from test-patch.sh. 2014-10-07 17:30:07 -07:00
Andrew Wang
0263656247 Fixup for CHANGES.txt 2014-10-07 14:58:57 -07:00
Andrew Wang
4b2834898c HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang) 2014-10-07 14:57:03 -07:00
Andrew Wang
b2f6197523 HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang) 2014-10-07 14:46:59 -07:00
Kihwal Lee
99d7a452be HADOOP-11007. Reinstate building of ant tasks support. Contributed by 
Jason Lowe.
 2014-10-07 16:20:16 -05:00
Colin Patrick Mccabe
9196db9a08 HDFS-7186. Document the "hadoop trace" command. (Masatake Iwasaki via Colin P. McCabe) 2014-10-07 11:56:30 -07:00
Haohui Mai
0fb273570c HADOOP-11168. Remove duplicated entry dfs.webhdfs.enabled in the user doc. Contributed by Yi Liu. 2014-10-06 22:07:16 -06:00
Colin Patrick Mccabe
687d83c9e1 HADOOP-10404. Commit correct version of patch (cmccabe) 2014-10-06 14:44:13 -07:00
Colin Patrick Mccabe
8099de259f HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe) 2014-10-06 14:40:56 -07:00
Arun C. Murthy
16333b4fd8 HADOOP-10731. Sync-ing CHANGES.txt across branches. 2014-10-05 07:50:41 -07:00
Arun C. Murthy
8f9ab998e2 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan. 2014-10-05 07:38:21 -07:00
cnauroth
bbb3b1acc0 HADOOP-11163. Correct CHANGES.txt. 2014-10-03 21:07:01 -07:00
cnauroth
69c9af9103 HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu. 2014-10-03 21:01:28 -07:00
Colin Patrick Mccabe
7f6ed7fe36 HDFS-7055. Add tracing to DFSInputStream (cmccabe) 2014-10-03 13:35:43 -07:00
Andrew Wang
2d8e6e2c4a HADOOP-11151. Automatically refresh auth token and retry on auth failure. Contributed by Arun Suresh. 2014-10-02 19:54:57 -07:00
Haohui Mai
f679ca38ce HADOOP-11160. Fix typo in nfs3 server duplicate entry reporting. Contributed by Charles Lamb. 2014-10-02 14:07:36 -07:00
Andrew Wang
6ac10516e7 HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang) 2014-10-02 13:51:08 -07:00
Haohui Mai
875aa797ca HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li. 2014-10-01 13:18:56 -07:00
Vinod Kumar Vavilapalli
5ca97f1e60 YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu. 
Committed as a YARN patch even though all the code changes are in common.
 2014-10-01 09:54:17 -07:00
arp
dde2ed13c2 Merge branch 'trunk' into HDFS-6581 2014-09-30 18:05:54 -07:00
Steve Loughran
a469833639 HADOOP-11117 UGI HadoopLoginModule doesn't catch & wrap all kerberos-related exceptions (stevel) 2014-09-30 17:30:06 -07:00
Andrew Wang
a4c9b80a7c HADOOP-11113. Namenode not able to reconnect to KMS after KMS restart. (Arun Suresh via wang) 2014-09-30 16:48:24 -07:00
Andrew Wang
d7075ada5d HADOOP-11156. DelegateToFileSystem should implement getFsStatus(final Path f). Contributed by Zhihai Xu. 2014-09-30 16:39:44 -07:00
Arun C. Murthy
ea32a66f7d Preparing to branch hadoop-2.6 2014-09-30 10:26:42 -07:00
cnauroth
b9158697a4 HADOOP-11145. TestFairCallQueue fails. Contributed by Akira AJISAKA. 2014-09-30 08:57:05 -07:00
cnauroth
8dc4e9408f HADOOP-11154. Update BUILDING.txt to state that CMake 3.0 or newer is required on Mac. Contributed by Chris Nauroth. 2014-09-30 08:30:44 -07:00
arp
bb84f1fccb HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal) 2014-09-29 22:27:59 -07:00
arp
7f0422be76 Merge branch 'trunk' into HDFS-6581 2014-09-29 16:29:43 -07:00
Brandon Li
c88c6c57aa HADOOP-11130. NFS updateMaps OS check is reversed. Contributed by Brandon Li 2014-09-29 15:05:59 -07:00
Andrew Wang
64aef18965 HADOOP-11153. Make number of KMS threads configurable. (wang) 2014-09-29 15:02:29 -07:00
Andrew Wang
c6c3247dc0 HDFS-7122. Use of ThreadLocal<Random> results in poor block placement. (wang) 2014-09-29 15:00:26 -07:00
arp
1e6b4b9b2e Merge branch 'trunk' into HDFS-6581 2014-09-29 14:01:47 -07:00
Andrew Wang
a45b331cc9 Move HDFS-7157 to HDFS CHANGES.txt 2014-09-29 13:17:21 -07:00
Andrew Wang
a78953c974 HADOOP-11110. JavaKeystoreProvider should not report a key as created if it was not flushed to the backing file. (Arun Suresh via wang) 2014-09-29 13:10:26 -07:00
Colin Patrick Mccabe
b3d5d269a7 HDFS-7157. Using Time.now() for recording start/end time of reconfiguration tasks (Lei Xu via Colin Patrick McCabe) 2014-09-29 11:29:54 -07:00
Jason Lowe
cf4631d7c9 HADOOP-11049. javax package system class default is too broad. Contributed by Sangjin Lee 2014-09-29 14:36:29 +00:00
arp
9cbb2c55d5 Merge branch 'trunk' into HDFS-6581 2014-09-27 20:28:03 -07:00
Steve Loughran
7f300bcdc7 HADOOP-11143 NetUtils.wrapException loses inner stack trace on BindException 2014-09-27 21:06:53 +01:00
Jian He
5f16c98ad6 MAPREDUCE-6087. Fixed wrong config name of MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by Akira AJISAKA 2014-09-26 18:05:26 -07:00
arp
d96396627f Merge branch 'trunk' into HDFS-6581 2014-09-26 16:31:08 -07:00
Allen Wittenauer
6b7673e3cd HADOOP-10552. Fix usage and example at FileSystemShell.apt.vm (Kenji Kikushima via aw) 2014-09-26 14:56:59 -07:00
Allen Wittenauer
aa5d9256fb HADOOP-10731. Remove @date JavaDoc comment in ProgramDriver class (Henry Saputra via aw) 2014-09-26 14:41:37 -07:00
Allen Wittenauer
c7c8e388a9 MAPREDUCE-5945. Update the description of GenericOptionsParser -jt option (Akira AJISAKA via aw) 2014-09-26 14:25:49 -07:00
Jason Lowe
f154ebe8c4 HADOOP-11048. user/custom LogManager fails to load if the client classloader is enabled. Contributed by Sangjin Lee 2014-09-26 19:49:23 +00:00
Allen Wittenauer
83264cf457 HADOOP-10954. Adding site documents of hadoop-tools (Masatake Iwasaki via aw) 2014-09-26 11:59:45 -07:00
Allen Wittenauer
df5fed5c0e HADOOP-8808. Update FsShell documentation to mention deprecation of some of the commands, and mention alternatives (Akira AJISAKA via aw) 2014-09-26 11:10:51 -07:00
arp
7060502edb Merge branch 'trunk' into HDFS-6581 2014-09-26 11:09:03 -07:00
Colin Patrick Mccabe
55302ccfba HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe) 2014-09-26 10:30:30 -07:00
Andrew Wang
4ea77efa3a HADOOP-11140. hadoop-aws only need test-scoped dependency on hadoop-common's tests jar. Contributed by Juan Yu. 2014-09-25 21:56:26 -07:00
arp
032e0eba6b Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-25 19:50:28 -07:00
Andrew Wang
e96ce6f3e3 HDFS-7077. Separate CipherSuite from crypto protocol version. (wang) 2014-09-25 18:40:40 -07:00
Colin Patrick Mccabe
1861b32eb5 HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe) 2014-09-25 13:11:59 -07:00
arp
e9edafc731 Merge branch 'trunk' into HDFS-6581 2014-09-25 11:06:25 -07:00
Vinayakumar B
dff95f7af8 HADOOP-11101. How about inputstream close statement from catch block to finally block in FileContext#copy() ( Contributed by skrho ) 2014-09-25 12:46:47 +05:30
arp
b1000fbba4 Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
 2014-09-24 20:08:32 -07:00
Allen Wittenauer
3cde37c991 HADOOP-11009. Add Timestamp Preservation to DistCp (Gary Steelman via aw) 2014-09-24 15:38:30 -07:00
cnauroth
cbf0ae742a HADOOP-11064. UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes. Contributed by Chris Nauroth. 2014-09-24 15:30:13 -07:00
Karthik Kambatla
ef784a2e08 HADOOP-11017. Addendum to fix RM HA. KMS delegation token secret manager should be able to use zookeeper as store. (Arun Suresh via kasha) 2014-09-23 17:07:48 -07:00
arp
bfc7b7e6a0 Merge branch 'trunk' into HDFS-6581 2014-09-23 16:40:35 -07:00
Allen Wittenauer
3dc28e2052 HADOOP-11092. hadoop shell commands should print usage if not given a class (aw) 2014-09-23 12:24:23 -07:00
Steve Loughran
7aa667eefa HADOOP-11111 MiniKDC to use locale EN_US for case conversions: hadoop-common/CHANGES.TXT 2014-09-23 10:57:15 +01:00
Steve Loughran
df52fec21d HADOOP-11111 MiniKDC to use locale EN_US for case conversions 2014-09-23 10:54:06 +01:00
arp
889122bd55 Merge branch 'trunk' into HDFS-6581 2014-09-22 18:00:58 -07:00
Vinayakumar B
eab15af12c HADOOP-10131. NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree (Contributed by Vinayakumar B) 2014-09-22 11:25:56 +05:30
Andrew Wang
1737950d0f HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. Contributed by Zhe Zhang. 2014-09-21 21:29:46 -07:00
arp
09dab88d3e Merge branch 'trunk' into HDFS-6581 2014-09-20 10:34:45 -07:00
Alejandro Abdelnur
db890eef32 HADOOP-11017. KMS delegation token secret manager should be able to use zookeeper as store. (asuresh via tucu) 2014-09-20 08:21:44 -07:00
cnauroth
f85cc14eb4 HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth. 2014-09-19 21:23:26 -07:00
Andrew Wang
b6ceef90e5 HADOOP-11112. TestKMSWithZK does not use KEY_PROVIDER_URI. (tucu via wang) 2014-09-19 17:42:00 -07:00
Andrew Wang
adf0b67a71 HADOOP-10970. Cleanup KMS configuration keys. (wang) 2014-09-19 14:59:25 -07:00
Allen Wittenauer
9f03a7c018 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw) 2014-09-19 11:33:07 -07:00
arp
f8bbf80067 Merge branch 'trunk' into HDFS-6581 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsLocatedFileStatus.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2014-09-18 22:26:42 -07:00
Aaron T. Myers
6434572297 HADOOP-11109. Site build is broken. Contributed by Jian He. 2014-09-18 18:00:39 -07:00
Andrew Wang
8e73084491 HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang) 2014-09-18 17:49:17 -07:00
Tsz-Wo Nicholas Sze
98f7bfe993 Merge branch 'HDFS-6584' into trunk 2014-09-19 07:11:19 +08:00
Alejandro Abdelnur
fad4cd85b3 KMS: Support for multiple Kerberos principals. (tucu) 2014-09-18 16:03:38 -07:00
arp
22295b4783 Merge branch 'trunk' into HDFS-6581 2014-09-18 15:59:37 -07:00
cnauroth
1b4b46004a HADOOP-11105. Update CHANGES.txt. 2014-09-18 15:41:19 -07:00
cnauroth
1942364ef1 HADOOP-11105. MetricsSystemImpl could leak memory in registered callbacks. Contributed by Chuan Liu. 2014-09-18 15:36:43 -07:00
Andrew Wang
fe2f54d4cb HADOOP-11106. Document considerations of HAR and Encryption. (clamb via wang) 2014-09-18 14:51:08 -07:00
arp
849ccfa699 Merge branch 'trunk' into HDFS-6581 2014-09-18 11:06:40 -07:00
Tsz-Wo Nicholas Sze
2d2b0009e6 Merge branch 'trunk' into HDFS-6584 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2014-09-18 13:00:29 +08:00
Andrew Wang
10e8602f32 HDFS-7004. Update KeyProvider instantiation to create by URI. (wang) 2014-09-17 20:14:40 -07:00
Andrew Wang
bf38793ce1 Move some HDFS JIRAs to the correct CHANGES.txt 2014-09-17 18:08:34 -07:00
Andrew Wang
47e5e19831 HADOOP-11040. Return value of read(ByteBuffer buf) in CryptoInputStream is incorrect in some cases. (Yi Liu via wang) 2014-09-17 17:58:56 -07:00
Alejandro Abdelnur
123f20d42f HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu) 2014-09-17 15:29:17 -07:00