big-data/hadoop
big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Projects Wiki Activity
16,493 Commits 2 Branches 2 Tags
Commit Graph

130 Commits

Author SHA1 Message Date
Steve Loughran
6595e92b64 Fix hadoop-common-project/hadoop-common/src/main/native/README to current mail list and URL 2014-09-02 20:29:38 +01:00
Chris Nauroth
b6c24472f3 HADOOP-10989. Work around buggy getgrouplist() implementations on Linux that return 0 on failure. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619659 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-22 04:05:18 +00:00
Andrew Wang
0cc08f6da4 Merge from trunk to branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618700 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-18 18:41:31 +00:00
Colin McCabe
e446497cd1 HDFS-6561. org.apache.hadoop.util.DataChecksum should support native checksumming (James Thomas via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618680 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-18 18:02:37 +00:00
Todd Lipcon
bd79a4b926 HADOOP-10838. Byte array native checksumming. Contributed by James Thomas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617875 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-14 04:29:35 +00:00
Arpit Agarwal
2f3ed504c1 HADOOP-10966. Hadoop Common native compilation broken in windows. (Contributed by David Villegas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617823 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-13 20:01:21 +00:00
Colin McCabe
f7ac928a7c HADOOP-10962. Flags for posix_fadvise are not valid in some architectures (David Villegas via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617621 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-12 23:03:06 +00:00
Andrew Wang
ac73d416f3 Merge from trunk to branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615844 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-05 02:30:54 +00:00
Chris Nauroth
c614ceed84 HADOOP-10925. Compilation fails in native link0 function on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615320 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-02 15:02:23 +00:00
Colin McCabe
1ba3f89714 HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-01 20:41:05 +00:00
Colin McCabe
a4984f5f0a HADOOP-10871. incorrect prototype in OpensslSecureRandom.c (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612436 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-21 23:56:53 +00:00
Andrew Wang
56c0bd4d37 Merge from trunk to branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610853 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-15 21:10:24 +00:00
Chris Nauroth
9fc972499f HADOOP-10810. Clean up native code compilation warnings. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610524 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-14 20:50:02 +00:00
Colin McCabe
425616861b HADOOP-10780. hadoop_user_info_alloc fails on FreeBSD due to incorrect sysconf use (trtrmitya via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610470 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-14 17:51:32 +00:00
Colin McCabe
905c90b066 HADOOP-10734. Implement high-performance secure random number sources. (Yi Liu via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609874 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-12 01:29:26 +00:00
Chris Nauroth
520e458d4f HADOOP-10815. Implement Windows equivalent of mlock. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609588 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-10 23:26:16 +00:00
Chris Nauroth
5279f64cb6 HADOOP-10808. Remove unused native code for munlock. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609509 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-10 17:11:27 +00:00
Colin McCabe
c030bac84f HADOOP-10781. Unportable getgrouplist usage breaks FreeBSD (Dmitry Sivachenko via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608869 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-08 18:15:25 +00:00
Colin McCabe
03c858dad4 HADOOP-10693: add files left out of previous checkin (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607769 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-03 23:51:50 +00:00
Colin McCabe
bfef9807a0 HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL (hitliuyi via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607768 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-03 23:40:31 +00:00
Jason Darrell Lowe
c1eda00e84 HADOOP-10699. Fix build native library on mac osx. Contributed by Binglin Chang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603042 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-17 02:23:58 +00:00
Kihwal Lee
ca4cf1c6f4 HADOOP-10527. Fix incorrect return code and allow more retries on EINTR. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589405 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-23 13:26:49 +00:00
Kihwal Lee
360c8d1a18 HADOOP-10522. JniBasedUnixGroupMapping mishandles errors. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588949 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-21 18:27:16 +00:00
Chris Nauroth
f5a8815492 HADOOP-10450. Build zlib native code bindings in hadoop.dll for Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582868 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-28 19:47:21 +00:00
Jonathan Turner Eagles
b5b350c02e HADOOP-10442. Group look-up can cause segmentation fault when certain JNI-based mapping module is used. (Kihwal Lee via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582451 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-27 19:56:26 +00:00
Chris Nauroth
c4b0ce0ace HADOOP-10327. Trunk windows build broken after HDFS-5746. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565389 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-06 18:40:23 +00:00
Colin McCabe
140246bad8 HDFS-5746. Add ShortCircuitSharedMemorySegment (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563362 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-01 02:25:33 +00:00
Andrew Wang
3a299fd7bb HADOOP-10198. DomainSocket: add support for socketpair. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554888 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-02 20:00:07 +00:00
Colin McCabe
002840f605 HADOOP-10087. UserGroupInformation.getGroupNames() fails to return primary group first when JniBasedUnixGroupsMappingWithFallback is used (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550229 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 18:58:30 +00:00
Andrew Wang
4004a42d53 HDFS-5404 Resolve regressions in Windows compatibility on HDFS-4949 branch. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1535217 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-24 00:08:15 +00:00
Andrew Wang
da1f4419e3 merge the rest of trunk to branch HDFS-4949 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532967 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-17 05:32:42 +00:00
Chris Nauroth
86b5f80e8c HADOOP-10040. Correct native.vcxproj for inclusion of lz4hc.c. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532136 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-14 23:31:08 +00:00
Chris Nauroth
edabf898d7 HADOOP-10040. Correct merge error on native.vcxproj. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531994 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-14 17:43:06 +00:00
Chris Nauroth
11716cf390 HADOOP-10040. Revert svn propset for CRLF line endings on Windows files. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531977 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-14 17:01:33 +00:00
Chris Nauroth
bbac0cf05e HADOOP-10040. hadoop.cmd in UNIX format and would not run by default on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531491 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-12 03:14:24 +00:00
Colin McCabe
50af34f778 HDFS-5201. NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523153 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-14 00:05:29 +00:00
Chris Nauroth
1a1f49fa4f HDFS-5195. Prevent passing null pointer to mlock and munlock. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523093 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-13 20:47:15 +00:00
Andrew Wang
dd00bb71aa merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1514105 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 00:15:11 +00:00
Colin McCabe
70527c8754 merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1513658 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-13 21:19:53 +00:00
Chris Nauroth
1fafb1e1e0 HADOOP-9802. Support Snappy codec on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512872 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-11 05:51:34 +00:00
Colin McCabe
2a4031940c HDFS-5049. Add JNI mlock support. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1512427 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-09 18:14:07 +00:00
Luke Lu
c8e200f2c2 HADOOP-9319. Update bundled LZ4 source to r99. (Binglin Chang via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510734 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 21:10:54 +00:00
Chris Nauroth
77fa04457c HADOOP-9759. Add support for NativeCodeLoader#getLibraryName on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506325 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-23 22:06:47 +00:00
Luke Lu
ba3d29a2e2 HADOOP-9164. Print paths of loaded native libraries in NativeLibraryChecker. (Binglin Chang via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504700 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 22:38:36 +00:00
Kihwal Lee
37b2a96055 HADOOP-9707. Fix register lists for crc32c inline assembly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503390 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-15 18:15:00 +00:00
Colin McCabe
ca35235b04 HADOOP-9439. JniBasedUnixGroupsMapping: fix some crash bugs (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496112 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-24 16:21:18 +00:00
Chris Nauroth
2e99da4853 HADOOP-9637. Adding Native Fstat for Windows as needed by YARN. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494341 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 22:15:26 +00:00
Colin McCabe
0c88f38be8 HADOOP-9635. Fix potential stack overflow in DomainSocket.c (V. Karthik Kumar via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491927 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-11 19:56:25 +00:00
Aaron Myers
4e419b3551 HADOOP-9566. Performing direct read using libhdfs sometimes raises SIGPIPE (which in turn throws SIGABRT) causing client crashes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483612 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-17 00:06:56 +00:00
Aaron Myers
b98b776363 HADOOP-9481. Broken conditional logic with HADOOP_SNAPPY_LIBRARY. Contributed by Vadim Bondarev. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481191 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 21:17:13 +00:00