Commit Graph

3017 Commits

Author SHA1 Message Date
Kai Zheng
4ad484883f HADOOP-11847 Enhance raw coder allowing to read least required inputs in decoding. Contributed by Kai Zheng 2015-05-26 12:07:16 -07:00
Vinayakumar B
5a391e1d25 HADOOP-12029. Remove chunkSize from ECSchema as its not required for coders (Contributed by Vinayakumar B) 2015-05-26 12:07:16 -07:00
Kai Zheng
b30e96bfb4 HDFS-8382 Remove chunkSize and initialize from erasure coder. Contributed by Kai Zheng 2015-05-26 12:07:15 -07:00
Kai Zheng
4ae32abdf4 HADOOP-12013 Generate fixed data to perform erasure coder test. Contributed by Kai Zheng 2015-05-26 12:07:14 -07:00
Zhe Zhang
343c0e76fc HADOOP-11938. Enhance ByteBuffer version encode/decode API of raw erasure coder. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
b64f6745a4 HADOOP-11566. Add tests and fix for erasure coders to recover erased parity units. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
09c3a375ba HADOOP-11920. Refactor some codes for erasure coders. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Zhe Zhang
9c7a78c874 HADOOP-11921. Enhance tests for erasure coders. Contributed by Kai Zheng. 2015-05-26 12:02:31 -07:00
Jing Zhao
3f2c6938f1 HDFS-8223. Should calculate checksum for parity blocks in DFSStripedOutputStream. Contributed by Yi Liu. 2015-05-26 11:59:54 -07:00
Zhe Zhang
e8df2581c3 HDFS-8156. Add/implement necessary APIs even we just have the system default schema. Contributed by Kai Zheng. 2015-05-26 11:59:53 -07:00
Uma Maheswara Rao G
014d8675c5 HDFS-8024. Erasure Coding: ECworker frame, basics, bootstraping and configuration. (Contributed by Uma Maheswara Rao G) 2015-05-26 11:59:52 -07:00
Tsz-Wo Nicholas Sze
909632dd90 HADOOP-11841. Remove unused ecschema-def.xml files. 2015-05-26 11:59:12 -07:00
Vinayakumar B
ceb3d1c170 HDFS-7349. Support DFS command for the EC encoding (Contributed by Vinayakumar B) 2015-05-26 11:59:11 -07:00
Vinayakumar B
f53e402635 HDFS-8090. Erasure Coding: Add RPC to client-namenode to list all ECSchemas loaded in Namenode. (Contributed by Vinayakumar B) 2015-05-26 11:58:40 -07:00
Kai Zheng
971bd5e885 HADOOP-11818 Minor improvements for erasurecode classes. Contributed by Rakesh R 2015-05-26 11:55:17 -07:00
Kai Zheng
1a37b0fe9a HDFS-8074 Define a system-wide default EC schema. Contributed by Kai Zheng 2015-05-26 11:55:16 -07:00
Vinayakumar B
99502cbbe2 HADOOP-11645. Erasure Codec API covering the essential aspects for an erasure code ( Contributed by Kai Zheng) 2015-05-26 11:55:15 -07:00
Vinayakumar B
aac73c21c3 HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang.
Updated CHANGES-HDFS-EC-7285.txt
2015-05-26 11:55:15 -07:00
Kai Zheng
d43102d2c5 Updated CHANGES-HDFS-EC-7285.txt 2015-05-26 11:55:14 -07:00
Kai Zheng
17f7cdc047 HADOOP-11805 Better to rename some raw erasure coders. Contributed by Kai Zheng 2015-05-26 11:55:14 -07:00
Zhe Zhang
e54a74b566 HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang. 2015-05-26 11:55:13 -07:00
Kai Zheng
98ea3ec0da HADOOP-11782 Correct two thrown messages in ECSchema class. Contributed by Xinwei Qin 2015-05-26 11:44:47 -07:00
Zhe Zhang
d9af36b9bd HADOOP-11664. Loading predefined EC schemas from configuration. Contributed by Kai Zheng. 2015-05-26 11:43:43 -07:00
Kai Zheng
df297245a7 HADOOP-11647. Reed-Solomon ErasureCoder. Contributed by Kai Zheng 2015-05-26 11:43:41 -07:00
Kai Zheng
90d332d6be HADOOP-11707. Add factory to create raw erasure coder. Contributed by Kai Zheng 2015-05-26 11:43:41 -07:00
Kai Zheng
e3dbfeb138 Updated CHANGES-HDFS-EC-7285.txt accordingly 2015-05-26 11:42:05 -07:00
Kai Zheng
c3bc083405 HADOOP-11706 Refine a little bit erasure coder API 2015-05-26 11:42:04 -07:00
Kai Zheng
68caf8728e Fixed a compiling issue introduced by HADOOP-11705. 2015-05-26 11:32:26 -07:00
drankye
292e367d07 HADOOP-11705. Make erasure coder configurable. Contributed by Kai Zheng 2015-05-26 11:32:25 -07:00
Vinayakumar B
8f89d7489d HADOOP-11646. Erasure Coder API for encoding and decoding of block group ( Contributed by Kai Zheng ) 2015-05-26 11:32:25 -07:00
drankye
c0945a8971 HADOOP-11643. Define EC schema API for ErasureCodec. Contributed by Kai Zheng 2015-05-26 11:32:24 -07:00
drankye
dae27f6dd1 HADOOP-11542. Raw Reed-Solomon coder in pure Java. Contributed by Kai Zheng 2015-05-26 11:07:15 -07:00
Kai Zheng
b29f3bde4d HADOOP-11541. Raw XOR coder 2015-05-26 11:03:35 -07:00
Vinayakumar B
9f19eb9fcf HADOOP-11534. Minor improvements for raw erasure coders ( Contributed by Kai Zheng ) 2015-05-26 11:03:35 -07:00
Uma Maheswara Rao G
e50bcea83d HADOOP-11514. Raw Erasure Coder API for concrete encoding and decoding (Kai Zheng via umamahesh) 2015-05-26 11:03:35 -07:00
Akira Ajisaka
56996a685e HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru. 2015-05-26 16:16:21 +09:00
Colin Patrick Mccabe
f34638399a HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe) 2015-05-22 12:51:03 -07:00
Vinayakumar B
55ed6558ba HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin) 2015-05-22 16:45:19 +05:30
Akira Ajisaka
ab7958f227 HADOOP-11594. Improve the readability of site index of documentation. Contributed by Masatake Iwasaki. 2015-05-22 16:51:05 +09:00
Akira Ajisaka
b2a40942c1 HADOOP-11955. Fix a typo in the cluster setup doc. Contributed by Yanjun Wang. 2015-05-22 16:09:01 +09:00
Akira Ajisaka
c7fea088f7 HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki. 2015-05-22 14:15:08 +09:00
Jakob Homan
4fc942a84f HADOOP-12016. Typo in FileSystem::listStatusIterator. Contributed by Arthur Vigil. 2015-05-21 14:50:03 -07:00
Akira Ajisaka
0e4f1081c7 HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru. 2015-05-21 17:52:03 +09:00
Haohui Mai
fb6b38d67d HADOOP-11772. RPC Invoker relies on static ClientCache which has synchronized(this) blocks. Contributed by Haohui Mai. 2015-05-20 20:10:50 -07:00
Akira Ajisaka
4aa730ce85 HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. 2015-05-20 19:25:45 +09:00
Haohui Mai
ce53c8eb0c HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. 2015-05-19 18:28:20 -07:00
Allen Wittenauer
12d6c5ce4f HADOOP-12000. cannot use --java-home in test-patch (aw) 2015-05-19 15:24:23 -07:00
cnauroth
e422e76fca HADOOP-11963. Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. Contributed by Anu Engineer. 2015-05-19 11:50:27 -07:00
Arun Suresh
fd3cb533d2 HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) 2015-05-19 11:35:57 -07:00
Colin Patrick Mccabe
470c87dbc6 HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 2015-05-19 10:50:15 -07:00