2013-08-09 18:14:07 +00:00
|
|
|
Hadoop HDFS Change Log for HDFS-4949
|
|
|
|
|
|
|
|
|
|
HDFS-4949 (Unreleased)
|
|
|
|
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
HDFS-5049. Add JNI mlock support. (Andrew Wang via Colin Patrick McCabe)
|
|
|
|
|
|
2013-08-13 21:05:09 +00:00
|
|
|
HDFS-5051. Propagate cache status information from the DataNode to the
|
|
|
|
|
NameNode (Andrew Wang via Colin Patrick McCabe)
|
|
|
|
|
|
2013-08-22 23:37:51 +00:00
|
|
|
HDFS-5052. Add cacheRequest/uncacheRequest support to NameNode.
|
|
|
|
|
(contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-08-24 03:41:25 +00:00
|
|
|
HDFS-5050. Add DataNode support for mlock and munlock
|
|
|
|
|
(Andrew Wang via Colin Patrick McCabe)
|
|
|
|
|
|
2013-08-30 22:15:51 +00:00
|
|
|
HDFS-5141. Add cache status information to datanode heartbeat.
|
|
|
|
|
(Contributed by Andrew Wang)
|
|
|
|
|
|
2013-09-03 20:38:45 +00:00
|
|
|
HDFS-5121. Add RPCs for creating and manipulating cache pools.
|
|
|
|
|
(Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-09-06 18:52:50 +00:00
|
|
|
HDFS-5163. Miscellaneous cache pool RPC fixes. (Contributed by Colin
|
|
|
|
|
Patrick McCabe)
|
|
|
|
|
|
2013-09-09 18:53:01 +00:00
|
|
|
HDFS-5120. Add command-line support for manipulating cache pools.
|
|
|
|
|
(Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-09-12 03:55:10 +00:00
|
|
|
HDFS-5158. Add command-line support for manipulating cache directives.
|
|
|
|
|
(Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-09-13 23:27:22 +00:00
|
|
|
HDFS-5053. NameNode should invoke DataNode APIs to coordinate caching.
|
|
|
|
|
(Andrew Wang)
|
2013-09-09 18:53:01 +00:00
|
|
|
|
2013-09-16 05:35:25 +00:00
|
|
|
HDFS-5197. Document dfs.cachereport.intervalMsec in hdfs-default.xml.
|
|
|
|
|
(cnauroth)
|
|
|
|
|
|
2013-09-18 20:43:40 +00:00
|
|
|
HDFS-5213. Separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId.
|
|
|
|
|
(Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-09-21 00:20:36 +00:00
|
|
|
HDFS-5236. Change PathBasedCacheDirective APIs to be a single value
|
|
|
|
|
rather than batch. (Contributed by Andrew Wang)
|
|
|
|
|
|
2013-09-24 21:40:53 +00:00
|
|
|
HDFS-5191. Revisit zero-copy API in FSDataInputStream to make it more
|
|
|
|
|
intuitive. (Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-10-04 17:46:18 +00:00
|
|
|
HDFS-5119. Persist CacheManager state in the edit log.
|
|
|
|
|
(Contributed by Andrew Wang)
|
|
|
|
|
|
2013-10-04 22:28:23 +00:00
|
|
|
HDFS-5190. Move cache pool related CLI commands to CacheAdmin.
|
|
|
|
|
(Contributed by Andrew Wang)
|
|
|
|
|
|
2013-10-09 21:30:08 +00:00
|
|
|
HDFS-5304. Expose if a block replica is cached in getFileBlockLocations.
|
|
|
|
|
(Contributed by Andrew Wang)
|
|
|
|
|
|
2013-10-11 19:44:20 +00:00
|
|
|
HDFS-5224. Refactor PathBasedCache* methods to use a Path rather than a
|
|
|
|
|
String. (cnauroth)
|
|
|
|
|
|
2013-10-14 22:56:11 +00:00
|
|
|
HDFS-5358. Add replication field to PathBasedCacheDirective.
|
|
|
|
|
(Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-10-15 00:19:48 +00:00
|
|
|
HDFS-5359. Allow LightWeightGSet#Iterator to remove elements.
|
|
|
|
|
(Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-10-16 22:15:33 +00:00
|
|
|
HDFS-5096. Automatically cache new data added to a cached path.
|
|
|
|
|
(Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-08-09 18:14:07 +00:00
|
|
|
OPTIMIZATIONS
|
2013-10-14 22:19:10 +00:00
|
|
|
HDFS-5349. DNA_CACHE and DNA_UNCACHE should be by blockId only. (cmccabe)
|
2013-08-09 18:14:07 +00:00
|
|
|
|
|
|
|
|
BUG FIXES
|
2013-09-06 20:07:38 +00:00
|
|
|
HDFS-5169. hdfs.c: translateZCRException: null pointer deref when
|
|
|
|
|
translating some exceptions. (Contributed by Colin Patrick McCabe)
|
2013-09-13 20:36:11 +00:00
|
|
|
|
|
|
|
|
HDFS-5198. NameNodeRpcServer must not send back DNA_FINALIZE in reply to a
|
|
|
|
|
cache report. (Contributed by Colin Patrick McCabe)
|
2013-09-13 20:47:15 +00:00
|
|
|
|
|
|
|
|
HDFS-5195. Prevent passing null pointer to mlock and munlock. (cnauroth)
|
2013-09-14 00:05:29 +00:00
|
|
|
|
|
|
|
|
HDFS-5201. NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit
|
|
|
|
|
(Contributed by Colin Patrick McCabe)
|
|
|
|
|
|
2013-09-16 18:41:27 +00:00
|
|
|
HDFS-5210. Fix some failing unit tests on HDFS-4949 branch.
|
|
|
|
|
(Contributed by Andrew Wang)
|
2013-09-26 20:30:14 +00:00
|
|
|
|
|
|
|
|
HDFS-5266. ElasticByteBufferPool#Key does not implement equals. (cnauroth)
|
2013-10-06 17:06:03 +00:00
|
|
|
|
|
|
|
|
HDFS-5309. Fix failing caching unit tests. (Andrew Wang)
|
2013-10-07 21:26:01 +00:00
|
|
|
|
|
|
|
|
HDFS-5314. Do not expose CachePool type in AddCachePoolOp (Colin Patrick
|
|
|
|
|
McCabe)
|
2013-10-11 23:13:13 +00:00
|
|
|
|
|
|
|
|
HDFS-5348. Fix error message when dfs.datanode.max.locked.memory is
|
|
|
|
|
improperly configured. (Colin Patrick McCabe)
|
2013-10-16 20:23:14 +00:00
|
|
|
|
|
|
|
|
HDFS-5373. hdfs cacheadmin -addDirective short usage does not mention
|
|
|
|
|
-replication parameter. (cnauroth)
|
2013-10-17 20:31:13 +00:00
|
|
|
|
|
|
|
|
HDFS-5383. fix broken caching unit tests. (Andrew Wang)
|
2013-10-18 20:20:20 +00:00
|
|
|
|
|
|
|
|
HDFS-5388. Loading fsimage fails to find cache pools during namenode
|
|
|
|
|
startup. (Chris Nauroth via Colin Patrick McCabe)
|
2013-10-18 22:15:26 +00:00
|
|
|
|
|
|
|
|
HDFS-5203. Concurrent clients that add a cache directive on the same path
|
|
|
|
|
may prematurely uncache from each other. (Chris Nauroth via Colin Patrick
|
|
|
|
|
McCabe)
|
