Surendra Singh Lilhore
|
75ccc1396b
|
HDFS-13166: [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls. Contributed by Rakesh R.
|
2018-08-12 03:06:05 -07:00 |
|
Rakesh Radhakrishnan
|
8467ec24fb
|
HDFS-13110: [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier. Contributed by Rakesh R.
|
2018-08-12 03:06:05 -07:00 |
|
Uma Maheswara Rao G
|
4402f3f855
|
HDFS-13097: [SPS]: Fix the branch review comments(Part1). Contributed by Surendra Singh.
|
2018-08-12 03:06:04 -07:00 |
|
Surendra Singh Lilhore
|
d3de4fb2a0
|
HDFS-13077. [SPS]: Fix review comments of external storage policy satisfier. Contributed by Rakesh R.
|
2018-08-12 03:06:04 -07:00 |
|
Rakesh Radhakrishnan
|
5845c36c16
|
HDFS-13050: [SPS]: Create start/stop script to start external SPS process. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:04 -07:00 |
|
Surendra Singh Lilhore
|
99594b48b8
|
HDFS-13075. [SPS]: Provide External Context implementation. Contributed by Uma Maheswara Rao G.
|
2018-08-12 03:06:04 -07:00 |
|
Uma Maheswara Rao G
|
3b83110d5e
|
HDFS-13057: [SPS]: Revisit configurations to make SPS service modes internal/external/none. Contributed by Rakesh R.
|
2018-08-12 03:06:04 -07:00 |
|
Uma Maheswara Rao G
|
b0cb8d9bb4
|
HDFS-13033: [SPS]: Implement a mechanism to do file block movements for external SPS. Contributed by Rakesh R.
|
2018-08-12 03:06:03 -07:00 |
|
Rakesh Radhakrishnan
|
3159b39cf8
|
HDFS-13025. [SPS]: Implement a mechanism to scan the files for external SPS. Contributed by Uma Maheswara Rao G.
|
2018-08-12 03:06:03 -07:00 |
|
Rakesh Radhakrishnan
|
8d4f74e733
|
HDFS-12911. [SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:06:03 -07:00 |
|
Surendra Singh Lilhore
|
05d4daf6ba
|
HDFS-12982 : [SPS]: Reduce the locking and cleanup the Namesystem access. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Uma Maheswara Rao G
|
78420719eb
|
HDFS-12955: [SPS]: Move SPS classes to a separate package. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Surendra Singh Lilhore
|
c561cb316e
|
HDFS-12106: [SPS]: Improve storage policy satisfier configurations. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:02 -07:00 |
|
Rakesh Radhakrishnan
|
9b83f94f35
|
HDFS-12790: [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits. Contributed by Rakesh R.
|
2018-08-12 03:06:02 -07:00 |
|
Rakesh Radhakrishnan
|
68017e3349
|
HDFS-12310: [SPS]: Provide an option to track the status of in progress requests. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:02 -07:00 |
|
Surendra Singh Lilhore
|
5780f0624d
|
HDFS-12556: [SPS] : Block movement analysis should be done in read lock.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
00eceed233
|
HDFS-12570: [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements. Contributed by Rakesh R.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
bfd3f8bd8a
|
HDFS-12291: [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
7ea24fc06c
|
HDFS-12225: [SPS]: Optimize extended attributes for tracking SPS movements. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
0e820f16af
|
HDFS-12214: [SPS]: Fix review comments of StoragePolicySatisfier feature. Contributed by Rakesh R.
|
2018-08-12 03:06:01 -07:00 |
|
Uma Maheswara Rao G
|
3b601f2c0e
|
HDFS-12152: [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
4bcf61c696
|
HDFS-12141: [SPS]: Fix checkstyle warnings. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Rakesh Radhakrishnan
|
9e82e5a86e
|
HDFS-12146. [SPS]: Fix TestStoragePolicySatisfierWithStripedFile#testSPSWhenFileHasLowRedundancyBlocks. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:00 -07:00 |
|
Rakesh Radhakrishnan
|
68af4e199a
|
HDFS-11874. [SPS]: Document the SPS feature. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
5eb24ef7e7
|
HDFS-11264: [SPS]: Double checks to ensure that SPS/Mover are not running together. Contributed by Rakesh R.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
0b360b16ab
|
HDFS-11965: [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:06:00 -07:00 |
|
Uma Maheswara Rao G
|
00cf207192
|
HDFS-11670: [SPS]: Add CLI command for satisfy storage policy operations. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
46f7523eb8
|
HDFS-11966. [SPS] Correct the log in BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
20f9c62336
|
HDFS-11726. [SPS]: StoragePolicySatisfier should not select same storage type as source and destination in same datanode. Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
d638a7dc03
|
HDFS-11762. [SPS]: Empty files should be ignored in StoragePolicySatisfier. Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Uma Maheswara Rao G
|
e53f89ccc3
|
HDFS-11883: [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Uma Maheswara Rao G
|
5ce332dc9a
|
HDFS-11695: [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log. Contributed by Surendra Singh Lilhore.
|
2018-08-12 03:05:59 -07:00 |
|
Rakesh Radhakrishnan
|
6fe6c549e8
|
HDFS-11572. [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
695a402fca
|
HDFS-11334: [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks. Contributed by Rakesh R.
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
11a08a7e8f
|
HDFS-11338: [SPS]: Fix timeout issue in unit tests caused by longger NN down time. Contributed by Wei Zhou and Rakesh R
|
2018-08-12 03:05:58 -07:00 |
|
Uma Maheswara Rao G
|
c00be44463
|
HDFS-11336: [SPS]: Remove xAttrs when movements done or SPS disabled. Contributed by Yuanbo Liu.
|
2018-08-12 03:05:58 -07:00 |
|
Rakesh Radhakrishnan
|
9b15f5418d
|
HDFS-11239: [SPS]: Check Mover file ID lease also to determine whether Mover is running. Contributed by Wei Zhou
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
e34331c31d
|
HDFS-11243. [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
f8fc96a66e
|
HDFS-11309. [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:57 -07:00 |
|
Rakesh Radhakrishnan
|
681d2804c9
|
HDFS-11186. [SPS]: Daemon thread of SPS should start only in Active NN. Contributed by Wei Zhou
|
2018-08-12 03:05:57 -07:00 |
|
Uma Maheswara Rao G
|
6215e35bb6
|
HDFS-11150: [SPS]: Provide persistence when satisfying storage policy. Contributed by Yuanbo Liu
|
2018-08-12 03:05:57 -07:00 |
|
Uma Maheswara Rao G
|
df2b551e79
|
HDFS-11293: [SPS]: Local DN should be given preference as source node, when target available in same node. Contributed by Yuanbo Liu and Uma Maheswara Rao G
|
2018-08-12 03:05:56 -07:00 |
|
Rakesh Radhakrishnan
|
422f870607
|
HDFS-11289. [SPS]: Make SPS movement monitor timeouts configurable. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:56 -07:00 |
|
Uma Maheswara Rao G
|
81ed364b63
|
HDFS-11193 : [SPS]: Erasure coded files should be considered for satisfying storage policy. Contributed by Rakesh R
|
2018-08-12 03:05:56 -07:00 |
|
Uma Maheswara Rao G
|
b7bed9f00a
|
HDFS-11248: [SPS]: Handle partial block location movements. Contributed by Rakesh R
|
2018-08-12 03:05:55 -07:00 |
|
Uma Maheswara Rao G
|
d81611fe55
|
HDFS-11032: [SPS]: Handling of block movement failure at the coordinator datanode. Contributed by Rakesh R
|
2018-08-12 03:05:55 -07:00 |
|
Rakesh Radhakrishnan
|
5179d99b7e
|
HDFS-11123. [SPS] Make storage policy satisfier daemon work on/off dynamically. Contributed by Uma Maheswara Rao G
|
2018-08-12 03:05:55 -07:00 |
|
Rakesh Radhakrishnan
|
cd5262aba0
|
HDFS-10885. [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on. Contributed by Wei Zhou
|
2018-08-12 03:05:55 -07:00 |
|
Rakesh Radhakrishnan
|
b07291e176
|
HDFS-11151. [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type. Contributed by Rakesh R
|
2018-08-12 03:05:54 -07:00 |
|
Rakesh Radhakrishnan
|
b67ae6d9d7
|
HDFS-10802. [SPS]: Add satisfyStoragePolicy API in HdfsAdmin. Contributed by Yuanbo Liu
|
2018-08-12 03:05:54 -07:00 |
|