2012-10-19 21:06:08 +00:00
|
|
|
Branch-2802 Snapshot (Unreleased)
|
|
|
|
|
|
|
|
|
|
HDFS-4076. Support snapshot of single files. (szetszwo)
|
|
|
|
|
|
|
|
|
|
HDFS-4082. Add editlog opcodes for snapshot create and delete operations.
|
|
|
|
|
(suresh via szetszwo)
|
|
|
|
|
|
2012-10-19 21:15:11 +00:00
|
|
|
HDFS-4086. Add editlog opcodes to allow and disallow snapshots on a
|
|
|
|
|
directory. (Brandon Li via suresh)
|
|
|
|
|
|
2012-10-19 22:15:27 +00:00
|
|
|
HDFS-4083. Protocol changes for snapshots. (suresh)
|
2012-10-19 22:21:50 +00:00
|
|
|
|
2012-10-26 22:02:30 +00:00
|
|
|
HDFS-4077. Add support for Snapshottable Directory. (szetszwo via suresh)
|
2012-10-21 19:05:49 +00:00
|
|
|
|
|
|
|
|
HDFS-4087. Protocol changes for listSnapshots functionality.
|
|
|
|
|
(Brandon Li via suresh)
|
2012-10-21 21:35:13 +00:00
|
|
|
|
|
|
|
|
HDFS-4079. Add SnapshotManager which maintains a list for all the
|
|
|
|
|
snapshottable directories and supports snapshot methods such as setting a
|
|
|
|
|
directory to snapshottable and creating a snapshot. (szetszwo)
|
2012-10-22 00:11:25 +00:00
|
|
|
|
|
|
|
|
HDFS-4078. Handle replication in snapshots. (szetszwo)
|
2012-10-23 20:26:08 +00:00
|
|
|
|
|
|
|
|
HDFS-4084. Provide CLI support to allow and disallow snapshot
|
|
|
|
|
on a directory. (Brondon Li via suresh)
|
2012-10-24 20:39:26 +00:00
|
|
|
|
|
|
|
|
HDFS-4091. Add snapshot quota to limit the number of snapshots allowed.
|
|
|
|
|
(szetszwo)
|
2012-10-25 04:08:36 +00:00
|
|
|
|
|
|
|
|
HDFS-4097. Provide CLI support for createSnapshot. (Brandon Li via suresh)
|
2012-10-25 19:32:26 +00:00
|
|
|
|
|
|
|
|
HDFS-4092. Update file deletion logic for snapshot so that the current inode
|
|
|
|
|
is removed from the circular linked list; and if some blocks at the end of the
|
|
|
|
|
block list no longer belong to any other inode, collect them and update the
|
|
|
|
|
block list. (szetszwo)
|
2012-10-26 22:02:30 +00:00
|
|
|
|
|
|
|
|
HDFS-4111. Support snapshot of subtrees. (szetszwo via suresh)
|
2012-10-28 20:02:54 +00:00
|
|
|
|
|
|
|
|
HDFS-4119. Complete the allowSnapshot code and add a test for it. (szetszwo)
|
2012-11-01 08:29:41 +00:00
|
|
|
|
|
|
|
|
HDFS-4133. Add testcases for testing basic snapshot functionalities.
|
|
|
|
|
(Jing Zhao via suresh)
|
2012-11-02 02:26:58 +00:00
|
|
|
|
|
|
|
|
HDFS-4116. Add auditlog for some snapshot operations. (Jing Zhao via suresh)
|
2012-11-02 05:01:10 +00:00
|
|
|
|
|
|
|
|
HDFS-4095. Add some snapshot related metrics. (Jing Zhao via suresh)
|
2012-11-03 01:31:51 +00:00
|
|
|
|
|
|
|
|
HDFS-4141. Support directory diff - the difference between the current state
|
|
|
|
|
and a previous snapshot of an INodeDirectory. (szetszwo)
|
2012-11-04 22:00:13 +00:00
|
|
|
|
|
|
|
|
HDFS-4146. Use getter and setter in INodeFileWithLink to access blocks and
|
|
|
|
|
initialize root directory as snapshottable. (szetszwo)
|
2012-11-05 00:40:54 +00:00
|
|
|
|
|
|
|
|
HDFS-4149. Implement the disallowSnapshot(..) in FSNamesystem and add
|
|
|
|
|
resetSnapshottable(..) to SnapshotManager. (szetszwo)
|
2012-11-05 01:22:54 +00:00
|
|
|
|
|
|
|
|
HDFS-4147. When there is a snapshot in a subtree, deletion of the subtree
|
|
|
|
|
should fail. (Jing Zhao via szetszwo)
|
2012-11-07 19:30:36 +00:00
|
|
|
|
|
|
|
|
HDFS-4150. Update the inode in the block map when a snapshotted file or a
|
|
|
|
|
snapshot file is deleted. (Jing Zhao via szetszwo)
|
2012-11-07 19:38:29 +00:00
|
|
|
|
|
|
|
|
HDFS-4159. Rename should fail when the destination directory is snapshottable
|
|
|
|
|
and has snapshots. (Jing Zhao via szetszwo)
|
2012-11-10 00:27:59 +00:00
|
|
|
|
|
|
|
|
HDFS-4170. Add snapshot information to INodesInPath. (szetszwo)
|
2012-11-13 19:59:55 +00:00
|
|
|
|
|
|
|
|
HDFS-4177. Add a snapshot parameter to INodeDirectory.getChildrenList() for
|
|
|
|
|
selecting particular snapshot children list views. (szetszwo)
|
2012-11-13 23:26:40 +00:00
|
|
|
|
|
|
|
|
HDFS-4148. Disallow write/modify operations on files and directories in a
|
|
|
|
|
snapshot. (Brandon Li via suresh)
|
2012-11-15 21:34:54 +00:00
|
|
|
|
|
|
|
|
HDFS-4188. Add Snapshot.ID_COMPARATOR for comparing IDs and fix a bug in
|
|
|
|
|
ReadOnlyList.Util.binarySearch(..). (szetszwo)
|
2012-11-15 23:08:25 +00:00
|
|
|
|
|
|
|
|
HDFS-4187. Add tests for replication handling in snapshots. (Jing Zhao via
|
|
|
|
|
szetszwo)
|
2012-11-18 20:44:10 +00:00
|
|
|
|
|
|
|
|
HDFS-4196. Support renaming of snapshots. (Jing Zhao via szetszwo)
|
2012-11-20 14:49:21 +00:00
|
|
|
|
|
|
|
|
HDFS-4175. Additional snapshot tests for more complicated directory
|
|
|
|
|
structure and modifications. (Jing Zhao via suresh)
|
2012-12-10 23:54:26 +00:00
|
|
|
|
|
|
|
|
HDFS-4293. Fix TestSnapshot failure. (Jing Zhao via suresh)
|
2012-12-17 03:40:27 +00:00
|
|
|
|
|
|
|
|
HDFS-4317. Change INode and its subclasses to support HDFS-4103. (szetszwo)
|
2012-12-21 01:30:49 +00:00
|
|
|
|
|
|
|
|
HDFS-4103. Support O(1) snapshot creation. (szetszwo)
|
2012-12-28 08:49:33 +00:00
|
|
|
|
|
|
|
|
HDFS-4330. Support snapshots up to the snapshot limit. (szetszwo)
|
2013-01-04 10:45:57 +00:00
|
|
|
|
|
|
|
|
HDFS-4357. Fix a bug that if an inode is replaced, further INode operations
|
|
|
|
|
should apply to the new inode. (Jing Zhao via szetszwo)
|
2013-01-07 01:43:21 +00:00
|
|
|
|
|
|
|
|
HDFS-4230. Support listing of all the snapshottable directories. (Jing Zhao
|
|
|
|
|
via szetszwo)
|
2013-01-09 16:44:05 +00:00
|
|
|
|
|
|
|
|
HDFS-4244. Support snapshot deletion. (Jing Zhao via szetszwo)
|
2013-01-13 11:29:14 +00:00
|
|
|
|
|
|
|
|
HDFS-4245. Include snapshot related operations in TestOfflineEditsViewer.
|
|
|
|
|
(Jing Zhao via szetszwo)
|
2013-01-14 02:30:15 +00:00
|
|
|
|
2013-01-14 08:40:13 +00:00
|
|
|
HDFS-4395. In INodeDirectorySnapshottable's constructor, the passed-in dir
|
|
|
|
|
could be an INodeDirectoryWithSnapshot. (Jing Zhao via szetszwo)
|
2013-01-15 06:20:22 +00:00
|
|
|
|
|
|
|
|
HDFS-4397. Fix a bug in INodeDirectoryWithSnapshot.Diff.combinePostDiff(..)
|
|
|
|
|
that it may put the wrong node into the deleted list. (szetszwo)
|
2013-01-16 12:43:51 +00:00
|
|
|
|
|
|
|
|
HDFS-4407. Change INodeDirectoryWithSnapshot.Diff.combinePostDiff(..) to
|
|
|
|
|
merge-sort like and keep the postDiff parameter unmodified. (szetszwo)
|
2013-01-17 23:38:30 +00:00
|
|
|
|
|
|
|
|
HDFS-4098. Add FileWithSnapshot, INodeFileUnderConstructionWithSnapshot and
|
|
|
|
|
INodeFileUnderConstructionSnapshot for supporting append to snapshotted files.
|
|
|
|
|
(szetszwo)
|
2013-01-23 02:48:01 +00:00
|
|
|
|
|
|
|
|
HDFS-4126. Add reading/writing snapshot information to FSImage.
|
|
|
|
|
(Jing Zhao via suresh)
|
2013-01-24 21:33:34 +00:00
|
|
|
|
|
|
|
|
HDFS-4436. Change INode.recordModification(..) to return only the current
|
|
|
|
|
inode and remove the updateCircularList parameter from some methods in
|
|
|
|
|
INodeDirectoryWithSnapshot.Diff. (szetszwo)
|
2013-01-25 03:09:26 +00:00
|
|
|
|
|
|
|
|
HDFS-4429. When the latest snapshot exists, INodeFileUnderConstruction should
|
|
|
|
|
be replaced with INodeFileWithSnapshot but not INodeFile. (Jing Zhao
|
|
|
|
|
via szetszwo)
|
2013-01-26 00:01:51 +00:00
|
|
|
|
|
|
|
|
HDFS-4441. Move INodeDirectoryWithSnapshot.Diff and the related classes to a
|
|
|
|
|
package. (szetszwo)
|
2013-01-28 22:48:58 +00:00
|
|
|
|
|
|
|
|
HDFS-4432. Support INodeFileUnderConstructionWithSnapshot in FSImage
|
|
|
|
|
saving/loading. (Jing Zhao via suresh)
|
2013-01-29 21:31:44 +00:00
|
|
|
|
|
|
|
|
HDFS-4131. Add capability to namenode to get snapshot diff. (Jing Zhao via
|
|
|
|
|
suresh)
|
2013-01-29 23:25:49 +00:00
|
|
|
|
2013-01-31 21:13:04 +00:00
|
|
|
HDFS-4447. Refactor INodeDirectoryWithSnapshot for supporting general INode
|
|
|
|
|
diff lists. (szetszwo)
|
|
|
|
|
|
|
|
|
|
HDFS-4189. Renames the getMutableXxx methods to getXxx4Write and fix a bug
|
|
|
|
|
that some getExistingPathINodes calls should be getINodesInPath4Write.
|
|
|
|
|
(szetszwo)
|
2013-01-31 21:35:19 +00:00
|
|
|
|
|
|
|
|
HDFS-4361. When listing snapshottable directories, only return those
|
|
|
|
|
where the user has permission to take snapshots. (Jing Zhao via szetszwo)
|
2013-02-02 01:53:17 +00:00
|
|
|
|
|
|
|
|
HDFS-4464. Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot
|
|
|
|
|
and rename it to destroySubtreeAndCollectBlocks. (szetszwo)
|
2013-02-02 20:39:01 +00:00
|
|
|
|
|
|
|
|
HDFS-4414. Add support for getting snapshot diff from DistributedFileSystem.
|
|
|
|
|
(Jing Zhao via suresh)
|
2013-02-08 02:18:55 +00:00
|
|
|
|
|
|
|
|
HDFS-4446. Support file snapshots with diff lists. (szetszwo)
|
2013-02-08 23:19:32 +00:00
|
|
|
|
|
|
|
|
HDFS-4480. Eliminate the file snapshot circular linked list. (szetszwo)
|
2013-02-14 00:43:28 +00:00
|
|
|
|
|
|
|
|
HDFS-4481. Change fsimage to support snapshot file diffs. (szetszwo)
|
2013-02-14 22:00:36 +00:00
|
|
|
|
|
|
|
|
HDFS-4500. Refactor snapshot INode methods. (szetszwo)
|
2013-02-14 23:07:49 +00:00
|
|
|
|
|
|
|
|
HDFS-4487. Fix snapshot diff report for HDFS-4446. (Jing Zhao via szetszwo)
|
2013-02-17 02:58:31 +00:00
|
|
|
|
|
|
|
|
HDFS-4431. Support snapshot in OfflineImageViewer. (Jing Zhao via szetszwo)
|
2013-02-20 20:02:24 +00:00
|
|
|
|
|
|
|
|
HDFS-4503. Update computeContentSummary(..), spaceConsumedInTree(..) and
|
|
|
|
|
diskspaceConsumed(..) in INode for snapshot. (szetszwo)
|
2013-02-21 03:27:36 +00:00
|
|
|
|
|
|
|
|
HDFS-4499. Fix file/directory/snapshot deletion for file diff. (Jing Zhao
|
|
|
|
|
via szetszwo)
|
2013-02-23 02:44:05 +00:00
|
|
|
|
|
|
|
|
HDFS-4524. Update SnapshotManager#snapshottables when loading fsimage.
|
|
|
|
|
(Jing Zhao via szetszwo)
|
2013-02-25 19:49:05 +00:00
|
|
|
|
|
|
|
|
HDFS-4520. Support listing snapshots under a snapshottable directory using ls.
|
|
|
|
|
(Jing Zhao via szetszwo)
|
2013-02-25 23:14:58 +00:00
|
|
|
|
|
|
|
|
HDFS-4514. Add CLI for supporting snapshot rename, diff report, and
|
|
|
|
|
snapshottable directory listing. (Jing Zhao via szetszwo)
|
2013-02-26 22:04:35 +00:00
|
|
|
|
|
|
|
|
HDFS-4523. Fix INodeFile replacement, TestQuota and javac errors from trunk
|
|
|
|
|
merge. (szetszwo)
|
2013-02-28 03:08:08 +00:00
|
|
|
|
|
|
|
|
HDFS-4507. Update quota verification for snapshots. (szetszwo)
|
2013-03-05 02:23:34 +00:00
|
|
|
|
|
|
|
|
HDFS-4545. With snapshots, FSDirectory.unprotectedSetReplication(..) always
|
|
|
|
|
changes file replication but it may or may not changes block replication.
|
|
|
|
|
(szetszwo)
|
2013-03-07 22:34:51 +00:00
|
|
|
|
|
|
|
|
HDFS-4557. Fix FSDirectory#delete when INode#cleanSubtree returns 0.
|
|
|
|
|
(Jing Zhao via szetszwo)
|
2013-03-09 18:14:30 +00:00
|
|
|
|
|
|
|
|
HDFS-4579. Annotate snapshot tests. (Arpit Agarwal via suresh)
|
2013-03-11 03:45:52 +00:00
|
|
|
|
|
|
|
|
HDFS-4574. Move Diff to the util package. (szetszwo)
|
2013-03-12 02:41:25 +00:00
|
|
|
|
|
|
|
|
HDFS-4563. Update namespace/diskspace usage after deleting snapshots.
|
|
|
|
|
(Jing Zhao via szetszwo)
|
2013-03-13 06:05:00 +00:00
|
|
|
|
|
|
|
|
HDFS-4144. Create test for all snapshot-related metrics.
|
|
|
|
|
(Jing Zhao via suresh)
|
2013-03-18 11:36:59 +00:00
|
|
|
|
|
|
|
|
HDFS-4556. Add snapshotdiff and LsSnapshottableDir tools to hdfs script.
|
|
|
|
|
(Arpit Agarwal via szetszwo)
|
2013-03-19 06:27:26 +00:00
|
|
|
|
|
|
|
|
HDFS-4534. Add INodeReference in order to support rename with snapshots.
|
|
|
|
|
(szetszwo)
|
2013-03-21 19:30:35 +00:00
|
|
|
|
|
|
|
|
HDFS-4616. Update the FilesDeleted metric while deleting file/dir in the
|
|
|
|
|
current tree. (Jing Zhao via szetszwo)
|
2013-03-24 14:53:52 +00:00
|
|
|
|
|
|
|
|
HDFS-4627. Fix FSImageFormat#Loader NPE and synchronization issues.
|
|
|
|
|
(Jing Zhao via suresh)
|
2013-03-25 10:21:30 +00:00
|
|
|
|
|
|
|
|
HDFS-4612. Not to use INode.getParent() when generating snapshot diff report.
|
|
|
|
|
(Jing Zhao via szetszwo)
|
2013-03-28 16:18:04 +00:00
|
|
|
|
|
|
|
|
HDFS-4636. Update quota usage when deleting files/dirs that were created
|
|
|
|
|
after taking the latest snapshot. (Jing Zhao via szetszwo)
|
2013-03-30 23:57:27 +00:00
|
|
|
|
|
|
|
|
HDFS-4648. For snapshot deletion, when merging the diff from to-delete
|
|
|
|
|
snapshot to the prior snapshot, make sure files/directories created after
|
|
|
|
|
the prior snapshot get deleted. (Jing Zhao via szetszwo)
|
2013-04-01 01:53:21 +00:00
|
|
|
|
|
|
|
|
HDFS-4637. INodeDirectory#replaceSelf4Quota may incorrectly convert a newly
|
|
|
|
|
created directory to an INodeDirectoryWithSnapshot. (Jing Zhao via szetszwo)
|
2013-04-01 23:24:42 +00:00
|
|
|
|
|
|
|
|
HDFS-4611. Update FSImage for INodeReference. (szetszwo)
|
2013-04-04 23:52:38 +00:00
|
|
|
|
|
|
|
|
HDFS-4647. Rename should call setLocalName after an inode is removed from
|
|
|
|
|
snapshots. (Arpit Agarwal via szetszwo)
|
