Ming Ma
|
083b44c136
|
HDFS-9008. Balancer#Parameters class could use a builder pattern. (Chris Trezzo via mingma)
|
2015-09-15 10:16:02 -07:00 |
|
Vinayakumar B
|
a440567491
|
HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore)
|
2015-09-15 17:30:46 +05:30 |
|
Haohui Mai
|
d777757d21
|
HDFS-9065. Include commas on # of files, blocks, total filesystem objects in NN Web UI. Contributed by Daniel Templeton.
|
2015-09-14 20:26:56 -07:00 |
|
Haohui Mai
|
76957a485b
|
HDFS-9010. Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key. Contributed by Mingliang Liu.
|
2015-09-14 18:22:52 -07:00 |
|
Colin Patrick Mccabe
|
7b5cf5352e
|
HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe)
Change-Id: I77dc71aaf9e14ef743f2a2cbebeec04a4f628c78
|
2015-09-14 16:02:10 -07:00 |
|
Colin Patrick Mccabe
|
53bad4eb00
|
HDFS-8996. Consolidate validateLog and scanLog in FJM#EditLogFile (Zhe Zhang via Colin P. McCabe)
|
2015-09-14 15:22:12 -07:00 |
|
Steve Loughran
|
6955771261
|
HDFS-9069. TestNameNodeMetricsLogger failing -port in use. (stevel)
|
2015-09-14 10:36:44 +01:00 |
|
Haohui Mai
|
0c7d3f4805
|
HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu.
|
2015-09-12 11:02:51 -07:00 |
|
Vinayakumar B
|
c715650385
|
HDFS-9036. In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. (Contributed by J.Andreina)
|
2015-09-12 17:40:16 +05:30 |
|
Vinayakumar B
|
d8455479b8
|
HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina)
|
2015-09-12 12:36:12 +05:30 |
|
Kihwal Lee
|
fba06a789c
|
Fix up CHANGES.txt
|
2015-09-11 16:02:54 -05:00 |
|
Arpit Agarwal
|
15a557fcfe
|
HDFS-9027. Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method. (Contributed by Mingliang Liu)
|
2015-09-11 10:11:52 -07:00 |
|
Vinod Kumar Vavilapalli
|
f103a70af5
|
HDFS-7314. Moving to 2.6.1 CHANGES.txt section.
|
2015-09-10 16:46:16 -07:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
fbbb7ff1ed
|
Updating all CHANGES.txt files to move entires from future releases into 2.6.1
section given the large number of backports to 2.6.1.
|
2015-09-10 13:45:57 -07:00 |
|
Kihwal Lee
|
a40342b0da
|
HDFS-6763. Initialize file system-wide quota once on transitioning to active. Contributed by Kihwal Lee
|
2015-09-10 09:16:29 -05:00 |
|
Akira Ajisaka
|
7b5b2c5822
|
HDFS-8974. Convert docs in xdoc format to markdown. Contributed by Masatake Iwasaki.
|
2015-09-10 16:45:27 +09:00 |
|
Vinayakumar B
|
4014ce5990
|
HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina)
|
2015-09-10 00:08:19 +05:30 |
|
Vinayakumar B
|
0f0e897bf1
|
HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R)
|
2015-09-09 22:58:50 +05:30 |
|
Kihwal Lee
|
4d13335fc9
|
HDFS-8716. Introduce a new config specifically for safe mode block count. Contributed by Chang Li.
|
2015-09-09 11:08:24 -05:00 |
|
Akira Ajisaka
|
0113e4528d
|
HDFS-9033. dfsadmin -metasave prints "NaN" for cache used%. Contributed by Brahma Reddy Battula.
|
2015-09-09 17:20:46 +09:00 |
|
Vinayakumar B
|
94cf7ab9d2
|
HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore)
|
2015-09-09 11:03:57 +05:30 |
|
Colin Patrick Mccabe
|
a153b9601a
|
HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)
|
2015-09-08 18:37:22 -07:00 |
|
Xiaoyu Yao
|
970daaa5e4
|
HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao.
|
2015-09-08 09:57:36 -07:00 |
|
Andrew Wang
|
e1feaf6db0
|
HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
|
2015-09-04 13:42:55 -07:00 |
|
Ming Ma
|
30db1adac3
|
HDFS-8981. Adding revision to data node jmx getVersion() method. (Siqi Li via mingma)
|
2015-09-04 11:55:58 -07:00 |
|
Haohui Mai
|
715b9c6499
|
HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai.
|
2015-09-04 11:45:31 -07:00 |
|
Jing Zhao
|
8928729c80
|
HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao.
|
2015-09-04 11:42:22 -07:00 |
|
Haohui Mai
|
d16c4eee18
|
HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu.
|
2015-09-04 10:41:09 -07:00 |
|
Andrew Wang
|
c83d13c649
|
HDFS-9021. Use a yellow elephant rather than a blue one in diagram.
|
2015-09-03 16:27:20 -07:00 |
|
Haohui Mai
|
ed78b14ebc
|
HDFS-9002. Move o.a.h.hdfs.net/*Peer classes to hdfs-client. Contributed by Mingliang Liu.
|
2015-09-03 15:32:53 -07:00 |
|
Jakob Homan
|
c2d2c1802a
|
HDFS-8939. Test(S)WebHdfsFileContextMainOperations failing on branch-2. Contributed by Chris Nauroth.
(cherry picked from commit 9871f57d41990b2763d4c23d9040aeb685b4a80f)
|
2015-09-03 13:26:54 -07:00 |
|
Colin Patrick Mccabe
|
53c38cc89a
|
HDFS-8964. When validating the edit log, do not read at or beyond the file offset that is being written (Zhe Zhang via Colin P. McCabe)
|
2015-09-03 11:22:47 -07:00 |
|
Arpit Agarwal
|
524ba8708b
|
HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal)
|
2015-09-03 11:14:47 -07:00 |
|
Tsuyoshi Ozawa
|
9a87f81ce6
|
HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang.
|
2015-09-03 22:34:25 +09:00 |
|
Akira Ajisaka
|
c92e31bd65
|
HDFS-8885. ByteRangeInputStream used in webhdfs does not override available(). Contributed by Shradha Revankar.
|
2015-09-03 19:40:34 +09:00 |
|
Ming Ma
|
d31a41c359
|
HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma)
|
2015-09-02 15:55:42 -07:00 |
|
Jing Zhao
|
de928d566a
|
HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee.
|
2015-09-02 15:19:04 -07:00 |
|
Andrew Wang
|
afc88b396f
|
HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton.
|
2015-09-02 13:46:00 -07:00 |
|
Colin Patrick Mccabe
|
c006c3a1e6
|
HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe)
|
2015-09-02 12:36:14 -07:00 |
|
Akira Ajisaka
|
65ccf2b125
|
HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore.
|
2015-09-02 14:28:38 +09:00 |
|
yliu
|
5652131d2e
|
HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu)
|
2015-09-02 08:58:51 +08:00 |
|
Colin Patrick Mccabe
|
24f6a7c956
|
HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe)
|
2015-08-31 18:06:30 -07:00 |
|
yliu
|
8fa41d9dd4
|
HDFS-8946. Improve choosing datanode storage for block placement. (yliu)
|
2015-09-01 08:52:50 +08:00 |
|
Haohui Mai
|
826ae1c26d
|
HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu.
|
2015-08-31 13:54:14 -07:00 |
|
Jing Zhao
|
caa04de149
|
HDFS-8980. Remove unnecessary block replacement in INodeFile. Contributed by Jing Zhao.
|
2015-08-31 11:48:09 -07:00 |
|
Jakob Homan
|
837fb75e8e
|
HDFS-8155. Support OAuth2 in WebHDFS.
|
2015-08-29 18:37:05 -07:00 |
|
Arpit Agarwal
|
bdbe53c676
|
HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal)
|
2015-08-29 09:52:37 -07:00 |
|
Haohui Mai
|
e2c9b288b2
|
HDFS-8925. Move BlockReaderLocal to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-28 14:38:36 -07:00 |
|
Colin Patrick Mccabe
|
b94b56806d
|
HDFS-8950. NameNode refresh doesn't remove DataNodes that are no longer in the allowed list (Daniel Templeton)
|
2015-08-28 14:21:46 -07:00 |
|
Haohui Mai
|
6d12cd8d60
|
HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu.
|
2015-08-28 14:14:32 -07:00 |
|
Kihwal Lee
|
b6ceee9bf4
|
HDFS-8865. Improve quota initialization performance. Contributed by Kihwal Lee.
|
2015-08-28 13:14:35 -05:00 |
|
yliu
|
e166c038c0
|
HDFS-8963. Fix incorrect sign extension of xattr length in HDFS-8900. (Colin Patrick McCabe via yliu)
|
2015-08-28 10:54:55 +08:00 |
|
Haohui Mai
|
035ed26147
|
Revert "HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu."
This reverts commit 4e9307f26d .
|
2015-08-27 16:09:35 -07:00 |
|
Haohui Mai
|
4e9307f26d
|
HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu.
|
2015-08-27 15:36:44 -07:00 |
|
Haohui Mai
|
f97a0f8c2c
|
HDFS-8969. Clean up findbugs warnings for HDFS-8823 and HDFS-8932. Contributed by Anu Engineer.
|
2015-08-27 13:03:16 -07:00 |
|
Haohui Mai
|
1e5f69e85c
|
HDFS-8961. Investigate lock issue in o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager. Contributed by Mingliang Liu.
|
2015-08-27 09:13:20 -07:00 |
|
Haohui Mai
|
7e971b7315
|
HDFS-8962. Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf. Contributed by Mingliang Liu.
|
2015-08-27 09:02:34 -07:00 |
|
Harsh J
|
0bf285413f
|
HDFS-2390. dfsadmin -setBalancerBandwidth does not validate -ve value. Contributed by Gautam Gopalakrishnan.
|
2015-08-27 16:22:48 +05:30 |
|
Vinayakumar B
|
fdb56f74f3
|
HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina)
|
2015-08-27 13:06:43 +05:30 |
|
Haohui Mai
|
4cbbfa2220
|
HDFS-8248. Store INodeId instead of the INodeFile object in BlockInfoContiguous. Contributed by Haohui Mai.
|
2015-08-26 18:14:29 -07:00 |
|
Jing Zhao
|
f44b599003
|
HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su.
|
2015-08-26 16:27:34 -07:00 |
|
Haohui Mai
|
c992bcf9c1
|
HDFS-8951. Move the shortcircuit package to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-26 14:02:48 -07:00 |
|
Colin Patrick Mccabe
|
a4d9acc51d
|
HDFS-8846. Add a unit test for INotify functionality across a layout version upgrade (Zhe Zhang via Colin P. McCabe)
|
2015-08-25 14:29:53 -07:00 |
|
yliu
|
eee0d4563c
|
HDFS-8900. Compact XAttrs to optimize memory footprint. (yliu)
|
2015-08-25 16:16:09 +08:00 |
|
Xiaoyu Yao
|
3b00eaea25
|
HDFS-8932. NPE thrown in NameNode when try to get TotalSyncCount metric before editLogStream initialization. Contributed by Surendra Singh Lilhore
|
2015-08-24 16:56:24 -07:00 |
|
Haohui Mai
|
66d0c81d8f
|
HDFS-8948. Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure. Contributed by Mingliang Liu.
|
2015-08-24 16:18:15 -07:00 |
|
Jing Zhao
|
bdd79388f3
|
HDFS-8928. Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array. Contributed by Jing Zhao.
|
2015-08-24 15:53:34 -07:00 |
|
Colin Patrick Mccabe
|
b5ce87f84d
|
HDFS-8930. Block report lease may leak if the 2nd full block report comes when NN is still in safemode (Colin P. McCabe via Jing Zhao)
|
2015-08-24 11:31:56 -07:00 |
|
Akira Ajisaka
|
bcaf83902a
|
HDFS-8942. Update hyperlink to rack awareness page in HDFS Architecture documentation. Contributed by Masatake Iwasaki.
|
2015-08-24 13:52:49 +09:00 |
|
Haohui Mai
|
490bb5ebd6
|
HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-22 13:31:03 -07:00 |
|
Haohui Mai
|
745d04be59
|
HDFS-8823. Move replication factor into individual blocks. Contributed by Haohui Mai.
|
2015-08-22 00:09:40 -07:00 |
|
Lei Xu
|
7087e700e0
|
HDFS-8924. Add pluggable interface for reading replicas in DFSClient. (Colin Patrick McCabe via Lei Xu)
|
2015-08-21 17:02:00 -07:00 |
|
Chris Douglas
|
b0564c9f3c
|
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
Moved CHANGES.txt entry to 2.7.2
|
2015-08-20 20:39:06 -07:00 |
|
Vinod Kumar Vavilapalli
|
33474939a0
|
Creating 2.6.2 entries in CHANGES.txt files.
|
2015-08-20 17:21:06 -07:00 |
|
Jing Zhao
|
c8bca62718
|
HDFS-8809. HDFS fsck reports under construction blocks as CORRUPT. Contributed by Jing Zhao.
|
2015-08-20 16:31:24 -07:00 |
|
Colin Patrick Mccabe
|
7642f64c24
|
HDFS-8922. Link the native_mini_dfs test library with libdl, since IBM Java requires it (Ayappan via Colin P. McCabe)
|
2015-08-20 13:57:32 -07:00 |
|
Yongjun Zhang
|
0bc15cb6e6
|
HDFS-8828. Utilize Snapshot diff report to build diff copy list in distcp. (Yufei Gu via Yongjun Zhang)
|
2015-08-20 08:02:54 -07:00 |
|
yliu
|
5e8fe89437
|
HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu)
|
2015-08-20 20:15:03 +08:00 |
|
yliu
|
80a29906bc
|
HDFS-8884. Fail-fast check in BlockPlacementPolicyDefault#chooseTarget. (yliu)
|
2015-08-20 20:07:18 +08:00 |
|
Jing Zhao
|
4e14f7982a
|
HDFS-8917. Cleanup BlockInfoUnderConstruction from comments and tests. Contributed by Zhe Zhang.
|
2015-08-19 15:11:37 -07:00 |
|
Haohui Mai
|
3aac4758b0
|
HDFS-8803. Move DfsClientConf to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-19 11:28:05 -07:00 |
|
Jing Zhao
|
f61120d964
|
HDFS-8867. Enable optimized block reports. Contributed by Daryn Sharp.
|
2015-08-19 10:36:56 -07:00 |
|
Arpit Agarwal
|
9c3571ea60
|
HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer)
|
2015-08-19 09:42:35 -07:00 |
|
yliu
|
2da5aaab33
|
HDFS-8908. TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode. (Tsz Wo Nicholas Sze via yliu)
|
2015-08-19 21:55:43 +08:00 |
|
Tsz-Wo Nicholas Sze
|
7ecbfd44aa
|
HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes.
|
2015-08-18 19:25:50 -07:00 |
|
Chris Douglas
|
30e342a5d3
|
HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan
|
2015-08-18 17:32:48 -07:00 |
|
Akira Ajisaka
|
fc509f66d8
|
HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S.
|
2015-08-18 23:31:52 +09:00 |
|
yliu
|
71566e2382
|
HDFS-8862. BlockManager#excessReplicateMap should use a HashMap. (yliu)
|
2015-08-18 09:23:06 +08:00 |
|
Tsz-Wo Nicholas Sze
|
51a00964da
|
HDFS-8278. When computing max-size-to-move in Balancer, count only the storage with remaining >= default block size.
|
2015-08-17 17:55:25 -07:00 |
|
Andrew Wang
|
eee4d716b4
|
HDFS-8895. Remove deprecated BlockStorageLocation APIs.
|
2015-08-17 17:40:37 -07:00 |
|
Arpit Agarwal
|
a88f31ebf3
|
HDFS-8880. NameNode metrics logging. (Arpit Agarwal)
|
2015-08-17 16:55:46 -07:00 |
|
Colin Patrick Mccabe
|
ec183faadc
|
HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe)
|
2015-08-17 15:25:29 -07:00 |
|
Colin Patrick Mccabe
|
c77bd6af16
|
HDFS-8792. BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory (Yi Liu via Colin P. McCabe)
|
2015-08-17 12:00:45 -07:00 |
|
Haohui Mai
|
e535e0f05b
|
HDFS-8801. Convert BlockInfoUnderConstruction as a feature. Contributed by Jing Zhao.
|
2015-08-17 11:28:28 -07:00 |
|
Haohui Mai
|
456e901a4c
|
HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai.
|
2015-08-17 11:04:00 -07:00 |
|
Andrew Wang
|
2e7b7e2cda
|
HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging.
|
2015-08-17 10:17:06 -07:00 |
|
Xiaoyu Yao
|
a7862d5fe4
|
HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer.
|
2015-08-17 10:15:56 -07:00 |
|
Jing Zhao
|
dc7a061668
|
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
|
2015-08-14 14:42:43 -07:00 |
|
Tsz-Wo Nicholas Sze
|
2bc0a4f299
|
HDFS-8824. Do not use small blocks for balancing the cluster.
|
2015-08-14 13:03:19 -07:00 |
|
Xiaoyu Yao
|
1569228ec9
|
HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao)
|
2015-08-14 12:34:31 -07:00 |
|