Allen Wittenauer
73348a4afd
HDFS-7407. Minor typo in privileged pid/out/log names (aw)
2014-11-19 14:02:28 -08:00
Andrew Wang
5bd048e837
HDFS-7373. Allow decommissioning of dead DataNodes. Contributed by Zhe Zhang.
2014-11-18 22:16:58 -08:00
Andrew Wang
406c09ad11
HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang)
2014-11-18 22:14:04 -08:00
cnauroth
9e81be0114
HDFS-7398. Reset cached thread-local FSEditLogOp's on every FSEditLog#logEdit. Contributed by Gera Shegalov.
2014-11-18 16:56:44 -08:00
Haohui Mai
fbf81fbd1c
HDFS-7406. SimpleHttpProxyHandler puts incorrect "Connection: Close" header. Contributed by Haohui Mai.
2014-11-18 14:52:59 -08:00
Andrew Wang
bcd402ae38
HADOOP-11312. Fix unit tests to not use uppercase key names.
2014-11-18 10:47:46 -08:00
Haohui Mai
9dd5d673c9
HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu.
2014-11-17 17:35:36 -08:00
Andrew Wang
dcb8e24427
HDFS-6982. nntop: top-like tool for name node users. (Maysam Yabandeh via wang)
2014-11-17 17:33:42 -08:00
Brandon Li
351c5561c2
HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang
2014-11-17 13:23:53 -08:00
Haohui Mai
bf8e4332cb
HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai.
2014-11-17 11:42:20 -08:00
Vinayakumar B
6783d17fcf
HDFS-7399. Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() (Contributed by Vinayakumar B)
2014-11-17 20:19:19 +05:30
Colin Patrick Mccabe
26d3b7e6ae
HDFS-7394. Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCache (Keith Pak via Colin P. McCabe)
2014-11-16 21:20:53 -08:00
cnauroth
1925e2a4ae
HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang.
2014-11-14 16:43:09 -08:00
Haohui Mai
1a2e5cbc4d
HDFS-7395. BlockIdManager#clear() bails out when resetting the GenerationStampV1Limit. Contributed by Haohui Mai.
2014-11-13 14:43:03 -08:00
Arun C. Murthy
9ff7315cbe
Preparing to release hadoop-2.6.0-rc1.
2014-11-13 13:02:55 -08:00
cnauroth
b0a41de68c
HDFS-7385. ThreadLocal used in FSEditLog class causes FSImage permission mess up. Contributed by jiangyu.
2014-11-13 12:34:52 -08:00
Tsz-Wo Nicholas Sze
394ba94c5d
HDFS-7358. Clients may get stuck waiting when using ByteArrayManager.
2014-11-13 12:28:44 -08:00
Allen Wittenauer
ba879a5dad
HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw)
2014-11-13 11:52:38 -08:00
cnauroth
0abb973f09
HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA.
2014-11-12 21:41:19 -08:00
Haohui Mai
e073b61dc4
Fix CHANGES.txt to make it consistent with branch-2.
2014-11-12 20:03:27 -08:00
Arun C. Murthy
9f0319bba1
HDFS-7391. Renable SSLv2Hello in HttpFS. Contributed by Robert Kanter.
2014-11-12 18:51:46 -08:00
Arun C. Murthy
782abbb000
HDFS-7387. Merging to branch-2.6 for hadoop-2.6.0-rc1.
2014-11-12 11:32:44 -08:00
Haohui Mai
46f6f9d60d
HDFS-7375. Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement. Contributed by Haohui Mai.
2014-11-11 18:22:40 -08:00
cnauroth
163bb55067
HDFS-7389. Named user ACL cannot stop the user from accessing the FS entity. Contributed by Vinayakumar B.
2014-11-11 13:29:55 -08:00
Brandon Li
99d9d0c2d1
HDFS-7387. NFS may only do partial commit due to a race between COMMIT and write. Contributed by Brandon Li
2014-11-11 13:03:31 -08:00
Haohui Mai
571e9c6232
HDFS-7381. Decouple the management of block id and gen stamps from FSNamesystem. Contributed by Haohui Mai.
2014-11-11 12:42:12 -08:00
Karthik Kambatla
68a0508728
Set the release date for 2.5.2
2014-11-10 15:22:53 -08:00
Arun C. Murthy
770cc14442
Updated CHANGES.txt to reflect hadoop-2.6.0 release dates.
2014-11-09 18:47:21 -08:00
Arun C. Murthy
f62ec31739
HDFS-7383. Merged to branch-2.6 also.
2014-11-09 18:22:05 -08:00
Suresh Srinivas
4ddc5cad0a
HDFS-7383. DataNode.requestShortCircuitFdsForRead may throw NullPointerException. Contributed by Tsz Wo Nicholas Sze.
2014-11-09 17:55:03 -08:00
cnauroth
9ba8d8c7eb
HDFS-7382. DataNode in secure mode may throw NullPointerException if client connects before DataNode registers itself with NameNode. Contributed by Chris Nauroth.
2014-11-08 22:24:57 -08:00
Arun C. Murthy
6caa8100d5
HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs.
2014-11-08 15:39:56 -08:00
Haohui Mai
57760c0663
HDFS-7379. TestBalancer#testBalancerWithRamDisk creates test files incorrectly. Contributed by Xiaoyu Yao.
2014-11-07 13:39:09 -08:00
cnauroth
d026f36762
HDFS-7226. Update CHANGES.txt to indicate fix in 2.6.0.
2014-11-06 23:10:21 -08:00
cnauroth
e7f1c0482e
HDFS-7221. Update CHANGES.txt to indicate fix in 2.6.0.
2014-11-06 22:46:22 -08:00
Jing Zhao
ae71a671a3
HDFS-7364. Balancer always shows zero Bytes Already Moved. Contributed by Tsz Wo Nicholas Sze.
2014-11-06 17:48:36 -08:00
Haohui Mai
75b820cca9
HDFS-7365. Remove hdfs.server.blockmanagement.MutableBlockCollection. Contributed by Li Lu.
2014-11-06 13:56:31 -08:00
Milan Desai
80d7d183cd
HDFS-7336. Unused member DFSInputStream.buffersize. Contributed by Milan Desai.
2014-11-05 21:00:28 -08:00
Byron Wong
228afed14c
HDFS-7329. Improve logging when MiniDFSCluster fails to start. Contributed by Byron Wong.
2014-11-05 20:56:21 -08:00
Haohui Mai
8e33d4bdb3
HDFS-7367. HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol. Contributed by Chris Nauroth.
2014-11-05 20:31:39 -08:00
Konstantin V Shvachko
240cb59b9f
HDFS-7361. TestCheckpoint fails after change of log message related to locking violation. Contributed by Konstantin Shvachko.
2014-11-05 20:15:16 -08:00
Haohui Mai
86eb27ba1d
HDFS-7366. BlockInfo should take replication as an short in the constructor. Contributed by Li Lu.
2014-11-05 18:14:18 -08:00
cnauroth
ba1d4ad25b
HDFS-7359. NameNode in secured HA cluster fails to start if dfs.namenode.secondary.http-address cannot be interpreted as a network address. Contributed by Chris Nauroth.
2014-11-05 15:09:22 -08:00
Colin Patrick Mccabe
7b07acb0a5
CHANGES.txt. Move HDFS-7199 to branch-2.6
2014-11-05 10:57:15 -08:00
Colin Patrick Mccabe
56257fab1d
HDFS-7199. DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception (rushabhs via cmccabe)
2014-11-05 10:51:49 -08:00
Haohui Mai
18312804e9
HDFS-7357. FSNamesystem.checkFileProgress should log file path. Contributed by Tsz Wo Nicholas Sze.
2014-11-05 10:14:30 -08:00
Konstantin V Shvachko
203c63030f
HDFS-7333. Improve logging in Storage.tryLock(). Contributed by Konstantin Shvachko.
2014-11-05 09:53:23 -08:00
Konstantin V Shvachko
6e8722e49c
HDFS-7335. Redundant checkOperation() in FSN.analyzeFileState(). Contributed by Milan Desai.
2014-11-05 09:32:32 -08:00
yliu
73e601259f
HDFS-7218. FSNamesystem ACL operations should write to audit log on failure. (clamb via yliu)
2014-11-05 15:49:37 +08:00
Haohui Mai
d794f785de
HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN. Contributed by Robert Kanter.
2014-11-04 17:52:03 -08:00
Karthik Kambatla
4de56d27fb
Adding release 2.5.2 to CHANGES.txt
2014-11-04 16:50:40 -08:00
Jing Zhao
5bd3a569f9
HDFS-7233. NN logs unnecessary org.apache.hadoop.hdfs.protocol.UnresolvedPathException. Contributed by Rushabh S Shah.
2014-11-04 16:02:07 -08:00
Haohui Mai
99d710348a
HDFS-7355. TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner. Contributed by Chris Nauroth.
2014-11-04 15:18:51 -08:00
Jing Zhao
27f106e226
HDFS-7356. Use DirectoryListing.hasMore() directly in nfs. Contributed by Li Lu.
2014-11-04 15:04:26 -08:00
Haohui Mai
d0449bd2fd
HDFS-7334. Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures. Contributed by Charles Lamb.
2014-11-04 14:34:52 -08:00
Jing Zhao
3dfd6e68fe
HDFS-7340. Make rollingUpgrade start/finalize idempotent. Contributed by Jing Zhao.
2014-11-04 10:16:37 -08:00
cnauroth
2bb327eb93
HDFS-7328. TestTraceAdmin assumes Unix line endings. Contributed by Chris Nauroth.
2014-11-03 19:59:52 -08:00
Haohui Mai
35d353e0f6
HDFS-7147. Update archival storage user documentation. Contributed by Tsz Wo Nicholas Sze.
2014-11-03 15:10:22 -08:00
Suresh Srinivas
237890feab
HDFS-7324. haadmin command usage prints incorrect command name. Contributed by Brahma Reddy Battula.
2014-11-03 13:27:09 -08:00
Kihwal Lee
67f13b58e4
HADOOP-10987. Provide an iterator-based listing API for FileSystem. Contributed by Kihwal Lee.
2014-11-03 08:20:22 -06:00
Tsz-Wo Nicholas Sze
36ccf097a9
HDFS-7276. Limit the number of byte arrays used by DFSOutputStream and provide a mechanism for recycling arrays.
2014-11-01 11:22:13 -07:00
Haohui Mai
80bb7d4794
HDFS-7319. Remove dead link to HFTP documentation from index.xml. Contributed by Masatake Iwasaki.
2014-10-31 16:54:59 -07:00
Colin Patrick Mccabe
7b026c50f1
HDFS-6917. Add an hdfs debug command to validate blocks, call recoverlease, etc. (cmccabe)
2014-10-31 13:15:17 -07:00
Haohui Mai
3f030c04e8
HDFS-7315. DFSTestUtil.readFileBuffer opens extra FSDataInputStream. Contributed by Plamen Jeliazkov.
2014-10-31 11:47:41 -07:00
Ravi Prakash
c7f81dad30
HDFS-7309. XMLUtils.mangleXmlString doesn't seem to handle less than sign. (Colin Patrick McCabe via raviprak)
2014-10-31 11:22:25 -07:00
cnauroth
5573b3476a
HDFS-7313. Support optional configuration of AES cipher suite on DataTransferProtocol. Contributed by Chris Nauroth.
2014-10-30 22:48:25 -07:00
cnauroth
c637d6d9d5
HDFS-6385. Show when block deletion will start after NameNode startup in WebUI. Contributed by Chris Nauroth.
2014-10-30 22:26:35 -07:00
Colin Patrick Mccabe
a9331fe9b0
HDFS-7035. Make adding a new data directory to the DataNode an atomic operation and improve error handling (Lei Xu via Colin P. McCabe)
2014-10-30 17:31:23 -07:00
Andrew Wang
c2866ac34d
HDFS-3342. SocketTimeoutException in BlockSender.sendChunks could have a better error message. Contributed by Yongjun Zhang.
2014-10-30 11:04:10 -07:00
Jing Zhao
b811212f23
HDFS-7230. Add rolling downgrade documentation. Contributed by Tsz Wo Nicholas Sze.
2014-10-30 10:47:05 -07:00
Tao Luo
0126cf16b7
HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo.
2014-10-29 20:21:12 -07:00
Jing Zhao
6f5f604a79
HDFS-7305. NPE seen in wbhdfs FS while running SLive. Contributed by Jing Zhao.
2014-10-29 16:25:48 -07:00
Kihwal Lee
3ae84e1ba8
HDFS-7300. HDFS-7300. The getMaxNodesPerRack() method in
...
BlockPlacementPolicyDefault is flawed. contributed by Kihwal Lee
2014-10-29 17:23:34 -05:00
Colin Patrick Mccabe
d33e07dc49
HDFS-7287. The OfflineImageViewer (OIV) can output invalid XML depending on the filename (Ravi Prakash via Colin P. McCabe)
2014-10-29 12:31:59 -07:00
Brandon Li
72a556d3b0
HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang
2014-10-29 11:05:29 -07:00
Karthik Kambatla
3f48493bed
HDFS-7274. Disable SSLv3 in HttpFS. (Robert Kanter via kasha)
2014-10-28 17:21:20 -07:00
Haohui Mai
675bca2968
HDFS-7280. Use netty 4 in WebImageViewer. Contributed by Haohui Mai.
2014-10-28 16:53:53 -07:00
Colin Patrick Mccabe
ac9ab037e9
HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe)
2014-10-28 16:41:22 -07:00
cnauroth
c6f04f391b
HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao.
2014-10-28 14:06:27 -07:00
Kihwal Lee
e226b5b40d
HDFS-7213. processIncrementalBlockReport performance degradation.
...
Contributed by Eric Payne.
2014-10-28 14:54:05 -05:00
Kihwal Lee
371a3b87ed
HDFS-6663. Admin command to track file and locations from block id.
...
Contributed by Chen He.
2014-10-28 14:26:04 -05:00
yliu
58c0bb9ed9
HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu)
2014-10-28 21:11:31 +08:00
Harsh J
0398db19b2
HDFS-6741. Improve permission denied message when FSPermissionChecker#checkOwner fails. Contributed by Stephen Chu and Harsh J. (harsh)
2014-10-28 12:22:37 +05:30
yliu
e7859015bc
HADOOP-11233. hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default. (Stephen Chu via yliu)
2014-10-28 14:21:26 +08:00
Colin Patrick Mccabe
518a7f4af3
HDFS-7282. Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC (Jinghui Wang via Colin P. McCabe)
2014-10-27 17:44:07 -07:00
Haohui Mai
00b4e44a2e
HDFS-5928. Show namespace and namenode ID on NN dfshealth page. Contributed by Siqi Li.
2014-10-27 16:22:19 -07:00
Colin Patrick Mccabe
baf794dc40
HDFS-7278. Add a command that allows sysadmins to manually trigger full block reports from a DN (cmccabe)
2014-10-27 09:53:16 -07:00
cnauroth
463aec1171
HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth.
2014-10-27 09:38:30 -07:00
Harsh J
0058eadbd3
HDFS-6538. Comment format error in ShortCircuitRegistry javadoc. Contributed by David Luo. (harsh)
2014-10-27 19:24:50 +05:30
Byron Wong
28051e4155
HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong.
2014-10-25 12:31:41 -07:00
Colin Patrick Mccabe
a52eb4bc5f
HDFS-6988. Improve HDFS-6581 eviction configuration (Xiaoyu Yao via Colin P. McCabe)
2014-10-24 13:08:59 -07:00
Jitendra Pandey
86ac0d40b8
HDFS-6904. Added files missing in previous commit.
2014-10-24 12:01:09 -07:00
Jitendra Pandey
e2be333744
HDFS-6904. YARN unable to renew delegation token fetched via webhdfs due to incorrect service port.
2014-10-24 11:35:19 -07:00
Haohui Mai
b3d8a642a9
HDFS-7283. Bump DataNode OOM log from WARN to ERROR. Contributed by Stephen Chu.
2014-10-24 10:50:16 -07:00
Haohui Mai
0942c99eba
HDFS-7258. CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level. Contributed by Xiaoyu Yao.
2014-10-23 23:58:32 -07:00
yliu
57dec28807
HDFS-7243. HDFS concat operation should not be allowed in Encryption Zone. (clamb via yliu)
2014-10-24 11:12:18 +08:00
Colin Patrick Mccabe
5b56ac4c72
HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe)
2014-10-23 19:14:00 -07:00
Haohui Mai
670879ef41
HDFS-7257. Add the time of last HA state transition to NN's /jmx page. Contributed by Charles Lamb.
2014-10-23 16:52:58 -07:00
Allen Wittenauer
828429dec1
HDFS-7232. Populate hostname in httpfs audit log (Zoran Dimitrijevic via aw)
2014-10-23 14:06:19 -07:00
Andrew Wang
86cad007d7
HDFS-7222. Expose DataNode network errors as a metric. (Charles Lamb via wang)
2014-10-23 12:53:01 -07:00
Andrew Wang
8c5b23b547
HDFS-7165. Separate block metrics for files with replication count 1. (Zhe Zhang via wang)
2014-10-23 12:28:02 -07:00
Brandon Li
d71d40a63d
HDFS-7180. NFSv3 gateway frequently gets stuck due to GC. Contributed by Brandon Li
2014-10-22 21:27:01 -07:00
Haohui Mai
f729ecf9d2
HDFS-7277. Remove explicit dependency on netty 3.2 in BKJournal. Contributed by Haohui Mai.
2014-10-22 17:31:57 -07:00
Andrew Wang
a36399e09c
HDFS-6824. Additional user documentation for HDFS encryption.
2014-10-22 14:38:47 -07:00
Andrew Wang
08457e9e57
Move HDFS-2486 down to 2.7.0 in CHANGES.txt
2014-10-22 14:35:06 -07:00
Colin Patrick Mccabe
7b0f9bb258
HDFS-6877. Avoid calling checkDisk when an HDFS volume is removed during a write. (Lei Xu via Colin P. McCabe)
2014-10-22 13:38:26 -07:00
Colin Patrick Mccabe
66e8187ea1
HDFS-7254. Add documentation for hot swaping DataNode drives (Lei Xu via Colin P. McCabe)
2014-10-22 13:27:51 -07:00
Jing Zhao
1c8d191117
HDFS-7228. Fix TestDNFencing.testQueueingWithAppend. Contributed by Yongjun Zhang.
2014-10-22 10:48:15 -07:00
Allen Wittenauer
4baca311ff
HDFS-7204. balancer doesn't run as a daemon (aw)
2014-10-21 14:26:08 -07:00
Jitendra Pandey
b85919feef
Updated CHANGES.txt for HDFS-6581 merge into branch-2.6.
2014-10-21 13:24:03 -07:00
Andrew Wang
ac56b0637e
HDFS-7221. TestDNFencingWithReplication fails consistently. Contributed by Charles Lamb.
2014-10-21 12:55:18 -07:00
Brandon Li
4e134a02a4
HDFS-7215.Add JvmPauseMonitor to NFS gateway. Contributed by Brandon Li
2014-10-21 11:49:10 -07:00
Brandon Li
b6f9d5538c
HDFS-7259. Unresponseive NFS mount point due to deferred COMMIT response. Contributed by Brandon Li
2014-10-21 10:20:29 -07:00
Colin Patrick Mccabe
7aab5fa1bd
HDFS-7154. Fix returning value of starting reconfiguration task (Lei Xu via Colin P. McCabe)
2014-10-20 18:33:11 -07:00
Colin Patrick Mccabe
4799570dfd
HDFS-7266. HDFS Peercache enabled check should not lock on object (awang via cmccabe)
2014-10-20 18:24:53 -07:00
Benoy Antony
e4d6a87854
HDFS-7184. Allow data migration tool to run as a daemon. (Benoy Antony)
2014-10-20 12:15:58 -07:00
Tsz-Wo Nicholas Sze
2e140523d3
HDFS-7260. Change DFSOutputStream.MAX_PACKETS to be configurable.
2014-10-17 18:30:09 -07:00
Vinayakumar B
368743140d
HDFS-7252. small refinement to the use of isInAnEZ in FSNamesystem. (Yi Liu via vinayakumarb)
2014-10-17 18:03:44 +05:30
Vinayakumar B
1c3ff0b7c8
HDFS-7242. Code improvement for FSN#checkUnreadableBySuperuser. (Contributed by Yi Liu)
2014-10-17 17:48:20 +05:30
Vinayakumar B
cba1f9e389
HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb)
...
Adding missed test file
2014-10-17 17:31:01 +05:30
Tsz-Wo Nicholas Sze
2894433332
HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support FSIMAGE_NAME_OPTIMIZATION.
2014-10-15 20:56:59 -07:00
Tsz-Wo Nicholas Sze
41980c56d3
HDFS-7208. NN doesn't schedule replication when a DN storage fails. Contributed by Ming Ma
2014-10-15 20:44:24 -07:00
Jing Zhao
18620649f9
HDFS-7185. The active NameNode will not accept an fsimage sent from the standby during rolling upgrade. Contributed by Jing Zhao.
2014-10-15 10:27:30 -07:00
Haohui Mai
128ace10cd
HDFS-7190. Bad use of Preconditions in startFileInternal(). Contributed by Dawson Choong.
2014-10-14 23:42:19 -07:00
Haohui Mai
0260231667
HDFS-7201. Fix typos in hdfs-default.xml. Contributed by Dawson Choong.
2014-10-14 17:36:07 -07:00
Jing Zhao
7dcad84143
HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao.
2014-10-14 10:22:34 -07:00
Tsz-Wo Nicholas Sze
f6d0b8892a
HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException.
2014-10-13 18:28:34 -07:00
cnauroth
1770bb942f
HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao.
2014-10-13 10:56:32 -07:00
Haohui Mai
53100318ea
HDFS-6544. Broken Link for GFS in package.html. Contributed by Suraj Nayak M.
2014-10-13 10:33:19 -07:00
Jing Zhao
98ac9f26c5
HDFS-7236. Fix TestOpenFilesWithSnapshot#testOpenFilesWithMultipleSnapshots. Contributed by Yongjun Zhang.
2014-10-13 10:27:36 -07:00
Haohui Mai
428dfaad60
Update CHANGES.txt after merging HDFS-6252 and HDFS-6657 to branch-2.
2014-10-10 17:32:14 -07:00
Andrew Wang
d3d3d47202
HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang)
2014-10-10 13:40:37 -07:00
Colin Patrick Mccabe
1ceb326933
HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe)
2014-10-10 13:03:29 -07:00
Aaron T. Myers
cbd21fd13b
HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang.
2014-10-09 18:52:48 -07:00
Andrew Wang
8d94114495
HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang)
2014-10-09 13:21:19 -07:00
cnauroth
9097183983
HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
2014-10-09 11:51:12 -07:00
Kihwal Lee
db71bb54bc
HDFS-7217. Better batching of IBRs. Contributed by Kihwal Lee.
2014-10-09 12:07:51 -05:00
Aaron T. Myers
2a51494ce1
HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh.
2014-10-08 18:01:51 -07:00
Colin Patrick Mccabe
d996235285
HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe)
2014-10-08 17:55:46 -07:00
Kihwal Lee
853cb704ed
HDFS-7203. Concurrent appending to the same file can cause data
...
corruption. Contributed by Kihwal Lee.
2014-10-08 15:05:34 -05:00
cnauroth
1efd9c9825
HDFS-7112. LazyWriter should use either async IO or one thread per physical disk. Contributed by Xiaoyu Yao.
2014-10-07 20:25:19 -07:00
cnauroth
9b8a35aff6
HDFS-7128. Decommission slows way down when it gets towards the end. Contributed by Ming Ma.
2014-10-07 15:01:09 -07:00
Andrew Wang
0263656247
Fixup for CHANGES.txt
2014-10-07 14:58:57 -07:00
Kihwal Lee
99d7a452be
HADOOP-11007. Reinstate building of ant tasks support. Contributed by
...
Jason Lowe.
2014-10-07 16:20:16 -05:00
Colin Patrick Mccabe
8dc6abf2f4
HDFS-7194 Fix findbugs "inefficient new String constructor" warning in DFSClient#PATH (yzhang via cmccabe)
2014-10-06 15:29:09 -07:00
Tsz-Wo Nicholas Sze
3affad9ebd
HDFS-7169. Add SE_BAD_FIELD to findbugsExcludeFile.xml.
2014-10-06 13:29:56 -07:00
Vinayakumar B
ed841dd9a9
HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb)
2014-10-06 14:31:15 +05:30
Colin Patrick Mccabe
7f6ed7fe36
HDFS-7055. Add tracing to DFSInputStream (cmccabe)
2014-10-03 13:35:43 -07:00
Andrew Wang
6ac10516e7
HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang)
2014-10-02 13:51:08 -07:00
Andrew Wang
d2d5a0ea03
HDFS-7179. DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtension. (wang)
2014-10-02 13:50:05 -07:00
Colin Patrick Mccabe
a56f3ecf86
HDFS-7162. Fix CHANGES.txt (should have Chenging Liu's name)
2014-10-02 12:45:54 -07:00
Colin Patrick Mccabe
03db9cc839
HDFS-7162. Wrong path when deleting through fuse-dfs a file which already exists in trash (cmccabe)
2014-10-02 12:42:19 -07:00
arp
c2fa5d1c42
HDFS-7178. Additional unit test for replica write with full disk. (Arpit Agarwal)
2014-10-02 09:28:26 -07:00
Haohui Mai
8dfe54f6d3
Addendum patch for HDFS-7172. Contributed by Chris Nauroth.
2014-10-01 16:09:30 -07:00
Colin Patrick Mccabe
dd1b8f2ed8
HDFS-7176. The namenode usage message doesn't include "-rollingupgrade started" (cmccabe)
2014-10-01 14:53:44 -07:00
Haohui Mai
875aa797ca
HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li.
2014-10-01 13:18:56 -07:00
Haohui Mai
1f5b42ac48
HDFS-7158. Reduce the memory usage of WebImageViewer. Contributed by Haohui Mai.
2014-10-01 10:53:38 -07:00
Haohui Mai
737f280dde
HDFS-7172. Test data files may be checked out of git with incorrect line endings, causing test failures in TestHDFSCLI. Contributed by Chris Nauroth.
2014-10-01 10:46:33 -07:00
arp
04b08431a3
HDFS-6581. Update CHANGES.txt in preparation for trunk merge
2014-10-01 09:01:08 -07:00
arp
e431d054cb
Merge branch 'trunk' into HDFS-6581
2014-10-01 08:52:21 -07:00
Kihwal Lee
3f25d916d5
HDFS-6754. TestNamenodeCapacityReport.testXceiverCount may sometimes fail due to lack of retry. Contributed by Mit Desai.
2014-10-01 09:53:01 -05:00
arp
a45ad330fa
HDFS-7171. Fix Jenkins failures in HDFS-6581 branch. (Arpit Agarwal)
2014-09-30 18:25:20 -07:00
arp
65ef35bbab
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
hadoop-hdfs-project/hadoop-hdfs/src/test/resources/editsStored.xml
2014-09-30 18:20:13 -07:00
arp
9e9e9cf711
HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal)
2014-09-30 18:10:13 -07:00
arp
dde2ed13c2
Merge branch 'trunk' into HDFS-6581
2014-09-30 18:05:54 -07:00
Jing Zhao
cdf1af0e5a
HDFS-7167. NPE while running Mover if the given path is for a file. Contributed by Jing Zhao.
2014-09-30 11:13:35 -07:00
Arun C. Murthy
ea32a66f7d
Preparing to branch hadoop-2.6
2014-09-30 10:26:42 -07:00
arp
5e8b697352
HDFS-7129. Metrics to track usage of memory for writes. (Contributed by Xiaoyu Yao)
2014-09-30 00:53:18 -07:00
arp
bb84f1fccb
HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal)
2014-09-29 22:27:59 -07:00
arp
368e2423a5
Merge branch 'trunk' into HDFS-6581
2014-09-29 20:09:06 -07:00
Haohui Mai
0577eb32fc
HDFS-6779. Add missing version subcommand for hdfs. Contributed by Sasaki Toru.
2014-09-29 18:10:47 -07:00
arp
7f0422be76
Merge branch 'trunk' into HDFS-6581
2014-09-29 16:29:43 -07:00
Andrew Wang
c6c3247dc0
HDFS-7122. Use of ThreadLocal<Random> results in poor block placement. (wang)
2014-09-29 15:00:26 -07:00
Andrew Wang
7f0efe96f8
HDFS-7124. Remove EncryptionZoneManager.NULL_EZ. (clamb via wang)
2014-09-29 14:14:22 -07:00
arp
1e6b4b9b2e
Merge branch 'trunk' into HDFS-6581
2014-09-29 14:01:47 -07:00
Andrew Wang
a45b331cc9
Move HDFS-7157 to HDFS CHANGES.txt
2014-09-29 13:17:21 -07:00
Andrew Wang
f0293f11a8
HDFS-7104. Fix and clarify INodeInPath getter functions. Contributed by Zhe Zhang.
2014-09-29 12:58:37 -07:00
arp
d45e7c7e85
HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal)
2014-09-29 12:36:27 -07:00
Andrew Wang
371ef4cefc
Move HDFS-4165 from trunk to 2.6.0 in CHANGES.txt.
2014-09-29 11:06:44 -07:00
Allen Wittenauer
84b9c632bf
HDFS-4227. Document dfs.namenode.resource.* (Daisuke Kobayashi via aw)
2014-09-29 09:01:43 -07:00
Allen Wittenauer
9829f9fa58
HDFS-6519. Document oiv_legacy command (Akira AJISAKA via aw)
2014-09-29 08:51:41 -07:00
arp
9a53c3699b
Merge branch 'trunk' into HDFS-6581
2014-09-28 20:42:56 -07:00
arp
b38e52b5e8
HDFS-7093. Add config key to restrict setStoragePolicy. (Arpit Agarwal)
2014-09-28 19:28:51 -07:00
Konstantin V Shvachko
400e1bb4ef
HDFS-7156. Update fsck documentation. Contributed by Masahiro Yamaguch.
2014-09-27 21:04:23 -07:00
arp
d96396627f
Merge branch 'trunk' into HDFS-6581
2014-09-26 16:31:08 -07:00
arp
a2d4edacea
HDFS-7155. Bugfix in createLocatedFileStatus caused by bad merge. (Arpit Agarwal)
2014-09-26 16:30:47 -07:00
Allen Wittenauer
3a1f981686
HDFS-6664. HDFS permissions guide documentation states incorrect default group mapping class. (Ray Chiang via aw)
2014-09-26 12:20:40 -07:00
arp
7060502edb
Merge branch 'trunk' into HDFS-6581
2014-09-26 11:09:03 -07:00
Colin Patrick Mccabe
55302ccfba
HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe)
2014-09-26 10:30:30 -07:00
Tsz-Wo Nicholas Sze
a6049aa994
CHANGES.txt: move HDFS-6584 and its subtasks to Release 2.6.0.
2014-09-26 23:51:00 +08:00
Andrew Wang
840825d819
Add HDFS-7148 to CHANGES.txt, branch-2 only commit.
2014-09-25 21:50:24 -07:00
arp
263977969b
Fix test build break after merging from trunk
2014-09-25 20:29:24 -07:00
arp
032e0eba6b
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
2014-09-25 19:50:28 -07:00
Andrew Wang
e96ce6f3e3
HDFS-7077. Separate CipherSuite from crypto protocol version. (wang)
2014-09-25 18:40:40 -07:00
Jing Zhao
e9c37de485
HDFS-7131. During HA upgrade, JournalNode should create a new committedTxnId file in the current directory. Contributed by Jing Zhao.
2014-09-25 17:15:33 -07:00
cnauroth
9f9a2222a2
HDFS-7119. Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics. Contributed by Chris Nauroth.
2014-09-25 13:33:37 -07:00
Colin Patrick Mccabe
1861b32eb5
HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe)
2014-09-25 13:11:59 -07:00
arp
5a5a7da3a3
Merge branch 'trunk' into HDFS-6581
2014-09-25 12:55:59 -07:00
cnauroth
b607c3c363
HDFS-7127. TestLeaseRecovery leaks MiniDFSCluster instances. Contributed by Chris Nauroth.
2014-09-25 11:24:31 -07:00
cnauroth
dc2ebf88a8
HDFS-7111. TestSafeMode assumes Unix line endings in safe mode tip. Contributed by Chris Nauroth.
2014-09-25 11:17:46 -07:00
arp
364e60b169
HDFS-7144. Fix findbugs warnings in RamDiskReplicaTracker. (Contributed by Tsz Wo Nicholas Sze)
2014-09-25 11:14:24 -07:00
arp
e9edafc731
Merge branch 'trunk' into HDFS-6581
2014-09-25 11:06:25 -07:00
cnauroth
e0b1dc514f
HDFS-7118. Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename. Contributed by Chris Nauroth.
2014-09-25 10:03:59 -07:00
arp
e8e7fbe81a
HDFS-6932. Balancer and Mover tools should ignore replicas on RAM_DISK. (Contributed by Xiaoyu Yao)
2014-09-24 21:08:59 -07:00
arp
feda4733a8
HDFS-7143. Fix findbugs warnings in HDFS-6581 branch. (Contributed by Tsz Wo Nicholas Sze)
2014-09-24 21:06:56 -07:00
arp
b1000fbba4
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
2014-09-24 20:08:32 -07:00
Jing Zhao
428a76663a
HDFS-7140. Add a tool to list all the existing block storage policies. Contributed by Jing Zhao.
2014-09-24 19:11:16 -07:00
Andrew Wang
116f83157a
Add branch-2 only commit HDFS-7138 to CHANGES.txt
2014-09-24 16:47:09 -07:00
Andrew Wang
63198bfba7
HDFS-7139. Unit test for creating encryption zone on root path. (Zhe Zhang via wang)
2014-09-24 16:40:20 -07:00
Andrew Wang
9fa5a89be3
Move HDFS-6987 from trunk to branch-2 in CHANGES.txt
2014-09-24 12:11:58 -07:00
Jing Zhao
073bbd805c
HDFS-7081. Add new DistributedFileSystem API for getting all the existing storage policies. Contributed by Jing Zhao.
2014-09-24 10:05:40 -07:00
Allen Wittenauer
cb74f39697
HDFS-6534. Fix build on macosx: HDFS parts (Binglin Chang via aw)
2014-09-24 08:22:02 -07:00
arp
bfc7b7e6a0
Merge branch 'trunk' into HDFS-6581
2014-09-23 16:40:35 -07:00
cnauroth
b93d9603a2
HDFS-7130. TestDataTransferKeepalive fails intermittently on Windows. Contributed by Chris Nauroth.
2014-09-23 14:35:33 -07:00
Andrew Wang
f48686a1ad
HDFS-7132. hdfs namenode -metadataVersion command does not honor configured name dirs. Contributed by Charles Lamb.
2014-09-23 14:10:02 -07:00
Allen Wittenauer
3dc28e2052
HADOOP-11092. hadoop shell commands should print usage if not given a class (aw)
2014-09-23 12:24:23 -07:00
cnauroth
a1fd804a31
HDFS-7126. TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.
2014-09-23 08:21:46 -07:00
arp
8b139b0800
HDFS-6990. Add unit test for evict/delete RAM_DISK block with open handle. (Contributed by Xiaoyu Yao)
2014-09-22 18:10:28 -07:00
arp
889122bd55
Merge branch 'trunk' into HDFS-6581
2014-09-22 18:00:58 -07:00
Colin Patrick Mccabe
7b8df93ce1
HDFS-7001. Tests in TestTracing should not depend on the order of execution. (iwasakims via cmccabe)
2014-09-22 17:21:58 -07:00
Colin Patrick Mccabe
912ad32b03
HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe)
2014-09-22 11:51:31 -07:00
cnauroth
26cba7f35f
HDFS-7115. TestEncryptionZones assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.
2014-09-22 09:07:07 -07:00
Andrew Wang
1737950d0f
HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. Contributed by Zhe Zhang.
2014-09-21 21:29:46 -07:00
cnauroth
b6fd5ccbce
HDFS-7110. Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read. Contributed by Chris Nauroth.
2014-09-21 12:36:57 -07:00
cnauroth
0795fe3721
HDFS-7109. TestDataStorage does not release file locks between tests. Contributed by Chris Nauroth.
2014-09-20 21:01:13 -07:00
cnauroth
47491f9a11
HDFS-7107. Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris Nauroth.
2014-09-20 20:53:09 -07:00
arp
8c9860f7c9
HDFS-7071. Undo accidental commit of binary file editsStored.
2014-09-20 17:11:11 -07:00
arp
486a76a39b
HDFS-7071. Updated editsStored and editsStored.xml to bump layout version and add LazyPersist flag. (Contributed by Xiaoyu Yao and Arpit Agarwal)
2014-09-20 16:58:58 -07:00
arp
e257b6dbb1
Merge branch 'trunk' into HDFS-6581
2014-09-20 16:13:17 -07:00
arp
50b321068d
HDFS-7108. Fix unit test failures in SimulatedFsDataset. (Arpit Agarwal)
2014-09-20 16:12:17 -07:00
Jing Zhao
84a0a629d3
HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. Contributed by Jing Zhao.
2014-09-20 13:44:53 -07:00
arp
b2d5ed36bc
HDFS-7100. Make eviction scheme pluggable. (Arpit Agarwal)
2014-09-20 13:25:23 -07:00
arp
09dab88d3e
Merge branch 'trunk' into HDFS-6581
2014-09-20 10:34:45 -07:00
cnauroth
f85cc14eb4
HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth.
2014-09-19 21:23:26 -07:00
cnauroth
332e2e23ba
HDFS-7105. Fix TestJournalNode#testFailToStartWithBadConfig to match log output change. Contributed by Ray Chiang.
2014-09-19 21:04:55 -07:00
Kihwal Lee
9e35571965
HDFS-7046. HA NN can NPE upon transition to active. Contributed by
...
Kihwal Lee.
2014-09-19 17:07:06 -05:00
arp
222bf0fe67
Merge branch 'trunk' into HDFS-6581
2014-09-19 10:02:27 -07:00
Colin Patrick Mccabe
25fd69a8f9
HDFS-7096. Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI (clamb via cmccabe)
2014-09-19 09:20:25 -07:00
Kihwal Lee
bf27b9ca57
HDFS-7065. Pipeline close recovery race can cause block corruption.
...
Contributed by Kihwal Lee.
2014-09-19 09:00:13 -05:00
Kihwal Lee
f02d934fed
HDFS-6948. DN rejects blocks if it has older UC block. Contributed by
...
Eric Payne.
2014-09-19 08:50:43 -05:00
arp
f8bbf80067
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsFileStatus.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsLocatedFileStatus.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java
hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto
hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
2014-09-18 22:26:42 -07:00
arp
e79c98c11f
HDFS-7091. Add forwarding constructor for INodeFile for existing callers. (Arpit Agarwal)
2014-09-18 19:20:25 -07:00
Andrew Wang
8e73084491
HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang)
2014-09-18 17:49:17 -07:00
Andrew Wang
20a076bafc
HDFS-6970. Move startFile EDEK retries to the DFSClient. (wang)
2014-09-18 17:35:24 -07:00
Colin Patrick Mccabe
fe38d2e9b5
HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe)
2014-09-18 16:52:46 -07:00
Tsz-Wo Nicholas Sze
5d01a684a3
Revise the HDFS-6584 entry CHANGES.txt.
2014-09-19 07:46:18 +08:00
Tsz-Wo Nicholas Sze
fd3cddf364
Fix hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt for HDFS-6584 after
...
merge.
2014-09-19 07:33:43 +08:00
Tsz-Wo Nicholas Sze
98f7bfe993
Merge branch 'HDFS-6584' into trunk
2014-09-19 07:11:19 +08:00
arp
22295b4783
Merge branch 'trunk' into HDFS-6581
2014-09-18 15:59:37 -07:00
Andrew Wang
70be56d093
HDFS-7003. Add NFS Gateway support for reading and writing to encryption zones. (clamb via wang)
2014-09-18 14:57:25 -07:00
arp
0b10e5a0f7
Merge branch 'trunk' into HDFS-6581
2014-09-18 12:10:45 -07:00
Colin Patrick Mccabe
570b8b468e
HDFS-7047. Expose FileStatus#isEncrypted in libhdfs (cmccabe)
2014-09-18 11:42:23 -07:00
arp
5e4627d0fb
HDFS-7084. FsDatasetImpl#copyBlockFiles debug log can be improved. (Contributed by Xiaoyu Yao)
2014-09-18 11:13:53 -07:00
arp
849ccfa699
Merge branch 'trunk' into HDFS-6581
2014-09-18 11:06:40 -07:00
Jing Zhao
76ccb80fad
HDFS-7088. Archival Storage: fix TestBalancer and TestBalancerWithMultipleNameNodes. Contributed by Tsz Wo Nicholas Sze.
2014-09-18 10:54:01 -07:00
Tsz-Wo Nicholas Sze
2d2b0009e6
Merge branch 'trunk' into HDFS-6584
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
2014-09-18 13:00:29 +08:00
Andrew Wang
0ecefe6017
HDFS-7078. Fix listEZs to work correctly with snapshots. (wang)
2014-09-17 21:28:05 -07:00
Andrew Wang
10e8602f32
HDFS-7004. Update KeyProvider instantiation to create by URI. (wang)
2014-09-17 20:14:40 -07:00
Andrew Wang
bf38793ce1
Move some HDFS JIRAs to the correct CHANGES.txt
2014-09-17 18:08:34 -07:00
arp
4eab083b1b
HDFS-7080. Fix finalize and upgrade unit test failures. (Arpit Agarwal)
2014-09-17 15:25:04 -07:00
arp
a186d514bd
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
2014-09-17 15:03:55 -07:00
Jing Zhao
911979c8ab
Merge changes from trunk
2014-09-17 13:12:45 -07:00
Colin Patrick Mccabe
e3803d002c
HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe)
2014-09-17 12:55:35 -07:00
arp
24f8156886
Merge branch 'trunk' into HDFS-6581
2014-09-17 12:10:50 -07:00
Andrew Wang
ea4e2e843e
HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang)
2014-09-17 11:23:47 -07:00
Jing Zhao
b014e83bc5
HDFS-6864. Archival Storage: add user documentation. Contributed by Tsz Wo Nicholas Sze.
2014-09-17 09:40:17 -07:00
Alejandro Abdelnur
c0c7e6fabd
HADOOP-11062. CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used. (asuresh via tucu)
2014-09-16 23:36:36 -07:00
Alejandro Abdelnur
e14e71d5fe
HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu)
2014-09-16 23:20:35 -07:00
Tsz-Wo Nicholas Sze
91f6ddeb34
Fix hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt .
2014-09-17 14:09:08 +08:00
Tsz-Wo Nicholas Sze
bd2e409de1
HDFS-7072. Fix TestBlockManager and TestStorageMover. Contributed by Jing Zhao
2014-09-17 13:48:32 +08:00
arp
dcbc467301
HDFS-7079. Few more unit test fixes for HDFS-6581. (Arpit Agarwal)
2014-09-16 18:19:57 -07:00
arp
a24a9331d4
Merge branch 'trunk' into HDFS-6581
2014-09-16 18:18:09 -07:00
Jing Zhao
432b863719
Merge changes from trunk
2014-09-16 17:58:39 -07:00
Jing Zhao
2e4033e872
HDFS-7052. Archival Storage: Add Mover into hdfs script. Contributed by Jing Zhao.
2014-09-16 17:52:28 -07:00
Andrew Wang
a044407b5c
HDFS-6789. TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7. Contributed by Akira Ajisaka.
2014-09-16 17:02:06 -07:00
Andrew Wang
33ce887c20
HDFS-6851. Refactor EncryptionZoneWithId and EncryptionZone. (clamb via wang)
2014-09-16 16:41:09 -07:00
Benoy Antony
02adf7185d
HDFS-6799. The invalidate method in SimulatedFSDataset failed to remove (invalidate) blocks from the file system. Contributed by Megasthenis Asteris.
2014-09-16 16:24:23 -07:00
Allen Wittenauer
7971c97ec1
HADOOP-11022. User replaced functions get lost 2-3 levels deep (e.g., sbin) (aw)
2014-09-16 16:06:23 -07:00
arp
4603e4481f
HDFS-7064. Fix unit test failures in HDFS-6581 branch. (Contributed by Xiaoyu Yao)
2014-09-16 15:45:07 -07:00
Alejandro Abdelnur
3e85f5b605
HDFS-7006. Test encryption zones with KMS. (Anthony Young-Garner and tucu)
2014-09-16 14:36:07 -07:00
arp
e0d7fb48fb
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/Receiver.java
2014-09-16 14:32:57 -07:00
Colin Patrick Mccabe
56119fec96
HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe)
2014-09-16 13:59:32 -07:00
Kihwal Lee
0c26412be4
HDFS-6965. NN continues to issue block locations for DNs with full
...
disks. Contributed by Rushabh Shah.
2014-09-16 09:04:54 -05:00
arp
a7814e1aa4
Merge branch 'trunk' into HDFS-6581
2014-09-15 15:30:19 -07:00
arp
a4dcbaa332
HDFS-7066. LazyWriter#evictBlocks misses a null check for replicaState. (Contributed by Xiaoyu Yao)
2014-09-15 15:28:17 -07:00
Kihwal Lee
2f847b3357
HDFS-7059. HAadmin transtionToActive with forceActive option can show
...
confusing message. Contributed by Rushabh Shah.
2014-09-15 16:27:22 -05:00
Jing Zhao
ece3ecabdf
Merge remote-tracking branch 'origin/trunk' into HDFS-6584
2014-09-15 10:45:45 -07:00
Andrew Wang
43b0303008
HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb.
2014-09-15 10:23:57 -07:00
Jing Zhao
2689b6ca72
HDFS-7062. Archival Storage: skip under construction block for migration. Contributed by Jing Zhao.
2014-09-15 10:16:56 -07:00
Andrew Wang
fc741b5d78
HDFS-7061. Add test to verify encryption zone creation after NameNode restart without saving namespace. Contributed by Stephen Chu.
2014-09-14 23:49:01 -07:00
Tsz-Wo Nicholas Sze
dba52ce0bb
Merge branch 'trunk' into HDFS-6584
2014-09-13 14:56:48 +08:00
arp
9f22fb8c9a
HDFS-6978. Directory scanner should correctly reconcile blocks on RAM disk. (Arpit Agarwal)
2014-09-12 22:13:18 -07:00
arp
7aeda47bd9
Merge branch 'trunk' into HDFS-6581
2014-09-12 11:45:11 -07:00
cnauroth
d6ce26986e
HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator. Contributed by Chris Nauroth.
2014-09-11 20:58:15 -07:00
Karthik Kambatla
17ffbe0864
Update CHANGES.txt to set the release date for 2.5.1
2014-09-11 17:35:35 -07:00
Jing Zhao
dc27ee9ae9
HDFS-7039. Archival Storage: fix Balancer tests. Contributed by Tsz Wo Nicholas Sze.
2014-09-11 14:19:18 -07:00
Jing Zhao
8de20a1987
Merge trunk into HDFS-6584
2014-09-11 13:04:35 -07:00
Jing Zhao
0d85f7e591
HDFS-7034. Archival Storage: Fix TestBlockPlacement and TestStorageMover. Contributed by Jing Zhao.
2014-09-11 13:00:43 -07:00
cnauroth
80ac6aabce
HDFS-7042. Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Contributed by Chris Nauroth.
2014-09-11 12:16:19 -07:00
Andrew Wang
1e684995d7
HDFS-7045. Fix NameNode deadlock when opening file under /.reserved path. Contributed by Yi Liu.
2014-09-11 10:59:09 -07:00
Andrew Wang
d1dab6cc63
HDFS-6621. Hadoop Balancer prematurely exits iterations. Contributed by Rafal Wodjdyla and Benjamin Bowman.
2014-09-11 10:32:20 -07:00
Andrew Wang
bf64fce78c
HDFS-6966. Add additional unit tests for encryption zones. Contributed by Stephen Chu.
2014-09-11 10:26:13 -07:00
Tsz-Wo Nicholas Sze
70dfe9cfab
Merge branch 'trunk' into HDFS-6584
2014-09-11 15:23:38 +08:00
Jing Zhao
db41a1b7b9
Merge changes from trunk
2014-09-09 22:47:50 -07:00
Alejandro Abdelnur
bbff44cb03
HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu)
2014-09-09 22:16:42 -07:00
Tsz-Wo Nicholas Sze
4124905aa5
HDFS-7028: FSDirectory should not get storage policy id from symlinks
2014-09-10 12:34:15 +08:00
arp
0de563a18e
HDFS-6482. Fix CHANGES.txt in trunk.
2014-09-09 18:09:10 -07:00
arp
0d2f6b4600
Merge branch 'trunk' into HDFS-6581
2014-09-09 18:07:18 -07:00
Konstantin V Shvachko
05af0ff4be
Revert HDFS-6940.
2014-09-09 17:30:10 -07:00
arp
be30c86cc9
HDFS-6482. Fix CHANGES.txt in trunk
2014-09-09 13:32:08 -07:00
cnauroth
2749fc677c
Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang.
2014-09-09 11:32:54 -07:00
arp
61ccd50362
Merge branch 'trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
2014-09-08 22:44:04 -07:00
arp
90c8ece188
HDFS-6981. Fix CHANGES.txt
2014-09-08 21:41:56 -07:00
arp
f949f6b548
HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal)
2014-09-08 21:20:55 -07:00
Andrew Wang
7498dd790e
Update CHANGES.txt for HDFS-6951
2014-09-08 17:01:25 -07:00
Andrew Wang
04915a0814
HDFS-6951. Correctly persist raw namespace xattrs to edit log and fsimage. Contributed by Charles Lamb.
2014-09-08 16:59:30 -07:00
Jing Zhao
6997c1c658
Merge remote-tracking branch 'origin/trunk' into HDFS-6584
2014-09-08 15:15:34 -07:00
arp
4ff128af12
Merge branch 'trunk' into HDFS-6581
2014-09-08 15:00:01 -07:00
Jing Zhao
867f0f141c
HDFS-7029. Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem. Contributed by Tsz Wo Nicholas Sze.
2014-09-08 14:57:27 -07:00
arp
a18caf7753
HDFS-6991. Notify NN of evicted block before deleting it from RAM disk. (Arpit Agarwal)
2014-09-08 14:29:30 -07:00
Jing Zhao
74a7e227c8
HDFS-7027. Archival Storage: Mover does not terminate when some storage type is out of space. Contributed by Tsz Wo Nicholas Sze.
2014-09-08 14:21:26 -07:00
Jing Zhao
2b5c528a73
HDFS-6875. Archival Storage: support migration for a list of specified paths. Contributed by Jing Zhao.
2014-09-08 14:10:00 -07:00
Allen Wittenauer
d989ac0444
MAPREDUCE-5972. Fix typo 'programatically' in job.xml (and a few other places) (Akira AJISAKA via aw)
2014-09-08 13:15:46 -07:00
Allen Wittenauer
6c790a7ab0
HDFS-6893. crypto subcommand is not sorted properly in hdfs\'s hadoop_usage (David Luo via aw)
2014-09-08 13:10:53 -07:00
Colin Patrick Mccabe
cad14aa916
HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe)
2014-09-08 12:51:56 -07:00
Kihwal Lee
6a84f88c11
HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp.
2014-09-08 14:41:44 -05:00
Haohui Mai
c1f8323234
HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma.
2014-09-08 11:07:23 -07:00
arp
ccdf0054a3
HDFS-6977. Delete all copies when a block is deleted from the block space. (Arpit Agarwal)
2014-09-08 10:35:54 -07:00
Tsz-Wo Nicholas Sze
f1432e2424
Merge branch 'trunk' into HDFS-6584
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
2014-09-08 10:54:48 +08:00
arp
eb8284d50e
Merge trunk into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java
2014-09-07 14:46:46 -07:00
cnauroth
a23144fd8a
HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao.
2014-09-07 08:39:20 -07:00
arp
d1fa58292e
HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal)
2014-09-06 21:04:29 -07:00
Tsz-Wo Nicholas Sze
22a41dce4a
HDFS-6997: add more tests for data migration and replicaion.
2014-09-07 07:44:28 +08:00
arp
31bbeaf383
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
2014-09-06 12:28:22 -07:00
Konstantin V Shvachko
88209ce181
HDFS-6940. Refactoring to allow ConsensusNode implementation.
...
Contributed by Konstantin Shvachko.
2014-09-06 12:07:52 -07:00
Alejandro Abdelnur
3b35f81603
HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu)
2014-09-05 22:33:48 -07:00
arp
339d21f273
Merge trunk into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
2014-09-05 21:36:25 -07:00
arp
21c0cdeec1
HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt
2014-09-05 14:29:57 -07:00
Allen Wittenauer
a149afd9e6
HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)
2014-09-05 13:50:42 -07:00
arp
fc68337049
HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao)
2014-09-05 13:50:42 -07:00
arp
c5ef9c9e69
HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
2014-09-05 13:50:42 -07:00
cnauroth
c828b8aa91
HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
2014-09-05 13:50:42 -07:00
cnauroth
2cd5b4f20d
HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
2014-09-05 13:50:42 -07:00
Jing Zhao
54767d3ff4
Fix TestOfflineEditsViewer after merging.
2014-09-05 12:05:22 -07:00
Jing Zhao
300cb12bef
Merge trunk into HDFS-6584
2014-09-05 11:37:22 -07:00
Allen Wittenauer
7a62515c86
HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)
2014-09-05 11:31:49 -07:00
arp
71269f7097
HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao)
2014-09-05 11:14:10 -07:00
arp
9609b7303a
HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
2014-09-05 11:10:58 -07:00
cnauroth
b051327ab6
HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
2014-09-05 11:07:41 -07:00
cnauroth
fab9bc58ec
HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
2014-09-05 11:03:58 -07:00
arp
9e941d9f99
HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao)
2014-09-05 10:45:54 -07:00
Jing Zhao
c6107f566f
HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai.
2014-09-05 10:40:02 -07:00
Vinayakumar B
772d1fb01e
HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb)
2014-09-05 10:25:09 +05:30
Jing Zhao
185200e709
HDFS-6876. Archival Storage: support set/get storage policy in DFSAdmin. Contributed by Jing Zhao.
2014-09-04 20:14:46 -07:00
Jing Zhao
6104520369
HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu.
2014-09-04 18:54:38 -07:00
Jing Zhao
f7df24bb1b
HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao.
2014-09-04 16:12:44 -07:00
Jing Zhao
e08701ec71
HDFS-6961. Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round.
2014-09-04 14:19:32 -07:00
Alejandro Abdelnur
1a09536141
Fixing HDFS CHANGES.txt, missing HDFS-6905 entry
2014-09-04 11:07:08 -07:00
Colin Patrick Mccabe
f4caedfcbf
HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang
2014-09-03 19:30:30 -07:00
arp
3a0142bd77
HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao)
2014-09-03 17:17:06 -07:00
Jing Zhao
45d5b13256
Merge changes from trunk
2014-09-03 15:36:47 -07:00
arp
cb9b485075
HDFS-6930. Improve replica eviction from RAM disk. (Arpit Agarwal)
2014-09-03 13:53:01 -07:00
arp
08a8f2be81
Merge trunk into HDFS-6581
2014-09-03 10:53:37 -07:00
arp
762b04e994
HDFS-6950. Add Additional unit tests for HDFS-6581. (Contributed by Xiaoyu Yao)
2014-09-03 10:51:26 -07:00
Karthik Kambatla
ce0462129f
HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha)
2014-09-03 09:39:02 -07:00
Uma Maheswara Rao G
3425ae5d7e
HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh)
2014-09-03 18:53:51 +05:30
arp
a6b32a3e78
Merge trunk into HDFS-6581
2014-09-02 16:25:32 -07:00
Haohui Mai
08a9ac7098
HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang.
2014-09-02 16:22:18 -07:00
Colin Patrick Mccabe
727331becc
HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo.
2014-09-02 15:14:33 -07:00
Andrew Wang
a0ccf83dfd
HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb.
2014-09-02 14:22:20 -07:00
Andrew Wang
faa4455be5
HDFS-6634. inotify in HDFS. Contributed by James Thomas.
2014-09-02 14:02:29 -07:00
Jing Zhao
3e2a0b5446
HDFS-6969. Archival Storage: INode#getStoragePolicyID should always return the latest storage policy. Contributed by Jing Zhao.
2014-09-01 17:56:04 -07:00
arp
217dea7794
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
2014-09-01 11:52:59 -07:00
Andrew Wang
6066b1a455
HDFS-6972. TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctly. Contributed by Yongjun Zhang.
2014-08-29 15:47:01 -07:00
arp
f65183eba3
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2014-08-29 13:37:17 -07:00
Aaron T. Myers
7eab2a29a5
HDFS-6774. Make FsDataset and DataStore support removing volumes. Contributed by Lei Xu.
2014-08-29 13:00:17 -07:00
arp
4ae8178c56
HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas)
2014-08-29 00:26:13 -07:00
arp
c92837aeab
HDFS-6931. Move lazily persisted replicas to finalized directory on DN startup. (Arpit Agarwal)
2014-08-28 23:13:46 -07:00
arp
4cf9afacbe
HDFS-6960. Bugfix in LazyWriter, fix test case and some refactoring. (Arpit Agarwal)
2014-08-28 23:05:32 -07:00
arp
7e32be8768
Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2014-08-28 19:06:46 -07:00
Alejandro Abdelnur
2ca93d1fbf
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-mapreduce-project/CHANGES.txt
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-08-28 19:05:57 -07:00
Allen Wittenauer
d8774cc577
HADOOP-11013. CLASSPATH handling should be consolidated, debuggable (aw)
2014-08-28 18:09:25 -07:00
Todd Lipcon
ab638e77b8
HDFS-6865. Byte array native checksumming on client side. Contributed by James Thomas.
2014-08-28 16:44:09 -07:00
arp
bbaa7dc28d
HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal)
2014-08-28 15:53:12 -07:00
Alejandro Abdelnur
d9a7404c38
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
...
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-mapreduce-project/CHANGES.txt
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-08-28 15:10:59 -07:00
arp
2e987148e0
HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
arp
3f64c4aaf0
HDFS-6927. Initial unit tests for Lazy Persist files. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
arp
eb448e1439
HDFS-6926. DN support for saving replicas to persistent storage and evicting in-memory replicas. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
arp
a317bd7b02
HDFS-6925. DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received. (Arpit Agarwal)
2014-08-27 21:47:19 -07:00
arp
c2354a7f81
HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
arp
042b33f20b
HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and edit logs. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
arp
7f49537ba1
HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
arp
a7bcc95358
HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal)
2014-08-27 21:47:18 -07:00
Colin Patrick Mccabe
7a16731191
HADOOP-10957. The globber will sometimes erroneously return a permission denied exception when there is a non-terminal wildcard.
2014-08-27 19:47:10 -07:00
Jing Zhao
a26aa6bd07
HDFS-6944. Archival Storage: add retry and termination logic for Mover. Contributed by Jing Zhao.
2014-08-27 14:20:54 -07:00
Colin Patrick Mccabe
37549576e7
Add HDFS-6879 to CHANGES.txt
2014-08-27 14:18:18 -07:00
Colin Patrick Mccabe
6962510f72
HDFS-6879. Adding tracing to Hadoop RPC. Contributed by Masatake Iwasaki.
2014-08-27 14:12:05 -07:00
Jing Zhao
b7ded466b0
HDFS-6920. Archival Storage: check the storage type of delNodeHintStorage when deleting a replica. Contributed by Tsz Wo Nicholas Sze.
2014-08-27 14:08:02 -07:00
Colin Patrick Mccabe
b6b95ff667
HDFS-6902. FileWriter should be closed in finally block in BlockReceiver#receiveBlock() (Tsuyoshi OZAWA via Colin Patrick McCabe)
2014-08-27 13:49:31 -07:00
Colin Patrick Mccabe
225569ece2
HDFS-4486. Add log category for long-running DFSClient notices. Contributed by Zhe Zhang.
2014-08-27 13:39:40 -07:00
Colin Patrick Mccabe
d805cc27a9
HDFS-6773. MiniDFSCluster should skip edit log fsync by default. Contributed by Stephen Chu.
2014-08-27 13:33:02 -07:00
Haohui Mai
26ebdd849b
HDFS-6938. Cleanup javac warnings in FSNamesystem. Contributed by Charles Lamb.
2014-08-27 11:14:39 -07:00
brandonli
cd9182d8b5
HDFS-6892. Add XDR packaging method for each NFS request. Contributed by Brandon Li
2014-08-27 11:06:01 -07:00
Jing Zhao
8ea20b53a8
HDFS-6911. Archival Storage: check if a block is already scheduled in Mover. Contributed by Tsz Wo Nicholas Sze.
2014-08-27 10:38:10 -07:00
Jing Zhao
555900a9dc
Merge branch 'trunk' into HDFS-6584
2014-08-27 10:32:30 -07:00
Jing Zhao
6b441d227a
HDFS-6908. Incorrect snapshot directory diff generated by snapshot deletion. Contributed by Juan Yu and Jing Zhao.
2014-08-27 10:26:22 -07:00
arp
c5d9a4a91e
HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms - debugging patch (Contributed by Yongjun Zhang)
2014-08-27 09:52:33 -07:00
Allen Wittenauer
9ec4a930f5
HADOOP-10996. Stop violence in the *_HOME (aw)
2014-08-27 07:00:31 -07:00
Karthik Kambatla
dc154ab86d
Add a section for 2.5.1 in CHANGES.txt
2014-08-27 00:55:19 -07:00
Arpit Agarwal
e871955765
HDFS-6899. Allow changing MiniDFSCluster volumes per DN and capacity per volume. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619970 13f79535-47bb-0310-9956-ffa450edef68
2014-08-23 06:01:17 +00:00
Chris Nauroth
a83d055f25
HDFS-4852. libhdfs documentation is out of date. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619967 13f79535-47bb-0310-9956-ffa450edef68
2014-08-23 05:30:21 +00:00
Arpit Agarwal
e6c3650070
HDFS-6829. DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster. (Contributed by zhaoyunjiong)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619882 13f79535-47bb-0310-9956-ffa450edef68
2014-08-22 18:14:55 +00:00
Alejandro Abdelnur
3aa3b0abc2
HDF-6905. fs-encryption merge triggered release audit failures. (clamb via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619667 13f79535-47bb-0310-9956-ffa450edef68
2014-08-22 05:17:22 +00:00
Jing Zhao
e69954d22c
HDFS-6906. Archival Storage: Add more tests for BlockStoragePolicy. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619628 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 23:42:33 +00:00
Jing Zhao
603cbe5eea
HDFS-6863. Archival Storage: Support migration for snapshot paths. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619627 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 23:41:10 +00:00
Brandon Li
7b28f363b1
HDFS-6890. NFS readdirplus doesn't return dotdot attributes. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619500 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 17:53:54 +00:00
Tsz-wo Sze
c92d869d02
Merge r1609845 through r1619277 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619293 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 05:22:10 +00:00
Arpit Agarwal
6824abc19e
HDFS-6758. Block writer should pass the expected block size to DataXceiverServer (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619275 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 01:13:49 +00:00
Arpit Agarwal
8f00897a4b
HDFS-6878. Change MiniDFSCluster to support StorageType configuration for individual directories. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619271 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 00:42:27 +00:00
Chris Nauroth
8304001861
HDFS-6858. Allow dfs.data.transfer.saslproperties.resolver.class default to hadoop.security.saslproperties.resolver.class. Contributed by Benoy Antony.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619256 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 22:46:35 +00:00
Karthik Kambatla
9b8250c742
Set the release date for 2.5.0 in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619237 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 21:33:19 +00:00
Andrew Wang
b0f0ef17f0
Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619203 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:56:56 +00:00
Andrew Wang
834fccf02b
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619194 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:19:13 +00:00
Jing Zhao
f20d363126
HDFS-6870. Blocks and INodes could leak for Rename with overwrite flag. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619192 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:13:03 +00:00
Andrew Wang
d2a39b61aa
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619018 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 01:22:42 +00:00
Brandon Li
fbc1ee4d6f
HDFS-6868. portmap and nfs3 are documented as hadoop commands instead of hdfs. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619001 13f79535-47bb-0310-9956-ffa450edef68
2014-08-19 22:31:57 +00:00
Allen Wittenauer
31467453ec
HADOOP-9902. Shell script rewrite (aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618847 13f79535-47bb-0310-9956-ffa450edef68
2014-08-19 12:11:17 +00:00
Tsz-wo Sze
4e324bcd3d
Merge r1609845 through r1618763 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618764 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 23:41:53 +00:00
Brandon Li
2fb04d2a30
HDFS-6569. OOB message can't be sent to the client when DataNode shuts down for upgrade. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618742 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 21:23:08 +00:00
Arpit Agarwal
1b5139b29a
HDFS-6188. An ip whitelist based implementation of TrustedChannelResolver. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618727 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 20:50:06 +00:00
Andrew Wang
0cc08f6da4
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618700 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 18:41:31 +00:00
Andrew Wang
bd616552cc
HDFS-6825. Edit log corruption due to delayed block removal. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618684 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 18:08:42 +00:00
Jing Zhao
5d5aae0694
HDFS-6801. Archival Storage: Add a new data migration tool. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618675 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 17:51:18 +00:00
Arpit Agarwal
1c77c80410
HDFS-6783. Addendum patch to fix test failures. (Contributed by Yi Liu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618635 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 15:34:58 +00:00
Tsz-wo Sze
cb75b6b07d
Merge r1609845 through r1618416 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618417 13f79535-47bb-0310-9956-ffa450edef68
2014-08-16 21:02:21 +00:00
Tsz-wo Sze
9b250d74f0
HDFS-6847. Support storage policy on directories and include storage policy in HdfsFileStatus. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618416 13f79535-47bb-0310-9956-ffa450edef68
2014-08-16 20:58:20 +00:00
Allen Wittenauer
31e478905a
Wrong categorization for a variety of commits in the CHANGES.txt files
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618233 13f79535-47bb-0310-9956-ffa450edef68
2014-08-15 16:47:34 +00:00
Aaron Myers
894b4e427f
HDFS-6850. Move NFS out of order write unit tests into TestWrites class. Contributed by Zhe Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618091 13f79535-47bb-0310-9956-ffa450edef68
2014-08-15 02:33:24 +00:00
Charles Lamb
20dcb841ce
HDFS-6546. Add non-superuser capability to get the encryption zone for a specific path. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618022 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 19:11:06 +00:00
Uma Maheswara Rao G
13ad623b9d
Updated contributors name in CHANGES.txt for HDFS-6783
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617880 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 04:57:47 +00:00
Uma Maheswara Rao G
44864c68b5
HDFS-6783. Fix HDFS CacheReplicationMonitor rescan logic. Contributed by Yi Liu and Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617872 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 04:20:00 +00:00
Alejandro Abdelnur
065d9ec5d9
HDFS-6849. Replace HttpFS custom proxyuser handling with common implementation. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617831 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 20:27:50 +00:00
Vinayakumar B
195961a7c1
HDFS-6247. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617799 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:43:05 +00:00
Vinayakumar B
6554994fab
Reverted
...
Merged revision(s) 1617784 from hadoop/common/trunk:
HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
........
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617794 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:36:51 +00:00
Vinayakumar B
471b1368e2
HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617784 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 18:06:33 +00:00
Haohui Mai
03d8ff496a
HDFS-6567. Normalize the order of public final in HdfsFileStatus. Contributed by Tassapol Athiapinya.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617779 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 17:45:47 +00:00
Allen Wittenauer
a34dafe325
HADOOP-8944. Shell command fs -count should include human readable option (Jonathan Allen via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617775 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 17:30:26 +00:00
Arpit Agarwal
a72fba5853
HDFS-6836. HDFS INFO logging is verbose & uses file appenders. (Contributed by Xiaoyu Yao)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617603 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 21:49:48 +00:00
Arpit Agarwal
662c5bb3af
HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617598 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 21:42:21 +00:00
Jing Zhao
37207b75d4
HDFS-6835. Archival Storage: Add a new API to set storage policy. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617568 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 19:32:09 +00:00
Charles Lamb
74f7be0887
merge from trunk r1617527
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1617532 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 17:02:07 +00:00
Charles Lamb
acc3d73a45
HDFS-6839. Fix TestCLI to expect new output. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1617526 13f79535-47bb-0310-9956-ffa450edef68
2014-08-12 16:50:18 +00:00
Jing Zhao
04884cd530
Merging r1616894 through r1617376 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617377 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 22:27:50 +00:00
Brandon Li
b760f20af1
HDFS-6582. Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler). Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617366 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 21:34:02 +00:00
Haohui Mai
80691b073f
HDFS-6838. Code cleanup for unnecessary INode replacement. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617361 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 21:28:33 +00:00
Jing Zhao
e60673697d
HDFS-6837. Code cleanup for Balancer and Dispatcher. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617337 13f79535-47bb-0310-9956-ffa450edef68
2014-08-11 18:01:14 +00:00
Jing Zhao
9d5f8fa68d
Merging r1616428 through r1616893 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616897 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 22:21:35 +00:00
Jing Zhao
c3cf331dc9
HDFS-6828. Separate block replica dispatching from Balancer. Contributed by Tsz Wo Nicholas Sze.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616889 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:33:57 +00:00
Arpit Agarwal
05d1bf4157
HDFS-6830. Revert accidental checkin
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616884 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:22:48 +00:00
Arpit Agarwal
a70c9de3f1
HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616883 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 21:20:19 +00:00
Ravi Prakash
a42231d19b
HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616846 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 18:24:10 +00:00
Ravi Prakash
6da830cfdf
HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616845 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 18:21:18 +00:00
Charles Lamb
e6bdb33784
HADOOP-10919. Copy command should preserve raw.* namespace extended attributes. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616840 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 17:58:01 +00:00
Chris Nauroth
70d453602c
HDFS-573. Porting libhdfs to Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616814 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 16:26:45 +00:00
Uma Maheswara Rao G
1fa2d6c4ba
HDFS-6834. Improve the configuration guidance in DFSClient when there are no Codec classes found in configs. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616721 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 11:35:16 +00:00
Arpit Agarwal
d3a2fe2807
HDFS-6772. Get DN storages out of blockContentsStale state faster after NN restarts. (Contributed by Ming Ma)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616680 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 05:41:38 +00:00
Haohui Mai
2ac640ec75
HDFS-6722. Display readable last contact time for dead nodes on NN webUI. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616669 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 04:27:47 +00:00
Aaron Myers
d758be1f35
HDFS-6740. Make FSDataset support adding data volumes dynamically. Contributed by Lei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616623 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 22:59:59 +00:00
Aaron Myers
eca80dca3e
HDFS-6728. Dynamically add new volumes to DataStorage, formatted if necessary. Contributed by Lei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616615 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 22:46:51 +00:00
Andrew Wang
311d2f0773
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616589 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 20:26:52 +00:00
Arpit Agarwal
b98400df7b
HDFS-6781. Separate HDFS commands from CommandsManual.apt.vm. (Contributed by Akira Ajisaka)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616575 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 19:42:09 +00:00
Tsz-wo Sze
b50cb5e056
Merge r1609845 through r1616427 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616428 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:38:23 +00:00
Tsz-wo Sze
0ed8732fee
HDFS-6812. Remove addBlock and replaceBlock from DatanodeDescriptor.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616426 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:30:53 +00:00
Tsz-wo Sze
83b9933db3
HDFS-6809. Move Balancer's inner classes MovedBlocks and Matcher as to standalone classes and separates KeyManager from NameNodeConnector.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616422 13f79535-47bb-0310-9956-ffa450edef68
2014-08-07 07:18:48 +00:00
Jing Zhao
efc73a0f13
HDFS-6791. A block could remain under replicated if all of its replicas are on decommissioned nodes. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616306 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 19:03:07 +00:00
Allen Wittenauer
6fa66f2357
HDFS-6517. Remove hadoop-metrics2.properties from hdfs project (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616262 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 16:07:52 +00:00
Allen Wittenauer
d7a57c27c6
HDFS-6517. Remove hadoop-metrics2.properties from hdfs project (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616261 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 16:06:13 +00:00
Yi Liu
2b5e044424
HDFS-6817. Fix findbugs and other warnings. (yliu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616092 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 04:43:58 +00:00
Brandon Li
812ac91add
HDFS-6790. DFSUtil Should Use configuration.getPassword for SSL passwords. Contributed by Larry McCay
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616058 13f79535-47bb-0310-9956-ffa450edef68
2014-08-06 00:50:07 +00:00
Karthik Kambatla
4869fa2cfa
Edit CHANGES.txt files to move HADOOP-10759 and HDFS-6717 from 2.5.0 to 2.6.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616036 13f79535-47bb-0310-9956-ffa450edef68
2014-08-05 22:47:46 +00:00
Andrew Wang
ac47ad11de
HDFS-6394. HDFS encryption documentation. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616016 13f79535-47bb-0310-9956-ffa450edef68
2014-08-05 21:49:31 +00:00
Andrew Wang
ac73d416f3
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615844 13f79535-47bb-0310-9956-ffa450edef68
2014-08-05 02:30:54 +00:00
Brandon Li
e2cb6e3c70
commit the additional doc change for HDFS-6717
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615801 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 21:30:42 +00:00
Brandon Li
c9aa747437
HDFS-6451. NFS should not return NFS3ERR_IO for AccessControlException. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615702 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 17:40:02 +00:00
Uma Maheswara Rao G
431857d09d
HDFS-6787. Remove duplicate code in FSDirectory#unprotectedConcat. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615622 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 15:44:44 +00:00
Uma Maheswara Rao G
6e421f78b3
HDFS-6814. Mistakenly dfs.namenode.list.encryption.zones.num.responses configured as boolean. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615525 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 10:04:33 +00:00
Uma Maheswara Rao G
10db613389
HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not loaded. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615523 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 09:56:57 +00:00
Vinayakumar B
33518e5613
HDFS-5185. DN fails to startup if one of the data dir is full. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615504 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 08:43:51 +00:00
Vinayakumar B
30a9ec26f7
HDFS-5723. Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615491 13f79535-47bb-0310-9956-ffa450edef68
2014-08-04 06:44:06 +00:00
Arpit Agarwal
bcf7ab1d0f
HDFS-6810. StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports. (Contributed by szetszwo)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615381 13f79535-47bb-0310-9956-ffa450edef68
2014-08-03 02:08:32 +00:00
Colin McCabe
1ba3f89714
HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 20:41:05 +00:00
Andrew Wang
07860b1c9e
HDFS-6788. Improve synchronization in BPOfferService with read write lock. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615190 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 18:56:06 +00:00
Andrew Wang
70c99278a9
HDFS-6780. Batch the encryption zones listing API. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615189 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 18:47:01 +00:00
Charles Lamb
3d9e39e51f
HDFS-6807. Fix TestReservedRawPaths. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615188 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 18:36:32 +00:00
Andrew Wang
da2ce46fbe
HDFS-6802. Some tests in TestDFSClientFailover are missing @Test annotation. Contributed by Akira Ajisaka.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615183 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 17:58:14 +00:00
Arpit Agarwal
45db4d204b
HDFS-6794. Update BlockManager methods to use DatanodeStorageInfo where possible. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615169 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 16:58:06 +00:00
Tsz-wo Sze
7e12b1912f
HDFS-6796. Improve the argument check during balancer command line parsing. Contributed by Benoy Antony
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615107 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 14:12:35 +00:00
Arpit Agarwal
397c882362
HDFS-6798. Add test case for incorrect data node condition during balancing. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615044 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 07:12:39 +00:00
Tsz-wo Sze
dc7744d2e5
Merge r1609845 through r1615019 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1615020 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:29:49 +00:00
Arpit Agarwal
8bca3c689a
HDFS-3482. Update CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615019 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:16:06 +00:00
Arpit Agarwal
b5b862e3af
HDFS-6797. DataNode logs wrong layoutversion during upgrade. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615017 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:13:42 +00:00
Tsz-wo Sze
b8597e6a10
HDFS-6685. Balancer should preserve storage type of replicas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615015 13f79535-47bb-0310-9956-ffa450edef68
2014-08-01 01:05:33 +00:00
Andrew Wang
beebb36595
Fix some merge errors that slipped through.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615013 13f79535-47bb-0310-9956-ffa450edef68
2014-07-31 22:45:08 +00:00
Arpit Agarwal
b8b8f3f5e7
HDFS-6441. Add ability to exclude/include specific datanodes while balancing. (Contributed by Benoy Antony and Yu Li)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614812 13f79535-47bb-0310-9956-ffa450edef68
2014-07-31 06:02:46 +00:00
Charles Lamb
ab47b666d0
HDFS-6785. Should not be able to create encryption zone using path to a non-directory file. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614755 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 20:00:24 +00:00
Andrew Wang
7405953692
HDFS-6692. Add more HDFS encryption tests. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614735 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 18:39:48 +00:00
Arpit Agarwal
18360e71f1
HDFS-6768. Fix a few unit tests that use hard-coded port numbers. (Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 18:37:41 +00:00
Chris Nauroth
535fe14ded
HDFS-6570. add api that enables checking if a user has certain permissions on a file. Contributed by Jitendra Pandey.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614723 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 17:49:09 +00:00
Steve Loughran
f6436c0720
HDFS-4629. Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614663 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 14:05:59 +00:00
Andrew Wang
c3fa0b5884
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614553 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 06:09:33 +00:00
Andrew Wang
09e7ff05df
HDFS-6778. The extended attributes javadoc should simply refer to the user docs. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614547 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 05:57:55 +00:00
Andrew Wang
12241908ad
HDFS-6665. Add tests for XAttrs in combination with viewfs. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614545 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 05:53:20 +00:00
Charles Lamb
9ca2f34c8f
HDFS-6730. Create a .RAW extended attribute namespace. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614535 13f79535-47bb-0310-9956-ffa450edef68
2014-07-30 01:35:04 +00:00
Andrew Wang
415223548d
HDFS-6771. Require specification of an encryption key when creating an encryption zone. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614519 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 23:39:38 +00:00
Andrew Wang
3a90228c30
HDFS-6509 addendum, extra file
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614491 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 21:11:52 +00:00
Andrew Wang
407bb3d3e4
HDFS-6509. Create a special /.reserved/raw directory for raw access to encrypted data. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614490 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 21:11:26 +00:00
Tsz-wo Sze
10d6210322
Merge r1609845 through r1614231 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1614234 13f79535-47bb-0310-9956-ffa450edef68
2014-07-29 00:49:14 +00:00
Tsz-wo Sze
4f9ffc7455
HDFS-6739. Add getDatanodeStorageReport to ClientProtocol.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614215 13f79535-47bb-0310-9956-ffa450edef68
2014-07-28 23:43:39 +00:00
Brandon Li
f49c2a1b62
HDFS-6717. JIRA HDFS-5804 breaks default nfs-gateway behavior for unsecured config. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614125 13f79535-47bb-0310-9956-ffa450edef68
2014-07-28 18:53:47 +00:00
Charles Lamb
1d3e9ec935
merge from trunk r1613787
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613788 13f79535-47bb-0310-9956-ffa450edef68
2014-07-27 13:32:51 +00:00
Chris Nauroth
9bce3eca42
HDFS-6749. FSNamesystem methods should call resolvePath. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613561 13f79535-47bb-0310-9956-ffa450edef68
2014-07-26 04:18:28 +00:00
Colin McCabe
e85a3fecc6
HDFS-6750. The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613537 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 23:56:47 +00:00
Colin McCabe
57d8f829d9
HDFS-6755. There is an unnecessary sleep in the code path where DFSOutputStream#close gives up its attempt to contact the namenode (mitdesai21 via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 22:12:37 +00:00
Andrew Wang
79d214121b
Fix up HDFS CHANGES.txt for 2.5.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613494 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 19:02:19 +00:00
Andrew Wang
b9e4be4523
HDFS-6724. Decrypt EDEK before creating CryptoInputStream/CryptoOutputStream. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613490 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 18:33:10 +00:00
Vinayakumar B
cc0464f4fe
HDFS-6752. Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613486 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 18:17:50 +00:00
Vinayakumar B
2bb650146d
HDFS-5919. FileJournalManager doesn't purge empty and corrupt inprogress edits files (vinayakumarb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613355 13f79535-47bb-0310-9956-ffa450edef68
2014-07-25 07:02:53 +00:00
Andrew Wang
e670641bbf
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613334 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 23:55:15 +00:00
Andrew Wang
e171254d56
Name node cannot start if the path of a file under construction contains .snapshot. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613329 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 23:42:06 +00:00
Jing Zhao
8c6e172a0a
HDFS-6715. Webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613237 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 18:28:00 +00:00
Haohui Mai
a7855e1c33
HDFS-6723. New NN webUI no longer displays decommissioned state for dead node. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613220 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 17:59:45 +00:00
Haohui Mai
ef9b6a45c4
HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI. Contributed by Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613195 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 17:28:31 +00:00
Todd Lipcon
2054453a39
HADOOP-10882. Move DirectBufferPool into common util. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613006 13f79535-47bb-0310-9956-ffa450edef68
2014-07-24 06:22:02 +00:00
Brandon Li
2a5f1029a5
HDFS-6455. NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612947 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 21:22:50 +00:00
Colin McCabe
a6b1d2a85c
HDFS-6114. Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr (vinayakumarb via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612943 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 20:59:39 +00:00
Andrew Wang
552b4fb9f9
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612928 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 19:26:29 +00:00
Uma Maheswara Rao G
5343b43fd9
HDFS-6422. getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist. (Charles Lamb via umamahesh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612922 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 19:05:11 +00:00
Tsz-wo Sze
48dc486672
Merge r1609845 through r1612880 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612883 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 17:30:06 +00:00
Tsz-wo Sze
ac5e8aed7c
HDFS-6686. Change BlockPlacementPolicy to use fallback when some storage types are unavailable.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612880 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 17:25:06 +00:00
Charles Lamb
512b756973
HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in EZManager#createEncryptionZone. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 15:23:03 +00:00
Charles Lamb
687ce1a5fc
HDFS-6733. Creating encryption zone results in NPE when KeyProvider is null. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612843 13f79535-47bb-0310-9956-ffa450edef68
2014-07-23 14:51:06 +00:00
Brandon Li
853ed29f2d
HDFS-6731. Run 'hdfs zkfc -formatZK' on a server in a non-namenode will cause a null pointer exception. Contributed by Masatake Iwasaki
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612715 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 22:29:04 +00:00
Brandon Li
c5686addb1
HDFS-6703. NFS: Files can be deleted from a read-only mount. Contributed by Srikanth Upputuri
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612702 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:53:50 +00:00
Arpit Agarwal
fee737eced
HDFS-6712. Document HDFS Multihoming Settings. (Contributed by Arpit Agarwal)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612695 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 20:28:57 +00:00
Andrew Wang
69b75fca7a
HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612632 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:57:06 +00:00
Andrew Wang
c83c5b868e
HDFS-6701. Make seed optional in NetworkTopology#sortByDistance. Contributed by Ashwin Shankar.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612625 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:47:49 +00:00
Jing Zhao
0c72ca9e7a
HDFS-6704. Fix the command to launch JournalNode in HDFS-HA document. Contributed by Akira AJISAKA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612613 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 17:10:43 +00:00
Yi Liu
b52b80d7bd
HADOOP-10853. Refactor get instance of CryptoCodec and support create via algorithm/mode/padding. (yliu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612513 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 08:38:38 +00:00
Tsz-wo Sze
ee13f8bf3e
Merge r1609845 through r1612502 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612505 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 08:23:34 +00:00
Tsz-wo Sze
25b0e8471e
HDFS-6702. Change DFSClient to pass the StorageType from the namenode to datanodes and change datanode to write block replicas using the specified storage type.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612493 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 07:41:24 +00:00
Andrew Wang
b57ec16567
HDFS-6718. Remove EncryptionZoneManager lock. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612439 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 00:55:20 +00:00
Andrew Wang
7b466b3b70
HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612438 13f79535-47bb-0310-9956-ffa450edef68
2014-07-22 00:27:51 +00:00
Tsz-wo Sze
3de6c61f86
Merge r1609845 through r1612431 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612432 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 23:37:54 +00:00
Tsz-wo Sze
44d9bb26d6
HDFS-6680. BlockPlacementPolicyDefault does not choose favored nodes correctly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612427 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 23:21:12 +00:00
Andrew Wang
cb20bb6117
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612403 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 21:44:50 +00:00
Tsz-wo Sze
ee3a32784f
Merge r1609845 through r1612268 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612270 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:48:02 +00:00
Tsz-wo Sze
0a736fbc17
HDFS-6679. Bump NameNodeLayoutVersion and update editsStored test files. Contributed by vinayakumarb
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612266 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:38:06 +00:00
Tsz-wo Sze
014be2510f
HDFS-6710. Change BlockPlacementPolicy to consider block storage policy in replica deletion.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612265 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 13:34:10 +00:00
Alejandro Abdelnur
64ed72a047
HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611780 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 19:42:01 +00:00
Tsz-wo Sze
7c18f8d55b
HDFS-6616. Add exclude-datanodes feature to WebHDFS redirection so that it will not redirect retries to the same datanode. Contributed by zhaoyunjiong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611750 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 18:20:20 +00:00
Daryn Sharp
551024915d
HDFS-6599. 2.4 addBlock is 10 to 20 times slower compared to 0.23 (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611737 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:58:07 +00:00
Tsz-wo Sze
2b07af0c59
Merge r1609845 through r1611734 from tunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611736 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:57:51 +00:00
Tsz-wo Sze
08466eaa00
HDFS-6700. BlockPlacementPolicy shoud choose storage but not datanode for deletion.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611731 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:40:03 +00:00
Colin McCabe
936895722e
fix eol style on TestBootstrapStandbyWithBKJM
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611726 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:23:05 +00:00
Chris Nauroth
5f9e52f745
HDFS-6597. Add a new option to NN upgrade to terminate the process after upgrade on NN is completed. Contributed by Danilo Vunjak.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611723 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:14:22 +00:00
Charles Lamb
962ef6939e
HDFS-6490. Fix the keyid format for generated keys in FSNamesystem.createEncryptionZone (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1611722 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 17:13:55 +00:00
Vinayakumar B
9f75b97a09
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Liang Xie and Rakesh R )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611562 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:48:52 +00:00
Vinayakumar B
8f0c341934
reverted
...
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
........
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611560 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:46:27 +00:00
Vinayakumar B
d2024f2e76
HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611556 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 08:32:40 +00:00
Vinayakumar B
2c5ceee6ab
HDFS-6655. Add 'header banner' to 'explorer.html' also in Namenode UI ( Contributed by Vinayakumar B )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611538 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 04:27:09 +00:00
Tsz-wo Sze
04fd2012fd
Merge r1609845 through r1611528 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611531 13f79535-47bb-0310-9956-ffa450edef68
2014-07-18 02:21:21 +00:00
Jing Zhao
7ba5913797
HDFS-6667. In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611508 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 23:11:27 +00:00
Vinayakumar B
ce1659f070
HDFS-6693. TestDFSAdminWithHA fails on windows ( Contributed by Vinayakumar B )
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611441 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 19:17:51 +00:00
Jing Zhao
f4151bbf4f
HDFS-6478. RemoteException can't be retried properly for non-HA scenario. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611410 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 17:37:22 +00:00
Tsz-wo Sze
38af6101d8
HDFS-6671. Change BlockPlacementPolicy to consider block storage policy in replicaiton.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611334 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 11:56:22 +00:00
Andrew Wang
ca52cb01c4
HDFS-6690. Deduplicate xattr names in memory. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611226 13f79535-47bb-0310-9956-ffa450edef68
2014-07-17 00:44:16 +00:00
Allen Wittenauer
c477a166e1
HDFS-2538. option to disable fsck dots. Contributed by Mohammad Kamrul Islam.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611220 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 23:55:32 +00:00
Andrew Wang
77f0e2cca5
HDFS-6405. Test Crypto streams in HDFS. (yliu via wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1611140 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 19:04:06 +00:00
Brandon Li
e896de98f2
HDFS-6689. NFS doesn't return correct lookup access for direcories. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611135 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 18:52:03 +00:00
Chris Nauroth
43fe48d9e2
HDFS-5624. Add HDFS tests for ACLs in combination with viewfs. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611068 13f79535-47bb-0310-9956-ffa450edef68
2014-07-16 16:27:38 +00:00
Andrew Wang
56c0bd4d37
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610853 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 21:10:24 +00:00
Andrew Wang
b066be8115
HDFS-6619. Clean up encryption-related tests. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 20:59:40 +00:00
Brandon Li
fb1f5bc618
HDFS-6456. NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610840 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 20:35:07 +00:00
Colin McCabe
7fe6ab7f91
HDFS-5809. BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610790 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 18:17:13 +00:00
Chris Nauroth
97b5fbc281
HDFS-6678. MiniDFSCluster may still be partially running after initialization fails. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610549 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 22:49:08 +00:00
Brandon Li
3d9bea277a
HDFS-6378. NFS registration should timeout instead of hanging when portmap/rpcbind is not available. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:48:44 +00:00
Tsz-wo Sze
395c763aef
Merge r1609845 through r1610532 from trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610533 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:23:20 +00:00
Tsz-wo Sze
4f1fae88f8
HDFS-6670. Add block storage policy support with default HOT, WARM and COLD policies.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610529 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:11:22 +00:00
Tsz-wo Sze
6f41baa623
HDFS-6677. Change INodeFile and FSImage to support storage policy ID.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610525 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 20:57:15 +00:00
Chris Nauroth
3b54223c0f
HDFS-2856. Fix block protocol so that Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610474 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 18:10:03 +00:00
Chris Nauroth
23e61a7a25
HDFS-3851. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609858 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:22:16 +00:00
Chris Nauroth
1c6be51e5e
HADOOP-8158. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609854 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:09:33 +00:00
Chris Nauroth
c9676bb07c
HDFS-2976. Move attribution to release 2.6.0 section in CHANGES.txt.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 21:58:16 +00:00
Andrew Wang
d79f27b429
HDFS-6474. Namenode needs to get the actual keys and iv from the KeyProvider. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609833 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 20:54:47 +00:00
Vinayakumar B
952b0fb18c
HDFS-6630. Unable to fetch the block information by Browsing the file system on Namenode UI through IE9 ( Contributed by Haohui Mai)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609629 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 05:15:18 +00:00
Chris Nauroth
81930b75bd
HDFS-5202. Support Centralized Cache Management on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609618 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 03:06:11 +00:00
Jing Zhao
b90dfe0b49
HDFS-6640. Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly in WebHdfs document (missed webhdfs/v1). Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609603 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 01:28:47 +00:00
Kihwal Lee
8f520386fb
HDFS-6647. Edit log corruption when pipeline recovery occurs for deleted file present in snapshot. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:18:22 +00:00
Chris Nauroth
cce02e3bef
HDFS-6631. TestPread#testHedgedReadLoopTooManyTimes fails intermittently. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609534 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:03:32 +00:00
Yi Liu
d90671137e
HADOOP-10803. Update OpensslCipher#getInstance to accept CipherSuite#name format. (yliu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609403 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 06:27:52 +00:00
Tsz-wo Sze
e67b80ec3a
HDFS-6643. Refactor INodeWithAdditionalFields.PermissionStatusFormat and INodeFile.HeaderFormat.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609401 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 06:16:34 +00:00
Jing Zhao
36492f084b
HDFS-6645. Add test for successive Snapshots between XAttr modifications. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609388 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 05:01:41 +00:00
Colin McCabe
d9c5f20333
HDFS-6622. Rename and AddBlock may race and produce invalid edits (kihwal via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609384 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 04:03:02 +00:00
Colin McCabe
8044a12ac0
HDFS-6618. FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map (kihwal via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609380 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 03:49:30 +00:00
Vinayakumar B
3b0db60113
HDFS-6646. [ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missed ( Contributed by Brahma Reddy Battula)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609020 13f79535-47bb-0310-9956-ffa450edef68
2014-07-09 06:05:44 +00:00
Chris Nauroth
709d5cbd71
HDFS-6627. Rename DataNode#checkWriteAccess to checkReadAccess. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608940 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 20:29:42 +00:00
Chris Nauroth
f62e93d591
HDFS-6638. Shorten test run time with a smaller retry timeout setting. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608905 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 19:16:48 +00:00
Chris Nauroth
3470dd9a2f
HDFS-6614. Addendum patch to shorten TestPread run time with smaller retry timeout setting. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608846 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 16:43:16 +00:00
Uma Maheswara Rao G
cddd6184ad
HDFS-5411. Update Bookkeeper dependency to 4.2.3. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608781 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:50:49 +00:00
Uma Maheswara Rao G
986c09f68e
HDFS-4221. Remove the format limitation point from BKJM documentation as HDFS-3810 closed. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608776 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:31:37 +00:00
Uma Maheswara Rao G
e6446b708d
HDFS-4286. Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM. Contributed by Rakesh R.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608764 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:17:54 +00:00
Andrew Wang
7aa07912dc
Move something down in CHANGES-fs-encryption.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608658 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 04:34:52 +00:00
Andrew Wang
ceed0f6c46
HDFS-6635. Refactor encryption zone functionality into new EncryptionZoneManager class. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608657 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 04:34:04 +00:00
Haohui Mai
76a621ffd2
HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 00:08:18 +00:00
Andrew Wang
dda85637df
Merge trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608603 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 20:43:56 +00:00
Chris Nauroth
93c1bc8114
HDFS-6617. Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 17:37:04 +00:00
Charles Lamb
83702b0707
HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608389 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 09:51:49 +00:00
Charles Lamb
c386652828
HDFS-6516. List of Encryption Zones should be based on inodes (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607770 13f79535-47bb-0310-9956-ffa450edef68
2014-07-04 00:24:28 +00:00
Colin McCabe
bfef9807a0
HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL (hitliuyi via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607768 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 23:40:31 +00:00
Andrew Wang
151c5deaf1
HDFS-6511. BlockManager#computeInvalidateWork() could do nothing. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607735 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:10:54 +00:00
Andrew Wang
f881f0e923
HDFS-6493. Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:02:14 +00:00
Andrew Wang
93e23a9915
HDFS-6613. Improve logging in caching classes. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607697 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 17:13:59 +00:00
Uma Maheswara Rao G
160c912ee6
HDFS-6620. Snapshot docs should specify about preserve options with cp command. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607685 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 16:08:44 +00:00
Steve Loughran
b6fbaba8e9
HADOOP-9361: Strictly define FileSystem APIs - HDFS portion
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607597 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 12:09:45 +00:00
Karthik Kambatla
54dc17ce2f
Preparing for release 2.6.0
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607538 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 05:55:05 +00:00
Charles Lamb
2a3bccddd9
HDFS-6625. Remove the Delete Encryption Zone function (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607507 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 00:58:45 +00:00
Andrew Wang
51b97a1396
HDFS-6605.Client server negotiation of cipher suite. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607499 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 23:08:29 +00:00
Andrew Wang
9b5d551ad9
HDFS-6610. TestShortCircuitLocalRead tests sometimes timeout on slow machines. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607496 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 23:02:24 +00:00
Colin McCabe
297e3c72fb
HDFS-6604. The short-circuit cache doesn't correctly time out replicas that haven't been used in a while (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607456 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 19:43:36 +00:00
Chris Nauroth
130182df1b
HDFS-6614. shorten TestPread run time with a smaller retry timeout setting. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607447 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 18:57:25 +00:00
Andrew Wang
9dfe9cf400
HDFS-6612. MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607442 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 18:37:00 +00:00
Chris Nauroth
c89bf0184d
HDFS-6603. Add XAttr with ACL test. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607239 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 03:20:25 +00:00
Chris Nauroth
0ca41a8f35
HDFS-6591. while loop is executed tens of thousands of times in Hedged Read. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606927 13f79535-47bb-0310-9956-ffa450edef68
2014-06-30 20:46:44 +00:00
Kihwal Lee
e8186a9dee
HDFS-6558. Missing newline in the description of dfsadmin -rollingUpgrade. Contributed by Chen He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606855 13f79535-47bb-0310-9956-ffa450edef68
2014-06-30 18:17:56 +00:00
Steve Loughran
2f75cd1190
HDFS-6418. Regression: DFS_NAMENODE_USER_NAME_KEY missing
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606536 13f79535-47bb-0310-9956-ffa450edef68
2014-06-29 16:27:24 +00:00
Kihwal Lee
94a1462bd5
HDFS-6601. Issues in finalizing rolling upgrade when there is a layout version change. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606371 13f79535-47bb-0310-9956-ffa450edef68
2014-06-28 15:21:46 +00:00
Uma Maheswara Rao G
78cafe34e6
HDFS-6556. Refine XAttr permissions. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606320 13f79535-47bb-0310-9956-ffa450edef68
2014-06-28 11:40:02 +00:00
Charles Lamb
31617733ac
HDFS-6389. Rename restrictions for encryption zones. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1606253 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 21:45:18 +00:00
Andrew Wang
2efea95213
HDFS-6391. Get the Key/IV from the NameNode for encrypted files in DFSClient. Contributed by Charles Lamb and Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1606220 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 20:43:41 +00:00
Aaron Myers
5f880f79d2
HADOOP-10701. NFS should not validate the access premission only based on the user's primary group. Contributed by Harsh J.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606042 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 12:00:55 +00:00
Chris Nauroth
280bdb9a16
HDFS-6572. Add an option to the NameNode that prints the software and on-disk image versions. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605928 13f79535-47bb-0310-9956-ffa450edef68
2014-06-26 23:12:45 +00:00
Chris Nauroth
c3e26735a6
HADOOP-9705. FsShell cp -p does not preserve directory attibutes. Contributed by Akira AJISAKA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605672 13f79535-47bb-0310-9956-ffa450edef68
2014-06-26 05:36:54 +00:00
Tsz-wo Sze
e3612e4428
HDFS-6595. Allow the maximum threads for balancing on datanodes to be configurable. Contributed by Benoy Antony
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605565 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 19:27:29 +00:00
Charles Lamb
2676365799
HDFS-6387. HDFS CLI admin tool for creating & deleting an encryption zone. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1605518 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 17:42:03 +00:00
Tsz-wo Sze
988bc17bc3
HADOOP-10674. Improve PureJavaCrc32 performance and use java.util.zip.CRC32 for Java 7 and above.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605239 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 02:22:15 +00:00
Aaron Myers
55a1defa50
HDFS-6475. WebHdfs clients fail without retry because incorrect handling of StandbyException. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605217 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 23:07:49 +00:00
Haohui Mai
a92318c2ef
HDFS-6587. Fix a typo in message issued from explorer.js. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605184 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 20:48:32 +00:00
Haohui Mai
bdf3de9f6b
HDFS-6593. Move SnapshotDiffInfo out of INodeDirectorySnapshottable. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605169 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 19:59:34 +00:00
Alejandro Abdelnur
46162a213f
HDFS-6430. HTTPFS - Implement XAttr support. (Yi Liu via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605118 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 15:59:50 +00:00
Uma Maheswara Rao G
ff41321e2f
HDFS-6486. Add user doc for XAttrs via WebHDFS. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605062 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 12:13:43 +00:00
Haohui Mai
08986fdbed
HDFS-6562. Refactor rename() in FSDirectory. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 06:56:27 +00:00
Arpit Agarwal
5ac06c8b38
HDFS-6578. add toString method to DatanodeStorage for easier debugging. (Contributed by Yongjun Zhang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604942 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 21:30:02 +00:00
Arpit Agarwal
9ddedbf3df
HDFS-6587. Bug in TestBPOfferService can cause test failure. (Contributed by Zhilei Xu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604899 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 18:21:00 +00:00
Haohui Mai
a90a8b26e9
HDFS-6580. FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper. Contributed bu Zhilei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604704 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 07:20:49 +00:00
Vinayakumar B
e8ca648005
HDFS-6507. Improve DFSAdmin to support HA cluster better. (Contributd by Zesheng Wu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604692 13f79535-47bb-0310-9956-ffa450edef68
2014-06-23 05:16:05 +00:00
Haohui Mai
1e89eba47d
HDFS-6583. Remove clientNode in FileUnderConstructionFeature. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604541 13f79535-47bb-0310-9956-ffa450edef68
2014-06-22 07:39:36 +00:00
Jing Zhao
8a83bb7ad6
HDFS-4667. Capture renamed files/directories in snapshot diff report. Contributed by Jing Zhao and Binglin Chang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604488 13f79535-47bb-0310-9956-ffa450edef68
2014-06-21 22:59:34 +00:00
Chris Nauroth
0c51289695
HDFS-6222. Remove background token renewer from webhdfs. Contributed by Rushabh Shah and Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604300 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 23:58:23 +00:00
Haohui Mai
9ca79e8d32
HDFS-6557. Move the reference of fsimage to FSNamesystem. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604242 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 18:54:19 +00:00
Jing Zhao
d9eb18bb2e
HDFS-6535. HDFS quota update is wrong when file is appended. Contributed by George Wong.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604226 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 18:25:09 +00:00
Aaron Myers
af6c91a80c
HDFS-6403. Add metrics for log warnings reported by JVM pauses. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604074 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 02:38:00 +00:00
Alejandro Abdelnur
46dc32e125
HDFS-6312. WebHdfs HA failover is broken on secure clusters. (daryn via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604045 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 23:06:40 +00:00
Aaron Myers
9ff3836a36
HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604022 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 19:39:29 +00:00
Kihwal Lee
0da148dae7
HDFS-3848. A Bug in recoverLeaseInternal method of FSNameSystem class. Contributed by Hooman Peiro Sajjad and Chen He.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604011 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 19:05:25 +00:00
Andrew Wang
97583dbb0a
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603993 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 18:32:13 +00:00
Andrew Wang
a3908b89f7
Move HDFS-6375 down to 2.5 section in CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603974 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 17:42:04 +00:00
Andrew Wang
d417e49ce4
HDFS-6492. Support create-time xattrs and atomically setting multiple xattrs. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603971 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 17:37:31 +00:00
Aaron Myers
3f82484218
HDFS-6563. NameNode cannot save fsimage in certain circumstances when snapshots are in use. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603712 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 05:17:58 +00:00
Haohui Mai
a4e0ff5e05
HDFS-6480. Move waitForReady() from FSDirectory to FSNamesystem. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603705 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 04:13:56 +00:00
Brandon Li
eb93f73ea8
HDFS-6553. Add missing DeprecationDeltas for NFS Kerberos configurations. Contributed by Stephen Chu
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603677 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 23:51:49 +00:00
Andrew Wang
5e5e1a6202
Merge trunk r1603663 to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603664 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 23:15:04 +00:00
Charles Lamb
6ef3a9e746
HDFS-6386. HDFS Encryption Zones (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1603658 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 22:33:50 +00:00
Arpit Agarwal
21ffcc348e
HDFS-6559. Fix wrong option "dfsadmin -rollingUpgrade start" in the document. (Contributed by Akira Ajisaka)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603638 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 21:29:39 +00:00
Brandon Li
2ecab65e3e
HDFS-6439. NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603622 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 20:45:53 +00:00
Haohui Mai
22cbcd16cb
HADOOP-10717. Revert r1603571.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603620 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 20:37:25 +00:00
Jing Zhao
4cf94aaf80
HDFS-6551. Rename with OVERWRITE option may throw NPE when the target file/directory is a reference INode. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603612 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 19:57:00 +00:00
Arpit Agarwal
52d18aa217
HDFS-6552. add DN storage to a BlockInfo will not replace the different storage from same DN. (Contributed by Amir Langer)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603602 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 19:37:18 +00:00
Tsz-wo Sze
1af69553a1
HDFS-6530. Fix Balancer documentation.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603571 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 18:44:28 +00:00
Steve Loughran
bae5837d3b
HADOOP-10717. Missing JSP support in Jetty
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603534 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 17:08:45 +00:00
Jing Zhao
8e8a769e7f
HDFS-6527. Edit log corruption due to defered INode removal. Contributed by Kihwal Lee and Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603340 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 01:00:32 +00:00
Kihwal Lee
2298f3d241
HDFS-6545. Finalizing rolling upgrade can make NN unavailable for a long duration. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603239 13f79535-47bb-0310-9956-ffa450edef68
2014-06-17 17:58:38 +00:00
Chris Nauroth
6e37dd331b
HADOOP-10557. FsShell -cp -pa option for preserving extended ACLs. Contributed by Akira Ajisaka.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603222 13f79535-47bb-0310-9956-ffa450edef68
2014-06-17 17:08:07 +00:00
Andrew Wang
f4b1c44415
HDFS-6528. Add XAttrs to TestOfflineImageViewer. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603020 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 23:07:31 +00:00
Andrew Wang
45c52ef924
HDFS-6518. TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 22:47:58 +00:00
Colin McCabe
b98da7f3b5
HDFS-6539. test_native_mini_dfs is skipped in hadoop-hdfs pom.xml (decstery via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602998 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 20:35:45 +00:00
Charles Lamb
c5b7236d9c
merge from trunk r1602933
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1602947 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 18:13:57 +00:00
Arun Murthy
26936978be
Preparing to release hadoop-2.4.1.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602886 13f79535-47bb-0310-9956-ffa450edef68
2014-06-16 15:07:00 +00:00
Uma Maheswara Rao G
2ad014a097
Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602699 13f79535-47bb-0310-9956-ffa450edef68
2014-06-15 14:54:36 +00:00
Aaron Myers
d18af7edd4
HDFS-6499. Use NativeIO#renameTo instead of File#renameTo in FileJournalManager. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602542 13f79535-47bb-0310-9956-ffa450edef68
2014-06-14 02:14:46 +00:00
Aaron Myers
3f5e04946d
HDFS-6529. Trace logging for RemoteBlockReader2 to identify remote datanode and file being read. Contributed by Anubhav Dhoot.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602538 13f79535-47bb-0310-9956-ffa450edef68
2014-06-14 00:57:52 +00:00
Andrew Wang
70db2ec417
HDFS-6470. TestBPOfferService.testBPInitErrorHandling is flaky. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602490 13f79535-47bb-0310-9956-ffa450edef68
2014-06-13 19:00:03 +00:00
Haohui Mai
02f3ff3387
HDFS-6330. Move mkdirs() to FSNamesystem. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602484 13f79535-47bb-0310-9956-ffa450edef68
2014-06-13 18:04:45 +00:00
Andrew Wang
be3fdd1c40
HADOOP-10691. Improve the readability of 'hadoop fs -help'. Contributed by Lei Xu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602329 13f79535-47bb-0310-9956-ffa450edef68
2014-06-13 06:39:57 +00:00
Andrew Wang
6aef8fec70
Fixup CHANGES.txt message for HDFS-3493
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602292 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 21:16:36 +00:00
Andrew Wang
be01103af7
HDFS-3493. Invalidate corrupted blocks as long as minimum replication is satisfied. Contributed by Juan Yu and Vinayakumar B.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602291 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 21:06:31 +00:00
Andrew Wang
befa4bb1ed
HDFS-6395. Skip checking xattr limits for non-user-visible namespaces. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602288 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 20:55:06 +00:00
Chris Nauroth
2368332138
HADOOP-10561. Copy command with preserve option should handle Xattrs. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602225 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 16:34:02 +00:00
Konstantin Boudnik
2f4f261cda
HDFS-6471. Make moveFromLocal CLI testcases to be non-disruptive (Contributed by Dasha Boudnik)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602064 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 05:48:26 +00:00
Arpit Agarwal
34e9173c00
HADOOP-10376. Refactor refresh*Protocols into a single generic refreshConfigProtocol. (Contributed by Chris Li)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602055 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 01:27:39 +00:00
Alejandro Abdelnur
8bfbec8cfb
HDFS-6379. HTTPFS - Implement ACLs support. (yoderme via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602040 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 22:35:18 +00:00
Uma Maheswara Rao G
22ec67ea6f
Moved the HDFS-2006 break down tasks list to 2.5 section in merging HDFS-2006 to branch-2
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602003 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 19:51:36 +00:00
Haohui Mai
e98529858e
HDFS-6315. Decouple recording edit logs from FSDirectory. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601960 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 17:22:44 +00:00
Haohui Mai
49fecbd402
HDFS-6503. Fix typo of DFSAdmin restoreFailedStorage. Contributed by Zesheng Wu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601958 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 17:12:46 +00:00
Arpit Agarwal
c802ca28fd
HDFS-6364. Incorrect check for unknown datanode in Balancer. (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601771 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 21:02:47 +00:00
Andrew Wang
123c563fe6
HDFS-6460. Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance. Contributed by Yongjun Zhang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601535 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 00:39:20 +00:00
Andrew Wang
a72f850e33
HDFS-6399. Add note about setfacl in HDFS permissions guide. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601476 13f79535-47bb-0310-9956-ffa450edef68
2014-06-09 18:42:17 +00:00
Colin McCabe
8b2b7ff0ae
HDFS-6257. TestCacheDirectives#testExceedsCapacity fails occasionally (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601473 13f79535-47bb-0310-9956-ffa450edef68
2014-06-09 18:39:37 +00:00
Junping Du
cc9bc8eef7
HDFS-6500. Snapshot shouldn't be removed silently after renaming to an existing snapshot. (Contributed by Nicholas SZE)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601199 13f79535-47bb-0310-9956-ffa450edef68
2014-06-08 07:06:35 +00:00
Konstantin Boudnik
fb7ea6d8bc
HDFS-6297. Add CLI testcases to reflect new features of dfs and dfsadmin (Contributed by Dasha Boudnik)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601059 13f79535-47bb-0310-9956-ffa450edef68
2014-06-07 05:22:34 +00:00
Colin McCabe
9528ed939d
HDFS-6497. Make TestAvailableSpaceVolumeChoosingPolicy deterministic (cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601035 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 23:40:39 +00:00
Andrew Wang
14394eed00
HDFS-6487. TestStandbyCheckpoint#testSBNCheckpoints is racy. Contributed by Mit Desai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601016 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 21:36:56 +00:00
Uma Maheswara Rao G
6a4f6d6b3e
HDFS-6464. Support multiple xattr.name parameters for WebHDFS getXAttrs. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600810 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 03:48:43 +00:00
Charles Lamb
a93a37a8cd
Various fixes to CHANGES-fs-encryption.txt. Various Jiras ended up in the hadoop-common CHANGES-fs-encryption.txt by accident. Moved them to HDFS CHANGES-fs-encryption.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600804 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 01:49:53 +00:00
Charles Lamb
3f892e9d53
HDFS-6473. Protocol and API for Encryption Zones (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600803 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 01:42:18 +00:00
Colin McCabe
e40524d759
HDFS-6369. Document that BlockReader#available() can return more bytes than are remaining in the block (Ted Yu via Colin Patrick McCabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600801 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 00:59:18 +00:00
Andrew Wang
1cbff8ff82
HDFS-6476. Print out the KeyProvider after finding KP successfully on startup. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600799 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 00:55:14 +00:00
Charles Lamb
bdee397e95
HADOOP-6392. Wire crypto streams for encrypted files in DFSClient. (clamb and yliu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600582 13f79535-47bb-0310-9956-ffa450edef68
2014-06-05 10:10:48 +00:00
Andrew Wang
02fcb6b6ba
HDFS-6268. Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found. (wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599734 13f79535-47bb-0310-9956-ffa450edef68
2014-06-03 18:33:09 +00:00
Jing Zhao
a29d2d3371
HDFS-6424. blockReport doesn't need to invalidate blocks on SBN. Contributed by Ming Ma.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599397 13f79535-47bb-0310-9956-ffa450edef68
2014-06-03 00:47:11 +00:00
Michael Stack
f15ff5e4f4
HDFS-6109 let sync_file_range() system call run in background (Liang Xie via stack)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599347 13f79535-47bb-0310-9956-ffa450edef68
2014-06-02 20:27:15 +00:00
Kihwal Lee
77805fb69b
Fix merge error.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598873 13f79535-47bb-0310-9956-ffa450edef68
2014-05-31 14:32:21 +00:00
Andrew Wang
880a0c673c
HDFS-6375. Listing extended attributes with the search permission. Contributed by Charles Lamb.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598788 13f79535-47bb-0310-9956-ffa450edef68
2014-05-31 00:12:02 +00:00
Andrew Wang
da5df3af0a
Move HDFS-6110 down to 2.5.0 section of CHANGES.txt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598787 13f79535-47bb-0310-9956-ffa450edef68
2014-05-31 00:07:46 +00:00
Charles Lamb
871616b993
merge from trunk r1598783
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1598785 13f79535-47bb-0310-9956-ffa450edef68
2014-05-31 00:01:20 +00:00
Charles Lamb
4054a40891
HDFS-6388. HDFS integration with KeyProvider. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1598783 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 23:53:45 +00:00
Brandon Li
42391d260d
HDFS-6056. Clean up NFS config settings. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598782 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 23:53:00 +00:00
Andrew Wang
f7f651fc56
HDFS-6472. fix typo in webapps/hdfs/explorer.js. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598746 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 20:43:58 +00:00
Alejandro Abdelnur
e4c06854b4
HDFS-6404. HttpFS should use a 000 umask for mkdir and create operations. (yoderme via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598668 13f79535-47bb-0310-9956-ffa450edef68
2014-05-30 16:49:11 +00:00
Chris Nauroth
39f3d135d0
HDFS-6463. Clarify behavior of AclStorage#createFsPermissionForExtendedAcl in comments. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598437 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 22:56:58 +00:00
Charles Lamb
333562b767
merge from trunk r1598430
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1598435 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 22:27:25 +00:00
Andrew Wang
f40a36758b
HDFS-6447. balancer should timestamp the completion message. Contributed by Juan Yu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598411 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:38:39 +00:00
Andrew Wang
5dff070e51
HDFS-6356. Fix typo in DatanodeLayoutVersion. Contributed by Tulasi G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598408 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:32:44 +00:00
Brandon Li
c55947343e
HDFS-6462. NFS: fsstat request fails with the secure hdfs. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598405 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:16:04 +00:00
Andrew Wang
1d5e564998
HDFS-6461. Use Time#monotonicNow to compute duration in DataNode#shutDown. Contributed by James Thomas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598399 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 21:01:55 +00:00
Arpit Agarwal
4a4868e523
HADOOP-10448. Support pluggable mechanism to specify proxy user settings (Contributed by Benoy Antony)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598396 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 20:52:01 +00:00
Chris Nauroth
806f4d11f2
HADOOP-10602. Documentation has broken "Go Back" hyperlinks. Contributed by Akira AJISAKA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598337 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 17:26:50 +00:00
Andrew Wang
66c5bcfc6d
HDFS-6453. Use Time#monotonicNow to avoid system clock reset. Contributed by Liang Xie.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598144 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 21:24:49 +00:00
Colin McCabe
cfd8647d0f
HDFS-6448. BlockReaderLocalLegacy should set socket timeout based on conf.socketTimeout (liangxie via cmccabe)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598079 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 17:44:14 +00:00
Arpit Agarwal
e976652a6e
HDFS-6442. Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts. (Contributed by Zesheng Wu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598078 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 17:38:25 +00:00
Brandon Li
0ec6fc9e3c
HDFS-6411. nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597895 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 22:58:55 +00:00
Brandon Li
1c867b1de8
HDFS-6416. Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs. Contributed by Abhiraj Butala
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597868 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 20:21:33 +00:00
Jing Zhao
8d9e8cec9f
HDFS-6227. ShortCircuitCache#unref should purge ShortCircuitReplicas whose streams have been closed by java interrupts. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597829 13f79535-47bb-0310-9956-ffa450edef68
2014-05-27 17:21:41 +00:00
Michael Stack
1228f8f6fb
HBASE-6110 adding more slow action log in critical write path (Liang Xie via stack)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597633 13f79535-47bb-0310-9956-ffa450edef68
2014-05-26 19:38:05 +00:00
Arpit Agarwal
978e3a6813
HDFS-6443. Fix MiniQJMHACluster related test failures. (Contributed by Zesheng Wu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597238 13f79535-47bb-0310-9956-ffa450edef68
2014-05-24 05:09:04 +00:00
Andrew Wang
1ba203e3e0
HDFS-6435. Add support for specifying a static uid/gid mapping for the NFS gateway. (atm via wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596966 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 20:44:30 +00:00
Jing Zhao
3671a5e16f
MAPREDUCE-5899. Support incremental data copy in DistCp. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596931 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 18:17:11 +00:00
Uma Maheswara Rao G
57d3daa7c9
Merge from trunk to fs-encryption branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1596873 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 13:54:53 +00:00
Jing Zhao
5b1e88b6d2
HDFS-6423. Diskspace quota usage should be updated when appending data to partial block. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596774 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 08:07:16 +00:00
Jing Zhao
752a9d84bb
HDFS-6438. DeleteSnapshot should be a DELETE request in WebHdfs. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596772 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 07:30:18 +00:00
Chris Nauroth
6b2e615f5f
HDFS-6433. Replace BytesMoved class with AtomicLong. Contributed by Benoy Antony.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596742 13f79535-47bb-0310-9956-ffa450edef68
2014-05-22 04:50:53 +00:00