hadoop

Author	SHA1	Message	Date
Andrew Wang	b0b9084433	HDFS-7530. Allow renaming of encryption zone roots. Contributed by Charles Lamb.	2014-12-18 14:06:53 -08:00
Haohui Mai	65f2a4ee60	HDFS-7543. Avoid path resolution when getting FileStatus for audit logs. Contributed by Haohui Mai.	2014-12-18 11:25:14 -08:00
Kihwal Lee	c0d666c74e	HDFS-7373. Clean up temporary files after fsimage transfer failures. Contributed by Kihwal Lee	2014-12-18 12:58:59 -06:00
Colin Patrick Mccabe	3b173d9517	HDFS-7531. Improve the concurrent access on FsVolumeList (Lei Xu via Colin P. McCabe)	2014-12-17 16:41:59 -08:00
Haohui Mai	0da1330bfd	HDFS-7528. Consolidate symlink-related implementation into a single class. Contributed by Haohui Mai.	2014-12-17 14:48:30 -08:00
Colin Patrick Mccabe	4281c96e24	HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe)	2014-12-17 10:32:40 -08:00
Haohui Mai	565d72fe6e	HDFS-7536. Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs. Contributed by Haohui Mai.	2014-12-16 13:26:37 -08:00
Colin Patrick Mccabe	a97a1e7317	HDFS-7494. Checking of closed in DFSInputStream#pread() should be protected by synchronization (Ted Yu via Colin P. McCabe)	2014-12-16 11:07:27 -08:00
Kihwal Lee	b7923a356e	HDFS-6425. Large postponedMisreplicatedBlocks has impact on blockReport latency. Contributed by Ming Ma.	2014-12-16 10:30:22 -06:00
Haohui Mai	832ebd8cb6	HDFS-7506. Consolidate implementation of setting inode attributes into a single class. Contributed by Haohui Mai.	2014-12-15 10:40:33 -08:00
Colin Patrick Mccabe	6e13fc62e1	HDFS-7513. HDFS inotify: add defaultBlockSize to CreateEvent (cmccabe)	2014-12-15 10:30:30 -08:00
Andrew Wang	fa7b9248e4	HDFS-7426. Change nntop JMX format to be a JSON blob.	2014-12-12 17:04:33 -08:00
Jing Zhao	c78e3a7cdd	HDFS-7059. Avoid resolving path multiple times. Contributed by Jing Zhao.	2014-12-12 15:13:35 -08:00
Haohui Mai	46612c7a51	HDFS-7517. Remove redundant non-null checks in FSNamesystem#getBlockLocations. Contributed by Haohui Mai.	2014-12-12 11:51:17 -08:00
Andrew Wang	b437f5eef4	HDFS-7497. Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui. Contributed by Yongjun Zhang.	2014-12-11 18:12:47 -08:00
Haohui Mai	b9f6d0c956	HDFS-7515. Fix new findbugs warnings in hadoop-hdfs. Contributed by Haohui Mai.	2014-12-11 12:36:13 -08:00
arp	390642acf3	HDFS-7503. Namenode restart after large deletions can cause slow processReport (Arpit Agarwal)	2014-12-10 23:44:28 -08:00
Haohui Mai	d693a252bd	HDFS-7463. Simplify FSNamesystem#getBlockLocationsUpdateTimes. Contributed by Haohui Mai.	2014-12-10 23:01:17 -08:00
Allen Wittenauer	c536142699	HADOOP-6590. Add a username check for hadoop sub-commands (John Smith via aw)	2014-12-10 13:41:28 -08:00
Allen Wittenauer	a7c6c710b2	HADOOP-10950. rework heap management vars (John Smith via aw)	2014-12-10 13:37:32 -08:00
Vinayakumar B	d93f3b9815	HDFS-7481. Add ACL indicator to the 'Permission Denied' exception. (Contributed by Vinayakumar B )	2014-12-10 08:27:15 +05:30
Jing Zhao	5776a41da0	HDFS-7498. Simplify the logic in INodesInPath. Contributed by Jing Zhao.	2014-12-09 11:37:39 -08:00
Colin Patrick Mccabe	d8352b9b2b	Incorrect locking in FsVolumeList#checkDirs can hang datanodes (Noah Lorang via Colin P. McCabe)	2014-12-09 10:56:46 -08:00
Haohui Mai	6c5bbd7a42	HDFS-7486. Consolidate XAttr-related implementation into a single class. Contributed by Haohui Mai.	2014-12-08 11:52:21 -08:00
cnauroth	d555bb2120	HDFS-7473. Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid. Contributed by Akira AJISAKA.	2014-12-08 11:04:29 -08:00
cnauroth	ffe942b82c	HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B.	2014-12-08 10:23:09 -08:00
cnauroth	9297f980c2	HDFS-7476. Consolidate ACL-related operations to a single class. Contributed by Haohui Mai.	2014-12-06 14:20:00 -08:00
Haohui Mai	e227fb8fbc	HDFS-7459. Consolidate cache-related implementation in FSNamesystem into a single class. Contributed by Haohui Mai.	2014-12-05 18:37:07 -08:00
Jing Zhao	475c6b4978	HDFS-7474. Avoid resolving path in FSPermissionChecker. Contributed by Jing Zhao.	2014-12-05 14:17:17 -08:00
Haohui Mai	f6452eb259	HDFS-7472. Fix typo in message of ReplicaNotFoundException. Contributed by Masatake Iwasaki.	2014-12-05 11:23:13 -08:00
Haohui Mai	6a5596e3b4	HDFS-7478. Move org.apache.hadoop.hdfs.server.namenode.NNConf to FSNamesystem. Contributed by Li Lu.	2014-12-05 10:55:13 -08:00
Haohui Mai	0653918dad	HDFS-7454. Reduce memory footprint for AclEntries in NameNode. Contributed by Vinayakumar B.	2014-12-04 20:49:45 -08:00
Haohui Mai	26d8dec756	HDFS-7468. Moving verify* functions to corresponding classes. Contributed by Li Lu.	2014-12-04 14:09:45 -08:00
stack	7caa3bc98e	HDFS-6735. A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream (Lars Hofhansl via stack)	2014-12-02 20:57:38 -08:00
Colin Patrick Mccabe	75a326aaff	HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to (cmccabe)	2014-12-02 17:15:21 -08:00
Haohui Mai	185e0c7b4c	HDFS-7462. Consolidate implementation of mkdirs() into a single class. Contributed by Haohui Mai.	2014-12-02 14:53:45 -08:00
Haohui Mai	042699401e	HDFS-7438. Consolidate the implementation of rename() into a single class. Contributed by Haohui Mai.	2014-12-01 21:48:28 -08:00
Haohui Mai	0af44ea846	HDFS-7450. Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class. Contributed by Haohui Mai.	2014-12-01 21:36:25 -08:00
Allen Wittenauer	031f980e7e	HADOOP-11081. Document hadoop properties expected to be set by the shell code in *-env.sh (aw)	2014-12-01 16:21:20 -08:00
Uma Maheswara Rao G	1556f86a31	HDFS-7210. Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient. (Vinayakumar B via umamahesh)	2014-11-28 21:09:16 +05:30
Haohui Mai	f5b1631179	HDFS-7444. convertToBlockUnderConstruction should preserve BlockCollection. Contributed by Haohui Mai.	2014-11-26 10:37:01 -08:00
Uma Maheswara Rao G	058af60c56	HDFS-7310. Mover can give first priority to local DN if it has target storage type available in local DN. (Vinayakumar B via umamahesh)	2014-11-26 23:27:25 +05:30
Haohui Mai	4a31611829	HDFS-7440. Consolidate snapshot related operations in a single class. Contributed by Haohui Mai.	2014-11-25 21:04:52 -08:00
Andrew Wang	f43a20c529	HDFS-7097. Allow block reports to be processed during checkpointing on standby name node. (kihwal via wang)	2014-11-25 15:37:11 -08:00
Haohui Mai	45fa7f0235	HDFS-7303. NN UI fails to distinguish datanodes on the same host. Contributed by Benoy Antony.	2014-11-24 17:46:35 -08:00
Haohui Mai	8caf537afa	HDFS-7436. Consolidate implementation of concat(). Contributed by Haohui Mai.	2014-11-24 15:42:38 -08:00
Haohui Mai	8e253cb930	HDFS-7412. Move RetryCache to NameNodeRpcServer. Contributed by Haohui Mai.	2014-11-24 11:11:15 -08:00
Colin Patrick Mccabe	f636f9d943	HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe)	2014-11-24 10:55:21 -08:00
Colin Patrick Mccabe	daacbc18d7	HDFS-4882. Prevent the Namenode's LeaseManager from looping forever in checkLeases (Ravi Prakash via Colin P. McCabe)	2014-11-24 10:46:33 -08:00
yliu	555fa2d9d0	HDFS-7403. Inaccurate javadoc of BlockUCState#COMPLETE state. (Yongjun Zhang via yliu)	2014-11-24 04:17:17 +08:00
Aaron T. Myers	2d4f3e567e	HDFS-7331. Add Datanode network counts to datanode jmx page. Contributed by Charles Lamb.	2014-11-21 16:36:39 -08:00
Haohui Mai	23dacb3892	HDFS-7420. Delegate permission checks to FSDirectory. Contributed by Haohui Mai.	2014-11-21 11:01:14 -08:00
Haohui Mai	c95b878abf	HDFS-7415. Move FSNameSystem.resolvePath() to FSDirectory. Contributed by Haohui Mai.	2014-11-20 19:23:23 -08:00
Andrew Wang	765aecb4e1	HDFS-7409. Allow dead nodes to finish decommissioning if all files are fully replicated.	2014-11-19 17:53:00 -08:00
Allen Wittenauer	72c141ba96	HADOOP-11208. Replace "daemon" with better name in script subcommands (aw)	2014-11-19 14:49:29 -08:00
Allen Wittenauer	73348a4afd	HDFS-7407. Minor typo in privileged pid/out/log names (aw)	2014-11-19 14:02:28 -08:00
Andrew Wang	5bd048e837	HDFS-7373. Allow decommissioning of dead DataNodes. Contributed by Zhe Zhang.	2014-11-18 22:16:58 -08:00
Andrew Wang	406c09ad11	HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang)	2014-11-18 22:14:04 -08:00
cnauroth	9e81be0114	HDFS-7398. Reset cached thread-local FSEditLogOp's on every FSEditLog#logEdit. Contributed by Gera Shegalov.	2014-11-18 16:56:44 -08:00
Haohui Mai	fbf81fbd1c	HDFS-7406. SimpleHttpProxyHandler puts incorrect "Connection: Close" header. Contributed by Haohui Mai.	2014-11-18 14:52:59 -08:00
Haohui Mai	9dd5d673c9	HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu.	2014-11-17 17:35:36 -08:00
Andrew Wang	dcb8e24427	HDFS-6982. nntop: top-like tool for name node users. (Maysam Yabandeh via wang)	2014-11-17 17:33:42 -08:00
Haohui Mai	bf8e4332cb	HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai.	2014-11-17 11:42:20 -08:00
Vinayakumar B	6783d17fcf	HDFS-7399. Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() (Contributed by Vinayakumar B)	2014-11-17 20:19:19 +05:30
Colin Patrick Mccabe	26d3b7e6ae	HDFS-7394. Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCache (Keith Pak via Colin P. McCabe)	2014-11-16 21:20:53 -08:00
cnauroth	1925e2a4ae	HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang.	2014-11-14 16:43:09 -08:00
Haohui Mai	1a2e5cbc4d	HDFS-7395. BlockIdManager#clear() bails out when resetting the GenerationStampV1Limit. Contributed by Haohui Mai.	2014-11-13 14:43:03 -08:00
cnauroth	b0a41de68c	HDFS-7385. ThreadLocal used in FSEditLog class causes FSImage permission mess up. Contributed by jiangyu.	2014-11-13 12:34:52 -08:00
Tsz-Wo Nicholas Sze	394ba94c5d	HDFS-7358. Clients may get stuck waiting when using ByteArrayManager.	2014-11-13 12:28:44 -08:00
cnauroth	0abb973f09	HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA.	2014-11-12 21:41:19 -08:00
Haohui Mai	46f6f9d60d	HDFS-7375. Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement. Contributed by Haohui Mai.	2014-11-11 18:22:40 -08:00
cnauroth	163bb55067	HDFS-7389. Named user ACL cannot stop the user from accessing the FS entity. Contributed by Vinayakumar B.	2014-11-11 13:29:55 -08:00
Haohui Mai	571e9c6232	HDFS-7381. Decouple the management of block id and gen stamps from FSNamesystem. Contributed by Haohui Mai.	2014-11-11 12:42:12 -08:00
Suresh Srinivas	4ddc5cad0a	HDFS-7383. DataNode.requestShortCircuitFdsForRead may throw NullPointerException. Contributed by Tsz Wo Nicholas Sze.	2014-11-09 17:55:03 -08:00
cnauroth	9ba8d8c7eb	HDFS-7382. DataNode in secure mode may throw NullPointerException if client connects before DataNode registers itself with NameNode. Contributed by Chris Nauroth.	2014-11-08 22:24:57 -08:00
Arun C. Murthy	6caa8100d5	HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs.	2014-11-08 15:39:56 -08:00
Jing Zhao	ae71a671a3	HDFS-7364. Balancer always shows zero Bytes Already Moved. Contributed by Tsz Wo Nicholas Sze.	2014-11-06 17:48:36 -08:00
Haohui Mai	75b820cca9	HDFS-7365. Remove hdfs.server.blockmanagement.MutableBlockCollection. Contributed by Li Lu.	2014-11-06 13:56:31 -08:00
Milan Desai	80d7d183cd	HDFS-7336. Unused member DFSInputStream.buffersize. Contributed by Milan Desai.	2014-11-05 21:00:28 -08:00
Haohui Mai	8e33d4bdb3	HDFS-7367. HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol. Contributed by Chris Nauroth.	2014-11-05 20:31:39 -08:00
Haohui Mai	86eb27ba1d	HDFS-7366. BlockInfo should take replication as an short in the constructor. Contributed by Li Lu.	2014-11-05 18:14:18 -08:00
cnauroth	ba1d4ad25b	HDFS-7359. NameNode in secured HA cluster fails to start if dfs.namenode.secondary.http-address cannot be interpreted as a network address. Contributed by Chris Nauroth.	2014-11-05 15:09:22 -08:00
Colin Patrick Mccabe	56257fab1d	HDFS-7199. DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception (rushabhs via cmccabe)	2014-11-05 10:51:49 -08:00
Haohui Mai	18312804e9	HDFS-7357. FSNamesystem.checkFileProgress should log file path. Contributed by Tsz Wo Nicholas Sze.	2014-11-05 10:14:30 -08:00
Konstantin V Shvachko	203c63030f	HDFS-7333. Improve logging in Storage.tryLock(). Contributed by Konstantin Shvachko.	2014-11-05 09:53:23 -08:00
Konstantin V Shvachko	6e8722e49c	HDFS-7335. Redundant checkOperation() in FSN.analyzeFileState(). Contributed by Milan Desai.	2014-11-05 09:32:32 -08:00
yliu	73e601259f	HDFS-7218. FSNamesystem ACL operations should write to audit log on failure. (clamb via yliu)	2014-11-05 15:49:37 +08:00
Jing Zhao	5bd3a569f9	HDFS-7233. NN logs unnecessary org.apache.hadoop.hdfs.protocol.UnresolvedPathException. Contributed by Rushabh S Shah.	2014-11-04 16:02:07 -08:00
Jing Zhao	3dfd6e68fe	HDFS-7340. Make rollingUpgrade start/finalize idempotent. Contributed by Jing Zhao.	2014-11-04 10:16:37 -08:00
Haohui Mai	35d353e0f6	HDFS-7147. Update archival storage user documentation. Contributed by Tsz Wo Nicholas Sze.	2014-11-03 15:10:22 -08:00
Suresh Srinivas	237890feab	HDFS-7324. haadmin command usage prints incorrect command name. Contributed by Brahma Reddy Battula.	2014-11-03 13:27:09 -08:00
Kihwal Lee	67f13b58e4	HADOOP-10987. Provide an iterator-based listing API for FileSystem. Contributed by Kihwal Lee.	2014-11-03 08:20:22 -06:00
Tsz-Wo Nicholas Sze	36ccf097a9	HDFS-7276. Limit the number of byte arrays used by DFSOutputStream and provide a mechanism for recycling arrays.	2014-11-01 11:22:13 -07:00
Colin Patrick Mccabe	7b026c50f1	HDFS-6917. Add an hdfs debug command to validate blocks, call recoverlease, etc. (cmccabe)	2014-10-31 13:15:17 -07:00
Ravi Prakash	c7f81dad30	HDFS-7309. XMLUtils.mangleXmlString doesn't seem to handle less than sign. (Colin Patrick McCabe via raviprak)	2014-10-31 11:22:25 -07:00
cnauroth	5573b3476a	HDFS-7313. Support optional configuration of AES cipher suite on DataTransferProtocol. Contributed by Chris Nauroth.	2014-10-30 22:48:25 -07:00
cnauroth	c637d6d9d5	HDFS-6385. Show when block deletion will start after NameNode startup in WebUI. Contributed by Chris Nauroth.	2014-10-30 22:26:35 -07:00
Colin Patrick Mccabe	a9331fe9b0	HDFS-7035. Make adding a new data directory to the DataNode an atomic operation and improve error handling (Lei Xu via Colin P. McCabe)	2014-10-30 17:31:23 -07:00
Andrew Wang	c2866ac34d	HDFS-3342. SocketTimeoutException in BlockSender.sendChunks could have a better error message. Contributed by Yongjun Zhang.	2014-10-30 11:04:10 -07:00
Tao Luo	0126cf16b7	HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo.	2014-10-29 20:21:12 -07:00
Jing Zhao	6f5f604a79	HDFS-7305. NPE seen in wbhdfs FS while running SLive. Contributed by Jing Zhao.	2014-10-29 16:25:48 -07:00
Kihwal Lee	3ae84e1ba8	HDFS-7300. HDFS-7300. The getMaxNodesPerRack() method in BlockPlacementPolicyDefault is flawed. contributed by Kihwal Lee	2014-10-29 17:23:34 -05:00
Colin Patrick Mccabe	d33e07dc49	HDFS-7287. The OfflineImageViewer (OIV) can output invalid XML depending on the filename (Ravi Prakash via Colin P. McCabe)	2014-10-29 12:31:59 -07:00
Haohui Mai	675bca2968	HDFS-7280. Use netty 4 in WebImageViewer. Contributed by Haohui Mai.	2014-10-28 16:53:53 -07:00
Colin Patrick Mccabe	ac9ab037e9	HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe)	2014-10-28 16:41:22 -07:00
cnauroth	c6f04f391b	HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao.	2014-10-28 14:06:27 -07:00
Kihwal Lee	e226b5b40d	HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne.	2014-10-28 14:54:05 -05:00
Kihwal Lee	371a3b87ed	HDFS-6663. Admin command to track file and locations from block id. Contributed by Chen He.	2014-10-28 14:26:04 -05:00
yliu	58c0bb9ed9	HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu)	2014-10-28 21:11:31 +08:00
Harsh J	0398db19b2	HDFS-6741. Improve permission denied message when FSPermissionChecker#checkOwner fails. Contributed by Stephen Chu and Harsh J. (harsh)	2014-10-28 12:22:37 +05:30
Haohui Mai	00b4e44a2e	HDFS-5928. Show namespace and namenode ID on NN dfshealth page. Contributed by Siqi Li.	2014-10-27 16:22:19 -07:00
Colin Patrick Mccabe	baf794dc40	HDFS-7278. Add a command that allows sysadmins to manually trigger full block reports from a DN (cmccabe)	2014-10-27 09:53:16 -07:00
cnauroth	463aec1171	HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth.	2014-10-27 09:38:30 -07:00
Harsh J	0058eadbd3	HDFS-6538. Comment format error in ShortCircuitRegistry javadoc. Contributed by David Luo. (harsh)	2014-10-27 19:24:50 +05:30
Byron Wong	28051e4155	HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong.	2014-10-25 12:31:41 -07:00
Colin Patrick Mccabe	a52eb4bc5f	HDFS-6988. Improve HDFS-6581 eviction configuration (Xiaoyu Yao via Colin P. McCabe)	2014-10-24 13:08:59 -07:00
Jitendra Pandey	86ac0d40b8	HDFS-6904. Added files missing in previous commit.	2014-10-24 12:01:09 -07:00
Jitendra Pandey	e2be333744	HDFS-6904. YARN unable to renew delegation token fetched via webhdfs due to incorrect service port.	2014-10-24 11:35:19 -07:00
Haohui Mai	b3d8a642a9	HDFS-7283. Bump DataNode OOM log from WARN to ERROR. Contributed by Stephen Chu.	2014-10-24 10:50:16 -07:00
Haohui Mai	0942c99eba	HDFS-7258. CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level. Contributed by Xiaoyu Yao.	2014-10-23 23:58:32 -07:00
yliu	57dec28807	HDFS-7243. HDFS concat operation should not be allowed in Encryption Zone. (clamb via yliu)	2014-10-24 11:12:18 +08:00
Haohui Mai	670879ef41	HDFS-7257. Add the time of last HA state transition to NN's /jmx page. Contributed by Charles Lamb.	2014-10-23 16:52:58 -07:00
Andrew Wang	86cad007d7	HDFS-7222. Expose DataNode network errors as a metric. (Charles Lamb via wang)	2014-10-23 12:53:01 -07:00
Andrew Wang	8c5b23b547	HDFS-7165. Separate block metrics for files with replication count 1. (Zhe Zhang via wang)	2014-10-23 12:28:02 -07:00
Colin Patrick Mccabe	7b0f9bb258	HDFS-6877. Avoid calling checkDisk when an HDFS volume is removed during a write. (Lei Xu via Colin P. McCabe)	2014-10-22 13:38:26 -07:00
Allen Wittenauer	4baca311ff	HDFS-7204. balancer doesn't run as a daemon (aw)	2014-10-21 14:26:08 -07:00
Colin Patrick Mccabe	7aab5fa1bd	HDFS-7154. Fix returning value of starting reconfiguration task (Lei Xu via Colin P. McCabe)	2014-10-20 18:33:11 -07:00
Colin Patrick Mccabe	4799570dfd	HDFS-7266. HDFS Peercache enabled check should not lock on object (awang via cmccabe)	2014-10-20 18:24:53 -07:00
Benoy Antony	e4d6a87854	HDFS-7184. Allow data migration tool to run as a daemon. (Benoy Antony)	2014-10-20 12:15:58 -07:00
Tsz-Wo Nicholas Sze	2e140523d3	HDFS-7260. Change DFSOutputStream.MAX_PACKETS to be configurable.	2014-10-17 18:30:09 -07:00
Vinayakumar B	368743140d	HDFS-7252. small refinement to the use of isInAnEZ in FSNamesystem. (Yi Liu via vinayakumarb)	2014-10-17 18:03:44 +05:30
Vinayakumar B	1c3ff0b7c8	HDFS-7242. Code improvement for FSN#checkUnreadableBySuperuser. (Contributed by Yi Liu)	2014-10-17 17:48:20 +05:30
Tsz-Wo Nicholas Sze	2894433332	HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support FSIMAGE_NAME_OPTIMIZATION.	2014-10-15 20:56:59 -07:00
Tsz-Wo Nicholas Sze	41980c56d3	HDFS-7208. NN doesn't schedule replication when a DN storage fails. Contributed by Ming Ma	2014-10-15 20:44:24 -07:00
Jing Zhao	18620649f9	HDFS-7185. The active NameNode will not accept an fsimage sent from the standby during rolling upgrade. Contributed by Jing Zhao.	2014-10-15 10:27:30 -07:00
Haohui Mai	128ace10cd	HDFS-7190. Bad use of Preconditions in startFileInternal(). Contributed by Dawson Choong.	2014-10-14 23:42:19 -07:00
Haohui Mai	0260231667	HDFS-7201. Fix typos in hdfs-default.xml. Contributed by Dawson Choong.	2014-10-14 17:36:07 -07:00
Jing Zhao	7dcad84143	HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao.	2014-10-14 10:22:34 -07:00
Tsz-Wo Nicholas Sze	f6d0b8892a	HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException.	2014-10-13 18:28:34 -07:00
cnauroth	1770bb942f	HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao.	2014-10-13 10:56:32 -07:00
Haohui Mai	53100318ea	HDFS-6544. Broken Link for GFS in package.html. Contributed by Suraj Nayak M.	2014-10-13 10:33:19 -07:00
Andrew Wang	d3d3d47202	HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang)	2014-10-10 13:40:37 -07:00
Colin Patrick Mccabe	1ceb326933	HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe)	2014-10-10 13:03:29 -07:00
Aaron T. Myers	cbd21fd13b	HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang.	2014-10-09 18:52:48 -07:00
Kihwal Lee	db71bb54bc	HDFS-7217. Better batching of IBRs. Contributed by Kihwal Lee.	2014-10-09 12:07:51 -05:00
Aaron T. Myers	2a51494ce1	HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh.	2014-10-08 18:01:51 -07:00
Kihwal Lee	853cb704ed	HDFS-7203. Concurrent appending to the same file can cause data corruption. Contributed by Kihwal Lee.	2014-10-08 15:05:34 -05:00
cnauroth	1efd9c9825	HDFS-7112. LazyWriter should use either async IO or one thread per physical disk. Contributed by Xiaoyu Yao.	2014-10-07 20:25:19 -07:00
cnauroth	9b8a35aff6	HDFS-7128. Decommission slows way down when it gets towards the end. Contributed by Ming Ma.	2014-10-07 15:01:09 -07:00
Colin Patrick Mccabe	8dc6abf2f4	HDFS-7194 Fix findbugs "inefficient new String constructor" warning in DFSClient#PATH (yzhang via cmccabe)	2014-10-06 15:29:09 -07:00
Vinayakumar B	ed841dd9a9	HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb)	2014-10-06 14:31:15 +05:30
Colin Patrick Mccabe	7f6ed7fe36	HDFS-7055. Add tracing to DFSInputStream (cmccabe)	2014-10-03 13:35:43 -07:00
Andrew Wang	d2d5a0ea03	HDFS-7179. DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtension. (wang)	2014-10-02 13:50:05 -07:00
Colin Patrick Mccabe	03db9cc839	HDFS-7162. Wrong path when deleting through fuse-dfs a file which already exists in trash (cmccabe)	2014-10-02 12:42:19 -07:00
Colin Patrick Mccabe	dd1b8f2ed8	HDFS-7176. The namenode usage message doesn't include "-rollingupgrade started" (cmccabe)	2014-10-01 14:53:44 -07:00
Haohui Mai	1f5b42ac48	HDFS-7158. Reduce the memory usage of WebImageViewer. Contributed by Haohui Mai.	2014-10-01 10:53:38 -07:00
arp	a45ad330fa	HDFS-7171. Fix Jenkins failures in HDFS-6581 branch. (Arpit Agarwal)	2014-09-30 18:25:20 -07:00
arp	65ef35bbab	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java hadoop-hdfs-project/hadoop-hdfs/src/test/resources/editsStored.xml	2014-09-30 18:20:13 -07:00
arp	9e9e9cf711	HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal)	2014-09-30 18:10:13 -07:00
arp	dde2ed13c2	Merge branch 'trunk' into HDFS-6581	2014-09-30 18:05:54 -07:00
Jing Zhao	cdf1af0e5a	HDFS-7167. NPE while running Mover if the given path is for a file. Contributed by Jing Zhao.	2014-09-30 11:13:35 -07:00
arp	5e8b697352	HDFS-7129. Metrics to track usage of memory for writes. (Contributed by Xiaoyu Yao)	2014-09-30 00:53:18 -07:00
arp	bb84f1fccb	HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal)	2014-09-29 22:27:59 -07:00
arp	368e2423a5	Merge branch 'trunk' into HDFS-6581	2014-09-29 20:09:06 -07:00
Haohui Mai	0577eb32fc	HDFS-6779. Add missing version subcommand for hdfs. Contributed by Sasaki Toru.	2014-09-29 18:10:47 -07:00
arp	7f0422be76	Merge branch 'trunk' into HDFS-6581	2014-09-29 16:29:43 -07:00
Andrew Wang	7f0efe96f8	HDFS-7124. Remove EncryptionZoneManager.NULL_EZ. (clamb via wang)	2014-09-29 14:14:22 -07:00
arp	1e6b4b9b2e	Merge branch 'trunk' into HDFS-6581	2014-09-29 14:01:47 -07:00
Andrew Wang	f0293f11a8	HDFS-7104. Fix and clarify INodeInPath getter functions. Contributed by Zhe Zhang.	2014-09-29 12:58:37 -07:00
arp	d45e7c7e85	HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal)	2014-09-29 12:36:27 -07:00
Allen Wittenauer	84b9c632bf	HDFS-4227. Document dfs.namenode.resource.* (Daisuke Kobayashi via aw)	2014-09-29 09:01:43 -07:00
Allen Wittenauer	9829f9fa58	HDFS-6519. Document oiv_legacy command (Akira AJISAKA via aw)	2014-09-29 08:51:41 -07:00
arp	9a53c3699b	Merge branch 'trunk' into HDFS-6581	2014-09-28 20:42:56 -07:00
arp	b38e52b5e8	HDFS-7093. Add config key to restrict setStoragePolicy. (Arpit Agarwal)	2014-09-28 19:28:51 -07:00
Konstantin V Shvachko	400e1bb4ef	HDFS-7156. Update fsck documentation. Contributed by Masahiro Yamaguch.	2014-09-27 21:04:23 -07:00
arp	a2d4edacea	HDFS-7155. Bugfix in createLocatedFileStatus caused by bad merge. (Arpit Agarwal)	2014-09-26 16:30:47 -07:00
arp	7060502edb	Merge branch 'trunk' into HDFS-6581	2014-09-26 11:09:03 -07:00
Colin Patrick Mccabe	55302ccfba	HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe)	2014-09-26 10:30:30 -07:00
arp	032e0eba6b	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java	2014-09-25 19:50:28 -07:00
Andrew Wang	e96ce6f3e3	HDFS-7077. Separate CipherSuite from crypto protocol version. (wang)	2014-09-25 18:40:40 -07:00
Jing Zhao	e9c37de485	HDFS-7131. During HA upgrade, JournalNode should create a new committedTxnId file in the current directory. Contributed by Jing Zhao.	2014-09-25 17:15:33 -07:00
cnauroth	9f9a2222a2	HDFS-7119. Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics. Contributed by Chris Nauroth.	2014-09-25 13:33:37 -07:00
Colin Patrick Mccabe	1861b32eb5	HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe)	2014-09-25 13:11:59 -07:00
arp	364e60b169	HDFS-7144. Fix findbugs warnings in RamDiskReplicaTracker. (Contributed by Tsz Wo Nicholas Sze)	2014-09-25 11:14:24 -07:00
arp	e9edafc731	Merge branch 'trunk' into HDFS-6581	2014-09-25 11:06:25 -07:00
cnauroth	e0b1dc514f	HDFS-7118. Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename. Contributed by Chris Nauroth.	2014-09-25 10:03:59 -07:00
arp	e8e7fbe81a	HDFS-6932. Balancer and Mover tools should ignore replicas on RAM_DISK. (Contributed by Xiaoyu Yao)	2014-09-24 21:08:59 -07:00
arp	feda4733a8	HDFS-7143. Fix findbugs warnings in HDFS-6581 branch. (Contributed by Tsz Wo Nicholas Sze)	2014-09-24 21:06:56 -07:00
arp	b1000fbba4	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java	2014-09-24 20:08:32 -07:00
Jing Zhao	428a76663a	HDFS-7140. Add a tool to list all the existing block storage policies. Contributed by Jing Zhao.	2014-09-24 19:11:16 -07:00
Jing Zhao	073bbd805c	HDFS-7081. Add new DistributedFileSystem API for getting all the existing storage policies. Contributed by Jing Zhao.	2014-09-24 10:05:40 -07:00
Allen Wittenauer	cb74f39697	HDFS-6534. Fix build on macosx: HDFS parts (Binglin Chang via aw)	2014-09-24 08:22:02 -07:00
arp	bfc7b7e6a0	Merge branch 'trunk' into HDFS-6581	2014-09-23 16:40:35 -07:00
Andrew Wang	f48686a1ad	HDFS-7132. hdfs namenode -metadataVersion command does not honor configured name dirs. Contributed by Charles Lamb.	2014-09-23 14:10:02 -07:00
Allen Wittenauer	3dc28e2052	HADOOP-11092. hadoop shell commands should print usage if not given a class (aw)	2014-09-23 12:24:23 -07:00
arp	889122bd55	Merge branch 'trunk' into HDFS-6581	2014-09-22 18:00:58 -07:00
Colin Patrick Mccabe	912ad32b03	HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe)	2014-09-22 11:51:31 -07:00
Andrew Wang	1737950d0f	HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. Contributed by Zhe Zhang.	2014-09-21 21:29:46 -07:00
cnauroth	47491f9a11	HDFS-7107. Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris Nauroth.	2014-09-20 20:53:09 -07:00
arp	e257b6dbb1	Merge branch 'trunk' into HDFS-6581	2014-09-20 16:13:17 -07:00
Jing Zhao	84a0a629d3	HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. Contributed by Jing Zhao.	2014-09-20 13:44:53 -07:00
arp	b2d5ed36bc	HDFS-7100. Make eviction scheme pluggable. (Arpit Agarwal)	2014-09-20 13:25:23 -07:00
arp	09dab88d3e	Merge branch 'trunk' into HDFS-6581	2014-09-20 10:34:45 -07:00
cnauroth	f85cc14eb4	HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth.	2014-09-19 21:23:26 -07:00
Kihwal Lee	9e35571965	HDFS-7046. HA NN can NPE upon transition to active. Contributed by Kihwal Lee.	2014-09-19 17:07:06 -05:00
arp	222bf0fe67	Merge branch 'trunk' into HDFS-6581	2014-09-19 10:02:27 -07:00
Kihwal Lee	bf27b9ca57	HDFS-7065. Pipeline close recovery race can cause block corruption. Contributed by Kihwal Lee.	2014-09-19 09:00:13 -05:00
Kihwal Lee	f02d934fed	HDFS-6948. DN rejects blocks if it has older UC block. Contributed by Eric Payne.	2014-09-19 08:50:43 -05:00
arp	f8bbf80067	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsFileStatus.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsLocatedFileStatus.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java	2014-09-18 22:26:42 -07:00
arp	e79c98c11f	HDFS-7091. Add forwarding constructor for INodeFile for existing callers. (Arpit Agarwal)	2014-09-18 19:20:25 -07:00
Andrew Wang	8e73084491	HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang)	2014-09-18 17:49:17 -07:00
Andrew Wang	20a076bafc	HDFS-6970. Move startFile EDEK retries to the DFSClient. (wang)	2014-09-18 17:35:24 -07:00
Colin Patrick Mccabe	fe38d2e9b5	HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe)	2014-09-18 16:52:46 -07:00
Tsz-Wo Nicholas Sze	98f7bfe993	Merge branch 'HDFS-6584' into trunk	2014-09-19 07:11:19 +08:00
arp	22295b4783	Merge branch 'trunk' into HDFS-6581	2014-09-18 15:59:37 -07:00
Andrew Wang	70be56d093	HDFS-7003. Add NFS Gateway support for reading and writing to encryption zones. (clamb via wang)	2014-09-18 14:57:25 -07:00
arp	0b10e5a0f7	Merge branch 'trunk' into HDFS-6581	2014-09-18 12:10:45 -07:00
Colin Patrick Mccabe	570b8b468e	HDFS-7047. Expose FileStatus#isEncrypted in libhdfs (cmccabe)	2014-09-18 11:42:23 -07:00
arp	5e4627d0fb	HDFS-7084. FsDatasetImpl#copyBlockFiles debug log can be improved. (Contributed by Xiaoyu Yao)	2014-09-18 11:13:53 -07:00
arp	849ccfa699	Merge branch 'trunk' into HDFS-6581	2014-09-18 11:06:40 -07:00
Jing Zhao	76ccb80fad	HDFS-7088. Archival Storage: fix TestBalancer and TestBalancerWithMultipleNameNodes. Contributed by Tsz Wo Nicholas Sze.	2014-09-18 10:54:01 -07:00
Tsz-Wo Nicholas Sze	2d2b0009e6	Merge branch 'trunk' into HDFS-6584 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java	2014-09-18 13:00:29 +08:00
Andrew Wang	0ecefe6017	HDFS-7078. Fix listEZs to work correctly with snapshots. (wang)	2014-09-17 21:28:05 -07:00
Andrew Wang	10e8602f32	HDFS-7004. Update KeyProvider instantiation to create by URI. (wang)	2014-09-17 20:14:40 -07:00
arp	4eab083b1b	HDFS-7080. Fix finalize and upgrade unit test failures. (Arpit Agarwal)	2014-09-17 15:25:04 -07:00
arp	a186d514bd	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java	2014-09-17 15:03:55 -07:00
Jing Zhao	911979c8ab	Merge changes from trunk	2014-09-17 13:12:45 -07:00
Colin Patrick Mccabe	e3803d002c	HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe)	2014-09-17 12:55:35 -07:00
arp	24f8156886	Merge branch 'trunk' into HDFS-6581	2014-09-17 12:10:50 -07:00
Andrew Wang	ea4e2e843e	HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang)	2014-09-17 11:23:47 -07:00
Jing Zhao	b014e83bc5	HDFS-6864. Archival Storage: add user documentation. Contributed by Tsz Wo Nicholas Sze.	2014-09-17 09:40:17 -07:00
Alejandro Abdelnur	e14e71d5fe	HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu)	2014-09-16 23:20:35 -07:00
Tsz-Wo Nicholas Sze	bd2e409de1	HDFS-7072. Fix TestBlockManager and TestStorageMover. Contributed by Jing Zhao	2014-09-17 13:48:32 +08:00
arp	a24a9331d4	Merge branch 'trunk' into HDFS-6581	2014-09-16 18:18:09 -07:00
Jing Zhao	432b863719	Merge changes from trunk	2014-09-16 17:58:39 -07:00
Jing Zhao	2e4033e872	HDFS-7052. Archival Storage: Add Mover into hdfs script. Contributed by Jing Zhao.	2014-09-16 17:52:28 -07:00
Andrew Wang	33ce887c20	HDFS-6851. Refactor EncryptionZoneWithId and EncryptionZone. (clamb via wang)	2014-09-16 16:41:09 -07:00
Allen Wittenauer	7971c97ec1	HADOOP-11022. User replaced functions get lost 2-3 levels deep (e.g., sbin) (aw)	2014-09-16 16:06:23 -07:00
arp	4603e4481f	HDFS-7064. Fix unit test failures in HDFS-6581 branch. (Contributed by Xiaoyu Yao)	2014-09-16 15:45:07 -07:00
arp	e0d7fb48fb	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/Receiver.java	2014-09-16 14:32:57 -07:00
Colin Patrick Mccabe	56119fec96	HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe)	2014-09-16 13:59:32 -07:00
Kihwal Lee	0c26412be4	HDFS-6965. NN continues to issue block locations for DNs with full disks. Contributed by Rushabh Shah.	2014-09-16 09:04:54 -05:00
arp	a7814e1aa4	Merge branch 'trunk' into HDFS-6581	2014-09-15 15:30:19 -07:00
arp	a4dcbaa332	HDFS-7066. LazyWriter#evictBlocks misses a null check for replicaState. (Contributed by Xiaoyu Yao)	2014-09-15 15:28:17 -07:00
Andrew Wang	43b0303008	HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb.	2014-09-15 10:23:57 -07:00
Jing Zhao	2689b6ca72	HDFS-7062. Archival Storage: skip under construction block for migration. Contributed by Jing Zhao.	2014-09-15 10:16:56 -07:00
arp	9f22fb8c9a	HDFS-6978. Directory scanner should correctly reconcile blocks on RAM disk. (Arpit Agarwal)	2014-09-12 22:13:18 -07:00
arp	7aeda47bd9	Merge branch 'trunk' into HDFS-6581	2014-09-12 11:45:11 -07:00
Jing Zhao	dc27ee9ae9	HDFS-7039. Archival Storage: fix Balancer tests. Contributed by Tsz Wo Nicholas Sze.	2014-09-11 14:19:18 -07:00
Jing Zhao	8de20a1987	Merge trunk into HDFS-6584	2014-09-11 13:04:35 -07:00
Jing Zhao	0d85f7e591	HDFS-7034. Archival Storage: Fix TestBlockPlacement and TestStorageMover. Contributed by Jing Zhao.	2014-09-11 13:00:43 -07:00
cnauroth	80ac6aabce	HDFS-7042. Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Contributed by Chris Nauroth.	2014-09-11 12:16:19 -07:00
Andrew Wang	1e684995d7	HDFS-7045. Fix NameNode deadlock when opening file under /.reserved path. Contributed by Yi Liu.	2014-09-11 10:59:09 -07:00
Andrew Wang	d1dab6cc63	HDFS-6621. Hadoop Balancer prematurely exits iterations. Contributed by Rafal Wodjdyla and Benjamin Bowman.	2014-09-11 10:32:20 -07:00
Tsz-Wo Nicholas Sze	70dfe9cfab	Merge branch 'trunk' into HDFS-6584	2014-09-11 15:23:38 +08:00
Jing Zhao	db41a1b7b9	Merge changes from trunk	2014-09-09 22:47:50 -07:00
Alejandro Abdelnur	bbff44cb03	HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu)	2014-09-09 22:16:42 -07:00
Tsz-Wo Nicholas Sze	4124905aa5	HDFS-7028: FSDirectory should not get storage policy id from symlinks	2014-09-10 12:34:15 +08:00
arp	0d2f6b4600	Merge branch 'trunk' into HDFS-6581	2014-09-09 18:07:18 -07:00
Konstantin V Shvachko	05af0ff4be	Revert HDFS-6940.	2014-09-09 17:30:10 -07:00
cnauroth	2749fc677c	Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang.	2014-09-09 11:32:54 -07:00
arp	61ccd50362	Merge branch 'trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java	2014-09-08 22:44:04 -07:00
arp	f949f6b548	HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal)	2014-09-08 21:20:55 -07:00
Andrew Wang	04915a0814	HDFS-6951. Correctly persist raw namespace xattrs to edit log and fsimage. Contributed by Charles Lamb.	2014-09-08 16:59:30 -07:00
Jing Zhao	6997c1c658	Merge remote-tracking branch 'origin/trunk' into HDFS-6584	2014-09-08 15:15:34 -07:00
arp	4ff128af12	Merge branch 'trunk' into HDFS-6581	2014-09-08 15:00:01 -07:00
Jing Zhao	867f0f141c	HDFS-7029. Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem. Contributed by Tsz Wo Nicholas Sze.	2014-09-08 14:57:27 -07:00
arp	a18caf7753	HDFS-6991. Notify NN of evicted block before deleting it from RAM disk. (Arpit Agarwal)	2014-09-08 14:29:30 -07:00
Jing Zhao	74a7e227c8	HDFS-7027. Archival Storage: Mover does not terminate when some storage type is out of space. Contributed by Tsz Wo Nicholas Sze.	2014-09-08 14:21:26 -07:00
Jing Zhao	2b5c528a73	HDFS-6875. Archival Storage: support migration for a list of specified paths. Contributed by Jing Zhao.	2014-09-08 14:10:00 -07:00
Allen Wittenauer	d989ac0444	MAPREDUCE-5972. Fix typo 'programatically' in job.xml (and a few other places) (Akira AJISAKA via aw)	2014-09-08 13:15:46 -07:00
Allen Wittenauer	6c790a7ab0	HDFS-6893. crypto subcommand is not sorted properly in hdfs\'s hadoop_usage (David Luo via aw)	2014-09-08 13:10:53 -07:00
Colin Patrick Mccabe	cad14aa916	HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe)	2014-09-08 12:51:56 -07:00
Kihwal Lee	6a84f88c11	HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp.	2014-09-08 14:41:44 -05:00
Haohui Mai	c1f8323234	HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma.	2014-09-08 11:07:23 -07:00
arp	ccdf0054a3	HDFS-6977. Delete all copies when a block is deleted from the block space. (Arpit Agarwal)	2014-09-08 10:35:54 -07:00
Tsz-Wo Nicholas Sze	f1432e2424	Merge branch 'trunk' into HDFS-6584 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java	2014-09-08 10:54:48 +08:00
arp	eb8284d50e	Merge trunk into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java	2014-09-07 14:46:46 -07:00
arp	d1fa58292e	HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal)	2014-09-06 21:04:29 -07:00
Tsz-Wo Nicholas Sze	22a41dce4a	HDFS-6997: add more tests for data migration and replicaion.	2014-09-07 07:44:28 +08:00
arp	31bbeaf383	Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581	2014-09-06 12:28:22 -07:00
Konstantin V Shvachko	88209ce181	HDFS-6940. Refactoring to allow ConsensusNode implementation. Contributed by Konstantin Shvachko.	2014-09-06 12:07:52 -07:00
Alejandro Abdelnur	3b35f81603	HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu)	2014-09-05 22:33:48 -07:00
arp	339d21f273	Merge trunk into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java	2014-09-05 21:36:25 -07:00
Allen Wittenauer	a149afd9e6	HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)	2014-09-05 13:50:42 -07:00
Jing Zhao	300cb12bef	Merge trunk into HDFS-6584	2014-09-05 11:37:22 -07:00
Allen Wittenauer	7a62515c86	HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)	2014-09-05 11:31:49 -07:00
arp	9e941d9f99	HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao)	2014-09-05 10:45:54 -07:00
Jing Zhao	c6107f566f	HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai.	2014-09-05 10:40:02 -07:00
Jing Zhao	185200e709	HDFS-6876. Archival Storage: support set/get storage policy in DFSAdmin. Contributed by Jing Zhao.	2014-09-04 20:14:46 -07:00
Jing Zhao	6104520369	HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu.	2014-09-04 18:54:38 -07:00
Jing Zhao	f7df24bb1b	HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao.	2014-09-04 16:12:44 -07:00
Jing Zhao	e08701ec71	HDFS-6961. Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round.	2014-09-04 14:19:32 -07:00
Colin Patrick Mccabe	f4caedfcbf	HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang	2014-09-03 19:30:30 -07:00
arp	3a0142bd77	HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao)	2014-09-03 17:17:06 -07:00
Jing Zhao	45d5b13256	Merge changes from trunk	2014-09-03 15:36:47 -07:00
arp	cb9b485075	HDFS-6930. Improve replica eviction from RAM disk. (Arpit Agarwal)	2014-09-03 13:53:01 -07:00
arp	08a8f2be81	Merge trunk into HDFS-6581	2014-09-03 10:53:37 -07:00
Uma Maheswara Rao G	3425ae5d7e	HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh)	2014-09-03 18:53:51 +05:30
arp	a6b32a3e78	Merge trunk into HDFS-6581	2014-09-02 16:25:32 -07:00
Haohui Mai	08a9ac7098	HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang.	2014-09-02 16:22:18 -07:00
Colin Patrick Mccabe	727331becc	HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo.	2014-09-02 15:14:33 -07:00
Andrew Wang	a0ccf83dfd	HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb.	2014-09-02 14:22:20 -07:00
Andrew Wang	faa4455be5	HDFS-6634. inotify in HDFS. Contributed by James Thomas.	2014-09-02 14:02:29 -07:00
Jing Zhao	3e2a0b5446	HDFS-6969. Archival Storage: INode#getStoragePolicyID should always return the latest storage policy. Contributed by Jing Zhao.	2014-09-01 17:56:04 -07:00
arp	f65183eba3	Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java	2014-08-29 13:37:17 -07:00
Aaron T. Myers	7eab2a29a5	HDFS-6774. Make FsDataset and DataStore support removing volumes. Contributed by Lei Xu.	2014-08-29 13:00:17 -07:00
arp	4ae8178c56	HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas)	2014-08-29 00:26:13 -07:00
arp	c92837aeab	HDFS-6931. Move lazily persisted replicas to finalized directory on DN startup. (Arpit Agarwal)	2014-08-28 23:13:46 -07:00
arp	4cf9afacbe	HDFS-6960. Bugfix in LazyWriter, fix test case and some refactoring. (Arpit Agarwal)	2014-08-28 23:05:32 -07:00
arp	7e32be8768	Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581 Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt	2014-08-28 19:06:46 -07:00
Allen Wittenauer	d8774cc577	HADOOP-11013. CLASSPATH handling should be consolidated, debuggable (aw)	2014-08-28 18:09:25 -07:00
Todd Lipcon	ab638e77b8	HDFS-6865. Byte array native checksumming on client side. Contributed by James Thomas.	2014-08-28 16:44:09 -07:00
arp	2e987148e0	HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace. (Arpit Agarwal)	2014-08-27 21:47:19 -07:00
arp	eb448e1439	HDFS-6926. DN support for saving replicas to persistent storage and evicting in-memory replicas. (Arpit Agarwal)	2014-08-27 21:47:19 -07:00
arp	a317bd7b02	HDFS-6925. DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received. (Arpit Agarwal)	2014-08-27 21:47:19 -07:00
arp	c2354a7f81	HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol. (Arpit Agarwal)	2014-08-27 21:47:18 -07:00
arp	042b33f20b	HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and edit logs. (Arpit Agarwal)	2014-08-27 21:47:18 -07:00
arp	7f49537ba1	HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)	2014-08-27 21:47:18 -07:00
arp	a7bcc95358	HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal)	2014-08-27 21:47:18 -07:00
Jing Zhao	a26aa6bd07	HDFS-6944. Archival Storage: add retry and termination logic for Mover. Contributed by Jing Zhao.	2014-08-27 14:20:54 -07:00
Colin Patrick Mccabe	6962510f72	HDFS-6879. Adding tracing to Hadoop RPC. Contributed by Masatake Iwasaki.	2014-08-27 14:12:05 -07:00
Jing Zhao	b7ded466b0	HDFS-6920. Archival Storage: check the storage type of delNodeHintStorage when deleting a replica. Contributed by Tsz Wo Nicholas Sze.	2014-08-27 14:08:02 -07:00
Colin Patrick Mccabe	b6b95ff667	HDFS-6902. FileWriter should be closed in finally block in BlockReceiver#receiveBlock() (Tsuyoshi OZAWA via Colin Patrick McCabe)	2014-08-27 13:49:31 -07:00
Colin Patrick Mccabe	225569ece2	HDFS-4486. Add log category for long-running DFSClient notices. Contributed by Zhe Zhang.	2014-08-27 13:39:40 -07:00
Haohui Mai	26ebdd849b	HDFS-6938. Cleanup javac warnings in FSNamesystem. Contributed by Charles Lamb.	2014-08-27 11:14:39 -07:00
Jing Zhao	8ea20b53a8	HDFS-6911. Archival Storage: check if a block is already scheduled in Mover. Contributed by Tsz Wo Nicholas Sze.	2014-08-27 10:38:10 -07:00
Jing Zhao	555900a9dc	Merge branch 'trunk' into HDFS-6584	2014-08-27 10:32:30 -07:00
Jing Zhao	6b441d227a	HDFS-6908. Incorrect snapshot directory diff generated by snapshot deletion. Contributed by Juan Yu and Jing Zhao.	2014-08-27 10:26:22 -07:00
Allen Wittenauer	9ec4a930f5	HADOOP-10996. Stop violence in the *_HOME (aw)	2014-08-27 07:00:31 -07:00
Arpit Agarwal	e871955765	HDFS-6899. Allow changing MiniDFSCluster volumes per DN and capacity per volume. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619970 13f79535-47bb-0310-9956-ffa450edef68	2014-08-23 06:01:17 +00:00
Arpit Agarwal	e6c3650070	HDFS-6829. DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster. (Contributed by zhaoyunjiong) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619882 13f79535-47bb-0310-9956-ffa450edef68	2014-08-22 18:14:55 +00:00
Alejandro Abdelnur	3aa3b0abc2	HDF-6905. fs-encryption merge triggered release audit failures. (clamb via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619667 13f79535-47bb-0310-9956-ffa450edef68	2014-08-22 05:17:22 +00:00
Jing Zhao	e69954d22c	HDFS-6906. Archival Storage: Add more tests for BlockStoragePolicy. Contributed by Tsz Wo Nicholas Sze. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619628 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 23:42:33 +00:00
Jing Zhao	603cbe5eea	HDFS-6863. Archival Storage: Support migration for snapshot paths. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619627 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 23:41:10 +00:00
Tsz-wo Sze	c92d869d02	Merge r1609845 through r1619277 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1619293 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 05:22:10 +00:00
Arpit Agarwal	6824abc19e	HDFS-6758. Block writer should pass the expected block size to DataXceiverServer (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619275 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 01:13:49 +00:00
Chris Nauroth	8304001861	HDFS-6858. Allow dfs.data.transfer.saslproperties.resolver.class default to hadoop.security.saslproperties.resolver.class. Contributed by Benoy Antony. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619256 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 22:46:35 +00:00
Andrew Wang	834fccf02b	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619194 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 18:19:13 +00:00
Jing Zhao	f20d363126	HDFS-6870. Blocks and INodes could leak for Rename with overwrite flag. Contributed by Yi Liu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619192 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 18:13:03 +00:00
Andrew Wang	d2a39b61aa	Merge from trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619018 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 01:22:42 +00:00
Allen Wittenauer	31467453ec	HADOOP-9902. Shell script rewrite (aw) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618847 13f79535-47bb-0310-9956-ffa450edef68	2014-08-19 12:11:17 +00:00
Tsz-wo Sze	4e324bcd3d	Merge r1609845 through r1618763 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618764 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 23:41:53 +00:00
Brandon Li	2fb04d2a30	HDFS-6569. OOB message can't be sent to the client when DataNode shuts down for upgrade. Contributed by Brandon Li git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618742 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 21:23:08 +00:00
Arpit Agarwal	1b5139b29a	HDFS-6188. An ip whitelist based implementation of TrustedChannelResolver. (Contributed by Benoy Antony) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618727 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 20:50:06 +00:00
Andrew Wang	0cc08f6da4	Merge from trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618700 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 18:41:31 +00:00
Andrew Wang	bd616552cc	HDFS-6825. Edit log corruption due to delayed block removal. Contributed by Yongjun Zhang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618684 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 18:08:42 +00:00
Jing Zhao	5d5aae0694	HDFS-6801. Archival Storage: Add a new data migration tool. Contributed by Tsz Wo Nicholas Sze. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618675 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 17:51:18 +00:00
Arpit Agarwal	1c77c80410	HDFS-6783. Addendum patch to fix test failures. (Contributed by Yi Liu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618635 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 15:34:58 +00:00
Tsz-wo Sze	cb75b6b07d	Merge r1609845 through r1618416 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618417 13f79535-47bb-0310-9956-ffa450edef68	2014-08-16 21:02:21 +00:00
Tsz-wo Sze	9b250d74f0	HDFS-6847. Support storage policy on directories and include storage policy in HdfsFileStatus. Contributed by Jing Zhao git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1618416 13f79535-47bb-0310-9956-ffa450edef68	2014-08-16 20:58:20 +00:00
Charles Lamb	20dcb841ce	HDFS-6546. Add non-superuser capability to get the encryption zone for a specific path. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618022 13f79535-47bb-0310-9956-ffa450edef68	2014-08-14 19:11:06 +00:00
Uma Maheswara Rao G	44864c68b5	HDFS-6783. Fix HDFS CacheReplicationMonitor rescan logic. Contributed by Yi Liu and Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617872 13f79535-47bb-0310-9956-ffa450edef68	2014-08-14 04:20:00 +00:00
Vinayakumar B	195961a7c1	HDFS-6247. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (vinayakumarb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617799 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 18:43:05 +00:00
Vinayakumar B	6554994fab	Reverted Merged revision(s) 1617784 from hadoop/common/trunk: HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.) ........ git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617794 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 18:36:51 +00:00
Vinayakumar B	471b1368e2	HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617784 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 18:06:33 +00:00
Haohui Mai	03d8ff496a	HDFS-6567. Normalize the order of public final in HdfsFileStatus. Contributed by Tassapol Athiapinya. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617779 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 17:45:47 +00:00
Arpit Agarwal	a72fba5853	HDFS-6836. HDFS INFO logging is verbose & uses file appenders. (Contributed by Xiaoyu Yao) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617603 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 21:49:48 +00:00
Arpit Agarwal	662c5bb3af	HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617598 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 21:42:21 +00:00
Jing Zhao	37207b75d4	HDFS-6835. Archival Storage: Add a new API to set storage policy. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617568 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 19:32:09 +00:00
Charles Lamb	74f7be0887	merge from trunk r1617527 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1617532 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 17:02:07 +00:00
Jing Zhao	04884cd530	Merging r1616894 through r1617376 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1617377 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 22:27:50 +00:00
Haohui Mai	80691b073f	HDFS-6838. Code cleanup for unnecessary INode replacement. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617361 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 21:28:33 +00:00
Jing Zhao	e60673697d	HDFS-6837. Code cleanup for Balancer and Dispatcher. Contributed by Tsz Wo Nicholas Sze. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617337 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 18:01:14 +00:00
Jing Zhao	9d5f8fa68d	Merging r1616428 through r1616893 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616897 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 22:21:35 +00:00
Jing Zhao	c3cf331dc9	HDFS-6828. Separate block replica dispatching from Balancer. Contributed by Tsz Wo Nicholas Sze. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616889 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:33:57 +00:00
Arpit Agarwal	05d1bf4157	HDFS-6830. Revert accidental checkin git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616884 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:22:48 +00:00
Arpit Agarwal	a70c9de3f1	HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616883 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:20:19 +00:00
Ravi Prakash	6da830cfdf	HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616845 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 18:21:18 +00:00
Chris Nauroth	70d453602c	HDFS-573. Porting libhdfs to Windows. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616814 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 16:26:45 +00:00
Uma Maheswara Rao G	1fa2d6c4ba	HDFS-6834. Improve the configuration guidance in DFSClient when there are no Codec classes found in configs. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616721 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 11:35:16 +00:00
Arpit Agarwal	d3a2fe2807	HDFS-6772. Get DN storages out of blockContentsStale state faster after NN restarts. (Contributed by Ming Ma) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616680 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 05:41:38 +00:00
Haohui Mai	2ac640ec75	HDFS-6722. Display readable last contact time for dead nodes on NN webUI. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616669 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 04:27:47 +00:00
Aaron Myers	d758be1f35	HDFS-6740. Make FSDataset support adding data volumes dynamically. Contributed by Lei Xu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616623 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 22:59:59 +00:00
Aaron Myers	eca80dca3e	HDFS-6728. Dynamically add new volumes to DataStorage, formatted if necessary. Contributed by Lei Xu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616615 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 22:46:51 +00:00
Andrew Wang	311d2f0773	Merge from trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616589 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 20:26:52 +00:00
Tsz-wo Sze	b50cb5e056	Merge r1609845 through r1616427 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1616428 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 07:38:23 +00:00
Tsz-wo Sze	0ed8732fee	HDFS-6812. Remove addBlock and replaceBlock from DatanodeDescriptor. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616426 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 07:30:53 +00:00
Tsz-wo Sze	83b9933db3	HDFS-6809. Move Balancer's inner classes MovedBlocks and Matcher as to standalone classes and separates KeyManager from NameNodeConnector. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616422 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 07:18:48 +00:00
Jing Zhao	efc73a0f13	HDFS-6791. A block could remain under replicated if all of its replicas are on decommissioned nodes. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616306 13f79535-47bb-0310-9956-ffa450edef68	2014-08-06 19:03:07 +00:00
Allen Wittenauer	6fa66f2357	HDFS-6517. Remove hadoop-metrics2.properties from hdfs project (Akira AJISAKA via aw) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616262 13f79535-47bb-0310-9956-ffa450edef68	2014-08-06 16:07:52 +00:00
Yi Liu	2b5e044424	HDFS-6817. Fix findbugs and other warnings. (yliu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616092 13f79535-47bb-0310-9956-ffa450edef68	2014-08-06 04:43:58 +00:00
Brandon Li	812ac91add	HDFS-6790. DFSUtil Should Use configuration.getPassword for SSL passwords. Contributed by Larry McCay git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616058 13f79535-47bb-0310-9956-ffa450edef68	2014-08-06 00:50:07 +00:00
Andrew Wang	ac47ad11de	HDFS-6394. HDFS encryption documentation. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616016 13f79535-47bb-0310-9956-ffa450edef68	2014-08-05 21:49:31 +00:00
Andrew Wang	ac73d416f3	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615844 13f79535-47bb-0310-9956-ffa450edef68	2014-08-05 02:30:54 +00:00
Uma Maheswara Rao G	431857d09d	HDFS-6787. Remove duplicate code in FSDirectory#unprotectedConcat. Contributed by Yi Liu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615622 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 15:44:44 +00:00
Uma Maheswara Rao G	6e421f78b3	HDFS-6814. Mistakenly dfs.namenode.list.encryption.zones.num.responses configured as boolean. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615525 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 10:04:33 +00:00
Uma Maheswara Rao G	10db613389	HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not loaded. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615523 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 09:56:57 +00:00
Vinayakumar B	33518e5613	HDFS-5185. DN fails to startup if one of the data dir is full. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615504 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 08:43:51 +00:00
Vinayakumar B	30a9ec26f7	HDFS-5723. Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615491 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 06:44:06 +00:00
Arpit Agarwal	bcf7ab1d0f	HDFS-6810. StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports. (Contributed by szetszwo) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615381 13f79535-47bb-0310-9956-ffa450edef68	2014-08-03 02:08:32 +00:00
Colin McCabe	1ba3f89714	HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615223 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 20:41:05 +00:00
Andrew Wang	07860b1c9e	HDFS-6788. Improve synchronization in BPOfferService with read write lock. Contributed by Yongjun Zhang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615190 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 18:56:06 +00:00
Andrew Wang	70c99278a9	HDFS-6780. Batch the encryption zones listing API. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615189 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 18:47:01 +00:00
Arpit Agarwal	45db4d204b	HDFS-6794. Update BlockManager methods to use DatanodeStorageInfo where possible. (Arpit Agarwal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615169 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 16:58:06 +00:00
Tsz-wo Sze	7e12b1912f	HDFS-6796. Improve the argument check during balancer command line parsing. Contributed by Benoy Antony git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615107 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 14:12:35 +00:00
Tsz-wo Sze	dc7744d2e5	Merge r1609845 through r1615019 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1615020 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 01:29:49 +00:00
Arpit Agarwal	b5b862e3af	HDFS-6797. DataNode logs wrong layoutversion during upgrade. (Contributed by Benoy Antony) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615017 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 01:13:42 +00:00
Tsz-wo Sze	b8597e6a10	HDFS-6685. Balancer should preserve storage type of replicas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615015 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 01:05:33 +00:00
Andrew Wang	beebb36595	Fix some merge errors that slipped through. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1615013 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 22:45:08 +00:00
Arpit Agarwal	b8b8f3f5e7	HDFS-6441. Add ability to exclude/include specific datanodes while balancing. (Contributed by Benoy Antony and Yu Li) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614812 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 06:02:46 +00:00
Charles Lamb	ab47b666d0	HDFS-6785. Should not be able to create encryption zone using path to a non-directory file. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614755 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 20:00:24 +00:00
Andrew Wang	7405953692	HDFS-6692. Add more HDFS encryption tests. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614735 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 18:39:48 +00:00
Chris Nauroth	535fe14ded	HDFS-6570. add api that enables checking if a user has certain permissions on a file. Contributed by Jitendra Pandey. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614723 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 17:49:09 +00:00
Steve Loughran	f6436c0720	HDFS-4629. Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614663 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 14:05:59 +00:00
Andrew Wang	c3fa0b5884	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614553 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 06:09:33 +00:00
Andrew Wang	09e7ff05df	HDFS-6778. The extended attributes javadoc should simply refer to the user docs. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614547 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 05:57:55 +00:00
Charles Lamb	9ca2f34c8f	HDFS-6730. Create a .RAW extended attribute namespace. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614535 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 01:35:04 +00:00
Andrew Wang	415223548d	HDFS-6771. Require specification of an encryption key when creating an encryption zone. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614519 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 23:39:38 +00:00
Andrew Wang	407bb3d3e4	HDFS-6509. Create a special /.reserved/raw directory for raw access to encrypted data. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1614490 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 21:11:26 +00:00
Tsz-wo Sze	10d6210322	Merge r1609845 through r1614231 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1614234 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 00:49:14 +00:00
Tsz-wo Sze	4f9ffc7455	HDFS-6739. Add getDatanodeStorageReport to ClientProtocol. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614215 13f79535-47bb-0310-9956-ffa450edef68	2014-07-28 23:43:39 +00:00
Charles Lamb	1d3e9ec935	merge from trunk r1613787 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613788 13f79535-47bb-0310-9956-ffa450edef68	2014-07-27 13:32:51 +00:00
Chris Nauroth	9bce3eca42	HDFS-6749. FSNamesystem methods should call resolvePath. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613561 13f79535-47bb-0310-9956-ffa450edef68	2014-07-26 04:18:28 +00:00
Colin McCabe	e85a3fecc6	HDFS-6750. The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613537 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 23:56:47 +00:00
Colin McCabe	57d8f829d9	HDFS-6755. There is an unnecessary sleep in the code path where DFSOutputStream#close gives up its attempt to contact the namenode (mitdesai21 via cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613522 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 22:12:37 +00:00
Andrew Wang	b9e4be4523	HDFS-6724. Decrypt EDEK before creating CryptoInputStream/CryptoOutputStream. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613490 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 18:33:10 +00:00
Vinayakumar B	2bb650146d	HDFS-5919. FileJournalManager doesn't purge empty and corrupt inprogress edits files (vinayakumarb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613355 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 07:02:53 +00:00
Andrew Wang	e670641bbf	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613334 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 23:55:15 +00:00
Andrew Wang	e171254d56	Name node cannot start if the path of a file under construction contains .snapshot. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613329 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 23:42:06 +00:00
Jing Zhao	8c6e172a0a	HDFS-6715. Webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613237 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 18:28:00 +00:00
Haohui Mai	a7855e1c33	HDFS-6723. New NN webUI no longer displays decommissioned state for dead node. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613220 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 17:59:45 +00:00
Haohui Mai	ef9b6a45c4	HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613195 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 17:28:31 +00:00
Todd Lipcon	2054453a39	HADOOP-10882. Move DirectBufferPool into common util. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613006 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 06:22:02 +00:00
Colin McCabe	a6b1d2a85c	HDFS-6114. Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr (vinayakumarb via cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612943 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 20:59:39 +00:00
Andrew Wang	552b4fb9f9	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612928 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 19:26:29 +00:00
Uma Maheswara Rao G	5343b43fd9	HDFS-6422. getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist. (Charles Lamb via umamahesh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612922 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 19:05:11 +00:00
Tsz-wo Sze	48dc486672	Merge r1609845 through r1612880 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612883 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 17:30:06 +00:00
Tsz-wo Sze	ac5e8aed7c	HDFS-6686. Change BlockPlacementPolicy to use fallback when some storage types are unavailable. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612880 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 17:25:06 +00:00
Charles Lamb	512b756973	HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in EZManager#createEncryptionZone. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612849 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 15:23:03 +00:00
Charles Lamb	687ce1a5fc	HDFS-6733. Creating encryption zone results in NPE when KeyProvider is null. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612843 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 14:51:06 +00:00
Brandon Li	853ed29f2d	HDFS-6731. Run 'hdfs zkfc -formatZK' on a server in a non-namenode will cause a null pointer exception. Contributed by Masatake Iwasaki git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612715 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 22:29:04 +00:00
Andrew Wang	69b75fca7a	HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612632 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 17:57:06 +00:00
Andrew Wang	c83c5b868e	HDFS-6701. Make seed optional in NetworkTopology#sortByDistance. Contributed by Ashwin Shankar. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612625 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 17:47:49 +00:00
Yi Liu	b52b80d7bd	HADOOP-10853. Refactor get instance of CryptoCodec and support create via algorithm/mode/padding. (yliu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612513 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 08:38:38 +00:00
Tsz-wo Sze	ee13f8bf3e	Merge r1609845 through r1612502 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612505 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 08:23:34 +00:00
Tsz-wo Sze	25b0e8471e	HDFS-6702. Change DFSClient to pass the StorageType from the namenode to datanodes and change datanode to write block replicas using the specified storage type. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612493 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 07:41:24 +00:00
Andrew Wang	b57ec16567	HDFS-6718. Remove EncryptionZoneManager lock. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612439 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 00:55:20 +00:00
Andrew Wang	7b466b3b70	HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612438 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 00:27:51 +00:00
Tsz-wo Sze	3de6c61f86	Merge r1609845 through r1612431 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612432 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 23:37:54 +00:00
Tsz-wo Sze	44d9bb26d6	HDFS-6680. BlockPlacementPolicyDefault does not choose favored nodes correctly. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612427 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 23:21:12 +00:00
Andrew Wang	cb20bb6117	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612403 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 21:44:50 +00:00
Tsz-wo Sze	ee3a32784f	Merge r1609845 through r1612268 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612270 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 13:48:02 +00:00
Tsz-wo Sze	0a736fbc17	HDFS-6679. Bump NameNodeLayoutVersion and update editsStored test files. Contributed by vinayakumarb git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612266 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 13:38:06 +00:00
Tsz-wo Sze	014be2510f	HDFS-6710. Change BlockPlacementPolicy to consider block storage policy in replica deletion. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1612265 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 13:34:10 +00:00
Tsz-wo Sze	7c18f8d55b	HDFS-6616. Add exclude-datanodes feature to WebHDFS redirection so that it will not redirect retries to the same datanode. Contributed by zhaoyunjiong git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611750 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 18:20:20 +00:00
Daryn Sharp	551024915d	HDFS-6599. 2.4 addBlock is 10 to 20 times slower compared to 0.23 (daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611737 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:58:07 +00:00
Tsz-wo Sze	2b07af0c59	Merge r1609845 through r1611734 from tunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611736 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:57:51 +00:00
Tsz-wo Sze	08466eaa00	HDFS-6700. BlockPlacementPolicy shoud choose storage but not datanode for deletion. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611731 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:40:03 +00:00
Chris Nauroth	5f9e52f745	HDFS-6597. Add a new option to NN upgrade to terminate the process after upgrade on NN is completed. Contributed by Danilo Vunjak. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611723 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:14:22 +00:00
Charles Lamb	962ef6939e	HDFS-6490. Fix the keyid format for generated keys in FSNamesystem.createEncryptionZone (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1611722 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 17:13:55 +00:00
Vinayakumar B	9f75b97a09	HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Liang Xie and Rakesh R ) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611562 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 08:48:52 +00:00
Vinayakumar B	8f0c341934	reverted HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R ) ........ git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611560 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 08:46:27 +00:00
Vinayakumar B	d2024f2e76	HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R ) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611556 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 08:32:40 +00:00
Vinayakumar B	2c5ceee6ab	HDFS-6655. Add 'header banner' to 'explorer.html' also in Namenode UI ( Contributed by Vinayakumar B ) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611538 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 04:27:09 +00:00
Tsz-wo Sze	04fd2012fd	Merge r1609845 through r1611528 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611531 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 02:21:21 +00:00
Jing Zhao	7ba5913797	HDFS-6667. In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611508 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 23:11:27 +00:00
Jing Zhao	f4151bbf4f	HDFS-6478. RemoteException can't be retried properly for non-HA scenario. Contributed by Ming Ma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611410 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 17:37:22 +00:00
Tsz-wo Sze	38af6101d8	HDFS-6671. Change BlockPlacementPolicy to consider block storage policy in replicaiton. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1611334 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 11:56:22 +00:00
Andrew Wang	ca52cb01c4	HDFS-6690. Deduplicate xattr names in memory. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611226 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 00:44:16 +00:00
Allen Wittenauer	c477a166e1	HDFS-2538. option to disable fsck dots. Contributed by Mohammad Kamrul Islam. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611220 13f79535-47bb-0310-9956-ffa450edef68	2014-07-16 23:55:32 +00:00
Andrew Wang	56c0bd4d37	Merge from trunk to branch git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610853 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 21:10:24 +00:00
Colin McCabe	7fe6ab7f91	HDFS-5809. BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610790 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 18:17:13 +00:00
Tsz-wo Sze	395c763aef	Merge r1609845 through r1610532 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610533 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 21:23:20 +00:00
Tsz-wo Sze	4f1fae88f8	HDFS-6670. Add block storage policy support with default HOT, WARM and COLD policies. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610529 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 21:11:22 +00:00
Tsz-wo Sze	6f41baa623	HDFS-6677. Change INodeFile and FSImage to support storage policy ID. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-6584@1610525 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 20:57:15 +00:00
Chris Nauroth	3b54223c0f	HDFS-2856. Fix block protocol so that Datanodes don't require root or jsvc. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610474 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 18:10:03 +00:00
Andrew Wang	d79f27b429	HDFS-6474. Namenode needs to get the actual keys and iv from the KeyProvider. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609833 13f79535-47bb-0310-9956-ffa450edef68	2014-07-11 20:54:47 +00:00
Vinayakumar B	952b0fb18c	HDFS-6630. Unable to fetch the block information by Browsing the file system on Namenode UI through IE9 ( Contributed by Haohui Mai) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609629 13f79535-47bb-0310-9956-ffa450edef68	2014-07-11 05:15:18 +00:00
Chris Nauroth	81930b75bd	HDFS-5202. Support Centralized Cache Management on Windows. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609618 13f79535-47bb-0310-9956-ffa450edef68	2014-07-11 03:06:11 +00:00
Kihwal Lee	8f520386fb	HDFS-6647. Edit log corruption when pipeline recovery occurs for deleted file present in snapshot. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609543 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 18:18:22 +00:00
Chris Nauroth	cce02e3bef	HDFS-6631. TestPread#testHedgedReadLoopTooManyTimes fails intermittently. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609534 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 18:03:32 +00:00
Tsz-wo Sze	e67b80ec3a	HDFS-6643. Refactor INodeWithAdditionalFields.PermissionStatusFormat and INodeFile.HeaderFormat. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609401 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 06:16:34 +00:00
Colin McCabe	d9c5f20333	HDFS-6622. Rename and AddBlock may race and produce invalid edits (kihwal via cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609384 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 04:03:02 +00:00
Colin McCabe	8044a12ac0	HDFS-6618. FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map (kihwal via cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609380 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 03:49:30 +00:00
Vinayakumar B	3b0db60113	HDFS-6646. [ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missed ( Contributed by Brahma Reddy Battula) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609020 13f79535-47bb-0310-9956-ffa450edef68	2014-07-09 06:05:44 +00:00
Chris Nauroth	709d5cbd71	HDFS-6627. Rename DataNode#checkWriteAccess to checkReadAccess. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608940 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 20:29:42 +00:00
Andrew Wang	ceed0f6c46	HDFS-6635. Refactor encryption zone functionality into new EncryptionZoneManager class. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608657 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 04:34:04 +00:00
Haohui Mai	76a621ffd2	HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 00:08:18 +00:00
Andrew Wang	dda85637df	Merge trunk to branch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608603 13f79535-47bb-0310-9956-ffa450edef68	2014-07-07 20:43:56 +00:00
Charles Lamb	83702b0707	HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1608389 13f79535-47bb-0310-9956-ffa450edef68	2014-07-07 09:51:49 +00:00
Charles Lamb	c386652828	HDFS-6516. List of Encryption Zones should be based on inodes (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607770 13f79535-47bb-0310-9956-ffa450edef68	2014-07-04 00:24:28 +00:00
Andrew Wang	151c5deaf1	HDFS-6511. BlockManager#computeInvalidateWork() could do nothing. Contributed by Juan Yu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607735 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 20:10:54 +00:00
Andrew Wang	f881f0e923	HDFS-6493. Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond. Contributed by Juan Yu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607732 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 20:02:14 +00:00
Andrew Wang	93e23a9915	HDFS-6613. Improve logging in caching classes. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607697 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 17:13:59 +00:00
Steve Loughran	b6fbaba8e9	HADOOP-9361: Strictly define FileSystem APIs - HDFS portion git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607597 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 12:09:45 +00:00
Charles Lamb	2a3bccddd9	HDFS-6625. Remove the Delete Encryption Zone function (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607507 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 00:58:45 +00:00
Andrew Wang	51b97a1396	HDFS-6605.Client server negotiation of cipher suite. (wang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1607499 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 23:08:29 +00:00
Colin McCabe	297e3c72fb	HDFS-6604. The short-circuit cache doesn't correctly time out replicas that haven't been used in a while (cmccabe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607456 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 19:43:36 +00:00
Chris Nauroth	0ca41a8f35	HDFS-6591. while loop is executed tens of thousands of times in Hedged Read. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606927 13f79535-47bb-0310-9956-ffa450edef68	2014-06-30 20:46:44 +00:00
Kihwal Lee	e8186a9dee	HDFS-6558. Missing newline in the description of dfsadmin -rollingUpgrade. Contributed by Chen He. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606855 13f79535-47bb-0310-9956-ffa450edef68	2014-06-30 18:17:56 +00:00
Steve Loughran	2f75cd1190	HDFS-6418. Regression: DFS_NAMENODE_USER_NAME_KEY missing git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606536 13f79535-47bb-0310-9956-ffa450edef68	2014-06-29 16:27:24 +00:00
Kihwal Lee	94a1462bd5	HDFS-6601. Issues in finalizing rolling upgrade when there is a layout version change. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606371 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 15:21:46 +00:00
Uma Maheswara Rao G	78cafe34e6	HDFS-6556. Refine XAttr permissions. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606320 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 11:40:02 +00:00
Charles Lamb	31617733ac	HDFS-6389. Rename restrictions for encryption zones. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1606253 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 21:45:18 +00:00
Andrew Wang	2efea95213	HDFS-6391. Get the Key/IV from the NameNode for encrypted files in DFSClient. Contributed by Charles Lamb and Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1606220 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 20:43:41 +00:00
Chris Nauroth	280bdb9a16	HDFS-6572. Add an option to the NameNode that prints the software and on-disk image versions. Contributed by Charles Lamb. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605928 13f79535-47bb-0310-9956-ffa450edef68	2014-06-26 23:12:45 +00:00
Tsz-wo Sze	e3612e4428	HDFS-6595. Allow the maximum threads for balancing on datanodes to be configurable. Contributed by Benoy Antony git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605565 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 19:27:29 +00:00
Charles Lamb	2676365799	HDFS-6387. HDFS CLI admin tool for creating & deleting an encryption zone. (clamb) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1605518 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 17:42:03 +00:00
Tsz-wo Sze	988bc17bc3	HADOOP-10674. Improve PureJavaCrc32 performance and use java.util.zip.CRC32 for Java 7 and above. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605239 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 02:22:15 +00:00

... 8 9 10 11 12 ...

3191 Commits