big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9,788 Commits 2 Branches 2 Tags 264 MiB
24aa462673
Commit Graph

3888 Commits

Author SHA1 Message Date
Tsuyoshi Ozawa
9886396400 Revert "Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)" because of missing JIRA's number. 
This reverts commit 2eba7eb9af.
 2015-01-08 14:35:08 +09:00
Tsuyoshi Ozawa
2eba7eb9af Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 2015-01-08 14:21:30 +09:00
Konstantin V Shvachko
e86943fd64 HDFS-7561. TestFetchImage should write fetched-image-dir under target. Contributed by Liang Xie. 2015-01-07 16:03:11 -08:00
Brandon Li
788ee35e2b HDFS-7564. NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map. Contributed by Yongjun Zhang 2015-01-06 16:19:39 -08:00
Vinayakumar B
4cd66f7fb2 HDFS-7583. Fix findbug in TransferFsImage.java (Contributed by Vinayakumar B) 2015-01-06 09:31:35 +05:30
cnauroth
dfd2589bcb HDFS-7572. TestLazyPersistFiles#testDnRestartWithSavedReplicas is flaky on Windows. Contributed by Arpit Agarwal. 2015-01-05 10:39:15 -08:00
Brandon Li
892b1bb746 HDFS-7563. NFS gateway parseStaticMap NumberFormatException. Contributed by Yongjun Zhang 2015-01-02 10:49:50 -08:00
Jing Zhao
5caebbae8c HDFS-7484. Make FSDirectory#addINode take existing INodes as its parameter. Contributed by Jing Zhao. 2014-12-22 23:19:20 -08:00
Vinayakumar B
50ae1a6664 HDFS-7456. De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode (Contributed by Vinayakumar B) 2014-12-23 12:35:53 +05:30
cnauroth
2cf90a2c33 HDFS-7560. ACLs removed by removeDefaultAcl() will be back after NameNode restart/failover. Contributed by Vinayakumar B. 2014-12-22 13:59:10 -08:00
yliu
7bc0a6d5c2 HDFS-7557. Fix spacing for a few keys in DFSConfigKeys.java (Colin P. McCabe) 2014-12-22 00:49:13 +08:00
Colin Patrick Mccabe
8fa265a290 HDFS-7443. Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume (cmccabe) 2014-12-19 13:18:03 -08:00
Colin Patrick Mccabe
a4876c130f HDFS-7552. Change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration (Liang Xie via Colin P. McCabe) 2014-12-19 11:13:04 -08:00
Colin Patrick Mccabe
6635ccd217 HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe) 2014-12-18 19:39:04 -08:00
cnauroth
5df7ecb33a HDFS-7431. log message for InvalidMagicNumberException may be incorrect. Contributed by Yi Liu. 2014-12-18 15:03:52 -08:00
Andrew Wang
b0b9084433 HDFS-7530. Allow renaming of encryption zone roots. Contributed by Charles Lamb. 2014-12-18 14:06:53 -08:00
Haohui Mai
65f2a4ee60 HDFS-7543. Avoid path resolution when getting FileStatus for audit logs. Contributed by Haohui Mai. 2014-12-18 11:25:14 -08:00
Kihwal Lee
c0d666c74e HDFS-7373. Clean up temporary files after fsimage transfer failures. Contributed by Kihwal Lee 2014-12-18 12:58:59 -06:00
Colin Patrick Mccabe
3b173d9517 HDFS-7531. Improve the concurrent access on FsVolumeList (Lei Xu via Colin P. McCabe) 2014-12-17 16:41:59 -08:00
Haohui Mai
0da1330bfd HDFS-7528. Consolidate symlink-related implementation into a single class. Contributed by Haohui Mai. 2014-12-17 14:48:30 -08:00
Colin Patrick Mccabe
4281c96e24 HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) 2014-12-17 10:32:40 -08:00
Haohui Mai
565d72fe6e HDFS-7536. Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs. Contributed by Haohui Mai. 2014-12-16 13:26:37 -08:00
Colin Patrick Mccabe
a97a1e7317 HDFS-7494. Checking of closed in DFSInputStream#pread() should be protected by synchronization (Ted Yu via Colin P. McCabe) 2014-12-16 11:07:27 -08:00
Kihwal Lee
b7923a356e HDFS-6425. Large postponedMisreplicatedBlocks has impact on blockReport latency. Contributed by Ming Ma. 2014-12-16 10:30:22 -06:00
Brandon Li
42d8858c5d HDFS-7516. Fix findbugs warnings in hdfs-nfs project. Contributed by Brandon Li 2014-12-15 11:28:56 -08:00
Haohui Mai
832ebd8cb6 HDFS-7506. Consolidate implementation of setting inode attributes into a single class. Contributed by Haohui Mai. 2014-12-15 10:40:33 -08:00
Colin Patrick Mccabe
6e13fc62e1 HDFS-7513. HDFS inotify: add defaultBlockSize to CreateEvent (cmccabe) 2014-12-15 10:30:30 -08:00
Andrew Wang
fa7b9248e4 HDFS-7426. Change nntop JMX format to be a JSON blob. 2014-12-12 17:04:33 -08:00
Jing Zhao
c78e3a7cdd HDFS-7059. Avoid resolving path multiple times. Contributed by Jing Zhao. 2014-12-12 15:13:35 -08:00
arp
7784b10808 HDFS-7514. TestTextCommand fails on Windows. (Arpit Agarwal) 2014-12-12 14:27:50 -08:00
Haohui Mai
46612c7a51 HDFS-7517. Remove redundant non-null checks in FSNamesystem#getBlockLocations. Contributed by Haohui Mai. 2014-12-12 11:51:17 -08:00
Andrew Wang
b437f5eef4 HDFS-7497. Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui. Contributed by Yongjun Zhang. 2014-12-11 18:12:47 -08:00
Haohui Mai
5b9fcedb4d HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. Contributed by Haohui Mai. 2014-12-11 16:42:38 -08:00
Brandon Li
f6f2a3f1c7 HDFS-7449. Add metrics to NFS gateway. Contributed by Brandon Li 2014-12-11 15:40:45 -08:00
Haohui Mai
b9f6d0c956 HDFS-7515. Fix new findbugs warnings in hadoop-hdfs. Contributed by Haohui Mai. 2014-12-11 12:36:13 -08:00
arp
390642acf3 HDFS-7503. Namenode restart after large deletions can cause slow processReport (Arpit Agarwal) 2014-12-10 23:44:28 -08:00
Haohui Mai
d693a252bd HDFS-7463. Simplify FSNamesystem#getBlockLocationsUpdateTimes. Contributed by Haohui Mai. 2014-12-10 23:01:17 -08:00
arp
9a44db48b4 HDFS-7475. Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic. (Contributed by Xiaoyu Yao) 2014-12-10 18:24:22 -08:00
Haohui Mai
92916ae487 HDFS-5578. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Andrew Purtell. 2014-12-10 14:54:37 -08:00
Allen Wittenauer
c536142699 HADOOP-6590. Add a username check for hadoop sub-commands (John Smith via aw) 2014-12-10 13:41:28 -08:00
Allen Wittenauer
a7c6c710b2 HADOOP-10950. rework heap management vars (John Smith via aw) 2014-12-10 13:37:32 -08:00
Haohui Mai
195f31a8ef HDFS-7502. Fix findbugs warning in hdfs-nfs project. Contributed by Brandon Li. 2014-12-09 20:42:42 -08:00
Vinayakumar B
d93f3b9815 HDFS-7481. Add ACL indicator to the 'Permission Denied' exception. (Contributed by Vinayakumar B ) 2014-12-10 08:27:15 +05:30
Jing Zhao
5776a41da0 HDFS-7498. Simplify the logic in INodesInPath. Contributed by Jing Zhao. 2014-12-09 11:37:39 -08:00
Colin Patrick Mccabe
d8352b9b2b Incorrect locking in FsVolumeList#checkDirs can hang datanodes (Noah Lorang via Colin P. McCabe) 2014-12-09 10:56:46 -08:00
Haohui Mai
6c5bbd7a42 HDFS-7486. Consolidate XAttr-related implementation into a single class. Contributed by Haohui Mai. 2014-12-08 11:52:21 -08:00
cnauroth
d555bb2120 HDFS-7473. Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid. Contributed by Akira AJISAKA. 2014-12-08 11:04:29 -08:00
cnauroth
ffe942b82c HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B. 2014-12-08 10:23:09 -08:00
cnauroth
9297f980c2 HDFS-7476. Consolidate ACL-related operations to a single class. Contributed by Haohui Mai. 2014-12-06 14:20:00 -08:00
Haohui Mai
e227fb8fbc HDFS-7459. Consolidate cache-related implementation in FSNamesystem into a single class. Contributed by Haohui Mai. 2014-12-05 18:37:07 -08:00
Jing Zhao
475c6b4978 HDFS-7474. Avoid resolving path in FSPermissionChecker. Contributed by Jing Zhao. 2014-12-05 14:17:17 -08:00
Haohui Mai
f6452eb259 HDFS-7472. Fix typo in message of ReplicaNotFoundException. Contributed by Masatake Iwasaki. 2014-12-05 11:23:13 -08:00
Haohui Mai
6a5596e3b4 HDFS-7478. Move org.apache.hadoop.hdfs.server.namenode.NNConf to FSNamesystem. Contributed by Li Lu. 2014-12-05 10:55:13 -08:00
Haohui Mai
0653918dad HDFS-7454. Reduce memory footprint for AclEntries in NameNode. Contributed by Vinayakumar B. 2014-12-04 20:49:45 -08:00
Haohui Mai
26d8dec756 HDFS-7468. Moving verify* functions to corresponding classes. Contributed by Li Lu. 2014-12-04 14:09:45 -08:00
Brandon Li
1bbcc3d032 HDFS-7424. Add web UI for NFS gateway. Contributed by Brandon Li 2014-12-04 10:46:26 -08:00
Brandon Li
a1e822595c HDFS-7458. Add description to the nfs ports in core-site.xml used by nfs test to avoid confusion. Contributed by Yongjun Zhang 2014-12-03 13:31:26 -08:00
Steve Loughran
22afae890d HDFS-7448 TestBookKeeperHACheckpoints fails in trunk -move CHANGES.TXT entry 2014-12-03 12:21:42 +00:00
stack
7caa3bc98e HDFS-6735. A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream (Lars Hofhansl via stack) 2014-12-02 20:57:38 -08:00
Colin Patrick Mccabe
75a326aaff HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to (cmccabe) 2014-12-02 17:15:21 -08:00
Haohui Mai
185e0c7b4c HDFS-7462. Consolidate implementation of mkdirs() into a single class. Contributed by Haohui Mai. 2014-12-02 14:53:45 -08:00
Steve Loughran
75d53456ea HDFS-7448 TestBookKeeperHACheckpoints fails in trunk build 2014-12-02 15:04:26 +00:00
Haohui Mai
042699401e HDFS-7438. Consolidate the implementation of rename() into a single class. Contributed by Haohui Mai. 2014-12-01 21:48:28 -08:00
Haohui Mai
0af44ea846 HDFS-7450. Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class. Contributed by Haohui Mai. 2014-12-01 21:36:25 -08:00
Allen Wittenauer
031f980e7e HADOOP-11081. Document hadoop properties expected to be set by the shell code in *-env.sh (aw) 2014-12-01 16:21:20 -08:00
Uma Maheswara Rao G
1556f86a31 HDFS-7210. Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient. (Vinayakumar B via umamahesh) 2014-11-28 21:09:16 +05:30
Haohui Mai
978736d486 HDFS-7444. Addendum patch to resolve conflicts between HDFS-7444 and HDFS-7310. 2014-11-26 10:53:53 -08:00
Haohui Mai
f5b1631179 HDFS-7444. convertToBlockUnderConstruction should preserve BlockCollection. Contributed by Haohui Mai. 2014-11-26 10:37:01 -08:00
Uma Maheswara Rao G
058af60c56 HDFS-7310. Mover can give first priority to local DN if it has target storage type available in local DN. (Vinayakumar B via umamahesh) 2014-11-26 23:27:25 +05:30
Steve Loughran
aa7dac3359 HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:44:03 +00:00
Haohui Mai
4a31611829 HDFS-7440. Consolidate snapshot related operations in a single class. Contributed by Haohui Mai. 2014-11-25 21:04:52 -08:00
Andrew Wang
f43a20c529 HDFS-7097. Allow block reports to be processed during checkpointing on standby name node. (kihwal via wang) 2014-11-25 15:37:11 -08:00
Haohui Mai
45fa7f0235 HDFS-7303. NN UI fails to distinguish datanodes on the same host. Contributed by Benoy Antony. 2014-11-24 17:46:35 -08:00
Haohui Mai
8caf537afa HDFS-7436. Consolidate implementation of concat(). Contributed by Haohui Mai. 2014-11-24 15:42:38 -08:00
Colin Patrick Mccabe
380a361cfa CHANGES.txt: add HDFS-7419 2014-11-24 11:50:00 -08:00
Colin Patrick Mccabe
6970dbf366 CHANGES.txt: add HDFS-4882 2014-11-24 11:44:32 -08:00
Haohui Mai
8e253cb930 HDFS-7412. Move RetryCache to NameNodeRpcServer. Contributed by Haohui Mai. 2014-11-24 11:11:15 -08:00
Colin Patrick Mccabe
f636f9d943 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe) 2014-11-24 10:55:21 -08:00
Colin Patrick Mccabe
daacbc18d7 HDFS-4882. Prevent the Namenode's LeaseManager from looping forever in checkLeases (Ravi Prakash via Colin P. McCabe) 2014-11-24 10:46:33 -08:00
yliu
555fa2d9d0 HDFS-7403. Inaccurate javadoc of BlockUCState#COMPLETE state. (Yongjun Zhang via yliu) 2014-11-24 04:17:17 +08:00
Aaron T. Myers
2d4f3e567e HDFS-7331. Add Datanode network counts to datanode jmx page. Contributed by Charles Lamb. 2014-11-21 16:36:39 -08:00
cnauroth
b8c094b075 HDFS-7425. NameNode block deletion logging uses incorrect appender. Contributed by Chris Nauroth. 2014-11-21 16:35:08 -08:00
Karthik Kambatla
1e9a3f42ff Update release date for 2.5.2 2014-11-21 14:34:23 -08:00
Haohui Mai
23dacb3892 HDFS-7420. Delegate permission checks to FSDirectory. Contributed by Haohui Mai. 2014-11-21 11:01:14 -08:00
Haohui Mai
c95b878abf HDFS-7415. Move FSNameSystem.resolvePath() to FSDirectory. Contributed by Haohui Mai. 2014-11-20 19:23:23 -08:00
Haohui Mai
acf1e033b0 HDFS-7413. Some unit tests should use NameNodeProtocols instead of FSNameSystem. Contributed by Haohui Mai. 2014-11-20 10:27:44 -08:00
Andrew Wang
765aecb4e1 HDFS-7409. Allow dead nodes to finish decommissioning if all files are fully replicated. 2014-11-19 17:53:00 -08:00
Allen Wittenauer
72c141ba96 HADOOP-11208. Replace "daemon" with better name in script subcommands (aw) 2014-11-19 14:49:29 -08:00
Allen Wittenauer
73348a4afd HDFS-7407. Minor typo in privileged pid/out/log names (aw) 2014-11-19 14:02:28 -08:00
Andrew Wang
5bd048e837 HDFS-7373. Allow decommissioning of dead DataNodes. Contributed by Zhe Zhang. 2014-11-18 22:16:58 -08:00
Andrew Wang
406c09ad11 HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang) 2014-11-18 22:14:04 -08:00
cnauroth
9e81be0114 HDFS-7398. Reset cached thread-local FSEditLogOp's on every FSEditLog#logEdit. Contributed by Gera Shegalov. 2014-11-18 16:56:44 -08:00
Haohui Mai
fbf81fbd1c HDFS-7406. SimpleHttpProxyHandler puts incorrect "Connection: Close" header. Contributed by Haohui Mai. 2014-11-18 14:52:59 -08:00
Andrew Wang
bcd402ae38 HADOOP-11312. Fix unit tests to not use uppercase key names. 2014-11-18 10:47:46 -08:00
Haohui Mai
9dd5d673c9 HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu. 2014-11-17 17:35:36 -08:00
Andrew Wang
dcb8e24427 HDFS-6982. nntop: top­-like tool for name node users. (Maysam Yabandeh via wang) 2014-11-17 17:33:42 -08:00
Brandon Li
351c5561c2 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 2014-11-17 13:23:53 -08:00
Haohui Mai
bf8e4332cb HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. 2014-11-17 11:42:20 -08:00
Vinayakumar B
6783d17fcf HDFS-7399. Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() (Contributed by Vinayakumar B) 2014-11-17 20:19:19 +05:30
Colin Patrick Mccabe
26d3b7e6ae HDFS-7394. Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCache (Keith Pak via Colin P. McCabe) 2014-11-16 21:20:53 -08:00