big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,529 Commits 2 Branches 2 Tags 264 MiB
a4baabe4a4
Commit Graph

136 Commits

Author SHA1 Message Date
Hairong Kuang
a4baabe4a4 HDFS-2477. Optimize computing the diff between a block report and the namenode state. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196676 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 16:31:21 +00:00
Jitendra Nath Pandey
bd21ddcb78 HDFS-2416. distcp with a webhdfs uri on a secure cluster fails. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196434 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 02:08:20 +00:00
Aaron Myers
abe45f59ac HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196171 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 17:59:53 +00:00
Eli Collins
4961441584 HDFS-2308. NamenodeProtocol.endCheckpoint is vestigial and can be removed. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196113 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 16:44:28 +00:00
Arun Murthy
4e42044b1c Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:46:22 +00:00
Konstantin Shvachko
22000ce96d HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195869 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:37:11 +00:00
Arun Murthy
a3a4ccfed7 Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 06:02:53 +00:00
Todd Lipcon
1c940637b1 HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195829 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 05:17:08 +00:00
Tsz-wo Sze
bb8fd6a267 TestHDFSCLI is failing due to HADOOP-7360. HDFS-2038 is going to fix it. Disable it for the moment. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195754 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:31:06 +00:00
Tsz-wo Sze
8d1a09b741 HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195731 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 00:38:57 +00:00
Todd Lipcon
c46876982e HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195693 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 21:53:58 +00:00
Tsz-wo Sze
32cad9affe HDFS-2385. Support renew and cancel delegation tokens in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195656 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 20:37:16 +00:00
Jitendra Nath Pandey
7cb77a3b1b HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195620 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 19:03:55 +00:00
Konstantin Shvachko
64c019cccc HDFS-2285. BackupNode should reject requests to modify namespace. Contributed by Konstantin Shvachko and Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195013 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 20:11:35 +00:00
Tsz-wo Sze
2eca60199a Revert 1190677 for HDFS-2509. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194986 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 19:31:06 +00:00
Tsz-wo Sze
2dcd43c7b1 HDFS-2436. Change FSNamesystem.setTimes(..) for allowing setting times on directories. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190708 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 00:19:21 +00:00
Thomas White
cd77a1668f HADOOP-7763. Add top-level navigation to APT docs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190703 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 00:16:16 +00:00
Tsz-wo Sze
c8ac31e9a0 HDFS-2509. Add a test for DistributedFileSystem.getFileChecksum(..) on directories or non existing files. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190677 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 23:42:27 +00:00
Todd Lipcon
6b0963c53b HDFS-2465. Add HDFS support for fadvise readahead and drop-behind. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190626 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:18:42 +00:00
Suresh Srinivas
c0c938f242 HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190620 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:06:04 +00:00
Tsz-wo Sze
9692cfc9ae HDFS-2493. Remove reference to FSNamesystem in blockmanagement classes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190491 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 18:28:26 +00:00
Eric Yang
da1db28e93 HADOOP-7740. Fixed security audit logger configuration. (Arpit Gupta via Eric Yang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190452 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 17:08:09 +00:00
Sanjay Radia
b49c95a5d9 HDFS-2479 HDFS Client Data Types in Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190127 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:52:00 +00:00
Tsz-wo Sze
4a98639a55 Move HDFS-2355, HDFS-2371 and HDFS-2298 entries from trunk to 0.23 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190126 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:48:12 +00:00
Tsz-wo Sze
8cb0d4b380 HDFS-2432. Webhdfs: response FORBIDDEN when setReplication on non-files; clear umask before creating a flie; throw IllegalArgumentException if setOwner with both owner and group empty; throw FileNotFoundException if getFileStatus on non-existing files; fix bugs in getBlockLocations; and changed getFileChecksum json response root to "FileChecksum". 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190077 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 23:13:26 +00:00
Todd Lipcon
221aadbc5b HDFS-2500. Avoid file system operations in BPOfferService thread while processing deletes. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190071 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 22:47:19 +00:00
Todd Lipcon
646e855f6e HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190060 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 22:11:10 +00:00
Suresh Srinivas
456ca74b96 HDFS-2496. Separate datatypes for DatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189901 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 18:09:42 +00:00
Tsz-wo Sze
10dc6b0927 HDFS-1869. mkdirs should use the supplied permission for all of the created directories. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189546 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 00:02:19 +00:00
Tsz-wo Sze
753c14cf4e Move webhdfs entries from trunk to 0.23 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189541 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 23:49:45 +00:00
Tsz-wo Sze
758194382c HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189360 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:24:29 +00:00
Jitendra Nath Pandey
8534e70044 HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189355 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:15:58 +00:00
Tsz-wo Sze
8335995630 HDFS-2501. Add version prefix and root methods to webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189028 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 05:16:57 +00:00
Mahadev Konar
d19cfe0164 MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188522 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:07:13 +00:00
Suresh Srinivas
a268a3c0e4 HDFS-2488. Separate datatypes for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188487 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 01:32:49 +00:00
Suresh Srinivas
4846ca7863 HDFS-2497 Fix TestBackupNode failure. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188436 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 23:07:13 +00:00
Sanjay Radia
0920056f04 HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188300 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 19:08:03 +00:00
Suresh Srinivas
8fe95d276d Added missing files for HDFS-2489 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188286 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 18:46:59 +00:00
Suresh Srinivas
2b35e8aa4f HDFS-2489. Move Finalize and Register to separate file out of DatanodeCommand.java. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188282 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 18:40:13 +00:00
Konstantin Shvachko
6e0991704f HDFS-2452. OutOfMemoryError in DataXceiverServer takes down the DataNode. Contributed by Uma Maheswara Rao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187965 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 20:17:04 +00:00
Steve Loughran
a54ccc0bde HDFS-2485 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187888 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 14:14:22 +00:00
Steve Loughran
2690d0db0e HDFS-2485 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187887 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 14:13:58 +00:00
Konstantin Shvachko
7dd869c2a9 HDFS-2491. TestBalancer can fail when datanode utilization and avgUtilization is exactly same. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187837 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 00:35:55 +00:00
Suresh Srinivas
d2e1a71918 HDFS-2480. Separate datatypes for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187505 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 19:03:18 +00:00
Tsz-wo Sze
7c48130d41 HDFS-2427. Change the default permission in webhdfs to 755 and add range check/validation for all parameters. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187140 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 00:27:08 +00:00
Suresh Srinivas
520d2502c5 HDFS-2459. Separate datatypes for Journal Protocol. (suresh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186896 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 16:31:57 +00:00
Suresh Srinivas
37137845c8 Merging change r1186579 for HDFS-2471 from 0.23 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186584 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 00:38:42 +00:00
Arun Murthy
a6cc9bafa8 HDFS-2445. Ensure failed tests exit with proper error code. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186550 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:51:51 +00:00
Tsz-wo Sze
0bd8f0bd40 HDFS-2453. Fix http response code for partial content in webhdfs, added getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem and cleared content type in ExceptionHandler. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186508 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:38:58 +00:00
Alejandro Abdelnur
01d408d5b0 Reverted HDFS-2474 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186501 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:29:01 +00:00