Commit Graph

27132 Commits

Author SHA1 Message Date
Dhruba Borthakur
c4e1126980 HADOOP-6433. Introduce asychronous deletion of files via a pool of
threads. This can be used to delete files in the Distributed Cache. 
(Zheng Shao via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890502 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 22:17:19 +00:00
Doug Cutting
2ee80854a5 HADOOP-6422. Remove log line.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890410 13f79535-47bb-0310-9956-ffa450edef68
2009-12-14 17:45:51 +00:00
Doug Cutting
6c842ad4b5 AVRO-6422. Make RPC backend plugable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889889 13f79535-47bb-0310-9956-ffa450edef68
2009-12-12 04:37:06 +00:00
Doug Cutting
843ac12f7a HADOOP-6323. Add comparators to the serialization API. Contributed by Aaron Kimball.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889877 13f79535-47bb-0310-9956-ffa450edef68
2009-12-12 01:26:22 +00:00
Thomas White
f9cb8b0d45 Add pyAntTasks jar for HADOOP 6426.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889845 13f79535-47bb-0310-9956-ffa450edef68
2009-12-11 22:49:41 +00:00
Konstantin Boudnik
d7fb2d3c85 HADOOP-6428. HttpServer sleeps with negative values. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889378 13f79535-47bb-0310-9956-ffa450edef68
2009-12-10 19:26:07 +00:00
Thomas White
a473f37733 HADOOP-6346. Add support for specifying unpack pattern regex to RunJar.unJar. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889018 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 23:25:51 +00:00
Thomas White
2e5fd1c0ab HADOOP-6392. Run namenode and jobtracker on separate EC2 instances.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888998 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 21:57:10 +00:00
Thomas White
368b6cc85b HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888697 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 04:17:02 +00:00
Konstantin Boudnik
929e91a08c HADOOP-6386. NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888565 13f79535-47bb-0310-9956-ffa450edef68
2009-12-08 20:50:47 +00:00
Jakob Homan
934deda190 HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887472 13f79535-47bb-0310-9956-ffa450edef68
2009-12-05 00:46:08 +00:00
Konstantin Boudnik
3549d30d7e HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887047 13f79535-47bb-0310-9956-ffa450edef68
2009-12-04 03:18:27 +00:00
Thomas White
8d6c5c41f2 HADOOP-6400. Log errors getting Unix UGI. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886645 13f79535-47bb-0310-9956-ffa450edef68
2009-12-03 01:14:15 +00:00
Konstantin Boudnik
ef643fd06b HADOOP-6405. Update Eclipse configuration to match changes to Ivy configuration. Contributed by Edwin Chan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886348 13f79535-47bb-0310-9956-ffa450edef68
2009-12-03 00:44:00 +00:00
Tsz-wo Sze
98beeca09d HADOOP-6307. Add a new SequenceFile.Reader constructor in order to support reading on un-closed file.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886003 13f79535-47bb-0310-9956-ffa450edef68
2009-12-01 23:25:56 +00:00
Thomas White
ff6c0ef547 HADOOP-6108. Add support for EBS storage on EC2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885888 13f79535-47bb-0310-9956-ffa450edef68
2009-12-01 19:33:10 +00:00
Konstantin Boudnik
36700348c1 HADOOP-6398. Build is broken after HADOOP-6395 patch has been applied. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885534 13f79535-47bb-0310-9956-ffa450edef68
2009-11-30 18:52:34 +00:00
Owen O'Malley
fc880f9794 HADOOP-6395. Upgrade some libraries to be consistent across common, hdfs,
and mapreduce. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@884428 13f79535-47bb-0310-9956-ffa450edef68
2009-11-26 07:33:38 +00:00
Christopher Douglas
f6990e06b4 HADOOP-6375. Sync documentation for FsShell du with its implementation.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@883206 13f79535-47bb-0310-9956-ffa450edef68
2009-11-23 00:59:29 +00:00
Christopher Douglas
09ec9c4ffc HADOOP-6269. Fix threading issue with defaultResource in Configuration.
Contributed by Sreekanth Ramakrishnan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@882831 13f79535-47bb-0310-9956-ffa450edef68
2009-11-21 04:22:02 +00:00
Devaraj Das
bd92322d22 HADOOP-6367. Removes Access Token implementation from common. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@881509 13f79535-47bb-0310-9956-ffa450edef68
2009-11-17 20:59:46 +00:00
Tsz-wo Sze
cdcb8514a0 HADOOP-6314. Fix "fs -help" for the "-count" commond. Contributed by Ravi Phulari
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@836019 13f79535-47bb-0310-9956-ffa450edef68
2009-11-13 22:10:01 +00:00
Konstantin Boudnik
2eba5972ed HADOOP-6366. Reduce ivy console output to ovservable level. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@835967 13f79535-47bb-0310-9956-ffa450edef68
2009-11-13 19:44:14 +00:00
Devaraj Das
ad88440651 HADOOP-6337. Updates FilterInitializer class to be more visible, and the init of the class is made to take a Configuration argument. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@833553 13f79535-47bb-0310-9956-ffa450edef68
2009-11-06 20:54:40 +00:00
Giridharan Kesavan
af59233ce1 HADOOP-6341. Fix test-patch.sh for checkTests function. ( gkesavan )
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832590 13f79535-47bb-0310-9956-ffa450edef68
2009-11-03 22:53:08 +00:00
Tsz-wo Sze
f5f95fe43a HADOOP-6343. Log unexpected throwable object caught in RPC. Contributed by Jitendra Nath Pandey
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832249 13f79535-47bb-0310-9956-ffa450edef68
2009-11-03 01:30:11 +00:00
Konstantin Boudnik
408117957e HADOOP-6347. run-test-core-fault-inject runs a test case twice if -Dtestcase is set. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832157 13f79535-47bb-0310-9956-ffa450edef68
2009-11-02 22:26:56 +00:00
Suresh Srinivas
382af3f627 HADOOP-6344. Fix rm and rmr immediately delete files rather than sending to trash, if a user is over-quota. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831478 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 22:39:01 +00:00
Suresh Srinivas
3f371a0a64 Hadoop-6223. Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831475 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 22:24:22 +00:00
Suresh Srinivas
b5c31f4ee6 HADOOP-6313. Implement Syncable interface in FSDataOutputStream to expose flush APIs to application users. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831416 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 18:33:00 +00:00
Tsz-wo Sze
a5427fc7eb HADOOP-6334. Fix GenericOptionsParser and Path to have a better URI support. Contributed by Amareshwari Sriramadasu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831412 13f79535-47bb-0310-9956-ffa450edef68
2009-10-30 18:21:26 +00:00
Owen O'Malley
b828f4ee78 HADOOP-5107. Remove generated files from subversion.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831070 13f79535-47bb-0310-9956-ffa450edef68
2009-10-29 19:42:06 +00:00
Owen O'Malley
f0f3fdbd3d HADOOP-5107. Use Maven ant tasks to publish the subproject jars.
(Giridharan Kesavan via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831032 13f79535-47bb-0310-9956-ffa450edef68
2009-10-29 17:08:42 +00:00
Doug Cutting
f9dee28085 HADOOP-6318. Move CHANGES.txt message to 0.21 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829289 13f79535-47bb-0310-9956-ffa450edef68
2009-10-24 00:17:24 +00:00
Doug Cutting
a13a0f3fba HADOOP-6318. Upgrade to Avro 1.2.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829279 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 23:36:29 +00:00
Konstantin Boudnik
d7a7f02c3e HADOOP-6326. Hundson runs should check for AspectJ warnings and report failure if any is present. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829269 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 22:33:57 +00:00
Tsz-wo Sze
9b0a0745d8 HADOOP-6329. Add build-fi directory to the ignore lists.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829165 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 18:26:01 +00:00
Tsz-wo Sze
4f4c74f76e HADOOP-6327. FileContext tests should not use /tmp and should clean up files. Contributed by Sanjay Radia
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828886 13f79535-47bb-0310-9956-ffa450edef68
2009-10-22 22:46:39 +00:00
Devaraj Das
19e8d6ad67 HADOOP-6218. Moving the commit comment to 0.20.2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828181 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 20:11:21 +00:00
Christopher Douglas
22bb3c6b77 Remove entries moved to 0.20.2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827860 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 01:10:08 +00:00
Christopher Douglas
449ac4ab87 HADOOP-6292. Update native libraries guide. Contributed by Corinne Chandel
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827855 13f79535-47bb-0310-9956-ffa450edef68
2009-10-21 00:32:20 +00:00
Christopher Douglas
7313955d04 HADOOP-6097. Fix Path conversion in makeQualified and reset LineReader byte
count at the start of each block in Hadoop archives. Contributed by Ben Slusky,
Tom White, and Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827837 13f79535-47bb-0310-9956-ffa450edef68
2009-10-20 23:39:49 +00:00
Christopher Douglas
1ecee2e062 HADOOP-6312. Remove unnecessary debug logging in Configuration constructor. Contributed by Aaron Kimball
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826141 13f79535-47bb-0310-9956-ffa450edef68
2009-10-17 00:22:39 +00:00
Christopher Douglas
c5bce7be47 HADOOP-6293. Fix FsShell -text to work on filesystems other than the default.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826120 13f79535-47bb-0310-9956-ffa450edef68
2009-10-16 22:41:54 +00:00
Konstantin Boudnik
3e9ba35841 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824942 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 21:54:48 +00:00
Tsz-wo Sze
512a39264f HADOOP-6309. Change build.xml to run tests with java asserts. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824899 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 19:59:17 +00:00
Devaraj Das
fed32afd17 HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824516 13f79535-47bb-0310-9956-ffa450edef68
2009-10-12 22:07:17 +00:00
Konstantin Boudnik
d3c314e450 HADOOP-6305. Unify build property names to facilitate cross-projects modifications. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823756 13f79535-47bb-0310-9956-ffa450edef68
2009-10-10 01:10:41 +00:00
Konstantin Boudnik
780efea7ae Eclipse .classpath template has outdated jar files and is missing some new
ones. Contributed by Konstantin Boudnik


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823355 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 23:08:59 +00:00
Christopher Douglas
b903b25072 HADOOP-6279. Add Runtime::maxMemory to JVM metrics. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823271 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 18:54:04 +00:00