-
Recent Posts
Popular Posts
- Rent or Own: Amazon EC2 vs. Colocation Comparison for Hadoop Clusters 27 comment(s) | 10890 view(s)
- Mysql Replication Adapter 26 comment(s) | 6700 view(s)
- Making sure Ruby Daemons die 20 comment(s) | 7400 view(s)
- Matching Impedance: When to use HBase 19 comment(s) | 22418 view(s)
- Goodbye MapReduce, Hello Cascading 17 comment(s) | 9747 view(s)
- Rapleaf Challenge Problem 12 comment(s) | 3824 view(s)
- BloomFilter 11 comment(s) | 5483 view(s)
- Using random numbers in Hadoop MapReduce is dangerous 11 comment(s) | 4057 view(s)
- Ruby and HBase 10 comment(s) | 5293 view(s)
- Cycles of Doom in Batch Processing Workflows 10 comment(s) | 2678 view(s)
Categories
- Anonymouse (2)
- Apache (1)
- bash (1)
- Cascading (6)
- Daemons (1)
- encryption (1)
- Extensions (2)
- Google (1)
- Grub (1)
- Hadoop (22)
- HBase (6)
- HDFS (4)
- Kickstart (1)
- MapReduce (9)
- mcrypt (1)
- Miscellaneous (26)
- Mongrel (2)
- Mysql (2)
- OpenSocial (1)
- Operations (1)
- Ruby (7)
- Security (2)
- Thrift (6)
- Xen (1)
Archives
- September 2010
- August 2010
- July 2010
- June 2010
- May 2010
- April 2010
- March 2010
- February 2010
- January 2010
- December 2009
- November 2009
- October 2009
- September 2009
- August 2009
- July 2009
- June 2009
- May 2009
- March 2009
- February 2009
- December 2008
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
- October 2007
- September 2007
- August 2007
Monthly Archives: May 2010
Avoiding Java varargs snafus
Since Java 1.5, Java has allowed you to take advantage of “varargs“, a usability feature that many other languages support. It lets you write really clean code and support some pretty cool use cases.
However, there is at least one possible pitfall of using varargs. Consider the method below:
public boolean filter() {
(do some filtering)
}
filter();
Let’s say you [...]
Parallelized bloom filter creation with Map/Reduce
As we’ve mentioned in the past, bloom filters are an important part of our workflow. They allow us to quickly skip a large portion of the records that we’re not interested in, thinning out the amount of data that has to be CoGrouped in our Cascading flows.
Up until recently, we’ve just been creating our bloom [...]
Posted in Miscellaneous 2 Comments
Application Deployment at Rapleaf