Blog Archives

The inevitable “Task not serializable” SparkException

The good old: org.apache.spark.SparkException: Task not serializable usually surfaces at least once in a spark developer’s career, or in my case, whenever enough time has gone by since I’ve seen it that I’ve conveniently forgotten its existence and the fact

Posted in code Tagged with: , , , ,

A week in ML part 2: algorithms

The previous post established the need for a thorough understanding of the data. Assuming we know our data, we can now consider the algorithms. Our chosen problem was a prediction question: clearly a supervised learning exercise, and as we expected

Posted in machine learning, Uncategorized Tagged with: , , ,

A week in ML

A group of us at CJ engineering recently got the opportunity to set aside all other project and squad work for 1 week, to focus exclusively on a machine learning exercise. The objective of this effort was not so much

Posted in machine learning Tagged with: , , ,

SCNA 2016

Software Craftsmanship North America – a community of software professionals focused on the skills and craft required to produce enduring proficiency in software development – hosted their annual conference at the Town and Gown facility at USC on Friday October 21st, 2016,

Posted in code, talks, women in tech Tagged with: ,

Apache Zeppelin 0.5.6 : spark 1.6.1 client : hadoop 2.6.0-cdh5.5.1 in remote cluster

Some trials, some errors, some success… Downloaded latest release which at this time is 0.5.6 from here and unzipped into incubator-zeppelin folder. Built using this command: mvn clean package -DskipTests -Pspark-1.5 -Dspark.version=1.6.1 -Dhadoop.version-2.6.0-cdh5.5.1 -Phadoop-2.6 -Pyarn caveat coder: -Pspark-1.5 corresponds to the

Posted in code Tagged with: , ,

TDD demo at SBHS Computer Science Academy

In March this year I roped in a few of my colleagues from CJ Affiliate to demo a little Test Driven Development to the students at Santa Barbara High School’s Computer Science Academy. The students were impressive – engaged, curious

Posted in code, talks, women in tech Tagged with: , , ,

I’m geeky?

(This originally appeared on the cj engineering blog on February 9, 2016) She’s Geeky 2016 “Unconference” was held at the Computer History Museum in Mountain View on Saturday, January 30. I don’t typically label myself a geek, but I seized

Posted in women in tech Tagged with: , , , ,