The good old: org.apache.spark.SparkException: Task not serializable usually surfaces at least once in a spark developer’s career, or in my case, whenever enough time has gone by since I’ve seen it that I’ve conveniently forgotten its existence and the fact…
codewicca
Useful stuff
Blog Archives
A week in ML part 2: algorithms
The previous post established the need for a thorough understanding of the data. Assuming we know our data, we can now consider the algorithms. Our chosen problem was a prediction question: clearly a supervised learning exercise, and as we expected…
A week in ML
A group of us at CJ engineering recently got the opportunity to set aside all other project and squad work for 1 week, to focus exclusively on a machine learning exercise. The objective of this effort was not so much…
SCNA 2016
Software Craftsmanship North America – a community of software professionals focused on the skills and craft required to produce enduring proficiency in software development – hosted their annual conference at the Town and Gown facility at USC on Friday October 21st, 2016,…
Apache Zeppelin 0.5.6 : spark 1.6.1 client : hadoop 2.6.0-cdh5.5.1 in remote cluster
Some trials, some errors, some success… Downloaded latest release which at this time is 0.5.6 from here and unzipped into incubator-zeppelin folder. Built using this command: mvn clean package -DskipTests -Pspark-1.5 -Dspark.version=1.6.1 -Dhadoop.version-2.6.0-cdh5.5.1 -Phadoop-2.6 -Pyarn caveat coder: -Pspark-1.5 corresponds to the…
TDD demo at SBHS Computer Science Academy
In March this year I roped in a few of my colleagues from CJ Affiliate to demo a little Test Driven Development to the students at Santa Barbara High School’s Computer Science Academy. The students were impressive – engaged, curious…
I’m geeky?
(This originally appeared on the cj engineering blog on February 9, 2016) She’s Geeky 2016 “Unconference” was held at the Computer History Museum in Mountain View on Saturday, January 30. I don’t typically label myself a geek, but I seized…
