The good old: org.apache.spark.SparkException: Task not serializable usually surfaces at least once in a spark developer’s career, or in my case, whenever enough time has gone by since I’ve seen it that I’ve conveniently forgotten its existence and the fact…
codewicca
Useful stuff
Blog Archives
SCNA 2016
Software Craftsmanship North America – a community of software professionals focused on the skills and craft required to produce enduring proficiency in software development – hosted their annual conference at the Town and Gown facility at USC on Friday October 21st, 2016,…
Apache Zeppelin 0.5.6 : spark 1.6.1 client : hadoop 2.6.0-cdh5.5.1 in remote cluster
Some trials, some errors, some success… Downloaded latest release which at this time is 0.5.6 from here and unzipped into incubator-zeppelin folder. Built using this command: mvn clean package -DskipTests -Pspark-1.5 -Dspark.version=1.6.1 -Dhadoop.version-2.6.0-cdh5.5.1 -Phadoop-2.6 -Pyarn caveat coder: -Pspark-1.5 corresponds to the…
TDD demo at SBHS Computer Science Academy
In March this year I roped in a few of my colleagues from CJ Affiliate to demo a little Test Driven Development to the students at Santa Barbara High School’s Computer Science Academy. The students were impressive – engaged, curious…
