So many of the tools and projects we talk about and use every day are prefaced by 6 letters, A P A C H E... What does it mean to be an Apache project? What does the Apache Software Foundation (ASF) do for software? Are there other options? Let us tell you about the ASF!

00:00 Recent events

Dave:

How we caught the circle line rogue train with data

https://blog.data.gov.sg/how-we-caught-the-circle-line-rogue-train-with-data-79405c86ab6a#.mhqs1mikx

Black Friday 2016: Mobile vs Desktop User Behaviour

http://appinstitute.com/black-friday-2016-mobile-vs-desktop-sales/

AI Machine Attempts to Understand Comic Books ... and Fails

https://www.technologyreview.com/s/602973/ai-machine-attempts-to-understand-comic-books-and-fails/ https://arxiv.org/abs/1611.05118 https://arxiv.org/pdf/1611.05118v1.pdf

Jhon:

Paypal From Big Data to Fast Data in Four Weeks or How Reactive Programming is Changing the World Part 1 and Reactive programming manifesto

http://www.reactivemanifesto.org/ https://www.paypal-engineering.com/2016/11/08/from-big-data-to-fast-data-in-four-weeks-or-how-reactive-programming-is-changing-the-world-part-1/

Part 2: How that change was followed by adding a spark micro bath (streaming) to the workflow

https://www.paypal-engineering.com/2016/11/18/from-big-data-to-fast-data-in-four-weeks-or-how-reactive-programming-is-changing-the-world-part-2/

Paypal And they are not only using spark, here is one talking about how they use storm for another real-time workflow.

https://www.paypal-engineering.com/2016/11/15/carrier-payments-big-data-pipeline-using-apache-storm/

Managing Spark Partitions with Coalesce and Repartition A short write up on how spark does partitioning internally and some ways of improving the partition scheme

https://medium.com/@mrpowers/managing-spark-partitions-with-coalesce-and-repartition-4050c57ad5c4#.s2l3yxemt

Principa The Top Predictive Analytics Pitfalls to avoid

http://insights.principa.co.za/the-top-predictive-analytics-pitfalls-to-avoid?utm_content=buffera2780&utm_medium=social&utm_source=facebook.com&utm_campaign=buffer

ODPi Publishes First Operations Specification To Provide Developers Consistency Across Application Management Tools As John talked about in our anniversary episode, the ODPI 2.0 released

https://www.odpi.org/announcements/2016/11/14/odpi-publishes-first-operations-specification-to-provide-developers-consistency-across-application-management-tools

25:30 Apache Software Foundation

The ASF

http://apache.org/

Overview

http://apache.org/foundation/

Process

http://apache.org/foundation/how-it-works.html

The Project List

http://apache.org/index.html#projects-list

Other Open Source Licence Options

http://choosealicense.com/ https://opensource.org/licenses

01:02:08 End

Please use the Contact Form on this blog or our twitter feed to send us your questions, or to suggest future episode topics you would like us to cover.