Rounding out our series on security in Hadoop, we finish with Encryption at rest and in motion. We go over the different approaches, do's and don'ts and mention some higher level application in this space.
00:00 News for the week!
Dave:
Executives Still Relying on Gut, Not Gigabytes in Planning for Future
http://www.datadigestonline.com/2016/10/executives-still-relying-on-gut.html
Rewriting SAS Programs for Financial Data Manipulation in R
http://blog.revolutionanalytics.com/2016/09/rewriting-sas-in-r-for-finance.html
Chris Surdak - Why so many Big Data projects fail
http://surdak.com/innovation-vs-improvement/
Jhon:
Apache Spark 2.0 Performance Improvements Investigated With Flame Graphs (14-Sep-2016)
http://db-blog.web.cern.ch/blog/luca-canali/2016-09-spark-20-performance-improvements-investigated-flame-graphs
SQL on Hadoop benchmarks get serious (14-Oct-2016)
http://www.zdnet.com/article/sql-on-hadoop-benchmarks-get-serious/ WHERE IS APACHE HIVE GOING? TO IN-MEMORY COMPUTING. (06-Oct-2016) http://hortonworks.com/blog/apache-hive-going-memory-computing/ APACHE HIVE VS APACHE IMPALA QUERY PERFORMANCE COMPARISON (11-Oct-2016) http://hortonworks.com/blog/apache-hive-vs-apache-impala-query-performance-comparison/ Cloudera wants extra money from Intel to become a cloud provider? http://venturebeat.com/2016/08/30/cloudera-cloud-intel/
Four interesting things about IBM, Hadoop and open source (2 years old)
http://www.ibmbigdatahub.com/infographic/four-interesting-things-about-ibm-hadoop-and-open-source Recovering from a database disk failure in Big SQL (20-oct-2016) https://developer.ibm.com/hadoop/2016/10/20/recovering-from-a-database-disk-failure-in-big-sql-worker-node-4-1fp2-and-4-2/
37:20 Security 3: Encryption at rest and in motion
Nice intro in the apache docs:
https://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html
RPC Encryption:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_Security_Guide/content/ch_wire-rpc.html
57:53 End
Please use the Contact Form on this blog or our twitter feed to send us your questions, or to suggest future episode topics you would like us to cover.