Home

Welcome to the Chronix Spark wiki!

Resources:

• RDD vs. DataFrame vs. DataSet: http://www.agildata.com/apache-spark-rdd-vs-dataframe-vs-dataset
• Implementing custom RDD
  • http://stackoverflow.com/questions/30446706/implementing-custom-spark-rdd-in-java
  • http://rahulkavale.github.io/blog/2014/12/01/extending-rdd-for-fun-and-profit
• Spark Java API: https://cwiki.apache.org/confluence/display/SPARK/Java+API+Internals
• Spark/RDD Internals
  • http://stackoverflow.com/questions/30691385/internal-work-of-spark
  • https://spark-summit.org/2014/wp-content/uploads/2014/07/A-Deeper-Understanding-of-Spark-Internals-Aaron-Davidson.pdf
  • https://github.com/JerryLead/SparkInternals/blob/master/readme.md
• Spark & Time series processing:
  • http://blog.cloudera.com/blog/2015/12/spark-ts-a-new-library-for-analyzing-time-series-data-with-apache-spark/
  • https://github.com/sryza/spark-timeseries/blob/master/src/main/scala/com/cloudera/sparkts/TimeSeriesRDD.scala
  • http://sryza.github.io/spark-timeseries/0.3.0/scaladocs/index.html#com.cloudera.sparkts.TimeSeriesRDD