This repository was archived by the owner on Jan 9, 2020. It is now read-only.

Spark on Kubernetes - basic scheduler backend [WIP]#492

Closed

foxish wants to merge 37 commits intomasterfrom

spark-kubernetes-2

Commits on Sep 15, 2017

[SPARK-21513][SQL][FOLLOWUP] Allow UDF to_json support converting MapType to json for PySpark and SparkR

goldmedal
authored and
HyukjinKwon
committed
[SPARK-22018][SQL] Preserve top-level alias metadata when collapsing projects
tdas
committed
[SPARK-21902][CORE] Print root cause for BlockManager#doPut

caneGuy
authored and
jerryshao
committed
[SPARK-22002][SQL] Read JDBC table use custom schema support specify partial fields.

wangyum
authored and
gatorsmile
committed
[SPARK-21987][SQL] fix a compatibility issue of sql event logs

cloud-fan
authored and
gatorsmile
committed
[SPARK-21958][ML] Word2VecModel save: transform data in the cluster

travishegner
authored and
Nick Pentreath
committed
[SPARK-15689][SQL] data source v2 read path
cloud-fan
committed

Commits on Sep 16, 2017

Commits on Sep 17, 2017

[SPARK-22032][PYSPARK] Speed up StructType conversion

maver1ck
authored and
HyukjinKwon
committed
[SPARK-21985][PYSPARK] PairDeserializer is broken for double-zipped RDDs

aray
authored and
HyukjinKwon
committed

Commits on Sep 18, 2017

[SPARK-21953] Show both memory and disk bytes spilled if either is present

ash211
authored and
cloud-fan
committed
[SPARK-22043][PYTHON] Improves error message for show_profiles and dump_profiles
HyukjinKwon
committed
[SPARK-21113][CORE] Read ahead input stream to amortize disk IO cost …

Sital Kedia
authored and
zsxwing
committed
[SPARK-22047][TEST] ignore HiveExternalCatalogVersionsSuite
cloud-fan
committed
[SPARK-22003][SQL] support array column in vectorized reader with UDF

Feng Liu
authored and
gatorsmile
committed
[SPARK-14878][SQL] Trim characters string function support

kevinyu98
authored and
gatorsmile
committed

Commits on Sep 19, 2017

[SPARK-22030][CORE] GraphiteSink fails to re-connect to Graphite instances behind an ELB or any other auto-scaled LB

alexmnyc
authored and
jerryshao
committed
[SPARK-22047][FLAKY TEST] HiveExternalCatalogVersionsSuite
cloud-fan
committed
[SPARK-21923][CORE] Avoid calling reserveUnrollMemoryForThisTask for every record

ConeyLiu
authored and
cloud-fan
committed
[MINOR][CORE] Cleanup dead code and duplication in Mem. Management

original-brownbear
authored and
srowen
committed
[SPARK-22052] Incorrect Metric assigned in MetricsReporter.scala

Taaffy
authored and
srowen
committed
[SPARK-21428][SQL][FOLLOWUP] CliSessionState should point to the actual metastore not a dummy one

yaooqinn
authored and
cloud-fan
committed
[SPARK-21917][CORE][YARN] Supporting adding http(s) resources in yarn mode

jerryshao
authored and
cloud-fan
committed
[MINOR][ML] Remove unnecessary default value setting for evaluators.
yanboliang
committed
[SPARK-21338][SQL] implement isCascadingTruncateTable() method in AggregatedDialect

huaxingao
authored and
gatorsmile
committed
[SPARK-21969][SQL] CommandUtils.updateTableStats should call refreshTable

aokolnychyi
authored and
gatorsmile
committed

Commits on Sep 20, 2017