Merge pull request #195347 from sreekzz/patch-42

New Image content without PySpark

Author: PRMerger6

articles/hdinsight/spark/apache-spark-jupyter-notebook-kernels.md

@@ -4,14 +4,14 @@ description: Learn about the PySpark, PySpark3, and Spark kernels for Jupyter No
 ms.service: hdinsight
 ms.topic: how-to
 ms.custom: hdinsightactive,hdiseo17may2017,seoapr2020
-ms.date: 04/24/2020
+ms.date: 04/18/2022
 ---
 
 # Kernels for Jupyter Notebook on Apache Spark clusters in Azure HDInsight
 
 HDInsight Spark clusters provide kernels that you can use with the Jupyter Notebook on [Apache Spark](./apache-spark-overview.md) for testing your applications. A kernel is a program that runs and interprets your code. The three kernels are:
 
-- **PySpark** - for applications written in Python2.
+- **PySpark** - for applications written in Python2. (Applicable only for Spark 2.4 version clusters)
 - **PySpark3** - for applications written in Python3.
 - **Spark** - for applications written in Scala.
 
@@ -38,6 +38,12 @@ An Apache Spark cluster in HDInsight. For instructions, see [Create Apache Spark
 
     :::image type="content" source="./media/apache-spark-jupyter-notebook-kernels/kernel-jupyter-notebook-on-spark.png " alt-text="Kernels for Jupyter Notebook on Spark" border="true":::
 
+ > [!NOTE]  
+ > For Spark 3.1, only **PySpark3**, or **Spark** will be available.
+ >
+ :::image type="content" source="./media/apache-spark-jupyter-notebook-kernels/kernel-jupyter-notebook-on-spark-for-hdi-4-0.png " alt-text="Kernels for Jupyter Notebook on Spark HDI4.0" border="true":::
+ 
+
 4. A notebook opens with the kernel you selected.
 
 ## Benefits of using the kernels