[Bug] spark on k8s 在connect模式下会产生两个spark session

[qshian]

Code of Conduct

• I agree to follow this project's Code of Conduct

Search before asking

• I have searched in the issues and found no similar issues.

Describe the bug

用java jdbc的方式连接 kyuubi ，提交一条sql ， spark 会生成两个集群。一个是show databases，另外一个是 show databases + 提交的sql 。

这种在connection的模式下， 我的理解，show tables是engine_initializing_queries 在SparkSqlEngine 135 行执行，后面都是返回这个session ，为什么会产生两个spark 作业了，向k8s申请两次不同的资源了。

Affects Version(s)

1.5.1

Kyuubi Server Log Output

没有报错

Kyuubi Engine Log Output

没有报错

Kyuubi Server Configurations

kyuubi.session.engine.initialize.timeout 600000
    # 约定Driver闲置了多长时间以后也释放
    kyuubi.session.engine.idle.timeout 300000
    kyuubi.engine.share.level CONNECTION
    kyuubi.engine.connection.url.use.hostname false
    kyuubi.session.idle.timeout  1800000

Kyuubi Engine Configurations

没有配置

Additional context

无

Are you willing to submit PR?

• Yes I am willing to submit a PR!

[github-actions[bot]]

Hello @qshian,
Thanks for finding the time to report the issue!
We really appreciate the community's efforts to improve Apache Kyuubi (Incubating).

[pan3793]

May be caused by #2686, fixed in 1.5.2

[qshian]

@pan3793 我看修复的是在 非connection level的问题，我这个是在 connection level 发生的

[pan3793]

After a second look, the Spark Application name does not match the Kyuubi App name pattern, are you sure they were created by Kyuubi?

[qshian]

@pan3793 是的， 在jdbc模式URL后面 加了一个参数 ？spark.app.name =xxxx

[pan3793]

does it occur every time? if yes, it may be caused by your client code, would you please share your JDBC client code?

[pan3793]

一个是show databases，另外一个是 show databases + 提交的sql 。

the show databases is the default init sql, every launched engine will run it before accepting connections.

[qshian]

@pan3793 经过验证 是 org.apache.commons.dbcp 在创建 datasource的时候 ，有一个效验连接工厂的方法