Skip to content

Commit 17f1b03

Browse files
committed
Minor updates
1 parent 3318340 commit 17f1b03

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

jupyter-enterprise-gateway-incorporation/jupyter-enterprise-gateway-incorporation.md

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -9,9 +9,8 @@ scientists to run frequent and large workloads against a large Apache Spark clus
99
several requirements that were not currently available in the Jupyter open source ecosystem. We tried
1010
to use the Jupyter Kernel Gateway project, but we quickly realized that the JKG server became the
1111
bottleneck because the co-located Spark driver application for these kinds of workloads (in this case,
12-
the kernel process running on behalf of notebook cells) were extremely resource intensive. Toss in a team
13-
or organization of data scientists, and you quickly saturate the compute resources of the Kernel Gateway
14-
server.
12+
the kernel process running on behalf of notebook cells) were extremely resource intensive. In organizations
13+
with multiple data scientists, you can quickly saturate the compute resources of the Kernel Gateway server.
1514

1615
Jupyter Enterprise Gateway enables Jupyter Notebook to launch and manage remote kernels in a distributed cluster,
1716
including Apache Spark managed by YARN, IBM Spectrum Conductor or Kubernetes. New platforms can be added via an
@@ -88,7 +87,7 @@ Other then that, below are some stats that have been collected from the Jupyter
8887
- 10 contributors
8988
- 5 different organizations (based on current employment)
9089
- 205 commits (16,551 additions, 9,616 removals)
91-
- 59 Stars
90+
- 60 Stars
9291
- 26 Forks
9392
- 10K+ pulls of primary docker image
9493

@@ -131,7 +130,9 @@ The Enterprise Gateway is packaged using setup tools, released in both source an
131130
## Pros and Cons
132131

133132
Pro: Extend Jupyter Stack to support distributed/remote Kernels
133+
134134
Pro: The runtime can easily be extensible to support new cluster resource managers
135+
135136
Con: Still requires couple extensions (e.g. NB2KG) to connect to the gateway
136137

137138
## Interested Contributors

0 commit comments

Comments
 (0)