Update prod compose file.

Author: lihebi

README.md

@@ -1,133 +1,116 @@
-# CodePod: A Hierarchical IDE for Interactive Development at Scale
+# CodePod: coding on a canvas, organized.
 
 ![screenshot](./screenshot.png)
 
-# Installation
-
-Binary release available for Linux and MacOS. See release page.
-
-For Debian/Ubuntu:
+# Development
 
 ```
-sudo dpkg -i codepod_0.1.0_amd64.deb
+cd ./compose/dev/
+touch .env
 ```
 
-On Mac, use the `codepod_0.1.0_arm64.dmg` image (for M1 Macs with Apple Sillicon).
-
-You can run `codepod` either in application launcher or through the `codepod` command line tool.
-
-# Install Jupyter kernels
-
-These kernels are Jupyter kernels. CodePod should detect them and work as long
-as they are properly installed to work in Jupyter.
-
-## python
+Add your choice of secrets to the .env file (replace the placeholders):
 
 ```
-sudo apt install python3
+POSTGRES_USER=<username>
+POSTGRES_PASSWORD=<password>
+POSTGRES_DB=<dbname>
+JWT_SECRET=<yoursecret>
 ```
 
-Install ipykernel:
+Start the docker-compose stack:
 
 ```
-python3 -m pip install ipykernel
-python3 -m ipykernel install --user
+docker compose up -d
 ```
 
-## racket
+The docker-compose file declares a set of services:
 
-Install on Ubuntu:
+- api: the backend API server
+- ui: the frontend React app
+- db: postgres DB
+- prisma: prisma db viewer
+- nginx: reverse proxy to use nice URLs
 
-```
-sudo add-apt-repository ppa:plt/racket
-sudo apt-get update
-sudo apt install racket
-```
+You will need to perform a manual installation of node_modules into the api and
+ui containers. Attach a shell and run `yarn`. Without this, the initial api/ui
+contianers will not run. So you likely need to make changes to docker compose to
+do this (add `tty: true` and comment out commands line).
 
-Install zmq:
+Then, initialize a DB by shell into the api container and run:
 
 ```
-brew install zmq
-sudo apt install libzmq5
+npx prisma migrate dev --name init
 ```
 
+The nginx server expects `codepod.test` as the domain name. You can add a local
+DNS record to your /etc/hosts:
+
 ```
-raco pkg install --auto iracket
-raco iracket install
+10.43.1.148	codepod.test
 ```
 
-On mac, zeromq lib cannot be found by racket due to [a known
-issue](https://github.com/rmculpepper/racket-zeromq/issues/6). To side-step it
-(replace the version numbers with your installation):
+This allows codepod.test to be resolved to your server machine. Then, go to
 
-```
-cp /opt/homebrew/Cellar/zeromq/4.3.4/lib/libzmq.5.dylib ~/Library/Racket/8.2/lib
-```
+- http://codepod.test:3000 the web app
+- http://codepod.test:3000/graphql the grpahql explorer
+- http://codepod.test:5555 the prisma db viewer
 
-## julia
+# (TODO) Deployment
 
-Install julia from the official binaries. On Ubuntu:
+Build the docker images:
 
 ```
-curl -O https://julialang-s3.julialang.org/bin/linux/x64/1.6/julia-1.6.4-linux-x86_64.tar.gz
-tar -xvzf julia-1.6.4-linux-x86_64.tar.gz
-sudo mv julia-1.6.4/ /opt/
-sudo ln -s /opt/julia-1.6.4/bin/julia /usr/local/bin/julia
+docker build -t lihebi/codepod-ui:v0.1.0 ./ui
+docker build -t lihebi/codepod-api:v0.1.0 ./api
 ```
 
-<!--
+Push to registry:
+
 ```
-julia
-]add add IJulia
-import IJulia
-IJulia.installkernel("Julia nodeps", "--depwarn=no")
+docker push lihebi/codepod-ui:v0.1.0
+docker push lihebi/codepod-api:v0.1.0
 ```
 
-Or just -->
-
-Install kernel:
+Create a cloud VM with docker support. Setup TLS:
 
 ```
-julia -e 'import Pkg; Pkg.add("IJulia"); using IJulia; installkernel("Julia nodeps", "--depwarn=no")'
+sudo certbot certonly
 ```
 
-## Javascript
+Clone this repo on the cloud VM, and go to the production folder, change the
+domain name to e.g. app-v0_1_0.codepod.io:
 
 ```
-npm install -g ijavascript
-ijsinstall
+cd compose/prod
+touch .env
 ```
 
-# Using remote runtime
+Add your choice of secrets to the .env file (replace the placeholders):
 
-In the runtime section in the sidebar, you can add a new runtime. For the runtime, you need to specify the two addresses: the websocket address for sending code to server, and the MQ address for receiving output. If MQ address is empty, the websocket will be used.
-
-The default runtime is the local runtime, which is `localhost:14321`
-
-To start the server, on the server machine, you need to setup the kernels. Then, you need to clone this repo, go into the cpkernel folder, and do:
-
-1. `docker-compose up -d`. This will setup a rabbitmq server. The MQ address is `:15674`
-2. `npm run kernel-server`. This will run the server. The websocket address is `:14321`
-
-So to use this server, enter:
-
-- `<your-server-ip>:14321` for the socket address
-- `<your-server-ip>:15674` for the MQ address
-
-We can spawn a docker container on the server for the kernels. However, it will be tricky to access files and install packages. One has to install packages for every restart of the kernel, and one has to mount a volume to exchange files between the server and the container. Thus we think it is a better experience to use the bare-metal server.
-
-# Development Scripts
+```
+POSTGRES_USER=<username>
+POSTGRES_PASSWORD=<password>
+POSTGRES_DB=<dbname>
+JWT_SECRET=<yoursecret>
+```
 
-Develop
+Start the docker-compose stack:
 
 ```
-cd app
-npm run dev
+docker compose up -d
 ```
 
-Build:
+Then, initialize a DB by shell into the api container and run:
 
 ```
-cd app
-npm run build:all
+npx prisma migrate dev --name init
 ```
+
+Now add DNS from domain name to the cloud server. Now go to
+
+- http://codepod.test:3000 the web app
+- http://codepod.test:3000/graphql the grpahql explorer
+- http://codepod.test:5555 the prisma db viewer
+
+# (TODO) Architecture

api/Dockerfile

@@ -0,0 +1,11 @@
+FROM node:18
+
+WORKDIR /app
+COPY package.json .
+RUN yarn
+
+COPY . .
+# this will modify node_modules/@prisma/client
+RUN yarn run prisma generate
+
+CMD ["yarn", "dev"]

api/docker-compose.yml

@@ -13,21 +13,20 @@ services:
       - codepod-db-prod:/var/lib/postgresql/data
 
   api:
-    image: codepod-api:v0.0.3.1
+    image: lihebi/codepod-api:v0.1.0
     depends_on:
       - rabbitmq
     restart: always
     volumes:
       - /var/run/docker.sock:/var/run/docker.sock
-      - git-data-prod:/srv/git
     command: yarn start
     environment:
       DATABASE_URL: "postgresql://${POSTGRES_USER}:${POSTGRES_PASSWORD}@db:5432/${POSTGRES_DB}?schema=public"
       JWT_SECRET: ${JWT_SECRET}
       KERNEL_NETWORK: "codepod-prod"
 
   ui:
-    image: codepod-ui:v0.0.3.1
+    image: lihebi/codepod-ui:v0.1.0
     restart: always
     # FIXME this takes a lot of time on startup
     command: yarn start
@@ -38,12 +37,6 @@ services:
     volumes:
       - ./rabbitmq/enabled_plugins:/etc/rabbitmq/enabled_plugins
 
-  git-http:
-    restart: always
-    build: ../dev/docker-git-http
-    volumes:
-      - git-data-prod:/var/lib/git
-
   # docker-compose up -d --build --force-recreate --no-deps nginx
   nginx:
     image: nginx:1.15-alpine
@@ -73,17 +66,9 @@ services:
     depends_on:
       - ui
 
-  # docker run -it --rm --network host -v $(pwd)/frpc.ini:/etc/frp/frpc.ini snowdreamtech/frpc
-  frpc:
-    image: snowdreamtech/frpc
-    restart: always
-    volumes:
-      - ./frpc.ini:/etc/frp/frpc.ini
-    network_mode: "host"
 
 volumes:
   codepod-db-prod:
-  git-data-prod:
 
 networks:
   default:

compose/prod/docker-compose.yml

@@ -1,3 +1,4 @@
+set $domain app-v0_1_0.codepod.io
 
 # By default, server /var/www/html
 # Need to mount it! I prefer not to mount it by default so that I don't server
@@ -14,7 +15,7 @@ server {
         listen 80;
         listen [::]:80;
 
-        server_name codepod.io www.codepod.io;
+        server_name $domain;
 
         return 301 https://$host$request_uri;
 
@@ -35,12 +36,12 @@ server {
 server {
         listen 443 ssl http2;
         listen [::]:443 ssl http2;
-        server_name codepod.io www.codepod.io;
+        server_name $domain;
 
         server_tokens off;
 
-        ssl_certificate /etc/letsencrypt/live/codepod.io/fullchain.pem;
-        ssl_certificate_key /etc/letsencrypt/live/codepod.io/privkey.pem;
+        ssl_certificate /etc/letsencrypt/live/$domain/fullchain.pem;
+        ssl_certificate_key /etc/letsencrypt/live/$domain/privkey.pem;
 
         location / {
                 proxy_pass http://ui:3000;
@@ -55,49 +56,3 @@ server {
                 proxy_pass http://api:4000;
         }
 }
-
-
-server {
-        listen 80;
-        listen [::]:80;
-        server_name git.codepod.io;
-        return 301 https://$host$request_uri;
-}
-
-server {
-        listen 443 ssl http2;
-        listen [::]:443 ssl http2;
-        server_name git.codepod.io;
-        ssl_certificate /etc/letsencrypt/live/git.codepod.io/fullchain.pem;
-        ssl_certificate_key /etc/letsencrypt/live/git.codepod.io/privkey.pem;
-        location / {
-                proxy_pass http://git-http:80;
-        }
-}
-
-
-server {
-        listen 80;
-        listen [::]:80;
-        server_name mq.codepod.io;
-        return 301 https://$host$request_uri;
-}
-
-server {
-        listen 443;
-        listen [::]:443;
-        server_name mq.codepod.io;
-        ssl_certificate /etc/letsencrypt/live/mq.codepod.io/fullchain.pem;
-        ssl_certificate_key /etc/letsencrypt/live/mq.codepod.io/privkey.pem;
-        # ssl_certificate /etc/nginx/conf.d/cfpub.pem;
-        # ssl_certificate_key /etc/nginx/conf.d/cfpriv.pem;
-        location / {
-                proxy_pass http://rabbitmq:15672;
-        }
-        location /ws {
-                proxy_pass http://rabbitmq:15674;
-                proxy_http_version 1.1;
-                proxy_set_header Upgrade $http_upgrade;
-                proxy_set_header Connection "upgrade";
-        }
-}

compose/prod/nginx/nginx.conf

@@ -1,4 +1,4 @@
-FROM node:16
+FROM node:18
 
 WORKDIR /app
 COPY ./package.json package.json