Include and improve host-scripts inside the docker image

Author: elgalu

CHANGELOG.md

@@ -4,10 +4,10 @@ Note sha256 digests are generated after pushing the image to the registry theref
 
 Note image ids also change after scm-source.json has being updated which triggers a cyclic problem so value TBD will be set here and updated in the [release][] page by navigating into any release tag.
 
-## 2.47.1b (2015-08-03)
+## 2.47.1c (2015-08-03)
  + Upgrade chromedriver from 2.16 to 2.17 (Leo Gallucci)
  + Upgrade chrome unstable from 45 to 46.0.2467.2
- + Include host-scripts inside the docker iamge
+ + Include and improve host-scripts inside the docker image
  + Reorganize packages installation order
  + Image tag details:
   + Selenium: v2.47.1 (411b314)
@@ -24,8 +24,8 @@ Note image ids also change after scm-source.json has being updated which trigger
   + Built with: Docker version 1.7.1, build 786b29d
   + FROM ubuntu:wily-20150708
   + Python: 2.7.10
-  + Image ID: eb7175aa47fac34f1f29ffc372cd9e6f52d3a3fe6218f2f760cef7e5047705a0
-  + Digest: sha256:ca7b8c9d1a8df59974b3dcb81499339cd3f46b5cda1934ba14c3b5f95c1ecba2
+  + Image ID: TBD
+  + Digest: sha256:TBD
 
 ## 2.47.1a (2015-07-30)
  + Upgrade selenium from 2.46.0 to 2.47.1 (Leo Gallucci)

README.md

@@ -19,7 +19,7 @@ Note SeleniumHQ/docker-selenium project is more useful for building selenium gri
 In general: add `sudo` only if needed in your environment and `--privileged` if you really need it.
 
     sudo docker run --privileged -p 4444:24444 -p 5920:25900 \
-        -e VNC_PASSWORD=hola elgalu/selenium:2.47.1b
+        -e VNC_PASSWORD=hola elgalu/selenium:2.47.1c
 
 ### Non-privileged
 ### Run
@@ -31,7 +31,7 @@ If your setup is correct, privileged mode and sudo should not be necessary:
         -e SCREEN_WIDTH=1920 -e SCREEN_HEIGHT=1080 \
         -e VNC_PASSWORD=hola \
         -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" \
-        elgalu/selenium:2.47.1b
+        elgalu/selenium:2.47.1c
 
 Make sure `docker run` finishes with **selenium all done and ready for testing** else you won't be able to start your tests. To perform this check programatically please use this command where `ch` is the name of the container:
 
@@ -96,7 +96,7 @@ You can lunch a grid only container via environment variables:
 
     docker run --rm --name=hub -p 4444:24444 -p 5930:25900 -p 2223:22222 \
       -p=6081:26080 -e CHROME=false -e FIREFOX=false \
-      elgalu/selenium:2.47.1b
+      elgalu/selenium:2.47.1c
 
 The important part above is `-e CHROME=false -e FIREFOX=false` which tells the docker image not run run default chorme and firefox nodes turning the container into a grid-only one.
 
@@ -112,7 +112,7 @@ You can lunch a node only container via environment variables:
       -p 25550:25550 -p 25551:25551 \
       -e GRID=false -e CHROME=true -e FIREFOX=true \
       -v $(pwd)/videos:/videos \
-      elgalu/selenium:2.47.1b
+      elgalu/selenium:2.47.1c
 
 The important part above is `-e GRID=false` which tells the container to be a node-only node, this this case with 2 browsers `-e CHROME=true -e FIREFOX=true` but could be just 1.
 
@@ -137,9 +137,9 @@ There are also additional steps you can take to ensure you're using the correct
 
 You can simply verify that image id is indeed the correct one.
 
-    # e.g. full image id for tag 2.47.1b
-    export IMGID=eb7175aa47fac34f1f29ffc372cd9e6f52d3a3fe6218f2f760cef7e5047705a0
-    if docker inspect -f='{{.Id}}' elgalu/selenium:2.47.1b |grep ${IMGID} &> /dev/null; then
+    # e.g. full image id for tag 2.47.1c
+    export IMGID=TBD
+    if docker inspect -f='{{.Id}}' elgalu/selenium:2.47.1c |grep ${IMGID} &> /dev/null; then
         echo "Image ID tested ok"
     else
         echo "Image ID doesn't match"
@@ -149,8 +149,8 @@ You can simply verify that image id is indeed the correct one.
 
 Given docker.io currently allows to push the same tag image twice this represent a security concern but since docker >= 1.6.2 is possible to fetch the digest sha256 instead of the tag so you can be sure you're using the exact same docker image every time:
 
-    # e.g. sha256 for tag 2.47.1b
-    export SHA=ca7b8c9d1a8df59974b3dcb81499339cd3f46b5cda1934ba14c3b5f95c1ecba2
+    # e.g. sha256 for tag 2.47.1c
+    export SHA=TBD
     docker pull elgalu/selenium@sha256:${SHA}
 
 You can find all digests sha256 and image ids per tag in the [CHANGELOG](./CHANGELOG.md) so as of now you just need to trust the sha256 in the CHANGELOG. Bullet proof is to fork this project and build the images yourself if security is a big concern.
@@ -169,7 +169,7 @@ Host machine, terminal 2:
     docker run --rm --name=ch -p=4470:24444 \
       -e SCREEN_WIDTH -e SCREEN_HEIGHT -e XE_DISP_NUM \
       -v /tmp/.X11-unix/X${XE_DISP_NUM}:/tmp/.X11-unix/X${XE_DISP_NUM} \
-      elgalu/selenium:2.47.1b
+      elgalu/selenium:2.47.1c
 
 Now when you run your tests instead of connecting. If docker run fails try `xhost +`
 
@@ -191,7 +191,7 @@ ANYPORT=0
 REMOTE_DOCKER_SRV=localhost
 CONTAINER=$(docker run -d -p=0.0.0.0:${ANYPORT}:22222 -p=0.0.0.0:${ANYPORT}:24444 \
     -p=0.0.0.0:${ANYPORT}:25900 -e SCREEN_HEIGHT=1110 -e VNC_PASSWORD=hola \
-    -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" elgalu/selenium:2.47.1b
+    -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" elgalu/selenium:2.47.1c
 
 # -- Option 2.docker run- Running docker on remote docker server like in the cloud
 # Useful if the docker server is running in the cloud. Establish free local ports
@@ -201,7 +201,7 @@ ssh ${REMOTE_DOCKER_SRV} #get into the remote docker provider somehow
 # it acts as a jump host so my public key is already on that server
 CONTAINER=$(docker run -d -p=0.0.0.0:${ANYPORT}:22222 -e SCREEN_HEIGHT=1110 \
     -e VNC_PASSWORD=hola -e SSH_AUTH_KEYS="$(cat ~/.ssh/authorized_keys)" \
-    elgalu/selenium:2.47.1b
+    elgalu/selenium:2.47.1c
 
 # -- Common: Wait for the container to start
 ./host-scripts/wait-docker-selenium.sh ch 7s
@@ -272,7 +272,7 @@ If you git clone this repo locally, i.e. cd into where the Dockerfile is, you ca
 
 If you prefer to download the final built image from docker you can pull it, personally I always prefer to build them manually except for the base images like Ubuntu 14.04.2:
 
-    docker pull elgalu/selenium:2.47.1b
+    docker pull elgalu/selenium:2.47.1c
 
 #### 2. Use this image
 

READMELeo.md

@@ -1,15 +1,15 @@
 ## Build
 
-    time (docker build -t="elgalu/selenium:2.47.1b" . ;echo $?;beep)
-    docker run --rm -ti -m 2000M --cpu-quota=90000 --name=ch -p=4470:24444 -p=5920:25900 -p=2222:22222 -p=6080:26080 -p=29001:29001 -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" -v $(pwd)/videos:/videos -e DISABLE_ROLLBACK=true -e VIDEO=true -e VIDEO_FILE_NAME=hola -e MEM_JAVA="1024m" -e WAIT_TIMEOUT="20s" elgalu/selenium:2.47.1b
+    time (docker build -t="elgalu/selenium:2.47.1c" . ;echo $?;beep)
+    docker run --rm -ti -m 2000M --cpu-quota=90000 --name=ch -p=4470:24444 -p=5920:25900 -p=2222:22222 -p=6080:26080 -p=29001:29001 -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" -v $(pwd)/videos:/videos -e DISABLE_ROLLBACK=true -e VIDEO=true -e VIDEO_FILE_NAME=hola -e MEM_JAVA="1024m" -e WAIT_TIMEOUT="20s" elgalu/selenium:2.47.1c
 
 See logs
 
     docker exec -ti ch bash -c "ls -lah /var/log/sele/"
 
 Testing in ssh [email protected]
 
-    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -p=2222:22222 -e SSH_AUTH_KEYS="$(cat ~/.ssh/authorized_keys)" -e VNC_PASSWORD=Hola3 os-registry.stups.zalan.do/tip/selenium:2.47.1b
+    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -p=2222:22222 -e SSH_AUTH_KEYS="$(cat ~/.ssh/authorized_keys)" -e VNC_PASSWORD=Hola3 os-registry.stups.zalan.do/tip/selenium:2.47.1c
 
 ## Transfer used browser source artifacts to keep them in the cloud
 
@@ -32,18 +32,18 @@ List firefox versions via docker exe
 
 ## To update image id and digest
 
-    docker inspect -f='{{.Id}}' elgalu/selenium:2.47.1b
+    docker inspect -f='{{.Id}}' elgalu/selenium:2.47.1c
     docker images --digests
 
 ## Run with shared dir
 
     docker run --rm --name=ch -p=127.0.0.1:4460:24444 -p=127.0.0.1:5910:25900 \
-      -v /e2e/uploads:/e2e/uploads elgalu/selenium:2.47.1b
+      -v /e2e/uploads:/e2e/uploads elgalu/selenium:2.47.1c
     docker run --rm --name=ch -p=4460:24444 -p=5910:25900 \
-      -v /var/run/docker.sock:/var/run/docker.sock -v $(which docker):$(which docker) elgalu/selenium:2.47.1b
+      -v /var/run/docker.sock:/var/run/docker.sock -v $(which docker):$(which docker) elgalu/selenium:2.47.1c
 
 
-    docker run --rm --name=ff -p=127.0.0.1:4461:24444 -p=127.0.0.1:5911:25900 -v /e2e/uploads:/e2e/uploads elgalu/selenium:2.47.1b
+    docker run --rm --name=ff -p=127.0.0.1:4461:24444 -p=127.0.0.1:5911:25900 -v /e2e/uploads:/e2e/uploads elgalu/selenium:2.47.1c
 
 ## Run without shared dir and bind ports to all network interfaces
 
@@ -66,11 +66,11 @@ List firefox versions via docker exe
 ## Run without dir and bind to all interfaces
 Note anything after the image will be taken as arguments for the cmd/entrypoint
 
-    docker run --rm --name=ch -p=0.0.0.0:8813:8484 -p=0.0.0.0:2222:2222 -p=0.0.0.0:4470:24444 -p=0.0.0.0:5920:25900 -e SCREEN_WIDTH=1800 -e SCREEN_HEIGHT=1110 -e VNC_PASSWORD=hola -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" elgalu/selenium:2.47.1b
+    docker run --rm --name=ch -p=0.0.0.0:8813:8484 -p=0.0.0.0:2222:2222 -p=0.0.0.0:4470:24444 -p=0.0.0.0:5920:25900 -e SCREEN_WIDTH=1800 -e SCREEN_HEIGHT=1110 -e VNC_PASSWORD=hola -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" elgalu/selenium:2.47.1c
 
-    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -e VNC_PASSWORD=hola elgalu/selenium:2.47.1b
-    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -e VNC_PASSWORD=hola docker.io/elgalu/selenium:2.47.1b
-    docker run --rm --name=ch -p=0.0.0.0:4470:24444 -p=0.0.0.0:5920:25900 --add-host myserver.dev:172.17.42.1 elgalu/selenium:2.47.1b
+    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -e VNC_PASSWORD=hola elgalu/selenium:2.47.1c
+    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -e VNC_PASSWORD=hola docker.io/elgalu/selenium:2.47.1c
+    docker run --rm --name=ch -p=0.0.0.0:4470:24444 -p=0.0.0.0:5920:25900 --add-host myserver.dev:172.17.42.1 elgalu/selenium:2.47.1c
 
 However adding a custom host IP to server-selenium.local (e.g. bsele ssh config) is more work:
 
@@ -79,32 +79,32 @@ However adding a custom host IP to server-selenium.local (e.g. bsele ssh config)
 
     vncv localhost:5920 -Scaling=60%  &
 
-    docker run --rm --name=ff -p=0.0.0.0:4471:24444 -p=0.0.0.0:5921:25900 elgalu/selenium:2.47.1b
+    docker run --rm --name=ff -p=0.0.0.0:4471:24444 -p=0.0.0.0:5921:25900 elgalu/selenium:2.47.1c
 
 Automatic builds not working for me right now, maybe there is an issue with docker registry v1 vs v2
 https://registry.hub.docker.com/u/elgalu/docker-selenium/builds_history/31621/
 
 ## Push version
 
     docker login
-    docker push docker.io/elgalu/selenium:2.47.1b ;echo $?;beep
-    docker tag elgalu/selenium:2.47.1b elgalu/selenium:latest
+    docker push docker.io/elgalu/selenium:2.47.1c ;echo $?;beep
+    docker tag elgalu/selenium:2.47.1c elgalu/selenium:latest
     docker push docker.io/elgalu/selenium:latest
 
 Not working maybe because it has automated builds enabled but then it fails in the cloud but works locally
 https://registry.hub.docker.com/u/elgalu/selenium/tags/manage/
 
-    docker push elgalu/selenium:2.47.1b
-    docker push elgalu/docker-selenium:2.47.1b
-    docker push docker.io/elgalu/docker-selenium:2.47.1b
+    docker push elgalu/selenium:2.47.1c
+    docker push elgalu/docker-selenium:2.47.1c
+    docker push docker.io/elgalu/docker-selenium:2.47.1c
 
 ## Pulling
 
-    docker pull registry.hub.docker.com/elgalu/selenium:2.47.1b
+    docker pull registry.hub.docker.com/elgalu/selenium:2.47.1c
 
 ## Pull
 
-    docker run -d --name=max -p=0.0.0.0:4411:24444 -p=0.0.0.0:5911:25900 elgalu/selenium:2.47.1b
+    docker run -d --name=max -p=0.0.0.0:4411:24444 -p=0.0.0.0:5911:25900 elgalu/selenium:2.47.1c
 
 How to connect through vnc (need a vnc client)
 

xterm/bin/timeout-wait-xterm.sh

@@ -0,0 +1,42 @@
+#!/usr/bin/env bash
+
+# Exit immediately if a command exits with a non-zero status
+set -e
+
+# echo fn that outputs to stderr http://stackoverflow.com/a/2990533/511069
+echoerr() {
+  cat <<< "$@" 1>&2;
+}
+
+# print error and exit
+die () {
+  echoerr "ERROR: $1"
+  # if $2 is defined AND NOT EMPTY, use $2; otherwise, set to "3"
+  errnum=${2-3}
+  exit $errnum
+}
+
+# if $1 is defined AND NOT EMPTY, use $1; otherwise, set to "7s"
+WAIT_TIMEOUT=${1-7s}
+LOOP_SCRIPT_PATH="/bin-utils/wait-xterm.sh"
+
+if [ ! -f "${LOOP_SCRIPT_PATH}" ]; then
+  die "Need '${LOOP_SCRIPT_PATH}' to exist!"
+fi
+
+# Avoid waiting forever using the `timeout` command
+if timeout --foreground ${WAIT_TIMEOUT} \
+     ${LOOP_SCRIPT_PATH}; then
+  echo ""
+  grep 'password' /var/log/sele/vnc-stdout.log || true
+  grep 'IP:' /var/log/sele/xterm-stdout.log || die "Failed to grep IP:"
+else
+  bash -c 'tail /var/log/sele/*' || true
+  echo "" && echo "" && echo "==> errors <=="
+  bash -c '/bin-utils/selenium-grep.sh' || true
+
+  die "
+   Your docker-selenium didn't start properly.
+   Start it next time with -e DISABLE_ROLLBACK=true
+  "
+fi

xterm/bin/wait-xterm.sh

@@ -0,0 +1,13 @@
+#!/usr/bin/env bash
+
+# Exit immediately if a command exits with a non-zero status
+set -e
+
+echo "Waiting for docker-selenium to finish starting..."
+while ! grep 'all done and ready for testing' \
+             /var/log/sele/xterm-stdout.log > /dev/null 2>&1; do
+  echo -n '.'
+  sleep 0.2;
+done
+
+echo "Done wait-xterm.sh"