Upgrade selenium from 2.46.0 to 2.47.1. Upgrade chrome stable. Add -e MEM_JAVA

Author: elgalu

.dockerignore

@@ -0,0 +1 @@
+.gitignore

.gitignore

@@ -2,5 +2,8 @@ tmp/
 *_image/
 binaries/
 READMEBS.md
+README-Zala.md
+.python-version
 videos/
-
+android/
+binaries

CHANGELOG.md

@@ -4,6 +4,28 @@ Note sha256 digests are generated after pushing the image to the registry theref
 
 Note image ids also change after scm-source.json has being updated which triggers a cyclic problem so value TBD will be set here and updated in the [release][] page by navigating into any release tag.
 
+## 2.47.1a (2015-07-30)
+ + Upgrade selenium from 2.46.0 to 2.47.1 (Leo Gallucci)
+ + Upgrade chrome stable to 44.0.2403.125
+ + Add -e MEM_JAVA to allow to pass custom values like "1024m".
+ + Image tag details:
+  + Selenium: v2.47.1 (411b314)
+  + Chrome stable:    44.0.2403.125
+  + Chrome beta:      45.0.2454.15
+  + Chrome dev:       45.0.2454.15
+  + Firefox versions in this image:
+                      39.0    38.0.6  37.0.2  36.0.4
+      35.0.1  34.0.5  33.0.3  32.0.3  31.0    30.0
+      29.0.1  28.0    27.0.1  26.0    25.0.1  24.0
+  + chromedriver: 2.16.333243 (0bfa1d3575fc1044244f21ddb82bf870944ef961)
+  + Java: 1.8.0_60-internal OpenJDK 64-Bit 1.8.0_60-b22
+  + Timezone: Europe/Berlin
+  + Built with: Docker version 1.7.1, build 786b29d
+  + FROM ubuntu:wily-20150708
+  + Python: 2.7.10
+  + Image ID: TBD
+  + Digest: sha256:TBD
+
 ## 2.46.0-06 (2015-07-24)
  + Upgrade chrome stable to 44.0.2403.89. (Leo Gallucci)
  + Remove letter v from version tags due to github tarball issue.

Dockerfile

@@ -152,17 +152,6 @@ RUN apt-get update -qqy \
 #        /usr/lib/jvm/java-8-oracle/jre/lib/security/java.security \
 #   && rm -rf /var/lib/apt/lists/*
 
-#==============================================================================
-# java blocks until kernel have enough entropy to generate the /dev/random seed
-#==============================================================================
-# This fix is not working so commented out.
-#  SeleniumHQ/docker-selenium/issues/14
-# RUN apt-get update -qqy \
-#   && apt-get -qqy install \
-#     haveged rng-tools \
-#   && service haveged start \
-#   && update-rc.d haveged defaults
-
 #=======
 # Fonts
 #=======
@@ -211,8 +200,8 @@ USER ${NORMAL_USER}
 #==========
 # Selenium
 #==========
-ENV SEL_MAJOR_MINOR_VER 2.46
-ENV SEL_PATCH_LEVEL_VER 0
+ENV SEL_MAJOR_MINOR_VER 2.47
+ENV SEL_PATCH_LEVEL_VER 1
 ENV SEL_HOME ${NORMAL_USER_HOME}/selenium
 RUN  mkdir -p ${SEL_HOME} \
   && export SELBASE="http://selenium-release.storage.googleapis.com" \
@@ -519,7 +508,7 @@ RUN apt-get update -qqy \
 # TODO: Use Google fingerprint to verify downloads
 #  http://www.google.de/linuxrepositories/
 # Also fix .deb file names with correct version
-RUN  latest_chrome_version_trigger="44.0.2403.89" \
+RUN  latest_chrome_version_trigger="44.0.2403.107" \
   && mkdir -p ${NORMAL_USER_HOME}/chrome-deb \
   && export CHROME_URL="https://dl.google.com/linux/direct" \
   && wget --no-verbose -O \
@@ -611,6 +600,18 @@ RUN apt-get update -qqy \
 ADD supervisor/etc/supervisor/supervisord.conf /etc/supervisor/
 ADD **/etc/supervisor/conf.d/* /etc/supervisor/conf.d/
 
+#==============================================
+# Java blocks until kernel have enough entropy
+# to generate the /dev/random seed
+#==============================================
+# See: SeleniumHQ/docker-selenium/issues/14
+RUN apt-get update -qqy \
+  && apt-get -qqy install \
+    haveged rng-tools \
+  && service haveged start \
+  && update-rc.d haveged defaults \
+  && rm -rf /var/lib/apt/lists/*
+
 #======
 # User
 #======
@@ -712,6 +713,8 @@ ENV FIREFOX_VERSIONS="${FIREFOX_VERSIONS1}, ${FIREFOX_VERSIONS2}, ${FIREFOX_VERS
   VIDEOS_DIR="${NORMAL_USER_HOME}/videos" \
   # You can choose what X manager to use
   XMANAGER="fluxbox" \
+  # Java stuff
+  # MEM_JAVA="1024m" \
   #===============================
   # Run docker from inside docker
   # Usage: docker run -v /var/run/docker.sock:/var/run/docker.sock

README.md

@@ -19,7 +19,7 @@ Note SeleniumHQ/docker-selenium project is more useful for building selenium gri
 In general: add `sudo` only if needed in your environment and `--privileged` if you really need it.
 
     sudo docker run --privileged -p 4444:24444 -p 5920:25900 \
-        -e VNC_PASSWORD=hola elgalu/selenium:2.46.0-06
+        -e VNC_PASSWORD=hola elgalu/selenium:2.47.1a
 
 ### Non-privileged
 ### Run
@@ -31,7 +31,7 @@ If your setup is correct, privileged mode and sudo should not be necessary:
         -e SCREEN_WIDTH=1920 -e SCREEN_HEIGHT=1080 \
         -e VNC_PASSWORD=hola \
         -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" \
-        elgalu/selenium:2.46.0-06
+        elgalu/selenium:2.47.1a
 
 Make sure `docker run` finishes with **selenium all done and ready for testing** else you won't be able to start your tests. To perform this check programatically please use this command where `ch` is the name of the container:
 
@@ -96,7 +96,7 @@ You can lunch a grid only container via environment variables:
 
     docker run --rm --name=hub -p 4444:24444 -p 5930:25900 -p 2223:22222 \
       -p=6081:26080 -e CHROME=false -e FIREFOX=false \
-      elgalu/selenium:2.46.0-06
+      elgalu/selenium:2.47.1a
 
 The important part above is `-e CHROME=false -e FIREFOX=false` which tells the docker image not run run default chorme and firefox nodes turning the container into a grid-only one.
 
@@ -112,7 +112,7 @@ You can lunch a node only container via environment variables:
       -p 25550:25550 -p 25551:25551 \
       -e GRID=false -e CHROME=true -e FIREFOX=true \
       -v $(pwd)/videos:/videos \
-      elgalu/selenium:2.46.0-06
+      elgalu/selenium:2.47.1a
 
 The important part above is `-e GRID=false` which tells the container to be a node-only node, this this case with 2 browsers `-e CHROME=true -e FIREFOX=true` but could be just 1.
 
@@ -137,9 +137,9 @@ There are also additional steps you can take to ensure you're using the correct
 
 You can simply verify that image id is indeed the correct one.
 
-    # e.g. full image id for tag 2.46.0-06
-    export IMGID=7d6df22491ed41ec6474b5bf9a48f453dc0d835ce257f39e02cd5fe356a2c1bb
-    if docker inspect -f='{{.Id}}' elgalu/selenium:2.46.0-06 |grep ${IMGID} &> /dev/null; then
+    # e.g. full image id for tag 2.47.1a
+    export IMGID=TBD
+    if docker inspect -f='{{.Id}}' elgalu/selenium:2.47.1a |grep ${IMGID} &> /dev/null; then
         echo "Image ID tested ok"
     else
         echo "Image ID doesn't match"
@@ -149,8 +149,8 @@ You can simply verify that image id is indeed the correct one.
 
 Given docker.io currently allows to push the same tag image twice this represent a security concern but since docker >= 1.6.2 is possible to fetch the digest sha256 instead of the tag so you can be sure you're using the exact same docker image every time:
 
-    # e.g. sha256 for tag 2.46.0-06
-    export SHA=fe49be13887bb390ca4f6d3617fd8f34c6a84bc08319bb4f18555ed7d6045f08
+    # e.g. sha256 for tag 2.47.1a
+    export SHA=TBD
     docker pull elgalu/selenium@sha256:${SHA}
 
 You can find all digests sha256 and image ids per tag in the [CHANGELOG](./CHANGELOG.md) so as of now you just need to trust the sha256 in the CHANGELOG. Bullet proof is to fork this project and build the images yourself if security is a big concern.
@@ -169,7 +169,7 @@ Host machine, terminal 2:
     docker run --rm --name=ch -p=4470:24444 \
       -e SCREEN_WIDTH -e SCREEN_HEIGHT -e XE_DISP_NUM \
       -v /tmp/.X11-unix/X${XE_DISP_NUM}:/tmp/.X11-unix/X${XE_DISP_NUM} \
-      elgalu/selenium:2.46.0-06
+      elgalu/selenium:2.47.1a
 
 Now when you run your tests instead of connecting. If docker run fails try `xhost +`
 
@@ -191,7 +191,7 @@ ANYPORT=0
 REMOTE_DOCKER_SRV=localhost
 CONTAINER=$(docker run -d -p=0.0.0.0:${ANYPORT}:22222 -p=0.0.0.0:${ANYPORT}:24444 \
     -p=0.0.0.0:${ANYPORT}:25900 -e SCREEN_HEIGHT=1110 -e VNC_PASSWORD=hola \
-    -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" elgalu/selenium:2.46.0-06
+    -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" elgalu/selenium:2.47.1a
 
 # -- Option 2.docker run- Running docker on remote docker server like in the cloud
 # Useful if the docker server is running in the cloud. Establish free local ports
@@ -201,7 +201,7 @@ ssh ${REMOTE_DOCKER_SRV} #get into the remote docker provider somehow
 # it acts as a jump host so my public key is already on that server
 CONTAINER=$(docker run -d -p=0.0.0.0:${ANYPORT}:22222 -e SCREEN_HEIGHT=1110 \
     -e VNC_PASSWORD=hola -e SSH_AUTH_KEYS="$(cat ~/.ssh/authorized_keys)" \
-    elgalu/selenium:2.46.0-06
+    elgalu/selenium:2.47.1a
 
 # -- Common: Wait for the container to start
 ./host-scripts/wait-docker-selenium.sh ch 7s
@@ -272,7 +272,7 @@ If you git clone this repo locally, i.e. cd into where the Dockerfile is, you ca
 
 If you prefer to download the final built image from docker you can pull it, personally I always prefer to build them manually except for the base images like Ubuntu 14.04.2:
 
-    docker pull elgalu/selenium:2.46.0-06
+    docker pull elgalu/selenium:2.47.1a
 
 #### 2. Use this image
 
@@ -334,10 +334,30 @@ All output is sent to stdout so it can be inspected by running:
 $ docker logs -f <container-id|container-name>
 ```
 
-Container leaves a few logs files to see what happened:
+Powered by Supervisor, the container leaves many logs;
+
+    /var/log/sele/docker-selenium-status.log
+    /var/log/sele/novnc-stderr.log
+    /var/log/sele/novnc-stdout.log
+    /var/log/sele/selenium-hub-stderr.log
+    /var/log/sele/selenium-hub-stdout.log
+    /var/log/sele/selenium-node-chrome-stderr.log
+    /var/log/sele/selenium-node-chrome-stdout.log
+    /var/log/sele/selenium-node-firefox-stderr.log
+    /var/log/sele/selenium-node-firefox-stdout.log
+    /var/log/sele/sshd-stderr.log
+    /var/log/sele/sshd-stdout.log
+    /var/log/sele/supervisord.log
+    /var/log/sele/video-rec-stderr.log
+    /var/log/sele/video-rec-stdout.log
+    /var/log/sele/vnc-stderr.log
+    /var/log/sele/vnc-stdout.log
+    /var/log/sele/xmanager-stderr.log
+    /var/log/sele/xmanager-stdout.log
+    /var/log/sele/xterm-stderr.log
+    /var/log/sele/xterm-stdout.log
+    /var/log/sele/xvfb-stderr.log
+    /var/log/sele/xvfb-stdout.log
+
+### Versioning
 
-    /tmp/Xvfb_headless.log
-    /tmp/xmanager.log
-    /tmp/x11vnc_forever.log
-    /tmp/local-sel-headless.log
-    /tmp/selenium-server-standalone.log

READMELeo.md

@@ -1,15 +1,15 @@
 ## Build
 
-    time (docker build -t="elgalu/selenium:2.46.0-06" . ;echo $?;beep)
-    docker run --rm -ti --name=ch -p=4470:24444 -p=5920:25900 -p=2222:22222 -p=6080:26080 -p=29001:29001 -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" -v $(pwd)/videos:/videos -e DISABLE_ROLLBACK=true -e CHROME_FLAVOR=unstable -e FIREFOX_VERSION=38.0.6 -e VIDEO=true -e VIDEO_FILE_NAME=hola -e VIDEO_CHUNK_SECS="00:00:05" elgalu/selenium:2.46.0-06
+    time (docker build -t="elgalu/selenium:2.47.1a" . ;echo $?;beep)
+    docker run --rm -ti --name=ch -p=4470:24444 -p=5920:25900 -p=2222:22222 -p=6080:26080 -p=29001:29001 -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" -v $(pwd)/videos:/videos -e DISABLE_ROLLBACK=true -e VIDEO=true -e VIDEO_FILE_NAME=hola elgalu/selenium:2.47.1a
 
 See logs
 
     docker exec -ti ch bash -c "ls -lah /var/log/sele/"
 
 Testing in ssh [email protected]
 
-    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -p=2222:22222 -e SSH_AUTH_KEYS="$(cat ~/.ssh/authorized_keys)" -e VNC_PASSWORD=Hola3 os-registry.stups.zalan.do/tip/selenium:2.46.0-06
+    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -p=2222:22222 -e SSH_AUTH_KEYS="$(cat ~/.ssh/authorized_keys)" -e VNC_PASSWORD=Hola3 os-registry.stups.zalan.do/tip/selenium:2.47.1a
 
 ## Transfer used browser source artifacts to keep them in the cloud
 
@@ -32,18 +32,18 @@ List firefox versions via docker exe
 
 ## To update image id and digest
 
-    docker inspect -f='{{.Id}}' elgalu/selenium:2.46.0-06
+    docker inspect -f='{{.Id}}' elgalu/selenium:2.47.1a
     docker images --digests
 
 ## Run with shared dir
 
     docker run --rm --name=ch -p=127.0.0.1:4460:24444 -p=127.0.0.1:5910:25900 \
-      -v /e2e/uploads:/e2e/uploads elgalu/selenium:2.46.0-06
+      -v /e2e/uploads:/e2e/uploads elgalu/selenium:2.47.1a
     docker run --rm --name=ch -p=4460:24444 -p=5910:25900 \
-      -v /var/run/docker.sock:/var/run/docker.sock -v $(which docker):$(which docker) elgalu/selenium:2.46.0-06
+      -v /var/run/docker.sock:/var/run/docker.sock -v $(which docker):$(which docker) elgalu/selenium:2.47.1a
 
 
-    docker run --rm --name=ff -p=127.0.0.1:4461:24444 -p=127.0.0.1:5911:25900 -v /e2e/uploads:/e2e/uploads elgalu/selenium:2.46.0-06
+    docker run --rm --name=ff -p=127.0.0.1:4461:24444 -p=127.0.0.1:5911:25900 -v /e2e/uploads:/e2e/uploads elgalu/selenium:2.47.1a
 
 ## Run without shared dir and bind ports to all network interfaces
 
@@ -66,11 +66,11 @@ List firefox versions via docker exe
 ## Run without dir and bind to all interfaces
 Note anything after the image will be taken as arguments for the cmd/entrypoint
 
-    docker run --rm --name=ch -p=0.0.0.0:8813:8484 -p=0.0.0.0:2222:2222 -p=0.0.0.0:4470:24444 -p=0.0.0.0:5920:25900 -e SCREEN_WIDTH=1800 -e SCREEN_HEIGHT=1110 -e VNC_PASSWORD=hola -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" elgalu/selenium:2.46.0-06
+    docker run --rm --name=ch -p=0.0.0.0:8813:8484 -p=0.0.0.0:2222:2222 -p=0.0.0.0:4470:24444 -p=0.0.0.0:5920:25900 -e SCREEN_WIDTH=1800 -e SCREEN_HEIGHT=1110 -e VNC_PASSWORD=hola -e SSH_AUTH_KEYS="$(cat ~/.ssh/id_rsa.pub)" elgalu/selenium:2.47.1a
 
-    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -e VNC_PASSWORD=hola elgalu/selenium:2.46.0-06
-    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -e VNC_PASSWORD=hola docker.io/elgalu/selenium:2.46.0-06
-    docker run --rm --name=ch -p=0.0.0.0:4470:24444 -p=0.0.0.0:5920:25900 --add-host myserver.dev:172.17.42.1 elgalu/selenium:2.46.0-06
+    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -e VNC_PASSWORD=hola elgalu/selenium:2.47.1a
+    docker run --rm --name=ch -p=4470:24444 -p=5920:25900 -e VNC_PASSWORD=hola docker.io/elgalu/selenium:2.47.1a
+    docker run --rm --name=ch -p=0.0.0.0:4470:24444 -p=0.0.0.0:5920:25900 --add-host myserver.dev:172.17.42.1 elgalu/selenium:2.47.1a
 
 However adding a custom host IP to server-selenium.local (e.g. bsele ssh config) is more work:
 
@@ -79,32 +79,32 @@ However adding a custom host IP to server-selenium.local (e.g. bsele ssh config)
 
     vncv localhost:5920 -Scaling=60%  &
 
-    docker run --rm --name=ff -p=0.0.0.0:4471:24444 -p=0.0.0.0:5921:25900 elgalu/selenium:2.46.0-06
+    docker run --rm --name=ff -p=0.0.0.0:4471:24444 -p=0.0.0.0:5921:25900 elgalu/selenium:2.47.1a
 
 Automatic builds not working for me right now, maybe there is an issue with docker registry v1 vs v2
 https://registry.hub.docker.com/u/elgalu/docker-selenium/builds_history/31621/
 
 ## Push version
 
     docker login
-    docker push docker.io/elgalu/selenium:2.46.0-06 ;echo $?;beep
-    docker tag elgalu/selenium:2.46.0-06 elgalu/selenium:latest
+    docker push docker.io/elgalu/selenium:2.47.1a ;echo $?;beep
+    docker tag elgalu/selenium:2.47.1a elgalu/selenium:latest
     docker push docker.io/elgalu/selenium:latest
 
 Not working maybe because it has automated builds enabled but then it fails in the cloud but works locally
 https://registry.hub.docker.com/u/elgalu/selenium/tags/manage/
 
-    docker push elgalu/selenium:2.46.0-06
-    docker push elgalu/docker-selenium:2.46.0-06
-    docker push docker.io/elgalu/docker-selenium:2.46.0-06
+    docker push elgalu/selenium:2.47.1a
+    docker push elgalu/docker-selenium:2.47.1a
+    docker push docker.io/elgalu/docker-selenium:2.47.1a
 
 ## Pulling
 
-    docker pull registry.hub.docker.com/elgalu/selenium:2.46.0-06
+    docker pull registry.hub.docker.com/elgalu/selenium:2.47.1a
 
 ## Pull
 
-    docker run -d --name=max -p=0.0.0.0:4411:24444 -p=0.0.0.0:5911:25900 elgalu/selenium:2.46.0-06
+    docker run -d --name=max -p=0.0.0.0:4411:24444 -p=0.0.0.0:5911:25900 elgalu/selenium:2.47.1a
 
 How to connect through vnc (need a vnc client)
 

host-scripts/get-host-scripts-and-dump.sh renamed to host-scripts/get-host-scripts.sh

@@ -4,7 +4,7 @@
 set -e
 
 BASEURL="https://github.com/elgalu/docker-selenium"
-CURVERSION="2.46.0-06"
+CURVERSION="2.47.1a"
 HSVERDIR="docker-selenium-${CURVERSION}/host-scripts"
 
 if [ ! -f "${CURVERSION}.zip" ]; then
@@ -21,17 +21,16 @@ if [ -f "${CURVERSION}.zip" ]; then
   rm ${CURVERSION}.zip
 fi
 
-for i in $(seq 0 3); do
-  FILENAME="${CURVERSION}.tar--part0${i}"
-  DOWNPART="${BASEURL}/releases/download/${CURVERSION}/${FILENAME}"
-  if [ ! -f "${FILENAME}" ]; then
-    echo "Downloading '${FILENAME}' ..."
-    wget -nv "${DOWNPART}"
-  fi
-done
-
-# Join
-if [ ! -f "${CURVERSION}.tar" ]; then
-  echo "Joining ${CURVERSION}.tar parts..."
-  cat ${CURVERSION}.tar--part* > ${CURVERSION}.tar
-fi
+# for i in $(seq 0 3); do
+#   FILENAME="${CURVERSION}.tar--part0${i}"
+#   DOWNPART="${BASEURL}/releases/download/${CURVERSION}/${FILENAME}"
+#   if [ ! -f "${FILENAME}" ]; then
+#     echo "Downloading '${FILENAME}' ..."
+#     wget -nv "${DOWNPART}"
+#   fi
+# done
+# # Join
+# if [ ! -f "${CURVERSION}.tar" ]; then
+#   echo "Joining ${CURVERSION}.tar parts..."
+#   cat ${CURVERSION}.tar--part* > ${CURVERSION}.tar
+# fi

java/bin/java-dynamic-memory-opts.sh

@@ -22,9 +22,10 @@ die () {
 # JVM uses only 1/4 of system memory by default
 # set at Dockerfile or via docker run: MEM_JAVA_PERCENT=80
 # Required env vars validations
-[ -z "$MEM_JAVA_PERCENT" ] && die "Need to set env var MEM_JAVA_PERCENT"
+[ -z "${MEM_JAVA_PERCENT}" ] && die "Need to set env var MEM_JAVA_PERCENT"
 
 MEM_TOTAL_KB=$(cat /proc/meminfo | grep MemTotal | awk '{print $2}')
-MEM_JAVA_KB=$(($MEM_TOTAL_KB * $MEM_JAVA_PERCENT / 100))
+MEM_JAVA_KB=$((${MEM_TOTAL_KB} * ${MEM_JAVA_PERCENT} / 100))
+[ -z "${MEM_JAVA}" ] && export MEM_JAVA="${MEM_JAVA_KB}k"
 
-echo "-Xmx${MEM_JAVA_KB}k"
+echo "-Xmx${MEM_JAVA}"