Update docker and reqs

Author: Alexandru Meterez

README.md

@@ -19,7 +19,7 @@ If you just want to clone and run the software, we have provided a Dockerfile. T
 ```
 git clone https://github.com/adobe/frontend-regression-validator.git
 cd frontend-regression-validator/docker
-docker build -t fred .
+docker build --no-cache -t fred .
 docker run -p 5000:5000 -m 8g --memory-reservation=8g --oom-kill-disable=True --memory-swap 8G fred
 ```
 If you still encounter issues with out of memory errors, allocate more memory from the UI Docker app. Simply click the Docker icon in your toolbar, go to `Preferences`-`Advanced` and then pull the slider to around `8GB`.

docker/Dockerfile

@@ -3,6 +3,8 @@ FROM pytorch/pytorch
 # Installing build dependencies
 RUN apt-get update && apt-get install -y git curl unzip
 
+RUN apt-get install -y xorg
+
 # Prepare environment UTF-8
 RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y locales
 RUN sed -i -e 's/# en_US.UTF-8 UTF-8/en_US.UTF-8 UTF-8/' /etc/locale.gen && \
@@ -22,8 +24,5 @@ RUN /opt/conda/bin/activate base && python3 -m pip install -r /work/frontend-reg
 # Extract the model files
 RUN cd /work/frontend-regression-validator/fred/inference && cat model_files.bz2.parta* > model_files.bz2 && tar xjf model_files.bz2
 
-# Install JDK for proxy
-RUN apt-get install -y openjdk-8-jdk
-
 # Start notebook
 CMD cd /work/frontend-regression-validator/fred && git pull && python3 run.py

fred/crawler/crawler.py

@@ -14,7 +14,7 @@ def set(self, source):
 
 
 async def get_page(test_page, url):
-    browser = await launch()
+    browser = await launch({'args': ['--disable-dev-shm-usage', '--no-sandbox']})
     page = await browser.newPage()
     await page.goto(url)
     out = await page.content()

fred/data/collect.py

@@ -16,7 +16,7 @@ async def intercept_console(response):
 
 
 async def collect_msgs_and_screenshot(url, ss_path):
-    browser = await launch()
+    browser = await launch({'args': ['--disable-dev-shm-usage', '--no-sandbox']})
     page = await browser.newPage()
 
     page.on('response', intercept_network_response)

requirements.txt

@@ -7,6 +7,5 @@ torch==1.2.0
 Flask_Cors==3.0.8
 numpy==1.17.1
 Pillow==6.1.0
-browsermob_proxy==0.8.0
 beautifulsoup4==4.8.0
 pyppeteer==0.0.25