What could be the issue?

[ilikepear]

Hi i am facing an issue to start the demo.

Ubuntu 22.04 LTS KVM instance.

Here are the steps i follow:

apt-get update && apt-get install docker && apt-get install docker-compose
git clone https://github.com/deepset-ai/haystack.git
cd haystack

Make the following changes to the docker-compose.yml file:

  haystack-api:
    # Pull Haystack's latest commit
    image: "deepset/haystack:cpu-main"
    ports:
      - 8000:8000
    restart: on-failure
    environment:
      # See rest_api/pipeline/pipelines.haystack-pipeline.yml for configurations of Search & Indexing Pipeline.
      - DOCUMENTSTORE_PARAMS_HOST=elasticsearch
      - PIPELINE_YAML_PATH=/opt/venv/lib/python3.10/site-packages/rest_api/pipeline/pipelines.haystack-pipeline.yml
      - QUERY_PIPELINE_NAME=query
      - TOKENIZERS_PARALLELISM=false
    depends_on:
      elasticsearch:
        condition: service_healthy

  elasticsearch:
    # This image is "ready-to-query" with some indexed articles
    # about countries and capital cities from Wikipedia:
    # image: "deepset/elasticsearch-countries-and-capitals"
    image: "elasticsearch:7.9.2" 
    ports:
      - 9200:9200
    restart: on-failure
    environment:
      - discovery.type=single-node
      - "ES_JAVA_OPTS=-Xms1024m -Xmx1024m"
    healthcheck:
        test: curl --fail http://localhost:9200/_cat/health || exit 1
        interval: 10s
        timeout: 1s
        retries: 10

  ui:
    depends_on:
      - haystack-api
    build:
      context: ui
      dockerfile: Dockerfile
    ports:
      - 8501:8501
    restart: on-failure
    environment:
      - API_ENDPOINT=http://haystack-api:8000
      - EVAL_FILE=ui/eval_labels_example.csv
      # The value of the following variables will be read from the host, if present.
      # They can also be temporarily set for docker-compose, for example:
      # DISABLE_FILE_UPLOAD=1 DEFAULT_DOCS_FROM_RETRIEVER=5 docker-compose up
      - DISABLE_FILE_UPLOAD
      - DEFAULT_QUESTION_AT_STARTUP
      - DEFAULT_DOCS_FROM_RETRIEVER
      - DEFAULT_NUMBER_OF_ANSWERS

sudo docker-compose pull
sudo docker-compose up

sudo docker ps -a //check the running docker containers.

deepset/haystack:cpu-main - haystack_haystack-api_1
haystack_ui - haystack_ui_1
elasticsearch:7.9.2 - haystack_elasticsearch_1

The deepset/haystack:cpu-main container keep restarting, failing with the following error.

haystack-api_1 | [2022-12-28 07:19:54 +0000] [7] [ERROR] Exception in worker process
haystack-api_1 | Traceback (most recent call last):
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
haystack-api_1 | worker.init_process()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/uvicorn/workers.py", line 66, in init_process
haystack-api_1 | super(UvicornWorker, self).init_process()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/gunicorn/workers/base.py", line 134, in init_process
haystack-api_1 | self.load_wsgi()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/gunicorn/workers/base.py", line 146, in load_wsgi
haystack-api_1 | self.wsgi = self.app.wsgi()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/gunicorn/app/base.py", line 67, in wsgi
haystack-api_1 | self.callable = self.load()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 58, in load
haystack-api_1 | return self.load_wsgiapp()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 48, in load_wsgiapp
haystack-api_1 | return util.import_app(self.app_uri)
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/gunicorn/util.py", line 359, in import_app
haystack-api_1 | mod = importlib.import_module(module)
haystack-api_1 | File "/usr/local/lib/python3.10/importlib/init.py", line 126, in import_module
haystack-api_1 | return _bootstrap._gcd_import(name[level:], package, level)
haystack-api_1 | File "", line 1050, in _gcd_import
haystack-api_1 | File "", line 1027, in _find_and_load
haystack-api_1 | File "", line 1006, in _find_and_load_unlocked
haystack-api_1 | File "", line 688, in _load_unlocked
haystack-api_1 | File "", line 883, in exec_module
haystack-api_1 | File "", line 241, in _call_with_frames_removed
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/rest_api/application.py", line 13, in
haystack-api_1 | app = get_app()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/rest_api/utils.py", line 28, in get_app
haystack-api_1 | from rest_api.controller import file_upload, search, feedback, document, health
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/rest_api/controller/file_upload.py", line 20, in
haystack-api_1 | indexing_pipeline: Pipeline = get_pipelines().get("indexing_pipeline", None)
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/rest_api/utils.py", line 59, in get_pipelines
haystack-api_1 | pipelines = setup_pipelines()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/rest_api/pipeline/init.py", line 28, in setup_pipelines
haystack-api_1 | query_pipeline = Pipeline.load_from_yaml(Path(config.PIPELINE_YAML_PATH), pipeline_name=config.QUERY_PIPELINE_NAME)
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/haystack/pipelines/base.py", line 1908, in load_from_yaml
haystack-api_1 | return cls.load_from_config(
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/haystack/pipelines/base.py", line 1969, in load_from_config
haystack-api_1 | validate_config(pipeline_config, strict_version_check=strict_version_check)
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/haystack/pipelines/config.py", line 245, in validate_config
haystack-api_1 | validate_schema(pipeline_config=pipeline_config, strict_version_check=strict_version_check, extras=extras)
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/haystack/pipelines/config.py", line 302, in validate_schema
haystack-api_1 | schema = load_schema()
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/haystack/nodes/_json_schema.py", line 423, in load_schema
haystack-api_1 | raise e
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/haystack/nodes/_json_schema.py", line 417, in load_schema
haystack-api_1 | update_json_schema(main_only=True)
haystack-api_1 | File "/opt/venv/lib/python3.10/site-packages/haystack/nodes/_json_schema.py", line 437, in update_json_schema
haystack-api_1 | os.makedirs(destination_path, exist_ok=True)
haystack-api_1 | File "/usr/local/lib/python3.10/os.py", line 225, in makedirs
haystack-api_1 | mkdir(name, mode)
haystack-api_1 | PermissionError: [Errno 13] Permission denied: '/opt/venv/lib/python3.10/site-packages/haystack/json-schemas'
haystack-api_1 | [2022-12-28 07:19:54 +0000] [7] [INFO] Worker exiting (pid: 7)
haystack-api_1 | [2022-12-28 07:19:56 +0000] [1] [INFO] Shutting down: Master
haystack-api_1 | [2022-12-28 07:19:56 +0000] [1] [INFO] Reason: Worker failed to boot.
haystack_haystack-api_1 exited with code 3
haystack-api_1 | [2022-12-28 07:20:57 +0000] [1] [INFO] Starting gunicorn 20.1.0
haystack-api_1 | [2022-12-28 07:20:57 +0000] [1] [INFO] Listening at: http://0.0.0.0:8000 (1)
haystack-api_1 | [2022-12-28 07:20:57 +0000] [1] [INFO] Using worker: uvicorn.workers.UvicornWorker
haystack-api_1 | [2022-12-28 07:20:57 +0000] [7] [INFO] Booting worker with pid: 7

Does anyone know what I did wrong? Thanks!

[masci]

@ilikepear there's a commit that was merged in main a few hours ago causing that problem. Can you try using a stable Haystack image, like image: "deepset/haystack:cpu-v1.12.2"?

[ilikepear]

Great! Thats the solution! Thanks so much.