Added Server setup

added folder server_setup containing cricial files for ubuntu sertver setup | nginx -> defult , *.mallickboy.com | gunicorn -> pysearch.service | Updated README.md with proper guidance and updated requirements.txt now using torch cpu version only so that it can be used in 2 GB RAM server

Author: mallickboy

README.md

@@ -1,26 +1,103 @@
 <h1 align="center">
-Python Search Engine 2.0
+Python Search Engine 2.0 Server setup
 </h1>
 
 ### Create virtual environment
 
-``` python -m venv search_engine ```
+``` mkdir pysearch  ```
+
+``` cd pysearch  ```
+
+``` sudo apt install python3.9 python3.9-venv python3.9-distutils ```
+
+``` python3.9 -m venv pysearch ```
 
 ### Activate virtual environment (from parent folder)
 
-```Set-ExecutionPolicy -Scope Process -ExecutionPolicy Bypass```
+```Set-ExecutionPolicy -Scope Process -ExecutionPolicy Bypass```   &
+
+``` .\search_engine\Scripts\activate ``` or
+
+``` source pysearch/bin/activate ```
 
-``` .\search_engine\Scripts\activate ```
+### Install PyTorch (  lightweight CPU version only )
+
+``` pip install torch --index-url https://download.pytorch.org/whl/cpu  ```
 
 ### Install required libraries
 
-``` pip install version_requirements.txt  ```
+``` pip install -r requirements.txt  ```
+
+### Open firewall & update inbound port 8000 in Azure
+
+``` sudo ufw enable ```
+
+``` sudo ufw allow 8000 ```
+
+``` sudo ufw status ```
+
+### Run and Test 
+
+``` python app.py  ```
+
+Visit http://{your_server_ip}:8000
+
+
+<h2 align="center">
+Adding SSL, NGINX and deployment using GUNICORNN
+</h1>
+
+### Deploy the site using gunicorn
+
+``` gunicorn -w 4 -b 0.0.0.0:8000 app:app ```
+
+``` sudo nano /etc/systemd/system/pysearch.service ``` paste code of server_setup/pysearch.service
+
+``` sudo systemctl daemon-reload ```
+
+``` sudo systemctl restart pysearch ```
+
+``` sudo systemctl enable pysearch ```
+
+``` sudo systemctl status pysearch ```
+
+### Setup Domain/ Sub-Domain
+
+Add New record in Advanced DNS in domain provider
+
+``` Type = "A Record"   Host= "pysearch"    Value = "server public ip"  TTL = "Automatic" ```  ( Sub-Domain )
+
+``` Type = "A Record"   Host= "@"    Value = "server public ip"  TTL = "Automatic" ```         ( Domain )
+
+### Installing SSL certificate
+
+``` sudo apt install certbot python3-certbot-nginx ```
+
+``` sudo certbot --nginx -d pysearch.mallickboy.com ```
+
+``` sudo certbot certificates ```
+
+``` sudo systemctl status certbot.timer ```  check auto renewal
+
+### Set-Up NGINX
+
+``` sudo nano /etc/nginx/sites-available/pysearch.mallickboy.com  ```  (copy contents of server_setup/pysearch.mallickboy.com)
+
+``` sudo nano /etc/nginx/sites-available/default  ```  (copy contents of server_setup/default)
+
+``` sudo ln -s /etc/nginx/sites-available/pysearch.mallickboy.com /etc/nginx/sites-enabled/ ```  
+
+``` sudo nginx -t  ```
+
+``` sudo systemctl reload nginx ```
+
+``` sudo systemctl restart nginx ```
+
+### Visit 
 
-### Select kernel for Jupiter Notebook ( ipynb )
+[ https://pysearch.mallickboy.com ](https://pysearch.mallickboy.com)
 
-From top right corner select ``` (parent_folder)/Scripts/python.exe ``` as kernel and run
 
-For python file use ``` python file_name ``` to execute
 
 <h1 align="center">
 Output View

requirements.txt

@@ -1,6 +1,8 @@
-Flask==3.0.3
-flask-cors==5.0.0
-python-dotenv==1.0.1
-pinecone-client==5.0.1
-sentence-transformers==3.3.1
-gunicorn==20.1.0
+--extra-index-url https://download.pytorch.org/whl/cpu
+torch>=2.0.0
+Flask>=3.1.0
+flask-cors>=5.0.0
+python-dotenv>=1.0.0
+pinecone-client>=5.0.1
+sentence-transformers>=3.3.1
+gunicorn>=23.0.0

server_setup/default

@@ -0,0 +1,18 @@
+# NGINX default file settings
+server {
+        listen 80 default_server;
+        listen [::]:80 default_server;
+
+        root /var/www/html;
+
+        # Add index.php to the list if you are using PHP
+        index index.html index.htm index.nginx-debian.html;
+
+        server_name _;
+
+        location / {
+                # First attempt to serve request as file, then
+                # as directory, then fall back to displaying a 404.
+                try_files $uri $uri/ =404;
+        }
+}

server_setup/nginx_setup_http_only_xyz.com

@@ -0,0 +1,14 @@
+# sudo nano /etc/nginx/sites-available/pysearch.mallickboy.com 
+server { # http only
+    listen 80;
+    server_name pysearch.mallickboy.com;
+
+    location / {
+        proxy_pass http://localhost:8000;
+        proxy_set_header Host $host;
+        proxy_set_header X-Real-IP $remote_addr;
+        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
+        proxy_set_header X-Forwarded-Proto $scheme;
+        proxy_redirect off;
+    }
+}

server_setup/pysearch.mallickboy.com

@@ -0,0 +1,28 @@
+# sudo nano /etc/nginx/sites-available/pysearch.mallickboy.com
+
+server {                                        # Redirect HTTP traffic to HTTPS
+    listen 80;
+    server_name pysearch.mallickboy.com;
+    return 301 https://$host$request_uri;       # Redirect to HTTPS
+}
+
+server {                                        # HTTPS Configuration
+    listen 443 ssl http2;
+    server_name pysearch.mallickboy.com;
+
+    ssl_certificate /etc/letsencrypt/live/pysearch.mallickboy.com/fullchain.pem;    # SSL certificate paths 
+    ssl_certificate_key /etc/letsencrypt/live/pysearch.mallickboy.com/privkey.pem;
+
+    ssl_protocols TLSv1.2 TLSv1.3;              # SSL security settings
+    ssl_ciphers HIGH:!aNULL:!MD5;
+    ssl_prefer_server_ciphers on;
+    
+    location / {                                # proxy requests to flask app
+        proxy_pass http://localhost:8000;
+        proxy_set_header Host $host;
+        proxy_set_header X-Real-IP $remote_addr;
+        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
+        proxy_set_header X-Forwarded-Proto $scheme;
+        proxy_redirect off;
+    }
+}

server_setup/pysearch.service

@@ -0,0 +1,19 @@
+[Unit]
+Description=Gunicorn instance for PySearch  # put it at  sudo nano /etc/systemd/system/pysearch.service  for gunicorn
+After=network.target
+
+# Setup to run gunicorn at system start
+
+[Service]
+User=mallickboy
+Group=www-data
+WorkingDirectory=/home/mallickboy/pysearch
+ExecStart=/home/mallickboy/pysearch/pysearch/bin/gunicorn -w 2 -b 0.0.0.0:8000 app:app      # 2 workers 
+
+# Optional: Standard output/error redirection to logs
+StandardOutput=syslog
+StandardError=syslog
+SyslogIdentifier=gunicorn
+
+[Install]
+WantedBy=multi-user.target

server_setup/search.mallickboy.com

@@ -0,0 +1,28 @@
+# sudo nano /etc/nginx/sites-available/search.mallickboy.com
+
+server {                                        # Redirect HTTP traffic to HTTPS
+    listen 80;
+    server_name search.mallickboy.com;
+    return 301 https://$host$request_uri;       # Redirect to HTTPS
+}
+
+server {                                        # HTTPS Configuration
+    listen 443 ssl http2;
+    server_name search.mallickboy.com;
+
+    ssl_certificate /etc/letsencrypt/live/search.mallickboy.com/fullchain.pem;    # SSL certificate paths 
+    ssl_certificate_key /etc/letsencrypt/live/search.mallickboy.com/privkey.pem;
+
+    ssl_protocols TLSv1.2 TLSv1.3;              # SSL security settings
+    ssl_ciphers HIGH:!aNULL:!MD5;
+    ssl_prefer_server_ciphers on;
+    
+    location / {                                # proxy requests to flask app
+        proxy_pass http://localhost:8000;
+        proxy_set_header Host $host;
+        proxy_set_header X-Real-IP $remote_addr;
+        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
+        proxy_set_header X-Forwarded-Proto $scheme;
+        proxy_redirect off;
+    }
+}