Express relay python searcher (#1319)

* move js searcher sdk

* add the python searcher sdk

* remove pycache

* create class for simple searcher

* add websocket to python searcher sdk

* finish ws, avoid storing liquidation opportunities within client

* python scripts now working w auto type generation

* minor precommit changes

* address comments 1

* add openapi type generations

* fixed precommit issues on generated type files

* reorg

* fixed openapi_client generated precommit

* fix js filepath issue

* added close ws

* renamings and add send_ws_message method

* get rid of duplicate error parsing

* cleanup

* set up pypi workflow

* address comments

* add python precommit

* changes + precommit changes

* test precommit change

* test precommit change

* test precommit change

* test precommit change

* test precommit change

* test precommit change

* test precommit change

* test precommit change

* test precommit change

* correct directory for poetry in pypi wf

* remove isort

* rename package

* add UUID and some cleanup

* new openapi typings

* add pydantic to pyproj

* more changes

* precommit

* remove extraneous files, stick w actual_instance

* added back http as nondefault

* correction

* some cleanup and reorg

* minor changes

* add back api response typing file

* minorer changes

* exclude openapi_client from end of file fixer

* build internal models via pydantic

* chgs

* start to reorg classes

* configure precommit to work

* some cleanup

* reorg a bit

* address comments

* chgs

* fgt

* morechgs

* some more chgs

---------

Co-authored-by: ani <[email protected]>
Co-authored-by: ani <[email protected]>

Author: 3 people

.github/workflows/ci-pre-commit.yml

@@ -5,6 +5,10 @@ on:
   push:
     branches: [main]
 
+env:
+  PYTHON_VERSION: "3.11"
+  POETRY_VERSION: "1.4.2"
+
 jobs:
   pre-commit:
     runs-on: ubuntu-latest
@@ -13,7 +17,6 @@ jobs:
         with:
           # Need to grab the history of the PR
           fetch-depth: 0
-      - uses: actions/setup-python@v2
       - uses: actions-rs/toolchain@v1
         with:
           profile: minimal
@@ -24,6 +27,21 @@ jobs:
           profile: minimal
           toolchain: nightly-2023-07-23
           components: rustfmt, clippy
+      - uses: actions/checkout@v4
+      - name: Install poetry
+        run: pipx install poetry
+      - uses: actions/setup-python@v2
+        with:
+          python-version: ${{ env.PYTHON_VERSION }}
+        id: setup_python
+      - name: Cache Poetry cache
+        uses: actions/cache@v3
+        with:
+          path: ~/.cache/pypoetry
+          key: poetry-cache-${{ runner.os }}-${{ steps.setup_python.outputs.python-version }}-${{ env.POETRY_VERSION }}
+      - name: Install poetry dependencies
+        run: poetry -C express_relay/sdk/python/express_relay install
+        shell: sh
       - uses: pre-commit/[email protected]
         if: ${{ github.event_name == 'pull_request' }}
         with:

.github/workflows/pypi-express-relay-utils.yml

@@ -0,0 +1,21 @@
+name: Upload express-relay Python Package to PyPI
+
+on:
+  push:
+    tags:
+      - "python-v*"
+
+jobs:
+  deploy:
+    runs-on: ubuntu-20.04
+    steps:
+      - uses: actions/checkout@v2
+      - uses: actions/setup-python@v2
+      - name: Install dependencies
+        run: |
+          python3 -m pip install --upgrade poetry
+          poetry -C express_relay/sdk/python/express_relay build
+      - name: Build and publish
+        run: |
+          poetry -C express_relay/sdk/python/express_relay build
+          poetry -C express_relay/sdk/python/express_relay publish --username __token__ --password ${{ secrets.PYPI_TOKEN }}

.gitignore

@@ -18,3 +18,4 @@ tsconfig.tsbuildinfo
 *mnemonic*
 .envrc
 */*.sui.log*
+__pycache__

.pre-commit-config.yaml

@@ -111,3 +111,19 @@ repos:
         entry: cargo +nightly-2023-03-01 clippy --manifest-path ./target_chains/solana/Cargo.toml --tests --fix --allow-dirty --allow-staged -- -D warnings
         pass_filenames: false
         files: target_chains/solana
+      # For express relay python files
+      - id: black
+        name: black
+        entry: poetry -C express_relay/sdk/python/express_relay run black express_relay/sdk/python/express_relay
+        pass_filenames: false
+        language: "system"
+      - id: pyflakes
+        name: pyflakes
+        entry: poetry -C express_relay/sdk/python/express_relay run pyflakes express_relay/sdk/python/express_relay
+        pass_filenames: false
+        language: "system"
+      - id: mypy
+        name: mypy
+        entry: poetry -C express_relay/sdk/python/express_relay run mypy express_relay/sdk/python/express_relay
+        pass_filenames: false
+        language: "system"