Skip to content

Refactor web application and other infra fixes#83

Open
MBkkt wants to merge 1 commit intoquickwit-oss:masterfrom
serenedb:mbkkt/some-infra-fixes
Open

Refactor web application and other infra fixes#83
MBkkt wants to merge 1 commit intoquickwit-oss:masterfrom
serenedb:mbkkt/some-infra-fixes

Conversation

@MBkkt
Copy link

@MBkkt MBkkt commented Mar 20, 2026

  • Removed unused testing dependencies from package.json.
  • Added a new Python script (serve.py) for serving JSON files with gzip compression.
  • Updated index.js to use initialMode prop for Benchmark component.
  • Deleted setupTests.js as it is no longer needed.
  • Renamed style.scss to style.css and added new styles for better UI.
  • UI doesn't work if there wasn't COUNT collection type in UI, it was fixed

Also

  • Added separate queries file to measure single term
  • Make engines produce separate results files
  • These files can be merged

- Removed unused testing dependencies from package.json.
- Added a new Python script (serve.py) for serving JSON files with gzip compression.
- Updated index.js to use initialMode prop for Benchmark component.
- Deleted setupTests.js as it is no longer needed.
- Renamed style.scss to style.css and added new styles for better UI.
@MBkkt MBkkt changed the title Refactor web application: Refactor web application and other infra fixes Mar 20, 2026
Comment on lines +290 to +291
query_idx[query.query] = {"count": -1, "duration": []}
elif query_idx[query.query]["count"] != -1:
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here was a bug for engines which doesn't support some queries

@echo "--- Serving results ---"
@cp results.json web/build/results.json
@cd web/build && python3 -m http.server $(PORT)
@cd web/build && python3 ../../web/serve.py $(PORT)
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just to serve gzip file instead of full large json (I sometimes had slow internet connection between me and the server, so it was fix suggest by claude and it actually allows to download less data (500kb vs 3.5 MB) when open this web view).

Copy link
Author

@MBkkt MBkkt Mar 20, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried to build it as is, when I fixed bug with COUNT collection type is required, but it didn't build.
So I was required to update it, our FE engineer gave me some recommendations how to do it.
(main was rewrite this entirety but I wasn't interested :)

I will ask him is it possible to extract our webview (https://serenedb.com/search-benchmark-game)
I hope so, because it's way more convenient, because 2 things:

  1. It has "heatmap" with all query and collection types
  2. It has sort by column feature (Because it's really more useful to optimize slow queries over fast/random)

@@ -0,0 +1,115 @@
{"query": "the", "tags": ["term"]}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why was this added?

Copy link
Author

@MBkkt MBkkt Mar 20, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We just was interested in performance of single wand for non high term.
In original (your) queries there's only single term query ("the"), so we made a separate file to measure this and don't affect benchmarks numbers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants