Commit 6210e6c
authored
NPM to Bun; Docker Build Caching; Fix Tests; Windows Build and Test Improvements (#620)
* Update dependencies and Dockerfile command
- Bump version of `@malloy-publisher/app`, `@malloy-publisher/sdk`, and `@malloy-publisher/server` to 0.0.165 in `bun.lock` and `package.json`.
- Add `@opentelemetry/exporter-prometheus` version 0.212.0 to dependencies.
- Change the command in the Dockerfile to use `bun` instead of `node` for starting the server.
These changes enhance the project by updating to the latest versions of dependencies and optimizing the Docker command for better performance.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Update k6 Tests workflow to trigger on pull requests
- Added a trigger for the k6 tests workflow to run on pull requests targeting the main branch, in addition to the existing push trigger. This change enhances the testing process by ensuring that tests are executed for pull requests, improving code quality before merging.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Update cross-platform tests workflow to enhance caching
- Modified the caching configuration in the GitHub Actions workflow to include `node_modules` and its subdirectories, improving dependency management during builds.
- Added a condition to only install dependencies if the cache is not hit, optimizing the workflow's efficiency.
This update aims to streamline the testing process and reduce build times by leveraging caching more effectively.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Refactor caching in cross-platform tests workflow
- Simplified the caching configuration by removing redundant paths for `node_modules`, focusing on the primary cache directory.
- Streamlined the dependency installation step to eliminate unnecessary echo statements, enhancing clarity and efficiency.
This update aims to improve the performance and maintainability of the GitHub Actions workflow for cross-platform testing.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Update cross-platform tests workflow to use actions/cache@v5
- Upgraded the caching action from v4 to v5 for improved performance and features.
- Removed the condition to install dependencies only if the cache is not hit, simplifying the installation step.
This change aims to enhance the efficiency and maintainability of the GitHub Actions workflow for cross-platform testing.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Refactor dependency installation in cross-platform tests workflow
- Split the dependency installation step into separate jobs for Unix and Windows environments, enhancing clarity and maintainability.
- Removed the caching step for Bun dependencies to streamline the workflow.
This update aims to improve the cross-platform testing process by providing clearer installation steps for different operating systems.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Enhance cross-platform tests workflow with OS-specific build steps
- Introduced separate build steps for Unix and Windows environments to improve clarity and ensure compatibility.
- Updated the environment variable handling for dependency installation to maintain consistency across platforms.
This change aims to streamline the build process in the cross-platform testing workflow, enhancing maintainability and clarity.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Update Windows dependency installation in cross-platform tests workflow
- Modified the Bun installation command for Windows to use the `--linker=isolated` option, enhancing the dependency management process.
- This change aims to improve compatibility and performance during the installation of dependencies in the cross-platform testing workflow.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Refactor cross-platform tests workflow for improved dependency management
- Consolidated the dependency installation step for Unix and Windows into a single job, enhancing clarity and reducing redundancy.
- Introduced caching for Bun dependencies to optimize installation times and improve workflow efficiency.
- Updated environment variable handling to ensure consistent behavior across different operating systems.
This update aims to streamline the cross-platform testing process and enhance maintainability of the workflow.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Add ShikiJS languages and themes dependencies, optimize Dockerfile caching
- Introduced `@shikijs/langs` and `@shikijs/themes` as dependencies in both `bun.lock` and `packages/sdk/package.json`.
- Enhanced the Dockerfile by implementing caching for Bun installations and builds, improving build efficiency and reducing installation times.
These updates aim to enrich the SDK with additional language and theme support while optimizing the build process in the Docker environment.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Refactor dependency installation in cross-platform tests workflow
- Updated the Bun installation command to include `--prefer-offline` and `--ignore-scripts`, enhancing efficiency and reducing unnecessary script executions.
- Removed the environment variable handling for post-install scripts, simplifying the workflow.
This change aims to streamline the dependency management process in the cross-platform testing workflow, improving overall performance and maintainability.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Enhance cross-platform tests workflow with Windows-specific configurations
- Added environment variables for Windows user profile and Bun cache directory to improve compatibility.
- Introduced steps to configure temporary directories and disable Windows Defender during the workflow execution.
- Updated caching for Bun dependencies to differentiate between Windows and Unix-like systems, optimizing installation times.
These changes aim to enhance the cross-platform testing process by ensuring a smoother experience on Windows environments while maintaining efficiency across all platforms.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Enhance cross-platform compatibility in E2E test setup
- Introduced `fileURLToPath` and `import.meta.url` to resolve file paths, ensuring compatibility across different operating systems, particularly Windows.
- Updated the method of determining `__dirname` and `__filename` to improve path resolution in the test environment.
These changes aim to streamline the E2E testing process by enhancing cross-platform functionality and reliability.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Remove pull request trigger from k6 tests workflow
- Eliminated the pull_request trigger for the k6 tests workflow, streamlining the workflow to only run on pushes to the main branch and manual dispatch.
This change aims to simplify the workflow configuration and focus on direct pushes to the main branch for testing.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Remove redundant step for rebuilding DuckDB native bindings in cross-platform tests workflow
- Eliminated the step that rebuilt DuckDB native bindings during the dependency installation process, streamlining the workflow.
This change aims to simplify the cross-platform testing process by removing unnecessary steps, enhancing overall efficiency.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Implement Windows-specific workarounds in cross-platform tests workflow
- Added environment variables for custom user profile and Bun cache directory to address known issues with Bun on Windows.
- Removed the caching step for Bun dependencies on Windows to streamline the workflow while maintaining efficiency.
These changes aim to enhance the cross-platform testing process by providing necessary adjustments for Windows environments, ensuring faster CI runs.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Update Docker configuration for improved command execution
- Removed the version specification from `docker-compose.yml` for simplification.
- Updated the CMD instruction in the Dockerfile to preload the instrumentation script before starting the server, enhancing performance and monitoring capabilities.
These changes aim to streamline the Docker setup and improve the application's startup behavior.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Refactor Dockerfile to streamline base image setup
- Removed comments regarding the pre-built base image for clarity.
- Maintained the focus on the Java base image and the base dependencies setup.
These changes aim to simplify the Dockerfile and enhance readability for future modifications.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Update Dockerfile CMD instruction and enhance Docker image workflow caching
- Modified the CMD instruction in the Dockerfile to include 'run' for improved command execution.
- Added caching configuration in the GitHub Actions workflow for Docker image builds to optimize build times.
These changes aim to enhance the application's startup behavior and improve the efficiency of the Docker image build process.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Enhance Docker image workflow with cache testing and configuration updates
- Added a pull request trigger for the main branch to improve workflow responsiveness.
- Updated the Docker image build outputs to disable automatic pushing, allowing for manual control.
- Introduced a cache testing step to verify cache functionality and ensure successful cache pushes to the registry.
These changes aim to optimize the Docker image workflow by enhancing cache management and improving build verification processes.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Update Docker image workflow to enable automatic pushing and remove cache testing steps
- Removed the pull request trigger for the main branch to simplify the workflow.
- Updated Docker image build outputs to enable automatic pushing to the registry.
- Eliminated the cache testing step to streamline the workflow process.
These changes aim to enhance the efficiency of the Docker image publishing process by reducing unnecessary steps and ensuring automatic updates to the registry.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
* Enhance server instrumentation and metrics handling (#622)
- Updated the Dockerfile to simplify the CMD instruction for starting the server.
- Integrated Prometheus metrics handling into the server, including a new endpoint for metrics and middleware for HTTP request metrics.
- Implemented a graceful shutdown for the OpenTelemetry SDK during server termination.
- Refactored instrumentation to support both Prometheus and OTLP exporters, improving observability.
These changes aim to enhance monitoring capabilities and streamline server performance during operation and shutdown.
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>
---------
Signed-off-by: Sagar Swami Rao Kulkarni <sagarswamirao@gmail.com>1 parent 241095c commit 6210e6c
File tree
12 files changed
+231
-73
lines changed- .github/workflows
- packages
- sdk
- server
- src
- tests/harness
12 files changed
+231
-73
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
6 | 16 | | |
7 | 17 | | |
8 | 18 | | |
| |||
14 | 24 | | |
15 | 25 | | |
16 | 26 | | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
17 | 41 | | |
18 | 42 | | |
19 | 43 | | |
20 | 44 | | |
21 | 45 | | |
22 | 46 | | |
| 47 | + | |
| 48 | + | |
23 | 49 | | |
24 | 50 | | |
25 | 51 | | |
26 | | - | |
27 | | - | |
28 | | - | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
29 | 55 | | |
30 | 56 | | |
31 | 57 | | |
32 | | - | |
33 | | - | |
| 58 | + | |
34 | 59 | | |
35 | 60 | | |
36 | | - | |
37 | | - | |
38 | | - | |
39 | | - | |
40 | 61 | | |
41 | | - | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
42 | 66 | | |
43 | 67 | | |
44 | 68 | | |
| |||
47 | 71 | | |
48 | 72 | | |
49 | 73 | | |
50 | | - | |
51 | | - | |
52 | 74 | | |
53 | 75 | | |
54 | 76 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
60 | 60 | | |
61 | 61 | | |
62 | 62 | | |
| 63 | + | |
| 64 | + | |
63 | 65 | | |
64 | 66 | | |
65 | 67 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
| 2 | + | |
| 3 | + | |
2 | 4 | | |
3 | 5 | | |
4 | | - | |
5 | | - | |
| 6 | + | |
6 | 7 | | |
7 | | - | |
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
15 | 14 | | |
16 | 15 | | |
17 | 16 | | |
| |||
37 | 36 | | |
38 | 37 | | |
39 | 38 | | |
40 | | - | |
| 39 | + | |
| 40 | + | |
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
45 | | - | |
| 45 | + | |
| 46 | + | |
46 | 47 | | |
47 | 48 | | |
48 | 49 | | |
49 | 50 | | |
50 | | - | |
| 51 | + | |
| 52 | + | |
51 | 53 | | |
52 | 54 | | |
53 | 55 | | |
54 | 56 | | |
55 | | - | |
| 57 | + | |
| 58 | + | |
56 | 59 | | |
57 | | - | |
58 | | - | |
| 60 | + | |
| 61 | + | |
59 | 62 | | |
60 | 63 | | |
61 | 64 | | |
| |||
68 | 71 | | |
69 | 72 | | |
70 | 73 | | |
71 | | - | |
| 74 | + | |
| 75 | + | |
72 | 76 | | |
73 | 77 | | |
74 | 78 | | |
75 | 79 | | |
76 | 80 | | |
77 | 81 | | |
78 | 82 | | |
79 | | - | |
| 83 | + | |
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
2 | | - | |
3 | 1 | | |
4 | 2 | | |
5 | 3 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
108 | 108 | | |
109 | 109 | | |
110 | 110 | | |
| 111 | + | |
| 112 | + | |
111 | 113 | | |
112 | 114 | | |
113 | 115 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
| 45 | + | |
45 | 46 | | |
46 | 47 | | |
47 | 48 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| 16 | + | |
16 | 17 | | |
17 | 18 | | |
18 | 19 | | |
| |||
112 | 113 | | |
113 | 114 | | |
114 | 115 | | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
115 | 123 | | |
116 | 124 | | |
117 | 125 | | |
| |||
0 commit comments