Skip to content
Merged
Show file tree
Hide file tree
Changes from 65 commits
Commits
Show all changes
69 commits
Select commit Hold shift + click to select a range
6c3b74c
commit initial project state
May 9, 2025
133b663
update step params and annotations
May 11, 2025
c282b90
update pipeline params
May 11, 2025
b70774b
add unique names to data artifacts, and fetch run id from step context
May 11, 2025
15e6930
fix pipeline protected attributes and target column
May 11, 2025
6850c0c
update compliance dir
May 11, 2025
d4880fb
update yaml configs
May 11, 2025
534ba1b
update constants, run.py and README
May 11, 2025
b73013f
add model definition to utils
May 11, 2025
e4f8607
delete preview md doc
May 11, 2025
b9cc7b3
small fixes for training pipeline
May 11, 2025
831c44b
fetch necessary params for training pipeline
May 12, 2025
078b973
name and store annotated types in constants
May 12, 2025
39e34fe
refactor and add additional artifacts
May 12, 2025
e68ac77
add deploymeny.yaml config
May 12, 2025
0556236
refactor and complete modal deployment template
May 12, 2025
441026c
add app dir for modal deployment
May 12, 2025
2bf328f
remove app.py
May 12, 2025
3f6fe14
delete auto-generated artifacts and refactor
May 12, 2025
2c52e85
refactor: storage consolidation, unified configuration, maximum zenml…
May 13, 2025
b2ee313
cleanup compliance dir and update jinja template
May 13, 2025
0cfc9fc
save approval record to modal, not locally
May 13, 2025
2b7cc53
add diagrams and detailed pipeline explanations
May 13, 2025
dc2d3a9
fix modal deployment: use add local file for constants.py, and add Ap…
May 13, 2025
b1cded9
convert UUID to strings, and update README
May 13, 2025
431c56b
remove modal card from metadata logged to zenml
May 13, 2025
69d09d7
remove unused deps
May 13, 2025
3f408d4
refactor and simplify feature engineering pipeline for demo purposes
May 14, 2025
7d16f4a
replace crypto dataset with better suited credit_scoring dataset and …
May 14, 2025
b35aac9
add qms templates, and releases dir per run for compliance docs
May 16, 2025
cf96b26
update utils and add incidents, preprocess, risk_dashboard streamlit …
May 16, 2025
392632f
refactor and integrate sbom, completed annex iv for demo, and improve…
May 16, 2025
2e25997
Add COMPLIANCE.md file, and assets dir for pipeline diagrams
May 16, 2025
0d9ab10
update diagrams and prettify jinja template
May 16, 2025
684e0e1
organize and refactor
May 19, 2025
1b9c251
update annex iv template and sample inputs
May 19, 2025
85e8d01
save whylogs htmlstring visualization along with release artifacts
May 19, 2025
4ffc4f4
update README
May 19, 2025
6008cdc
Add 'credit-scorer/' from commit '6c3b74c063e60cd456b7ab6168107abc657…
May 19, 2025
ff0c15b
implement PR suggestions and additional dashboard improvements
May 20, 2025
a388c3c
update README and add typehints to template.py
May 20, 2025
396126c
Merge commit 'a388c3cb635e4e5c72a349105430d7d86b932fb1' into import/c…
May 20, 2025
b4b81da
cleanup and trim blank rows from csv and xlsx files
May 20, 2025
84f9c54
fix broken links
May 20, 2025
a708b2c
run format/lint scripts
May 20, 2025
132f2a8
add credit-scorer to zenml-projects README.md
May 20, 2025
88a2f71
remove diagrams.md reference
May 20, 2025
6bb6c92
remove diagrams.md reference from README.md
May 20, 2025
4c0dc06
update streamlit_app to use shared compliance_dashboard html
May 21, 2025
21ce7b0
update utils
May 21, 2025
8f0a125
modify model from GradientBooster to LightGBM and update steps/pipelines
May 21, 2025
c395ea5
update requirements.txt and refactor code
May 21, 2025
5f0b9ec
add generate_dashboard step for compliane coverage html artifact
May 21, 2025
9ed7683
run format/lint scripts
May 21, 2025
eadb783
run format/lint scripts
May 21, 2025
960656a
add docs/releases to typos.toml ignore list
May 21, 2025
f614dcc
implement suggestions from PR review and simplify project
May 22, 2025
f8beeb2
run format/lint scripts
May 22, 2025
b5c8c02
fix broken links
May 22, 2025
9bb2937
improve README clarity, and small update to approve_deployment step
May 22, 2025
3eae010
run format script
May 22, 2025
d4dde3d
fix broken markdown link
May 22, 2025
9099a4f
add slack alerter for approval step
May 22, 2025
b88d784
uncomment code and cleanup approve step
May 22, 2025
e99a509
run format script
May 22, 2025
2b6894b
make slack message neater
May 22, 2025
d091258
remove extra html file
May 22, 2025
f8d2c2d
reorder imports, and add missing utils/visualizations directory
May 23, 2025
2a77a2d
run format script
May 23, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .typos.toml
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ extend-exclude = [
"llm-finetuning/*",
"end-to-end-computer-vision/*",
"research-radar/data/*.jsonl",
"credit-scorer/docs/releases/*",
]

[default.extend-identifiers]
Expand Down
74 changes: 39 additions & 35 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,25 +50,26 @@ you can adapt for your application. We maintain a growing list of projects
from various ML domains including time-series, tabular data, computer vision,
etc.

| Project | Domain | Key Features | Core Technologies |
| --------------------------------------------------------- | --------- | ------------------------------------------ | ------------------------------------ |
| [ZenML Support Agent](zenml-support-agent) | 🤖 LLMOps | 🔍 RAG, 📊 Vector DB, 💬 Conversational | langchain, llama_index, openai |
| [ZenCoder](zencoder) | 🤖 LLMOps | 🧠 Fine-tuning, 📈 Transfer Learning | huggingface, pytorch, wandb |
| [Complete Guide to LLMs](llm-complete-guide) | 🤖 LLMOps | 🔍 RAG, 🧠 Fine-tuning, 📊 Evaluation | openai, huggingface, anthropic |
| [Gamesense](gamesense) | 🤖 LLMOps | 🧠 LoRA, ⚡ Efficient Training | pytorch, peft, phi-2 |
| [Nightwatch AI](nightwatch-ai) | 🤖 LLMOps | 📝 Summarization, 📊 Reporting | openai, supabase, slack |
| [ResearchRadar](research-radar) | 🤖 LLMOps | 📝 Classification, 📊 Comparison | anthropic, huggingface, transformers |
| [End-to-end Computer Vision](end-to-end-computer-vision) | 👁 CV | 🔎 Object Detection, 🏷️ Labeling | pytorch, label_studio, yolov8 |
| [Magic Photobooth](magic-photobooth) | 👁 CV | 📷 Image Gen, 🎞️ Video Gen | stable-diffusion, huggingface |
| [OmniReader](omni-reader) | 👁 CV | 📑 OCR, 📊 Evaluation, ⚙️ Batch Processing | polars, litellm, openai, ollama |
| [Sign Language Detection](sign-language-detection-yolov5) | 👁 CV | 🔎 Object Detection, ⚡ Real-time | mlflow, bentoml, vertex-ai |
| [Oncoclear](oncoclear) | 🚀 MLOps | 📦 Deployment, 🔄 CI/CD | docker, kubernetes, scikit-learn |
| [Huggingface to Sagemaker](huggingface-sagemaker) | 🚀 MLOps | 🔄 CI/CD, 📦 Deployment | mlflow, sagemaker, kubeflow |
| [Databricks Production QA](databricks-production-qa-demo) | 🚀 MLOps | 📊 Monitoring, 🔍 Quality Assurance | databricks, evidently, shap |
| [Vertex Registry and Deployer](vertex-registry-and-deployer) | 🚀 MLOps | 📦 Model Registry, 🚀 Deployment | vertex, gcp, zenml |
| [Eurorate Predictor](eurorate-predictor) | 📊 Data | ⏱️ Time Series, 🧹 ETL | airflow, bigquery, xgboost |
| [RetailForecast](retail-forecast) | 📊 Data | ⏱️ Time Series, 📈 Forecasting, 🔄 Multi-Model | prophet, zenml, pandas |
| [Bank Subscription Prediction](bank_subscription_prediction) | 📊 Data | 💼 Classification, ⚖️ Imbalanced Data, 🔍 Feature Selection | xgboost, plotly, zenml |
| Project | Domain | Key Features | Core Technologies |
| ------------------------------------------------------------ | --------- | ----------------------------------------------------------- | ------------------------------------ |
| [ZenML Support Agent](zenml-support-agent) | 🤖 LLMOps | 🔍 RAG, 📊 Vector DB, 💬 Conversational | langchain, llama_index, openai |
| [ZenCoder](zencoder) | 🤖 LLMOps | 🧠 Fine-tuning, 📈 Transfer Learning | huggingface, pytorch, wandb |
| [Complete Guide to LLMs](llm-complete-guide) | 🤖 LLMOps | 🔍 RAG, 🧠 Fine-tuning, 📊 Evaluation | openai, huggingface, anthropic |
| [Gamesense](gamesense) | 🤖 LLMOps | 🧠 LoRA, ⚡ Efficient Training | pytorch, peft, phi-2 |
| [Nightwatch AI](nightwatch-ai) | 🤖 LLMOps | 📝 Summarization, 📊 Reporting | openai, supabase, slack |
| [ResearchRadar](research-radar) | 🤖 LLMOps | 📝 Classification, 📊 Comparison | anthropic, huggingface, transformers |
| [End-to-end Computer Vision](end-to-end-computer-vision) | 👁 CV | 🔎 Object Detection, 🏷️ Labeling | pytorch, label_studio, yolov8 |
| [Magic Photobooth](magic-photobooth) | 👁 CV | 📷 Image Gen, 🎞️ Video Gen | stable-diffusion, huggingface |
| [OmniReader](omni-reader) | 👁 CV | 📑 OCR, 📊 Evaluation, ⚙️ Batch Processing | polars, litellm, openai, ollama |
| [Sign Language Detection](sign-language-detection-yolov5) | 👁 CV | 🔎 Object Detection, ⚡ Real-time | mlflow, bentoml, vertex-ai |
| [Oncoclear](oncoclear) | 🚀 MLOps | 📦 Deployment, 🔄 CI/CD | docker, kubernetes, scikit-learn |
| [Huggingface to Sagemaker](huggingface-sagemaker) | 🚀 MLOps | 🔄 CI/CD, 📦 Deployment | mlflow, sagemaker, kubeflow |
| [Databricks Production QA](databricks-production-qa-demo) | 🚀 MLOps | 📊 Monitoring, 🔍 Quality Assurance | databricks, evidently, shap |
| [Vertex Registry and Deployer](vertex-registry-and-deployer) | 🚀 MLOps | 📦 Model Registry, 🚀 Deployment | vertex, gcp, zenml |
| [Eurorate Predictor](eurorate-predictor) | 📊 Data | ⏱️ Time Series, 🧹 ETL | airflow, bigquery, xgboost |
| [RetailForecast](retail-forecast) | 📊 Data | ⏱️ Time Series, 📈 Forecasting, 🔄 Multi-Model | prophet, zenml, pandas |
| [Bank Subscription Prediction](bank_subscription_prediction) | 📊 Data | 💼 Classification, ⚖️ Imbalanced Data, 🔍 Feature Selection | xgboost, plotly, zenml |
| [Credit Scorer](credit-scorer) | 📊 Data | 💰 Credit Risk, 📊 Explainability, 🇪🇺 EU AI Act | scikit-learn, fairlearn, zenml |

# 💻 System Requirements

Expand All @@ -87,6 +88,7 @@ See our [contributing guide](./CONTRIBUTING.md) to start.
## Code Quality

All code contributions must pass our automated code quality checks:

- **Code Formatting**: We use [ruff](https://github.com/astral-sh/ruff) for code formatting and linting
- **Spelling**: We check for typos and spelling errors
- **Markdown Links**: We verify that all links in documentation work properly
Expand All @@ -97,8 +99,8 @@ Our CI pipeline will automatically check your PR for these issues. Remember to r

By far the easiest and fastest way to get help is to:

* Ask your questions in [our Slack group](https://zenml.io/slack/).
* [Open an issue](https://github.com/zenml-io/zenml-dashboard/issues/new/choose)
- Ask your questions in [our Slack group](https://zenml.io/slack/).
- [Open an issue](https://github.com/zenml-io/zenml-dashboard/issues/new/choose)
on our GitHub repo.

# 🔥 About ZenML
Expand Down Expand Up @@ -128,20 +130,22 @@ this repository. Any contribution made to this project will be licensed under
the Apache License Version 2.0.

# 📖 Learn More
| ZenML Resources | Description |
|-----------------------------|----------------------------------------------------|
| 🧘 **[ZenML 101]** | New to ZenML? Here's everything you need to know! |
| ⚛ **[Core Concepts]** | Understand ZenML's building blocks. |
| 🚀 **[Our latest release]** | New features, bug fixes. |
| 🗳 **[Vote for Features]** | Pick what we work on next! |
| 📓 **[Docs]** | Full documentation for creating your own ZenML pipelines. |
| 📒 **[API Reference]** | Detailed reference on ZenML's API. |
| ⚽ **[Examples]** | Explore more sample projects. |

| ZenML Resources | Description |
| --------------------------- | --------------------------------------------------------------- |
| 🧘 **[ZenML 101]** | New to ZenML? Here's everything you need to know! |
| ⚛ **[Core Concepts]** | Understand ZenML's building blocks. |
| 🚀 **[Our latest release]** | New features, bug fixes. |
| 🗳 **[Vote for Features]** | Pick what we work on next! |
| 📓 **[Docs]** | Full documentation for creating your own ZenML pipelines. |
| 📒 **[API Reference]** | Detailed reference on ZenML's API. |
| ⚽ **[Examples]** | Explore more sample projects. |
| 📬 **[Blog]** | Use cases of ZenML and technical deep dives on how we built it. |
| 🔈 **[Podcast]** | Conversations with leaders in ML, released every 2 weeks. |
| 💬 **[Join Slack]** | Need help with your specific use case? Say hi on Slack! |
| 🗺 **[Roadmap]** | See where ZenML is working to build new features. |
| 🙋 **[Contribute]** | Got a PR or feature request? Start here. |
| 🔈 **[Podcast]** | Conversations with leaders in ML, released every 2 weeks. |
| 💬 **[Join Slack]** | Need help with your specific use case? Say hi on Slack! |
| 🗺 **[Roadmap]** | See where ZenML is working to build new features. |
| 🙋 **[Contribute]** | Got a PR or feature request? Start here. |

[ZenML 101]: https://docs.zenml.io/user-guides/starter-guide
[Core Concepts]: https://docs.zenml.io/getting-started/core-concepts
[Our latest release]: https://github.com/zenml-io/zenml/releases
Expand All @@ -153,4 +157,4 @@ the Apache License Version 2.0.
[Podcast]: https://podcast.zenml.io/
[Join Slack]: https://zenml.io/slack-invite/
[Roadmap]: https://zenml.io/roadmap
[Contribute]: https://github.com/zenml-io/zenml/blob/main/CONTRIBUTING.md
[Contribute]: https://github.com/zenml-io/zenml/blob/main/CONTRIBUTING.md
105 changes: 105 additions & 0 deletions credit-scorer/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,105 @@
# Python
__pycache__/
*.py[cod]
*$py.class
*.so
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
*.egg-info/
.installed.cfg
*.egg

# Virtual Environment
venv/
env/
.env
.venv/
ENV/

# IDE
.idea/
.vscode/
*.swp
*.swo
.project
.pydevproject
.settings/
*.sublime-workspace
*.sublime-project

# Jupyter Notebook
.ipynb_checkpoints
*.ipynb

# Model checkpoints and evaluation results
eval_results/
runs/
wandb/
*.pt
*.pth
*.ckpt
*.bin
model_outputs/

# Data
# *.csv
*.tsv
!requirements.txt

# Logs
*.log
logs/
tensorboard_logs/
lightning_logs/

# OS
.DS_Store
Thumbs.db
*.db
*.sqlite
*.sqlite3

# Environment variables
.env
.env.local
.env.*.local

# Testing
.coverage
htmlcov/
.pytest_cache/
.tox/
coverage.xml
*.cover
.hypothesis/

# Documentation
docs/_build/
site/

# Misc
*.bak
*.tmp
*.temp
.cache
.zen/

# Extras
checkpoints/
ruff.toml
models/
cache/
_pocs/
TODO.md
visualizations/
Loading