|
| 1 | +# Data Pipelines: Security \& Governance |
| 2 | + |
| 3 | +Costa Rica |
| 4 | + |
| 5 | +[](https://github.com/) |
| 6 | +[brown9804](https://github.com/brown9804) |
| 7 | + |
| 8 | +Last updated: 2025-05-08 |
| 9 | + |
| 10 | +------------------------------------------ |
| 11 | + |
| 12 | +> `Data Pipeline` in Microsoft Fabric is a `workflow orchestration tool` that enables users to design, schedule, and manage |
| 13 | +> complex data workflows across various services and environments. It supports activities like `Copy Jobs`, `Data Flows`, `Notebook executions`, and |
| 14 | +> `Spark jobs`, allowing seamless integration between `OneLake`, `Data Warehouses`, `Lakehouses`, and external sources. |
| 15 | +> Data Pipelines are ideal for `ETL/ELT automation, data transformation, and end-to-end data integration`, providing a scalable and visual interface for building reliable and repeatable data processes. |
| 16 | +
|
| 17 | +<details> |
| 18 | +<summary><b>List of References</b> (Click to expand)</summary> |
| 19 | + |
| 20 | +- [Concept: Data pipeline Runs](https://learn.microsoft.com/en-us/fabric/data-factory/pipeline-runs) |
| 21 | +- [Quickstart: Move and transform data with dataflows and data pipelines](https://learn.microsoft.com/en-us/fabric/data-factory/transform-data) |
| 22 | +- [Ingest data into your Warehouse using data pipelines](https://learn.microsoft.com/en-us/fabric/data-warehouse/ingest-data-pipelines) |
| 23 | + |
| 24 | +</details> |
| 25 | + |
| 26 | +> [!NOTE] |
| 27 | +> As of now, access to **Data Pipelines** is controlled `entirely through workspace roles (Admin, Member, Contributor, Viewer).` |
| 28 | +> `There is no support for assigning permissions to individual Data Pipelines` or managing them through SQL-like `GRANT`, `REVOKE`, or `DENY` statements. |
| 29 | +
|
| 30 | +<div align="center"> |
| 31 | + <img width="700" alt="image" src="https://github.com/user-attachments/assets/3d68fb14-8da1-4d6f-8059-360748252bfb" style="border: 2px solid #4CAF50; border-radius: 5px; padding: 5px;"/> |
| 32 | +</div> |
| 33 | + |
| 34 | +> [!IMPORTANT] |
| 35 | +> `Workspace roles in Microsoft Fabric (Admin, Member, Contributor, Viewer) grant access to all items within the workspace, not just Data Pipelines.` This includes Dashboards, Semantic Models, Data Warehouses, Notebooks, Copy Jobs, and more. There is currently no way to assign permissions to Data Pipelines individually, access is inherited from the user's role in the workspace. |
| 36 | +
|
| 37 | +| **Workspace Role** | **Access to Data Pipelines** | |
| 38 | +|--------------------|-----------------------------------------------------------------------------------------------| |
| 39 | +| **Admin** | Full control: create, edit, delete, monitor, and manage permissions for Data Pipelines. | |
| 40 | +| **Member** | Can create, edit, and run Data Pipelines; can also share them with others. | |
| 41 | +| **Contributor** | Can create and run Data Pipelines, but cannot manage permissions or share them. | |
| 42 | +| **Viewer** | Can view Data Pipelines and their status but cannot create, edit, or run them. | |
| 43 | + |
| 44 | +<img width="700" alt="image" src="https://github.com/user-attachments/assets/93ccd9f1-a650-4663-a631-3b2b20434cae" /> |
| 45 | + |
| 46 | +<img width="700" alt="image" src="https://github.com/user-attachments/assets/ce0bcfe1-cce2-45e9-81ee-c58e89a7f089" /> |
| 47 | + |
| 48 | +<img width="500" alt="image" src="https://github.com/user-attachments/assets/097cb406-b4c8-4d49-88c2-6d4ea8cf7294" /> |
| 49 | + |
| 50 | +<div align="center"> |
| 51 | + <h3 style="color: #4CAF50;">Total Visitors</h3> |
| 52 | + <img src="https://profile-counter.glitch.me/brown9804/count.svg" alt="Visitor Count" style="border: 2px solid #4CAF50; border-radius: 5px; padding: 5px;"/> |
| 53 | +</div> |
0 commit comments