Skip to content

Commit eb7a067

Browse files
harshachharshach
authored
Merge pull request #2 from open-metadata/fix_workflows
Fix workflows
2 parents 689c7ee + bd12dc9 commit eb7a067

File tree

7 files changed

+179
-26
lines changed

7 files changed

+179
-26
lines changed

‎.github/workflows/deploy-docs.yml‎

Lines changed: 1 addition & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -8,15 +8,9 @@ on:
88

99
permissions:
1010
contents: write
11-
pages: write
12-
id-token: write
13-
14-
concurrency:
15-
group: "pages"
16-
cancel-in-progress: false
1711

1812
jobs:
19-
build:
13+
deploy:
2014
runs-on: ubuntu-latest
2115
steps:
2216
- name: Checkout repository
@@ -46,19 +40,3 @@ jobs:
4640
- name: Build and Deploy to GitHub Pages
4741
run: |
4842
mkdocs gh-deploy --force --clean --verbose
49-
50-
- name: Upload artifact
51-
uses: actions/upload-pages-artifact@v3
52-
with:
53-
path: './site'
54-
55-
deploy:
56-
needs: build
57-
runs-on: ubuntu-latest
58-
environment:
59-
name: github-pages
60-
url: ${{ steps.deployment.outputs.page_url }}
61-
steps:
62-
- name: Deploy to GitHub Pages
63-
id: deployment
64-
uses: actions/deploy-pages@v4

‎.github/workflows/validate.yml‎

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -55,8 +55,11 @@ jobs:
5555
python -c "
5656
from rdflib import Graph
5757
from pathlib import Path
58+
import json
5859
5960
errors = []
61+
62+
# Validate Turtle (.ttl) files
6063
for rdf_file in Path('rdf').rglob('*.ttl'):
6164
try:
6265
g = Graph()
@@ -66,11 +69,13 @@ jobs:
6669
errors.append(f'{rdf_file}: {e}')
6770
print(f'✗ {rdf_file}: {e}')
6871
72+
# Validate JSON-LD files (check JSON syntax only, not RDF parsing)
73+
# Context files may have structures that rdflib cannot parse standalone
6974
for jsonld_file in Path('rdf').rglob('*.jsonld'):
7075
try:
71-
g = Graph()
72-
g.parse(jsonld_file, format='json-ld')
73-
print(f'✓ {jsonld_file} ({len(g)} triples)')
76+
with open(jsonld_file) as f:
77+
json.load(f)
78+
print(f'✓ {jsonld_file} (valid JSON)')
7479
except Exception as e:
7580
errors.append(f'{jsonld_file}: {e}')
7681
print(f'✗ {jsonld_file}: {e}')

‎docs/metadata-standards/json-schemas.md‎

Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,49 @@
1+
# JSON Schemas
2+
3+
Comprehensive JSON Schema specifications for OpenMetadata entities, types, APIs, and configurations.
4+
5+
---
6+
7+
## Overview
8+
9+
OpenMetadata Standards includes **700+ JSON Schema** files that define the structure, validation rules, and documentation for all metadata entities and types.
10+
11+
## Schema Categories
12+
13+
### Entity Schemas
14+
15+
Complete schemas for all metadata entities:
16+
17+
- **Data Assets**: Tables, topics, dashboards, pipelines, ML models
18+
- **Services**: Database, messaging, dashboard, pipeline services
19+
- **Governance**: Glossaries, tags, policies, classifications
20+
- **Teams & Users**: Organizations, teams, users, roles, personas
21+
- **Observability**: Data quality, profiling, lineage, usage metrics
22+
23+
### Type System
24+
25+
Rich type definitions including:
26+
27+
- Basic types (UUID, email, timestamp, markdown)
28+
- Collection types (arrays, entity references)
29+
- SQL and programming data types
30+
- Custom properties and extensions
31+
32+
### API Schemas
33+
34+
OpenAPI specifications for RESTful operations
35+
36+
### Event Schemas
37+
38+
Change events, lifecycle events, and audit logs
39+
40+
### Configuration Schemas
41+
42+
Service connectors and system configurations
43+
44+
## Related Documentation
45+
46+
- [Overview](overview.md)
47+
- [RDF & OWL](rdf-ontology.md)
48+
- [JSON-LD Contexts](jsonld-contexts.md)
49+
- [SHACL Validation](shacl-validation.md)

‎docs/metadata-standards/jsonld-contexts.md‎

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
# JSON-LD Contexts
2+
3+
Semantic contexts for metadata interoperability.
4+
5+
---
6+
7+
## Overview
8+
9+
JSON-LD contexts enable OpenMetadata JSON documents to be interpreted as linked data, enabling semantic interoperability with other systems.
10+
11+
## Features
12+
13+
### Semantic Interoperability
14+
15+
Transform JSON metadata into RDF using JSON-LD contexts.
16+
17+
### Vocabulary Mapping
18+
19+
Map OpenMetadata terms to standard vocabularies and ontologies.
20+
21+
### Linked Data
22+
23+
Enable URIs and semantic relationships in JSON documents.
24+
25+
## Usage
26+
27+
JSON-LD contexts allow metadata to be both:
28+
- Valid JSON for easy consumption by applications
29+
- Valid RDF for semantic web applications
30+
31+
## Related Documentation
32+
33+
- [Overview](overview.md)
34+
- [JSON Schemas](json-schemas.md)
35+
- [RDF & OWL](rdf-ontology.md)
36+
- [SHACL Validation](shacl-validation.md)

‎docs/metadata-standards/rdf-ontology.md‎

Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,43 @@
1+
# RDF & OWL Ontologies
2+
3+
Semantic web standards for knowledge graphs and linked metadata.
4+
5+
---
6+
7+
## Overview
8+
9+
OpenMetadata Standards provides comprehensive RDF/OWL ontologies for representing metadata as linked data and building knowledge graphs.
10+
11+
## OpenMetadata Ontology
12+
13+
Full OWL 2 ontology covering:
14+
15+
- Classes for all entity types
16+
- Object and data properties
17+
- Relationships and constraints
18+
- Annotations and documentation
19+
20+
## Features
21+
22+
### Knowledge Graph Integration
23+
24+
Export metadata as RDF for integration with knowledge graphs and semantic databases.
25+
26+
### Linked Data
27+
28+
Connect metadata across systems using URIs and SPARQL queries.
29+
30+
### Standards Compliance
31+
32+
Built on W3C standards:
33+
- RDF 1.1
34+
- OWL 2
35+
- PROV-O for provenance
36+
- SKOS for knowledge organization
37+
38+
## Related Documentation
39+
40+
- [Overview](overview.md)
41+
- [JSON Schemas](json-schemas.md)
42+
- [SHACL Validation](shacl-validation.md)
43+
- [JSON-LD Contexts](jsonld-contexts.md)

‎docs/metadata-standards/shacl-validation.md‎

Lines changed: 41 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,41 @@
1+
# SHACL Validation
2+
3+
W3C SHACL shapes for metadata quality and constraint validation.
4+
5+
---
6+
7+
## Overview
8+
9+
SHACL (Shapes Constraint Language) shapes provide validation constraints for ensuring metadata quality and compliance.
10+
11+
## Features
12+
13+
### Constraint Validation
14+
15+
Define and enforce constraints on metadata:
16+
- Required properties
17+
- Value ranges and formats
18+
- Cardinality constraints
19+
- Relationship constraints
20+
21+
### Quality Assurance
22+
23+
Ensure metadata meets organizational standards and requirements.
24+
25+
### Standards Compliance
26+
27+
Built on W3C SHACL specification for RDF validation.
28+
29+
## Use Cases
30+
31+
- Validate metadata before ingestion
32+
- Enforce governance policies
33+
- Ensure data quality
34+
- Compliance checking
35+
36+
## Related Documentation
37+
38+
- [Overview](overview.md)
39+
- [JSON Schemas](json-schemas.md)
40+
- [RDF & OWL](rdf-ontology.md)
41+
- [JSON-LD Contexts](jsonld-contexts.md)

‎rdf/ontology/openmetadata-prov.ttl‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
@prefix om: <https://open-metadata.org/ontology/> .
2+
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
23
@prefix prov: <http://www.w3.org/ns/prov#> .
34
@prefix xsd: <http://www.w3.org/2001/XMLSchema#> .
45
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .

0 commit comments

Comments
 (0)