Skip to content

Commit 1362767

Browse files
Update Data Uses for 1.4 (#107)
* Update Data uses for 1.4 * feat: refactor how the default taxonomy is set up to make modification easier * Update Data Uses * feat: add a suite of "count" tests for the default taxonomy * feat: set proper Defaults for Optional fields * feat: rework top-level and second-level uses * feat: advertising restructure * fix: pytest * feat: add a new export script for the default taxonomy that includes YAML, JSON and CSV * feat: fix the CSV export and add a simple sorting to the default data types * feat: add a CI check for the taxonomy export * fix: uppercase fides key * fix: pylint * fix: exported taxonomy * feat: remove accidental files * fix: remove alignment spaces from data_uses csv * Add missing data use * Update export_default_taxonomy to generate root nodes and copy to docs CSVs * Run export_default_taxonomy locally * Fixes for taxonomy visualization * feat: make all of the data use updates based on the latest spreadsheet * docs: changelog * feat: update descriptions based on new spreadsheet * Apply suggestions from code review * fix: update exported resources * feat: add the authentication use --------- Co-authored-by: Neville Samuell <[email protected]>
1 parent af67da5 commit 1362767

29 files changed

+3039
-1368
lines changed

.github/workflows/pr_checks.yml

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -56,6 +56,24 @@ jobs:
5656
- name: Run formatter
5757
run: make black
5858

59+
Export:
60+
runs-on: ubuntu-latest
61+
steps:
62+
- name: Checkout
63+
uses: actions/checkout@v3
64+
65+
- name: Set Up Python
66+
uses: actions/setup-python@v4
67+
with:
68+
python-version: "3.10.11"
69+
cache: "pip"
70+
71+
- name: Install Package
72+
run: pip install .
73+
74+
- name: Run Export
75+
run: python scripts/export_default_taxonomy.py
76+
5977
Pylint:
6078
needs: Build
6179
runs-on: ubuntu-latest

CHANGELOG.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@ The types of changes are:
1919
### Changed
2020

2121
- Make `PrivacyDeclaration` use pydantic `orm_mode` [#101](https://github.com/ethyca/fideslang/pull/101)
22+
- Updated the default data uses [#107](https://github.com/ethyca/fideslang/pull/107)
2223

2324
### Remove
2425

data_files/data_categories.csv

Lines changed: 58 additions & 66 deletions
Original file line numberDiff line numberDiff line change
@@ -1,66 +1,58 @@
1-
privacy_key,name,parent_key,description
2-
data_category,Data Category,,
3-
system,System Data,data_category,"Data unique to, and under control of the system."
4-
system.authentication,Authentication Data,system,Data used to manage access to the system.
5-
system.operations,Operations Data,system,Data used for system operations.
6-
user,User Data,data_category,"Data related to the user of the system, either provided directly or derived based on their usage."
7-
user.account,Account Data,user,Data related to a user's system account.
8-
user.account.contact,Account Contact Data,user.account,Contact data related to a system account.
9-
user.account.contact.city,Account City,user.account.contact,Account's city level address data.
10-
user.account.contact.country,Account Country,user.account.contact,Account's country level address data.
11-
user.account.contact.email,Account Email,user.account.contact,Account's email address.
12-
user.account.contact.phone_number,Account Phone Number,user.account.contact,Account's phone number.
13-
user.account.contact.postal_code,Account Postal Code,user.account.contact,Account's postal code.
14-
user.account.contact.state,Account State,user.account.contact,Account's state level address data.
15-
user.account.contact.street,Account Street,user.account.contact,Account's street level address.
16-
user.account.payment,Payment Data,user.account,Payment data related to system account.
17-
user.account.payment.financial_account_number,Account Payment Financial Account Number,user.account.payment,"Financial account number for an account's payment card, bank account, or other financial system."
18-
user.device,Device Data,user,"Data related to a user's device, configuration, and settings."
19-
user.device.cookie_id,Cookie ID,user.device,Cookie unique identification number.
20-
user.device.device_id,Device ID,user.device,Device unique identification number.
21-
user.device.ip_address,IP Address,user.device,Unique identifier related to device connection.
22-
user.contact,Contact Data,user,User contact data for purposes other than account management.
23-
user.contact.city,User Contact City,user.contact,"User's city level address data."
24-
user.contact.country,User Contact Country,user.contact,"User's country level address data."
25-
user.contact.email,User Contact Email,user.contact,"User's email address."
26-
user.contact.phone_number,User Contact Phone Number,user.contact,"User's phone number."
27-
user.contact.postal_code,User Contact Postal Code,user.contact,"User's postal code."
28-
user.contact.state,User Contact State,user.contact,"User's state level address data."
29-
user.contact.street,User Contact Street,user.contact,"User's street level address data."
30-
user.credentials,Credentials,user,User authentication data.
31-
user.credentials.biometric_credentials,Biometric Credentials,user.credentials,Credentials for system authentication.
32-
user.credentials.password,Password,user.credentials,Password for system authentication.
33-
user.financial,Financial Data,user,Payment data and financial history.
34-
user.financial.account_number,Financial Account Number,user.financial,"User's account number for a payment card, bank account, or other financial system."
35-
user.government_id,Government ID,user,State provided identification data.
36-
user.government_id.drivers_license_number,"Driver's License Number",user.government_id,State issued driving identification number.
37-
user.government_id.national_identification_number,National Identification Number,user.government_id,State issued personal identification number.
38-
user.government_id.passport_number,Passport Number,user.government_id,State issued passport data.
39-
user.biometric,Biometric Data,user,Encoded characteristics of a user.
40-
user.biometric_health,Biometric Health Data,user,"Encoded characteristics of a user's health."
41-
user.browsing_history,Browsing History,user,Content browsing history of a user.
42-
user.childrens,Children's Data,user,Data relating to children.
43-
user.date_of_birth,Date of Birth,user,"User's date of birth."
44-
user.demographic,Demographic Data,user,Demographic data about a user.
45-
user.gender,Gender,user,Gender of an individual.
46-
user.genetic,Genetic Data,user,Data about the genetic makeup provided by a user.
47-
user.health_and_medical,Health and Medical Data,user,"Health records or individual's personal medical information."
48-
user.job_title,Job Title,user,Professional data.
49-
user.location,Location Data,user,Records of the location of a user.
50-
user.name,Name,user,"User's real name."
51-
user.non_specific_age,Non-Specific Age,user,Age range data.
52-
user.media_consumption,Media Consumption Data,user,Media type consumption data of a user.
53-
user.observed,Observed Data,user,Data collected through observation of use of the system.
54-
user.organization,Organization Data,user,Data that is linked to, or identifies an organization.
55-
user.political_opinion,Political Opinion,user,"Data related to the individual's political opinions."
56-
user.profiling,Profiling Data,user,Preference and interest data about a user.
57-
user.race,Race,user,Racial or ethnic origin data.
58-
user.religious_belief,Religious Belief,user,Religion or religious belief.
59-
user.search_history,Search History,user,Records of search history and queries of a user.
60-
user.sensor,Sensor Data,user,Non-user identifiable measurement data derived from sensors and monitoring systems.
61-
user.sexual_orientation,Sexual Orientation,user,Personal sex life or sexual data.
62-
user.social,Social Data,user,Social activity and interaction data.
63-
user.telemetry,Telemetry Data,user,User measurement data from system sensors and monitoring.
64-
user.unique_id,Unique ID,user,Unique identifier for a user assigned through system use.
65-
user.user_sensor,User Sensor Data,user,Measurement data derived about a user's environment through system use.
66-
user.workplace,Workplace,user,Organization of employment.
1+
fides_key,is_default,name,organization_fides_key,parent_key,tags,description
2+
data_category,,Data Category,,,,
3+
system,True,System Data,default_organization,data_category,,"Data unique to, and under control of the system."
4+
system.authentication,True,Authentication Data,default_organization,system,,Data used to manage access to the system.
5+
system.operations,True,Operations Data,default_organization,system,,Data used for system operations.
6+
user,True,User Data,default_organization,data_category,,"Data related to the user of the system, either provided directly or derived based on their usage."
7+
user.payment,True,Payment Data,default_organization,user,,Payment data related to user.
8+
user.biometric,True,Biometric Data,default_organization,user,,Encoded characteristics provided by a user.
9+
user.biometric_health,True,Biometric Health Data,default_organization,user,,Encoded characteristic collected about a user.
10+
user.browsing_history,True,Browsing History,default_organization,user,,Content browsing history of a user.
11+
user.demographic,True,Demographic Data,default_organization,user,,Demographic data about a user.
12+
user.contact,True,Contact Data,default_organization,user,,Contact data collected about a user.
13+
user.device,True,Device Data,default_organization,user,,"Data related to a user's device, configuration and setting."
14+
user.gender,True,Gender,default_organization,user,,Gender of an individual.
15+
user.location,True,Location Data,default_organization,user,,Records of the location of a user.
16+
user.media_consumption,True,Media Consumption Data,default_organization,user,,Media type consumption data of a user.
17+
user.non_specific_age,True,Non-Specific Age,default_organization,user,,Age range data.
18+
user.observed,True,Observed Data,default_organization,user,,Data collected through observation of use of the system.
19+
user.profiling,True,Profiling Data,default_organization,user,,Preference and interest data about a user.
20+
user.race,True,Race,default_organization,user,,Racial or ethnic origin data.
21+
user.religious_belief,True,Religious Belief,default_organization,user,,Religion or religious belief.
22+
user.search_history,True,Search History,default_organization,user,,Records of search history and queries of a user.
23+
user.sexual_orientation,True,Sexual Orientation,default_organization,user,,Personal sex life or sexual data.
24+
user.social,True,Social Data,default_organization,user,,Social activity and interaction data.
25+
user.telemetry,True,Telemetry Data,default_organization,user,,User identifiable measurement data from system sensors and monitoring.
26+
user.unique_id,True,Unique ID,default_organization,user,,Unique identifier for a user assigned through system use.
27+
user.user_sensor,True,User Sensor Data,default_organization,user,,Measurement data about a user's environment through system use.
28+
user.organization,True,Organization Identifiable Data,default_organization,user,,"Data that is linked to, or identifies an organization."
29+
user.workplace,True,Workplace,default_organization,user,,Organization of employment.
30+
user.sensor,True,Sensor Data,default_organization,user,,Measurement data from sensors and monitoring systems.
31+
user.childrens,True,Children's Data,default_organization,user,,Data relating to children.
32+
user.credentials,True,Credentials,default_organization,user,,User authentication data.
33+
user.date_of_birth,True,Date of Birth,default_organization,user,,User's date of birth.
34+
user.financial,True,Financial Data,default_organization,user,,Payment data and financial history.
35+
user.genetic,True,Genetic Data,default_organization,user,,Data about the genetic makeup provided by a user.
36+
user.government_id,True,Government ID,default_organization,user,,State provided identification data.
37+
user.health_and_medical,True,Health and Medical Data,default_organization,user,,Health records or individual's personal medical information.
38+
user.job_title,True,Job Title,default_organization,user,,Professional data.
39+
user.name,True,Name,default_organization,user,,User's real name.
40+
user.political_opinion,True,Political Opinion,default_organization,user,,Data related to the individual's political opinions.
41+
user.contact.address,True,Contact Data,default_organization,user.contact,,Contact address data collected about a user.
42+
user.contact.email,True,User Contact Email,default_organization,user.contact,,User's contact email address.
43+
user.contact.phone_number,True,User Contact Phone Number,default_organization,user.contact,,User's phone number.
44+
user.contact.address.city,True,User Contact City,default_organization,user.contact.address,,User's city level address data.
45+
user.contact.address.country,True,User Contact Country,default_organization,user.contact.address,,User's country level address data.
46+
user.contact.address.postal_code,True,User Contact Postal Code,default_organization,user.contact.address,,User's postal code.
47+
user.contact.address.state,True,User Contact State,default_organization,user.contact.address,,User's state level address data.
48+
user.contact.address.street,True,User Contact Street,default_organization,user.contact.address,,User's street level address data.
49+
user.credentials.biometric_credentials,True,Biometric Credentials,default_organization,user.credentials,,Credentials for system authentication.
50+
user.credentials.password,True,Password,default_organization,user.credentials,,Password for system authentication.
51+
user.device.cookie_id,True,Cookie ID,default_organization,user.device,,Cookie unique identification number.
52+
user.device.device_id,True,Device ID,default_organization,user.device,,Device unique identification number.
53+
user.device.ip_address,True,IP Address,default_organization,user.device,,Unique identifier related to device connection.
54+
user.financial.account_number,True,User Financial Account Number,default_organization,user.financial,,"User's account number for a payment card, bank account, or other financial system."
55+
user.government_id.drivers_license_number,True,Driver's License Number,default_organization,user.government_id,,State issued driving identification number.
56+
user.government_id.national_identification_number,True,National Identification Number,default_organization,user.government_id,,State issued personal identification number.
57+
user.government_id.passport_number,True,Passport Number,default_organization,user.government_id,,State issued passport data.
58+
user.payment.financial_account_number,True,Account Payment Financial Account Number,default_organization,user.payment,,"Financial account number for an account's payment card, bank account, or other financial system."

0 commit comments

Comments
 (0)