Skip to content

Feat/export estimation data#582

Closed
samakinen wants to merge 11 commits intohelmet5-experimental-deploy-issuesfrom
feat/export-estimation-data
Closed

Feat/export estimation data#582
samakinen wants to merge 11 commits intohelmet5-experimental-deploy-issuesfrom
feat/export-estimation-data

Conversation

@samakinen
Copy link
Collaborator

Add support for exporting zone and network data into gpkg-files.
Add geodata_helpers.py for handling network geodataframe operations.
Split definition of EventHandler into a separate file.

@hsl-petrhaj
Copy link
Contributor

Debug in the log file seems to be unnecessary big, could we reduce it?
@samakinen

@samakinen
Copy link
Collaborator Author

Debug in the log file seems to be unnecessary big, could we reduce it?

@hsl-petrhaj, what kind of debut log do you get? For me there is only one line notification that the module has been loaded.

@hsl-petrhaj
Copy link
Contributor

@samakinen

2025-04-10 15:18:17 [DEBUG] Set field workplaces: 239.0
2025-04-10 15:18:17 [DEBUG] Looking up zone_area in {'zone_id': 'zone_id', 'pnr_capacity': 'pnr_capacity', 'pnr_cost': 'pnr_cost', 'population': 'population', 'age_7-17': 'age_7-17', 'age_18-29': 'age_18-29', 'age_30-49': 'age_30-49', 'age_50-64': 'age_50-64', 'age_65-99': 'age_65-99', 'share_age_7-17': 'share_age_7-17', 'share_age_18-29': 'share_age_18-29', 'share_age_30-49': 'share_age_30-49', 'share_age_50-64': 'share_age_50-64', 'share_age_65-99': 'share_age_65-99', 'share_age_7-99': 'share_age_7-99', 'share_age_18-99': 'share_age_18-99', 'share_female': 'share_female', 'share_male': 'share_male', 'population_density': 'population_density', 'workplaces': 'workplaces', 'service': 'service', 'shops': 'shops', 'logistics': 'logistics', 'industry': 'industry', 'parking_cost_work': 'parking_cost_work', 'parking_cost_errand': 'parking_cost_errand', 'comprehensive_schools': 'comprehensive_schools', 'secondary_schools': 'secondary_schools', 'tertiary_education': 'tertiary_education', 'zone_area': 'zone_area', 'share_detached_houses': 'share_detached_houses', 'perc_detached_houses_sqrt': 'perc_detached_houses_sqrt', 'helsinki': 'helsinki', 'cbd': 'cbd', 'lauttasaari': 'lauttasaari', 'helsinki_other': 'helsinki_other', 'espoo_vant_kau': 'espoo_vant_kau', 'surrounding': 'surrounding', 'shops_cbd': 'shops_cbd', 'shops_elsewhere': 'shops_elsewhere', 'share_detached_houses_new': 'share_detached_houses_new', 'time_ratio': 'time_ratio', 'cost_ratio': 'cost_ratio', 'car_density': 'car_density', 'cars_per_1000': 'cars_per_1000', 'car_users': 'car_users', 'hw_c': 'hw_c', 'hw_t': 'hw_t', 'hw_b': 'hw_b', 'hw_w': 'hw_w', 'hw_p': 'hw_p', 'hw': 'hw', 'hc_c': 'hc_c', 'hc_t': 'hc_t', 'hc_b': 'hc_b', 'hc_w': 'hc_w', 'hc': 'hc', 'hu_c': 'hu_c', 'hu_t': 'hu_t', 'hu_b': 'hu_b', 'hu_w': 'hu_w', 'hu': 'hu', 'hs_c': 'hs_c', 'hs_t': 'hs_t', 'hs_b': 'hs_b', 'hs_w': 'hs_w', 'hs': 'hs', 'ho_c': 'ho_c', 'ho_t': 'ho_t', 'ho_b': 'ho_b', 'ho_w': 'ho_w', 'ho': 'ho', 'hh_c': 'hh_c', 'hh_t': 'hh_t', 'hh_b': 'hh_b', 'hh_w': 'hh_w', 'hh': 'hh', 'wo_c': 'wo_c', 'wo_t': 'wo_t', 'wo_b': 'wo_b', 'wo_w': 'wo_w', 'wo': 'wo', 'oo_c': 'oo_c', 'oo_t': 'oo_t', 'oo_b': 'oo_b', 'oo_w': 'oo_w', 'oo': 'oo', 'wh_c': 'wh_c', 'wh_t': 'wh_t', 'wh_b': 'wh_b', 'wh_w': 'wh_w', 'wh': 'wh', 'hwp_c': 'hwp_c', 'hwp_t': 'hwp_t', 'hwp': 'hwp', 'hop_c': 'hop_c', 'hop_t': 'hop_t', 'hop': 'hop', 'oop_c': 'oop_c', 'oop_t': 'oop_t', 'oop': 'oop', 'parking_time': 'parking_time'}
2025-04-10 15:18:17 [DEBUG] Normalizing schema type for key 'zone_area' in schema OrderedDict([('zone_id', 'int'), ('pnr_capacity', 'float'), ('pnr_cost', 'float'), ('population', 'float'), ('age_7-17', 'float'), ('age_18-29', 'float'), ('age_30-49', 'float'), ('age_50-64', 'float'), ('age_65-99', 'float'), ('share_age_7-17', 'float'), ('share_age_18-29', 'float'), ('share_age_30-49', 'float'), ('share_age_50-64', 'float'), ('share_age_65-99', 'float'), ('share_age_7-99', 'float'), ('share_age_18-99', 'float'), ('share_female', 'float'), ('share_male', 'float'), ('population_density', 'float'), ('workplaces', 'float'), ('service', 'float'), ('shops', 'float'), ('logistics', 'float'), ('industry', 'float'), ('parking_cost_work', 'float'), ('parking_cost_errand', 'float'), ('comprehensive_schools', 'float'), ('secondary_schools', 'float'), ('tertiary_education', 'float'), ('zone_area', 'float'), ('share_detached_houses', 'float'), ('perc_detached_houses_sqrt', 'float'), ('helsinki', 'str'), ('cbd', 'str'), ('lauttasaari', 'str'), ('helsinki_other', 'str'), ('espoo_vant_kau', 'str'), ('surrounding', 'str'), ('shops_cbd', 'float'), ('shops_elsewhere', 'float'), ('share_detached_houses_new', 'float'), ('time_ratio', 'float'), ('cost_ratio', 'float'), ('car_density', 'float'), ('cars_per_1000', 'float'), ('car_users', 'float'), ('hw_c', 'float'), ('hw_t', 'float'), ('hw_b', 'float'), ('hw_w', 'float'), ('hw_p', 'float'), ('hw', 'float'), ('hc_c', 'float'), ('hc_t', 'float'), ('hc_b', 'float'), ('hc_w', 'float'), ('hc', 'float'), ('hu_c', 'float'), ('hu_t', 'float'), ('hu_b', 'float'), ('hu_w', 'float'), ('hu', 'float'), ('hs_c', 'float'), ('hs_t', 'float'), ('hs_b', 'float'), ('hs_w', 'float'), ('hs', 'float'), ('ho_c', 'float'), ('ho_t', 'float'), ('ho_b', 'float'), ('ho_w', 'float'), ('ho', 'float'), ('hh_c', 'float'), ('hh_t', 'float'), ('hh_b', 'float'), ('hh_w', 'float'), ('hh', 'float'), ('wo_c', 'float'), ('wo_t', 'float'), ('wo_b', 'float'), ('wo_w', 'float'), ('wo', 'float'), ('oo_c', 'float'), ('oo_t', 'float'), ('oo_b', 'float'), ('oo_w', 'float'), ('oo', 'float'), ('wh_c', 'float'), ('wh_t', 'float'), ('wh_b', 'float'), ('wh_w', 'float'), ('wh', 'float'), ('hwp_c', 'float'), ('hwp_t', 'float'), ('hwp', 'float'), ('hop_c', 'float'), ('hop_t', 'float'), ('hop', 'float'), ('oop_c', 'float'), ('oop_t', 'float'), ('oop', 'float'), ('parking_time', 'float')]) to 'float'
2025-04-10 15:18:17 [DEBUG] Set field zone_area: 12.15999984741211
2025-04-10 15:18:17 [DEBUG] Looking up zone_id in {'zone_id': 'zone_id', 'pnr_capacity': 'pnr_capacity', 'pnr_cost': 'pnr_cost', 'population': 'population', 'age_7-17': 'age_7-17', 'age_18-29': 'age_18-29', 'age_30-49': 'age_30-49', 'age_50-64': 'age_50-64', 'age_65-99': 'age_65-99', 'share_age_7-17': 'share_age_7-17', 'share_age_18-29': 'share_age_18-29', 'share_age_30-49': 'share_age_30-49', 'share_age_50-64': 'share_age_50-64', 'share_age_65-99': 'share_age_65-99', 'share_age_7-99': 'share_age_7-99', 'share_age_18-99': 'share_age_18-99', 'share_female': 'share_female', 'share_male': 'share_male', 'population_density': 'population_density', 'workplaces': 'workplaces', 'service': 'service', 'shops': 'shops', 'logistics': 'logistics', 'industry': 'industry', 'parking_cost_work': 'parking_cost_work', 'parking_cost_errand': 'parking_cost_errand', 'comprehensive_schools': 'comprehensive_schools', 'secondary_schools': 'secondary_schools', 'tertiary_education': 'tertiary_education', 'zone_area': 'zone_area', 'share_detached_houses': 'share_detached_houses', 'perc_detached_houses_sqrt': 'perc_detached_houses_sqrt', 'helsinki': 'helsinki', 'cbd': 'cbd', 'lauttasaari': 'lauttasaari', 'helsinki_other': 'helsinki_other', 'espoo_vant_kau': 'espoo_vant_kau', 'surrounding': 'surrounding', 'shops_cbd': 'shops_cbd', 'shops_elsewhere': 'shops_elsewhere', 'share_detached_houses_new': 'share_detached_houses_new', 'time_ratio': 'time_ratio', 'cost_ratio': 'cost_ratio', 'car_density': 'car_density', 'cars_per_1000': 'cars_per_1000', 'car_users': 'car_users', 'hw_c': 'hw_c', 'hw_t': 'hw_t', 'hw_b': 'hw_b', 'hw_w': 'hw_w', 'hw_p': 'hw_p', 'hw': 'hw', 'hc_c': 'hc_c', 'hc_t': 'hc_t', 'hc_b': 'hc_b', 'hc_w': 'hc_w', 'hc': 'hc', 'hu_c': 'hu_c', 'hu_t': 'hu_t', 'hu_b': 'hu_b', 'hu_w': 'hu_w', 'hu': 'hu', 'hs_c': 'hs_c', 'hs_t': 'hs_t', 'hs_b': 'hs_b', 'hs_w': 'hs_w', 'hs': 'hs', 'ho_c': 'ho_c', 'ho_t': 'ho_t', 'ho_b': 'ho_b', 'ho_w': 'ho_w', 'ho': 'ho', 'hh_c': 'hh_c', 'hh_t': 'hh_t', 'hh_b': 'hh_b', 'hh_w': 'hh_w', 'hh': 'hh', 'wo_c': 'wo_c', 'wo_t': 'wo_t', 'wo_b': 'wo_b', 'wo_w': 'wo_w', 'wo': 'wo', 'oo_c': 'oo_c', 'oo_t': 'oo_t', 'oo_b': 'oo_b', 'oo_w': 'oo_w', 'oo': 'oo', 'wh_c': 'wh_c', 'wh_t': 'wh_t', 'wh_b': 'wh_b', 'wh_w': 'wh_w', 'wh': 'wh', 'hwp_c': 'hwp_c', 'hwp_t': 'hwp_t', 'hwp': 'hwp', 'hop_c': 'hop_c', 'hop_t': 'hop_t', 'hop': 'hop', 'oop_c': 'oop_c', 'oop_t': 'oop_t', 'oop': 'oop', 'parking_time': 'parking_time'}
2025-04-10 15:18:17 [DEBUG] Normalizing schema type for key 'zone_id' in schema OrderedDict([('zone_id', 'int'), ('pnr_capacity', 'float'), ('pnr_cost', 'float'), ('population', 'float'), ('age_7-17', 'float'), ('age_18-29', 'float'), ('age_30-49', 'float'), ('age_50-64', 'float'), ('age_65-99', 'float'), ('share_age_7-17', 'float'), ('share_age_18-29', 'float'), ('share_age_30-49', 'float'), ('share_age_50-64', 'float'), ('share_age_65-99', 'float'), ('share_age_7-99', 'float'), ('share_age_18-99', 'float'), ('share_female', 'float'), ('share_male', 'float'), ('population_density', 'float'), ('workplaces', 'float'), ('service', 'float'), ('shops', 'float'), ('logistics', 'float'), ('industry', 'float'), ('parking_cost_work', 'float'), ('parking_cost_errand', 'float'), ('comprehensive_schools', 'float'), ('secondary_schools', 'float'), ('tertiary_education', 'float'), ('zone_area', 'float'), ('share_detached_houses', 'float'), ('perc_detached_houses_sqrt', 'float'), ('helsinki', 'str'), ('cbd', 'str'), ('lauttasaari', 'str'), ('helsinki_other', 'str'), ('espoo_vant_kau', 'str'), ('surrounding', 'str'), ('shops_cbd', 'float'), ('shops_elsewhere', 'float'), ('share_detached_houses_new', 'float'), ('time_ratio', 'float'), ('cost_ratio', 'float'), ('car_density', 'float'), ('cars_per_1000', 'float'), ('car_users', 'float'), ('hw_c', 'float'), ('hw_t', 'float'), ('hw_b', 'float'), ('hw_w', 'float'), ('hw_p', 'float'), ('hw', 'float'), ('hc_c', 'float'), ('hc_t', 'float'), ('hc_b', 'float'), ('hc_w', 'float'), ('hc', 'float'), ('hu_c', 'float'), ('hu_t', 'float'), ('hu_b', 'float'), ('hu_w', 'float'), ('hu', 'float'), ('hs_c', 'float'), ('hs_t', 'float'), ('hs_b', 'float'), ('hs_w', 'float'), ('hs', 'float'), ('ho_c', 'float'), ('ho_t', 'float'), ('ho_b', 'float'), ('ho_w', 'float'), ('ho', 'float'), ('hh_c', 'float'), ('hh_t', 'float'), ('hh_b', 'float'), ('hh_w', 'float'), ('hh', 'float'), ('wo_c', 'float'), ('wo_t', 'float'), ('wo_b', 'float'), ('wo_w', 'float'), ('wo', 'float'), ('oo_c', 'float'), ('oo_t', 'float'), ('oo_b', 'float'), ('oo_w', 'float'), ('oo', 'float'), ('wh_c', 'float'), ('wh_t', 'float'), ('wh_b', 'float'), ('wh_w', 'float'), ('wh', 'float'), ('hwp_c', 'float'), ('hwp_t', 'float'), ('hwp', 'float'), ('hop_c', 'float'), ('hop_t', 'float'), ('hop', 'float'), ('oop_c', 'float'), ('oop_t', 'float'), ('oop', 'float'), ('parking_time', 'float')]) to 'int64'
2025-04-10 15:18:17 [DEBUG] Setting field 0, type 'int64', to value 31009
2025-04-10 15:18:17 [DEBUG] Set field zone_id: 31009

@hsl-petrhaj hsl-petrhaj deleted the branch helmet5-experimental-deploy-issues April 25, 2025 12:53
@s-hiitola s-hiitola deleted the feat/export-estimation-data branch December 10, 2025 06:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants