Skip to content

incorporate pandera into network structure#2788

Open
heckstrahler wants to merge 235 commits intorelease/v4.0.0from
structure_dict_extension
Open

incorporate pandera into network structure#2788
heckstrahler wants to merge 235 commits intorelease/v4.0.0from
structure_dict_extension

Conversation

@heckstrahler
Copy link
Copy Markdown
Contributor

@heckstrahler heckstrahler commented Oct 30, 2025

continue work from #2717

  • incorporate pandera schemata into network structure creation

  • make sure string dtypes are properly set after element creation

  • write tests for validation

  • write tests for result validation?

  • test validation for every create function (not all create functions have tests...)

  • automate docu csv creation (see Feature/generate doc csv #2941)

  • CGMES tags

  • default values

  • decide on how to handle name column

  • trafo creation needs tap variable handling, required seems wrong, tap variables should only exist together

TODO: CHANGELOG!!!

Questions:
switch z_ohm required
sc, 3ph dependancy, trafo, trafo3w

heckstrahler and others added 30 commits September 18, 2025 10:23
* add motor.py

* add motor.py

* adding pa.Check to bus
adding min and max value

* adding import for motor

* adding asymmetric_sgen.py
adding import for asymmetric_sgen.py

* deleting import for asymmetric_sgen
deleting current_source from asymmetric_load
adding import for asymmetric_load
note: asymmetric_sgen was not added in the last commit (spelling mistake)

* adding asymmetric_sgen.py
adding import for asymmetric_sgen

* adding storage.py
adding import for storage

* fix doc for gen (cos_phi in csv)
adding gen.py
adding import for gen

* adding shunt.py
adding import for shunt

* fixed formatting in svc_par.csv (max_angle_degree)
adding svc.py
adding import for svc

* adding res_schema for svc
editing schema names
adding format for res_scv

* editing schema names back

* adding vsc.py
adding import for vsc
adding res_schema for vsc
adding import for res_schema

* adding res_schema for motor
adding import for res_motor
adding res_schema for asymmetric_load
adding import for res_asymmetric_load
adding res_schema for asymmetric_sgen
adding import for res_asymmetric_sgen

* adding res_schema for storage
adding import for res_storage
adding res_schema for gen
adding import for res_gen
adding res_schema for shunt
adding import for res_shunt

* deleting strict_False from res_schema

* adding 3ph for asymmetric_load
adding import for res_schema_3ph
adding 3ph for asymmetric_sgen
adding import for res_schema_3ph
adding 3ph for storage
adding import for res_schema_3ph

* adding metadata to storage
adding metadata to gen
@heckstrahler heckstrahler marked this pull request as ready for review March 26, 2026 08:14
@heckstrahler heckstrahler requested a review from KS-HTK March 26, 2026 08:14
KS-HTK and others added 11 commits March 26, 2026 09:28
* added pytest split to tutorial_test pipeline

* added notebook test times
other formatting

Co-authored-by: V3 <mike.vogt@iee.fraunhofer.de>
* Fix copyright text formatting in LICENSE file

* Refactor copyright notice in LICENSE

Updated copyright notice formatting in LICENSE file following [upstream changes](licensee/licensee#950) to handle multi-line attribution.

---------

Co-authored-by: KS_HTK <2981026+KS-HTK@users.noreply.github.com>
…notebooks (PowerElectronicsConnection) (#2942)

Co-authored-by: David Heck <david.heck@iee.fraunhofer.de>
# Careful when copying this command. The PYTHONPATH setup is Linux specific syntax.
run: |
pytest --nbmake --nbmake-timeout=900 --timeout=900 "./tutorials"
pytest --splits 3 --group ${{ matrix.group }} --nbmake --nbmake-timeout=900 --timeout=900 "./tutorials"
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I know it has been forgotten on develop, but the matrix should also be implemented on the tutorial_warnings_tests, as they run a long time as well.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The FIXME's in this file should be adressed

@@ -0,0 +1 @@
# TODO:
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

?

T = TypeVar("T")


# FIXME: Remove this!
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this be removed? If so remove.

* added PowerElectronicsConnection to the LTDS converter, updated LTDS notebooks (PowerElectronicsConnection)

* updated LTDS notebooks for mapping Excel data
@KS-HTK KS-HTK linked an issue Mar 31, 2026 that may be closed by this pull request
mrifraunhofer and others added 12 commits March 31, 2026 18:04
* updated ltds notebooks

* updated LTDS notebooks for mapping Excel data

* updated LTDS notebooks for mapping Excel data
* updated ltds notebooks

* updated LTDS notebooks for mapping Excel data

* updated LTDS notebooks for mapping Excel data

* UKPN Jupiter Notebook

* fix UKPN Jupiter Notebook
* added check to check if vkr_percent values are reasonable.

* added changelog entry.

---------

Co-authored-by: KS_HTK <2981026+KS-HTK@users.noreply.github.com>
* added more diagnostic functions.

* added changelog entry.

* fixed a small bug, used the wrong value in the reactance field.
Updated the description of loading_percent.
* consider empty R dataframe in ucte conversion

* convert impedances and trafos with G/B=NaN to G/B=0

* change fillna for trafos and impedances to the ucte_parser

* fillna df if 0

* fix nan values in impedances and trafos

* ucte2pp: averaging voltages and clean up parser

* changelog entries for ucte2pp fixes

* average voltage setpoints using topological search instead of ucte name

* empty space at EOF

* fix codacy issue

* remove create_switch from pp_import_functions

* fix create_vsc functions

* changelog :)

* change symmetrical tap changer to 90 degree tap step degree

* correct handling of symmetrical PSTs in ucte2pp

* comment averaging function based on PR review

* changes ucte converter

* ucte2pp: add flag for voltage harmonization, with default false

* fix test

* fix tests and restrict tolerances a bit

---------

Co-authored-by: mrichter <mario.richter@iee.fraunhofer.de>
Co-authored-by: V3 <mike.vogt@iee.fraunhofer.de>
* change patch sizes for plot (#2733)

* fix patch sizes for plot only once (#2733)

`get_collection_sizes()` takes arguments to adjust the relative size of
an element.

---------

Co-authored-by: V3 <mike.vogt@iee.fraunhofer.de>
…ial vector (#2902)

* Fix runopp(init=results) warm-start handling in pips OPF

* Update CHANGELOG for upcoming release fixes and features

---------

Co-authored-by: jereOG <jerelang@users.noreply.github.com>
Co-authored-by: V3 <mike.vogt@iee.fraunhofer.de>
* integrated highlighting feature into simple_plot

* integrated hover feature into simple_plot

* update plotting tutorial

* adjust color
@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud bot commented Apr 7, 2026

Quality Gate Failed Quality Gate failed

Failed conditions
7.9% Duplication on New Code (required ≤ 3%)
B Reliability Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

use nullable integer dtypes bool columns and casting of NaN to True