Support for GivEnergy

[davesmeghead]

Hi,
I'm asking for help to import GivEnergy data in to Home Assistant. I have written a python script to grab the data from the GivEnergy API and I have it in a csv file of my own format. Note that I have solar panels and a battery, with a single inverter.

This is my python script
grab_givenergy_data.zip

This is an example of my output data in the created csv file (1st Nov 2025 to 7th Nov 2025)
output.zip

GivEnergy only allow data points for a single day to be grabbed at a time through the API. The following file is an example of 1 day of the json format that I get from GivEnergy (as per the intermediate step in my python script where I save it to a file in the temporary directory)
MeterData_2025-11-02 - sanitised.zip
Note that in the "links" and "meta" I have removed all sensitive data of my inverter.

So now on to my questions that I'm hoping you can help with

1. My Home Assistant database has corrupt energy data in it, is there an easy way to remove this first before I import new data?
2. Given the 3 uploads above, what do I need to do next and can anyone help please?
3. What do I do with the python script that I used to grab the data from GivEnergy, is this located in this repository or in my own area elsewhere?
4. The data from GivEnergy is at varying times and not regular, I have a variable in the python script to only output data when there is any change, is this OK?

Any help would be appreciated, thanks

[patrickvorgers]

1. My Home Assistant database has corrupt energy data in it, is there an easy way to remove this first before I import new data?

It depends on what "corrupt" means in your case. Using the Developer tools > statistics you can remove certain statistics of a sensor in case the statistics are wrong for a few values. You need to use SQL in case you want to delete/correct whole periods and that can be quite tricky.

2. Given the 3 uploads above, what do I need to do next and can anyone help please?
The import script also supports JSON, so I can have a look whether the JSON format can be used to create the script to convert the data to the CSV format which the import script expects. I won't be able to do that somewhere next week.

3. What do I do with the python script that I used to grab the data from GivEnergy, is this located in this repository or in my own area elsewhere?
I presume that you want to import the historical data once and then import it into Home Assistant. The realtime data is fed into Home Assistant using another integration?

The workflow could be:

• Python script: get all the historical json files that need to be imported into Home Assistant
• Script that converts the json files into the standardized CSV format
• Import the data into Home Assistant

4. The data from GivEnergy is at varying times and not regular, I have a variable in the python script to only output data when there is any change, is this OK?

Does that also apply to historical data because I don't understand the changed part in the context of historical data?

I saw for realtime data that there is a HACS integration. You are probably using that one, correct?
https://github.com/cdpuk/givenergy-local

[davesmeghead]

Hi and thanks for the quick reply,

1. I use GivTCP in a docker container and then MQTT for the realtime data. I've had problems with my GivEnergy setup and Home Assistant has corrupt data for a few months at the end of last year, but the GivEnergy source data that I've grabbed through the API is correct, I've checked it. So I'd like to erase most of October, all of November and a bit of December from the Home Assistant database and re-import it. I've had it fixed and working for about a month and it looks good now. So I can't delete/correct all these entries using the statistics interface, there are lots!
   https://github.com/britkat1980/giv_tcp

2. I'd appreciate you taking a look, though there's no urgency. If you want more json data then let me know. Also, feel free to use any of my python script.
   There are 2 main variables that the user needs to set:
   GivEnergyPortalAPI --> On the GivEnergy web the user needs to create an API key, a long string of printable random characters
   SerialNum --> The unique GivEnergy inverter serial number
   These are both set at the top of my python script.
   There are 3 entries in the json that I made an empty string in the zip file above but they are just direct web links to my data on the Givenergy web. The following is what it looks like, I've replaced my serial number with SerialNum

    "links": {
        "first": "https://api.givenergy.cloud/v1/inverter/SerialNum/data-points/2025-11-25?page=1",
        "last": "https://api.givenergy.cloud/v1/inverter/SerialNum/data-points/2025-11-25?page=1",
        "prev": null,
        "next": null
    },
    "meta": {
        "current_page": 1,
        "from": 1,
        "last_page": 1,
        "path": "https://api.givenergy.cloud/v1/inverter/SerialNum/data-points/2025-11-25",
        "per_page": 100000,
        "to": 3130,
        "total": 3130
    }

3. Yes I just want to grab the historical data and import it in to HA. In my python script there are 2 loops, the first gets the data (for each single day) from GivEnergy and creates a file representing the raw data for each day, the second opens each file and processes it to create a single csv file for the whole date range. But if you take a look then do whatever you think is best.

4. The raw data that I save to a json file is the raw data direct from GivEnergy for each whole day. I do not know the criteria that they use but the time varies for each data set, they are not captured regularly. In my second loop I have a variable output_changes_only to just look at changes in the data I'm interested in. Does this make sense?

Thanks again 😄

[patrickvorgers]

1. The import script cannot insert missing data but can only add data that precedes the data in Home Assistant. So what I would do is the following (as soon as we have the import working).
   - Delete the data from the sensor that is older than and including the corrupted data
   - Export all the json files for the days that are now missing
   - Convert the json files to the CSV files (The new script I am going to look at)
   - Import the data
2. It would help if you could provide me with a set of json files for several days.
3. I think only the first loop is needed and the second loop would be covered by the generic import script (I will check next week)
4. Does the JSON file contain serveral measurements during the day or one measurement per day? There is logic in the generic DataPrepare script that can downsample the data to one hour (if needed). Some datasets provide measurements per 15 minute interval and this is a higher resolution than Home Assistant needs (1 hour interval)

[davesmeghead]

1. OK, no problem. I had the system installed last May so I'll need to remove all data up until about 5th December. I'll need to work out the sql to do this but shouldn't be too difficult, it might be easier if I deleted all data, or do I need to keep some, I might delete all data from last May to the day before I do all this. Lots to think about! Would I need to run your script for each day? The GivEnergy API only allows the retrieval of the data points for a single date at a time.

2. Here's a zip with all of my json files, I've replaced the inverter serial number with "ABCDEFGHIJ"
   Data.zip

3. I think that as well, let me know if you think I can help or maybe do some testing for you

4. In the zip file above each json file represents a single day:

   • The date is part of the filename but also inside for each data point as well throughout that day
   • There are 3 main keys: "data", "links" and "meta".
   • There is an array/list of data points in "data". So the json file contains several measurements for the day.
   • Each data point has a timestamp (within that day, a UTC time field including year, month, day, hours, minutes and seconds)
   • Each data point contains all the needed information about the solar, battery and grid (associated with a single inverter)
   • The time between data points varies a lot, it could be a few seconds to minutes to tens of minutes
   • In each data point there is a "status" key that needs to be checked to be "NORMAL" for the data to be used
   • I only have 1 inverter but other people may have more

[patrickvorgers]

I gave it a go and created the script for GivEnergy (see below file).

GivEnergy.zip

I did not use the today structure but the total structure because that one gives the measurement per timestamp and continues across the days.

• Only records that are metered and NORMAL are used
• Records are reduced to an hourly timeframe (standard for Home Assistant)
• It creates files for grid import (feed in), grid export (feed out) and solar, others can be added if needed
• Output is now in the format that can be used by the import script

Could you check whether this works for you?
Just download/clone the repository and add the GivEnergy directory from the zip-file to the datasources directory. From there you can run the python script: python GivEnergyDataPrepare.py "Sample files\*.json".

@davesmeghead, if this works we could rebuild your script into a script that fetches the json files for a specified period.

[davesmeghead]

I'm just in the middle of testing and it's looking good.

I added the following to your GivEnergyDataPrepare to get the battery charge/discharge history

    OutputFileDefinition(
        "elec_battery_feed_out_high_resolution.csv",
        "total.battery.charge",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_battery_feed_in_high_resolution.csv",
        "total.battery.discharge",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),

I took a copy of my db to work on and followed your instructions, using "Option 1: Use the Sensors.py script (GUI)" and it seemed to work, at least no errors or anything like that.

I then remembered that I need to delete all historic data first so I'm just finishing a python script to do the sql, here it is
db_energy_cleaner.zip

I you get time to take a look and have comments then please let me know, I "sql" delete from the state, statistics and statistics_short_term data tables, is this correct?

This seems to work on a copy of the home assistant db

So all I need to do is put it all together, take a copy of the db, run my delete script and then follow your process. I can't do it now as I have to go out, I'll have a go later today and let you know.

Feel free to use whatever you need from any of the python scripts

[patrickvorgers]

• You only need to delete from the statistics table. Don't delete from the state en statistics_short_term tables
• Instead of using a Python script you can also use tools like HeidiSQL to directly execute a SQL statement
• You have to stop the Home Assistant recorder before you copy the SQLite databse file while Home Assistant is running (Developer Tools -> Actions -> search for: disable recorder)

[patrickvorgers]

Could you test the below script?
I don't have a GivEnergy account, so I am not able to test it.
The script downloads the json files for a specified period.

GrabGivEnergyData.zip

[davesmeghead]

Hi, I'm just walking through the process now and saw your post. I tried your download script but couldn't get it working:

python .\GrabGivEnergyData.py -y --api-token MyAPITOKEN --serial MySerial 2025-08-01 2025-08-30
Grab GivEnergy data

This python script grabs the GivEnergy daily data which can be used in the conversion script.

usage: GrabGivEnergyData.py [-h] [-y] --api-token API_TOKEN --serial SERIAL start_date [end_date]
GrabGivEnergyData.py: error: argument start_date: Invalid date. Expected YYYY-MM-DD

Am I doing it right?
Just 1 more thing, you might want to add another option to read the API Token from a file as it's very long, mine is 1476 characters long. The API Token has all printable characters but also includes hyphens and punctuation.

I also tried "" like this and it did the same

python .\GrabGivEnergyData.py -y --api-token "MyAPITOKEN" --serial "MySerial" 2025-08-01 2025-08-30

[patrickvorgers]

This is my output based on your parameters. I am getting errors because the API-token is invalid.
Are you running on windows or on linux?

H:\Documents\GitHub\Home-Assistant-Import-Energy-Data\Datasources\GivEnergy>python .\GrabGivEnergyData.py -y --api-token "MyAPITOKEN" --serial "MySerial" 2025-08-01 2025-08-30
Grab GivEnergy data

This python script grabs the GivEnergy daily data which can be used in the conversion script.

GivEnergy JSON Downloader
Serial: MySerial
Date range: 2025-08-01 .. 2025-08-30 (inclusive)
Output: current directory
WARNING: Existing files WILL be overwritten.

Downloading 2025-08-01 -> MeterData_2025-08-01.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-02 -> MeterData_2025-08-02.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-03 -> MeterData_2025-08-03.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-04 -> MeterData_2025-08-04.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-05 -> MeterData_2025-08-05.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-06 -> MeterData_2025-08-06.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-07 -> MeterData_2025-08-07.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-08 -> MeterData_2025-08-08.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-09 -> MeterData_2025-08-09.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-10 -> MeterData_2025-08-10.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-11 -> MeterData_2025-08-11.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-12 -> MeterData_2025-08-12.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-13 -> MeterData_2025-08-13.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-14 -> MeterData_2025-08-14.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-15 -> MeterData_2025-08-15.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-16 -> MeterData_2025-08-16.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-17 -> MeterData_2025-08-17.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-18 -> MeterData_2025-08-18.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-19 -> MeterData_2025-08-19.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-20 -> MeterData_2025-08-20.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-21 -> MeterData_2025-08-21.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-22 -> MeterData_2025-08-22.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-23 -> MeterData_2025-08-23.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-24 -> MeterData_2025-08-24.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-25 -> MeterData_2025-08-25.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-26 -> MeterData_2025-08-26.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-27 -> MeterData_2025-08-27.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-28 -> MeterData_2025-08-28.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-29 -> MeterData_2025-08-29.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-30 -> MeterData_2025-08-30.json
  Failed: 401 Unauthorized. Check your API token.
Done.

H:\Documents\GitHub\Home-Assistant-Import-Energy-Data\Datasources\GivEnergy>

[davesmeghead]

Hi,
Quick question, is there a specific reason that you use "total" values from the GivEnergy json data? I ask because I've walked through the process and it all worked .... except that when looking at the battery data in Home Assistant Energy panel, the charge and discharge is always the same. I went back to look at the downloaded json files from Givenergy and sure enough, the total values are always the same, for example:

            "total": {
                "solar": 3289.8,
                "grid": {
                    "import": 2169.6,
                    "export": 2784.9
                },
                "battery": {
                    "charge": 1313.6,
                    "discharge": 1313.6
                },
                "consumption": 2284.4,
                "ac_charge": 991.8
            },

HA uses the 5 values to calculate the 6th i.e. "Home", this is a screen grab from 7th July:

On a positive, because these are the same in the GivEnergy source json files and also in HA, then it proves that the whole process worked 😄

It's not drastically important to me as I have the grid use (import/export) correct which is what i'm interested in. It also changes per day so I assume it's an average for that day maybe.

[davesmeghead]

I'm sorry but I should have said, that is not my API Token or my Serial number. If I gave that out to anyone then they would have full access to my system and I'm not going to do that. It was a problem with the date format that seemed to be the error

GrabGivEnergyData.py: error: argument start_date: Invalid date. Expected YYYY-MM-DD

Maybe it's an issue because of the length of the API Token, it's 1476 characters long, I'm on windows 11, how long can a command line be?
That would make the whole command line more than 1500 characters

EDIT: just googles and it should be OK
https://learn.microsoft.com/en-us/troubleshoot/windows-client/shell-experience/command-line-string-limitation

So it might be because the API Token includes punctuation etc

[davesmeghead]

Yeah it must be the API Token

I get the same as you like this

PS E:\HomeAssistant\GivEnergyAPI\GrabGivEnergyData> python .\GrabGivEnergyData.py -y --api-token "MyAPITOKEN" --serial "MySerial" 2025-08-01 2025-08-30
Grab GivEnergy data

This python script grabs the GivEnergy daily data which can be used in the conversion script.

GivEnergy JSON Downloader
Serial: MySerial
Date range: 2025-08-01 .. 2025-08-30 (inclusive)
Output: current directory
WARNING: Existing files WILL be overwritten.

Downloading 2025-08-01 -> MeterData_2025-08-01.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-02 -> MeterData_2025-08-02.json
  Failed: 401 Unauthorized. Check your API token.
Downloading 2025-08-03 -> MeterData_2025-08-03.json
  Failed: 401 Unauthorized. Check your API token.

etc

But when I include the real API Token and Serial it tells me about the invalid date

[davesmeghead]

Sorry for the rapid updates

I just tried putting it in to a PowerShell script as testy.ps1 and it's working so I don't know what I did wrong with the command prompt.

PS E:\HomeAssistant\GivEnergyAPI\GrabGivEnergyData> .\testy.ps1
Grab GivEnergy data

This python script grabs the GivEnergy daily data which can be used in the conversion script.

GivEnergy JSON Downloader
Serial: MySerial                                          <<<<<<<<<<<<<<<<<<<< Changed to replace my actual serial number
Date range: 2025-08-01 .. 2025-08-30 (inclusive)
Output: current directory
WARNING: Existing files WILL be overwritten.

Downloading 2025-08-01 -> MeterData_2025-08-01.json
  Wrote 286 points
Downloading 2025-08-02 -> MeterData_2025-08-02.json
  Wrote 494 points
Downloading 2025-08-03 -> MeterData_2025-08-03.json
  Wrote 306 points
Downloading 2025-08-04 -> MeterData_2025-08-04.json
  Wrote 285 points
Downloading 2025-08-05 -> MeterData_2025-08-05.json

etc

Whenever I try it using a command prompt though it fails.
EDIT: I can select all text in the testy.ps1 file, copy and then paste it to the PowerShell command prompt and it fails

[patrickvorgers]

So maybe it is better to use an api-token-file.
I will update the code for you to retry

[patrickvorgers]

The total for GRID and SOLAR is an increasing value so for the OutputFileDefinition you can/must use IntervalMode.READING_START_INTERVAL. When looking at the different json files it seems that battery is also increasing.

elec_battery_feed_in_high_resolution.csv
elec_battery_feed_out_high_resolution.csv

[patrickvorgers]

Things to check for the battery:

• Did you also delete the old data?
• Did you add the extra import lines in the SQL script?

[davesmeghead]

Yeah I:

1. Stopped HA and took a copy of the db
2. Deleted the old statistics data for the 5 sensors, I used my updated python script. I did not delete state or statistics_short_term data.
3. Used your process for SQL, the IMPORT_DATA was definitely there in the db

This is the SQLite that your python created

INSERT INTO SENSORS VALUES ('elec_solar'             , 406       , 1         , 25          , 1000           );
INSERT INTO SENSORS VALUES ('elec_battery_feed_in'   , 407       , 1         , 25          , 1000           );
INSERT INTO SENSORS VALUES ('elec_feed_out_tariff_1' , 408       , 1         , 25          , 1000           );
INSERT INTO SENSORS VALUES ('elec_feed_in_tariff_1'  , 409       , 1         , 25          , 1000           );
INSERT INTO SENSORS VALUES ('elec_battery_feed_out'  , 410       , 1         , 25          , 1000           );

So it all looks correct to me, but as I said it's not really a problem for me personally.
Whatever date I pick in HA the charge/discharge is the same. Just to be clear, it changes day to day (e.g. 10th Dec is 7.8KWh and 11th Dec is 5.1KWh), but for each individual day the charge/discharge is the same.

EDIT: I also know that it worked because it's replaced my bad data from last year.

[patrickvorgers]

Ah, I misunderstood the issue.
The charge and discharge are the same for every day but the values changes across the days.

I had a look at the json source files and saw that the values are the same there aswell. So the process works but the sourcedata is incorrect?

Your input and steps look to be correct.

[patrickvorgers]

Can you have a new look at the updated script?
It now only accepts a tokenfile

GrabGivEnergyData.zip

[davesmeghead]

I'll give that a go now

Just to complete what I said earlier, this is what I have in my GivenergyDataPrepare file

# List of one or more output file definitions
engine.outputFiles = [
    OutputFileDefinition(
        "elec_feed_in_tariff_1_high_resolution.csv",
        "total.grid.import",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_feed_out_tariff_1_high_resolution.csv",
        "total.grid.export",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_solar_high_resolution.csv",
        "total.solar",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_battery_feed_out_high_resolution.csv",
        "total.battery.charge",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_battery_feed_in_high_resolution.csv",
        "total.battery.discharge",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
]

[davesmeghead]

Yes your GrabGivEnergyData script works with the api token in a file (again I've replaced my serial number with "MySerial").

PS E:\HomeAssistant\GivEnergyAPI\GrabGivEnergyData> python .\GrabGivEnergyData.py --api-token-file apitoken.txt --serial MySerial 2025-08-01 2025-08-30
Grab GivEnergy data

This python script grabs the GivEnergy daily data which can be used in the conversion script.

GivEnergy JSON Downloader
Serial: MySerial
Date range: 2025-08-01 .. 2025-08-30 (inclusive)
Output: current directory
WARNING: Existing files WILL be overwritten.

Continue? [y/N]: y
Downloading 2025-08-01 -> MeterData_2025-08-01.json
  Wrote 286 points
Downloading 2025-08-02 -> MeterData_2025-08-02.json
  Wrote 494 points
Downloading 2025-08-03 -> MeterData_2025-08-03.json
  Wrote 306 points

[patrickvorgers]

Could you help me with a description on how to get the API-TOKEN and the serial so that I can use that in the README of the GivEnergy datasource?

[patrickvorgers]

Could you use the below script for the battery data?
It now uses the Today data. I think it will work but am not 100% sure because the value is reset every day.

GrabGivEnergyData.zip

engine.outputFiles = [
    OutputFileDefinition(
        "elec_feed_in_tariff_1_high_resolution.csv",
        "total.grid.import",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_feed_out_tariff_1_high_resolution.csv",
        "total.grid.export",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_solar_high_resolution.csv",
        "total.solar",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_battery_feed_out_high_resolution.csv",
        "today.battery.charge",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_battery_feed_in_high_resolution.csv",
        "today.battery.discharge",
        [DataFilter("status", "^NORMAL$", True), DataFilter("is_metered", "^True$", True)],
        IntervalMode.READING_START_INTERVAL,
    ),
]

[davesmeghead]

For the script

Access the GivEnergy (Cloud) Dashboard:

• The Serial Number is that of the Inverter, users may have more than 1 Inverter but 1 is most likely. My Serial Number starts with FD and is 10 characters in total.
• The API Token. Select "Account Settings" and then "Manage Account Security". About half way down there's "Manage API Tokens". Select "Generate New Token". You need to give it a name and an expiry date (this could be "No Expiry"). For the "Scope" setting I just selected "api: Full Control" but there are many sub-selections. I believe that the same API Token can be used across all Inverters.

This is a screengrab so you get the idea:

EDIT: It might be best if you suggest that the API Token only lasts a day or a week, that way the user can get the data they need and the token automatically expires.

[patrickvorgers]

Thank you for the information. I will include it in the README.

[davesmeghead]

I've just gone through the sequence using today for battery charge and discharge and that looks correct.

This is the same day as last time, it was actually the 8th July and not the 7th July data

This looks correct, battery charge is 8.1 and home assistant calculates Home as 14.2

So I think we have a winner, it all looks like it's working. I'll do more checking of the historical data later today but it looks good.

If there is anything else that I can help with then let me know 😄

[patrickvorgers]

I created the remaining files (README, tests) and have added GivEnergy as a datasource to the repository,

[davesmeghead]

Hi again,
I think that the battery charge and discharge are the wrong way around, what do you call elec_battery_feed_out_high_resolution, is that charge or discharge?
I assumed it was charge in my earlier post and you just copied it across, so my fault if it's the wrong way around. But it appears wrong in my HA, though I could have mapped the sensor wrong using your sensors.py script as well.

[patrickvorgers]

I would say that elec_battery_feed_in_high_resolution is the charge and elec_battery_feed_out_high_resolution is discharge.
So you would have to map the right sensor in the sensors.py script.
They seem to be switched around, looking at the current outputfile definition. I will change that.

[davesmeghead]

This this needs updating in GivEnergyDataPrepare.py
Do you agree?

    OutputFileDefinition(
        "elec_battery_feed_out_high_resolution.csv", 
        "today.battery.charge",
        [
            DataFilter("status", "^NORMAL$", True),
            DataFilter("is_metered", "^True$", True),
        ],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_battery_feed_in_high_resolution.csv",
        "today.battery.discharge",
        [
            DataFilter("status", "^NORMAL$", True),
            DataFilter("is_metered", "^True$", True),
        ],
        IntervalMode.READING_START_INTERVAL,
    ),

[davesmeghead]

OK thanks

[patrickvorgers]

This is the new definition:

    OutputFileDefinition(
        "elec_battery_feed_in_high_resolution.csv",
        "today.battery.charge",
        [
            DataFilter("status", "^NORMAL$", True),
            DataFilter("is_metered", "^True$", True),
        ],
        IntervalMode.READING_START_INTERVAL,
    ),
    OutputFileDefinition(
        "elec_battery_feed_out_high_resolution.csv",
        "today.battery.discharge",
        [
            DataFilter("status", "^NORMAL$", True),
            DataFilter("is_metered", "^True$", True),
        ],
        IntervalMode.READING_START_INTERVAL,
    ),