Vitals All Working But One (No Data) #625
Replies: 1 comment 5 replies
-
|
Thanks @wiltocking - I'm wondering where the issue could be. Basically the data flows: Powerwall <- pyPowerwall <- Telegraph -> Influxdb <- Grafana My guess is that it is an issue with Influxdb not creating the CQs. I'm not sure why. But just to check, look at the logs to see if you see anything odd: # Use ^C to cancel log output
docker logs pypowerwall -f
docker logs telegraf -f
docker logs influxdb -f
docker logs grafana -fThe string data comes from this: http://localhost:8675/strings The influxdb CQ that stores this for Grafana and long term storage: CREATE CONTINUOUS QUERY cq_inverters ON powerwall
BEGIN
SELECT
mean(Inverter1) AS Inverter1,
mean(Inverter2) AS Inverter2,
mean(Inverter3) AS Inverter3,
mean(Inverter4) AS Inverter4
INTO powerwall.strings.:MEASUREMENT
FROM (
SELECT
A_Power + B_Power + C_Power + D_Power + E_Power + F_Power AS Inverter1,
A1_Power + B1_Power + C1_Power + D1_Power + E1_Power + F1_Power AS Inverter2,
A2_Power + B2_Power + C2_Power + D2_Power + E2_Power + F2_Power AS Inverter3,
A3_Power + B3_Power + C3_Power + D3_Power + E3_Power + F3_Power AS Inverter4
FROM raw.http
)
GROUP BY time(1m), month, year
FILL(linear)
END
CREATE CONTINUOUS QUERY cq_inverters1 ON powerwall
BEGIN
SELECT
mean(Inverter5) AS Inverter5,
mean(Inverter6) AS Inverter6
INTO powerwall.strings.:MEASUREMENT
FROM (
SELECT
A4_Power + B4_Power + C4_Power + D4_Power + E4_Power + F4_Power AS Inverter5,
A5_Power + B5_Power + C5_Power + D5_Power + E5_Power + F5_Power AS Inverter6
FROM raw.http
)
GROUP BY time(1m), month, year
FILL(linear)
ENDThe dashboard.json is set to display these InterverX values (you can select Edit on the panel to see this): 
|
Beta Was this translation helpful? Give feedback.
-
|
Telegraf had a lot of errors for 05-09 when I was setting up everything again, after that the only errors were these: For InfluxDB, lots of repeating "Retention Policy Deletion Checks", "Cache Snapshots", "Compacting File" but nothing that seems out of place for writing the Inverter Data. For Grafana, some repeating logger errors about every minute: Meanwhile, the string data seems to be coming in fine for the two that I have: The dashboard.json matches what your screenshot shows but oddly enough the "Invert1" field can't be selected from the drop down menu:
Does the above give any clues? Very odd because the String Power data is there so in theory it should just add those up to display for Inverter Power. Not a big deal if it doesn't show I suppose |
Beta Was this translation helpful? Give feedback.
-
|
That last bit tell us that the CQ is not working correctly or it would be creating those. Let's check a few things: # Make sure we have CQs defined
grep cq_inv influxdb/influxdb.sql
# Next let's query InfluxDB to see if it has those queries running
docker exec -it influxdb influx -database powerwall -execute 'SHOW CONTINUOUS QUERIES' | grep cq_inverters
# If you do NOT see any result, somehow the CQs were not added. Setup should have done this:
docker exec -it influxdb sh -c "influx -import -path=/var/lib/influxdb/influxdb.sql"
# If you run the above, paste any errors you see. We can also create the individual queries this way:
docker exec -it influxdb influx -database powerwall -execute 'CREATE CONTINUOUS QUERY cq_inverters ON powerwall BEGIN SELECT mean(Inverter1) AS Inverter1, mean(Inverter2) AS Inverter2, mean(Inverter3) AS Inverter3, mean(Inverter4) AS Inverter4 INTO powerwall.strings.:MEASUREMENT FROM (SELECT A_Power + B_Power + C_Power + D_Power AS Inverter1, A1_Power + B1_Power + C1_Power + D1_Power AS Inverter2, A2_Power + B2_Power + C2_Power + D2_Power AS Inverter3, A3_Power + B3_Power + C3_Power + D3_Power AS Inverter4 FROM powerwall.raw.http) GROUP BY time(1m), month, year fill(linear) END'
# paste any errors from thatNext, let's test to see if the CQs are actually working. Run this script: import argparse
import csv
import re
from datetime import datetime
import requests
# Defaults
DEFAULT_INFLUX_HOST = "http://localhost:8086"
DB_NAME = "powerwall"
# ANSI colors for terminal output
GREEN = "\033[92m"
RED = "\033[91m"
YELLOW = "\033[93m"
RESET = "\033[0m"
# Map GROUP BY time() intervals to lookback periods for health checking
LOOKBACK_MAP = {
"1m": "5m",
"5m": "15m",
"15m": "30m",
"1h": "2h",
"2h": "4h",
"1d": "2d",
"30d": "60d",
"365d": "400d"
}
def influx_query(query, host):
"""Send a raw query to the InfluxDB host"""
url = f"{host}/query"
params = {"q": query}
if DB_NAME:
params["db"] = DB_NAME
resp = requests.get(url, params=params)
resp.raise_for_status()
return resp.json()
def get_continuous_queries(host):
"""Return a list of (name, query) tuples for all CQs in the specified database"""
data = influx_query("SHOW CONTINUOUS QUERIES", host)
cqs = []
for result in data.get("results", []):
for series in result.get("series", []):
if series.get("name") != DB_NAME:
continue
for row in series.get("values", []):
name, query = row
cqs.append((name, query))
return cqs
def extract_target(query):
"""Extract the INTO <target> value from a CQ definition, resolving :MEASUREMENT"""
match = re.search(r'INTO\s+([^\s]+)', query, re.IGNORECASE)
if not match:
return None
target = match.group(1)
if ":MEASUREMENT" in target:
# Try to find the source measurement from an inner SELECT
from_match = re.search(r'FROM\s+\(?SELECT.*?FROM\s+([a-zA-Z0-9_\.]+)', query, re.IGNORECASE | re.DOTALL)
if not from_match:
# Fallback for simpler CQs like "FROM autogen.http"
from_match = re.search(r'FROM\s+([a-zA-Z0-9_\.]+)', query, re.IGNORECASE)
if from_match:
source_measurement = from_match.group(1).split(".")[-1]
target = target.replace(":MEASUREMENT", source_measurement)
else:
return None
return target
def extract_lookback(query):
"""Determine the lookback window based on the GROUP BY time() interval"""
match = re.search(r'GROUP BY\s+time\(([^)]+)\)', query, re.IGNORECASE)
if match:
duration = match.group(1).strip()
return LOOKBACK_MAP.get(duration, "10m")
return "5m"
def has_recent_data(target, lookback, host):
"""Check if recent data exists in the CQ's target measurement within the lookback window"""
try:
rp, measurement = target.split(".", 1)
query = f"SELECT * FROM {rp}.{measurement} WHERE time > now() - {lookback} LIMIT 1"
data = influx_query(query, host)
return any("series" in result for result in data["results"])
except Exception as e:
print(f"{YELLOW}⚠️ Error checking {target}: {e}{RESET}")
return False
def main():
parser = argparse.ArgumentParser(description="Check InfluxDB Continuous Query health")
parser.add_argument("--host", type=str, default=DEFAULT_INFLUX_HOST, help="InfluxDB host (e.g., http://localhost:8086)")
parser.add_argument("--csv", action="store_true", help="Export results to CSV")
args = parser.parse_args()
influx_host = args.host
print(f"\n🔍 Checking Continuous Queries in '{DB_NAME}' on host {influx_host}...\n")
results = []
for name, query in get_continuous_queries(influx_host):
target = extract_target(query)
lookback = extract_lookback(query)
if not target:
print(f"{YELLOW}⚠️ Could not parse target for CQ: {name}{RESET}")
results.append((name, "Unknown", "Parse Error"))
continue
healthy = has_recent_data(target, lookback, influx_host)
status_text = "Healthy" if healthy else "No recent data"
color = GREEN if healthy else RED
print(f"{name:<30} → {target:<40} : {color}{status_text}{RESET} (lookback={lookback})")
results.append((name, target, status_text))
if args.csv:
now = datetime.now().strftime("%Y%m%d_%H%M")
filename = f"cq_health_{now}.csv"
with open(filename, "w", newline="") as f:
writer = csv.writer(f)
writer.writerow(["CQ Name", "Target", "Status"])
writer.writerows(results)
print(f"\n📄 CSV report saved to: {filename}")
if __name__ == "__main__":
main()It should test every one of your CQs and report back if they are healthy. Thank for helping debug this! I would love to figure out the cause so we can address it in the project. |
Beta Was this translation helpful? Give feedback.
-
|
Sorry for the delay replying, start of a busy week, but finally had some time to go through the suggestions and the first four didn't reveal much. The CQs seem to be defined:
And they seem to be running:
However, I do get errors when I run the last line suggested: The CQ test showed everything healthy too! Yet the Dashboard doesn't report the Inverter total.
|
Beta Was this translation helpful? Give feedback.
-
|
This is an intriguing puzzle! I think my next step would be to test to see if the powerwall.strings.http data in InfluxDB actually shows the inverter data. Maybe try this: import requests
# Config
INFLUX_HOST = "http://localhost:8086"
DB_NAME = "powerwall"
QUERY = """
SELECT Inverter1, Inverter2, Inverter3, Inverter4
FROM strings.http
ORDER BY time DESC
LIMIT 10
"""
def query_influxdb():
url = f"{INFLUX_HOST}/query"
params = {
"db": DB_NAME,
"q": QUERY
}
try:
response = requests.get(url, params=params)
response.raise_for_status()
data = response.json()
print(f"\n✅ Last 10 inverter entries from {DB_NAME}.strings.http:\n")
for result in data.get("results", []):
for series in result.get("series", []):
columns = series["columns"]
for row in series["values"]:
entry = dict(zip(columns, row))
print(entry)
except Exception as e:
print(f"❌ Error querying InfluxDB: {e}")
if __name__ == "__main__":
query_influxdb()I get: |
Beta Was this translation helpful? Give feedback.
-
|
Indeed... I'm starting to mull just formatting the Pi and installing everything again. Gave the script a try and no entries were displayed, after "Last 10 inverter entries from powerwall.strings.http:" Would this be an issue from the PW+ then instead of the Pi? |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Recently my Pi4 crashed and had to do a clean install. Got everything back up and running but one spot in the Dashboard doesn't populate "Inverter Power", I've rerun setup.sh a couple of times, reloaded the json file, and start/stop pypowerwall but nothing seems to bring it back. Any ideas why just one vital would be missing? Had it before the crash with Powerwall+
Checking pypowerwall
Checking telegraf
Checking influxdb
Checking grafana
Checking weather411
Beta Was this translation helpful? Give feedback.
All reactions