[REQUEST] Water flow metering reading of IEC 62056-21 protocol smart water meters (Kamstrup Meter Protocol / KMP) via photodiode/infrared optical eye reader header?

[Hedda]

Describe the problem you have/What new integration you would like

Our local utility company has installed a Kamstrup MULTICA 21 ultrasonic water meter (which is also sold as Kamstrup flowIQ 210x.

Done some research and think would somehow like to get water flow metering reading from it using its IEC 62056-21 protocol smart water meters (Kamstrup Meter Protocol / KMP) by putting some IR-writter and reader on the built-in two-way photodiode/infrared optical eye header that is made for communication on these devices.

That is, like to get water flow metering from smart water meters with IR (InfraRed) eye via some kind of hardware similar to Home Assistant Glow or SlimmeLezer.

Frrom what I could find the optical photodiode/infrared read and write header hardware for those used some varient of IEC 62056-21 protocol (formerly IEC 61107 / IEC 1107) similar to these:

https://www.mysensors.org/build/ir

http://jheyman.github.io/blog/pages/WirelessWaterMeter/

A hackerspace group in Denmark is selling these IR/photodiode optical reading heads for about $14 US (Google translate as test written in Danish) and they wrote a note that using magnets is required as the IR port transmitter / reader eye does not activate unless it sense a magnet:

https://wiki.hal9k.dk/projects/kamstrup

https://github.com/Hal9k-dk/kamstrup

I believe that a such IR reader adapter could be used with newer Kamstrup water meters with IR optical heads common in Europe.

Specifically, I myself live in Sweden where I believe that the Kamstrup MULTICA 21 / Kamstrup flowIQ 210x ultrasonic water meter is the most common model installed by the municipality's utility companies (e.i. local government agencies) in normal private residential houses here in Scandinavia (Sweden, Norway, Denmark, Finland, and Island) to track water usage for their service fees.

https://www.kamstrup.com/en-en/water-solutions/smart-water-meters

https://www.kamstrup.com/en-en/water-solutions/smart-water-meters/multical-21

They currently also have Kamstrup flowIQ 2200 "advanced model with acoustic leak detection":

and Kamstrup flowIQ 3100 "Commercial and industrial" model

https://www.kamstrup.com/en-en/water-solutions/smart-water-meters/flowiq-2200

https://www.kamstrup.com/en-en/water-solutions/smart-water-meters/flowiq-3100

Please describe your use case for this integration and alternatives you've tried:

I believe many new water meters offer such two-way bidirectional infrared port (IR receiver and sender header) for communication?

https://www.mysensors.org/build/ir

http://jheyman.github.io/blog/pages/WirelessWaterMeter/

Kamstrup seems to only provide some technical documentation about all their products here but nothing about their protocols:

https://products.kamstrup.com/index.php

Kamstrup apparently calls their DLMS implementation for Kamstrup Meter Protocol (KMP) it has been reverse-engineered here:

https://github.com/bsdphk/PyDLMS

https://github.com/RuntimeError123/hass-mc66c

https://github.com/KenanV/KamstrupMultical66

https://github.com/Hal9k-dk/kamstrup/tree/master/Software%20eksempler/kamstrup_multical402

https://github.com/Hal9k-dk/kamstrup/tree/master/Software%20eksempler/kamstrup_powermeter

https://github.com/bsdphk/PyKamstrup

https://frack.nl/wiki/Stadsverwarming

https://forum.mysensors.org/topic/3525/district-heating-city-heating-stadsverwarming-mysensor-ir-sender-receiver/

https://www.domoticz.com/forum/viewtopic.php?t=11333

As I understand most of those optical probes should work with optical infrared waves be compliant with the international standard IEC 62056-21 (formerly IEC 61107 / IEC 1107) or ANSI C12.18 communications protocols for energy metering for reading utility meters?

https://github.com/pwitab/iec62056-21

https://en.wikipedia.org/wiki/IEC_62056

https://en.wikipedia.org/wiki/Smart_meter#Protocols

Kamstrup official (and expensive) optical read-out head tools are called 6699-099 (USB) and 699-102 (9F D-sub plug serial)

https://www.termonet.rs/pdf/Kamstrup/Optical%20Read-out%20(IR)%20Head%20-%20Data%20Sheet%20-%20English.pdf

Additional context

I understand these models are very common within the European Union and especially the Nordics/Scandinavia (Sweden, Denmark, Norway, Finland, and Iceland, as well as autonomous territories of the Faroe Islands and Greenland).

FYI, most of the older and newer Kamstrup electricity meters look to feature a similar or same type of bi-directional optical header, so the hardware could probably be repurposed for other meters as well.

PS: Off-topic but FYI; some if not all of these models of Kamstrup water meters can also be read remotely via Sigfox network RF (Radio Frequency) but that communication traffic is most of the time encrypted, at least if the water meter itself is owned and operated by a utility company or a service provider.

https://www.kamstrup.com/en-en/water-solutions/water-meter-reading

https://www.kamstrup.com/en-en/water-solutions/water-meter-reading/usb-meter-reader

If the case is that the RF radio communication is not encrypted then there look to be projects that can work with that:

https://github.com/adams-okode/kamstrup-integration

https://github.com/weetmuts/wmbusmeters

https://github.com/tobiasrask/wmbus-client

[Hedda]

This might be related the the request for SML (Smart Message Language) protocol for reading smartmeter?

#1041

There is a lot collected about workings of SML (a.k.a. "D0 interface") smartmeters with IR two-way here:

https://github.com/volkszaehler/libsml

https://www.msxfaq.de/sonst/bastelbude/smartmeter_d0_sml.htm

[ajvdw]

Have a look at my solution for reading pulse from a sensus620 watermeter. With minor adjustments you can use the same hardware solution....

[Hedda]

@ajvdw These mentioned Kamstrup MULTICA 21 / Kamstrup flowIQ meters don't generate a pulse that represents a metering value.

IR port on these Kamstrup MULTICA 21 / Kamstrup flowIQ communicate via a bi-directional protocol over that IR port (serial-based?).

You can not compare these to for example Kamstrup electricity meters (like their OMNIPOWER meters) which have both a pulse diod where the pulses can just be counted as well as the more complex IR port for their bi-directional protocol similar to MULTICA/flowIQ:

See example this project about building IR sender and receiver hardware to both read and write https://wiki.hal9k.dk/projects/kamstrup

[ajvdw]

It's not about the pulse. The hardware that I have designed can easily be adjusted to communicate via IR. It already contains an IR sender and receiver. You only have to connect the IR sender to a datapin in order to send data to the Kamstrup. Receiving is already possible. Then you can use softserial to implement the protocol. Op ma 25 okt. 2021 om 15:19 schreef Hedda ***@***.***>:

…

@ajvdw <https://github.com/ajvdw> These mentioned Kamstrup MULTICA 21 / Kamstrup flowIQ meters don't generate a pulse that represents a metering value. IR port on these Kamstrup MULTICA 21 / Kamstrup flowIQ communicate via a bi-directional protocol over that IR port (serial-based?). You can not compare these to for example Kamstrup electricity meters (like their OMNIPOWER meters) which have both a pulse diod where the pulses can just be counted as well as the more complex IR port for their bi-directional protocol similar to MULTICA/flowIQ: [image: image] <https://user-images.githubusercontent.com/6320001/138702295-e57ef8a1-d42b-4794-93eb-f4719de0433d.png> — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1402 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AET5LMIIVOXSZFQDOE2XXWLUIVKMLANCNFSM5DULRVRA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

-- Met vriendelijke groeten, Arie Johan van de Werken

[coltju]

Check out https://github.com/golles/Home-Assistant-Sensor-MC66C

Im using this for my block heating sensor, which uses the same tech.

[evlo]

Hi, i'm looking at projects regarding this, either esphome (preferably)

OP did nice summary of the things I also found.

What i understand that IEC 62056-21 is quite widely used in this environment, and sometimes called "S0" (probably something from DIN). I even seems basically UART RS485, just trough optical IR diode(s).
BTW I remember ages ago IR was used by laptops and cellphones to transfer data.

I think not a lot people know about this and all the projects I found so far about this are quite old/cumbersome or me or at least quite hard to follow.

So I was wondering if i understand it correctly that all need is this
https://www.aliexpress.com/item/33005112599.html - connect it using "dupont" cables to nodemcu32 ana i should be able to read the data if speed set to 9600 baud or slower?

https://onemeter.com/cs/specifications/ found this, not esp, but maybe they just convert ir uart to bt uart?
https://www.fiedler.company/sites/default/files/dokumenty/cenik_2022_v104b.pdf here they sell 3d printed assembled optical diodes with correct IEC 62056-21 4.3.2 magnetic ring etc. https://www.fiedler.company/en/products/smart-metering-remote-meter-readings/sensors-and-transducers-meters/elm1-converter-electric (suspiciously simillar to https://wiki.hal9k.dk/projects/kamstrup solution ...)

EDIT: found this https://www.aliexpress.com/item/1005003509520122.html but it is USB

this one is RS232 https://www.aliexpress.com/item/1005003328350869.html

[evlo]

I think the main issue is sending /?!\r\n / HEX: 2F3F210D0A to poll the meter, otherwise maybe the default SML component might work.

[evlo]

Most likely what my meter spits out is not actually SML, but called IEC62056-21 or sometimes d0 - i think it goes like d0 is the port, IEC62056-21 is the definition of the IR communication, SML is the "extended" protocol and OBIS codes are what each code mean, so even though meter uses IEC62056-21, d0 and OBIS it is most likely not SML, but just IEC62056-21 compliant (which contains basic protocol, but not exactly SML - sml seems to me that it might be IEC62056-21 for multiple meters on the same bus)

This is used by more meters then just water, very similar to SML, but i think separate component is need for easiest implementation. What I wrote in my previous post about using SML component is not true

example:

[jakobschou]

Hopefully somebody could figure out to get some cheap optical probe like this to work:
https://a.aliexpress.com/_mK4qGxM
so we dont need to solder something ourselves.

It seems that it is possible to do with other Kamstrup meters:
https://github.com/golles/ha-kamstrup_403
(Somebody is using
https://a.aliexpress.com/_mPY7OYe and getting it to work, though there needs to be attached magnet aswell https://a.aliexpress.com/_mOYY7d4 to get the IR sensors working on the Kamstrup meter)

Though this setup is using pykamstrup (https://github.com/golles/ha-kamstrup_403/tree/main/custom_components/kamstrup_403) which I dont know if it is the right/same protocol for water meters with IEC62056-21, but maybe it could be changed to pyDLMS (https://github.com/bsdphk/PyDLMS). Here is also some code for the old IEC1107 protocol which maybe could be useful, since the original Kamstrup Optical read-out head seems to be only compliant with this protocol...

Hopefully somebody could fork kamstrup_403 and make it work with Kamstrup Multical 21/FlowIQ 2200 - I just dont have the knowledge to do so.