Omnik data logger DSMR P1 support

Met de splinternieuwe release van Omnik data logger heb ik de ondersteuning voor de Slimme meter (DSMR) toegevoegd. Met een simpele P1 naar USB kabel kan Omnik data logger nu ook het verbruik van je slimme meter publiceren (inclusief gasverbruik). Met PVoutput kan op basis hiervan het verbruik worden vastgelegd inclusief netspanning zodat de netto energie (gebruikt/teruggeleverd) kan worden berekend.

De P1 adapter kan direct aan het apparaat met Omnik data logger worden aangesloten of via TCP. Ik heb hiervoor ser2net gebruikt zodat ik met meerdere verbindingen naar mijn slimme meter kan voa de P1 adapter (handig voor testen). Om dit mogelijk te maken heb je minimaal ser2net v3.5 nodig. Ik heb hiervoor een docker container geïnstalleerd met als image (jsurf/rpi-ser2net:buster). Met het toevoegen van de max-connections optie in de configuratie worden meerdere gelijktijdige verbindingen ondersteund.

3333:raw:600:/dev/ttyUSB0:115200 NONE 1STOPBIT 8DATABITS -XONXOFF RTSCTS max-connections=3

/etc/ser2net.conf

Al je je slimme meter gegevens binnen Home Assistant wilt hebben, dan kan Omnik Datalogger hiermee de ingebouwde DSMR integratie vervangen. Door gebruik van MQTT kan Home Assistant alle tellerstanden e.d. automatisch herkennen. In de config file kun je (indien gewenst) de namen van de alle gemeten waarden hernoemen naar het Nederlands. Aanvullend krijg je via MQTT binnen Home Assistant ook direct verbruik, direct verbruikte energie en de werkelijke verbruiksdata te zien. Deze data wordt zoawel over MQTT als over InfluxDB gelogd.

HACS Default

Omnik data logger is toegevoegd aan de hoofd appstore binnen Home Assistant Community Store (HACS), dit betekend dat je Omnik data logger kunt vinden tussen de Automatiseringen.

Zorg er eerst voor dat je de AppDamon plugin hebt geïnstalleerd vanuit de officiele Home Assistant Add-on store.

TCPclient getest en werkend

Met dank aan Han Lubach is de tcpclient nu succesvol getest. Het lijkt er op dat deze client, gebaseerd op de logger van Wouter van der Zwan nu ook te gebruiken is met Omnik data logger.

Omnik data logger news update

PIP ondersteuning voor omnikdatalogger en omnikdatalogerproxy

Omnikdatalogger kan vanaf nu worden geïnstalleerd met PIP:

sudo pip3 install omnikdatalogger

Om omnikdataloggerproxy te installeren gebruik je sudo pip3 install omnikdataloggerproxy

HACS default support

Omnikdatalogger kon als custom repository binnen HACS worden geïnstalleerd. Een verzoek om Omnik data logger toe te voegen aan de ingebouwde store is aangevraagd en goedgekeurd.

Caching automation application for Home Assistant

When automating with Home Assistant, you can use elements like:

They can be set through the config at be set to initial values. The current state will be reset to the initial value. You can use ha-entity-cache to recover to the last value set. Be aware that Home Assistant already restores certain values at restart.

If you have other properties or attributes you want to make persistent, then have a look at this project.

P.s. when you do not supply an initial value, Home assistant will recover state as well.

See my project that enables caching the state and attributes of custom controls within Home Assistant.

https://github.com/jbouwh/ha-entity-cache

Caching of manual inputs for Home Assistant

I found it to be annoying Home Assistant is recovering the manual input selects I am using for my automations. To enable a persistant state I have made a generic scrits that cashes the state of these input to disk and restores them automatically when Home Assistant restarts.

De script is written in Python and is written to work with AppDaemon.

The code shows how to use the Home Assistant integration API that comes with AppDaemon.

New release Omnik datalogger

Check https://GitHub.com/jbouwh/omnikdatalogger for the newrelease (0.91-beta) of Omnik datalogger.

The last days omnikport was down. In the mean while I found a second method getting access your the data. During the outage the portal at https://www.solarmanpv.com/portal was available the whole time. Here you can find your data aswell. This proves omnikportal is just a skin and the data is at solarman PV. I found an API and working code that gives access to the realtime information. This API seems to give more accurate and in time access to the most recent data that was logged. Unfortunally the API is not TLS encrypted and uses a MD5 hashed password login. Not very safe. Neverless the alternative API is a good alternative for the time being. In the main menu there is now a special page for the omnik datalogger sofware.

Pluggable client

The new release comes with a pluggable client for logging. This makes it easy to change the logging code by just changing the configuration.

New client in development for local logging

For older Omnik inverters it is not possible to get the data straight from the inverter. Newer inverters listen at port 8899 and are able to respond directly. The datalogger in the inverter sends an update about every 5 minutes to a fixed IP of a logging server in the Solarman datacenter. The IP address the inverter is logging to is fixed and cannot be changed via the interface, but it is possible to intercept the message by simulating the server using a NAT rule and a static route for the IP address in your netwerk. The code te parse the data that is logged is already available to use, thanks to Woutrrr. The software will be able to listen on a TCP port to the rerouted datalogger sessions. The code ewill be based on this project of t3kpunk. A tutorial how to use this will apear on this site as soon as the code is ready for release. Local logging will give more detail information then currently available using the API’s. Extra sensors will be:

  • AV Voltage* and Current and Frequency (3 fase if yor model supports it)
  • DC Voltages and Currents for all strings (max 2)
  • The Temperature* of the inverter

*These values are submitted to PVoutput as well. And every new sensor will become available via the MQTT plugin.

DSMR integration

For ouput to pvoutput.org I have planned to make an integration for the Dutch Smart Meter (DSMR). An adapter from the P1 connector to a USB serial interface is general available. Integrating makes is possible to calculate the real energy consumption. Of course all these new sensor information will be available to the MQTT output plugin as well.

Outage omnik portal

The last few days, the omnik portal and app and API have been unavailabe. So the data loggging is not possible at the moment. I have found out Omnik dataloggers log to the database of SolarmanPV. It seems you can still see your live output and history.

The URL is https://www.solarmanpv.com/portal/LoginPage.aspx and you can use your omnik portal credentials. I am working to get the API working so the software can be updated. Unfortunally there is only a working unsecure API interface. There is a secure alternative, but an API-key is needed for that. I am working on this.

Have some patience, I will come with a working update coming days.

Regards,

Jan

Thirst (pre) release for the omnik data logger

De first pre-release of the new Omnik data logger is now available. I would like to know if this works for you! If you have any comments or issues, let me know!

Release details

Version: 0.9-alpha (pre-release)

This pre-release brings a solution to integrate the actual state of your Omnik power inverter in to your favorite home automation system. The script reads out omnikportal.com using your credentials and enables you process the real time data of your solar plant.
The realetime output can be forwared to pvoutput.com or send over MQTT to your favorite Home Automation porject. The MQTT implementation supports the Home Assistant Automatic MQTT discovery.

You can run the script from the command line, use systemd or make use of AppDaemon so you can integrate directly with Home Assistent.

Have fun! Let me know your experience if you have any issues.

You can download the release here.

omnik-data-logger

https://github.com/jbouwh/omnikdatalogger

Some time ago I found this https://github.com/paprins/omnik-data-logger/ at github. A python based project to read out the statistics from https://www.omnikportal.com/. I own an inverter of Omnik (Omniksol-3.0-TL) and was installed october 2012. Pascal Prins, the author implemented a plugin based logger with a working example for pvoutput.org.

Issue fixed

Pascals code had some issues, and I decided to report them. In de mean wile I went on with a clone copy of the project, fixed some issues and optimized the code.

AppDaemon and Home Assistant integration with MQTT

I wrote an additional plugin (mqtt) to enable an easy integration with Home Assistant or any other MQTT based home automation solution.

The AppDaemon integration further enables updating the config without the need to restart.

New version at github

After integration with AppDaemon I ended up with an alternative that can be configured with AppDaemon through apps.yaml. The logging was adapted so it supports the AppDaemon logging system. When using the command line native logging is used.

I submitted the new code to github and did a pull request.

See: https://github.com/jbouwh/omnikdatalogger

Using MQTT Auto discovery logging now can be easily integrated with Home Assistant.