{"id":39,"date":"2020-05-15T16:23:21","date_gmt":"2020-05-15T14:23:21","guid":{"rendered":"https:\/\/jbsoft.nl\/site\/?page_id=39"},"modified":"2021-06-09T13:40:07","modified_gmt":"2021-06-09T11:40:07","slug":"omnik-datalogger","status":"publish","type":"page","link":"https:\/\/jbsoft.nl\/site\/omnik-datalogger\/","title":{"rendered":"Omnik datalogger"},"content":{"rendered":"\n<p>Omnik datalogger is <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/jbouwh\/omnikdatalogger\" target=\"_blank\">my solar project on Github<\/a> that enables you to do more with your Omnik Solar System logging. The manual page\/documentation has been updated and there is a now a <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/jbouwh\/omnikdatalogger\/wiki\" target=\"_blank\">wiki<\/a> for more information (Note: The wiki is still onder development).  Thanks to Pascal Prins who&#8217;s wrote the initial <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/paprins\/omnik-data-logger\" target=\"_blank\">code base<\/a>. His project used the <strong>omnik portal<\/strong> API, which now is no longer available. Many installed a Omniksolar PV system with a wireless datalogger to enable reporting at <a rel=\"noreferrer noopener\" href=\"https:\/\/www.omnikportal.com\" target=\"_blank\">https:\/\/www.omnikportal.com<\/a>. Over the years this portal supplied reporting for your Omnik solar system. Now this functionality is still available at <a rel=\"noreferrer noopener\" href=\"https:\/\/www.solarmanpv.com\/portal\" target=\"_blank\">https:\/\/www.solarmanpv.com\/portal<\/a>. Many users now have a home automation system installed and want to do more with their solar data. Others want to use other reportings tools that process there solar power data. Omnik datalogger can help you achieve this. Omnikdatalogger can export Omnik inverter data to <a rel=\"noreferrer noopener\" href=\"https:\/\/pvoutput.org\/\" target=\"_blank\">pvoutput <\/a>, an Influxdb database or publish at an MQTT broker. For <a rel=\"noreferrer noopener\" href=\"https:\/\/www.home-assistant.io\/\" target=\"_blank\">Home Assistant<\/a> auto discovery is supported.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"730\" src=\"https:\/\/jbsoft.nl\/site\/wp-content\/uploads\/2020\/07\/image-2-1024x730.png\" alt=\"\" class=\"wp-image-176\" srcset=\"https:\/\/jbsoft.nl\/site\/wp-content\/uploads\/2020\/07\/image-2-1024x730.png 1024w, https:\/\/jbsoft.nl\/site\/wp-content\/uploads\/2020\/07\/image-2-300x214.png 300w, https:\/\/jbsoft.nl\/site\/wp-content\/uploads\/2020\/07\/image-2-768x548.png 768w, https:\/\/jbsoft.nl\/site\/wp-content\/uploads\/2020\/07\/image-2.png 1367w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/figure>\n\n\n\n<h4 class=\"wp-block-heading\">How does it work<\/h4>\n\n\n\n<p>Omnik datalogger can retrieve the data from the SolarmanPV portal (the infrastructure behind Omnik portal). You can register your inverter on Solarman portal to be able to use this software using the build-in the portal clients, but you can also use omnikdatalogger without the portal . Some older Omnik inverters doe not have a possibility to get the data directly, some types do, but if not the portal seems the only place you can collect the submitted data. My inverter (installed October 2012) is of that older type, and cannot be accessed directly to get the actual data. All Omnik inverters sends an update to a fixed IP &#8216;176.58.117.69&#8217; about every 5 minutes (approx. 310 seconds). This IP address seems to be part of infrastructure the Solarman. <a href=\"https:\/\/jbsoft.nl\/site\/omnik-datalogger\/logger-interception-using-omnik-datalogger\/\">Omnikdatalogger can intercept this traffic<\/a> using the <strong>localproxy<\/strong> client. This will completely bypass the Solarman infrastructure, but needs some advances skills.<\/p>\n\n\n\n<h5 class=\"wp-block-heading\">Using tcpclient<\/h5>\n\n\n\n<p>If you own a newer inverter (introduced in 2013 or later) that supports local readout at port 8899, you are advised to try the <strong>tcpclient.<\/strong> This will enable polling your inverter as many times as you want, not being limitted to a 5 minute interval. A big advantage is that you will not rely on the SolarmanPV infrastructure. Further you do not need to intercept the network traffic, which requires advanced skills. If your Omnik WiFi logger is supported, you now can use the buit-in tcpclient to poll your inverter directly. Not all inverters support this method, but is worth it to try this method first before switching to interception. Thanks to Han Lubach this method could be tested. If you have any problems or questions, please let me know!<\/p>\n\n\n\n<h5 class=\"wp-block-heading\">Intercept the logger data with localproxy client<\/h5>\n\n\n\n<p>The inverter sends data updates to the fixed IP<em> &#8216;176.58.117.69&#8217; <\/em>that can be intercepted on your local network. The traffic is not encrypted and is decodable using the <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/Woutrrr\/Omnik-Data-Logger\" target=\"_blank\">Omnik-Data-Loger project of Wouter van der Zwan<\/a>. The <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/t3kpunk\/Omniksol-PV-Logger\" target=\"_blank\">code to intercept I have adapted from t3kpunk at Github<\/a>. An <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/jbouwh\/omnikdataloggerproxy\/\" target=\"_blank\">additional proxy script<\/a> will help to support this. My logger sends updates approximately every 305 seconds. <\/p>\n\n\n\n<p>The new <strong>localproxy <\/strong>client together with this proxy script will help to set this up. This new client has 3 plugins (hassap, mqtt_proxy and tcp_proxy) and integrates with the proxy script through AppDaemon and Home Assistant with the <strong>hassapi <\/strong>client plugin. The <strong>mqtt_proxy<\/strong> client plugin allows to montor MQTT for the changes of the proxy script. Direct logging is supported  using the <strong>tcp_proxy<\/strong> client plugin.<\/p>\n\n\n\n<p><a href=\"https:\/\/jbsoft.nl\/site\/omnik-datalogger\/logger-interception-using-omnik-datalogger\/\">Read more here about intercepting.<\/a><\/p>\n\n\n\n<h5 class=\"wp-block-heading\">Using Solarman PV API (fallback)<\/h5>\n\n\n\n<p>Solarman still provides the data logging for omnik portal users with the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.solarmanpv.com\/portal\/LoginPage.aspx\" target=\"_blank\">portal at SolarMAN<\/a>. Solarman announced that it will be providing this service for free till the end of the year. But the period after that is still unclear. The <a rel=\"noreferrer noopener\" href=\"https:\/\/www.solarmanpv.com\/portal\/LoginPage.aspx\" target=\"_blank\">portal at SolarMAN<\/a> can still be accessed using the same login credentials that ware used at the Omnik portal. There is 1 API&#8217;s Omnik datalogger supports to fetch the data collected from your inverter.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>solarmanpv<\/strong> client http:\/\/www.solarmanpv.com:18000\/SolarmanApi\/serverapi<\/li><\/ul>\n\n\n\n<p>The <strong>solarmanpv<\/strong> API has one disadvantage: The API is not secure. On every API call, the password needs to be supplied. This API enables to readout the inverters serial number but wel will need to specify the plant ID. Fortunately this value can be found in the URL when you log into the portal:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p>https:\/\/www.solarmanpv.com\/portal\/Terminal\/TerminalMain.aspx?pid=<strong>plant_id<\/strong><\/p><cite>Fortunately this value can be found in the URL when you log into the portal<\/cite><\/blockquote>\n\n\n\n<p>Getting your logger data using these API&#8217;s has some disadvantages:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>You need to poll at an interval of about 310 seconds, but it make take longer before the data becomes available.<\/li><li>The API might be down or show the last value.<\/li><li>No secure access.<\/li><\/ul>\n\n\n\n<p><a href=\"https:\/\/jbsoft.nl\/site\/omnik-datalogger\/omnik-datalogger-architecture\/\">This architecture view show how the application works and how the different clients and plugins work<\/a><\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Support voor Dutch Smart Meter (P1 port)<\/h4>\n\n\n\n<p>The latest version of Omnik data logger now has possibility to calculate consumption data  using the DSMR P1 port. This meter is applied in the Netherland and Belgium and provides in my case net power statistics (every 10 seconds) and gas statistics (every 5 minutes). The combination with the Omnik solar data makes it possible to calculate the enegry and power consumption. Additional direct use and total consumption can be calculated and published to Influx DB of MQTT. With MQTT Home Assistants MQTT auto discovery is supported.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">PVoutput.org<\/h4>\n\n\n\n<p>PVoutput.org is modern and free portal for owners of a PV-system. It is quite popular, and many users send there solar data to this portal. Omnik data logger enables you to send your realtime data to pvoutput.org. With direct access inverter temperature and voltage can be supplied as well. With the brand new DSMR integration, now you can also send your energy consumption data!<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">MQTT output<\/h4>\n\n\n\n<p>When you have a home automation system setup like Home Assistant, OpenHAB or Domiticz your are probably familiar with MQTT. This IoT messaging bus protocal enables easy automation using your realtime data as a sensor. Omik datalogger can produce MQTT sensors (including DSMR en DSMR gas entities and combined consumption data) which automatically can be discovered by Home Assistance (MQTT auto discovery) and of course can be used with your favorite MQTT supporting home automation system<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">InfluxDB<\/h4>\n\n\n\n<p>Support dor InfluxDB have been added, and is now available. Thanks to <a href=\"https:\/\/github.com\/lepirlouit\/omnik-data-logger\">lepirlouit<\/a>. DSMR data and combined consumption data can also be logged to InfluxDB. <\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Installing Omnik data logger<\/h3>\n\n\n\n<h4 class=\"wp-block-heading\">HACS Compliant<\/h4>\n\n\n\n<p>Home Assistant Community Store is the community store plugin for Home Assistant. Omnik datalogger is included in the default HACS store.  To install Omnik Datalogger with the Home Assistant Community Store <a href=\"https:\/\/hacs.xyz\/\" target=\"_blank\" rel=\"noreferrer noopener\">HACS<\/a>. <\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Install the official AppDaemon plugin from the Home Assistant store.<\/li><li>Install HACS (see <a rel=\"noreferrer noopener\" href=\"https:\/\/hacs.xyz\/\" target=\"_blank\">HACS<\/a> website)<\/li><li>Select Automations and add an automation.<\/li><li>Find Omnik Data Logger and install it<\/li><\/ul>\n\n\n\n<p>Before you can use Omnik Data Logger via AppDaemon\/HACS make sure you prepare the yaml configuration (\/config\/appdaemon\/apps\/apps.yaml). After performing updates to your configuration or after a software update do not forget to restart AppDaemon an check the log. <\/p>\n\n\n\n<p>For more details on installation and configuration see the Github <a href=\"https:\/\/github.com\/jbouwh\/omnikdatalogger\">homepage <\/a>and <a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/jbouwh\/omnikdatalogger\/wiki\" target=\"_blank\">wiki <\/a>of the project.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Docker builds<\/h4>\n\n\n\n<p>Docker builds for omnik data logger and the proxy script are available:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Omnik data logger: jbouwh\/omnikdatalogger:latest<\/li><li>Omnik data logger proxy: jbouwh\/omnikdataloggerproxy:latest<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Install using PIP<\/h4>\n\n\n\n<p>If you have a local Python environment you can use pip.<\/p>\n\n\n\n<p>Omnik data logger: <strong>pip3 install omnikdatalogger<\/strong> or <strong>python -m pip3 install omnikdatalogger<\/strong><\/p>\n\n\n\n<p>Omnik data logger proxy: <strong>pip3 install omnikdataloggerproxy<\/strong> or <strong>python -m pip3 install omnikdataloggerproxy<\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>Homepage omnik datalogger &amp; omnikdataloggerproxy<\/td><td><a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/jbouwh\/omnikdatalogger\" target=\"_blank\">https:\/\/github.com\/jbouwh\/omnikdatalogger<\/a><br><a href=\"https:\/\/github.com\/jbouwh\/omnikdataloggerproxy\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/github.com\/jbouwh\/omnikdataloggerproxy<\/a><\/td><\/tr><tr><td>wiki<\/td><td><a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/jbouwh\/omnikdatalogger\/wiki\" target=\"_blank\">https:\/\/github.com\/jbouwh\/omnikdatalogger\/wiki<\/a><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Omnik datalogger is my solar project on Github that enables you to do more with your Omnik Solar System logging. The manual page\/documentation has been updated and there is a now a wiki for more information (Note: The wiki is still onder development). Thanks to Pascal Prins who&#8217;s wrote the initial code base. His project &hellip; <a href=\"https:\/\/jbsoft.nl\/site\/omnik-datalogger\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Omnik datalogger&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-39","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/jbsoft.nl\/site\/wp-json\/wp\/v2\/pages\/39","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jbsoft.nl\/site\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/jbsoft.nl\/site\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/jbsoft.nl\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jbsoft.nl\/site\/wp-json\/wp\/v2\/comments?post=39"}],"version-history":[{"count":23,"href":"https:\/\/jbsoft.nl\/site\/wp-json\/wp\/v2\/pages\/39\/revisions"}],"predecessor-version":[{"id":373,"href":"https:\/\/jbsoft.nl\/site\/wp-json\/wp\/v2\/pages\/39\/revisions\/373"}],"wp:attachment":[{"href":"https:\/\/jbsoft.nl\/site\/wp-json\/wp\/v2\/media?parent=39"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}