problems with summary.py

[Bluhme1]

In running summary.py I get only headlines. No data. But when I run dailystats.py I get all data. Tried to run debug.py and got python debug.py

     tire_pressure_front_right_warning_is_on=False,
     tire_pressure_rear_right_warning_is_on=False,
     _next_service_distance=None,
     _next_service_distance_value=None,
     _next_service_distance_unit=None,
     _last_service_distance=None,
     _last_service_distance_value=None,
     _last_service_distance_unit=None,
     _location_latitude=55.977997,
     _location_longitude=10.169544,
     _location_last_set_time=datetime.datetime
    (
        2023,
         4,
         11,
         13,
         13,
         33,
         tzinfo=tzfile
        (
            '/usr/share/zoneinfo/Europe/Berlin'
        )
    ),
     ev_charge_port_door_is_open=None,
     ev_charge_limits_dc=100,
     ev_charge_limits_ac=100,
     total_power_consumed=49918,
     power_consumption_30d=146,
     daily_stats=
    [
        DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 11,
                 0,
                 0
            ),
             total_consumed=808,
             engine_consumption=495,
             climate_consumption=193,
             onboard_electronics_consumption=120,
             battery_care_consumption=0,
             regenerated_energy=684,
             distance=5
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 8,
                 0,
                 0
            ),
             total_consumed=6520,
             engine_consumption=4928,
             climate_consumption=272,
             onboard_electronics_consumption=1320,
             battery_care_consumption=0,
             regenerated_energy=3730,
             distance=51
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 7,
                 0,
                 0
            ),
             total_consumed=7843,
             engine_consumption=6918,
             climate_consumption=435,
             onboard_electronics_consumption=490,
             battery_care_consumption=0,
             regenerated_energy=4041,
             distance=63
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 6,
                 0,
                 0
            ),
             total_consumed=1331,
             engine_consumption=375,
             climate_consumption=156,
             onboard_electronics_consumption=800,
             battery_care_consumption=0,
             regenerated_energy=428,
             distance=3
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 5,
                 0,
                 0
            ),
             total_consumed=7311,
             engine_consumption=5582,
             climate_consumption=389,
             onboard_electronics_consumption=1340,
             battery_care_consumption=0,
             regenerated_energy=4418,
             distance=54
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 4,
                 0,
                 0
            ),
             total_consumed=17822,
             engine_consumption=15981,
             climate_consumption=661,
             onboard_electronics_consumption=1180,
             battery_care_consumption=0,
             regenerated_energy=9552,
             distance=153
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 3,
                 0,
                 0
            ),
             total_consumed=3925,
             engine_consumption=3403,
             climate_consumption=122,
             onboard_electronics_consumption=400,
             battery_care_consumption=0,
             regenerated_energy=2539,
             distance=35
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 2,
                 0,
                 0
            ),
             total_consumed=1994,
             engine_consumption=1185,
             climate_consumption=9,
             onboard_electronics_consumption=800,
             battery_care_consumption=0,
             regenerated_energy=1331,
             distance=8
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 4,
                 1,
                 0,
                 0
            ),
             total_consumed=2364,
             engine_consumption=1510,
             climate_consumption=164,
             onboard_electronics_consumption=690,
             battery_care_consumption=0,
             regenerated_energy=1516,
             distance=11
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 31,
                 0,
                 0
            ),
             total_consumed=1745,
             engine_consumption=1045,
             climate_consumption=0,
             onboard_electronics_consumption=700,
             battery_care_consumption=0,
             regenerated_energy=830,
             distance=10
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 30,
                 0,
                 0
            ),
             total_consumed=44366,
             engine_consumption=42124,
             climate_consumption=482,
             onboard_electronics_consumption=1760,
             battery_care_consumption=0,
             regenerated_energy=8754,
             distance=333
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 29,
                 0,
                 0
            ),
             total_consumed=14090,
             engine_consumption=11025,
             climate_consumption=1395,
             onboard_electronics_consumption=1670,
             battery_care_consumption=0,
             regenerated_energy=6376,
             distance=96
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 28,
                 0,
                 0
            ),
             total_consumed=12163,
             engine_consumption=10262,
             climate_consumption=1041,
             onboard_electronics_consumption=860,
             battery_care_consumption=0,
             regenerated_energy=6123,
             distance=100
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 27,
                 0,
                 0
            ),
             total_consumed=8622,
             engine_consumption=6450,
             climate_consumption=942,
             onboard_electronics_consumption=1230,
             battery_care_consumption=0,
             regenerated_energy=3753,
             distance=55
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 26,
                 0,
                 0
            ),
             total_consumed=830,
             engine_consumption=424,
             climate_consumption=6,
             onboard_electronics_consumption=400,
             battery_care_consumption=0,
             regenerated_energy=372,
             distance=4
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 25,
                 0,
                 0
            ),
             total_consumed=13921,
             engine_consumption=12801,
             climate_consumption=350,
             onboard_electronics_consumption=770,
             battery_care_consumption=0,
             regenerated_energy=5521,
             distance=95
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 24,
                 0,
                 0
            ),
             total_consumed=7768,
             engine_consumption=6638,
             climate_consumption=350,
             onboard_electronics_consumption=780,
             battery_care_consumption=0,
             regenerated_energy=4052,
             distance=64
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 23,
                 0,
                 0
            ),
             total_consumed=41922,
             engine_consumption=40198,
             climate_consumption=734,
             onboard_electronics_consumption=990,
             battery_care_consumption=0,
             regenerated_energy=4140,
             distance=295
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 22,
                 0,
                 0
            ),
             total_consumed=3083,
             engine_consumption=1663,
             climate_consumption=520,
             onboard_electronics_consumption=900,
             battery_care_consumption=0,
             regenerated_energy=1640,
             distance=12
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 21,
                 0,
                 0
            ),
             total_consumed=10579,
             engine_consumption=8245,
             climate_consumption=1034,
             onboard_electronics_consumption=1300,
             battery_care_consumption=0,
             regenerated_energy=4142,
             distance=75
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 20,
                 0,
                 0
            ),
             total_consumed=3265,
             engine_consumption=1738,
             climate_consumption=227,
             onboard_electronics_consumption=1300,
             battery_care_consumption=0,
             regenerated_energy=1885,
             distance=12
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 19,
                 0,
                 0
            ),
             total_consumed=1502,
             engine_consumption=740,
             climate_consumption=302,
             onboard_electronics_consumption=460,
             battery_care_consumption=0,
             regenerated_energy=765,
             distance=6
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 18,
                 0,
                 0
            ),
             total_consumed=6364,
             engine_consumption=5041,
             climate_consumption=403,
             onboard_electronics_consumption=920,
             battery_care_consumption=0,
             regenerated_energy=3205,
             distance=48
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 17,
                 0,
                 0
            ),
             total_consumed=33346,
             engine_consumption=30635,
             climate_consumption=1121,
             onboard_electronics_consumption=1010,
             battery_care_consumption=580,
             regenerated_energy=6997,
             distance=197
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 16,
                 0,
                 0
            ),
             total_consumed=26423,
             engine_consumption=24800,
             climate_consumption=1083,
             onboard_electronics_consumption=540,
             battery_care_consumption=0,
             regenerated_energy=3833,
             distance=146
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 15,
                 0,
                 0
            ),
             total_consumed=827,
             engine_consumption=424,
             climate_consumption=3,
             onboard_electronics_consumption=400,
             battery_care_consumption=0,
             regenerated_energy=279,
             distance=2
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 14,
                 0,
                 0
            ),
             total_consumed=6372,
             engine_consumption=5245,
             climate_consumption=587,
             onboard_electronics_consumption=540,
             battery_care_consumption=0,
             regenerated_energy=2530,
             distance=41
        ),
         DailyDrivingStats
        (
            date=datetime.datetime
            (
                2023,
                 3,
                 13,
                 0,
                 0
            ),
             total_consumed=1854,
             engine_consumption=1140,
             climate_consumption=314,
             onboard_electronics_consumption=400,
             battery_care_consumption=0,
             regenerated_energy=717,
             distance=10
        )
    ],
     month_trip_info=None,
     day_trip_info=None,
     ev_battery_percentage=98,
     ev_battery_is_charging=False,
     ev_battery_is_plugged_in=0,
     _ev_driving_range=431.0,
     _ev_driving_range_value=431.0,
     _ev_driving_range_unit='km',
     _ev_estimated_current_charge_duration=0,
     _ev_estimated_current_charge_duration_value=0,
     _ev_estimated_current_charge_duration_unit='m',
     _ev_estimated_fast_charge_duration=2,
     _ev_estimated_fast_charge_duration_value=2,
     _ev_estimated_fast_charge_duration_unit='m',
     _ev_estimated_portable_charge_duration=35,
     _ev_estimated_portable_charge_duration_value=35,
     _ev_estimated_portable_charge_duration_unit='m',
     _ev_estimated_station_charge_duration=2,
     _ev_estimated_station_charge_duration_value=2,
     _ev_estimated_station_charge_duration_unit='m',
     _ev_target_range_charge_AC=437,
     _ev_target_range_charge_AC_value=437,
     _ev_target_range_charge_AC_unit='km',
     _ev_target_range_charge_DC=437,
     _ev_target_range_charge_DC_value=437,
     _ev_target_range_charge_DC_unit='km',
     ev_first_departure_enabled=False,
     ev_second_departure_enabled=False,
     ev_first_departure_days=
    [
        0,
         1,
         2,
         3,
         4,
         5,
         6
    ],
     ev_second_departure_days=
    [
        0,
         1,
         2,
         3,
         4,
         5,
         6
    ],
     ev_first_departure_time=datetime.time
    (
        8,
         0
    ),
     ev_second_departure_time=datetime.time
    (
        10,
         0
    ),
     ev_off_peak_start_time=datetime.time
    (
        0,
         0
    ),
     ev_off_peak_end_time=datetime.time
    (
        0,
         0
    ),
     ev_off_peak_charge_only_enabled=None,
     _fuel_driving_range=None,
     _fuel_driving_range_value=None,
     _fuel_driving_range_unit=None,
     fuel_level=None,
     fuel_level_is_low=None,
     engine_type=<ENGINE_TYPES.EV: 'EV'>,
     data=
    {
        'vehicleLocation': 
        {
            'coord': 
            {
                'lat': 55.977997,
                 'lon': 10.169544,
                 'alt': 0,
                 'type': 0
            },
             'head': 257,
             'speed': 
            {
                'value': 0,
                 'unit': 0
            },
             'accuracy': 
            {
                'hdop': 0,
                 'pdop': 0
            },
             'time': '20230411131333'
        },
         'vehicleStatus': 
        {
            'airCtrlOn': False,
             'engine': False,
             'doorLock': False,
             'doorOpen': 
            {
                'frontLeft': 0,
                 'frontRight': 0,
                 'backLeft': 0,
                 'backRight': 0
            },
             'trunkOpen': False,
             'airTemp': 
            {
                'value': '02H',
                 'unit': 0,
                 'hvacTempType': 1
            },
             'defrost': False,
             'acc': False,
             'evStatus': 
            {
                'batteryCharge': False,
                 'batteryStatus': 98,
                 'batteryPlugin': 0,
                 'remainTime2': 
                {
                    'etc1': 
                    {
                        'value': 2,
                         'unit': 1
                    },
                     'etc2': 
                    {
                        'value': 35,
                         'unit': 1
                    },
                     'etc3': 
                    {
                        'value': 2,
                         'unit': 1
                    },
                     'atc': 
                    {
                        'value': 0,
                         'unit': 1
                    }
                },
                 'drvDistance': 
                [
                    
                    {
                        'rangeByFuel': 
                        {
                            'evModeRange': 
                            {
                                'value': 431,
                                 'unit': 1
                            },
                             'totalAvailableRange': 
                            {
                                'value': 431,
                                 'unit': 1
                            }
                        },
                         'type': 2
                    }
                ],
                 'reservChargeInfos': 
                {
                    'reservChargeInfo': 
                    {
                        'reservChargeInfoDetail': 
                        {
                            'reservInfo': 
                            {
                                'day': 
                                [
                                    0,
                                     1,
                                     2,
                                     3,
                                     4,
                                     5,
                                     6
                                ],
                                 'time': 
                                {
                                    'time': '0800',
                                     'timeSection': 0
                                }
                            },
                             'reservChargeSet': False,
                             'reservFatcSet': 
                            {
                                'defrost': False,
                                 'airTemp': 
                                {
                                    'value': '14H',
                                     'unit': 0,
                                     'hvacTempType': 1
                                },
                                 'airCtrl': 0,
                                 'heating1': 0
                            }
                        }
                    },
                     'offpeakPowerInfo': 
                    {
                        'offPeakPowerTime1': 
                        {
                            'starttime': 
                            {
                                'time': '1200',
                                 'timeSection': 0
                            },
                             'endtime': 
                            {
                                'time': '1200',
                                 'timeSection': 0
                            }
                        },
                         'offPeakPowerFlag': 0
                    },
                     'reserveChargeInfo2': 
                    {
                        'reservChargeInfoDetail': 
                        {
                            'reservInfo': 
                            {
                                'day': 
                                [
                                    0,
                                     1,
                                     2,
                                     3,
                                     4,
                                     5,
                                     6
                                ],
                                 'time': 
                                {
                                    'time': '1000',
                                     'timeSection': 0
                                }
                            },
                             'reservChargeSet': False,
                             'reservFatcSet': 
                            {
                                'defrost': False,
                                 'airTemp': 
                                {
                                    'value': '14H',
                                     'unit': 0,
                                     'hvacTempType': 1
                                },
                                 'airCtrl': 0,
                                 'heating1': 0
                            }
                        }
                    },
                     'reservFlag': 0,
                     'ect': 
                    {
                        'start': 
                        {
                            'day': 9,
                             'time': 
                            {
                                'time': '1200',
                                 'timeSection': 0
                            }
                        },
                         'end': 
                        {
                            'day': 9,
                             'time': 
                            {
                                'time': '1200',
                                 'timeSection': 0
                            }
                        }
                    },
                     'targetSOClist': 
                    [
                        
                        {
                            'targetSOClevel': 100,
                             'dte': 
                            {
                                'rangeByFuel': 
                                {
                                    'evModeRange': 
                                    {
                                        'value': 437,
                                         'unit': 1
                                    },
                                     'totalAvailableRange': 
                                    {
                                        'value': 437,
                                         'unit': 1
                                    }
                                },
                                 'type': 2
                            },
                             'plugType': 0
                        },
                         
                        {
                            'targetSOClevel': 100,
                             'dte': 
                            {
                                'rangeByFuel': 
                                {
                                    'evModeRange': 
                                    {
                                        'value': 437,
                                         'unit': 1
                                    },
                                     'totalAvailableRange': 
                                    {
                                        'value': 437,
                                         'unit': 1
                                    }
                                },
                                 'type': 2
                            },
                             'plugType': 1
                        }
                    ]
                }
            },
             'ign3': False,
             'hoodOpen': False,
             'transCond': True,
             'steerWheelHeat': 0,
             'sideBackWindowHeat': 0,
             'tirePressureLamp': 
            {
                'tirePressureLampAll': 0,
                 'tirePressureLampFL': 0,
                 'tirePressureLampFR': 0,
                 'tirePressureLampRL': 0,
                 'tirePressureLampRR': 0
            },
             'battery': 
            {
                'batSoc': 84,
                 'batState': 0
            },
             'lampWireStatus': 
            {
                'stopLamp': 
                {
                    'stopLampStatus': False,
                     'leftLamp': False,
                     'rightLamp': False
                },
                 'headLamp': 
                {
                    'headLampStatus': False,
                     'leftLowLamp': False,
                     'rightLowLamp': False,
                     'leftHighLamp': False,
                     'rightHighLamp': False,
                     'leftBifuncLamp': False,
                     'rightBifuncLamp': False
                },
                 'turnSignalLamp': 
                {
                    'turnSignalLampStatus': False,
                     'leftFrontLamp': False,
                     'rightFrontLamp': False,
                     'leftRearLamp': False,
                     'rightRearLamp': False
                }
            },
             'smartKeyBatteryWarning': False,
             'breakOilStatus': False,
             'sleepModeCheck': True,
             'time': '20230411131335',
             'remoteWaitingTimeAlert': 
            {
                'remoteControlAvailable': 1,
                 'remoteControlWaitingTime': 168,
                 'elapsedTime': '00:03:04'
            },
             'systemCutOffAlert': 0,
             'tailLampStatus': 0,
             'hazardStatus': 0
        },
         'odometer': 
        {
            'value': 0,
             'unit': 1
        }
    }
)

}
targetSOClist:

[

{
    'targetSOClevel': 100,
     'dte': 
    {
        'rangeByFuel': 
        {
            'evModeRange': 
            {
                'value': 437,
                 'unit': 1
            },
             'totalAvailableRange': 
            {
                'value': 437,
                 'unit': 1
            }
        },
         'type': 2
    },
     'plugType': 0
},
 
{
    'targetSOClevel': 100,
     'dte': 
    {
        'rangeByFuel': 
        {
            'evModeRange': 
            {
                'value': 437,
                 'unit': 1
            },
             'totalAvailableRange': 
            {
                'value': 437,
                 'unit': 1
            }
        },
         'type': 2
    },
     'plugType': 1
}

]
Summary:
Target SOC level : 100
Target SOC range : 437
Target SOC level : 100
Target SOC range : 437
Last updated at : 2023-04-11 13:13:35+02:00
Location Last updated at: 2023-04-11 13:13:33+02:00
Location : (10.169544, 55.977997)
Air temperature : 15.0
Driving range : 431.0
Charge limits AC : 100
Charge limits DC : 100
Odometer : 0
Total driving range : 431.0
Battery SOC : 98
12V percentage : 84
Locked : False

[ZuinigeRijder]

You should regularly run monitor.py which will write to monitor.csv.
summary.py will use the data of monitor.csv.
What is inside monitor.csv?

[Bluhme1]

Monitor.csv has the correct data. (Compared to the data sent by dailystats.py.) I think the problem is in summary.py somewhere. In summary.csv I only get the headlines. Have tried to change language from “da” to “en” and back And thanks for a fine program. I love to go deep in data to become wiser Lars Bluhme

…

________________________________ Fra: Zuinige Rijder ***@***.***> Sendt: Tuesday, April 11, 2023 1:36:36 PM Til: ZuinigeRijder/hyundai_kia_connect_monitor ***@***.***> Cc: Lars Bluhme ***@***.***>; Author ***@***.***> Emne: Re: [ZuinigeRijder/hyundai_kia_connect_monitor] problems with summary.py (Issue #51) You should regularly run monitor.py which will write to monitor.csv. summary.py will use the data of monitor.csv. What is inside monitor.csv? — Reply to this email directly, view it on GitHub<#51 (comment)>, or unsubscribe</~https://github.com/notifications/unsubscribe-auth/AMACE6QAONG7IFSD63KJ5ILXAU64JANCNFSM6AAAAAAW2ESXOQ>. You are receiving this because you authored the thread.Message ID: ***@***.***>

[ZuinigeRijder]

Did you give parameters to summary.py?
Are the following files empty?

summary.charge.csv
summary.day.csv
summary.trip.csv

Can you post the (anonymized) contents of monitor.csv? I assume you are in the same directory as were monitor.csv is stored? You may also send this by email, I use a gmail account, zuinige.rijder

And what is the output when you run:
python summary.py debug

[Bluhme1]

Hello again

Found out.

In my data the odometer value is 0.0. I think it is a bug in the newest upgrade to hyundai software. When the car stops the value of odometer in the app shows 0.0. If you get a reading while the car runs, I think you get a true value

Anyway, apparently the code in summary.py will not accept 0.0 as value in odometer and stops running.

So either you can only get updates from the car with the engine running or you can accept in the code of summary.py that the value of odometer is 0.0

Hope that makes sense

Yours

Lars

[ZuinigeRijder]

Hi Lars,

Indeed is that the problem. I had this problem too on the IONIQ 5. See this issue:

Hyundai-Kia-Connect/hyundai_kia_connect_api#196 (comment)

NE_E.EUR.S5W_L.001.001.221129 on December 6th for IONIQ5:
https://update.hyundai.com/EU/E1/updateNoticeView/623/pop2

and it was solved with version 221223:
Hyundai-Kia-Connect/hyundai_kia_connect_api#196 (comment)

Which car do you have? Probably this is also fixed when updating the infotainment version to the latest version.

[Bluhme1]

I have a Kona Electric with sw: OS_E_PE.EUR.S5W_L.001.001.221129. Looks like it is a bit older than yours. But the installer (Navigation Updater) finds this one. I will be looking for a new update.
Meanwhile I will perform an python monitor.py while the engine is running.
Closing this issue and thank you

[Bluhme1]

By the way. Do you know where I can find the newest firmware for my Kona. When I follow the “official” way I get the version from November 2022

[ZuinigeRijder]

I have a Kona Electric with sw: OS_E_PE.EUR.S5W_L.001.001.221129. Looks like it is a bit older than yours. But the installer (Navigation Updater) finds this one. I will be looking for a new update.

There is also for the Kona a version 221223, see this link:
https://update.hyundai.com/EU/E1/updateNoticeView/623/pop2

Just download the latest version, you will see inside the Kona_EU.ver the version 221223.

[Bluhme1]

You are right. Performed an update and installed 122322. Now everything works.
Thank you very much
/Lars

[Bluhme1]

Hi @ZuinigeRijder
Now New Year is getting closer.
I would like to reset my data so that I can start collecting data the first of January and in this way register data from a whole year - 2024.
Can you help me with a solution
Thanks
Lars

[ZuinigeRijder]

@Bluhme1 Just move at 1 january 2024 all the csv files (*.csv) to a backup folder (e.g. 2023) , maybe you want to look back to those results in the future. But do NOT move monitor.translations.csv.

Possibly older data of 3 months old is recreated for monitor.tripinfo.csv and monitor.dailystats.csv. You can also just remove manually all the entries with 2023 in all the csv files, when 2024 data is added or when you moved the *.csv files too late to another location (and you would miss some days from 2024).

[Bluhme1]

Thanks a lot. Will do that tomorrow.
And thanks for your work with this program. I use it a lot
Lars

[Bluhme1]

@ZuinigeRijder
Hi again. Trying to configure the new MQTT option. Don't get anything in MQTT explorer. Think the problem lies in the monitor.cfg. I use 192.168.86.152 as my localhost and have correct username and pw. Does this look right? The MQTT broker is the add-on used in Homeassistant and the ip address is the local home assistant instance

[MQTT]
send_to_mqtt = True
mqtt_broker_hostname = 192.168.86.152
mqtt_broker_port = 1883
mqtt_broker_username = xxxx
mqtt_broker_password = xxxx
mqtt_main_topic = hyundai_kia_connect_monitor

/Lars

[ZuinigeRijder]

@Bluhme1 It looks ok. Note that only when there is something added in monitor.csv, monitor.tripinfo.csv and/or monitor.dailystats.csv the corresponding line is splitted and send to MQTT. You can trigger this testing by e.g. removing the last line of monitor.csv , monitor.tripinfo.csv and/or monitor.dailystats.csv.

I did only test with a test server, because I do not have HA. Let me know if this was the problem, otherwise we have to dig deeper. Does it work with test.mosquitto.org?

[Bluhme1]

@ZuinigeRijder Everything works now. Great and thank you. I have succeeded in getting data into my MQTT broker (which is an add-on in HomeAssistant). From there I have made MQTT sensors the manual way. I enclose af few screenshots to show my results

I have made a few changes in the yaml code of the manual sensors to streamline the data a bit. (Using kwh as measure unit and showing dates and times in the way we do in Denmark)

If you plan to make the Homeassistant experience even better you can perhaps make the sensors "discoverable" so that Homeassistant picks them up automatically when they appear in the MQTT broker.
I'm sure that it would be possible with your skills. There's is some documentation here
https://www.home-assistant.io/integrations/mqtt/#configuration-via-mqtt-discovery

But again thank you for your great work

/Lars

[ZuinigeRijder]

@Bluhme1 Thanks for the screenshots. Good to hear it worked. I will have a look into the MQTT discovery. I am also thinking about sending computed information from summary.py and/or dailystats.py to MQTT.

E.g. the few last lines of summary.py:

Period	Date	Info	Odometer	Delta km	+kWh	-kWh	km/kWh	kWh/100km	Cost Euro	SOC%	Avg	Min	Max	12V%	Avg	Min	Max	#Charging	#Trips	Range	Address
YEARLY	2024-11-09	311d	43834.7	12096.3	1872.2	-1874.7	5.7	17.6	461.17	66	56	12	100	94	87	75	255	143.2	740.6	248	"7;; Nederland"
MONTH AVG	2024-11-09	311d	43834.7	1008.0	156.0	-156.2	5.7	17.6	38.43	66	56	12	100	94	87	75	255	11.9	61.7	248	"7;; Nederland"
WEEK AVG	2024-11-09	311d	43834.7	232.0	35.9	-36.0	5.7	17.6	8.84	66	56	12	100	94	87	75	255	2.7	14.2	248	"7;; Nederland"
DAY AVG	2024-11-09	311d	43834.7	33.1	5.1	-5.1	5.7	17.6	1.26	66	56	12	100	94	87	75	255	0.4	2	248	"7;; Nederland"
TRIP AVG	2024-11-09	631t	43834.7	16.3	2.5	-2.5	5.7	17.6	0.62	66	56	12	100	94	87	75	255	0.2	1	248	"7;; Nederland"
YEAR	2024-11-09	2024	43834.7	10306.7	1595.2	-1597.3	5.7	17.6	392.94	66	56	12	100	94	87	75	255	122	631	248	"7;; Nederland"
MONTH	2024-11-09	Nov	43834.7	312.5	65.4	-51.5	5.3	18.7	12.67	66	60	30	70	94	93	88	97	3	9	248	"7;; Nederland"
WEEK	2024-11-09	WK 45	43834.7	154.8	41.8	-23.7	5.8	17.4	5.82	66	65	40	70	94	94	91	97	1	7	248	"7;; Nederland"
DAY	2024-11-09	Sat	43834.7	11.8		-2.1	5.0	20.1	0.51	66	67	66	69	94	94	94	95		2	248	"7;; Nederland"

And the totals of dailystats:

Totals	Recuperation	Consumption	Engine	Climate	Electr.	Batt.Care
1466.4kWh	385.7kWh	6km/kWh	1306kWh	34.9kWh	125.4kWh	0kWh
9979km	26.3%	16.7kWh/100km	89%	2.4%	8.6%	0%
(+1570.8kWh)	Trip	(6.4km/kWh)	Distance	Avg km/h	Max km/h	Idle
	11850min		9977km	58km/h	136km/h	1094min

However, I do not know if I should return the information unsplitted (comma seperated) or splitted per item. Do you have ideas? Which information is interesting?

[Bluhme1]

That would be great and very useful. I would clearly recommend to sent the data splittet pr. item.
The format could be "yearly xxxx-xx-xx_info", "yearly xxx-xx-xx_odometer" and so on.
And for the dailystats it could be "dailystats_totals_kwh", dailystats_totals_distance", "dailystats_trip_distance", "dailystats_totals_recuperation_kwh", "dailystats_totals_recuperation_percentage" and so on.
It will create a lot of sensors but maybe they should be made as attributes. "yearly xxx-xx-xx", "month_average", "week_average".............. could be the main sensor with all the other information as attributes. In the same way "dailystats" could be the main sensor with the input as attributes. And maybe "trip" as a main sensor, too.
In this way the users of Homeassistant can extract the sensors, they want by templating.

Just my quick response. Hope you can use it

Yours Lars

[ZuinigeRijder]

@Bluhme1 I have added sensors for summary.py and dailystats.py. See this release.

[Bluhme1]

Great. I have installed the new version and everything works fine. It is an abundance of data. Now I am starting the project of making manual MQTT entities in Homeassistant to show the data in HA. We are talking about a great number of entities, so it will take some time.
But now the data is available so it is just to get started.

Thank you , again for your great work

[Bluhme1]

After working with the new version for a while, I realize that I don't get any data from summary.py as shown in your example.
I got data from monitor.py and dailystats.py (se attachment) but none on summary.py.
I have run both monitor.py and summary.py on my Pi - both manually and via crontab - and the data is exported to the Goggle Drive as spreadsheet. Am I missing something?

[ZuinigeRijder]

@Bluhme1 Strange that it is not working for you.

Note that monitor.py entries directly below your VIN number are no longer updated, I moved this information to the subtopic hyundai_kia_connect_monitor/VIN/monitor. Probably it is better to remove the top level entries manually from MQTT Explorer.

Can you run the command:

python summary.py trip day week month year debug

This will give a lot of output, but at the end it should show the information which is send to MQTT Broker. Part of my last output with test data:

20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/MONTHAVG/trip_count = 57.6
20241126 21:05:30: DEBUG: Send 57.6 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/MONTHAVG/trip_count
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/MONTHAVG/range = 204
20241126 21:05:30: DEBUG: Send 204 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/MONTHAVG/range
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/MONTHAVG/address = "9;Kwakstraat; Duckstad; Nederland; 7054; AN"
20241126 21:05:30: DEBUG: Send "9;Kwakstraat; Duckstad; Nederland; 7054; AN" to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/MONTHAVG/address
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/date = 2023-02-19
20241126 21:05:30: DEBUG: Send 2023-02-19 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/date
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/info = 47d
20241126 21:05:30: DEBUG: Send 47d to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/info
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/odometer = 23589.5
20241126 21:05:30: DEBUG: Send 23589.5 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/odometer
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/delta_distance = 13531.4
20241126 21:05:30: DEBUG: Send 13531.4 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/delta_distance
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/kwh_charged = 2317.3
20241126 21:05:30: DEBUG: Send 2317.3 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/kwh_charged
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/kwh_discharged = -2424.4
20241126 21:05:30: DEBUG: Send -2424.4 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/kwh_discharged
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/distance_unit_per_kwh = 5.6
20241126 21:05:30: DEBUG: Send 5.6 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/distance_unit_per_kwh
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/kwh_per_100_distance_unit = 17.9
20241126 21:05:30: DEBUG: Send 17.9 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/kwh_per_100_distance_unit
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/cost = 596.40
20241126 21:05:30: DEBUG: Send 596.40 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/cost
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/soc = 57
20241126 21:05:30: DEBUG: Send 57 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/soc
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/soc_avg = 57
20241126 21:05:30: DEBUG: Send 57 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/soc_avg
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/soc_min = 19
20241126 21:05:30: DEBUG: Send 19 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/soc_min
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/soc_max = 100
20241126 21:05:30: DEBUG: Send 100 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/soc_max
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/battery12v = 84
20241126 21:05:30: DEBUG: Send 84 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/battery12v
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/battery12v_avg = 86
20241126 21:05:30: DEBUG: Send 86 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/battery12v_avg
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/battery12v_min = 76
20241126 21:05:30: DEBUG: Send 76 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/battery12v_min
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/battery12v_max = 95
20241126 21:05:30: DEBUG: Send 95 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/battery12v_max
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/charging_sessions = 139.8
20241126 21:05:30: DEBUG: Send 139.8 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/charging_sessions
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/trip_count = 691.2
20241126 21:05:30: DEBUG: Send 691.2 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/trip_count
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/range = 204
20241126 21:05:30: DEBUG: Send 204 to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/range
20241126 21:05:30: DEBUG: send_to_mqtt: hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/address = "9;Kwakstraat; Duckstad; Nederland; 7054; AN"
20241126 21:05:30: DEBUG: Send "9;Kwakstraat; Duckstad; Nederland; 7054; AN" to topic hyundai_kia_connect_monitor/KMHKR81CPNU012345/summary/YEARLY/address
20241126 21:05:30: DEBUG: Stopping MQTT

[Bluhme1]

Hi

Deleted the stale entries and ran the debug command. No mention of MQTT anywhere

debug.txt

[Bluhme1]

Maybe some help in debugging. After I deleted the posts directly below the VIN number they have returned with values today. Am I running a wrong version. The date of my summary.py is 20/11,2024

[ZuinigeRijder]

That is the same timestamp as in the latest Release R4.2.0. So the versions seems right.

What is the output of the last lines with the following command:

python summary.py

For me with the testdata, the last 11 lines of output is:

         TRIP, 2023-02-19, 17:48,  23589.5,      6.7,         ,     -0.7,    9.2,      10.8,      0.18,   57,   58,   57,   58,   84,  85,  84,  86,          ,      1,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
          DAY, 2023-02-19,   Sun,  23589.5,     13.9,     27.6,     -2.2,    6.4,      15.7,      0.54,   57,   49,   22,   60,   84,  85,  84,  86,         1,      2,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
         WEEK, 2023-02-19, WK 07,  23589.5,    452.3,     92.2,    -80.6,    5.6,      17.8,     19.82,   57,   57,   22,  100,   84,  86,  81,  90,         7,     14,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
        MONTH, 2023-02-19,   Feb,  23589.5,    590.3,    106.7,   -108.2,    5.5,      18.3,     26.61,   57,   50,   22,  100,   84,  86,  76,  93,        10,     35,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
         YEAR, 2023-02-19,  2023,  23589.5,   1742.4,    298.4,   -312.2,    5.6,      17.9,     76.80,   57,   57,   19,  100,   84,  86,  76,  95,        18,     89,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
     TRIP AVG, 2023-02-19,   89t,  23589.5,     19.6,      3.4,     -3.5,    5.6,      17.9,      0.86,   57,   57,   19,  100,   84,  86,  76,  95,       0.2,      1,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
      DAY AVG, 2023-02-19,   47d,  23589.5,     37.1,      6.3,     -6.6,    5.6,      17.9,      1.63,   57,   57,   19,  100,   84,  86,  76,  95,       0.4,    1.9,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
     WEEK AVG, 2023-02-19,   47d,  23589.5,    259.5,     44.4,    -46.5,    5.6,      17.9,     11.44,   57,   57,   19,  100,   84,  86,  76,  95,       2.7,   13.3,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
    MONTH AVG, 2023-02-19,   47d,  23589.5,   1127.6,    193.1,   -202.0,    5.6,      17.9,     49.70,   57,   57,   19,  100,   84,  86,  76,  95,      11.6,   57.6,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
       YEARLY, 2023-02-19,   47d,  23589.5,  13531.4,   2317.3,  -2424.4,    5.6,      17.9,    596.40,   57,   57,   19,  100,   84,  86,  76,  95,     139.8,  691.2,   204, "9;Kwakstraat; Duckstad; Nederland; 7054; AN"                                                                                         ,
       Period,       Date,  Info, Odometer, Delta km,     +kWh,     -kWh, km/kWh, kWh/100km, Cost Euro, SOC%,  Avg,  Min,  Max, 12V%, Avg, Min, Max, #Charging, #Trips, Range, Address                                                                                                                               ,

You can mail me the output, because it can contain sensitive data, like Address.

[ZuinigeRijder]

I found the problem, in my test I used language is "en". But when set to "nl" the output is different. I filtered on the non-translated headers!

def send_summary_line_to_mqtt(line: str) -> None:
    """send_summary_line_to_mqtt"""
    if SEND_TO_MQTT:
        splitted = [x.strip() for x in line.split(",")]
        period = splitted[0].replace(" ", "")
        if (
            period
            in "TRIP, DAY, WEEK, MONTH, YEAR, TRIPAVG, DAYAVG, WEEKAVG, MONTHAVG, YEARLY"  # noqa
        ):
            send_splitted_line(
                get_items(f"summary/{period}", ITEMS_SUMMARY), splitted, True, True
            )

I will make a fix soon.

[Bluhme1]

Changed the language to English and now everything works fine. Has the issue something to do with the posts returning from the previous build?
I have deleted them again and now I will wait to see if they come back again

[ZuinigeRijder]

No, in your screenshot the top-level values immediately below topic hyundai_kia_connect_monitor/VIN did not longer appear. The appear one level lower: hyundai_kia_connect_monitor/VIN/monitor.

I made a fix, so summary.py should also work in Danish (I hope). See fix in attachment (just rename mqtt_utils.py.txt into mqtt_utils.py).

Note that you will get the translated headers as subtopic below summary.

mqtt_utils.py.txt

[ZuinigeRijder]

The same problem is in Domoticz. I will have another solution, where I want to keep the original English headlines.....

[Bluhme1]

The fix works for me. Thank you
Just to remind me. How do I force an update? Something about deleting the last line in monitor.csv Or??

[ZuinigeRijder]

You can indeed delete the last line in monitor.csv. But you can also put the car in Drive and thereafter just fully off again ;-)

[ZuinigeRijder]

I made a new release which should fix all the problems with respect to MQTT/Domoticz: R4.2.1.

Note that the MQTT subtopics have now the original header name, so not the translated ones.

[Bluhme1]

Now I got 285 sensors Homeassistant (se attached). The question is: Why so many? The answer is:Because we can!

Thanks again

[ZuinigeRijder]

Great. Nice to see that it is working and useful. Still a lot of effort to map the MQTT to HA, I assume.

[Bluhme1]

I had som help from ChatGPT that could create sensors automatically from the state_topic lines imported from MQTT.Helped a lot and saved a lot of time. You need to know the YAML syntax, however, to put the right prompts

[ZuinigeRijder]

Ah, ChatGPT to the rescue. Can you post the configuration.yaml here? So I can put this as example in the README?

[Bluhme1]

Hi, Here you go

There are many entries.

They should be included in configuration.yaml or put into a file called mqtt.yaml and "mqtt: !include mqtt.yaml" (without quotes)should be added to configuration.yaml.

If put in configuration.yaml the lines should be preceded by

• platform: MQTT
  sensor:
  - name: XXXXXXXXX

If put in a separate file called mqtt.yaml the lines should be preceded by
sensor:
- name XXXXXXX

Remember right intention (Homeassistant users would know)

MQTT.txt

[rpositive]

Hi Bluhme1, thanks for sharing this. In my case it showed there were errors in MQTT.txt. What I did (as you described):

• create file mqtt.yaml
• enter "sensor:" on line 1
• pasted the contents of your MQTT.txt file in my file on line 2 and on.
• Home Assistant threw an error on the YAML code.
  I've veryfied the code using www.yamllint.com. I received errors like: "Invalid escape sequence \{ at line 5, column 24". When I cleared out all appearances of the escape char \, the code validated and the sensors where there.
• entered "mqtt: !include mqtt.yaml" (without quotes) in configuration.yaml.

One thing I forgot was changing the VIN number in there. Once I fixed that my sensors where showing data.

I'm really happy you shared this with us and I didn't have to figure this out myself. And I don't know if this escape char issue is only with my configuration. This might help someone else.

[ZuinigeRijder]

@rpositive Probably my examples/configuration.yaml has to be updated too then.

Can you check if below is correct? Then I can update the yaml example.

configuration.yaml.txt

[Bluhme1]

@rpositive You are right. The MQTT.txt was created in Textedit and it looks like the program has added the \ after each line. Perhaps as a line break. I don't have that character in my MQTT settings and consequently everything works fine at my end and I didn't find the problem. Sorry.
It just shows how careful you must be when copying and pasting to keep the formatting
And @ZuinigeRijder you should replace the original MQTT.txt file with the one you have created.
And perhaps also write somewhere that the individual users must change the VIN

And a Merry Christmas to both of you

[rpositive]

@rpositive Probably my examples/configuration.yaml has to be updated too then.

Can you check if below is correct? Then I can update the yaml example.

configuration.yaml.txt

This file doesn't have the escape char. Thanks