Possible event.json size limit problem in HS4

[rjh]

Can you email me or PM me your .JSON folder in your Data folder? I can then try to recreate this here.

Robert rjh , I'm getting the following message , it seems to materialize some time ~>12 hrs. after a fresh restart, whereas their frequency seems to increase, any suggestions or recommendations you might have? I've included my system particulars below


Date/time=11/16/2021 1:28:43 PM Eastern Standard Time
Version=HS4 Pro Edition 4.2.6.0 (Windows)
License=Registered
License ID=XXXXXX
MyHS Subscription=Basic
MyHS Subscription Backup Interval=No Backup
MyHS Subscription Max Cameras=1
Confguration File=C:\Program Files (x86)\HomeSeer HS3\Data\HomeSeerData.json
In Virtual Machine=No MFG: intel corporation
Antivirus=Windows Defender Norton 360
OS=Microsoft Windows 10 Pro - Work Station
OS Version=10.0.19043
Uptime=0 Days 22 Hours 49 Minutes 26 Seconds
User/Access=HS4 (Admin)
Lan IP=192.168.1.XXX (HomeSeer3)
Client IP=192.168.1.XXX (LMBFarms-Office.localdomain)
WAN IP= intentionally removed ()
Device Count=1994
Event Count=492
Last Event Ran=Timed Virtual Switch Events : Cat Litter - Virtual Device/Timer String Update, Ran at 11/16/2021 1:27:59 PM
# of unique event scripts=25
Connected Speaker Clients=HOMESEER3 (127.0.0.1)EFAULT
Processor:=Intel64 Family 6 Model 142 Stepping 9 at 3.26 GHz
Modules/Threads=160 Modules, 191 Threads
Available Threads=1023
System Load=212 Processes, 8% Load
Free/Total Memory=11.39 GBytes / 15.88 GBytes (72% free)
Free/Total Virtual Memory=12.84 GBytes / 18.26 GBytes (70% free)
HomeSeer Memory Used=1 Gbytes
Plugin Memory Used=22 EXE Plug-Ins using 567 Mbytes
Plugins Installed=APCUPSD 3.3.2.3,BLBackup 2.0.63.0,BLEditor 2.0.11.0,BLGData 3.0.55.0,BLOccupied 2.0.28.0,BLRoombaWifi 2.0.37.0,BLShutdown 1.0.6.0,Blue-Iris 3.1.3.33206,Device History 3.2.0.1,EasyTrigger 3.0.0.74,Harmony Hub 4.0.13.0,Nest 3.0.0.34,NetCam Plugin 1.0.0.5,PHLocation2 3.0.0.64,Pushover 3P 0.0.0.54,Random 3.0.0.2,Restart 1.0.0.7,rnbWeather 4.2.0.0,SDJ-Health 3.1.0.3,Sonos 3.1.0.59,Sonos4 4.0.1.9,UltraCID3 3.0.6681.34300,UltraMon3 3.0.6554.33094,UltraNetCam3 3.0.6413.20219,Unifi 4.0.15.12,Z-Wave 3.0.7.0,Z-Wave UI 1.0.0.0

[Wade]

Can you email me or PM me your .JSON folder in your Data folder? I can then try to recreate this here.

Please post back here with any solution info discovered. I struggled with this for months. Although I tried a number of things to troubleshoot, it seems most likely that disabling automatic backup is what finally stopped it. Ive not reenabled backup to confirm.

[MNB]

Wade, thanxs for the comeback, when you say automatic backup what are you implying e.g. Plugins BLBackup or ZipBackup or something total else?

[Wade]

Wade, thanxs for the comeback, when you say automatic backup what are you implying e.g. Plugins BLBackup or ZipBackup or something total else?

HS4's built-in backup. Tools > Backup/Restore

I'm using BLBackup without issues.

[Wade]

HS4's built-in backup. Tools > Backup/Restore

I'm using BLBackup without issues.

More specifically, disabling local backup is what seems to have solved it. I just re-enabled it and I'll see if the out of memory errors resume after it tries to run overnight tonight.

BTW, there's a bug preventing cloud backup being disabled after being enabled on the above page, so it's still enabled for monthly backup. Per rjh it was supposed to be fixed in the next version but I've not installed 4.2.6.0 to see if it's there. But cloud backup doesn't work for me anyway. I've had an open support ticket on it for months. HS stopped responding to it a couple months ago and it was never solved. So even though it's enabled, it fails and I get associated errors in the log--but not the out of memory errors. But I digress....

[MNB]

Thanxs Wade, I totally spaced-out on that option, I can see that I don't it enabled for a once a week (Sun at 3:00 am) the "Auto local Backup" options isn't selected. Dumb question, I also have the plugin BLBackup enabled to do both a file copy and zip backup it seems a little redundant or am I missing something?

I see that there is also a Cloud Backup with the Premium Subscription, but currently am a Basic kind of guy...

Out of curiosity how did make this discovery as it seems to work for you?

[Wade]

Out of curiosity how did make this discovery as it seems to work for you?

Trial and error. Since it's my production system I've been limited as to what I can test and when without disrupting household operations. Over the course of three 2-3 day periods while my SO was away, I systematically disabled all my plugins for varying periods of time and determined they didn't appear to be the problem. At some point I realized the errors seemed to reappear after a restart and *possibly* after a subsequent backup attempt. Seeing that my backups were sizeable, it occurred to me it could be related to copying large backup sets. I then made sure I had sufficient storage space at my backup target location. Initially I thought that could have been the problem, but the errors persisted. I then disabled local backup several altogether and I'm pretty certain I've not had any further out of memory errors. Certainly not the almost daily, consistent errors I was getting before. (BTW, HS was also crashing and restarting a few times per week which I assumed was related to the OOM errors--and that's stopped, too.) Admittedly, I made some other changes to my system just before the problems stopped so it's not definitively the problem. My overnight test tonight--having reenabled the built-in local backup--may tell us more. I've configured it to backup nightly for the next few nights as a more rigorous test over the coming week.

edit: I also kept an eye on my server event log to see while troubleshooting. Each time HS would crash I saw errors associated with various plugin executables, but it wasn't consistent. A couple errors thrown from random plugins, not like one was causing the problem. There also weren't system errors that pointed to the server or OS being the problem, although I'm no hardware or OS expert and could have overlooked something.

[Wade]

My overnight test tonight--having reenabled the built-in local backup--may tell us more. I've configured it to backup nightly for the next few nights as a more rigorous test over the coming week.

Quick update...a few hundred of these over a 25 minute period as the backup ran but so far no OOM errors. I'll continue to observe as it backs up the next few nights.

[Wade]

Quick update...a few hundred of these over a 25 minute period as the backup ran but so far no OOM errors. I'll continue to observe as it backs up the next few nights.

Closing this out. I consistently received these warnings as the system backup was in progress but no out of memory errors nor spontaneous HS4 restarts. Not conclusive, but it seems this wasn't the cause--alone at least--of the errors and restarts. I'm again disabling automatic local backup as I'm more comfortable with the BLBackup solution I've been using recently.