Announcement

Collapse
No announcement yet.

Possible event.json size limit problem in HS4

Collapse
X
Collapse
 
  • Page of 2
  • Filter
  • Time
  • Show
Clear All
new posts
Previous 1 2 template Next
    #1

    Possible event.json size limit problem in HS4

    I figured I would start new topic about problem with event.json... It may or may not be related to error in topic linked below but I think it might be different problem. Feel free to merge topics if it is same issue.

    HS-723 - All events gone in 4.0.4.0



    rjh

    Quick question for you. I see yo have mentioned that there is a fix for Cor 's issue.

    Error while serializing object for database : Collection was modified; enumeration operation may not execute.



    I was just wondering if you have some input on my error and if you think they are related.

    Error Error while serializing object for database : Exception of type 'System.OutOfMemoryException' was thrown.


    I have spent a lot time trying to upgrade to HS4. I was getting error above fairly quickly after upgrade. I did some changes on HS3 file and now that error is always there right after everything starts up resulting in events.json 0KB file.

    I found that reducing number of event (reducing events.json I assume) fixes the problem. I have absolutely no issues with same setup in HS3.


    Just FYI when I had full setup with 2155 events and was able to events.json file it was about 295MB in size. That is where things were falling appart.
    At that point events.json would get corrupted or saved with 0KB.

    After I reduced number of events to 1439 for testing purposes event.json size is about 130MB and no issues at all.

    Is that going to be limitation of HS4 or is there a way to fix it?


    Thanks for your input. Charles
    Tags: None
    #2
    Wow, 2155 events. That is a lot :-)

    I wonder if you run into the limits of a 32 bit process when serializing/deserializing such a large JSON file.
    • Likes 1

    Comment

      #3
      I get this on startup and all my events are gone
      HomeSeer~!~Error~!~Error while reading events.bson : Object reference not set to an instance of an object.

      I guess that events.bson is a typo?

      My events.json file is still 2352kb

      Greig.

      Zwave = Z-Stick, 3xHSM100� 7xACT ZDM230, 1xEverspring SM103, 2xACT HomePro ZRP210.
      X10 = CM12U, 2xAM12, 1xAW10, 1 x TM13U, 1xMS13, 2xHR10, 2xSS13
      Other Hardware = ADI Ocelot + secu16, Global Cache GC100, RFXtrx433, 3 x Foscams.
      Plugings = RFXcom, ActiveBackup, Applied Digital Ocelot, BLDeviceMatrix, BLGarbage, BLLAN, Current Cost, Global Cache GC100,HSTouch Android, HSTouch Server, HSTouch Server Unlimited, NetCAM, PowerTrigger, SageWebcamXP, SqueezeBox, X10 CM11A/CM12U.
      Scripts =       Various

      Comment

        #4
        kriz83 I don't know. It's above my pay grade to determine.

        I know that HS3 doesn't have that problem.
        It looks like it event.json is new thing in HS4.

        With more sophisticated system in large house you can easily reach this number of events.

        More things will be connected and automated requiring more events.

        If this is limit, it should be looked into IMO.

        At this point I can't upgrade to HS4 because event.json is not saved property due to mentioned error.



        Originally posted by kriz83 View Post
        Wow, 2155 events. That is a lot :-)

        I wonder if you run into the limits of a 32 bit process when serializing/deserializing such a large JSON file.

        Comment

          #5
          An update to HS4 was posted today that fixes this issue. If you see an events problem with build 4.0.5.0 please post here so I will get notified.
          💁‍♂️ Support & Customer Service 🙋‍♂️ Sales Questions 🛒 Shop HomeSeer Products

          Comment

            #6
            rjh

            Still getting error with 4.0.5.0 with one extra new line before the error.
            I did upgrade from HS3. Obviously other messages are related to HS4 registration.

            So I guess the fix did not help to my issue mentioned above.

            Any suggestions?


            4/21/2020 5:02:40 PM HomeSeer Info System connected to MyHS Service successfully with license ID 666356.
            4/21/2020 5:02:40 PM HomeSeer Info System connected to MyHS Service, waiting for acknowledge...
            4/21/2020 5:02:40 PM HomeSeer Info Starting the MyHS Service...
            4/21/2020 5:02:36 PM HomeSeer Info Stopping the MyHS Service...
            4/21/2020 5:02:33 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:02:22 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:02:11 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:02:00 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:01:59 PM HomeSeer 3 Attempting to write blank file for C:\Program Files (x86)\HomeSeer HS3\Data\Setup_Server.json\events.json. Aborting...
            4/21/2020 5:01:59 PM HomeSeer Error Error while serializing object for database : Exception of type 'System.OutOfMemoryException' was thrown.
            4/21/2020 5:01:49 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:01:38 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:01:27 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:01:23 PM HomeSeer 3 Attempting to write blank file for C:\Program Files (x86)\HomeSeer HS3\Data\Setup_Server.json\events.json. Aborting...
            4/21/2020 5:01:23 PM HomeSeer Error Error while serializing object for database : Exception of type 'System.OutOfMemoryException' was thrown.
            4/21/2020 5:01:16 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:01:05 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
            4/21/2020 5:00:54 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.

            Comment

              #7
              Can you PM me your .HSD file from your HS3 system that you upgraded from? I will try to recreate the issue.

              Originally posted by Charles_cz View Post
              rjh

              Still getting error with 4.0.5.0 with one extra new line before the error.
              I did upgrade from HS3. Obviously other messages are related to HS4 registration.

              So I guess the fix did not help to my issue mentioned above.

              Any suggestions?


              4/21/2020 5:02:40 PM HomeSeer Info System connected to MyHS Service successfully with license ID 666356.
              4/21/2020 5:02:40 PM HomeSeer Info System connected to MyHS Service, waiting for acknowledge...
              4/21/2020 5:02:40 PM HomeSeer Info Starting the MyHS Service...
              4/21/2020 5:02:36 PM HomeSeer Info Stopping the MyHS Service...
              4/21/2020 5:02:33 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:02:22 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:02:11 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:02:00 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:01:59 PM HomeSeer 3 Attempting to write blank file for C:\Program Files (x86)\HomeSeer HS3\Data\Setup_Server.json\events.json. Aborting...
              4/21/2020 5:01:59 PM HomeSeer Error Error while serializing object for database : Exception of type 'System.OutOfMemoryException' was thrown.
              4/21/2020 5:01:49 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:01:38 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:01:27 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:01:23 PM HomeSeer 3 Attempting to write blank file for C:\Program Files (x86)\HomeSeer HS3\Data\Setup_Server.json\events.json. Aborting...
              4/21/2020 5:01:23 PM HomeSeer Error Error while serializing object for database : Exception of type 'System.OutOfMemoryException' was thrown.
              4/21/2020 5:01:16 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:01:05 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              4/21/2020 5:00:54 PM HomeSeer Warning Unable to connect to MyHS service, license ID is 0. Please register the system with a valid license.
              💁‍♂️ Support & Customer Service 🙋‍♂️ Sales Questions 🛒 Shop HomeSeer Products

              Comment

                #8
                rjh I guess the file is too big to attach to PM.. Can you PM your email address and I can send it to you that way?

                I am getting this error when trying to attach hsd file. I tried to compress it but it is still a little bit over 2MB.

                Error: PHP Max Post Size has been exceeded.

                Comment

                  #9

                  Nevermind.. I PMd you link to shared file..


                  Originally posted by Charles_cz View Post
                  rjh I guess the file is too big to attach to PM.. Can you PM your email address and I can send it to you that way?

                  I am getting this error when trying to attach hsd file. I tried to compress it but it is still a little bit over 2MB.

                  Error: PHP Max Post Size has been exceeded.

                  Comment

                    #10
                    Found the issue. I think someone mentioned something about a 32 bit limit. The limit was the max size of a string in .NET, it was overflowing due to the large number of events. We have put in a fix for the next build which will be 4.0.6.0.

                    The issue # is HS-723.
                    💁‍♂️ Support & Customer Service 🙋‍♂️ Sales Questions 🛒 Shop HomeSeer Products

                    Comment

                      #11
                      You should hire me :-)

                      Verstuurd vanaf mijn SM-G965F met Tapatalk

                      • Likes 2

                      Comment

                        #12
                        Cool. Thanks

                        Comment

                          #13
                          You should hire me :-)
                          They have, as an unpaid intern or is that indentured servant?
                          • Likes 1

                          Comment

                            #14
                            Originally posted by racerfern View Post

                            They have, as an unpaid intern or is that indentured servant?
                            LOL...

                            Comment

                              #15
                              Robert rjh , I'm getting the following message
                              Error while serializing object for database : Exception of type 'System.OutOfMemoryException' was thrown.
                              , it seems to materialize some time ~>12 hrs. after a fresh restart, whereas their frequency seems to increase, any suggestions or recommendations you might have? I've included my system particulars below


                              Date/time=11/16/2021 1:28:43 PM Eastern Standard Time
                              Version=HS4 Pro Edition 4.2.6.0 (Windows)
                              License=Registered
                              License ID=XXXXXX
                              MyHS Subscription=Basic
                              MyHS Subscription Backup Interval=No Backup
                              MyHS Subscription Max Cameras=1
                              Confguration File=C:\Program Files (x86)\HomeSeer HS3\Data\HomeSeerData.json
                              In Virtual Machine=No MFG: intel corporation
                              Antivirus=Windows Defender Norton 360
                              OS=Microsoft Windows 10 Pro - Work Station
                              OS Version=10.0.19043
                              Uptime=0 Days 22 Hours 49 Minutes 26 Seconds
                              User/Access=HS4 (Admin)
                              Lan IP=192.168.1.XXX (HomeSeer3)
                              Client IP=192.168.1.XXX (LMBFarms-Office.localdomain)
                              WAN IP= intentionally removed ()
                              Device Count=1994
                              Event Count=492
                              Last Event Ran=Timed Virtual Switch Events : Cat Litter - Virtual Device/Timer String Update, Ran at 11/16/2021 1:27:59 PM
                              # of unique event scripts=25
                              Connected Speaker Clients=HOMESEER3 (127.0.0.1)EFAULT
                              Processor:=Intel64 Family 6 Model 142 Stepping 9 at 3.26 GHz
                              Modules/Threads=160 Modules, 191 Threads
                              Available Threads=1023
                              System Load=212 Processes, 8% Load
                              Free/Total Memory=11.39 GBytes / 15.88 GBytes (72% free)
                              Free/Total Virtual Memory=12.84 GBytes / 18.26 GBytes (70% free)
                              HomeSeer Memory Used=1 Gbytes
                              Plugin Memory Used=22 EXE Plug-Ins using 567 Mbytes
                              Plugins Installed=APCUPSD 3.3.2.3,BLBackup 2.0.63.0,BLEditor 2.0.11.0,BLGData 3.0.55.0,BLOccupied 2.0.28.0,BLRoombaWifi 2.0.37.0,BLShutdown 1.0.6.0,Blue-Iris 3.1.3.33206,Device History 3.2.0.1,EasyTrigger 3.0.0.74,Harmony Hub 4.0.13.0,Nest 3.0.0.34,NetCam Plugin 1.0.0.5,PHLocation2 3.0.0.64,Pushover 3P 0.0.0.54,Random 3.0.0.2,Restart 1.0.0.7,rnbWeather 4.2.0.0,SDJ-Health 3.1.0.3,Sonos 3.1.0.59,Sonos4 4.0.1.9,UltraCID3 3.0.6681.34300,UltraMon3 3.0.6554.33094,UltraNetCam3 3.0.6413.20219,Unifi 4.0.15.12,Z-Wave 3.0.7.0,Z-Wave UI 1.0.0.0
                              Computer: CUK Intel NUC7i7BNH
                              Op System: Windows10 Pro - Work Station
                              HS Version: HS4 Pro Edition 4.2.19.0

                              Plug-Ins: AK Weather 4.0.5.25,APCUPSD 3.3.2.3,BLBackup 2.0.63.0,BLEditor 2.0.11.0,BLGData 3.0.55.0,BLOccupied 2.0.28.0,BLShutdown 1.0.6.0,Blue-Iris 3.1.3.33206,Device History 3.2.0.2,EasyTrigger 3.0.0.76,Harmony Hub 4.0.14.0,iRobot 5.22.41.1,JowiHue 4.0.8.7,Nest 3.0.0.34,NetCam Plugin 1.0.0.5,PHLocation2 3.0.0.64,Pushover 4.0.10.0,Random 3.0.0.2,Restart 1.0.0.7,Ring 1.0.0.9,SDJ-Health 3.1.1.3,Sonos 3.1.0.59,Sonos4 4.0.1.12,UltraCID3 3.0.6681.34300,UltraMon3 3.0.6554.33094,UltraNetCam3 3.0.6413.20219,Unifi 4.0.32.0,Zigbee 4.0.11.0,Z-Wave 4.0.3.0, and Jon00 scripts.

                              Comment

                              Previous 1 2 template Next
                              Working...
                              X