Announcement

Collapse
No announcement yet.

Jon00 DataScraper/JSON Parser Script For Homeseer 3 and Homeseer 4

Collapse
This topic is closed.
X
This is a sticky topic.
X
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    #16
    i restarted 5 x and still works , its temporary but it works , maybe rich now can see the problem
    Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
    Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




    HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

    Comment


      #17
      hi jon ,

      i report back , its still working without any errors , and no lags .

      so it really fix the problem ,

      Kind regards
      Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
      Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




      HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

      Comment


        #18
        //solved already
        Last edited by Malosa; July 1, 2015, 03:05 PM.
        Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
        Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




        HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

        Comment


          #19
          hi jon ,

          is it possible to do more than 5 pattern ? its for my temperature readings , it need a lot more patterns.

          thanks in advance ,
          btw still running great and no lag or weird recurs

          Kind regards
          Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
          Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




          HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

          Comment


            #20
            No but you can use multiple (.*?) entries in a single pattern and each will capture the data in the Jon00DataScraperdata.ini file. You can make up to 100 devices under a single 'Grab' configuration.

            Other than that you will have to use use additional 'Grab' definitions using the same source.
            Jon

            Comment


              #21
              ok thanks ,

              but how to do that ?


              example:

              Pattern5=(?s) data-variable="humidity">.*?"wx-value">(.*?)</span>


              But how to put this line together with above one
              Pattern6=(?s) data-variable="visibility">.*?"wx-value">(.*?)</span>


              i only need a start on how to do that ,

              thanks for the quick reply





              Originally posted by jon00 View Post
              No but you can use multiple (.*?) entries in a single pattern and each will capture the data in the Jon00DataScraperdata.ini file. You can make up to 100 devices under a single 'Grab' configuration.

              Other than that you will have to use use additional 'Grab' definitions using the same source.
              Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
              Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




              HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

              Comment


                #22
                It looks like the same HTML code repeated so you should only need to use a single pattern entry i.e.

                Pattern1=(?s) data-variable=.*?"wx-value">(.*?)</span>

                This should create several entries in the Jon00DataScraperData.ini file. You just need to determine which value is which.
                Jon

                Comment


                  #23
                  aaa yes i see it , its really easy
                  im stupid , yeah ofcourse the html repeats , so if i do that a whole list will be listed in the data file

                  thanks jon again

                  kind regards



                  Originally posted by jon00 View Post
                  It looks like the same HTML code repeated so you should only need to use a single pattern entry i.e.

                  Pattern1=(?s) data-variable=.*?"wx-value">(.*?)</span>

                  This should create several entries in the Jon00DataScraperData.ini file. You just need to determine which value is which.
                  Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
                  Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




                  HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

                  Comment


                    #24
                    ///EDIT Already found it out , hehe , i needed to add it to value also...



                    hi jon ,

                    i got a question , i was thinking about it but i really dont know how to do it ,

                    i use a scrape from windspeed it shows like (4.2) in the string

                    But is there a way to change the name of it ? so if it is in range of 4-5 it displays windpeed 3 as string..

                    like if it was a value i could change it in the status grapics ,

                    thanks in advance
                    Last edited by Malosa; August 10, 2015, 02:35 PM.
                    Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
                    Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




                    HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

                    Comment


                      #25
                      hi jon

                      Today i added 1 more number 14 to the scraper
                      and after that my cpu went 100% and the scraper doesnt work anymore , even if i put 14 away , it doesnt update anymore ....
                      there is no error or nothing in the log... but no devices are created or opdated

                      what to do now ?

                      this is what i had :
                      4+6+7+8+9+10+11+12+13+14
                      Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
                      Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




                      HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

                      Comment


                        #26
                        I cannot see how that can happen. Did you restart HS?
                        Jon

                        Comment


                          #27
                          hi jon

                          yes i restarted multiple times , then i delete the devices in homeseer and only want to update nr 14 , he doesnt create devices ,

                          i also deleted the scraperdata and checked if its created , so i checked it and its created with all the data in it ... but no homeseer devices...



                          so i try again now and i get a hstouch warning and it has updated nr13 after a few times..


                          Code:
                          Aug-14 17:36:40	 	HSTouch Server Warning	Exception on Value Change callback: Object reference not set to an instance of an object.
                          Aug-14 17:36:40	 	HSTouch Server Warning	Exception on Value Change callback: Object reference not set to an instance of an object.
                          Aug-14 17:36:40	 	HSTouch Server Warning	Exception on Value Change callback: Object reference not set to an instance of an object.
                          Aug-14 17:36:40	 	HSTouch Server Warning	Exception on Value Change callback: Object reference not set to an instance of an object.
                          Aug-14 17:36:40	 	HSTouch Server Warning	Exception on Value Change callback: Object reference not set to an instance of an object.
                          Aug-14 17:36:40	 	Jon00_DataScrape	Virtual device created for Address Jon00-DS-013-5 with Reference: 1216
                          Aug-14 17:36:40	 	Jon00_DataScrape	Virtual device created for Address Jon00-DS-013-4 with Reference: 1215
                          Aug-14 17:36:40	 	Jon00_DataScrape	Virtual device created for Address Jon00-DS-013-3 with Reference: 1214
                          Aug-14 17:36:40	 	Jon00_DataScrape	Virtual device created for Address Jon00-DS-013-2 with Reference: 1213
                          Aug-14 17:36:40	 	Jon00_DataScrape	Virtual device created for Address Jon00-DS-013-1 with Reference: 1212
                          Aug-14 17:36:38	 	Event	Running script in background: C:/Program Files (x86)/HomeSeer HS3/scripts/Jon00DataScraper.vben
                          Aug-14 17:36:38	 	Event	Event Trigger "test Jon Scraper t"
                          Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
                          Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




                          HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

                          Comment


                            #28
                            Are you willing to post what you are scraping for no 14 and the pattern etc?
                            Jon

                            Comment


                              #29
                              yes ofcourse , it worked before and now i get 100%cpu with it and doesnt create anymore devices
                              Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
                              Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




                              HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

                              Comment


                                #30
                                it woked before , it grabs ok , but doesnt create devices anymore....and i get 100%cpu


                                Code:
                                Path=http://dutch.wunderground.com/cgi-bin/findweather/getForecast?query=pws:ILIMBURG37
                                TextFile=1
                                Encoding=UTF-8
                                Username=
                                Password=
                                Options=
                                UserAgent=
                                Devicemode=0
                                
                                Pattern1=(?s)<span class="wx-value">(.*?)</span>
                                
                                
                                Pattern2=(?s)<a href="/EU/NL/012.html#warn">	nederlands: (.*?)english: Risk of</a>	
                                
                                Pattern3=(?s).*? data-variable="humidity"><span class="wx-value">(.*?)</span>
                                	
                                	
                                			
                                
                                
                                DeviceName1=WeerRadar HS
                                DeviceText1=WeerRadar HS
                                DeviceValue1=
                                DeviceImage1=
                                Speakbutton1=1
                                TriggerString1=
                                SearchMode1=1
                                TriggerEvent1=
                                
                                DeviceName2=Temp now 
                                DeviceText2=[6]℃
                                DeviceValue2=
                                DeviceImage2=
                                Speakbutton2=1
                                TriggerString2=
                                SearchMode2=1
                                TriggerEvent2=
                                
                                DeviceName3=Humidity
                                DeviceText3=[17]% 
                                DeviceValue3=
                                DeviceImage3=
                                Speakbutton3=1
                                TriggerString3=
                                SearchMode3=1
                                TriggerEvent3=
                                
                                DeviceName4=Windspeed
                                DeviceText4=[10]
                                DeviceValue4=[10]
                                DeviceImage4=
                                Speakbutton4=1
                                TriggerString4=
                                SearchMode4=1
                                TriggerEvent4=
                                
                                DeviceName5=Winddirection
                                DeviceText5=[9]
                                DeviceValue5=
                                DeviceImage5=
                                Speakbutton5=1
                                TriggerString5=
                                SearchMode5=1
                                TriggerEvent5=
                                
                                DeviceName6=Pressure
                                DeviceText6=[11] hPa
                                DeviceValue6=
                                DeviceImage6=
                                Speakbutton6=1
                                TriggerString6=
                                SearchMode6=1
                                TriggerEvent6=
                                
                                DeviceName7=UV
                                DeviceText7=N.A van de 12
                                DeviceValue7=
                                DeviceImage7=
                                Speakbutton7=1
                                TriggerString7=
                                SearchMode7=1
                                TriggerEvent7=
                                
                                
                                DeviceName8=Voelt als
                                DeviceText8=[7]℃ 
                                DeviceValue8=
                                DeviceImage8=
                                Speakbutton8=1
                                TriggerString8=
                                SearchMode8=1
                                TriggerEvent8=
                                
                                
                                
                                DeviceName9=Clouds
                                DeviceText9=[5]
                                DeviceValue9=
                                DeviceImage9=
                                Speakbutton9=1
                                TriggerString9=
                                SearchMode9=1
                                TriggerEvent9=
                                
                                
                                DeviceName10=Zicht
                                DeviceText10=[12]km
                                DeviceValue10=
                                DeviceImage10=
                                Speakbutton10=1
                                TriggerString10=
                                SearchMode10=1
                                TriggerEvent10=
                                
                                DeviceName11=Warning Message
                                DeviceText11=[100]
                                DeviceValue11=
                                DeviceImage11=
                                Speakbutton11=1
                                TriggerString11=
                                SearchMode11=1
                                TriggerEvent11=
                                Preferred -> Jon's Plugins, Pushover, Phlocation, Easy-trigger,
                                Rfxcom, Blade Plugins, Pushbullet, homekit, Malosa Scripts




                                HS3Pro 4.1.14.0 on windows 10 enterprise X64 on hp quadcore laptop 8 GB.

                                Comment

                                Working...
                                X