Announcement

**Rupp** · March 2, 2012, 08:00 AM

Post the contents of the messagebox or use hs.writelog to write the return to the log and paste this and someone will post code to parse it.

**mrhappy** · March 2, 2012, 08:01 AM

If you leave the HTML tags in then you could split the return from the webserver by the break tags. Something like this as an example (uncommenting out the getURL).

Code:

Sub Main(ByVal Parms As Object)

Dim WebStr As String = "Arduino powered webserver<br>Serving temperature and humidity values from a DHT22 sensor<br>Light (Lux): 

0<br>Temperature (oC): 24.40<br>Humidity (%): 54.00<br>"

'Dim Path As String = "http://192.168.1.178/"
'Dim WebStr As String = hs.geturl(Path, "/", FALSE, 80)

Dim SplitStr() As String = Split(WebStr, "<br>")

'For i As Integer = 0 to UBound(SplitStr) - 1
'hs.writelog(i, SplitStr(i))
'Next

If UBound(SplitStr) > 0 Then

hs.writelog("Temp", Trim(Right(SplitStr(3), 5)) & " �C")
hs.writelog("Humidity", Trim(Right(SplitStr(4), 5)) & " %")

End If

End Sub

**travisdh** · March 2, 2012, 06:06 PM

Thanks for your help so far, for some reason it was fine to extract the parts from your string, but the web site it struggled with, so i modified the website code (run from an arduino) to include # before the line breaks and it now splits the string perfectly.

Quick question, the temperature & humidity are easy ones because they are fixed, i.e: temperature should always be 5 digits (i hope), but with light as an example, and applying the same to temperature and humidity, how can I parse the string if the length of the integer changes, for example instead of one digit :9:, light goes up to 4 digits, and
with temperature and humidity, instead of one digit it has six in the case of temperature to include a negative, or four if it is 6.50 Deg C etc, same with humidity.

For example light at the moment is 9 because it is dark in the room, but when it is sunny outside it might go up to 1024, so i cant apply a simple trim for 5 digits.

Code:

[FONT=Century Gothic][SIZE=2]Arduino powered webserver#<br /> Serving temperature and humidity values from a DHT22 sensor#<br /> Light : 16 #<br /> Temperature (oC): 22.30 #<br /> Humidity (%): 56.50 #<br />[/SIZE][/FONT][FONT=Century Gothic][SIZE=2][/SIZE][/FONT]

The modified vb code is below:

Code:

Sub Main(ByVal Parms As Object)

'Dim WebStr As String = "Arduino powered webserver<br>Serving temperature and humidity values from a DHT22 sensor<br>Light (Lux): 0<br>Temperature (oC): 24.40<br>Humidity (%): 54.00<br>"

Dim Path As String = "http://192.168.1.178/"
Dim WebStr As String = hs.geturl(Path, "/", FALSE, 80)

hs.writelog("RAW", WebStr)
Dim SplitStr() As String = Split(WebStr, "#")
For i As Integer = 0 to UBound(SplitStr) - 1
hs.writelog(i, SplitStr(i))
Next

If UBound(SplitStr) > 0 Then

hs.writelog("Light", Trim(Right(SplitStr(2), 6)))
hs.writelog("Temp", Trim(Right(SplitStr(3), 6)) & " �C")
hs.writelog("Humidity", Trim(Right(SplitStr(4), 6)) & " %")


End If

End Sub

This results in the log below:

Code:

3/3/2012 10:01:55 AM 	Humidity 	56.50 %
3/3/2012 10:01:55 AM 	Temp 	22.30 �C
3/3/2012 10:01:55 AM 	Light 	: 15
3/3/2012 10:01:55 AM 	4 	Humidity (%): 56.50
3/3/2012 10:01:55 AM 	3 	Temperature (oC): 22.30
3/3/2012 10:01:55 AM 	2 	Light : 15
3/3/2012 10:01:55 AM 	1 	Serving temperature and humidity values from a DHT22 sensor
3/3/2012 10:01:55 AM 	0 	Arduino powered webserver
3/3/2012 10:01:55 AM 	RAW 	Arduino powered webserver#
                                        Serving temperature and humidity values from a DHT22 sensor#
                                        Light : 15 #
                                        Temperature (oC): 22.30 #
                                        Humidity (%): 56.50 #

Once again thanks for all the help, I am starting to understand the Right and Left, just not how to get the length of a certain char to determine the length of the integer or string.

**mrhappy** · March 2, 2012, 06:31 PM

It was poor on my part really as I knew this was going to come up, I would say you have a couple of options;

1) A further split of each return on the space character, so you would have 0 as the title of the return and 1 as the value.
2) A replace that replaces the string with nothing
3) The dark art of regex, this is an example which may work with a regex.

Code:

Imports System.Text.RegularExpressions

Sub Main(ByVal Parms As Object)

    Dim WebStr As String = "Arduino powered webserver#Serving temperature and humidity values from a DHT22 sensor#Light (Lux): 0#Temperature (oC): 24.40#Humidity (%): 54.00#"

    'Dim Path As String = "http://192.168.1.178/"
    'Dim WebStr As String = hs.geturl(Path, "/", FALSE, 80)

    hs.writelog("RAW", WebStr)
    Dim SplitStr() As String = Split(WebStr, "#")

    'For i As Integer = 0 To UBound(SplitStr) - 1
    'hs.writelog(i, SplitStr(i))
    'Next

    If UBound(SplitStr) > 0 Then

        hs.writelog("Light", convert.todouble(Regex.Replace(SplitStr(2), "[\D]", "")) & " lux")
        hs.writelog("Temp", convert.todouble(Regex.Replace(SplitStr(3), "[\D]", "")) / 100 & " �C")
        hs.writelog("Humidity", convert.todouble(Regex.Replace(SplitStr(4), "[\D]", "")) / 100 & " %")


    End If

End Sub

**travisdh** · March 2, 2012, 06:50 PM

Thank you very much,
the dark art of regex appears to have worked well. So to understand, the d allows for extraction of any digit, does this mean that it can be positive or negative, or would it just extract the digit regardless of if positive or negative?

Once again thanks for your help, this is perfect!

**mrhappy** · March 2, 2012, 07:11 PM

Originally posted by travisdh View Post

Thank you very much,
the dark art of regex appears to have worked well. So to understand, the d allows for extraction of any digit, does this mean that it can be positive or negative, or would it just extract the digit regardless of if positive or negative?

Once again thanks for your help, this is perfect!

Very valid point and one I forgot about, try this;

Code:

Imports System.Text.RegularExpressions

Sub Main(ByVal Parms As Object)

    Dim WebStr As String = "Arduino powered webserver#Serving temperature and humidity values from a DHT22 sensor#Light (Lux): 

0#Temperature (oC): -24.40#Humidity (%): +54.00#"

    'Dim Path As String = "http://192.168.1.178/"
    'Dim WebStr As String = hs.geturl(Path, "/", FALSE, 80)

    hs.writelog("RAW", WebStr)
    Dim SplitStr() As String = Split(WebStr, "#")

    'For i As Integer = 0 To UBound(SplitStr) - 1
    'hs.writelog(i, SplitStr(i))
    'Next

    If UBound(SplitStr) > 0 Then

        hs.writelog("Light", convert.todouble(Regex.Replace(SplitStr(2), "[^\d|\.\-]", "")) & " lux")
        hs.writelog("Temp", convert.todouble(Regex.Replace(SplitStr(3), "[^\d|\.\-]", "")) & " �C")
        hs.writelog("Humidity", convert.todouble(Regex.Replace(SplitStr(4), "[^\d|\.\-]", "")) & " %")


    End If

End Sub

Different regex string, should handle negative numbers and decimals now.

**travisdh** · April 1, 2012, 06:07 AM

Timeout

Just a quick question, is there any way to extend the amount of time the script will wait to get the page to load. The page is normally slow to load (because it is based on an arduino, over a long cable etc) and i get lots of timed out. If i could get it to wait a bit longer it would work more reliably.

Thanks

**mrhappy** · April 1, 2012, 06:20 AM

I'm not sure that you can with the HS scripting commands to download a URL, it would be possible to switch to a .net method of downloading a file (the simplest way being the my.computer.downloadfile), that command can accept a timeout and then you would download the page and reopen it in the script. What sort of time delay are you experiencing?

**mrhappy** · April 1, 2012, 07:02 AM

There are probably ways of doing this slightly better but here might be something for you to try;

Code:

Imports System.Text.RegularExpressions

Sub Main(ByVal Parms As Object)

    Try

    Dim WebStr As String = "Arduino powered webserver#Serving temperature and humidity values from a DHT22 sensor#Light (Lux): 0#Temperature (oC): 24.40#Humidity (%): +54.00#"

    My.Computer.Network.DownloadFile("http://192.168.1.178/", hs.getapppath & "\adstation.txt", "", "", False, 10000, True)

    If System.IO.File.Exists(hs.getapppath & "\adstation.txt") Then

    Dim objReader As New System.IO.StreamReader(hs.getapppath & "\adstation.txt")

    WebStr = objReader.ReadToEnd

    hs.writelog("RAW", WebStr)
    Dim SplitStr() As String = Split(WebStr, "#")

    If UBound(SplitStr) > 0 Then

	hs.writelog("Light", convert.todouble(Regex.Replace(SplitStr(2), "[^\d|\.\-]", "")) & " lux")
        hs.writelog("Temp", convert.todouble(Regex.Replace(SplitStr(3), "[^\d|\.\-]", "")) & " �C")
        hs.writelog("Humidity", convert.todouble(Regex.Replace(SplitStr(4), "[^\d|\.\-]", "")) & " %")

    End If

    'delete the file, not absolutely needed but prevents the data caching

    objReader.Close()


    System.IO.File.Delete(hs.getapppath & "\adstation.txt")

    End If

    Catch Ex As Exception

    hs.writelog("Arduino Web", "Error: " & ex.message)

    End Try

End Sub

Basically it tries to download the file and has a 10 second timeout, it downloads it to your root HS directory as a text file, attempts to parse it and then deletes the file. There is no absolute need for it to delete the file (it will overwrite it if it finds it) but it prevents the webserver going down and it still reading old data and the script not knowing that it is actually old data it is viewing.

**travisdh** · April 4, 2012, 01:55 AM

Thanks for the tip(s)!

Murphy's law says i am more than 200km away from home (for the next few days) and the Arduino in the greenhouse is not responding, so can't test it

.

I will give it a go when i get back, I was slack when running the network cable which runs about 50m outside, and i am sure there is a break in the cable which prevents it from responding. Even when it does the speed is about 1mbps (on LAN) so it always takes quite a while to respond.

**travisdh** · April 22, 2012, 04:39 PM

Hi mrhappy,

I slightly modified your code example for another website (melbourne water data), so that i could use the water levels in my home automation setup to warn me if the creek near me is getting to high. The code i used is below but i was hoping you might be able to take a look. I am sure it will be simple but i am trying to set the device string as the extracted string, but i think because i am just pulling out the whole string including blankspace it is making the device look horrible.

I had also hoped to be able to use the values to put in the device value section of the homeseer devices, but for some reason whenever that was in it errored up due to wrong input type.

Would you be able to take a look and make any suggestions on changes required to neaten up the extracted string, and extract the value for the device value.

Thanks!

Code:

Imports System.Text.RegularExpressions

Sub Main(ByVal Parms As Object)

    Dim WebStr As String = hs.GetURL("http://www.melbournewater.com.au","/content/rivers_and_creeks/rainfall_and_river_level_data/site.asp?SiteID=16&bhcp=1", False, 80)

    'hs.writelog("WATER-RAW", WebStr)
    Dim SplitStr() As String = Split(WebStr, "<td>")

    For i As Integer = 0 To UBound(SplitStr) - 1
    'hs.writelog(i, SplitStr(i))
    Next

    If UBound(SplitStr) > 0 Then

        hs.writelog("Flow", SplitStr(3))
        hs.SetDeviceString("Y13","Flow: " & SplitStr(3))
        hs.writelog("Level", SplitStr(6))
        hs.SetDeviceString("Y14","Level: " & SplitStr(6))

       
    End If

End Sub

**mrhappy** · April 22, 2012, 05:15 PM

Try this;

Code:

Imports System.Text.RegularExpressions

Sub Main(ByVal Parms As Object)

    Dim WebStr As String = hs.GetURL("http://www.melbournewater.com.au","/content/rivers_and_creeks/rainfall_and_river_level_data/site.asp?SiteID=16&bhcp=1", False, 80)
    Dim SplitStr() As String = Split(WebStr, "<td>")

    If UBound(SplitStr) > 0 Then

	hs.writelog("Flow", Regex.Replace(SplitStr(3), "<[^>]*>", ""))
	hs.writelog("FlowValue", Convert.ToDecimal(Regex.Replace(SplitStr(3), "[^0-9.]", "")))        
	hs.writelog("Level", Regex.Replace(SplitStr(6), "<[^>]*>", ""))
       	hs.writelog("LevelValue", Convert.ToDecimal(Regex.Replace(SplitStr(6), "[^0-9.]", "")))
    
    End If

End Sub

You will need to add the device setting back in, due to the fact they are decimals then you will need to multiply them to get an accurate figure or if you are happy you could just set the value from there. I think what was happening is that you were getting some HTML left in the device strings that might have been causing some formatting issues.

**travisdh** · April 22, 2012, 06:59 PM

Thanks,

That is perfect!

**travisdh** · April 29, 2012, 12:29 AM

Hi MrHappy,

Just a (hopefully quick) question, the script has started to error up, i am guessing the string has slightly changed. Would you be able to take a look and make some suggestions on how it could be fixed?

Thanks

4/29/2012 3:22:38 PM Error Scripting runtime error: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.FormatException: Input string was not in a correct format. at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal) at System.Number.ParseDecimal(String value, NumberStyles options, NumberFormatInfo numfmt) at System.Convert.ToDecimal(String value) at scriptcode5.scriptcode5.Main(Object Parms) --- End of inner exception stack trace --- at System.RuntimeMethodHandle._InvokeMethodFast(Object target, Object[] arguments, SignatureStruct& sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner) at System.RuntimeMethodHandle.InvokeMethodFast(Object target, Object[] arguments, Signature sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean skipVisibilityChecks) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture) at System.Reflection.MethodBase.Invoke(Object obj, Object[] parameters) at Scheduler.VsaScriptHost.Invoke(String ModuleName, String MethodName, Object[] Arguments) 4/29/2012 3:22:38 PM Level 0.250 m Flow as at 29-Apr-2012 2 PM : 39.300 Ml/day Chart View Detailed historical data Period Max Min Period Max Min 4/29/2012 3:22:38 PM FlowValue 39.300 4/29/2012 3:22:38 PM Flow 39.300 Ml/day

Announcement

Simple Extract String from Website.

Simple Extract String from Website.

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment