Announcement

Collapse
No announcement yet.

VR Syntax Guide Discussion

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    #31
    Originally posted by surovich View Post
    Spud -

    Im having the issue in this thread now that I update to .29 -

    Apr-11 10:44:18 AM Kinect DEBUG at Microsoft.Speech.Recognition.RecognizedPhrase.InsertSemantic ValueToDictionary(SemanticValue semanticValue, String propertyName, SemanticValue thisSemanticValue, GrammarOptions semanticTag, Collection`1& dupItems) at Microsoft.Speech.Recognition.RecognizedPhrase.RecursiveBuild SemanticProperties(IList`1 words, List`1 properties, RuleNode ruleTree, GrammarOptions semanticTag, Collection`1& dupItems) at Microsoft.Speech.Recognition.RecognizedPhrase.RecursiveBuild SemanticProperties(IList`1 words, List`1 properties, RuleNode ruleTree, GrammarOptions semanticTag, Collection`1& dupItems) at Microsoft.Speech.Recognition.RecognizedPhrase.RecursiveBuild SemanticProperties(IList`1 words, List`1 properties, RuleNode ruleTree, GrammarOptions semanticTag, Collection`1& dupItems) at Microsoft.Speech.Recognition.RecognizedPhrase.CalcSemantics( Grammar grammar) at Microsoft.Speech.Recognition.RecognizedPhrase.get_Semantics( ) at HSPI_KINECT.VoiceRecognition.SpeechRecognizedHandler(Object sender, SpeechRecognizedEventArgs e)

    Apr-11 10:44:18 AM Kinect ERROR The semantic value in rule 'control' was already set and cannot be changed.

    Apr-11 10:44:18 AM Kinect DEBUG Computer

    Apr-11 10:44:18 AM Kinect DEBUG Phrase recognized with confidence=0.9983721

    Apr-11 10:44:18 AM Kinect TRACE Phrase hypothesized = Computer, Confidence=0.9973238

    Apr-11 10:44:17 AM Kinect TRACE Phrase hypothesized = Computer, Confidence=0.1191543

    Apr-11 10:44:17 AM Kinect TRACE Speech Detected:


    It works for a few questions, then I ask it to turn off the lights and it stops working and throws the above in the log?
    it looks like the command "Computer" without anything after that is recognized as a valid command. Do you have a command where everything is optional or a wildcard?

    could you post the grammar rules that get logged when you start the plugin or when the grammar is rebuilt.

    Comment


      #32
      Hey Spud - sure, posted below. I added a wildcard to play, "What is *" - Aside from that, its all the commands that always worked for me since December, all very well. My living room system has no wildcard commands and it just stopped recognizing anything well. Overall the .29 has killed my VR systems. - Even with trace on, I can ask Turn on lights and I get nothing in the log - If I just say computer, it may log the computer event.

      -11 10:41:08 AM Kinect DEBUG Speech Recognition Started

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) increase temperature

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) decrease temperature

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) set Temperature to (value)

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) turn [the] [Family Room] Lights Off

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) turn [the] [Family Room] Lights On

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) [turn lights off] [lights off]

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) [turn lights on] [lights on]

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) turn [the] [media] [Entertainment] [Center] Off

      Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) turn [the] [media] [Entertainment] [Center] On

      Apr-11 10:41:08 AM Info Plugin Nest has connected. IP:127.0.0.1:58489

      Apr-11 10:41:08 AM Kinect DEBUG Rule:[stop music] [stop playback]

      Apr-11 10:41:08 AM Kinect DEBUG Rule:what is *

      Apr-11 10:41:08 AM Kinect DEBUG Rule:motion check

      Apr-11 10:41:08 AM Kinect DEBUG Rule:[Regular Lights] [make it brighter]

      Apr-11 10:41:08 AM Kinect DEBUG Rulelay disney playlist

      Apr-11 10:41:08 AM Kinect DEBUG Rule:[start playing] [start music]

      Apr-11 10:41:08 AM Kinect DEBUG Rule:what time is it

      Apr-11 10:41:08 AM Kinect DEBUG Rule:[stop music] [stop playback]

      Apr-11 10:41:08 AM Kinect DEBUG Rule:[next song] [next track] [skip track]

      Apr-11 10:41:08 AM Kinect DEBUG Rule:Command List

      Apr-11 10:41:08 AM Kinect DEBUG Rule:

      Apr-11 10:41:08 AM Kinect DEBUG Rule:alert

      Apr-11 10:41:08 AM Kinect DEBUG Rule:what is the power use

      Apr-11 10:41:08 AM Plug-In Finished initializing plug-in Kinect

      Apr-11 10:41:08 AM Kinect DEBUG Rule:[turn on] morning lights

      Apr-11 10:41:08 AM Kinect DEBUG Rule:good morning

      Apr-11 10:41:08 AM Kinect DEBUG Rulelay christmas playlist

      Apr-11 10:41:08 AM Kinect DEBUG Building Grammars

      Apr-11 10:41:08 AM Kinect DEBUG End Init

      Apr-11 10:41:08 AM Kinect INFO Kinect initialized

      Apr-11 10:41:08 AM Kinect DEBUG Snapshot server started: http://*:3000/kinectsnapshot/

      Apr-11 10:41:08 AM Kinect DEBUG Web Pages Registered

      Apr-11 10:41:08 AM Kinect DEBUG Visual Recognition Initialized

      Apr-11 10:41:08 AM Kinect DEBUG Writing image file Kinect/zones_FamilyRoom/zones1.jpg

      Apr-11 10:41:08 AM Kinect DEBUG Deleting image file Kinect/zones_FamilyRoom/zones0.jpg

      Apr-11 10:41:07 AM Kinect DEBUG Drawing Zones File

      Apr-11 10:41:07 AM Kinect DEBUG CreateZoneDevice: End Enumerating Devices

      Apr-11 10:41:07 AM Kinect DEBUG CreateZoneDevice: Start Enumerating Devices

      Apr-11 10:41:07 AM Kinect DEBUG Voice Recognition Initialized

      Comment


        #33
        Originally posted by surovich View Post

        Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) [turn lights off] [lights off]

        Apr-11 10:41:08 AM Kinect DEBUG Rule (Devices) [turn lights on] [lights on]

        Apr-11 10:41:08 AM Kinect DEBUG Rule:[stop music] [stop playback]

        Apr-11 10:41:08 AM Kinect DEBUG Rule:[Regular Lights] [make it brighter]

        Apr-11 10:41:08 AM Kinect DEBUG Rule:[start playing] [start music]

        Apr-11 10:41:08 AM Kinect DEBUG Rule:[stop music] [stop playback]

        Apr-11 10:41:08 AM Kinect DEBUG Rule:[next song] [next track] [skip track]
        all the rules above are not ok, because they allow for an empty command to be recognized. I think for most of them you should use the multiple choices syntax <> rather than the optional [] syntax. Here is how I would rewrite them:

        [turn] lights off

        [turn] lights on

        stop <music|playback>

        <Regular Lights|make it brighter>

        start <playing | music>

        stop <music | playback>

        <next song|next track|skip track>

        Comment


          #34
          Makes sense - I didn't see that - Any idea why they worked until .29? All have been working perfectly. Upgraded to .29 last night and now issues.... Funny thing is, two remote Kinect's on .23 (Had them off, was going to upgrade tonight) are working fine, two Kinect's on .29 direct on the HS3 server, have issues.

          Comment


            #35
            Cleaned them up :

            Apr-11 11:35:55 PM Web Server Local IP address (subnet) is: 10.2.1.99 (255.255.255.0)

            Apr-11 11:35:55 PM Kinect DEBUG Speech Recognition Started

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) increase temperature

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) decrease temperature

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) set Temperature to (value)

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) turn [the] [Family Room] Lights Off

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) turn [the] [Family Room] Lights On

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) [turn] lights off

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) [turn] lights on

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) turn [the] [media] [Entertainment] [Center] Off

            Apr-11 11:35:55 PM Kinect DEBUG Rule (Devices) turn [the] [media] [Entertainment] [Center] On

            Apr-11 11:35:55 PM Kinect INFO Kinect version 3.0.0.22

            Apr-11 11:35:55 PM Kinect DEBUG Rule:what is *

            Apr-11 11:35:55 PM Kinect DEBUG Rule:motion check

            Apr-11 11:35:55 PM Kinect DEBUG Rule:

            Apr-11 11:35:55 PM Kinect DEBUG Rulelay disney playlist

            Apr-11 11:35:55 PM Kinect DEBUG Rule:start

            Apr-11 11:35:55 PM Kinect DEBUG Rule:what time is it

            Apr-11 11:35:55 PM Kinect DEBUG Rule:stop

            Apr-11 11:35:55 PM Kinect DEBUG Rule:

            Apr-11 11:35:55 PM Kinect DEBUG Rule:Command List

            Apr-11 11:35:55 PM Kinect DEBUG Rule:

            Apr-11 11:35:55 PM Kinect DEBUG Rule:alert

            Apr-11 11:35:55 PM Kinect DEBUG Rule:what is the power use

            Apr-11 11:35:55 PM Kinect DEBUG Rule:[turn on] morning lights

            Apr-11 11:35:55 PM Kinect DEBUG Rule:good morning

            It did lights off once, but I have asked for lights on 5 times and its not working - nothing is logging either, its acting like its not hearing anything at all (on both Kinect's direct attached).

            Comment


              #36
              Apr-11 11:35:55 PM Kinect DEBUG Rule:
              your log shows some empty rules, I don't know how is it possible since the plugin filters out the empty command.
              Where do these empty rules come from?

              also it says:
              Apr-11 11:35:55 PM Kinect INFO Kinect version 3.0.0.22
              so could you just start one instance that is not working (3.0.0.29) and post the logs for this instance only.

              thanks

              Comment


                #37
                Yeah, that's the odd thing - I don't have any empty rules - Before .29 that never showed in the log.

                The old plugin you saw is from a remote connection, it connected in the middle of the local one logging.

                Sure, I tried that before - it didn't help, but I'll do it for a test tomorrow.

                Odd thing tonight - About to go to bed, so I told the family room to turn off the media center - it worked, but it took forever to do it (20 seconds or more)

                Apr-12 9:57:22 PM Z-Wave Device: Z-Wave Node 65 Family Room Entertainment Center Switch Set to 0

                Apr-12 9:57:21 PM Device Control Device: Z-Wave Node 65 Family Room Entertainment Center Switch to Off (0) by/from: CAPI Control Handler

                Apr-12 9:57:21 PM Kinect DEBUG Computer turn media Off

                Apr-12 9:57:21 PM Kinect DEBUG Phrase recognized with confidence=0.9829738

                Apr-12 9:57:17 PM Z-Wave Warning Z-Wave Multilevel Sensor device Z-Wave Node 77 Z-Wave Interface Aeon Labs Power Node 77 Child is missing Sensor Type information - cannot update sensor status.

                Apr-12 9:57:06 PM Kinect TRACE Phrase rejected =

                Apr-12 9:57:05 PM Kinect TRACE Phrase hypothesized = computer, Confidence=0.138388

                Apr-12 9:57:05 PM Kinect TRACE Speech Detected:

                Apr-12 9:57:00 PM Kinect TRACE Phrase hypothesized = Computer turn media Off, Confidence=0.8387918

                Apr-12 9:57:00 PM Energy DB Warning Energy database maintenance may be needed. (51 >= 50)

                Apr-12 9:56:59 PM Kinect TRACE Phrase rejected =

                Apr-12 9:56:58 PM Kinect TRACE Phrase hypothesized = computer, Confidence=0.1342349

                Apr-12 9:56:57 PM Kinect TRACE Phrase hypothesized = computer, Confidence=0.04954168

                Apr-12 9:56:57 PM Kinect TRACE Speech Detected:

                Apr-12 9:56:53 PM Kinect TRACE Phrase hypothesized = Computer turn media, Confidence=0.889927

                Apr-12 9:56:53 PM Kinect TRACE Phrase hypothesized = Computer turn, Confidence=0.9635193

                Apr-12 9:56:53 PM Kinect TRACE Phrase hypothesized = Computer, Confidence=0.1394907

                Apr-12 9:56:53 PM Kinect TRACE Speech Detected:

                Apr-12 9:56:48 PM Kinect TRACE Phrase rejected =

                Apr-12 9:56:46 PM Kinect TRACE Phrase hypothesized = computer, Confidence=0.2198275

                Apr-12 9:56:46 PM Kinect TRACE Speech Detected:

                Apr-12 9:56:42 PM Z-Wave Device: Node 84 Z-Wave Power Set to 18.417 (W)

                Apr-12 9:56:42 PM Z-Wave Device: Node 84 Z-Wave Watts Set to 18.417 (18.417 Watts)

                Apr-12 9:56:39 PM Kinect TRACE Computer turn Off

                Comment


                  #38
                  the logs you posted, do you copy them from the HS web interface or from the console? Maybe we see some empty rules because they contain some special characters and HS try to display them as html.

                  anyway in version 3.0.0.30 I have added the possibility to log to a file, so please install, turn that setting on, set file log level to trace, and send me the full log file when a problem occurs:

                  The logs are writen to Logs/Kinect_<instance_name>.txt

                  Comment


                    #39
                    Cool Spud - Will do ... It worked last night, but tonight it stopped triggering anything ... It does seem to be better with only one Kinect enabled - but I'll log and update all clients to .30 to track this down.

                    Comment


                      #40
                      Hey Spud -

                      So, I'm back to testing with a single Kinect, and last night it worked mostly, today I asked to turn on my media center and it did work, but so slow to do it - Before .29 it was quick -

                      Apr-15 6:53:27 PM Z-Wave Device: Family Room Entertainment Center Switch Set to 255

                      Apr-15 6:53:26 PM Device Control Device: Family Room Entertainment Center Switch to On (255) by/from: CAPI Control Handler

                      Apr-15 6:53:26 PM Kinect DEBUG Computer turn On

                      Apr-15 6:53:26 PM Kinect DEBUG Phrase recognized with confidence=0.9064624

                      Apr-15 6:53:23 PM Kinect TRACE Phrase hypothesized = Computer turn, Confidence=0.7993433

                      Apr-15 6:52:56 PM Kinect TRACE Phrase hypothesized = Computer, Confidence=0.01004556

                      Apr-15 6:52:56 PM Kinect TRACE Speech Detected:

                      Apr-15 6:52:43 PM Kinect TRACE computer the Light off

                      Apr-15 6:52:43 PM Kinect TRACE Phrase recognized but confidence=0.04962531 is lower than threshold

                      Apr-15 6:52:42 PM Kinect TRACE Phrase hypothesized = computer the Light off, Confidence=0.03933177

                      Apr-15 6:52:41 PM Kinect TRACE Phrase hypothesized = computer the Light, Confidence=0.05468006

                      Apr-15 6:52:41 PM Kinect TRACE Phrase hypothesized = computer set Temperature to, Confidence=0.05026967

                      Apr-15 6:52:41 PM Kinect TRACE Phrase hypothesized = computer the Light, Confidence=0.05731368

                      Apr-15 6:52:40 PM Kinect TRACE Phrase hypothesized = computer, Confidence=0.02772311

                      Apr-15 6:52:39 PM Kinect TRACE Phrase hypothesized = computer the, Confidence=0.08246318

                      Apr-15 6:52:36 PM Kinect TRACE Phrase hypothesized = computer, Confidence=0.06330082

                      Apr-15 6:52:36 PM Kinect TRACE Speech Detected:


                      The rules from the log file for the Kinect :

                      Apr-14 21:42:58 DEBUG Building Grammars
                      Apr-14 21:42:58 DEBUG Rulelay christmas playlist
                      Apr-14 21:42:58 DEBUG Rule:good morning
                      Apr-14 21:42:58 DEBUG Rule:what is the power use
                      Apr-14 21:42:58 DEBUG Rule:alert
                      Apr-14 21:42:58 DEBUG Rule:<hello|motion check|check nest settings>
                      Apr-14 21:42:58 DEBUG Rule:Command List
                      Apr-14 21:42:58 DEBUG Rule:<next song|next track|skip track>
                      Apr-14 21:42:58 DEBUG Rule:stop <playing|music>
                      Apr-14 21:42:58 DEBUG Rule:what time is it
                      Apr-14 21:42:58 DEBUG Rule:start <playing|music>
                      Apr-14 21:42:58 DEBUG Rulelay disney playlist
                      Apr-14 21:42:58 DEBUG Rule:<Regular Lights|make it brighter>
                      Apr-14 21:42:58 DEBUG Rule:motion check
                      Apr-14 21:42:58 DEBUG Rule:what is *
                      Apr-14 21:42:58 DEBUG Rule (Devices) turn [the] [media] [Entertainment] [Center] On
                      Apr-14 21:42:58 DEBUG Rule (Devices) turn [the] [media] [Entertainment] [Center] Off
                      Apr-14 21:42:58 DEBUG Rule (Devices) [turn] lights on
                      Apr-14 21:42:58 DEBUG Rule (Devices) [turn] lights off
                      Apr-14 21:42:59 DEBUG Rule (Devices) turn [the] [Family Room] Lights On
                      Apr-14 21:42:59 DEBUG Rule (Devices) turn [the] [Family Room] Lights Off
                      Apr-14 21:42:59 DEBUG Rule (Devices) set Temperature to (value)
                      Apr-14 21:42:59 DEBUG Rule (Devices) decrease temperature
                      Apr-14 21:42:59 DEBUG Rule (Devices) increase temperature
                      Apr-14 21:42:59 DEBUG Speech Recognition Started


                      I haven't added any rules for weeks - except the wildcard. I removed the wildcard and it didn't help ..... Anything else I can grab to help???

                      Comment


                        #41
                        can you post your ini file for this instance

                        how slow is it?
                        in your example you started to say "Computer, turn on" at 6:53:23 or 6:52:56, in other words did it took 30secs or 3secs?

                        can you try to revert back to the version that worked for you before, and confirm it is still working fast?

                        Comment


                          #42
                          Hey Spud -

                          I decided that today (after a week of not working well at all) and .25 is back to working great and fast on all 4 Kinect's.

                          When it was slow, it was about 30 seconds to do a command - IF it recognized one at all.

                          The family room ink :

                          [CAMERA]
                          netcam_enabled=True
                          snapshot_server_port=3000
                          [CONFIG_DEVICE]
                          15###voicecommand=True
                          15###255###command=turn [the] [media] [Entertainment] [Center] On
                          15###0###command=turn [the] [media] [Entertainment] [Center] Off
                          1166###voicecommand=True
                          1166###255###command=turn [the] [Family Room] Lights On
                          1166###0###command=turn [the] [Family Room] Lights Off
                          87###voicecommand=True
                          87###0###command=set Temperature to (value)
                          87###1000###command=decrease temperature
                          87###1001###command=increase temperature
                          388###voicecommand=True
                          388###255###command=[turn] lights on
                          388###0###command=[turn] lights off
                          [VOICE_RECOGNITION]
                          echo_cancellation=True
                          confidence_threshold=0.6
                          attention_phrase=Computer
                          save_recognized_phrase_as_wav_file=True
                          [GENERAL]
                          log_level=Trace
                          visual_recognition_enabled=True
                          kinect_sensor_id=USB\VID_0409&PID_005A\8&307BC0C1&0&4
                          voice_recognition_enabled=True
                          log_to_file_enabled=True
                          file_log_level=Trace
                          [ZONES]
                          2###name=Whole Room
                          2###type=Overall

                          I was .30 working for the RAW Wav feature ... very depressing

                          Comment

                          Working...
                          X