Announcement

Collapse
No announcement yet.

Datascraper and self-signed certificates

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    Datascraper and self-signed certificates

    Hi,

    Just trying to use the plugin to scrape some data from a Tesla Powerwall, but its using a self-signed certificate that it generates and I can't change it.

    Forgive me if i've missed where / how to do this, but i'm wanting to get the plugin to accept the self-signed certificate, and I couldn't find a way. I've enabled the recording of the text file, but haven't been able to work out how to do it, and tried the following:
    • Changing the SSL mode - none of these work
    • Enabling IE mode - in this case, I get the message below which is the usual click accept to ignore the self-signed cert message

    Any ideas how to fix?

    Many Thanks - Kieran
    <head>
    <link href="newErrorPageTemplate.css" rel="stylesheet" type="text/css">
    <meta http-equiv="x-ua-compatible" content="IE=edge">
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
    <title>This site isn't secure</title>

    <script language="javascript" src="invalidcert.js" type="text/javascript">
    </script>
    <script language="javascript" src="errorPageStrings.js" type="text/javascript">
    </script>
    <script language="javascript" src="httpErrorPagesScripts.js" type="text/javascript">
    </script>
    </head>
    <body onload="BodyLoad(); initMoreInfo('infoBlockID');">
    <div class="mainContent" id="contentContainer">
    <div class="title" id="invalidcert_mainTitle" style="color: rgb(169, 0, 0);">This site is not secure</div>
    <div class="BodyTextBlockStyle" id="invalidcert_subError">
    This might mean that someone's trying to fool you or steal any info you send to the server. You should close this site immediately.<br><br>
    </div>
    <div class="BaseTextBlockStyle"><a href="javascript:close();"><img width="20" height="20" class="shieldImage" alt="Recommended icon" src="shieldcheck.ico"><id id="invalidcert_closeTab">Close this tab</id></a><br></div>

    <div align="left" id="moreInformationAlign" aria-labelledby="moreInformation">
    <table>
    <tbody><tr>
    <td aria-labelledby="infoBlockIDImage" valign="top">
    <a onclick="javascript:expandCollapse('infoBlockID', true); return false;" href="#"><img class="actionIcon" id="infoBlockIDImage" alt="More information" src="down.png" border="0"></a>
    </td>
    <td valign="top">
    <span id="moreInfoContainer"><a href="javascript:expandCollapse('infoBlockID', true);">More information</a></span>

    </td>
    </tr>
    </tbody></table>

    <div class="infoBlock" id="infoBlockID" style="display: none;">
    <br>
    <b><span id="certReason" style="margin-left: 20px;">Your PC doesn't trust this website's security certificate.<br>The hostname in the website's security certificate differs from the website you are trying to visit.</span></b>
    <p id="ErrorCode" style="margin-left: 20px;">Error Code: DLG_FLAGS_INVALID_CA<br>DLG_FLAGS_SEC_CERT_CN_INVALID</p>
    <p class="BaseTextBlockStyle" id="override" style="margin-left: 20px;"><a id="overridelink" href="https://<url>/api/system_status/soe"><img width="20" height="20" class="shieldImage" alt="Not recommended icon" src="shieldcritical.ico">Go on to the webpage (not recommended)</a></p>
    </div>
    </div>
    </div>

    </body>

    #2
    I would think that adding the self-signed certificate to the trusted root certificate store of the machine running the plugin should work.

    Sent from my Pixel 2 using Tapatalk

    Comment


      #3
      There is actually a bug with the SSLMode which I noticed the other day. I'm not sure how I introduced this but TLS12 will always be selected. Let me correct that first......
      Jon

      Comment


        #4
        Hi jon00,

        Just installed the new ver - and its now working with the SSLMode=3072 value, without needing to import the self-signed cert

        Many thanks - now for the fun regex work - sigh... - you don't know a good regex generator at all, i had a look and they all seemed a bit over-complicated...

        Cheers,

        Kieran

        Comment


          #5
          If you send me your GrabX.txt file, I can take a look here. Also list the metrics you require.
          Jon

          Comment

          Working...
          X