KnowBrainer Speech Recognition
Decrease font size
Increase font size
Topic Title: Click by voice interferes with some scripts
Topic Summary: Scripts may behave strangely with click by voice present in memory
Created On: 04/25/2019 11:11 PM
Status: Post and Reply
Linear : Threading : Single : Branch
 Click by voice interferes with some scripts   - harpalus - 04/25/2019 11:11 PM  
 Click by voice interferes with some scripts   - Lunis Orcutt - 04/26/2019 10:17 AM  
 Click by voice interferes with some scripts   - harpalus - 04/26/2019 05:38 PM  
 Click by voice interferes with some scripts   - mdl - 05/04/2019 03:33 PM  
 Click by voice interferes with some scripts   - mdl - 11/26/2021 01:48 PM  
Keyword
 04/25/2019 11:11 PM
User is offline View Users Profile Print this message

Author Icon
harpalus
Top-Tier Member

Posts: 213
Joined: 10/05/2008

Click by voice unfortunately makes it impossible for some scripts to properly execute. The following example was tested in Google Chrome.

I have a paid subscription with newspapers.com that allows me to search Arizona newspapers published during the territorial years. I search for a desired term and obtain a webpage that has little windows that show the text around the desired search term. To the side of each little window is brief information about each newspaper page. Without the use of click by voice I have to move my mouse over the information opposite a given preview window and click on the information and select a menu choice to have the page open up in a new tab. With click by voice the information area opposite each preview window has a number.

 

When I want to obtain a copy of a given page, I call up a script

 

SendSystemKeys "{Ctrl+s}"

Wait 0.3

HeardWord "click", "entire", "page"

Wait 0.5HeardWord "click", "save"

'HeardWord "choose 2",

Wait 1

SetMousePosition 1,1006,371

Wait 1

ButtonClick 1,1

Wait 1

HeardWord "click", "save", "as", "JPG"

The first line of the script results in the page looking as shown below.

 

A black bar appears over part of the webpage and within that bar providing the choices of entire page or select portion of page. The script works perfectly in Google Chrome browser when click by voice is not in operation and gives me a JPEG file.

 

When click by voice is present, I get weird results in which part of the page is selected and then things stop. I have tried manually obtaining a JPEG file by using the keyboard to press control save, and then giving a verbal command to click the number associated with the entire page choice. The command is recognized, but absolutely nothing happens. If I say, "click entire page" , by voice, nothing happens. So click by voice somehow disables the ability to use my voice to click on the entire page choice.

 

To be able to get the script to work properly I have to disable the click by voice extension and then restart the browser. Merely disabling the extension and then attempting to give a verbal command of "click entire page" doesn't work.

 

 

The click by voice extension with the :b hint allows me to look at previews of pages of possible interest (each preview obtains a click by voice number) and then rapidly assemble a set of tabs that contain pages  of interest to me. However, to be able to save the pages in the various tabs as a JPEG, I have to disable the extension and then quit the browser to be able to execute properly the script for saving the pages as JPEG! Closing Google Chrome of course wipes out the information that I got into tabs by using click by voice.

 



-------------------------

GaryN

 04/26/2019 10:17 AM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 39769
Joined: 10/01/2006

We noticed the following line in your script:

Wait 0.5HeardWord "click", "save"

If you copied the script from your command, you should break it into 2 lines as follows:

Wait 0.5
HeardWord "click", "save"


or


Wait 0.5
SendKeys "^s"
'this is a little faster than HeardWord scripts

PS: You might also consider reducing the size of your inserted picture because we can barely fit the Reply button on a 32 inch monitor

 



-------------------------

Change "No" to "Know" w/KnowBrainer 2020
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ex 1



 04/26/2019 05:38 PM
User is offline View Users Profile Print this message

Author Icon
harpalus
Top-Tier Member

Posts: 213
Joined: 10/05/2008

Lunis, When I copied the script from my command, something happened and the carriage return after 0.5 became deleted. The script is the way you indicated it should be and when clicked by voice is not present works great. I don't understand why clicked by voice inhibits my clicking on things by voice but will have to disable it and restart Google Chrome when I want to save newspaper pages. I will endeavor indeed to reduce the size of inserted pictures!

-------------------------

GaryN

 05/04/2019 03:33 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 906
Joined: 04/18/2009

HeardWord has never been terribly reliable at best, but the problem here is probably that inline hints modify the HTML, which confuses Dragon about what the links' names are. Do you have any better luck with overlay mode (try the show hints command ':+o')? I unfortunately don't have a subscription to that website so can't test it myself. 


Using mouse clicks or keys only in your script is probably somewhat more reliable. Better yet would be using a CSS selector to tell click-by-voice which element to activate, but that requires some familiarity with web standards you may not have.

If you turn off click-by-voice temporarily (':once-'), does your script work? If so, you could have the script turn off hints, use the Dragon click commands, then turn hints back on again.



 11/26/2021 01:48 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 906
Joined: 04/18/2009

harpalus, did you ever get this working for you?

I'm pretty sure using a CSS selector would work and failing that the
new version of click-by-voice I have under review will probably make
the Dragon click command work again even while hints are present.
Statistics
32285 users are registered to the KnowBrainer Speech Recognition forum.
There are currently 0 users logged in.
The most users ever online was 12124 on 09/09/2020 at 04:59 AM.
There are currently 450 guests browsing this forum, which makes a total of 450 users using this forum.

FuseTalk Standard Edition v4.0 - © 1999-2022 FuseTalk™ Inc. All rights reserved.