KnowBrainer Speech Recognition
Decrease font size
Increase font size
Topic Title: New Click by Voice issues and discussion thread
Topic Summary:
Created On: 04/29/2018 04:14 PM
Status: Post and Reply
Linear : Threading : Single : Branch
 New Click by Voice issues and discussion thread   - mdl - 04/29/2018 04:14 PM  
 New Click by Voice issues and discussion thread   - Edgar - 04/29/2018 05:08 PM  
 New Click by Voice issues and discussion thread   - Mphillipson - 05/22/2018 02:13 PM  
 New Click by Voice issues and discussion thread   - djb5718 - 05/21/2018 08:10 PM  
 New Click by Voice issues and discussion thread   - mdl - 06/09/2018 08:57 PM  
 New Click by Voice issues and discussion thread   - BillMiller823 - 08/03/2018 04:24 AM  
 New Click by Voice issues and discussion thread   - Mphillipson - 08/03/2018 11:16 AM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 08/03/2018 12:18 PM  
 New Click by Voice issues and discussion thread   - BillMiller823 - 08/04/2018 05:15 AM  
 New Click by Voice issues and discussion thread   - spock - 08/28/2018 02:44 PM  
 New Click by Voice issues and discussion thread   - mdl - 09/08/2018 04:23 PM  
 New Click by Voice issues and discussion thread   - dilligence - 09/09/2018 12:05 AM  
 New Click by Voice issues and discussion thread   - spock - 09/09/2018 01:33 PM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 09/09/2018 01:54 PM  
 New Click by Voice issues and discussion thread   - alexander - 03/30/2019 08:21 PM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 03/31/2019 12:59 PM  
 New Click by Voice issues and discussion thread   - alexander - 03/31/2019 07:36 PM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 04/13/2019 01:44 PM  
 New Click by Voice issues and discussion thread   - dilligence - 04/13/2019 02:45 PM  
 New Click by Voice issues and discussion thread   - squirtle2 - 04/12/2019 08:58 PM  
 New Click by Voice issues and discussion thread   - mdl - 05/04/2019 03:18 PM  
 New Click by Voice issues and discussion thread   - Steve Morris - 06/05/2019 09:22 PM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 06/06/2019 05:14 PM  
 New Click by Voice issues and discussion thread   - mdl - 07/20/2019 02:29 PM  
 New Click by Voice issues and discussion thread   - dilligence - 07/30/2019 08:36 PM  
 New Click by Voice issues and discussion thread   - Matt_Chambers - 07/30/2019 08:52 PM  
 New Click by Voice issues and discussion thread   - monkey8 - 08/13/2019 01:43 PM  
 New Click by Voice issues and discussion thread   - dilligence - 08/13/2019 05:01 PM  
 New Click by Voice issues and discussion thread   - squirtle2 - 06/30/2019 08:52 PM  
 New Click by Voice issues and discussion thread   - mdl - 07/20/2019 02:36 PM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 08/13/2019 08:33 PM  
 New Click by Voice issues and discussion thread   - dilligence - 08/13/2019 09:48 PM  
 New Click by Voice issues and discussion thread   - monkey8 - 08/14/2019 07:44 AM  
 New Click by Voice issues and discussion thread   - dilligence - 08/14/2019 08:35 AM  
 New Click by Voice issues and discussion thread   - monkey8 - 08/14/2019 09:23 AM  
 New Click by Voice issues and discussion thread   - Matt_Chambers - 08/14/2019 05:46 PM  
 New Click by Voice issues and discussion thread   - monkey8 - 08/16/2019 08:08 AM  
 New Click by Voice issues and discussion thread   - Matt_Chambers - 08/16/2019 08:58 AM  
 New Click by Voice issues and discussion thread   - monkey8 - 08/16/2019 09:49 AM  
 New Click by Voice issues and discussion thread   - Matt_Chambers - 08/16/2019 11:24 AM  
 New Click by Voice issues and discussion thread   - monkey8 - 08/16/2019 11:46 AM  
 New Click by Voice issues and discussion thread   - Matt_Chambers - 08/16/2019 12:35 PM  
 New Click by Voice issues and discussion thread   - zmcgohan - 08/15/2019 05:40 PM  
 New Click by Voice issues and discussion thread   - jwstout - 08/30/2019 01:19 PM  
 New Click by Voice issues and discussion thread   - Matt_Chambers - 08/30/2019 01:56 PM  
 New Click by Voice issues and discussion thread   - mdl - 09/22/2019 11:59 AM  
 New Click by Voice issues and discussion thread   - mdl - 09/22/2019 12:05 PM  
 New Click by Voice issues and discussion thread   - mdl - 09/22/2019 12:10 PM  
 New Click by Voice issues and discussion thread   - mdl - 09/22/2019 12:12 PM  
 New Click by Voice issues and discussion thread   - mdl - 09/22/2019 12:21 PM  
 New Click by Voice issues and discussion thread   - mdl - 09/22/2019 12:22 PM  
 New Click by Voice issues and discussion thread   - jwstout - 10/19/2019 03:52 PM  
 New Click by Voice issues and discussion thread   - zmcgohan - 01/06/2020 05:37 PM  
 New Click by Voice issues and discussion thread   - dougransom - 04/01/2020 11:44 PM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 04/02/2020 11:28 AM  
 New Click by Voice issues and discussion thread   - zmcgohan - 04/06/2020 09:23 PM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 04/06/2020 10:42 PM  
 New Click by Voice issues and discussion thread   - Steve Morris - 08/16/2020 07:15 PM  
 New Click by Voice issues and discussion thread   - Lunis Orcutt - 08/16/2020 11:22 PM  
 New Click by Voice issues and discussion thread   - rob - 08/26/2020 01:04 PM  
 New Click by Voice issues and discussion thread   - mdl - 08/26/2020 10:02 PM  
 New Click by Voice issues and discussion thread   - rob - 08/27/2020 07:43 AM  
 New Click by Voice issues and discussion thread   - dilligence - 08/27/2020 04:05 PM  
 New Click by Voice issues and discussion thread   - rob - 08/27/2020 04:57 PM  
 New Click by Voice issues and discussion thread   - dilligence - 08/27/2020 08:30 PM  
 New Click by Voice issues and discussion thread   - rob - 08/28/2020 09:18 AM  
 New Click by Voice issues and discussion thread   - dilligence - 08/28/2020 10:58 AM  
 New Click by Voice issues and discussion thread   - MDH - 08/30/2020 11:54 AM  
 New Click by Voice issues and discussion thread   - dilligence - 08/31/2020 01:20 PM  
 New Click by Voice issues and discussion thread   - mdl - 08/28/2020 12:38 PM  
 New Click by Voice issues and discussion thread   - rob - 08/28/2020 01:32 PM  
 New Click by Voice issues and discussion thread   - mdl - 08/28/2020 04:44 PM  
 New Click by Voice issues and discussion thread   - mdl - 08/28/2020 04:45 PM  
 New Click by Voice issues and discussion thread   - rob - 08/29/2020 11:37 AM  
 New Click by Voice issues and discussion thread   - rob - 08/30/2020 12:09 PM  
 New Click by Voice issues and discussion thread   - MDH - 08/30/2020 12:19 PM  
 New Click by Voice issues and discussion thread   - rob - 08/31/2020 11:09 AM  
 New Click by Voice issues and discussion thread   - rob - 08/31/2020 01:57 PM  
 New Click by Voice issues and discussion thread   - MDH - 08/31/2020 08:46 PM  
 New Click by Voice issues and discussion thread   - rob - 09/06/2020 12:45 PM  
 New Click by Voice issues and discussion thread   - MDH - 09/06/2020 12:51 PM  
 New Click by Voice issues and discussion thread   - rob - 09/06/2020 01:11 PM  
 New Click by Voice issues and discussion thread   - MDH - 09/07/2020 09:21 AM  
 New Click by Voice issues and discussion thread   - Edgar - 09/07/2020 11:32 AM  
 New Click by Voice issues and discussion thread   - rob - 08/31/2020 02:10 PM  
 New Click by Voice issues and discussion thread   - dilligence - 08/31/2020 10:50 PM  
 New Click by Voice issues and discussion thread   - rob - 09/06/2020 12:57 PM  
 New Click by Voice issues and discussion thread   - rob - 09/06/2020 12:59 PM  
 New Click by Voice issues and discussion thread   - rob - 09/09/2020 06:27 AM  
 New Click by Voice issues and discussion thread   - MDH - 09/09/2020 10:35 AM  
Keyword
 04/29/2018 04:14 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

 04/29/2018 05:08 PM
User is offline View Users Profile Print this message

Author Icon
Edgar
Top-Tier Member

Posts: 915
Joined: 04/03/2009

It would be helpful to have a complete list of all the commands each with its own brief description.

It would be helpful if we had a command which gave us access to the font size used by the application in creating the hints. Now that 8K monitors are available <cringe>, but even at 1920 X 1080 the x-small font size is is way too small to read. I found a workaround with a combination of setting Chrome's font size and magnifying the page but this causes other items to be too large for convenience.

 

click-by-voice-master\src\show_hints.css

     19: font-size:   x-small        !important;



-------------------------

-Edgar
DPI 15.3, 64-bit Windows 10 Pro, OpenOffice & Office 365, Norton Security, Shure X2U XLR to USB mic adapter with Audio Technica DB135 vocal mic, Asus X299-Deluxe Prime, Intel Core i9-7940X (14 core, 4.3 GHz overclocked to 4.9 GHz), G.SKILL TridentZ Series 64GB (4 x 16GB) DDR4 3333 (PC4 26600) F4-3333C16Q-64GTZ, NVIDIA GIGABYTE GeForce GTX 1060 GV-N1060G1 GAMING-6GD REV 2.0 6GB graphics card with 3 1920x1080 monitors

 05/22/2018 02:13 PM
User is offline View Users Profile Print this message

Author Icon
Mphillipson
Top-Tier Member

Posts: 230
Joined: 09/22/2014

Hi Edgar,

 

There is a list of commands available at the following link:

 

Click Here



-------------------------

Thanks Mark


 


 


 


Dragon Professional Advanced Scripting/KnowBrainer Scripts
Video Examples of Coding by Voice

 05/21/2018 08:10 PM
User is offline View Users Profile Print this message


djb5718
Junior Member

Posts: 31
Joined: 10/22/2008

I just started using this recently, and it's great!

I would love a feature that Firefox mouseless browsing had, which is the ability to specify URLs where I never want the numbers shown. For example gmail, it has reasonably good keyboard support so the numbers just get in the way.

Thanks!

Dana
 06/09/2018 08:57 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

The next major release is planned to have the ability to configure click-by-voice on a per-URL basis. Might be a couple of months before I have time to finish this, however.
 08/03/2018 04:24 AM
User is offline View Users Profile Print this message

Author Icon
BillMiller823
Top-Tier Member

Posts: 256
Joined: 08/21/2010

Hi guys,

So I installed MDL's click by voice, and I see all these cool little numbers on my screen using Google Chrome.

I swear I read you can access the numbers in a single voice command, e.g. "pick 4 2" but I emulate that type of command without success.

Please forgive my ignorance, but what am I doing wrong?

I'm running DPI 15.3, KnowBrainer, and SpeechStart+ on Windows 10 64-bit.

Many thanks!

Bill

-------------------------


Bill Miller :-)
C1-2 Quadriplegic with a 255 High Bowling Game
Co-founder of Manufacturing Genuine Thrills Inc.
Business website: http://www.ikanbowler.com
Personal website: http://www.lookmomnohands.net

 08/03/2018 11:16 AM
User is offline View Users Profile Print this message

Author Icon
Mphillipson
Top-Tier Member

Posts: 230
Joined: 09/22/2014

Hi Bill,

 

In order to use it you need to use the KnowBrainer Commands.  I believe they were included in the latest commands released.

Please see the following screenshot, the 2 checked commands are the main ones to use.

 

https://www.screencast.com/t/qd69YC0r



-------------------------

Thanks Mark


 


 


 


Dragon Professional Advanced Scripting/KnowBrainer Scripts
Video Examples of Coding by Voice

 08/03/2018 12:18 PM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

Mark nailed it…

You're running an older version of KnowBrainer 2017. If you still have your original email, check the IMPORTANT paragraph which shows you how to update to the latest KnowBrainer 2017 commands now or in the future.



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1

 08/04/2018 05:15 AM
User is offline View Users Profile Print this message

Author Icon
BillMiller823
Top-Tier Member

Posts: 256
Joined: 08/21/2010

Thank you Mark and Lunis!

Now it is working beautifully, much appreciated (if only we could get the selected item to flash orange and blue instead of red and yellow, it would be beyond awesome - I'm kidding, sort of)... but MUCH MORE IMPORTANTLY I thank MDL for creating the extension!

For the sake of feedback about updating KnowBrainer commands, Lunis, obviously when I copied and pasted your XML commands file, that wiped out my existing commands, including all of my custom commands. Of course, I anticipated that, and had already saved my commands file, which I then imported the vocabularies in which I know I created custom commands.

But if I'm not mistaken, I think importing my old global vocabulary resulted in adding copies of certain commands, e.g. I noticed some have basically the same command name but with a 2 added. Am I wrong?

My only slight disappointment was that my previously disabled commands did not also import with the vocabularies that I imported. But, thankfully, I only prefer a small group be disabled (the "call" commands, the "close #" commands, the "print #" commands, the hibernate Windows command, the hidden mode command, and the "over" and "over and out" commands).

No worries - thanks!145



-------------------------


Bill Miller :-)
C1-2 Quadriplegic with a 255 High Bowling Game
Co-founder of Manufacturing Genuine Thrills Inc.
Business website: http://www.ikanbowler.com
Personal website: http://www.lookmomnohands.net



 08/28/2018 02:44 PM
User is offline View Users Profile Print this message

Author Icon
spock
New Member

Posts: 12
Joined: 08/28/2018

First of all a big thank you to mdl. Your excellent work has transformed the way I browse the internet.

You gave an example in the previous cbV thread of how to physicallly move the mouse to the desired element. Here is your code;

include "string.vch";

 

MoveMouse(hint) := 

 

Clipboard.Set("xyzzy") 
{ctrl+shift+space} Wait(500) $hint:X {enter} 
Clipboard.WaitForNew("xyzzy",5) 
Mouse.Go(window, Split(Clipboard.Get(),',',0), Split(Clipboard.Get(),',',1)); 

move pick 0..9 [0..9 [0..9 [0..9]]] = MoveMouse($1$2$3$4);

I was able to get it working successfully and it helps enormously for some tricky website menus.

Would it be possible to adapt the above code so that it works without invoking the click by voice entry box ?



 09/08/2018 04:23 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

spock, the following should work:

 

MoveMouse(hint) := 

    Variable.Set(chrome:oldClip, Clipboard.Get())

    Clipboard.Set($hint ':X') {ctrl+shift+.}

    Clipboard.WaitForNew($hint ':X',5)

    Mouse.Go(window,  Split(Clipboard.Get(),',',0), Split(Clipboard.Get(),',',1))

    Clipboard.Set(Variable.Get(chrome:oldClip));

 

Remember that this is experimental and doesn't quite work correctly with some DPI settings / when the browser has stuff like download bar at the bottom.

 09/09/2018 12:05 AM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

Yes, Click by Voice rocks! 

 

I just made an additional DVC list command to quickly scan any Google link I don't trust with virustotal.com

Just say the number of the link followed by: virus total. Examples: "44 virus total", "23 virus total"

 

Remember that this is a DVC command and the Wait is in milliseconds not seconds. Simply double-click any existing DVC command in your Command Browser and click the Create New button.

 

Command name:

 

<1to500> virus total

 

Script:

 

SendKeys "{Ctrl+Shift+Space}"

Wait 200

SendKeys _arg1

SendKeys ":k"

Wait 500

SendKeys "{Enter}"

Wait 100

SendKeys "{Ctrl+t}"

Wait 150

SendKeys "https://www.virustotal.com/en/#url"

Wait 200

SendKeys "{Enter}"

Wait 3000

SendKeys "{Tab}"

Wait 400

SendKeys "{Ctrl+v}"

Wait 200

SendKeys "{Enter}"

 

Perhaps you will have to adjust the Wait times a little with your system.



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite

 09/09/2018 01:33 PM
User is offline View Users Profile Print this message

Author Icon
spock
New Member

Posts: 12
Joined: 08/28/2018

no idea where the emoji came from there...

 09/09/2018 01:54 PM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

appears if you type : and o adjacently. You can disable this occasionally unwanted feature by putting a checkmark in Do not parse emotions



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1

 03/30/2019 08:21 PM
User is offline View Users Profile Print this message

Author Icon
alexander
Senior Member

Posts: 156
Joined: 07/31/2016

Is there a way to exclude websites by default? I get issues with Google sheets, and would like to just add that to a blacklist.
 03/31/2019 12:59 PM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

There is no way to exclude websites; especially if you're using the KnowBrainer Go To <dictation> command unless you remove certain words from your vocabulary. For example, if you say Go To <KnowBrainer> you might wind up at www.nobrainer.au because “KnowBrainer”, by default, is not in your vocabulary. Otherwise you will need to manually blacklist specific websites. Unfortunately, this process is not in our wheelhouse but if you can figure out, the steps that are involved, you can probably create a command to block certain websites.



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1



 03/31/2019 07:36 PM
User is offline View Users Profile Print this message

Author Icon
alexander
Senior Member

Posts: 156
Joined: 07/31/2016

Lunis, I think you misunderstood the question, and/or I did not state it properly. My understanding is this is the thread for click by voice the chrome extension by Mark.

What I would like is for hints to be automatically hidden for certain websites since when there, they actually create errors, presumably because the added numbers cause some sort of confusion during the loading of the site.
 04/13/2019 01:44 PM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

Alexander,

Sorry about misinterpreting your question. Click by Voice is an all or nothing feature. There is currently no way to isolate specific addresses and you can't even enable/disable Click by Voice without going through the Google Chrome extensions, which is 4 clicks away. We are working on a middle ground numbering variation that will allow you to show or hide numbers. This will also give you the option of creating a command that will allow you to go to a specific website and automatically toggle off numbers. You can optionally create another command that will display numbers when you go to other specific websites but this would involve a fair amount of work. A simple hide and show numbers toggle would probably be preferable. We are planning on doing something along those lines because numbers can really get in your way on certain websites. We are also considering 2 approaches. A single shot approach is currently built into SpeechStart+ and KnowBrainer 2017 now. Just say SHOW Numbers or DISPLAY Numbers to number everything. After you choose 1 of the numbers, all of the numbers disappear.



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1

 04/13/2019 02:45 PM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

Yes, disabling the hints per page would be preferred. Until that is implemented in Click by Voice I use the following DVC workaround to relatively quickly disable the extension itself:

 

Disable Click by Voice

 

SendKeys "{Ctrl+t}"

Wait 500

SendKeys "chrome://extensions/"

Wait 500

SendKeys "{Enter}"

Wait 500

SendKeys "{Tab 4}"

Wait 500

SendKeys "{Enter}"

Wait 500

SendKeys "{Ctrl+w}"

Wait 500

SendKeys "{F5}"

 

You can use the exact same command to enable it again.

 

Note that Tab 4 means that the first extension in the chrome extensions page is disabled. This depends on the order and amount of extensions you have installed.

Also note that this is a DVC command and Wait 500 means 500 milliseconds (in Advanced Scripting it would mean 500 seconds (!)).



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite

 04/12/2019 08:58 PM
User is offline View Users Profile Print this message

Author Icon
squirtle2
Power Member

Posts: 55
Joined: 11/10/2018

Sometimes when I'm using click by voice and I click on a few links (using click by voice), the numbers increase at every new page (i.e. every time I click on a link) and pretty soon all the numbers are in the thousands even though there are only a handful of links on the page. Is there a way to get it so that this doesn't happen? If I refresh the page, that seems to make the numbers become smaller but that's a bit annoying to have to do that. Thanks in advance!

-------------------------

Caster: take Dragon to the next level!


Please join us! https://gitter.im/dictation-toolbox/Caster


 


 


 


 


 

 05/04/2019 03:18 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

put up a clarifying post on how to enable and disable click-by-voice without disabling the extension: http://www.knowbrainer.com/forums/forum/messageview.cfm?catid=25&threadid=33147&enterthread=y



 06/05/2019 09:22 PM
User is offline View Users Profile Print this message

Author Icon
Steve Morris
Top-Tier Member

Posts: 202
Joined: 07/22/2007

Hi. Is there a way to activate links using Click by Voice without bringing up the text box (ctrl+shift+space)? We have a Customer Relationship Management system that opens chrome in app mode which blocks menus and that box.

Additionally, the click by voice numbers keep increasing. That is, the first item in a page is initially "0". But as I make selections using CbV they increase despite being the first item on the page.  

I have a command called "reset numbers" that runs the following code. But it would be better if it automatically did it? I assume I am missing something.

SendKeys "^+{Space}"

Wait .5

SendKeys ":=-{Enter}"

Wait .5

SendKeys "^+{Space}"

Wait .5

SendKeys ":={+}c{Enter}"

 


Thanks very much.



-------------------------

 


 


Steve 



 06/06/2019 05:14 PM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

Edited on August 14, 2019

Just substitute {Ctrl+Shift+.} for {Ctrl+Shift+Space}



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1



 07/20/2019 02:29 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

"Is there a way to activate links using Click by Voice without bringing up the text box (ctrl+shift+space)?"

Yes, see https://github.com/mdbridge/click-by-voice/blob/master/doc/making_voice_commands.md

 07/30/2019 08:36 PM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

Copied from mdl's Github page:

 

"That is, the recommended procedure to send a command cmd to Click by Voice is:

 

retrieve the current text value of the clipboard, call it clip

set the contents of the clipboard to cmd!!!clip

send synthetic keystrokes for {ctrl+shift+.} to invoke the shortcut"

 

Is there any way to accomplish this with regular Dragon voice commands (preferably DVC) for non-Python users?

 

(PG, Lindsay, Lunis )



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite



 07/30/2019 08:52 PM
User is offline View Users Profile Print this message

Author Icon
Matt_Chambers
Top-Tier Member

Posts: 254
Joined: 08/09/2018

Originally posted by: dilligence Copied from mdl's Github page:

 

"That is, the recommended procedure to send a command cmd to Click by Voice is:

 

retrieve the current text value of the clipboard, call it clip

 

set the contents of the clipboard to cmd!!!clip

 

send synthetic keystrokes for {ctrl+shift+.} to invoke the shortcut"

 

Is there any way to accomplish this with regular Dragon voice commands (preferably DVC) for non-Python users?

 

(PG, Lindsay, Lunis )

 

 

Good question.  I've tried to do this two or three different ways over the last few days, but have had no success, using Advanced Scripting.



 08/13/2019 01:43 PM
User is offline View Users Profile Print this message

Author Icon
monkey8
Top-Tier Member

Posts: 3573
Joined: 01/14/2008

I gave an answer for this here:

 

http://www.knowbrainer.com/forums/forum/messageview.cfm?catid=3&threadid=32699&enterthread=y#166967

 

Also please note that since Windows update 1903 Google Chrome and chromium edge are fully UIA compliant so you don't need chrome extensions any more with applications I developed like knowbrainer, or Speechstart+.  Also bear in mind that click by voice has restrictions (security) on pages like new tabs, settings, not to mention the control menus at the top of the browser blah blah blah.

 

Having said all of that I like click by voice a lot so would still recommend it for chrome or chromium edge. The other applications could be used for the menus and restricted pages like new tabs or settings for users who have already purchased these applications.



-------------------------



 08/13/2019 05:01 PM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

Sorry, must've missed the SendKeys"^+." you were already using in that thread.

 

Thank you this works a treat!



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite

 06/30/2019 08:52 PM
User is offline View Users Profile Print this message

Author Icon
squirtle2
Power Member

Posts: 55
Joined: 11/10/2018

Bug report: sometimes click by voice accidentally inserts the numbers (the hints) into text fields so that I end up having numbers typed into text fields. I have occasionally noticed this on Github, Slack, KnowBrainer forum, and Google groups. It is particularly troublesome on Github because when I'm editing a file on there sometimes it changes the name of the file by inserting numbers into the file name which causes problems. I've tried messing around with some of the different options like in-line versus overlay, I think that might help a bit but the overlay also is in the way of the text so I can't see anything. I can turn off the numbers for certain sites, but I would have to do that for some of my most frequently used sites.thisI think this is a great product but this issue is causing a lot of problems for me,so I mostly switching to a similar product called vimium for now. Thanks for all your work on this!

-------------------------

Caster: take Dragon to the next level!


Please join us! https://gitter.im/dictation-toolbox/Caster


 


 


 


 


 

 07/20/2019 02:36 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

"click by voice accidentally inserts the numbers (the hints) into text fields"
unfortunately this is a known issue -- some applications actually read back from the webpage and get confused when they see the hints. :-(
I hope to fix this eventually with a smarter overlay mode but in the meantime you could try doing things like:
leave hints off by default for those pages and only toggle them on using overlay just before you choose ( this is probably not much better than vimuim in some respects)
turn off hints for just the affected elements
etc.
 08/13/2019 08:33 PM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

MDL,

We have just finished rewriting and uploading the KnowBrainer Click by Voice commands to double the executable speed, via your 
recommendation to change Ctrl+Shift+Space to Ctrl+Shift+. and using Windows clipboard. While doing this, we realized that we might be missing an important feature. Can you tell us if you have written a right-click Hint? If so, we couldn't find it. If not, could you put a right-click on our wish list?


We have also changed the KnowBrainer Click by Voice command naming convention to prevent interfering with other Mouseless Browsing extensions /utilities and enable KnowBrainer to permanently support Click by Voice. This will also make it easier for end-users because the entire Click by Voice command list will be located in the same place. Click by Voice KnowBrainer commands NOW begin with the word Mouse and end-users will be able to find all Click by Voice commands by simply saying Find Global Command <mouse>. You'll find the new Click by Voice command list at the bottom of the KnowBrainer Quickstart



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1



 08/13/2019 09:48 PM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

Lindsay/Lunis,

 

You may want to add a feature that restores previous clipboard contents after issuing the ClickByVoice command. Although the clipboard method is much faster (creating the Advanced Scripting command in KnowBrainer deploys significantly faster compared to the native Dragon Advanced Scripting command btw) it would be convenient if previous clipboard contents (i.e. copied text) would be maintained/restored (as can be done with Vocola, Python and AHK - as demonstrated by PG).



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite



 08/14/2019 07:44 AM
User is offline View Users Profile Print this message

Author Icon
monkey8
Top-Tier Member

Posts: 3573
Joined: 01/14/2008

Thank you for acknowledging how fast it is. Well in that case if you want to return the clipboard to what it was, if you use the <0to9> command as an example then it would be:

 

Sub Main
myClipboard = Clipboard$
Wait 0.2
Clipboard ListVar1
Wait 0.1
SendKeys"^+."
Wait 0.2
Clipboard myClipboard
End Sub

You may have to adjust the wait times and I have no idea if it would work with all clipboard contents but it does with text at least from quickly testing.


-------------------------



 08/14/2019 08:35 AM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

Awesome! Works great with text (not with files but that's less important).

 

Looks like setting all the waits to 0.1 works reliably.



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite

 08/14/2019 09:23 AM
User is offline View Users Profile Print this message

Author Icon
monkey8
Top-Tier Member

Posts: 3573
Joined: 01/14/2008

Numbers Off and Numbers On for your reference:

 

Sub Main

SendKeys "^+{Space}"

Wait 0.5

SendKeys ":-{Enter}"

End Sub

 

Sub Main

SendKeys "^+{Space}"

Wait 0.5

SendKeys ":{+}{Enter}"

End Sub

 

You could also use the clipboard for doing this instead of the drop down e.g. numbers off: Clipboard ":-"



-------------------------



 08/14/2019 05:46 PM
User is offline View Users Profile Print this message

Author Icon
Matt_Chambers
Top-Tier Member

Posts: 254
Joined: 08/09/2018

Originally posted by: monkey8 Thank you for acknowledging how fast it is. Well in that case if you want to return the clipboard to what it was,

 

if you use the <0to9> command as an example then it would be:

 

 

Sub Main

myClipboard = Clipboard$

Wait 0.2

Clipboard ListVar1

Wait 0.1

SendKeys"^+."

Wait 0.2

Clipboard myClipboard

End Sub

 

You may have to adjust the wait times and I have no idea if it would work with all clipboard contents but it does with text at least from quickly testing.

I'm confused.  I thought the Clipboard also needed to contain the command and "!!!", so to open, say link 76 in a new tab, the Clipboard needed to contain "t!!!76. 

 

What am I missing?



 08/16/2019 08:08 AM
User is offline View Users Profile Print this message

Author Icon
monkey8
Top-Tier Member

Posts: 3573
Joined: 01/14/2008

Originally posted by: Matt_Chambers 

 

I'm confused.  I thought the Clipboard also needed to contain the command and "!!!", so to open, say link 76 in a new tab, the Clipboard needed to contain "t!!!76. 

 

 

 

What am I missing?

 

 

To open a new tab giving a one digit example using KnowBrainer or advanced scripting you just need to add ":t" after the number in the clipboard. If there is more than one number like 325 then just add the ":t" after the last listvar you are assigning to clipboard like shown below.  Look at readme.md or something like that on gift hub:

 

Sub Main
myClipboard = Clipboard$
Wait 0.1
Clipboard  ListVar1 + ":t"
Wait 0.1
SendKeys"^+."
Wait 0.1
Clipboard myClipboard
End Sub

 



-------------------------



 08/16/2019 08:58 AM
User is offline View Users Profile Print this message

Author Icon
Matt_Chambers
Top-Tier Member

Posts: 254
Joined: 08/09/2018

Originally posted by: monkey8

 

 

 

To open a new tab giving a one digit example using KnowBrainer or advanced scripting you just need to add ":t" after the number in the clipboard. If there is more than one number like 325 then just add the ":t" after the last listvar you are assigning to clipboard like shown below.  Look at readme.md or something like that on gift hub:

 

 

 

Sub Main
myClipboard = Clipboard$
Wait 0.1
Clipboard  ListVar1 + ":t"
Wait 0.1
SendKeys"^+."
Wait 0.1
Clipboard myClipboard
End Sub
 

 

Thanks!  I did read the GitHub documentation, but read the instructions here differently:

https://github.com/mdbridge/click-by-voice/blob/master/README.md



 08/16/2019 09:49 AM
User is offline View Users Profile Print this message

Author Icon
monkey8
Top-Tier Member

Posts: 3573
Joined: 01/14/2008

No problem Matt. Are you the same Matt (lawyer I think) who has been on the forum for quite a few years going way back? Or is it just a name coincidence?



-------------------------

 08/16/2019 11:24 AM
User is offline View Users Profile Print this message

Author Icon
Matt_Chambers
Top-Tier Member

Posts: 254
Joined: 08/09/2018

Originally posted by: monkey8 No problem Matt. Are you the same Matt (lawyer I think) who has been on the forum for quite a few years going way back? Or is it just a name coincidence?

 

I am that Matt! Not quite the same, in that I have retired from practicing law and am only doing some part-time consulting. I didn't really have any need for Dragon until recently, when the consulting required quite a bit of writing. I am sorry to say that my Advanced Scripting skills have atrophied.

I dug out my old commands and imported them into Dragon 15. I still have some that are based on commands you wrote. I have other commands that I apparently wrote myself, but confuse me these days! I am slowly reacquiring my skills.

 08/16/2019 11:46 AM
User is offline View Users Profile Print this message

Author Icon
monkey8
Top-Tier Member

Posts: 3573
Joined: 01/14/2008

Well Matt I always had you down as one of the best scripters on the forum going way back so get the polish out, good to see you back again!



-------------------------



 08/16/2019 12:35 PM
User is offline View Users Profile Print this message

Author Icon
Matt_Chambers
Top-Tier Member

Posts: 254
Joined: 08/09/2018

Originally posted by: monkey8 Well Matt I always had you down as one of the best scripters on the forum going way back so get the polish out, good to see you back again!

 

Thanks!  Seems like a long time ago.

 08/15/2019 05:40 PM
User is offline View Users Profile Print this message

Author Icon
zmcgohan
New Member

Posts: 20
Joined: 08/02/2019

Has anybody experienced an issue where all of the numbers appear on the webpage as they should, however neither of the extension's hotkeys work? {Ctrl+Shift+Space} simply toggles a gray circular background behind the extension's icon, while {Ctrl+Shift+.} doesn't appear to have any visible effect. I am still trying to figure out when exactly this occurs and how I fix it each time (usually a reinstall, however I think that sometimes the issue persists for a little beyond even that).

Update: reinstalled and it is working again. Will be paying more attention to see if I can figure out what (a specific theory site?) is breaking it.



 08/30/2019 01:19 PM
User is offline View Users Profile Print this message

Author Icon
jwstout
New Member

Posts: 6
Joined: 01/05/2016

MDL, have you considered releasing this for Firefox as well as Chrome? I have released a couple extensions on both, and I made zero code changes. Firefox now uses the Chrome extension API natively. I know that this was originally motivated by Mouseless Browsing for Firefox, but as I understand it, that no longer works, and this has diverged anyways.

There are many reasons to release on Firefox aside from the obvious "support the open web". One is that Firefox has better support for accessibility, especially on Linux where Chrome doesn't support it.
 08/30/2019 01:56 PM
User is offline View Users Profile Print this message

Author Icon
Matt_Chambers
Top-Tier Member

Posts: 254
Joined: 08/09/2018

And another reason is that Firefox is much better for user privacy than Chrome.  The new Microsoft Edge may be good on privacy, but I think it’s too early to tell.  

 09/22/2019 11:59 AM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

squirtle2, the numbers start over when you go to a truly new page or refresh the current page. Probably for the page in question when you click on a link it still staying at the same page.
Numbers are also refreshed when you issue a show hints command, which does not require reloading the page. That's what I recommend doing for now.
 09/22/2019 12:05 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

jwstout, I tried porting the extension to Firefox briefly but got stuck because I couldn't figure out how to get read from clipboard and write to clipboard to work on Firefox. :-(
these require weird workarounds on chrome to work around security restrictions, and presumably the workaround is different on Firefox.
 09/22/2019 12:10 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

Matt is correct; click by voice has a feature to make preserving the clipboard easier. With the discussed example it would be:

Sub Main
myClipboard = Clipboard$
Wait 0.1
Clipboard ListVar1 + ":t" + "!!!" + myClipboard
Wait 0.1
SendKeys"^+."
End Sub

This avoids the issue where you have to guess how long click by voice will take to execute a command -- Click by voice will automatically restore the clipboard after it finishes executing the command given.
Note that this only works for clipboard contents that are text (previous posted example also has this problem).
 09/22/2019 12:12 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

the other point with the !!! feature: you can wait for the clipboard to change to know when click by voice has accepted your command.
I miss spoke earlier -- click by voice restores the clipboard as soon as it accepts the command, not after it has finished executing it.
I wish I could do the latter, but it's not easy to implement.
 09/22/2019 12:21 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

Sadly, I don't have a decent version of right-click available yet. Figuring out the right synthetic events to send is somewhat tricky. I tried with experimental operation "R" (e.g. 36:R), but it doesn't seem to work most of the time. :-(
 09/22/2019 12:22 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

to get the effect of right-click, however, you can often first focus the element then send {shift+f10}.
 10/19/2019 03:52 PM
User is offline View Users Profile Print this message

Author Icon
jwstout
New Member

Posts: 6
Joined: 01/05/2016

Mark, I haven't worked with the clipboard myself in Firefox extensions, but I found this detailed (and up-to-date) documentation for you:
https://developer.mozilla.org/en-US/docs/Mozilla/Add-ons/WebExtensions/Interact_with_the_clipboard



 01/06/2020 05:37 PM
User is offline View Users Profile Print this message

Author Icon
zmcgohan
New Member

Posts: 20
Joined: 08/02/2019

Has anybody ran into major issues with text boxes including the numbers generated by Click by Voice?

There are a few sites, Gmail in particular, where the Click by Voice numbers insert themselves into the actual text box content. In Gmail, the entire Compose UI actually becomes right-adjusted unless you "hide hints".

On another site, I can't even use the UI without hiding the hints first because it will auto-submit the form with whatever number Click by Voice inserted.
 04/01/2020 11:44 PM
User is offline View Users Profile Print this message

Author Icon
dougransom
Junior Member

Posts: 33
Joined: 03/02/2017

I was hoping to tweak Click by Voice to display numbers over buttons. In this page, you can see that the buttons have an image placed over them.  the images are pretty much teh same size as teh buttons.

 

When the screen is rendered, i can briefly see the numbers in square brackets before the image is drawn for the button. I tried changing the z-order for the text in the that encoded thes the number, it doesn't do anything.

Anyone have any idea on how to modify the CSS for the span in this case (child of a button) so that it is always visible?  

Doug Ransom

 

 

 

 

 






-------------------------

Doug Ransom



 04/02/2020 11:28 AM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

We believe MDL released Click by Voice as a quick but limited way to use in Google Chrome and Microsoft Edge. Considering that he made his technology freeware and doesn't even ask for a donation, we owe him a great deal of thanks. With this in mind, we may not be able to expect much more.


We are mentioning this because several organizations are working on a faster, global and far more flexible/adjustable numbering approaches that should become available in early fall. We recommend waiting...



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1

 04/06/2020 09:23 PM
User is offline View Users Profile Print this message

Author Icon
zmcgohan
New Member

Posts: 20
Joined: 08/02/2019

Originally posted by: Lunis Orcutt We believe MDL released Click by Voice as a quick but limited way to use in Google Chrome and Microsoft Edge. Considering that he made his technology freeware and doesn't even ask for a donation, we owe him a great deal of thanks. With this in mind, we may not be able to expect much more.

 

We are mentioning this because several organizations are working on a faster, global and far more flexible/adjustable numbering approaches that should become available in early fall. We recommend waiting...

 

Can you expand on this? Officially-supported operating system-level numbering like iOS has with Voice Control?  or something less?

 04/06/2020 10:42 PM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

You will have to wait. We are now under an NDA



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1

 08/16/2020 07:15 PM
User is offline View Users Profile Print this message

Author Icon
Steve Morris
Top-Tier Member

Posts: 202
Joined: 07/22/2007

Hi. Is there any update on the universal numbering system around fall? 



-------------------------

 


 


Steve 

 08/16/2020 11:22 PM
User is offline View Users Profile Print this message

Author Icon
Lunis Orcutt
Top-Tier Member

Posts: 37992
Joined: 10/01/2006

The nature of an NDA is to limit what you can publicly disclose. An ETA is 1 of those limitations.



-------------------------

Forum Mission Statement
Trial Downloads
Dragon/Sales@KnowBrainer.com 
(615) 884-4558 ext 1

 08/26/2020 01:04 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

Hi,

Is there a command that will open a link in a new tab but keep the focus on the original tab? I know I can work around that with an extra step in the voice command but was just wondering if there is an option for that in click by voice?

Also has anyone noticed that when in the messenger section of Facebook on Microsoft edge most of the page links do not get numbered in the modern view of Facebook which will soon be the only view of Facebook since they are getting rid of the classic view in September?

In the classic view of Facebook in the messenger section everything gets numbered even the menu where you select emojis.

Thanks,
Rob



-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.



 08/26/2020 10:02 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

"Is there a command that will open a link in a new tab but keep the focus on the original tab?"

yes, use the b action
e.g., 13:b
 08/27/2020 07:43 AM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

Hi,

Thanks I should have realised that from the example code.

Has anyone else noticed the numbering problem with the new Facebook interface I mentioned in my previous post?

Thanks,
Rob

-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 08/27/2020 04:05 PM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

I really don't like that new Facebook UI, but I'm afraid we have no choice because switching back to Classic View is no longer possible beginning September.

Indeed ClickByVoice doesn't seem to have access to the main Facebook menu items on top of the page. I really hope this can be fixed.

 

Luckily VoiceComputer and SpeechStart+ still work with Facebook.

 

Rob



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite

 08/27/2020 04:57 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

Hi,

I don't mind the new Facebook UI apart from click by voice not working with it. I've not tried voice computer yet I did try their chrome extension on Edge but it didn't seem to work https://chrome.google.com/webstore/detail/intag-chrome/bdnfddhnghbkmplgkbihnfhndbngjdnf it said to press the backtick key or ctrl + backtick to show the numbers but nothing happened.

Has it worked for anyone else on Edge? Or do you need to have voice computer?

Thanks,

Rob



-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 08/27/2020 08:30 PM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

You are correct the extension doesn't seem to work with the most recent version of Edge anymore. However if you use VoiceComputer it is no longer needed because the standard Intags work very sufficient in every browser:

 

 

 

 

Update on the VC Intag Chrome extension. It most definitely does work but I forgot to disable ClickByVoice extension and remove its voice commands from my Dragon Command Browser before testing VC Intag Chrome extension :-(.



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite



 08/28/2020 09:18 AM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

With voice computer, do you have to say "show inTags" or whatever the command name is to show the numbers again in the browser, after each number selection or would it stay on like click by voice, renumbering the new links ready for selection again unless it is toggled off?

Thanks,
Rob



-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.



 08/28/2020 10:58 AM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

In VoiceComputer the intags automatically relaunch (refresh) after you have issued a specific number. That's the whole idea behind it. You'll soon get tired of having to say "show numbers" all the time.

 

However the VC intags of course need a fraction of a second to refresh, which is a slightly different process compared to the tagging in ClickByVoice and other HTML numbering extensions (which will usually tag the entire web page, including the sections that are not yet in view, like a very long Facebook page).

 

If you study the VC XML command files somewhat you'll find that you can easily modify names of existing commands or add new commands to the file. I added a whole bunch of them like properties <number>, add to archive <number>, extract <number>, open with <number>, control click <number> etc..

 

If you talk to your computer all day it is crucial to say the absolute minimum when it comes to commands you use a gazillion times a day. Hands-free users are already at risk of developing Voice Strain. That's why I renamed the default VC command names:

 

Show Numbers

Hide Numbers 

 

into simple:

 

Yes

No

 

This is what those sections now look like in the VC displaynumbers.xml:

 

<command type="vp-script">

        <name>

        <![CDATA[yes]]>

        </name>

        <actions>

        <customoverlay action="close" />

        <wait ms="500"/>

        <numbers action="display" />

        </actions>

        </command>

 

and:      

 

 <command type="vp-script">

        <name>

        <![CDATA[no]]>

        </name>

        <actions>

        <numbers action="close" />

        </actions>

        </command>

 

With a little more studying you will find that the VC XML files give you a lot of possibilities to create your own custom <numbers> commands for performing all kinds of mouse actions. Like for instance the VC script that is added to the SP Press Utility (now part of SP 6 PRO) where the voice command is Press <number> (i.e. "Press 15", "Press 24") to drag desktop items around by voice:

 

<command type="vp-script">


        <name>

        <![CDATA[press <1to300cf>]]>

        </name>

        <actions>

        <overlaymouseaction action="move" numbers="_value1"/>

        <wait ms="700"/>

        <mimic phrase="Press" />

        </actions>

        </command>

 

Rob



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite



 08/30/2020 11:54 AM
User is offline View Users Profile Print this message

Author Icon
MDH
Top-Tier Member

Posts: 2163
Joined: 04/02/2008

Dilligence,

 

I developed a monitor-independent way of simply creating mouse-positioning commands remotely that does not require number choosing methods such as Show Numbers, or Click-By-Voice (or variations), or mouse grids, and is independent of monitor size, resolution, or scaling. If you send me an image of something that I am not likely to have, I can create commands to demonstrate proof of concept and sent these back to you. I will send you a private message with my contact info.

 

MDH



-------------------------
 08/31/2020 01:20 PM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

MDH,

 

I sent you some screenshots yesterday (less known applications). However I now attached two others where I'm using Eviacam. I would particularly be interested in using your mouse position commands for its windows because I never managed to approach them reliably with mouse position commands before. There is something different about the Eviacam window.

 

I frequently need to get into its WebCam settings because they are often reset after Windows reboot (I want the frame rate to always be set to 30 for smooth performance) and therefore I have to manually uncheck some boxes which is a real pain in the keister.



evia.png
evia.png  (366 KB)
evia 2.png
evia 2.png  (303 KB)



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite



 08/28/2020 12:38 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

Yes, you aren't imagining things. The new version of Messenger is using
an iframe, which the current version of click-by-voice can't create
hints in. This is a known issue ("Elements inside of iframes are
missed").

Luckily, however, it's a same-origin iframe, which I believe shouldn't
be too hard to add support for. I have a patch that seems to work,
but I want to do some more testing and polishing before releasing it.
 08/28/2020 01:32 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

Hi, @dilligence thanks for the info.

@mdl Nice one! I look forward to trying the update.

-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 08/28/2020 04:44 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

I have submitted a new version of click-by-voice to the Chrome store that appears to work correctly with the new version of Messenger. Unfortunately, Google has substantially tightened their privacy policies and is requiring reviews of extensions that work on all pages so it could be a couple of weeks before it becomes available. :-(

If you are a power user and don't want to wait, you are course free to use the github version at https://github.com/mdbridge/click-by-voice.
 08/28/2020 04:45 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 817
Joined: 04/18/2009

(new version is 0.21.2 if you want to check to see if you have it yet.)
 08/29/2020 11:37 AM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

@mdl Nice one, just checked, it must have updated very recently! I went on to the Facebook messenger section and the numbers show again for all menus. That was a fast update!

-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 08/30/2020 12:09 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

@MDH sounds interesting, don't know what you mean about how it works though?

-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 08/30/2020 12:19 PM
User is offline View Users Profile Print this message

Author Icon
MDH
Top-Tier Member

Posts: 2163
Joined: 04/02/2008

Rob,

 

Send me some image that I would not likely have access to as per my private message to you and I will demonstrate proof of concept. No need to tell me your monitor size, resolution, or scaling. I will then send you back commands for your import to target those points.

 

MDH



-------------------------
 08/31/2020 11:09 AM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

Hi,

Here is a screenshot to check out the mouse positioning.

screenshot

Thanks,
Rob

 



-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.



 08/31/2020 01:57 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

@MDH I misunderstood before, you wanted a screenshot of an app you might not have, is that correct?

-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 08/31/2020 08:46 PM
User is offline View Users Profile Print this message

Author Icon
MDH
Top-Tier Member

Posts: 2163
Joined: 04/02/2008

Rob,

 

Yes, would be best to send something that I don't have access to make it a "cleaner" trial.

 

MDH

 



-------------------------
 09/06/2020 12:45 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

Hi,

Here is another screenshot to check out the mouse positioning, that any better?

image


Thanks,
Rob



-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.



 09/06/2020 12:51 PM
User is offline View Users Profile Print this message

Author Icon
MDH
Top-Tier Member

Posts: 2163
Joined: 04/02/2008

Rob,

 

I have not yet heard feedback (or replies to 2 previous private messages) regarding the previous commands that I created for you based on the prior image that you posted. That would be appreciated--Thanks much!

 

MDH



-------------------------
 09/06/2020 01:11 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

@MDH I had checked my inbox on this forum several times after you had sent me messages and nothing was there. And then saw the notifications today even though I had checked the inbox after the 2nd when you sent messages.

Anyway thanks, will try the commands and let you know how they are.

Has anyone else had a delay in getting messages on here?

 

Thanks,

Rob



-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 09/07/2020 09:21 AM
User is offline View Users Profile Print this message

Author Icon
MDH
Top-Tier Member

Posts: 2163
Joined: 04/02/2008

Rob,

 

Thanks.

 

MDH



-------------------------
 09/07/2020 11:32 AM
User is offline View Users Profile Print this message

Author Icon
Edgar
Top-Tier Member

Posts: 915
Joined: 04/03/2009

Originally posted by: rob   Has anyone else had a delay in getting messages on here?

My experience has been that the private messaging system on this forum is weak. Sometimes the message doesn't show up when I expose the left panel until long after it has been sent. Also, I don't get an email saying that I have a Private Message - Every other forum I visit does so.



-------------------------

-Edgar
DPI 15.3, 64-bit Windows 10 Pro, OpenOffice & Office 365, Norton Security, Shure X2U XLR to USB mic adapter with Audio Technica DB135 vocal mic, Asus X299-Deluxe Prime, Intel Core i9-7940X (14 core, 4.3 GHz overclocked to 4.9 GHz), G.SKILL TridentZ Series 64GB (4 x 16GB) DDR4 3333 (PC4 26600) F4-3333C16Q-64GTZ, NVIDIA GIGABYTE GeForce GTX 1060 GV-N1060G1 GAMING-6GD REV 2.0 6GB graphics card with 3 1920x1080 monitors

 08/31/2020 02:10 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

@dilligence is Eviacam pixel accurate and reliable as I tried software in the past and didn't find it accurate at all. I use the hardware version called a headmouse?

-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 08/31/2020 10:50 PM
User is offline View Users Profile Print this message

Author Icon
dilligence
Top-Tier Member

Posts: 1127
Joined: 08/16/2010

Originally posted by: rob @dilligence is Eviacam pixel accurate and reliable as I tried software in the past and didn't find it accurate at all. I use the hardware version called a headmouse?

 

Rob,

 

Yes, Eviacam is very precise. Not sure about pixel precision though, have never managed to keep my head still enough to move just one pixel

 

It really is important that you set your WebCam frame rate to 30 frames per second (that means disabling things like: white balance, saturation, backlight compensation etc..

 

The general advice I can give though is to use HeadTracking with care and not all the time, particularly if you are prone to neck pains. The same by the way, goes for foot pedals (which can easily injure your knees if you use them too much). 



-------------------------

www.speechproductivity.eu 


SP 6 PRO - The Dragon Enhancement & Productivity Suite

 09/06/2020 12:57 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

@dilligence thanks for the info. I've used a headmouse for years and it works well whatever the lighting conditions, but might come in handy if it breaks or for a different pc.

 

Does the webcam solution not need certain lighting conditions to work well?

 

Do you track a specific part of your face?

 

What type of webcam do you use?

 

Thanks,

Rob



-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.



 09/06/2020 12:59 PM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

@MDH ah weird hadn't seen the notification till now, will check them out.

-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.

 09/09/2020 06:27 AM
User is offline View Users Profile Print this message


rob
Advanced Member

Posts: 196
Joined: 11/29/2006

@MDH yeah commands seem to work fine.

@Edgar ah ok yeah that is what happened, I will need to watch out for that more when pm'ing someone on here. Also, don't know if anyone else has noticed, when trying to put an image in a private message it looks like it will send correctly but when it just shows a link tag that can't be clicked like this but with a little icon before it http://www.knowbrainer.com/for.../UserImages/1/rob.jpg" alt="" />

But I seem to be able add a link to the same pic in the forum no problem. Actually I think the problem was with adding an image to the private message and not linking to it.

Thanks,
Rob



-------------------------

Dragon Professional Group 15.6 with knowbrainer 2017 professional and speech start.



 09/09/2020 10:35 AM
User is offline View Users Profile Print this message

Author Icon
MDH
Top-Tier Member

Posts: 2163
Joined: 04/02/2008

"@MDH yeah commands seem to work fine. "

 

Rob,

 

Thanks for your feedback--much appreciated.

 

MDH



-------------------------
Statistics
31791 users are registered to the KnowBrainer Speech Recognition forum.
There are currently 1 users logged in.
The most users ever online was 12124 on 09/09/2020 at 04:59 AM.
There are currently 646 guests browsing this forum, which makes a total of 647 users using this forum.

FuseTalk Standard Edition v4.0 - © 1999-2020 FuseTalk™ Inc. All rights reserved.