KnowBrainer Speech Recognition
Decrease font size
Increase font size
Topic Title: Natlink/dragonfly newbie learning resources
Topic Summary: Beginner programmer needs help with writing speech grammars
Created On: 04/16/2018 02:23 PM
Status: Post and Reply
Linear : Threading : Single : Branch
 Natlink/dragonfly newbie learning resources   - j_mundel - 04/16/2018 02:23 PM  
 Natlink/dragonfly newbie learning resources   - Aaron Walker - 04/16/2018 03:17 PM  
 Natlink/dragonfly newbie learning resources   - G.J. Premo - 04/16/2018 04:50 PM  
 Natlink/dragonfly newbie learning resources   - quintijn - 04/17/2018 04:42 AM  
 Natlink/dragonfly newbie learning resources   - j_mundel - 04/17/2018 09:46 AM  
 Natlink/dragonfly newbie learning resources   - Ag - 12/08/2019 04:50 PM  
 Natlink/dragonfly newbie learning resources   - Aaron Walker - 04/17/2018 10:08 AM  
 Natlink/dragonfly newbie learning resources   - j_mundel - 04/17/2018 05:32 PM  
 Natlink/dragonfly newbie learning resources   - LexiconCode - 12/11/2019 06:00 PM  
 Natlink/dragonfly newbie learning resources   - alexander - 12/17/2019 05:14 PM  
 Natlink/dragonfly newbie learning resources   - LexiconCode - 12/17/2019 05:36 PM  
 Natlink/dragonfly newbie learning resources   - alexander - 12/17/2019 06:59 PM  
 Natlink/dragonfly newbie learning resources   - kkkwj - 06/28/2020 11:53 PM  
 Natlink/dragonfly newbie learning resources   - mdl - 07/04/2020 05:48 PM  
 Natlink/dragonfly newbie learning resources   - mdl - 07/04/2020 05:48 PM  
Keyword
 04/16/2018 02:23 PM
User is offline View Users Profile Print this message

Author Icon
j_mundel
Junior Member

Posts: 29
Joined: 04/16/2018

Hi.

Looking for some tips or resources to help a voice recognition and coding newbie get started on writing my own grammars.

Since installing natlink and dragonfly I have completed two 5 week online python coding courses. So now at least I understand the data structures and many of the commands/concepts inherent in dragonfly grammars (lists, dictionaries, classes, functions/methods etc.)

I have attempted to read through the dragonfly documentation but i still dont know what Im at tbh.

It seems that many people who are successful at creating their own grammars are already programmers. There does not seem to be too many non-programmers like me trying to use this software.

 

Can anyone recommend any learning material, forum posts or some fundamental knowledge required to be able to write grammars?

 

My goal is to write a grammar to write LaTeX markup within the Vim editor. Due to RSI I can't write for too long but I want to study maths/stats. Writing math with my voice using LaTeX through the use of Dragonfly seems like a viable approach. Any help or tips very much appreciated.

Thanks!

 

 

 04/16/2018 03:17 PM
User is offline View Users Profile Print this message

Author Icon
Aaron Walker
New Member

Posts: 20
Joined: 01/20/2018

Why don't you join us on https://github.com/synkarius/caster there is a gitter chat room link at the bottom of the page where you can connect with us.

I think these 3 resources will get you started. They're not exactly tutorials but I think it gives you a broader context of  information.

http://vocola.net/programming-by-voice-FAQ.html

http://explosionduck.com/wp/tag/voice-programming/

http://caster.readthedocs.io/en/latest/caster/doc/readthedocs/Voice%20Index/#dragonfly-and-natlink-documentation



 04/16/2018 04:50 PM
User is offline View Users Profile Print this message


G.J. Premo
Top-Tier Member

Posts: 821
Joined: 05/12/2007

You don't need to be a programmer if you use Vocola. Good explanation of how to use it at http://vocola.net/
On the other hand, DragonFly seems to me to be beyond the capacity of mere mortals.



 04/17/2018 04:42 AM
User is offline View Users Profile Print this message

Author Icon
quintijn
Top-Tier Member

Posts: 218
Joined: 07/28/2014

Maybe you could also try the Unimacro grammar _latex.py. http://qh.antenna.nl/unimacro/grammars/globalgrammars/latex/index.html



 04/17/2018 09:46 AM
User is offline View Users Profile Print this message

Author Icon
j_mundel
Junior Member

Posts: 29
Joined: 04/16/2018

@Aarpm Walker - thanks I will have a read of all of those links. I am compiling a list of all the forums and groups associated with voice programming and will add your gitter chat room suggestion to the list.

@G. J. Premo indeed I have gone straight to Dragonfly because I read it was the most powerful. But perhaps if Vocola has a less steep learning curve I might just start with that.

@quitijn I will certainly have a look at the Unimacro latex grammar and play around with it. Also, I really appreciate all the work you do with maintaining Natlink. It really is awesome and I hope to contribute someway in the future when I have the means.


I think I will continue working on learning Python until I reach a stage where I'm more comfortable working on Dragonfly macros. In the meantime, I will check out all those links and dabble with unimacro and vocola and see what can be achieved there. I have an eye on a career in data science so a setup akin to Tavis Rudd with Dragonfly + Emacs/Vim looks like an attractive solution due to its apparent versatility.

Thanks for all the feedback!

 12/08/2019 04:50 PM
User is offline View Users Profile Print this message

Author Icon
Ag
Top-Tier Member

Posts: 647
Joined: 07/08/2019

Originally posted by: j_mundel I am compiling a list of all the forums and groups associated with voice programming and will add your gitter chat room suggestion to the list.

 

did you post that list somewhere, on a wiki, in this forum, in the gitter chat room mentioned above?

 

I'm getting frustrated with the limits of Dragon/KnowBrainer scripting, and I'm trying to decide which something else I should hop over to.

 



-------------------------

DPG15.6 (also DPI 15.3) + KB, Sennheiser MB Pro 1 UC ML, BTD 800 dongle, Windows 10 Pro, MS Surface Book 3, Intel Core i7-1065G7 CPU @ 1.3/1.5GHz (4 cores, 8 logical, GPU=NVIDIA Quadro RTX 3000 with Max-Q Design.

 04/17/2018 10:08 AM
User is offline View Users Profile Print this message

Author Icon
Aaron Walker
New Member

Posts: 20
Joined: 01/20/2018

Don't burn yourself out and don't be afraid to ask questions. Learning the program with these tools is harder than just learning to program by traditional means.

A basic tutorial for dragonfly.
http://caster.readthedocs.io/en/latest/caster/doc/readthedocs/examples/rules/Dragonfly%20Rules/



 04/17/2018 05:32 PM
User is offline View Users Profile Print this message

Author Icon
j_mundel
Junior Member

Posts: 29
Joined: 04/16/2018

That link is VERY helpful. Thank you! I will go through that entire document as it looks really useful. 

 

Yeah learning to program has been tough going at times. Im taking separate courses away from dragonfly code and then going back to dragonfly and seeing if the code makes more sense. It has been working for me somewhat as in I understand more about the code now than when I initally started. Im beginning to understand the data structures that dragonfly code utilizes. Slowly but surely Ill get there!

 

Thanks again for the info 

 12/11/2019 06:00 PM
User is offline View Users Profile Print this message

Author Icon
LexiconCode
Senior Member

Posts: 82
Joined: 08/10/2018

An updated URL. I will edit as necessary in the future if the hyperlink changes.

A basic tutorial for dragonfly.
https://caster.readthedocs.io/en/latest/readthedocs/Rule_Construction/Intro_Into_Rules_and_Grammars/



 12/17/2019 05:14 PM
User is offline View Users Profile Print this message

Author Icon
alexander
Advanced Member

Posts: 188
Joined: 07/31/2016

Also rather than focusing on just the grammar I would give some thought to the environment you are using. This document discusses a number of items that you can think about with regards to getting around quickly
https://docs.google.com/document/d/e/2PACX-1vSGRicRTJ2iv7rzLnwYxGnUb39usUk_5o2KPxJ5YE91qv-W_lWHD1C7S4syAHM61VAheR5lQ6hoE55W/pub
Here's also another document that you can use as a reference which while the bit dated has a number of grammars to think about
https://docs.google.com/spreadsheets/d/1pk2gwTFbMebgYSsrxIFsZ-QvpEPWCybF8ypdeBvfBsg/pubhtml



 12/17/2019 05:36 PM
User is offline View Users Profile Print this message

Author Icon
LexiconCode
Senior Member

Posts: 82
Joined: 08/10/2018

Originally posted by: alexander Also rather than focusing on just the grammar I would give some thought to the environment you are using. This document discusses a number of items that you can think about with regards to getting around quickly https://docs.google.com/document/d/e/2PACX-1vSGRicRTJ2iv7rzLnwYxGnUb39usUk_5o2KPxJ5YE91qv-W_lWHD1C7S4syAHM61VAheR5lQ6hoE55W/pub Here's also another document that you can use as a reference which while the bit dated has a number of grammars to think about https://docs.google.com/spreadsheets/d/1pk2gwTFbMebgYSsrxIFsZ-QvpEPWCybF8ypdeBvfBsg/pubhtml

 

Who can I contact so I can update the Caster section of the Google doc?

 12/17/2019 06:59 PM
User is offline View Users Profile Print this message

Author Icon
alexander
Advanced Member

Posts: 188
Joined: 07/31/2016

just PM me.
 06/28/2020 11:53 PM
User is offline View Users Profile Print this message

Author Icon
kkkwj
Top-Tier Member

Posts: 829
Joined: 11/05/2015

Here is an updated link to the Caster web docs. Very well done.

https://caster.readthedocs.io/en/latest/



-------------------------

Win10/x64, AMD Ryzen 7 3700X, 64GB RAM, Dragon 15.3, SP 6 PRO, SpeechStart, Office 365, KB 2017, Dragon Capture, Samson Meteor USB Desk Mic, Klim and JUKSTG earbuds with microphones, 3 BenQ 2560x1440 monitors, Microsoft Sculpt Keyboard and fat mouse



 07/04/2020 05:48 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 869
Joined: 04/18/2009

The advice here is pretty good. If the existing latex command grammar in Unimacro works, that's going to be your easiest bet.
Likely you will need to supplement with some additional commands specific to your use case; Vocola is going to be your easiest bet for that until/if you need...
...multiple commands in a single utterance with some complexity. Think "two X-ray squared over three Yankee" to type "2x^2/3y". (If it's just stringing one command after another without pauses, Vocola does that fine.)
While you can do things like this in Vocola with enough cleverness, I would recommend using dragonfly or one of the dragonfly derivatives instead.

I vaguely recall seeing some website recently that had a very impressive system for writing math via voice. I'll see if I can find a link...
 07/04/2020 05:48 PM
User is offline View Users Profile Print this message


mdl
Top-Tier Member

Posts: 869
Joined: 04/18/2009

it's https://mathtalk.com/
Statistics
32171 users are registered to the KnowBrainer Speech Recognition forum.
There are currently 1 users logged in.
The most users ever online was 12124 on 09/09/2020 at 04:59 AM.
There are currently 359 guests browsing this forum, which makes a total of 360 users using this forum.

FuseTalk Standard Edition v4.0 - © 1999-2021 FuseTalk™ Inc. All rights reserved.