What can we expect regarding speech recognition in Scrivener v3 for Windows?

we
weez
Posts: 10
Joined: Sun Mar 15, 2009 1:24 pm
Platform: Mac + Windows

Fri Dec 29, 2017 5:48 pm Post

I know that speech recognition capability in Scrivener v1 for Windows was very limited. Does anyone know what the plans are for speech recognition in v3? For example, is Dragon expected to work directly into Scrivener text windows? Will there be a way to issue Scrivener commands directly using speech? And so on....I know things may still be changing, but it would be nice to know what is being planned/considered. Most of what I was able to find online is largely speculation, so an "official" setting of expectations would be most appreciated. [Apologies if I used the wrong forum for this post]

rg
rgletter
Posts: 25
Joined: Mon Aug 14, 2017 9:45 pm
Platform: Win + iOS

Sat Dec 30, 2017 7:31 pm Post

That feature alone would be worth the purchase of scrivener or the 3.0 upgrade. It would be nice to have comparability with Amazon's Alexa or Google's Home voice recognition systems.

User avatar
kewms
Posts: 3381
Joined: Fri Feb 02, 2007 5:22 pm
Platform: Mac

Sat Dec 30, 2017 7:52 pm Post

rgletter wrote:That feature alone would be worth the purchase of scrivener or the 3.0 upgrade. It would be nice to have comparability with Amazon's Alexa or Google's Home voice recognition systems.


What does this even mean? Scrivener is extremely unlikely to learn how to turn your lights on or adjust your thermostat.

To the OP, you might want to ask Dragon about their plans for Scrivener compatibility. There isn't actually much to do on our side: Scrivener just takes the input from whatever source, be it the keyboard, the mouse, or Dragon-generated text.

(For the technically inclined, the Google Assistant SDK is public. You can get it running on any computer you like in a weekend or so.)

Katherine
Scrivener Support Team

User avatar
garpu
Posts: 1828
Joined: Mon Oct 25, 2010 9:38 pm
Platform: Linux

Sat Dec 30, 2017 8:41 pm Post

kewms wrote:What does this even mean? Scrivener is extremely unlikely to learn how to turn your lights on or adjust your thermostat.


I'd settle for Scrivener acquiring sentience and being able to do the dishes.
Slackware 64-bit 14.2, XFCE

User avatar
devinganger
Posts: 954
Joined: Sat Nov 06, 2010 1:55 pm
Platform: Mac + Windows
Location: Monroe, WA USA
Contact:

Sat Dec 30, 2017 9:13 pm Post

kewms wrote:To the OP, you might want to ask Dragon about their plans for Scrivener compatibility. There isn't actually much to do on our side: Scrivener just takes the input from whatever source, be it the keyboard, the mouse, or Dragon-generated text.


This might not be a Dragon-side thing, depending on how Qt is building the various UI controls. If I understand correctly, Dragon looks to hook into specific standard Windows control instances. If the corresponding Qt controls are not using those instances, or not inheriting the same objects and classes, then it might be up to the developer to add the appropriate SDK elements so that Dragon can "see" the Scrivener controls in the same way.
--
Devin L. Ganger
Devin on Earth: http://www.devinonearth.com/
Plotter on the streets, pantser in the sheets

we
weez
Posts: 10
Joined: Sun Mar 15, 2009 1:24 pm
Platform: Mac + Windows

Sat Dec 30, 2017 9:42 pm Post

devinganger wrote:This might not be a Dragon-side thing, depending on how Qt is building the various UI controls. If I understand correctly, Dragon looks to hook into specific standard Windows control instances. If the corresponding Qt controls are not using those instances, or not inheriting the same objects and classes, then it might be up to the developer to add the appropriate SDK elements so that Dragon can "see" the Scrivener controls in the same way.

This is ringing a bell from what I read some time ago. It was my understanding that the text boxes, etc. need to be implemented in such a way that Dragon (or whatever....) knows they have focus and can manipulate the buffer (inject text into it, cut/paste with it, etc.). If that is correct, then "Dragon support" would need to be provided on the Scrivener side by instrumenting the various Scrivener controls (e.g., text boxes) so that they can be made accessible to other applications (e.g., Dragon). I don't have any particular experience with this, so I'm just making some guesses.

User avatar
kewms
Posts: 3381
Joined: Fri Feb 02, 2007 5:22 pm
Platform: Mac

Sun Dec 31, 2017 12:22 am Post

There is no exposed Scrivener SDK, on either the Mac or Windows. Nor are there plans to create one.

Katherine
Scrivener Support Team

User avatar
devinganger
Posts: 954
Joined: Sat Nov 06, 2010 1:55 pm
Platform: Mac + Windows
Location: Monroe, WA USA
Contact:

Sun Dec 31, 2017 12:27 am Post

kewms wrote:There is no exposed Scrivener SDK, on either the Mac or Windows. Nor are there plans to create one.


Wrong way round. Dragon SDK.

https://www.nuance.com/dragon/for-devel ... r-kit.html

This allows Windows devs to add the hooks Dragon needs, if they are using widgets that Dragon doesn't already support. But, that requires additional licensing, so if Qt's widgets don't have the appropriate magic for Dragon to recognize them the way it does basic Windows system widgets, it seems it's up to Qt to fix their object inheritance.
--
Devin L. Ganger
Devin on Earth: http://www.devinonearth.com/
Plotter on the streets, pantser in the sheets

User avatar
kewms
Posts: 3381
Joined: Fri Feb 02, 2007 5:22 pm
Platform: Mac

Sun Dec 31, 2017 12:33 am Post

Ah, yes. And on the Mac -- which I'm much more familiar with -- Scrivener uses the Mac OS X system tools and therefore gets Dragon's ability to connect with those tools more or less for free.

Katherine
Scrivener Support Team

rg
rgletter
Posts: 25
Joined: Mon Aug 14, 2017 9:45 pm
Platform: Win + iOS

Wed Jan 03, 2018 8:15 pm Post

I suggest looking at Windows built-in Speech Recognition. Microsoft puts out an SDK with published APIs. This would benefit more Windows users.

https://msdn.microsoft.com/en-us/library/hh362938.aspx