iOS, converting handwriting to text

mi
miskryie
Posts: 6
Joined: Tue Aug 12, 2014 4:49 am
Platform: Mac

Tue Aug 08, 2017 4:28 pm Post

I asked and learned whether or not Scrivener could or had plans to allow handwritten notes or comments against manuscripts, and/or writing out the actual manuscripts, and they said they knew of no plans.
My follow up question that I know pose to all of you is are there any third party apps that convert to text for easy import into Scrivener?
The idea is to be able to use my iPad and stylus for prompt flash fiction events, or even to edit manuscripts, that can be brought back into the Scrivener app seamlessly.
Thank you!!!

User avatar
lunk
Posts: 2719
Joined: Wed Aug 21, 2013 4:24 pm
Platform: Mac + iOS
Location: Sweden 64° N

Tue Aug 08, 2017 4:42 pm Post

Notes Plus can do it...

https://ipadnotebook.wordpress.com/2017 ... g-to-text/

... but personally I prefer to use the Drafts app. It's not for handwriting, it uses a keyboard, but it is super-easy to use and you can easily send the text along to the Scratch pad in Scrivener (provided you store your Scratch pad on Dropbox).

https://ipadnotebook.wordpress.com/2016/04/24/drafts-4/
I am a user, writing non-fiction and science, using:
* Mac Scrivener 3 on a Macbook 12”, MacBook Pro 13”, and iMac 27”, all running the latest MacOS
* iOS Scrivener 1 on an iPhone 8, iPad Air 9.7”, and iPad Pro 12.9”, all running the latest iOS

Hu
Hugh
Posts: 2426
Joined: Thu Mar 08, 2007 12:05 pm
Platform: Mac
Location: UK

Fri Aug 11, 2017 2:01 pm Post

As you've probably learnt in looking at the possibility of converting handwriting to text for Scrivener, handwriting-to-text is a developing technology, and therefore imperfect. Myscript is a company that's been working at the technology longer than most, it licenses its technology to a number of other companies, and its latest application for iOS, Myscript Nebo, is highly regarded. It's a note-taking application and you'd have to copy and paste what you write into Scrivener. Another of Myscript's handwriting-to-text pieces of software, MyScript Stylus, will replace your keyboard and so may write directly into Scrivener; I don't know because I've not tried it.
'Listen, some quiet night, when you've shirked your work that day. Do you hear
that distant, almost inaudible clicking sound? That's one of your
competitors, working away in the night in
Paris or London or Erie, PA.'

User avatar
Silverdragon
Posts: 699
Joined: Mon Jul 29, 2013 2:52 pm
Platform: Mac + iOS
Location: Tarzana, California, USA
Contact:

Fri Aug 18, 2017 6:58 pm Post

I can speak to the handwriting replacement for onscreen keyboard issue.

I've used both MyScript Stylus (on-screen keyboard replacement) and WritePad for iPad (which also has an on-screen keyboard replacement.) Each has a learning curve, and depending on your style of handwriting you may prefer one or the other. I've used both for input into Scrivener, and they work as well for Scriv as they do for other apps.

Neither is for someone who wants to handwrite fast and not worry about the writing-to-text conversion. With each, I need to keep a close eye on how the conversion is going if I don't want nonsense to end up in my Scrivener doc. I've settled on WritePad, and use it when I just can't figure out what to write next. I pick up my stylus and start handwriting, and pretty soon I know what to write--at which point I switch to an external keyboard because it's MUCH more efficient. YMMV.
So you know where I'm coming from:
  • I'm a user, not an L&L employee.
  • Mac Scrivener 3.0.3, MacBook Air 11, MacOS 10.13.6 (High Sierra)
  • IOS Scrivener 1.1.5, iPhone 6s, iPad Air 2, iOS 12.0

br
brookter
Posts: 1713
Joined: Wed Mar 18, 2009 12:22 pm
Platform: Mac

Sat Aug 19, 2017 12:53 pm Post

I've just bought an iPad Pro 10.5" and have been looking for handwriting conversion apps. I've downloaded MyScript Nebo, Goodnotes, and Notes Plus.

If all you want to do is write text which can be converted then imported into Scrivener then IMO there is no question you should use Nebo (which also happens to be the cheapest, though none of them is expensive).

All three do the handwriting conversion in real time behind the scenes, using the same engine (My Script's) so the results are comparable. The difference is that Nebo displays the results as you type in a bar above the paragraph: you can see whether the conversion has succeeded immediately. Double tap and the paragraph is shown in its converted form, which you can then correct (in handwriting) using several gestures: e.g. Scrub out to delete text, a vertical downwards line to add a space or split a line, a vertical upwards line to join words or lines.

There are formatting gestures too: draw a box to highlight a selection, underline words to emphasise, double underline a paragraph to make it a heading, bullet lists etc.

This all works really well and is just so much simpler than the method used by Notes Plus and Goodnotes which focus on retaining your handwritten notes as they were written on the screen rather than showing the converted text. You can see it, but you have to draw round the handwriting, select it then choose convert: after a delay the text is shown in an a dialogue box for copying/sharing. This is excellent for note taking, but simply impractical for longer text.

Hugh's comment above about having to copy and paste into Scrivener is no longer correct, fortunately. All three can export as Word docx (not RTF) and as far as I can tell function properly as Scrivener docs when they're imported (via the normal Share mechanism).

Nebo can also incorporate diagrams (with recognition of shapes), and photos, and it enables you to enter (and even calculate, to some extent) formulae, which it will convert. The other two probably have more features for visual notes, but they are a long way behind Nebo for ease of use with text input.

TLDR: Goodnotes and Notes Plus are good apps, but only Nebo is a practical way to import handwritten drafts into Scrivener. IMHO, of course...

User avatar
nom
Posts: 1857
Joined: Sun Aug 31, 2008 12:02 am
Platform: Mac + iOS
Location: Melbourne, Australia
Contact:

Sat Sep 09, 2017 2:10 am Post

Even simpler than all the above is to install MyScript Stylus - Handwriting Keyboard. It allows you to write in the space where the keyboard usually appears & converts your writing into text on the fly. It's fast and remarkably accurate, even with my scratchy scrawl.
My only hesitation is it sometimes struggles with punctuation: I still haven't worked at how to get it to recognise an N- or M-dash and parentheses sometimes take a couple of goes. Also, MyScript don't seem to have updated it for a couple of years, so I'm not sure if it's being actively maintained.

Having said that I used to use it daily, and still use it regularly, with few problems.

While I also have Nebo, and have tried several other Notes apps, I keep coming back to MyScript. Highly recommended.
(written on my iPad with an Apple Pencil and MyScript Stylus)
Complete and utter NOMsense.
Image

User avatar
KB
Site Admin
Posts: 20114
Joined: Tue Jun 13, 2006 11:23 pm
Platform: Mac
Location: Truro, Cornwall
Contact:

Mon Sep 11, 2017 3:40 pm Post

I'm hoping that Apple will add a handwriting-to-text framework of their own to iOS at some point, at which point we can make use of it. That would be far be the best solution. I thought they might add something like this to iOS 11, as it seems an obvious addition to iOS. I would put good money on Apple having been working on something like this behind the scenes, though. They're probably just waiting until it is better than anything else out there before unveiling it. I'd be surprised if we don't see it introduced with a big iOS update in the next few years.
"You can't waltz in here, use my toaster, and start spouting universal truths without qualification."

Hu
Hugh
Posts: 2426
Joined: Thu Mar 08, 2007 12:05 pm
Platform: Mac
Location: UK

Tue Sep 12, 2017 9:50 am Post

I hope that you're right, Keith, and I suspect that you are. Although aware that handwriting-to-text isn't technically easy, I've been somewhat obsessional for a good while about the advantages for any kind of creative writing of handwriting over typing (and was pleased when brain research in the US appeared to support my obsessions a year or two ago). It will be great when one can hand-write directly into Scrivener for iOS and see the words converted to text directly on the Scrivener page.
'Listen, some quiet night, when you've shirked your work that day. Do you hear
that distant, almost inaudible clicking sound? That's one of your
competitors, working away in the night in
Paris or London or Erie, PA.'

ma
marcussommer
Posts: 4
Joined: Sun Nov 22, 2015 2:38 pm
Platform: Mac

Fri Sep 15, 2017 1:06 pm Post

Hi Hugh

allow myself to pinch you here.
will Nebo allow to write in various languages?
i’m polyglot and write mostly in german, english and/or french.
how is Nebo able to handle this?

carpe diem

Hugh wrote:As you've probably learnt in looking at the possibility of converting handwriting to text for Scrivener, handwriting-to-text is a developing technology, and therefore imperfect. Myscript is a company that's been working at the technology longer than most, it licenses its technology to a number of other companies, and its latest application for iOS, Myscript Nebo, is highly regarded. It's a note-taking application and you'd have to copy and paste what you write into Scrivener. Another of Myscript's handwriting-to-text pieces of software, MyScript Stylus, will replace your keyboard and so may write directly into Scrivener; I don't know because I've not tried it.

ma
marcussommer
Posts: 4
Joined: Sun Nov 22, 2015 2:38 pm
Platform: Mac

Fri Sep 15, 2017 1:07 pm Post

should i dug our my old Apple Newton :D

KB wrote:I'm hoping that Apple will add a handwriting-to-text framework of their own to iOS at some point, at which point we can make use of it. That would be far be the best solution. I thought they might add something like this to iOS 11, as it seems an obvious addition to iOS. I would put good money on Apple having been working on something like this behind the scenes, though. They're probably just waiting until it is better than anything else out there before unveiling it. I'd be surprised if we don't see it introduced with a big iOS update in the next few years.

Hu
Hugh
Posts: 2426
Joined: Thu Mar 08, 2007 12:05 pm
Platform: Mac
Location: UK

Fri Sep 15, 2017 2:08 pm Post

marcussommer wrote:Hi Hugh

allow myself to pinch you here.
will Nebo allow to write in various languages?
i’m polyglot and write mostly in german, english and/or french.
how is Nebo able to handle this?

carpe diem

Hugh wrote:As you've probably learnt in looking at the possibility of converting handwriting to text for Scrivener, handwriting-to-text is a developing technology, and therefore imperfect. Myscript is a company that's been working at the technology longer than most, it licenses its technology to a number of other companies, and its latest application for iOS, Myscript Nebo, is highly regarded. It's a note-taking application and you'd have to copy and paste what you write into Scrivener. Another of Myscript's handwriting-to-text pieces of software, MyScript Stylus, will replace your keyboard and so may write directly into Scrivener; I don't know because I've not tried it.


Marcus, I've sent you a PM about this in response to yours. But I think the short answer is that Nebo can handle 59 languages, including French and two forms of German, as well of course as English.
'Listen, some quiet night, when you've shirked your work that day. Do you hear
that distant, almost inaudible clicking sound? That's one of your
competitors, working away in the night in
Paris or London or Erie, PA.'

User avatar
arthaey
Posts: 9
Joined: Fri Sep 15, 2017 5:21 am
Platform: Mac + iOS
Contact:

Wed Sep 20, 2017 3:41 pm Post

If you like writing on physical paper and have a bit of money to burn…

I've been rather impressed by Livescribe 3's "smartpen", and especially impressed by the Neo N2. You write on special paper (buy or print) with a Bluetooth pen that syncs to your phone, then you have the app transcribe your handwriting into text. From there you can email it, sync with cloud services, or whatever.

User avatar
Jot
Posts: 174
Joined: Wed Oct 11, 2006 7:35 pm
Platform: Mac, Win + iOS

Wed Sep 20, 2017 8:46 pm Post

arthaey wrote:If you like writing on physical paper and have a bit of money to burn…

I've been rather impressed by Livescribe 3's "smartpen", and especially impressed by the Neo N2. You write on special paper (buy or print) with a Bluetooth pen that syncs to your phone, then you have the app transcribe your handwriting into text. From there you can email it, sync with cloud services, or whatever.

I loved my Livescribe pen until it...stopped working (sadly a regular occurrence for the pens) and Livescribe weren't interested in repairs. Unfortunately (for me) the new versions require you to do everything online rather than use the application (and have everything local) like my busted pen did. I could write for hours, plug it in to my not online laptop, download the pages and convert it with MyScript and whack it in Scrivener without phaffing about with email etc. If you don't always have internet access like me, the new system is a crock. I bought the new pen, discovered that I couldn't use it locally and took it back to the shop.

I am using the MyScript "keyboard" for the ipad though and am impressed how much better it copes with handwriting than my Livescribe pen/books did.
J

Hu
Hugh
Posts: 2426
Joined: Thu Mar 08, 2007 12:05 pm
Platform: Mac
Location: UK

Thu Sep 21, 2017 5:02 pm Post

Jot wrote:
arthaey wrote:
I am using the MyScript "keyboard" for the ipad though and am impressed how much better it copes with handwriting than my Livescribe pen/books did.


This matches my experience with Nebo - a step up from Livescribe.
'Listen, some quiet night, when you've shirked your work that day. Do you hear
that distant, almost inaudible clicking sound? That's one of your
competitors, working away in the night in
Paris or London or Erie, PA.'

bi
big_anemone
Posts: 5
Joined: Tue Apr 17, 2012 1:37 am
Platform: Mac

Fri Sep 22, 2017 12:46 am Post

Hugh wrote:
Jot wrote:
arthaey wrote:
I am using the MyScript "keyboard" for the ipad though and am impressed how much better it copes with handwriting than my Livescribe pen/books did.


This matches my experience with Nebo - a step up from Livescribe.


Agreed - although I don’t yet use Nebo on my ipad, when using a Microsoft Surface 3, Nebo is much more accurate for me than LiveScribe ever was, and also much better than Microsoft’s own OneNote. It would be nice, I suppose, to have some kind of handwriting integration into Scrivener, but copying text from Nebo works well, even if (like me) you’re moving between Windows and iOS.