On-device processing key to iPadOS Scribble's success hints Apple SVP Craig Federighi

Apple's handwriting recognition in the Apple Pencil relies on recognizing strokes, an interview with Craig Federighi reveals, while new features such as iPadOS' Scribble rely on massive amounts of onboard machine learning processing.

Introduced as part of iPadOS 14, Scribble enables users to fill out text fields and forms using the Apple Pencil, without needing to type anything out. It accomplishes this by performing onboard processing instead of cloud-based versions, as well as taking advantage of machine learning to improve its accuracy.Speaking to Popular Mechanics, Apple SVP of software engineering Craig Federighi explains how the Apple Pencil's handwriting recognition was produced. It all started with "data-gathering" by asking people around the world to write stuff down.

Read more...