Skip to content

Offline SpeechToText #2089

@VladislavAntonyuk

Description

@VladislavAntonyuk

Feature name

SpeechToText

Progress tracker

  • Android Implementation
  • iOS Implementation
  • MacCatalyst Implementation
  • Windows Implementation
  • Tizen Implementation
  • Unit Tests
  • Samples
  • Documentation

Summary

Free Speech recognition functionality that is available offline.

More details with samples at https://vladislavantonyuk.azurewebsites.net/articles/Speech-recognition-with-.NET-MAUI

Motivation

Allows offline SpeechToText to allow without internet connection.

Detailed Design

https://developer.apple.com/documentation/speech
https://developer.android.com/reference/android/speech/SpeechRecognizer
https://learn.microsoft.com/en-us/uwp/api/windows.media.speechrecognition?view=winrt-22621

The same API as online Speech Recognition but with Offline suffix

Usage Syntax

var isAuthorized = await speechToText.RequestPermissions();
		if (isAuthorized)
		{
			try
			{
				RecognitionText = await speechToText.StartListeningOffline(CultureInfo.GetCultureInfo(Locale?.Language ?? "en-us"), new Progress<string>(partialText =>
					{
						RecognitionText += partialText + " ";
					}), cancellationToken);
			}
			catch (Exception ex)
			{
				await Toast.Make(ex.Message).Show(cancellationToken);
			}
		}
		else
		{
			await Toast.Make("Permission denied").Show(cancellationToken);
		}

Drawbacks

No response

Alternatives

No response

Unresolved Questions

No response

Metadata

Metadata

Labels

approvedThis Proposal has been approved and is ready to be added to the Toolkitarea/essentialsIssue/Discussion/PR that has to do with Essentialsfeature request 📬

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions