Skip to content

NLP and NLP pipeline

Jump to bottom
Sagen Soren edited this page Nov 29, 2020 · 5 revisions

Natural Language processing

References

Natural language is the language that human beings communicate. That means we read and write in this language. The NLP(Natural Language Processing) refers to an AI method for communicating with an intelligent systems using a natural language(e.g. English). NLP is a method that makes computers to perform useful tasks with the natural languages humans use.

The input and output of a NLP system :

  • Speech
  • Written Text

Components of NLP

There are two components of NLP given as --

  • NLU(Natural Language Understanding)
  • NLG(Natural Language Generation)

NLU

NLU covers the reading aspect of NLP. The tasks involved in this process --

  • understanding the meaning of the input or the text given
  • classify the given text into proper intent
  • Intent : Intents are similar to verbs as they refer action
  • Entities : These are similar to noun which defines the intent

NLG

This covers the writing aspect as in this process we generate meaningful sentences to respond to the given text. NLG involves --

  • Text Planning
  • Sentence Planning
  • Text Realization

Ambiguity in NL

  • Lexical Ambiguity
  • Syntax Level Ambiguity
  • Referential Ambiguity

NLP Process

Lexical Analysis --> Syntactic Analysis --> Semantic Analysis --> Discourse Integration --> Pragmatic Analysis

Clone this wiki locally