Skip to content

Add a lookup entity extractor #5957

Closed
@tabergma

Description

Description of Problem:
Lookup tables are used to create additional features for our entity extractors. In order for the features (aka "the word is part of lookup table xyz, so it is likely that is has the entity xyz") to work, you need to have some examples in your training data with entires from the lookup table.

However, many users think that all entries in the lookup table are extracted as an entity right away. So, as soon as an entry from the lookup table is detected it is extracted as an entity. Many users on the forum struggling with this.

Overview of the Solution:

  • Create a new component LookupEntityExtractor that takes a lookup table. It will extract exact matches of entries in the lookup table and marks them as certain entity. (What about plural/singular/etc. of words? Should we also consider those?)
  • We should update the docs to clarify the difference between lookup tables and lookup entity extractor.

Metadata

Assignees

Labels

area:rasa-oss 🎡Anything related to the open source Rasa frameworktype:enhancement ✨Additions of new features or changes to existing ones, should be doable in a single PR

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions