The current implementation first converts to affine form, which involves an inversion.
libgoldilocks uses the following 4-isogeny maps between the untwisted and twisted forms which require no inversions and use only squarings, addition, subtraction, and multiplication:
Untwisted to twisted
https://github.com/otrv4/libgoldilocks/blob/d07cb5b423995bae1155702aa949846c95d855c1/src/goldilocks.c#L980-L994
Twisted to untwisted
https://github.com/otrv4/libgoldilocks/blob/d07cb5b423995bae1155702aa949846c95d855c1/src/goldilocks.c#L915-L928
See also: