Answering too slow, but not sure why (10062)

[SvenWollinger]

Hi! I have buttons for a small game that work fine 90% of the time.
Once every few clicks however i dont get an answer from my bot, with an error "10062: Unknown Exception".
Ive gathered that im not replying fast enough, however im really not sure why.
This is my event function:

(It simply replies a . which it then deletes, since i use these buttons for events that dont need an actual text answer).
The stacktrace i receive:

net.dv8tion.jda.api.exceptions.ErrorResponseException: 10062: Unknown interaction
        at net.dv8tion.jda.internal.requests.RestActionImpl.complete(RestActionImpl.java:230)
        at net.dv8tion.jda.api.requests.RestAction.complete(RestAction.java:632)
        at io.wollinger.rataudc.Ratau.onButtonInteraction(Ratau.kt:60)
        at net.dv8tion.jda.api.hooks.ListenerAdapter.onEvent(ListenerAdapter.java:424)
        at net.dv8tion.jda.api.hooks.InterfacedEventManager.handle(InterfacedEventManager.java:96)
        at net.dv8tion.jda.internal.hooks.EventManagerProxy.handleInternally(EventManagerProxy.java:88)
        at net.dv8tion.jda.internal.hooks.EventManagerProxy.handle(EventManagerProxy.java:70)
        at net.dv8tion.jda.internal.JDAImpl.handleEvent(JDAImpl.java:171)
        at net.dv8tion.jda.internal.handle.InteractionCreateHandler.handleAction(InteractionCreateHandler.java:134)
        at net.dv8tion.jda.internal.handle.InteractionCreateHandler.handleInternally(InteractionCreateHandler.java:86)
        at net.dv8tion.jda.internal.handle.SocketHandler.handle(SocketHandler.java:39)
        at net.dv8tion.jda.internal.requests.WebSocketClient.onDispatch(WebSocketClient.java:984)
        at net.dv8tion.jda.internal.requests.WebSocketClient.onEvent(WebSocketClient.java:870)
        at net.dv8tion.jda.internal.requests.WebSocketClient.handleEvent(WebSocketClient.java:848)
        at net.dv8tion.jda.internal.requests.WebSocketClient.onBinaryMessage(WebSocketClient.java:1023)
        at com.neovisionaries.ws.client.ListenerManager.callOnBinaryMessage(ListenerManager.java:385)
        at com.neovisionaries.ws.client.ReadingThread.callOnBinaryMessage(ReadingThread.java:276)
        at com.neovisionaries.ws.client.ReadingThread.handleBinaryFrame(ReadingThread.java:996)
        at com.neovisionaries.ws.client.ReadingThread.handleFrame(ReadingThread.java:755)
        at com.neovisionaries.ws.client.ReadingThread.main(ReadingThread.java:108)
        at com.neovisionaries.ws.client.ReadingThread.runMain(ReadingThread.java:64)
        at com.neovisionaries.ws.client.WebSocketThread.run(WebSocketThread.java:45)
Caused by: net.dv8tion.jda.api.exceptions.ContextException
        at net.dv8tion.jda.api.exceptions.ContextException.here(ContextException.java:54)
        at net.dv8tion.jda.api.requests.Request.<init>(Request.java:73)
        at net.dv8tion.jda.api.requests.RestFuture.<init>(RestFuture.java:36)
        at net.dv8tion.jda.internal.requests.RestActionImpl.submit(RestActionImpl.java:212)
        at net.dv8tion.jda.internal.requests.restaction.interactions.InteractionCallbackImpl.submit(InteractionCallbackImpl.java:89)
        at net.dv8tion.jda.internal.requests.RestActionImpl.complete(RestActionImpl.java:222)
        ... 21 more

I tried answering the event via .complete, just in case that queue isnt fast enough for some reason.
I also tried to first deferReply via complete, which still didnt work by then using the hook to edit the original message.
Is this a problem with me deleting the message again?
Thankfull for some insight

Edit: The full code in question, sorry

override fun onButtonInteraction(event: ButtonInteractionEvent) {
        //We need to reply, so we do this
        event.reply(".").queue { it.deleteOriginal().queue() }

        val parts = event.componentId.split("-")
        if(parts.size < 3) return

        val intendedID = parts[1].toLong()
        //Only allow the user the button is meant to to use it
        if(intendedID != event.user.idLong) return

        MatchManager.getMatch(parts[0])?.buttonEvent(intendedID, parts[2])
    }