Include pre-encoded column name embeddings and use as e.g. hadamard product between encodings and embeddings.