"It is said that the xLSTM model is significantly superior to the LSTM model.
As @agibsonccc said it 2 weeks ago in reference to another novel architecture question (Kolmogorov-Arnold - #2 by agibsonccc):
Feel free to implement it yourself using the SameDiff API.