This model has the completed architecture - some of the missing pieces that were essential were added like RoPE and others (README will be updated). There are some issues that remain. One of the challenges is because I do not have the infrastructure, I have not got the time to generate an extensive training, validation and test data set. Comnsequently the dataset is tiny and the approach can be much better. Memorisation is still there. I will have work on this later/
