Srsly. Welcome to my day job. I can see that the LLMs' center of training is so far off from where I'd need it, I can accelerate auxillary stuff but prompt never beats the weights and it constantly pulls back into it's middle...