I'm (unfortunately) running Tahoe on my M1 macbook pro and don't notice it to be slower than Sequoia. Where is your slowdown?

I'm dislike Tahoe as much as anyone else but performance isn't the problem for me.