That was some hardcore shit.
I had merged all the workers together yesterday with cursor. But it turns out it didn't really do shit. So today I actually made the new unified worker actually run.
It's waaaay faster, utilises all the speed-ups @stojg did before he finished up, but is far less code and much easier to extend (uses comlink instead of a zillion different messages).