It would be really great to be able to add/remove components/test cases to/from existing test runs instead of to/from only new test runs

You can't as of now. That's a feature that still needs to implemented imo