Cast on Crit is not often used on Witch Hunter, so no issues there.
Weapon swaps, however, you may want to take a little time to learn. After they're set up, it does *not* require pressing a button to swap and then use an ability and then press a button to swap again. It's simply press a button to use a skill for one weapon, and press a button to use a skill for the second weapon, just as you may be used to for two skills using the same weapon. Also, if you end up using a crossbow, using a "weapon swap" but using the same weapon in both weapon sets actually can *decrease* the number of buttons you press in your rotation because of how crossbow ammo loading works in PoE2. For example, one build I used while leveling was using permafrost bolts to freeze enemies and fragmentation rounds to do a ton of damage to frozen enemies. If I were using just one weapon set, I would need to press to shoot permafrost bolts (1 button), press another button to load fragmentation rounds (2 buttons), press the first button again to shoot the fragmentation rounds (2 buttons still) and then load the permafrost bolts (3 buttons). If I set it up to have the same weapon in both weapon sets, I could set permafrost bolts to weapon set 1, and fragmentation rounds to weapon set 2, and I would only need to press to shoot weapon set 1 with one button, and press to shoot weapon set 2 with a second button. With 2 weapon sets, it takes 2 less button presses to shoot two types of ammo and only 2 total buttons, compared to 1 weapon set which requires 3 total buttons and 4 button presses.
Here's a similar build, focusing on permafrost bolts and fragmentation rounds https://mobalytics.gg/poe-2/builds/pohx-shatter-tactician?weaponSet=set1
This one is close to what I ended up doing with mine this league https://mobalytics.gg/poe-2/builds/woolie-run-n-gun-witch-hunter