Know When to Fold-In