Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributes