Let G be a finite group. A PT-group is a group G whose subnormal subgroups are all permutable in G. A PST-group is a group G whose subnormal subgroups are all S-permutable in G. We say that G is a PTo-group (respectively, a PSTo-group) if its Frattini quotient group G/Φ(G) is a PT-group (respectively, a PST-group). In this paper, we determine the structure of minimal non-PTo-groups and minimal non-PSTo-groups.