His family weren't abused but stopped going because of what was getting shouted at Kettlewell.
Not pleasant but not unsurprising for a football manager when things aren't going well on the park, even when things are going well they get abuse hurled at them 🙄