Large numbers of public servants working in the federal government's three biggest departments aren't following Ottawa's three-days-per-week office work rule, federal data shows.