The departments of Defense and Veterans Affairs want non-bargaining unit employees back to the office full time in the next few weeks.