Plymouth police say a 63 year old man set fire to a building that houses a federal probation office.