A portion of Riverside Avenue will be closed from March 3 to early May for water main construction and a culvert replacement, St. Charles officials say.