One of the former students. "One of" refers to a group. The group that follows is plural. "Students" is plural of "student." Consider the statement, "one of the team." A team is a group. It can be referred to as singular or plural, depending on the context. In this case, the sentence refers to a larger entity which "one" is part of. "Students" in the instance you refer to is the larger entity.
