Kelly was the Crusaders' starting center fielder for three years during the mid 1960's. He batted .333 in 1965 as the Crusaders made the NCAA tournament and finished the season ranked 12th in the nation. In his junior year, he hit .410, the highest batting average in New England and tenth highest in the country that year. In recognition of his performance, he was named All New England and third team All America. Again selected all New England as a senior, Kelly finished with a career average of .360 and won the first Riopel Ring at the Hall of Fame Dinner in 1967. A senior walk-on to the football squad, he became a starter at defensive safety and intercepted the pass that led to the winning touchdown as HC defeated BC 32-26 in the fall of 1966.