The CFMTA was founded on August 24, 1935 in Vancouver by a group of professional musicians who were also recognized as eminent teachers. They represented the Provincial Associations of British Columbia, Alberta, Saskatchewan and Manitoba. The impetus for the formation of this organization resulted from correspondence between Minnie Boyd of Winnipeg and Roy Robertson of Vancouver, as well as through consultation with the Presidents of the four founding Provincial Organizations. The officers elected to this new federation were: President - Roy Robertson (Vancouver); Vice-President - Mrs. O. J. Walker (Edmonton); Secretary-Treasurer - Minnie Boyd (Winnipeg). On August 26, 1935 a framework for the By-Laws and a Constitutional outline were drawn up.
Other Provincial Organizations gradually became affiliated with the CFMTA: Ontario in 1942, Nova Scotia in 1944, Quebec in 1945, New Brunswick in 1955, Newfoundland in 1987 and Prince Edward Island in 1995.
The first convention of the CFMTA was held in Vancouver in July, 1936 with one hundred and fourteen delegates registered and the following year the second convention took place in Winnipeg. Subsequently conventions became a biennial event, hosted by Provincial organizations, and most provinces have taken on this role several times. In 2003 Newfoundland and Labrador had its first opportunity to welcome CFMTA members to a national convention. During Convention Week a time is set aside for business to be conducted by the Executive Council, and the AGM provides all attending CFMTA members a chance to familiarize themselves with the affairs of the national organization. In a non-convention year provincial Delegates and the Executive hold business meetings and the AGM. Prince Edward Island, the newest member of the Federation, played host to these at Charlottetown in 2002.