Earlier this year the group announced plans to invest $104m in the new plant which will include both office space for corporate operations and chocolate processing.
Brantford has a population of just over 100,000 residents and the new facility will create more than 200 jobs in the area.
The new operation is the first new factory for Barry Callebaut in North America since 2008 and the plant will be focused on sugar-free, high protein, and other specialty chocolate products.
A groundbreaking ceremony will take place in September and is expected to be operational by 2024, with an initial production capacity of more than 50,000 tonnes of chocolate serving markets across North America.