These are the five ogre magi in the Docks district. They turn up just outside Candlekeep as you arrive at the start of chapter six.