Another, equivalent way to define Bayesian Games is in terms of "types", which determine both what an agent knows and how the agent values different outcomes.
This video from Game Theory Online (http://www.game-theory-class.org) formally defines Bayesian games in terms of types.
It features Yoav Shoham (Stanford).