Abstract: Under the background of the unified political construction of Emperor Wu of Western Han Dynasty, SIMA Qian, influenced by the thoughts of Heaven-Human induction, constructed his own thoughts of music governance by using the historical materials of pre-Qin music. Different from Emperor Wu's political thoughts of "external Confucianism and internal law" at that time, SIMA Qian, citing the fact that the wise king in ancient times presented music as the governance, proposed the idea of music governance, which centered on music and developed with Eight Books as the framework. In short, the way of rites and music connects heaven and earth. Rites and music were the key factors for the reign of the wise king in ancient times. The order of their actions was the harmony of music, man and politics. Therefore, those who could win the hearts of the people could win the world; otherwise, they would perish.