To build China under the rule of law, we must push forward the building of a law-based society as well as a law-abiding country and a law-abiding government. Meanwhile, it is essential to promote the construction of a law-abiding ruling party as its prerequisite and guarantee. The target and task of building a law-based society is:to enhance the public awareness of rule of law, to push forward a multi-level and multi-domain governance by law, to construct a comprehensive legal service system, and to strengthen the mechanism of supporting rights and resolving disputes by law, so as to create the legal environment and enforce the rule of law in the whole society, and train the nationals to abide by the law consciously, believe in the law sincerely, advocate the rule of law faithfully and defend the rule of law firmly. The path to building a law-based society mainly includes three parts: the construction of social organizations, the construction of social behavior norms, and the construction of the mechanisms for social supervision and dispute settlement.