The research has shown that every one ton of cement produce releases half ton of carbon dioxide, so there is an instantaneous need to manage the usage of cement. The rapid increase in construction activities leads to massive shortage of conventional construction materials such as cement, fine aggregate and coarse aggregate. Phosphogypsum is a by-product while of phosphate fertilizer plant and chemical industries. It can be used as partial replacement of cement. The partially cement replaced Phosphogypsum concrete using 10%, 20%&30% replacement with M20 grade concrete with water binder ratio of 0.55. Granite powder is a by-product produced in granite factories while cutting huge granite rocks to the desired shapes. Granite fines are used as a filter material in the concrete, partial replacement of fine aggregate, which will helps in filling up the pores in the concrete. Filling up of the pores by granite fines will increases the strength of the concrete. The partially sand replaced granite powder concrete using 25% with M20 grade. This study revealed that there is an improvement in compressive strength.