Knowledge management has become one of the survival strategies for university libraries that are facing serious financial pressures and the challenges of globalization. This study aimed at proposing the overall approach to KM implementation in federal university libraries in Nigeria by identifying the required organizational factors. The relationship between these factors was also determined to help define appropriately the organizational commitments for KM implementation strategies. The study was based on a quantitative approach within which the descriptive survey research method was chosen. Questionnaire was the main instrument for data collection, and 360 Librarians in federal university libraries in Nigeria responded to the questionnaire. The copies of the questionnaire were administered to the respondents using Research Assistants. Data collected were analyzed quantitatively using descriptive and inferential statistics. The analysis was performed using SPSS. The results of the study showed that the success of KM implementation depends on certain organizational dimensions. This study revealed that, in federal university libraries in Nigeria, these organizational dimensions consisted of top management leadership support, human resources policy, compensation schemes and collaboration. Positive correlation was also found between the factors defined by these organizational dimensions. Based on these findings, the overall organizational approach to KM implementation was proposed for the federal university libraries in Nigeria.