"We are a team that always wants to think of ways we can improve and after this tour we will look be to even stronger with the 2019 World Cup in mind," he said after India took a 4-1 lead in the six-match series on Tuesday.
"It's a wonderful feeling to have created some history. The guys really got stuck in, with the bat and the ball and in the field as well," he added after the Port Elizabeth triumph.
Success in the series has lifted India above South Africa in the International Cricket Council's one-day rankings and they retained their number one status in tests as well despite losing 2-1 to the South Africans last month.
"For now, 4-1 feels amazing. Obviously the players put up some really good cricket to be in this position," Kohli added.
The last match of the ODI series is in Pretoria on Friday.
"We want to win 5-1 but there might be a scenario to give a few (other) guys a chance." Kohli said with the series won using only 12 of India's 17-man squad.
The 2019 World Cup is being hosted by England and Wales, where India won their first global title in 1983 before adding a second on home soil in 2011.
(Reporting by Mark Gleeson in Cape Town; Editing by John O'Brien)
