Liverpool finally conceded a goal after more than eight hours of a league shutout, but maintained their best start to a league campaign for almost three decades.
There was a second half wobble when Alisson overplayed with his feet and was caught out with a sloppy goal but despite a sub-par performance, the reds maintained their position at the summit of the Premier League table.
Jurgen Klopp made his first change to the starting line up of the season when he replaced Naby Keita with Jordan Henderson.
He cited the need to be defensively sound against a good Leicester side.
And on the sunny September day, it was Liverpool who started the game looking the brighter. Mo Salah, who started last season with a few missed chances, should have started the scoring within five minutes.
Bobby Firmino's shot was rebounded out straight into the path of the Egyptian who hit it wide when it looked the more difficult thing to do than put it in the net.
But Sadio Mane would soon open the scoring - his fourth goal in his opening 4 games. Great work from Andy Robertson down the wing and Mane took one touch past a defender before drilling in a left footed shot past Kasper Schmeichel.
The goal sparked Leicester in to life, who had not picked a recognised forward for this game.
Youngster James Maddison was one of their bright sparks and they enjoyed the majority of possession in the rest of the half. Alisson produced a good save from Demerai Gray, partially unsighted from the shot, and Gomez and van Dijk's growing partnership looked solid.
Thankfully, at the end of the first half the reds got the crucial second goal against the run of play.
From a James Milner corner, Roberto Firmino lost his marker and sent a powerful downward header past the Leicester keeper.
It was a blow for Leicester who had looked good value for an equaliser.
In the second half it was more Leicester pressure. New signing Rachid Ghezzal was looking dangerous and he had a cross/shot squirm across the face of goal.
But Liverpool were holding resolute, just. Joe Gomez in particular with a goal-saving tackle from 10 yards out.
However, after eight hours of not conceding in the league, the reds would be breached.
A poor backpass to Alisson who then attempted to take on substitute Ihenahcho. He was caught in possession and the ball fed across to Ghezzal who fired in.
The reds were under unnecessary pressure after that error and it took a number of substitutes before the pressure released. Both Keita and Shaqiri came on for Henderson and Mo Salah.
A late corner for Leicester saw Kasper Schmeichel come up - but Virgil van Dijk outjumped the goalkeeper to clear the danger.
Liverpool saw out the final sixty seconds to hold on for another big win when not playing anywhere near their best.
After the international break things will get a lot more tasty - but Liverpool will at the very least be joint top of the league.