how many by-elections would it take before the Conservatives lost their majority?
That would depend on which party's seats came up for by-election, and which party won the by-election.
Although the Tories don't yet have a majority, if they get one, future by-elections could just as easily increase their majority.