Concrete is cement plus aggregate (pebbles, etc.)
"In 1756, British engineer, John Smeaton, made the first modern concrete (hydraulic cement) by adding pebbles as a coarse aggregate and mixing powdered brick into the cement. In 1824, English inventor Joseph Aspdin invented Portland Cement....."
Wikipedia, The History of Concrete and Cement.

Saw a recent TV documentary which showed cement used by ancient Assyrians and later Romans, etc.

The word in the meaning of aggregate particles goes back to 1656 according to Merriam Webster's Collegiate (better info in OED, but I haven't looked).