The Lindsays were of Lowland origin, the first known member of the family being Baldric de Lindesaya, a Norman who held lands in England and Normandy. Around 1120 Sir Walter Lindsay was a member of the Council of Prince David, Earl of Huntington, who became King of Scots in 1124; Walter's successor, William, acquired lands of Crawford in Clydesdale. Sir David Lindsay of Crawford acquired Glenesk in Angus by marriage with Maria Abernethy one of the heiresses of the Earldom of Angus and was hence created Earl of Crawford in 1398. The 4th Earl, the ferocious "Earl Beardie", was defeated by the Earl of Huntly in 1452 and deprived of his lands. His son, David was created Duke of Montrose by James III in 1488, this title ended on his death in 1495.

The House of Lindsay established itself in Angus (although Lindsays were to be found throughout Scotland) and engaged in bitter feuds with the Ogilvies and Alexanders. The Lindsays remained loyal throughout to the Stewarts; the 6th Earl died at Flodden in 1513, the 10th supported Mary Queen of Scots and the 16th Earl commanded a regiment for Charles I. When he died the title passed on to a cadet branch, the Balcarres, already raised to earldom of Balcarres in 1651. In 1848, the House of Lords decided that the titles of Earls of Crawford and Earls of Lindsay belonged to James, 7th Earl of Bal carres who was then 24th Earl of Crawford.

The Lindsays are celebrated for their literary talent, Sir David Lindsay of the Mount in Fife, created Lyon King of Arms, was a poet and reformer, and Robert Lindsay of Pitscottie was famed as a witty although unreliable historian.