Listen to Tertullian:
It is usual, indeed, with persons of a weaker character, to be so built up (in confidence) by certain individuals who are caught by heresy, as to topple over into ruin themselves. How comes it to pass, (they ask), that this woman or that man, who were the most faithful, the most prudent, and the most approved in the church, have gone over to the other side? Who that asks such a question does not in fact reply to it himself, to the effect that men whom heresies have been able to pervert ought never to have been esteemed prudent, or faithful, or approved? This again is, I suppose, an extraordinary thing, that one who has been approved should afterwards fall back? Saul, who was good beyond all others, is afterwards subverted by envy. David, a good man after the Lord’s own heart, is guilty afterwards of murder and adultery. Solomon, endowed by the Lord with all grace and wisdom, is led into idolatry, by women. For to the Son of God alone was it reserved to persevere to the last without sin. But what if a bishop, if a deacon, if a widow, if a virgin, if a doctor, if even a martyr, have fallen from the rule (of faith), will heresies on that account appear to possess the truth? Do we prove the faith by the persons, or the persons by the faith? No one is wise, no one is faithful, no one excels in dignity, but the Christian; and no one is a Christian but he who perseveres even to the end.
Tertullian, Prescription against the Heretics §3
That question captures the essence of a “low” conception of ecclesial authority in theology: do we prove the faith by appeal to the person, or do we prove the person by appeal to his or her faith?