Another common careless cliché we hear often today is "Follow your heart…it knows the way", or "Don't be pushed around by the fears in your mind, be led by the dreams of your heart", or "Follow your heart, listen to your inner voice, stop caring about what others think."

What does the Bible say about the heart? 

5 The LORD saw how great the wickedness of the human race had become on the earth, and that every inclination of the thoughts of the human heart was only evil all the time. Genesis 6:5

19 For out of the heart come evil thoughts—murder, adultery, sexual immorality, theft, false testimony, slander. Matthew 15:19

5 But because of your stubbornness and your unrepentant heart, you are storing up wrath against yourself for the day of God’s wrath, when his righteous judgment will be revealed. Romans 2:5

12 See to it, brothers and sisters, that none of you has a sinful, unbelieving heart that turns away from the living God. Hebrews 3:12

No, we should not follow our heart at all.  We must follow God and obey His Word.