I don't believe you can turn it off. I practically asked Medium that and they said no. Also, I don't mind some highlights.

I'm interested in reader's opinions - I love to read people's opinions in the comments!

Some people who find it distracting or difficult to read might value the information.