A fee stated as a small annual percentage of assets is not a small percentage of the outcome: because it is charged on the whole balance every year, it compounds against you at the same rate the portfolio compounds for you.

The gap between the two paths is wider than the fees paid. Each year's fee also removes the returns that money would have earned in every year that followed, which is why the two lines separate slowly at first and then sharply.