There are a few scenarios that would cause your page views to go down.

1. If someone below you deletes their account, all their page views will also be deleted.
2. If someone below you was caught cheating, Yuwie reset their page views to 0. This would affect your total page views.

Remember, the numbers shown in your control panel are not official. They are for informational purposes only.