Well, according to another thread, potential actually has effect on training speed, since potential have soft caps on each skill, so depending on the level of the skill the increases don't work like mentioned in your post, the increases are considerably lower.