Yep! I agree completely. In fact, I advocate for explicitly linear story points and updating them posthoc to reflect actual time spent, resulting in a crude-but-roughly-accurate time tracking method that doesn't actually require tracking hours.

https://betterprogramming.pub/youre-doing-story-points-all-wrong-but-not-for-the-reason-you-think-e50535be88