Constantly getting rate limit even after a few requests

[erm_yas]

I'm having very aggressively rate limiting issues with the Spotify Web API for my project, Even after creating a new application and implementing caching for most requests I'm still facing problems 

- After only 2-3 requests, I get rate limited for almost 24 hours
- This happens consistently only for get album and get track which I use a lot
- I'm using spotipy

& I've already tried:
- Creating a new application
- Implementing caching to reduce the number of requests

Error messages I'm receiving is simply

"Rate limited. Retry after 65998 seconds."

And apparently the rate limiting happens after 3 or 4 requests now, Has anyone else experienced similar issues recently? Are there any known fixes or workarounds? Any help or guidance would be greatly appreciated, Please help