I have an update for anybody interested. IAC bearing was seized, so I replaced them, but it still had the same behavior, idles faster when warmer.
I though the IAC was working previous to this post, but it was not. Now I definitely knew the IAC was working, so I figured it (IAC) must be out of...