Of course its justified.
I would pounce at any attractive girl if I had the chance. Some
guys do that, so you have a cause for worry.
However, you added in your question the line "even though you know
its ok." That means you are sure that his heart belongs to you.
Thats a very important clause in your question.
In this case, whats there to worry about?
The females might be nice to look at, but if his heart is taken (by
you I assume,) they are just that. Nice to look at.