Squirrel can be like that sometimes. If you leave them be, they usually will not bother you too badly.

Or perhaps... they simply sense the fear in you. They can smell it.