You lay out a clear and constant view of morality, Steve, which does in fact imply that every action we do has a moral dimension. It's perhaps the most basic criterion of being human.

Insofar as we become aware of that quality in an animal, or maybe in some robot or alien in a science fiction story, so that what it does is seen as moral or immoral, we regard it as sharing that humanity. We wouldn't see a tree that fell on us as acting immorally. We might see a man who chopped down a tree as acting immorally, depending on circumstances.