Ahh, yes, environment. You are indeed correct about the baggage. Part of the issue is that the word has come to be a synonym for "nature" although technically it doesn’t necessarily mean the same thing, or at least not from the same perspective.
Nature is a thing or realm in and of itself, not dependent on any relationship to humanity per se. The term, environment, however, implies a human subjectivity in relationship to the natural world surounding it. An environment is an environment to or for something else.
I could go on with this. When I was working on my Ph.D. the focus of my research was on rhetorical constructions of the concept of nature and the environment.
Brad