From the end user's perspective, features often reduce complexity, sometimes dramatically so. Before "mail merge" was a common MS Word feature, collating form letters was a tedious job.

Good engineering and design integrates features into the application in a way that avoids complexity.