Design IS a broad term. There is architectural design, industrial design and user interface design for example. What you are describing is generally called visual design. Quite contrary to what you argued, many people, including Steve Jobs, have emphasized that design is much more than visual design.