Sure. But the reality is that cotton is expensive and resource intensive compared to other materials; absent a global effort to ban plastic clothes, it seems worthwhile to make those clothes less environmentally damaging.
Cotton also shrinks when wet and has poor thermal properties - polymer blend fabrics perform better in the cold, and are lighter and cheaper than wool. Goretex is wonderful stuff, but its also made of '"forever-plastics" and is known to slowly leach into runoff. Finding a polymer that can be cleanly manufactured for a competitive price with similar properties would be wonderful, as long as theres also a method for it to degrade safely when discarded.