Members of the public have refused the implementation of a 20mph speed limit in multiple areas of the Lake District.