I would agree. One thing to be aware of, that is not a fast drive whatsoever. There is a lot of tourist, boat, trailer and RV traffic. Especially on a Friday, Saturday or Sunday expect a leisurely drive and leave adequate time to get where you are going - any other expectation will just frustrate you and spoil your day.
A great stop just on the N. end of Duluth is the Glensheen Mansion - truly an amazing site to visit and oh, yeah, the site of a historic murder so full of intrigue too. The way old lumber money used to live along the North Shore!