The Hermitage, Nevis The tiny island of Nevis is one of the Caribbean’s richest historical destinations (one that has been in the spotlight of late as the birthplace of Alexander Hamilton). But its leading historic inn is The Hermitage, a classic Caribbean plantation inn set around what is the oldest extant wooden house in the Caribbean, dating back to 1670. There’s a mix of places to stay, from colorful gingerbread cottages to hillside rooms to a private villa.