Schmidtt's review(pdf) appears to exhibit a comparatively continuous decline from time of European Speak to until eventually around the start of the 20th century (at which level their population started expanding once more). The only little bit in there that seriously sticks out like a sore thumb was in 1804, when it seems nearly 50 % the remaining