Anglo-Saxons not Dutch. But the short answer is yes. The word Welsh is derived from the Old English word for foreigner.
Latin would have been spoken in towns and cities but as Roman rule collapsed it was replaced by Brittonic (ancestor of Welsh), unlike in the continent where it developed into various Latin derived Romance languages.