There are 280 islanders with a learning disability, the Adult Learning Disability Service says.