Only 5.6% of adults with learning disabilities were in full-time employment last year, research shows.