Add a 'starts with' filter to the artist overview
The album overview has a 'starts with' filter which enabled you to filter by the start character.
The same option should be available for the artist overview.
Wolfgang Kremser commented
Just as with albums it would be great to select artists based on the first character, or filter for it (a -> all artists starting with a, ...)
It will be great idea to show clickable alphabet's letters in the "Artists"view to jump to the first Artist with the name that begin with that letter
Merged in "select artist from alphabetical drop--down list" with comment "extremely inconvenient to page through 600 artists, a selection option would be great, just like for albums" - figured this meant it was the same as the album starts with filter.