Does keyword difficulty matter for a small site?

It's a tool's guess at how hard it is to get onto page one, mostly based on how many links the ranking pages have. Each tool calculates it differently. It does matter for a small site, as a filter. Start with the low ones. But look at the actual results too: if page one is forums and thin posts, you can probably compete even if the score says otherwise.