Fantasy that isn't heavy on the weapons?

The more I read of currently popular fantasy, the more dismayed I am that there tends to be such a huge focus on weaponry and fighting and the protagonists being (or becoming) martial arts geniuses. I stick with some of these books anyway if, such as in The Hunger Games, they're written really well and the plot and characters are compelling. But I've got to admit that violence and weaponry and action scenes are really not my favorite things. They're never the parts I re-read for pleasure (that would be the love declarations, or some particularly amusing exchanges or incidents, or passages of beautiful writing describing something magical). I don't particularly like writing fighting-and-weapons scenes either, though sometimes I find I have to, given the way I've set things up. So now I'm pondering how to set up a fantasy book so I can spend as little time as possible in violent weapon-related scenes and still create a really good read.

I think this is actually what appeals to me about the Harry Potter world, and also stories like Howl's Moving Castle: we get a lot of time to hang out in the magic world and enjoy it, and when there's fighting, it's almost solely with spells and with using one's brain. When Hermione actually uses her fist to hit Draco, it's all the more startling and satisfying that way. Except I want to write for grown-ups more than for kids. So, yeah. Pondering this, and I see from forum discussions like this that others have pondered it too.