Just found this and it works like a charm:
myNumberPicker.setDescendantFocusability(NumberPicker.FOCUS_BLOCK_DESCENDANTS);
You can also set this in XML:
android:descendantFocusability="blocksDescendants"
References
https://stackoverflow.com/questions/8854781/disable-soft-keyboard-on-numberpicker