You are expected to create the ~/.pandoc directory if it doesn't exist already. For example for a default latex template:

mkdir -p ~/.pandoc/templates
pandoc -D latex > ~/.pandoc/templates/default.latex