Just specify your local branch1 or remote origin/branch2
git diff branch1 origin/branch2    #show diff referenced from second branch
git diff branch1 branch2 file.txt #show diff only between file.txt