Turns out the extensions are stored under %USER%\.vscode\extensions. Deleting that gets rid of them.

For Windows : %USER%\\.vscode\extensions (or) %USERPROFILE%\.vscode\extensions

Location of extensions for Linux/MAC: ~/.vscode/extensions