It's a new feature in Windows 10. You can access the emoji keyboard shortcut using the keys: "Windows key + ." or, "Windows key + >"

The "." is the period or, the full stop key, not the point or the decimal key.