It's not problem of factor. To find the solution I just needed to include the error code into the search. Whole google search query:

microsoft cryptographic provider object exists 2148073487

The solution is basically to fix permissions (or delete and let them be re-generated) of directory %APPDATA%\Microsoft\Crypto and/or its "All Users" counter-part.

Take care to not lose any certificates in progress ;-)