If you are for sure pregnant, it's most likely your boyfriends. I've never heard of pregnancy showing up just 4 days after having sex. I wouldn't have sex with your bf again until you get tested for std's though. Since you had sex unprotected with someone else, never know if they had something and you surely don't want to give your bf anything.
I personally would tell him what happened, but whatever you decide to do, it's your choice. I'd just stay in the relationship for now on so you don't cause any unwanted harm to your baby. Good luck.