Is my webcam being hacked into?

I believe so, your webcam should not attempt to get internet access without a proper need for it (eg. Skype or other video chatting programs). Trust me there are ways to record a webcam, one such program would be Netbus, a trojan. Easy way to detect it is to right click your taskbar and hit Start Task Manager, click the processes tab, and look for a proccess named NBServer.exe. I recommend you dont use your webcam until the issue gets resolved. I recommend Spybot Search and Destory and Malwarebytes Anti-Malware to do some virus scans, both programs are free. (Malwarebytes comes as a trial version but you can still scan and remove without issues).