Can someone steel your identity with just your social security number?

ok i got my cars oil checked and i forgot to take out a hiring pamphlet that was inside my cup board. in it, it had my social security number and drivers liscense number as well. should i be worried, cause i m scared if one of the workers read it and wrote down my social and drivers number? if so what should i do?