Press and hold the pick-up/activate button.
I'll add here a thing I noticed when doing this; sometimes it doesn't work and instead of picking up the object, it does nothing. When I stop holding the activate button, it picks up the object instead. Was really annoying when I tried to move around stuff, instead I ended up picking up goblets and pots.. ****