What is the smallest part of computer?

A Bite.
That's spelled Byte and it is made up of eight bits.
A bit is stored in a flip-flop - or on a hard disk it is a small stretch of iron oxide.