Milton Bradley, a company then better known for Hungry Hungry Hippos than video games, has the distinction of being the first to introduce a handheld video game console with interchangeable cartridges with its Microvision.
ENGADGET: A Brief History of Handheld Video Games