Once language starts to develop from about age 2, they do have a system for symbolic representation and can talk about things which aren't in their immediate environment including the past.
Almost all parents who adopt now tell their children about it right from the start, and once those children reach 18 they can, if they wish, view their original birth records.