James lived with his family in Wisconsin. When his uncle Charles Ingalls came to visit, he sat at the table with his sister Amelia and their uncle came in to talk. He was excused with his sister from the table and left the room. (Episode 306: Journey in the Spring (Part 1)
Behind the scenes
James Ingalls was played by an unknown uncredited Stand-in.