Matsell was born in New York City to George Joshua Matsell, an immigrant from Walsingham, Norfolk, England. He worked as an apprentice in his father's bookstore on Broadway during his childhood, eventually opening a bookstore of his own on Chatham Street after spending several years as a sailor. His bookstore became notorious for carrying the works of Freethinkers such as