Built in the early 20th century, the mansion was originally constructed for tobacco magnate James Buchanan Duke. Described as the last intact mansion on Fifth Avenue, the building's was purchased by Sapir in 2005 for $40 million. The mansion was later sold to Carlos Slim in 2010 for $44 million.