The library's first location was two rooms on the second floor in the brick Opera House block. Later the Women's Harmony Library Club purchased a brick building on Main Street, paying $50 a month. A few years later a real estate businessman offered to trade his home and several lots for the brick building that housed the library. The deal was completed and the library moved to the new location, which is the present site of the City Hall.

In 1922 the library deeded four lots to the city of Smith Center for a new public building. An agreement was reached with the city as follows: the library would become city property, with the provision that the new building would house the library and upkeep would be through taxes, and the city would employ a librarian. The new building cost the city $36,000. The Women's Harmony Library Club disbanded and the management has since been under a library board and city council.

The library offers many services: new and classic fiction and non-fiction for adults and children; magazines; VHS & DVD videos; foreign language tapes; hospice library; Story Hour for preschoolers and Summer Reading Club for school-age children; copy machine; fax machine; laminator; free internet access including a Wi-Fi connection; tax forms; county newspapers on microfilm; census reports; genealogy collection; Smith County history; census microfilm; audiobooks on cassette and CD; large-print books; rotating books; and interlibrary loans. The library has a display case which features monthly collections of local residents. The Smith Center library board, city council and librarians appreciate the high level of interest and support shown by the community. With growth and expansion in the future, they plan to continue to meet the needs of the community.