How difficult is it to learn to sail?

I grew up spending summers on the Lake of the Ozarks in MO, have recently moved to the shores of Lake Erie, where I look out my sliding gl door and see sailboats on the lake, and I realized I would like to learn to sail and eventually get a sailboat. How realistic is this for an experienced boater and fisherman who has never sailed?