This looks like a native wild flower related to Sweet Woodruff and it enjoys the cool shade near your fence line. No reason to get rid of it as it is rather pretty and will block out more invasive native plants. Keep growing, Marianne Binetti