In Cumberland County, as elsewhere in Kentucky, local newspapers feature photos of children proudly displaying their kills, including turkey and deer.
Phelps, who is much like a mayor in these parts, said it had been four or five years since there had been a shooting death in the county, which lies along the Cumberland River near the Tennessee state line.
Phelps said he knew the family well. He said the father, Chris Sparks, works as a logger at a mill and also shoes horses.
The family lives in a gray mobile home on a long, winding road, surrounded by rolling hills and farmland that's been in the family since the 1930s. Toys, including a small truck and a basketball goal, were on the front porch, but no one was home Wednesday.
There's a house across the street, but the next closest neighbor lives over a hill.
Family friend Logan Wells said he received a frantic call telling him that the little girl was in an accident and to come quickly.
When he got to the hospital, Caroline was already dead. "She passed just when I got there," Wells said.
White said the shooting had been ruled accidental, though a police spokesman said it was unclear whether any charges will be filed.
"I think it's too early to say whether there will or won't be," Trooper Billy Gregory said.
White said the boy received the .22-caliber rifle as a gift, but it wasn't clear who gave him the gun, which is known as a Crickett.
"It's a little rifle for a kid. ... The little boy's used to shooting the little gun," White said.