Whisk buttermilk with 1 teaspoon salt and 1 teaspoon black pepper. Add chicken; refrigerate 4 to 12 hours.
Mix flour, cornstarch, garlic powder, remaining salt, and remaining black pepper in a wide bowl. Drizzle in 3 tablespoons buttermilk marinade; rub into shaggy clumps.
Lift thighs from marinade; press firmly into flour mixture. Rest on a rack 10 minutes.
Heat canola oil in a deep heavy pot to 350°F, leaving at least 3 inches headroom.
Fry 2 thighs at a time, 6 to 8 minutes, turning once. Maintain oil at 335°F to 350°F; cook until deep golden and chicken reaches 165°F.
Drain on a wire rack over a sheet pan, not paper towels. Rest 5 minutes.
Toast buns cut-side down in a dry skillet 1 to 2 minutes. Spread both halves with mayonnaise; stack each with 1 thigh and 4 pickle chips.