Conte has been able to use very average players as wing backs, like Moses, Alonso, Lichsteiner, even Ashley Young.
But he has always had real quality in the interior of his teams, especially his midfield (Pirlo, Vidal, Pogba, Marchisio, Kante, prime age Matic, Brozovic, Barella) and the middle ball playing CB (Bonucci, Luiz, De Vrij).
IMO, the biggest challenge at Spurs is that he doesn't have those players in the interior. There is nobody to be the ball playing CB in the middle, they don't have anybody to be the CDM/deep lying playmaker like Pirlo or Brozovic (Hojbjerg and Winks are not nearly good enough, maybe Skipp could do this eventually but Conte won't trust him right now) and while they have a few candidates for the all action midfielder roles (N'Dombele, Lo Celso) they just aren't the same level as players like Vidal, Pogba, Marchisio, Kante, and Barella that Conte has generally worked with.