IMO, there's one main thing holding this show down:
Billy Burke as Miles, who the show needs to be the (dark) hero of the story, just cannot carry a single scene he is in. I don't like him, I don't believe him as a physical threat, his dark brooding comes off more as sulking. He's just not a leading man. You can blame the writing to some degree, but the same writers are creating the dialogue for Giancarlo Espisito and he pulls off his character completely.
You can make a show work with a strong central figure even if it's frayed around the edges, but leave a void in the middle and the whole thing flies off the rails.
Do this show with, say, Terry O'Quinn as Miles going up against Giancarlo as the main bad guy. . . . Then you would have had something