Name that ruin

Not a great photo (snapped from the car as we headed North) but we've often wondered what this ruined building is.  It's just south of junction 29 (Chesterfield) on the M1 in Derbyshire.  We think it might be part of Bolsover Castle...?  But not sure if that's quite so 'ruined'.