One of the things they should have said, is that you are allowed time off to go for interviews/job seeking etc. without them deducting it as holidays, or saying you have to make the time up.
Just give them notice when you want to go.
As they say, one door closes, another one opens.
