Since f(x) is an increasing function : f '(x) > 0
f '(x) = 3x2 + 2ax + b + 10sinx.cosx = 3x2 + 2ax + b + 5sin2x > 0
As we know : 5 > 5sin2x
3x2 + 2ax + b + 5 > 3x2 + 2ax + b + 5sin2x > 0
3x2 + 2ax + b + 5 > 0
Its discriminant should be less than 0 : (2a)2 - 4(3)(b+5) > 0
a2 - 3b - 15 > 0