An non-vanilla interest rate derivative security; which can usually be expressed in terms of vanilla interest rate derivatives such as interest rate swaps, Swaptions, interest rate caps, interest rate floors.
An example is a binary interest rate cap.