The imbalance market is very volatile and often exhibits extreme price spikes. This makes it very hard to model; however, if predicted correctly, one could make significant gains by participating on the right side of the market. In this manuscript, we conduct a very short-term probabilistic forecasting of imbalance prices, contributing to the scarce literature in this novel subject. The forecasting is performed 30 min before the delivery, so that the trader might still choose the trading place. The distribution of the imbalance prices is modelled and forecasted using methods well-known in the electricity price forecasting literature: lasso with bootstrap, gamlss, and probabilistic neural networks. The methods are compared with a naive benchmark in a meaningful rolling window study. The results provide evidence of the efficiency between the intraday and balancing markets as the sophisticated methods do not substantially overperform the intraday continuous price index. On the other hand, they significantly improve the empirical coverage. Therefore, the traders should avoid participating in the balancing market, which is inline with the objective and current regulations of the market. The analysis was conducted on the German market; however, it could be easily applied to any other market of a similar structure.