IB/mlx5: Enable MAD_IFC commands for IB ports only