It works fine before I move the Column to SingleChildScrollView. Could it be the SingleChildScrollView is blocking the underlying pan gesture?