The Supreme Court on Monday refused to stay "scientific survey" of the Bhojshala complex, a medieval-era structure which both Hindus and Muslims claim as their own in Madhya Pradesh's Dhar district, but said no action should be taken without it permission on the outcome of the ASI survey.