The perpetrators and sponsors of terrorism must be held accountable, Defence Minister Rajnath Singh told a conclave of the Shanghai Cooperation Organisation (SCO) on Thursday, even as he chose not to sign a communique by the bloc for not explicitly addressing India's concerns over Pakistan-backed cross-border terrorism.