English: Tales of history says that Raja Dinaj or Dinaraj is the founder of the Dinajpur Rajbari. But others say that after usurping the Ilyas Shahi rule, the famous Raja Ganesh of the early 15th century was the real founder of this house . At the end of the 17th century Srimanta Dutta Chaudhury became the zamindar of Dinajpur and after him, his sister's son Sukhdeva Ghosh inherited the property as Srimanta's son had a premature death.