how to  make foreground & background user interactive

is there nobody made possible this user interactive? 
i want change this program could take user interface by mouse but i can`t understand GMM & CRF .
anyone could helping me or having same problem free to contact by e-mail.