Sia Phearum told “Hello VOA” people are being forced off land they earned through “backbreaking” work.
The UN sent its expert for the court to Cambodia this week to meet with government and court officials over a UN-appointed judge.
Nearly 400 families were forcibly evicted from the Borei Keila site this month.
UN Secretary-General Ban Ki-moon nominated Kasper-Ansermet to replace a German judge who resigned last year.
Provincial Police Chief Chhoung Seanghak said police are working the case and focusing on the two guards.
The group counted nearly 50 community evictions last year alone, affecting almost 12,000 families.
A number of Asean countries have conflicts with China over maritime territories in the South China Sea.
Kasper-Ansermet was to have filled a vacancy created by the departure of German judge Siegfried Blunt - who resigned late last year.
Cambodia is pushing for a seat on the council, UN Security Council, for 2013 and 2014; voting will be held later this year.
HRW also detailed what it views as severe violations of human rights in nations including Cambodia, Indonesia, Malaysia and Vietnam.
The measures are designed to crack down on the sales of pirated U.S. products overseas.
A UN spokesman told VOA Khmer this week the government has an obligation to fill vacant posts at the court.