Amulet doesn't talk during the night, other than in response to direct commands you issue. (You can configure these curfew hours on the Settings / Talker page.)

If you want Amulet to stop talking for good, simply set Amulet's voice to None on the Settings / Talker page.