I have activated the "Require passcode for participants joining by phone" in my Settings but participants who join by phone can still access my meeting without entering the passcode

This setting applies automatically only to newly created meetings. Meetings created in the past must be edited in order for the setting to apply.