.. =*= coding: utf=8 =*= .. _bob.bio.demographics.mobio.analysis: ========= MOBIO II ========= Follow below the demographic differentials considering some FR baselines using the :ref:`Fairness Discrepancy Rate ` . .. figure:: mobio.png :align: center :alt: Fairness Discrepancy Rate FDR and FMR/FNMR trade-offs (:download:`pdf `) Facenet-sanderberg ------------------ `Facenet `_ model. FMR === ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0.003 0.038 0.281 Female-Male 0 0 0 0 0.001 0.026 Male-Female 0 0 0 0 0.001 0.031 Male-Male 0 0 0 0 0.005 0.081 ============= ===== ===== ====== ===== ===== ===== FNMR ==== ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0.127 0.127 0.068 0.026 0.003 0 Male-Male 0.033 0.033 0.016 0.006 0.002 0.001 ============= ===== ===== ====== ===== ===== ===== iResnet 100 ----------- `Arcface (iResnet 101) model `_ ported to pytorch. FMR === ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0.004 0.027 0.235 Female-Male 0 0 0 0 0.001 0.043 Male-Female 0 0 0 0 0.001 0.052 Male-Male 0 0 0 0 0.006 0.077 ============= ===== ===== ====== ===== ===== ===== FNMR ==== ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0 0 0 Male-Male 0.002 0.002 0.001 0.001 0.001 0.001 ============= ===== ===== ====== ===== ===== ===== iResnet 50 ---------- `Arcface (iResnet 50) model `_ ported to pytorch. FMR === ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0.003 0.046 0.282 Female-Male 0 0 0 0 0.002 0.036 Male-Female 0 0 0 0 0.002 0.045 Male-Male 0 0 0 0 0.004 0.069 ============= ===== ===== ====== ===== ===== ===== FNMR ==== ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0.098 0.098 0.032 0.008 0 0 Male-Male 0.109 0.109 0.041 0.014 0.004 0.002 ============= ===== ===== ====== ===== ===== ===== idiap_resnet50_arcface_2021 --------------------------- Arcface (resnet 50 **not the iResnet**) model trained using tensorflow. FNMR ==== ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0.003 0.058 0.297 Female-Male 0 0 0 0 0.001 0.033 Male-Female 0 0 0 0 0.001 0.046 Male-Male 0 0 0 0 0.005 0.075 ============= ===== ===== ====== ===== ===== ===== FMR === ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0.525 0.525 0.255 0.077 0.015 0.001 Male-Male 0.403 0.403 0.208 0.07 0.011 0.002 ============= ===== ===== ====== ===== ===== ===== idiap_resnet50_arcface_20210521 ------------------------------- Arcface (resnet 50 **not the iResnet**) model trained using tensorflow. This one is more recent. FMR === ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0.001 0.021 0.297 Female-Male 0 0 0 0 0 0.026 Male-Female 0 0 0 0 0 0.036 Male-Male 0 0 0 0 0.004 0.075 ============= ===== ===== ====== ===== ===== ===== FNMR ==== ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0.29 0.29 0.116 0.05 0.006 0 Male-Male 0.192 0.192 0.095 0.039 0.005 0.001 ============= ===== ===== ====== ===== ===== ===== VGG - 16 -------- VGG 16 Face model FMR === ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0 0.004 0.056 Female-Male 0 0 0 0 0 0.011 Male-Female 0 0 0 0 0 0.006 Male-Male 0 0 0 0 0 0.009 ============= ===== ===== ====== ===== ===== ===== FNMR ==== ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0.848 0.848 0.65 0.48 0.25 0.059 Male-Male 0.788 0.788 0.578 0.417 0.182 0.03 ============= ===== ===== ====== ===== ===== ===== arcface_insightface ------------------- Original `Arcface (iResnet 101) model `_. FMR === ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0.004 0.027 0.235 Female-Male 0 0 0 0 0.001 0.043 Male-Female 0 0 0 0 0.001 0.052 Male-Male 0 0 0 0 0.006 0.077 ============= ===== ===== ====== ===== ===== ===== FNMR ==== ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0 0 0 0 Male-Male 0.002 0.002 0.001 0.001 0.001 0.001 ============= ===== ===== ====== ===== ===== ===== idiap_inc_res_v2_2018 ------------------------------------------- Inception-resnet v2 model trained in [TFP18]_: FMR === ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0 0 0.001 0.004 0.03 0.282 Female-Male 0 0 0 0 0 0.011 Male-Female 0 0 0 0 0 0.014 Male-Male 0 0 0 0 0.002 0.068 ============= ===== ===== ====== ===== ===== ===== FNMR ==== ============= ===== ===== ====== ===== ===== ===== Ethnicities 1e-06 1e-05 0.0001 0.001 0.01 0.1 Female-Female 0.209 0.209 0.09 0.044 0.01 0 Male-Male 0.106 0.106 0.037 0.015 0.003 0.001 ============= ===== ===== ====== ===== ===== =====