MOBIO II¶
Follow below the demographic differentials considering some FR baselines using the Fairness Discrepancy Rate .
Facenet-sanderberg¶
Facenet model.
FMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0.003 |
0.038 |
0.281 |
Female-Male |
0 |
0 |
0 |
0 |
0.001 |
0.026 |
Male-Female |
0 |
0 |
0 |
0 |
0.001 |
0.031 |
Male-Male |
0 |
0 |
0 |
0 |
0.005 |
0.081 |
FNMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0.127 |
0.127 |
0.068 |
0.026 |
0.003 |
0 |
Male-Male |
0.033 |
0.033 |
0.016 |
0.006 |
0.002 |
0.001 |
iResnet 100¶
Arcface (iResnet 101) model ported to pytorch.
FMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0.004 |
0.027 |
0.235 |
Female-Male |
0 |
0 |
0 |
0 |
0.001 |
0.043 |
Male-Female |
0 |
0 |
0 |
0 |
0.001 |
0.052 |
Male-Male |
0 |
0 |
0 |
0 |
0.006 |
0.077 |
FNMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0 |
0 |
0 |
Male-Male |
0.002 |
0.002 |
0.001 |
0.001 |
0.001 |
0.001 |
iResnet 50¶
Arcface (iResnet 50) model ported to pytorch.
FMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0.003 |
0.046 |
0.282 |
Female-Male |
0 |
0 |
0 |
0 |
0.002 |
0.036 |
Male-Female |
0 |
0 |
0 |
0 |
0.002 |
0.045 |
Male-Male |
0 |
0 |
0 |
0 |
0.004 |
0.069 |
FNMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0.098 |
0.098 |
0.032 |
0.008 |
0 |
0 |
Male-Male |
0.109 |
0.109 |
0.041 |
0.014 |
0.004 |
0.002 |
idiap_resnet50_arcface_2021¶
Arcface (resnet 50 not the iResnet) model trained using tensorflow.
FNMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0.003 |
0.058 |
0.297 |
Female-Male |
0 |
0 |
0 |
0 |
0.001 |
0.033 |
Male-Female |
0 |
0 |
0 |
0 |
0.001 |
0.046 |
Male-Male |
0 |
0 |
0 |
0 |
0.005 |
0.075 |
FMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0.525 |
0.525 |
0.255 |
0.077 |
0.015 |
0.001 |
Male-Male |
0.403 |
0.403 |
0.208 |
0.07 |
0.011 |
0.002 |
idiap_resnet50_arcface_20210521¶
Arcface (resnet 50 not the iResnet) model trained using tensorflow. This one is more recent.
FMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0.001 |
0.021 |
0.297 |
Female-Male |
0 |
0 |
0 |
0 |
0 |
0.026 |
Male-Female |
0 |
0 |
0 |
0 |
0 |
0.036 |
Male-Male |
0 |
0 |
0 |
0 |
0.004 |
0.075 |
FNMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0.29 |
0.29 |
0.116 |
0.05 |
0.006 |
0 |
Male-Male |
0.192 |
0.192 |
0.095 |
0.039 |
0.005 |
0.001 |
VGG - 16¶
VGG 16 Face model
FMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0 |
0.004 |
0.056 |
Female-Male |
0 |
0 |
0 |
0 |
0 |
0.011 |
Male-Female |
0 |
0 |
0 |
0 |
0 |
0.006 |
Male-Male |
0 |
0 |
0 |
0 |
0 |
0.009 |
FNMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0.848 |
0.848 |
0.65 |
0.48 |
0.25 |
0.059 |
Male-Male |
0.788 |
0.788 |
0.578 |
0.417 |
0.182 |
0.03 |
arcface_insightface¶
Original Arcface (iResnet 101) model.
FMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0.004 |
0.027 |
0.235 |
Female-Male |
0 |
0 |
0 |
0 |
0.001 |
0.043 |
Male-Female |
0 |
0 |
0 |
0 |
0.001 |
0.052 |
Male-Male |
0 |
0 |
0 |
0 |
0.006 |
0.077 |
FNMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0 |
0 |
0 |
0 |
Male-Male |
0.002 |
0.002 |
0.001 |
0.001 |
0.001 |
0.001 |
idiap_inc_res_v2_2018¶
Inception-resnet v2 model trained in [TFP18]:
FMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0 |
0 |
0.001 |
0.004 |
0.03 |
0.282 |
Female-Male |
0 |
0 |
0 |
0 |
0 |
0.011 |
Male-Female |
0 |
0 |
0 |
0 |
0 |
0.014 |
Male-Male |
0 |
0 |
0 |
0 |
0.002 |
0.068 |
FNMR¶
Ethnicities |
1e-06 |
1e-05 |
0.0001 |
0.001 |
0.01 |
0.1 |
Female-Female |
0.209 |
0.209 |
0.09 |
0.044 |
0.01 |
0 |
Male-Male |
0.106 |
0.106 |
0.037 |
0.015 |
0.003 |
0.001 |