The False Positive Paradox

One thing more people need to be aware of is the False Positive Paradox.

If you have an app that can identify people with 97.6% accuracy, that’s pretty good right?

No! When looking for a small sample in a large enough population, it’s really bad.

I ran the numbers for a facial recognition app with a 97.6% accuracy rate, looking for a group of people that make up approx 3% of the US population. Of the ~8 million matches it will find, with a 97.6% accuracy rate, around 96% of the matches will be false positives.

When the thing you are looking for is rare, you need a margin of error that is significantly lower than the rarity of the thing you are searching for. Otherwise you get some unintuitive (and potentially alarming) results.

When you deploy those tests at scale, your results become garbage.

That 97.6% accuracy rate is from facial recognition is for algorithms being tested in ideal conditions. Not when the subject is a terrified, trembling person being filmed in a snowstorm. In those conditions, I can guarantee that the accuracy is significantly worse.

Anybody who claims an app can provide a ‘definitive’ identification in the field is lying to you.

Anybody who claims such an app should supersede provided documentation is malicious.

Anybody who buys into those claims, I happen to have a bridge for sale (and I don’t feel bad about selling you it).

Response from my MP

I got a response from my MP over the Onlnie Safety Act! And it seems like she read my email as I got my actual concerns at least acknowledged… Given it isn’t a form response, I can accept the delay in response! As with my initial letter, the response is below

Read More →

Nothing from my MP in response to my email. I’m getting the impression she doesn’t like me…

Emailing my MP about The Online Safety Act

I have sent my MP the below email regarding the Online Safety Act. I’m hoping I will get a constructive response, but I’m expecting to just get called a predator according to the party line. I will post the response when it arrives…

Read More →

Hot network closets in your area

One of our network node rooms at work had it’s air con die yesterday (Friday) afternoon. It’s not considered critical and we are in a budget squeeze, so the team who are responsible for it have decided it can wait over the weekend. They have however, not turned off the alert emails. So now I’m getting a nice hour by hour view of the temperature in an uncooled network closet until things start turning off. It’s hit almost 42C overnight and is still on the rise… I’m not sure what the shut off point for the kit in there is, but it’s clearly still running…

Dental Woes

I don’t like dentists. I know that regular dental check-ups are important. I know that they are key to having a healthy mouth. But I don’t like them. I have a bad gag reflex and some really bad memories of having a cast made of my teeth when I was younger. So when we moved I never really bothered looking into getting signed up with a dentist. This was a bad idea…

Read More →

New Shiny Thing

I’m not great at blogging. Long form historically hasn’t worked well for me and full microblogging feels a little too restrictive (I can ramble a bit much and splitting into a thread is mentally awkward). Maybe this will be a working middle ground.

Read More →