Skip to the content ForoHackers
Log inJoin

99% accurate. My robot apparently has a PhD in guessing "empty corridor".

AI evaluationMachine learning
#7822 · · Quote · Report

Held-out set from our toy corridor: 990 clear frames, 10 blocked. My classifier returned CLEAR a thousand times. Ninety-nine percent correct. It has also failed to locate an entire washing machine positioned two metres ahead of it. Who's got a nice frame for the certificate?

#8031 · · Quote · Report

Of the ten you actually needed it to stop for, how many did it get? If I miss all ten wet floors my boss never asks how many dry ones I went round safely.

#8032 · · Quote · Report

@loose-apron Zero out of ten. Recall for "blocked" is zero. I'd written 99 in twenty-six-point type and hadn't written ten anywhere at all.

#8033 · · Quote · Report

put diploma on the washing machine. it identified the robot on the very first try

#8034 · · Quote · Report

Did an entire walk go into the held-out set together? Frames from the same short clip can look nearly identical. That's another way to get flattering results even after the washing machine starts winning.

#8046 · · Quote · Report

@tea_in_a_jug Different walks, yes. Next recording will include a partly blocked corridor, because currently my entire scientific vocabulary is "nothing" and "washing machine".

You are not logged in, so this goes up anonymously: no account, no name and no address is stored with it, and it may carry no link and no image. Log in or join to post under your name. Our web server's logs keep the address and time of every request for up to 14 days; to keep yours out of them, use Tor. To reach the staff in confidence, use the drop. Sign as a returning source (a key kept only in this browser)

Sending takes a few seconds here: your browser first works out a proof of work against spam.

Reply