Creepy Smartwatch Spies What You Type on a Keyboard

Status
Not open for further replies.

Exterminator

Community Manager
Thread author
Verified
Staff Member
Well-known
Oct 23, 2012
12,527
Researchers create a smartwatch app that can detect what you've typed based on the movements of your left hand
Researchers have created an app that follows the micro-movements of your smartwatch and is able to detect what keys you're pressing with your left hand, and guess what words you may be typing on a keyboard.

Romit Roy Choudhury, Associate Professor at ECE Illinois, together with a group of students worked on a project called Motion Leaks (MoLe), funded by the National Science Foundation, set to be presented during this week at the MobiCon 2015 conference in Paris.

Their research consisted of a homegrown app which they installed on a Samsung Gear Live smartwatch.

Researchers use the smartwatch's sensors to spy keyboard strokes
Using the watch's built-in motion sensors, more specifically data from the accelerometer and gyroscope, researchers were able to create a 3D map of the user's hand movements while typing on a keyboard.

The researchers then created two algorithms, one for detecting what keys were being pressed, and one for guessing what word was typed.

The first algorithm recorded the places where the smartwatch's sensors would detect a dip in movement, considering this spot as a keystroke, and then creating a heatmap of common spots where the user would press down.

Based on known keyboard layouts these spots were attributed to letters on the left side of the keyboard.

Their algorithm could guess what words you've typed
The second algorithm took this data, and analyzing the pauses between smartwatch (left hand) keystrokes, was able to detect how many letters were pressed with the right hand, based on the user's regular keystroke frequency.

Based on a simple dictionary lookup, the algorithm was then able to reliably reproduce what words were typed on the keyboard.

The research team acknowledged that the MoLe project still has a long way to go since there are some flaws in their system. Currently, MoLe can't detect special characters (numbers, punctuation, and symbols), the space bar still poses some difficulties, and the project can acquire usable data from people with standard typing patterns.

The app developed for the MoLe project only works on a Samsung Gear Live smartwatch, but researchers say that in theory, a similar app could be developed for other smartwatch makes and models.

Researchers have issued an warning, saying that this kind of device, by design, poses a problem to user privacy, allowing attackers to acquire passwords or data from sensitive emails.

 
  • Like
Reactions: upnorth

Viking

Level 26
Verified
Honorary Member
Top Poster
Well-known
Oct 2, 2011
1,534
I read this story in my Newspaper today - creepy indeed!
 

jamescv7

Level 85
Verified
Honorary Member
Mar 15, 2011
13,070
The next keylogger generation concept, there's no more safe in the place of encryption of keystrokes. Its a matter how you will limit the communication to avoid the attacker compromises any data as much as possible.
 

upnorth

Moderator
Verified
Staff Member
Malware Hunter
Well-known
Jul 27, 2015
5,459
Researchers create a smartwatch app that can detect what you've typed based on the movements of your left hand

Guess this wouldn't take much work to calculate...Researchers create a smartwatch app that can detect what you've do based on the movements of your left hand :D
 
Status
Not open for further replies.

About us

  • MalwareTips is a community-driven platform providing the latest information and resources on malware and cyber threats. Our team of experienced professionals and passionate volunteers work to keep the internet safe and secure. We provide accurate, up-to-date information and strive to build a strong and supportive community dedicated to cybersecurity.

User Menu

Follow us

Follow us on Facebook or Twitter to know first about the latest cybersecurity incidents and malware threats.

Top