Skip to content

eyes-on-disabilities/awesome-eye-tracking

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
README.md
README.md
 
 

Repository files navigation

Awesome Eye Tracking

A list of various eye- and head-tracking software, products, etc.

About us: We are Eyes on (Dis)Abilites and we want to provide low-cost eye-tracking solutions to paraplegics and ALS patients. This document is the result of our research. The focus is mostly on software, hardware, and products, and not on datasets and studies.

Table of Contents

Projects

On-Screen Keyboards

https://github.com/OptiKey/OptiKey ⭐ Personal Highlight ⭐
OptiKey is an open-source on-screen keyboard designed for eye-tracking, offering layouts from simple phrase cards to full keyboards. It supports voice output, mouse control, and various eye-trackers, with plugins like one for playing Minecraft. It’s the ideal on-screen keyboard for our needs.

  • 4.3k stars, last commit 3 months ago, 65 contributors
  • On-Screen Keyboard with various modes, optimized for people with disabilities
  • C#
  • Is there a Mac port for this?
  • ✔️ Tested, extremely good and versatile, has layouts for different precision levels.

https://github.com/bbenligiray/slicetype

  • 14 stars, last commit 5 years ago, 1 contributor
  • On-Screen Keyboard optimized for gaze-typing using circles
  • C++
  • Not tested yet

https://github.com/pasha-liubetski/LINKa.look-windows

  • 2 stars, last commit 1 year ago, 1 contributor
  • On-Screen Keyboard with cards, in Russian
  • C#, .NET Framework 4.8, WPF
  • Not tested yet

Wearable-based Eye Trackers

https://github.com/pupil-labs/pupil ⭐ Personal Highlight ⭐
Pupil-Labs produces open-source eye-tracking software and hardware. Their software was very useful for our research, though likely too complex for end-users. It allowed us to experiment with different cameras and build our first OptiKey plugin. However, their products are costly (starting at 3k€), and their DIY headset documentation lacks detail, so we sought alternative models. Still we are very happy that we found this software.

  • 1.4k stars, last commit 7 months ago, 42 contributors
  • Eye-tracking for wearables. Very promising
  • Python, OpenCV
  • ✔️ Tested, works exceptionally well. Requires some initial, somewhat tedious configuration. More details in the Pupil-Lab section.

https://github.com/EyeTrackVR/EyeTrackVR ⭐ Personal Highlight ⭐
EyeTrackVR offers open-source software and DIY guides for VR headset eye-tracking. With detailed documentation and affordable solutions using infrared technology, it meets many if not all of our needs when it comes to head-mounted eye-trackers. We see great potential in this project as we continue exploring it.

  • 767 stars, last commit 3 months ago, 8 contributors
  • eye-tracking software and DIY instructions for eye-tracking headsets
  • Python
  • not tested yet

https://github.com/esdalmaijer/PyGaze

  • 672 stars, last commit 2 weeks ago, 17 contributors
  • Toolbox for eye-tracking
  • Python (2 and 3), OpenCV, Pygame
  • Not sure if also works for screen-based tracking
  • ❌ we tried (on Linux) and gave up due to being very beginner-unfriendly. Confusing documentation. At least for us. :(

https://github.com/SummerSigh/TheVrMLEyeToolbox

  • 361 stars, last commit 11 month ago, 4 contributors
  • Toolbox for eye-tracking
  • Python, ASP.NET
  • Not tested yet

https://github.com/YutaItoh/3D-Eye-Tracker

  • 296 stars, last commit 8 years ago, 1 contributor
  • Eye-tracking software directly in front of the eye using infrared. Looks promising. C++. 2015
  • C++, OpenCV
  • Not tested yet

https://github.com/czero69/acomoeye-NN

  • 23 stars, last commit 4 years ago, 1 contributor
  • Implementation of one-shot direct gaze estimation NN based on NVGaze. Goal is for VR/AR.
  • Python, Conda
  • ~2.5° error rate with Acomo-14 dataset
  • Not tested yet

https://github.com/gmierz/pupil-lib

  • 10 stars, last commit 5 years ago, 1 contributor
  • Library for processing data from Pupil Labs' eye tracker, in conjunction with Lab Streaming Layer (LSL)
  • Python, Matlab
  • Not tested yet

Screen-based Eye Trackers

https://github.com/brownhci/WebGazer

https://github.com/vladmandic/human

  • 2.2k stars, last commit 4 months ago, 9 contributors
  • AI-powered 3D Face Detection & Rotation Tracking, Face Description, and more
  • Node.js
  • ❌ very resource intensive.

https://github.com/antoinelame/GazeTracking

  • 1.9k stars, last commit 1 month ago, 7 contributors
  • Webcam-based, real-time eye tracking
  • Python with NumPy, OpenCV, Dlib
  • Gives directions like "left", "up". Also gives a ratio from left (1.0) to right (0.0)
  • ✔️ Tested. Very dependent on lighting conditions (more light != better). When it works, it provides okay-ish results. Could perhaps be used in combination with calibration to move a cursor around. Better than nothing.
  • To build: Dlib doesn't build. Specific versions of Python, Dlib, and NumPy are required. (See this Github comment)
    1. Python 3.8.10
    2. Change requirements.txt as follows: 
      dlib==19.22.99
numpy==1.24.4
opencv-python==4.10.0.82
setuptools==70.0.0
    3. Install Dlib 19.22.99 manually:
    4. Then continue as per the project: pip install -r requirements.txt

https://github.com/trishume/eyeLike

https://github.com/cpury/lookie-lookie

  • 361 stars, last commit 4 years ago, 1 contributor
  • AI-based eye tracking, works entirely in the browser without a backend, using TensorFlow.js
  • JS, TensorFlow.js
  • ✔️ Tested, works well under good lighting conditions. Trained models and datasets can be uploaded and downloaded. However, glasses confuse the tool.

https://github.com/hysts/pytorch_mpiigaze

  • 346 stars, last commit 2 years ago, 1 contributor
  • PyTorch implementation of MPIIGaze and MPIIFaceGaze
  • Python, PyTorch
  • Not tested yet

https://github.com/Ahmednull/L2CS-Net

  • 310 stars, last commit 9 months ago, 4 contributors
  • PyTorch implementation for gaze estimation and tracking.
  • Python
  • Not tested yet

https://github.com/iitmcvg/eye-gaze

  • 229 stars, last commit 7 years ago, 2 contributors
  • Gaze and pupil tracker
  • C++
  • Provides gaze direction based on head position and pupil detection
  • Not tested yet

https://github.com/hugochan/Eye-Tracker

https://github.com/NativeSensors/EyeGestures

  • 120 stars, last commit 0 months ago, 1 contributor
  • Eye tracking. A more modern open-source Python project..
  • Python
  • Not tested yet

https://github.com/glefundes/mobile-face-gaze

  • 93 stars, last commit 4 years ago, 1 contributor
  • Gaze estimation using a neural network, based on the MPIIFaceGaze architecture (MPIIFaceGaze is a dataset)
  • Python, Jupyter Notebook
  • Not tested yet

https://github.com/avosskuehler/ogama

  • 71 stars, last commit 2 years ago, 1 contributor
  • Eye tracker, discontinued in 2016
  • C#, C++
  • Not tested yet

https://github.com/szydej https://api.gazerecorder.com/

  • 59 stars, last commit 4 years ago, 1 contributor
  • Closed-source Windows software, can track eyes and has an API for data extraction, with an in-browser version and online demo available. Repos contain APIs.
  • Backend: ???, Frontends: some C#, some JS
  • ❌ Tested online demo, works (unfortunately) very well.

https://github.com/yas-sim/gaze-estimation-with-laser-sparking

  • 40 stars, last commit 3 years ago, 1 contributor
  • Neural network for gaze estimation
  • Python, OpenVINO, NumPy, SciPy, OpenCV-Python
  • Not tested yet

https://github.com/visualcamp/seeso-sample-android

  • 34 stars, last commit 1 year ago, 6 contributors
  • AI-based eye tracking SDK for Android
  • Java
  • Not tested yet

https://github.com/osama-afifi/Eye-Iris-Automatic-Detection

  • 26 stars, last commit 9 years ago, 1 contributor
  • Eye iris detection based on entropy & iris color score (likely screen-based)
  • C++, OpenCV
  • Not tested yet

https://github.com/R4j4n/Eye-Gaze_and_Blink-detection-using-Neural-Network

  • 23 stars, last commit 4 years ago, 1 contributor
  • AI-based eye tracking with gaze and blink detection
  • Python, Jupyter Notebook
  • Not tested yet

https://github.com/MustafaLotfi/Owleye

  • 9 stars, last commit 1 month ago, 2 contributors
  • Eye tracker (the one with the car and two webcams)
  • Python, Jupyter Notebook
  • Not tested yet

Head-Tracker

https://github.com/opentrack/opentrack ⭐ Personal Highlight ⭐
Opentrack is a middleware for various head-tracking inputs and outputs. Some of the inputs are already included within Opentrack and don't require any additional software. We love Opentrack for its effortless usage. With the UDP output we were able to easily test our calibration software with real tracker data without any extra hardware.

  • 3.6k stars, last commit 1 month ago, 54 contributors
  • Head tracker middleware. Supports many input and output formats and comes pre-installed with some input trackers.
  • C++
  • ✔️ Very good software, particularly useful with UDP output.

https://github.com/AIRLegend/aitrack ⭐ Personal Highlight ⭐
AITrack is a head-tracking software that uses only a simple webcam to accurately capture head movements. No additional hardware is required. The software delivers reliable performance even in low-light conditions or when the face is partially obscured, such as by wearing glasses. It requires minimal computing power, allowing it to run smoothly even on older computers. For added flexibility, AITrack can operate on a second device, like a laptop, to send tracking data to the main computer. Even without a webcam, it can be used by integrating smartphones as cameras via the Droid Cam app. AITrack can also act as an input for Opentrack.

  • 1.1k stars, last commit 2 years ago, 6 contributors
  • A 6DOF head-tracker, which pushes the data over UDP. Very compatiple with Opentrack.
  • C++
  • ✔️ While a little resource hungry, still very good. The output format of the head-tracking data is the same as the one from Opentrack. So if you are just interested in the data over UDP, and you don't care about calibrating the data first, you actually don't need Opentrack.

Others

https://github.com/eyes-on-disabilities/miranda-eye-tracking-screen-calibrator ⭐ Personal Highlight ⭐
Miranda is a GUI tool for calibrating eye and head tracker input to match your screen gaze. It enables seamless integration with other applications, allowing you to use your calibrated tracker data in various ways. For example, you can use Opentrack or Pupil as an input source, calibrate your head rotation to your screen, and output the data as UDP messages. This enables you to control applications like OptiKey with your head movements. Honestly, it's our personal highlight, because we made it.

  • 0 stars, last commit last wek, 1 contributor
  • screen calibration tool for eye-trackers and head-trackers
  • Python
  • ✔️ Its still in development, but we were able to bring together a trackers like AITrack or Pupil together with OptiKey.

Companies

Tobii AB https://www.tobii.com/:

Pupil-Labs https://pupil-labs.com/:

  • produces: eye-tracking software and wearable hardware, mostly for research applications.
  • location: Germany

others:

Commercial Software and Devices for Individuals

A disclaimer: Our goal is to provide cheap or even free and eye-tracking solutions. We therefore don't want to encourage you to buy the following listed solutions. However, for transparency, we want to present these commercial products we found. The list contains the newest version of the products. Their predecessors might still be available.

Communities

Help Organizations

Gaming

Awesome Lists

Learning Materials/Videos

DIY Hardware

Other Stuff

About

A list of various eye- and head-tracking software, products, etc. ℹ️ This is just a push-mirror. We develop here: https://codeberg.org/eyes-on-disabilities/awesome-eye-tracking ℹ️

codeberg.org/eyes-on-disabilities/awesome-eye-tracking

Topics

eye-tracking head-tracking awesome-list awesome-lists

Resources

Readme
Activity
Custom properties

Stars

14 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published