Developed an iOS application that identifies faces using AR and facial recognition using iPhone hardware written in Swift to search for people. Have you ever been in the situation where you see someone you've met before but you forgot where exactly and felt to awkward to ask for their name?. That's where Lookup swoops in to save the day!
Lookup is an application built with Swift, NodeJS and Microsoft's Project Oxford, and Facebook's Graph API. This application allows you to point your mobile phone at someone's face and, in a couple seconds, be able to identify who they are. This application utilizes Facial Detection, and Facial Identification to take take an analysis of someone's face and map it to their information.
Lookup first take images from the client device, through the iPhone. A camera is opened up and images are being taken once Apple's camera API detects a face through the lens. When a face is detected a series of pictures are taken and a subset of 20 are serialized and sent to the NodeJS server where it is then being stored coordinated to Microsoft's Project Oxford API for Analysis. Beforehand a set of images from people in the surrounding area, at least at the event themselves, have their faces analyzed through Project Oxford to act as a training set. Once the analysis is done and there is a match, Project Oxford sends back the match that corresponds. Facebooks Graph API is then used to get the public details of the profile identified. From the NodeJS server the profile results are then sent back to the iPhone to display profile details next to the face that is being presented on the screen as the camera points to it.
More details of this project can be found on it's Github
Let's do a project!