Lighthouse Review: a Smarter Security Camera

Reviewing the recordings your security camera makes can answer the question “Was there anybody in my home while I was away?” The problem is that you need to review everything it recorded while you were gone to find out. With the AI-driven Lighthouse  security camera, you literally ask if anyone was in your home while you were gone.

Like a lot of home security cameras, the Lighthouse provides a 1080p live stream, two-way talk, night vision, real-time activity alerts, and an onboard siren for scaring off intruders. It also uses facial recognition to distinguish between pets and people and to identify recognized individuals by name. But its natural-language processing engine sets it apart from the sea of samey offerings, allowing you to search recorded footage and set alerts by speaking or typing questions and commands.

Lighthouse Review: a Smarter Security Camera
Photo Credit: CNET

Lighthouse developed for self-driving cars

The camera incorporates a 3D time-of-flight sensor—a carryover from the Lighthouse founders’ Ph.D. work on self-driving cars at Stanford University—for enhanced computer vision. According to Lighthouse, this sensor measures the time it takes for emitted light to return to the Lighthouse after bouncing off objects in the environment, allowing it to create a 3D model of the scene it’s viewing. Because the camera only triggers alerts based on 3D motion, it purportedly eliminates the false alerts common to cameras with 2D sensors, which are often set off by lights and shadows. The 3D sensor also helps the AI engine to distinguish between adults, children, and pets.

The Lighthouse starts building a catalog of faces as soon as you power it up. You identify these using a “tag faces” feature that presents you with any new faces the camera encounters and lets you assign them names. Typically, facial recognition takes a few weeks of repeating this process over and over to learn who’s who, but the Lighthouse started recognizing my kids, my wife, and me immediately.

All this data enables the Lighthouse to respond to your questions and commands. For example you can search recorded footage by saying “What did the cat do last night?” or “What did Tom do while I was gone?” After a brief search, the app will display time-stamped thumbnails of all the video clips containing the cat and Tom respectively, recorded in the designated time period. In these clips, the subject is surrounded by a colored halo—blue for humans and orange for pets—so you can easily identify them and track their movement.

You can also use voice and typed commands to create custom notifications (Lighthouse calls them “pings”) to alert you when the camera sees a pet, a family member, or an unrecognized person. “Ping me if you see anything between 10pm and 6am,” and “Tell me if you see anyone new with the kids when I’m not there” are two of the ones I used, but the possibilities seem limited only by your imagination. The app includes one default Ping to alert you to any person-related activity while all invited users are away. The camera uses your phone’s location service to determine when you’re home and away, so it’s best to have everyone in the household create an account (you can invite people within the app).

Effective person recognition

Lighthouse Review: a Smarter Security Camera
Photo Credit: Wirecutter

The Lighthouse generally had no problem identifying my family members and alerting me to their activity. The facial recognition was surprisingly accurate from the get-go and only improved with continued use. The ability to distinguish between adults and children—which Lighthouse told me during a briefing uses age 10 as the dividing line—was also spot on. The AI wasn’t flawless: One search for video showing our cats returned more than 30 clips, only one of which contained an actual feline. In the rest, it misidentified various family members—and even the back of my head—as a cat. But this is to be expected when the system is learning about your environment, and it’s less likely to occur the longer you use the camera.

The Lighthouse app is planned amazingly well. On the home screen underneath the live stream board are controls for the alarm, two-way talk, and killing the camera on. Any enrolled clients as of now home are shown beneath this. Next is a “last observed” accumulation of catches that let you see the most recent 24 long stretches of chronicles of grown-ups, youngsters, pets, and obscure people, and in addition a period day by day recap of all action. Additionally down is a board with every one of your Pings and switches to empower/handicap each, and a day by day action structured presentation separated by hour.

Along the bottom of the home screen are several buttons that take you to other parts of the app. The People button displays a screen with all the people in your facial recognition database. Events opens a time-stamped list of all alert-triggering activity. The Ask button takes you to the screen where you can search video or create Ping using voice commands. And the More menu lets you add additional cameras, change your location and access help topics.