{{appName}}

Goals

  • Free Mobile Phone based assistant App for Blind and Visually Impaired
  • Recognizes
    • Objects
    • Faces
    • Obstacles
    • Provide a voice detail of the scene the user is in

Inspiration

Object Detection

Chips

Apple A11 Bionic

  • 64-bit ARM-based 6-core system on a chip
  • 2 high-performance cores which are 25% faster than the Apple A10
  • 4 high-efficiency cores which are up to 70% faster than the energy-efficient cores in the A10
  • Has the performance controller, which permits the A11 to use all six cores simultaneously
  • Integrated 3 core graphics processing unit (GPU) with 30% faster graphics performance than the A10
  • Embedded in the A11 is the M11 motion coprocessor
  • Includes a new image processor which supports computational photography, supports:
    • lighting estimation
    • wide color capture
    • advanced pixel processing
  • 4.3 billion transistors, 30% smaller than A10
  • Manufactured in a package on package (PoP) together with:
    • 2 GB of LPDDR4X memory in the iPhone 8
    • 3 GB of LPDDR4X memory in the iPhone 8 Plus and iPhone X

Apple A11 Bionic - contd.

  • Icludes dedicated neural network hardware that Apple calls a Neural Engine
    • Can perform up to 600 billion operations per second
    • Used for Face ID, Animoji and other machine learning (ML) tasks
Ref: Apple A11

Deep Learning - Ruslan Salakhutdinov

MIT 6.S094: Deep Learning for Human Sensing

MIT 6.S094: Convolutional Neural Networks (CNN) for End-to-End Learning of the Driving Task

MIT 6.S094: Recurrent Neural Networks (RNN) for Steering Through Time

Android Things

Android Things: The IoT Platform for Everyone

Developing for Android Things Using Android Studio (Google I/O '17)

Raspberry Pi 3

Raspberry Pi 3 - contd.

Raspberry Pi 3 - Spec

  • Quad Core 1.2GHz Broadcom BCM2837 64bit CPU
  • 1GB RAM
  • BCM43438 wireless LAN and Bluetooth Low Energy (BLE) on board
  • 40-pin extended GPIO
  • 4 USB 2 ports
  • 4 Pole stereo output and composite video port
  • Full size HDMI
  • CSI camera port for connecting a Raspberry Pi camera
  • DSI display port for connecting a Raspberry Pi touchscreen display
  • Micro SD port for loading your operating system and storing data
  • Upgraded switched Micro USB power source up to 2.5A
  • Hardware Guide
  • Android Things & Raspberry Pi 3

Flash Android Things

$ sudo  ./android-things-setup-utility-macos
Android Things Setup Utility (version 1.0.19)
============================
This tool will help you install Android Things on your board and set up Wi-Fi.
What do you want to do?
1 - Install Android Things and optionally set up Wi-Fi
2 - Set up Wi-Fi on an existing Android Things device
1
What hardware are you using?
1 - Raspberry Pi 3
2 - NXP Pico i.MX7D
3 - NXP Pico i.MX6UL
1
You chose Raspberry Pi 3.
Setting up required tools...
Fetching additional configuration...
Downloading platform tools...
5.45 MB/5.45 MB
Unzipping platform tools...
Finished setting up required tools.
Raspberry Pi 3
Do you want to use the default image or a custom image?
1 - Default image: Used for development purposes. No access to the Android
Things Console features such as metrics, crash reports, and OTA updates.
2 - Custom image: Upload your custom image for full device development and
management with all Android Things Console features.
1
Downloading Android Things image...
314 MB/314 MB
Unzipping image...
Downloading Etcher-cli, a tool to flash your SD card...
20.5 MB/20.5 MB
Unzipping Etcher-cli...
Plug the SD card into your computer. Press [Enter] when ready