Knight Time Baby Monitor

Knight Time Baby Monitor

Keeping our babies safe!

1

Group InformationTeam 5

2

Members: Mentors:

Jaoaud Annoni (EE) Zaza Soriano, EE/CpETheresa Moyo (EE) Dino Soriano, RNHanyun Wang (EE)Dan Zuber (CpE)

Sponsor: Boeing

ObjectivesBuild a reliable baby monitor for infants under one year old to monitor the infant and keep it out of hazardous positions known to be associated with SUID and SIDS.

Monitor breathing, motion, and body heat of the infant and temperature and sound of the environment.

Acquire and analyze images to identify the infant’s position in the crib. Alert the caretaker and parents of life threatening events.Enable the parents to monitor the babies environment via their smart phones.

Ability to add remote sensors in the future to monitor the heart rate and babies temperature.

3

System Specifications

System Specifications

Monitoring unit no larger than 8” wide x 12” deep x ¾ “ thick

The monitoring unit shall operate for 10 hours on rechargeable batteries.

The minimum broadcast range from the transmitter to the wireless receiver will be 40 meters.

The alarm unit shall always be active using 110 V outlet with auxiliary power by rechargeable batteries lasting 8 hours on one charge.

Product images at least 256 pixels by 256 pixels at 25 frames per second.

Detect the respiration rate within 2 breaths per minute.

4

Overall System

5

Smart PhoneApplication

Microprocessor

Alarm Unit

Overall System

CameraPIR Motion sensor Microphone PIR Temperature sensor

Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

Motion sensor

6


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

sensor•Move too often•Don’t move

•Move too often•Don’t move

Cell Phone

motion sensor

Buzzer

24 Hours

Induction Distance

Size

7

Adjustable distance

Induction distance

Size Infrared (24 Hours)

Delay time

Triggering

Mini IR sensor

<3m 10 x 23 mm infrared Repeated triggering

Security Hi-Q

3-5 28 x 28 x 26 mm infrared Repeated triggering

New R1 5-8m 6.3 x 3.8 x 2.8cm infrared 30s

HC-SR501 yes 0-7m 24x34mm infrared 0- tens of seconds

Repeated trigger/can

not repeated

Motion Sensor Modules

8

HC-SR501Infrared PIR Motion Sensor Detector

Module

Infrared sensor

Control circuit board

Basic Specifications

Detection distance:

Delay time Working voltage Voltage output

0-7M 0.5-200s DC 4.5V – 20V High/Low output :3.3V/0V

24m

m32mm

9

Potentiometer

•Adjust delay timeClockwise=longer delayAnticlockwise=shorter delay

•Adjust distanceClockwise = increase 7mAnticlockwise= decrease 0m

Output voltage:to enter the sensor output range is high, people leave the sensor range of the automatic delay off high, output low

Input Ground Output

10

Basic Features Induction blocking time(default setting:2.5s)

Two trigger mode: A: can not repeat the trigger

B: repeatable trigger

11

Connect to the board

Microcontroller

Microcontroller

12

Camera

13


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

Camera

24 hours

definition

Small No flashing

14

Small Definition 24 Hours No Flashing

OV7660 25x25mm 0.3 mega yes LED light

OV5642 25x25mm 5 mega Yes

Raspberry Pi 25x20mm 5 mega yes Yes (Pi noir)

Camera modules

15

Raspberry Pi 5MP 1080P Camera NoIR (No IR Filter) Night Vision Module

Basic SpecificationsSensor size 3.67×2.74mm

Pixel count 2592×1944

Sensor type Color CMOS(5-megapixel)

Fixed focus 1m to infinity

Video supports 1080p30,720p60 and 640×480p60/90

weight 3g

25mm

20m

m8mm

16

Automatic image control functions:

Automatic exposure control (AEC)

Automatic white balance (AWB)

Automatic band filter (ABF)

Automatic black level calibration (ABLC)

Automatico 50/60 Hz luminance détection

32 bytes of embedded one-time programmable (OTP) memory

Digital video port (DVP) parallel output interface

15cm

16m

m

15 pin ribbon cable

17

Connect To The Board

CSI(Camera Serial Interface)

(the blue backing on the cable should be away from the PCB)

15 Pin Ribbon Cable

Ethernet

HDMI

Video Output

18

Camera Serial Interface

15 Pin

CSI connector

19

Third party soft ware

BerryCam – iOS

Pi Sight – Android

Pi Sight is an Android application which allows you to control all the aspects of your Raspberry Pi camera.

RaspiCam Remote – Android

RaspiCam Remote is an app to view the Raspberry Pi camera module on your Android Device.

Pi Vision - Raspberry Pi

20

Microphone

21


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

Candidate Microphone Devices for Breathing

Device AOM-4544P-2-R TOM-1545P-R

Manufacturer Projects Unlimited Projects Unlimited Directivity Omnidirectional Omnidirectional

Supply Voltage Min 1.5 VDC 2.0 VDC Supply Voltage Max 10 VDC 10 VDC

Frequency Response Min 20 Hz 20 Hz

Frequency Response Max 20 kHz 19 kHz

Sensitivity -44 ± 2 dB -45 ± 3 dB Current Consumption (max)

0.5 mA 0.5 mA

Impedance 2.2 kΩ 2.2 kΩ Signal-to-Noise Ratio (min)

60 dB 60 dB

Dimensions (diameter x height) 9.7 x 4.5 mm 4.0 x 1.5 mm

Price $0.853 $1.90

22

MICROPHONE:AOM-4544P-2-RMicrophone – This will be put near the bottom of the monitoring unit in order to record the sound of the baby’s breathing. Since the microphone will also detect ambient noise, a band pass filter will be used to correct for this.Specifications:The AOMP4544 has a high SNR and flat, wideband frequency response, resulting in natural sound with high intelligibility

Directivity: Omnidirectional Frequency Response Min: 20Hz Supply Voltage Max: 1.5V Sensitivity (dB): -44dB Drain Current Max: 500µA Output Impedance: 2.2kohm

23

Microphone Schematic: AOM 45444P-2 Rand and TI 0801 Amplifier

24

Temperature sensor

25


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

Temperature Sensors:

26

Why MLX90614DAA ?

Power saving mode Customizable PWM output for continuous

reading Medical accuracy of 0.1°C in a limited

temperature range SMBus compatible digital interface for fast

temperature readings and building sensor networks

High accuracy of 0.5°C over wide temperature range (0..+50 C for both Ta and To)

Infrared thermometer for non contact temperature measurements.

17-bit ADC and powerful DSPResolution of 0.02°C

27

Monitoring unit

28


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

Atmega328 MSP430 STM32F4 AM3359

Dev Board Arduino Uno MSP430 Launchpad STM32F4 Discovery BeagleBone Black

Speed (MHz) 16 16 168 1 GHz

Language C, Assembly C, Assembly C, C++, Assembly C, C++, C#, Java

Dev Board CostEst. PCB Cost

$35.00$50.00

$9.99$50.00

$14.25$50.00

$45$100+

PWM support Yes Yes Yes Yes

Max Temp. (F) 185 185 221 221

Flash Memory 32kB 16kB 1MB 512 MB

Onboard Camera Support

No No Yes Yes

ARM?? No No YES! =D YES!

29

Microprocessor

Why we chose MSP 430???? Microprocessor

The MSP430 has a built in clock.

Familiarity with the MSP 430 through embedded systems courses

The MSP has an A/D converter , amplifier switch and Trigger switch built in it.

FREE from TI and the support system

30

INTERFACING MSP WITH DM355

The MSP series has neither the required throughput nor the RAM to handle and process VGA images

A highly integrated programmable platform for digital still cameras, digital photo frames, IP security cameras, four-channel digital video recorders, video doorbell applications, and other low-cost portable digital video applications.High picture quality, the DM355 combines high performance, high quality The DM355 also enables a seamless interface in most additional external devices for a complete digital camera implementation.

31

Microprocessor Programming

32


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

Software Requirements Use the waterfall development process.

Use C or assembly languages for the microcontroller programming.

Save sensor outputs at regular intervals.

Compare all sensor outputs to the appropriate sensor parameters and identify signals outside the parameters.

Send sensor outputs to the smart phones when requested.

Send alerts to the alarm unit(s) and smart phone(s).

Utilize power saving modes of the microprocessor to extend operation.

33

Software SpecificationsSoftware Specifications

Sample audio every ¼ second and save three previous samples.

Sample respiration rates every ¼ second and save three previous rates.

Sample room temperature every ¼ second and save three previous temperatures.

Acquire an image every 4 minutes and save previous three samples.

Compare all sensor outputs against sensor parameters.

Sound alarm if sensor output is outside parameters.

Compare current image against hazardous position sample images and sound alarm if a positive match.

34

35

MONITORING UNIT PROGRAMMING

AudioSensor<<signal>>

Image<<signal>>

MotionSensor<<signal>>

TempSensor<<signal>>

Temperature

+currentTemp+low+high+extreme+historyTemp

+compare(param, curr)+getHistory(int)+soundAlarm(alert)

Motion

+currentMotion+motionSample+noMovementTime+rapidMovementTime

+compare(param, curr)+zeroTime(noMoveStart)+getSample(int)+soundAlarm(alert)

Audio

+currentAudio+lowDecibel+highDecibel+differenceDecibel+soundSample+history

+encode(audio)+save(codedAudio)+get(currentAudio)+compare(param, curr)+getSample(int)+getHistory(time)+sendAudio(index)+record(codedAudio)+soundAlarm(alert)

Video

+pic+samplePics+historyPic

+savePic(pic)+getPic(pic)+sendPic(pic)+receivePic(pic)+video(pic-i)+compare(sample, current)+compare(history, current)+soundAlarm(alert)

Alert

+alertType

+processAlert(alert)+email(alert)+off(off)

Communications

+alert+emgAlert

+callMethod(int)+contactAlarm(alert)+awake()+off()

WiFi<<signal>>

+packet

+receive(packet)+send(packet)

36

Four Sensor sequence repeatsseq

Monitor Temp Ambient Body Heat Motion Audio Image

1 : get()

2 : return()3 : get()



8 : return()

9 : get()

10 : return()

Picture timer/event interrupt

Communications

37


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

38

Communication Technology

Why Wi-Fi?

Communicate, and streaming video to the Android App

Readily available in most locations

Greater Range Than Bluetooth

39

40

Wi-Fi Modules

Wi-Fi Module: Xbee RN-XV

Transmission Range: 400 ft

Transmit Power: 1.25 to 2 mW

Voltage: 2.1 - 3.6 VDC

Greater Data Rate than Bluetooth

@11/54Mbps 802.11 b/g Protocol

41

Communication Radio Frequency

42


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

Transmitter/ReceiverTransmitter- receives audio/video signal and converts it to modulated radio frequency signal and transmits to receiver over a variety of distances.

Receiver-picks up modulated radio frequency, converts it to original audio/video signal

43

Module (XBEE PRO)

44

Specifications:2.4 GHz ISM Band 250 kbps Max Data Rate6o mW output PowerUART serial communicationWeight: 39g

Alarm unit

45


Microprocessor

Alarm Unit

Overall System


Monitoring Unit

WiFi RF Transceiver

WiFi RF Receiver

Alarm Unit

46

Alarm Unit

Audio Alarm

Visual AlarmReceiving Unit

VibrationMotor

Alarm Unit LED Visual Alarm

The vibrator motor is perfect for non- audible indicators

Audible Alarm Vibration Motor

47

Power SupplyVoltage Amps

Wi-Fi (XBEE) 2.1 V- 3.6 V 92mA – 270mA

Microcontroller 4 150 mA

Camera

Transmitter/Receiver

Buzzer( Audible Alarm) 3.5V 35 mA

Buzzer(Vibrator motor) 3 V 75 mA

LED

48

AC/DC wall adapter

Input:

Voltage 120 VAC

Frequency 60 Hz

Output:

Voltage 12 VDC

Current 500mA

49

Power Supply

Power SupplyRechargeable Batteries, Rechargeable, high energy density battery

Low Cost

lithium-ion battery (Li-ion)

50

Android application

Smart PhoneBaby Monitor Application

Monitor Unit

Self contained unit with microprocessor to processes sensor inputs.

Audio and Visual AlarmUnit.

Knight Baby MonitorOverall System

Image sensorIR Motion sensorMicrophoneIR Temperature sensor

51

Application class diagram

52

Smart Phone Application

On/ Off

+state

+toggle()

Parameters

+temperatureLow+temperatureHigh+tempSampleRate+noMotionTime+rapidMotion+motionSampleRate+audioDB+audioLow+audioHigh+audioSampleRate+picSampleRate

+enterParameter()+changeParameter()+cancel()

Listen

+audioSignal

+playAudio()+recordAudio()+compareAudio()

View

+videoSignal+pic

+viewVideo()+recordVideo()+selectPic()+viewPic()+savePic()+comparePics(picA, picB)

Application Interface

53

Knight's Baby Monitor Application

SETPARAMETERSMONITOR

SENSORS

TURNOFF

MONITORVIDEO

MONITORAUDIO

Application Alert Interface

54

ALERT

Knight's Baby Monitor Application

MONITORSENSORS

TURNOFF

MONITORVIDEO

MONITORAUDIO

Work loadTeam member Assigned task

Andy Camera

Andy IR motion sensor

Theresa Microphone

Theresa IR temperature sensor

Theresa and Jaouad Microcontroller

Jaouad Communications

Jaouad Power supply

Dan Microcontroller programming

Dan Android smart phone application

55

Parts list

56

Parts Quantity Technology Cost

Wi-Fi (XBEE) 1 Roving Networks $35.95

Microcontroller 1 Texas Instruments free

Camera 1 Raspberry Pi $45

Transmitter/Receiver

1 Roving Networks $ 22.95

Buzzer( Audible Alarm)

1 Cluinic $9.83

Buzzer(Vibrator motor)

1 Precision Microdrives $4.95

LED 1 Green Technology free

Temperature Sensor

Melaxis $14.31

Microphone 1 Pui Audio $6.95

PIR Motion Sensor

1 Ademco Honeywell $5.95

Power Supplies 2 Sony $4.95

Wall adapter 1 Tascam $11.95

Percent Complete

57

Percent complete

58

Problems

Measuring the amount of movement of the infant.

Sensing the infants breathing remotely.

Sensing the infants body heat remotely.

Possible solution would be to add remote sensors and transmitting units to the infant’s clothing as recommended by Dino Sariano, RN.

59

Questions?

60

Documents

Knight Time Baby Monitor