NSFWorkshopon

SpectrumMeasurementsInfrastructure

WorkshopReport

6-7April2016

TableofContents

1. ExecutiveSummary.......................................................................................................................................4

1.1 KeyFindings...........................................................................................................................................5

1.2 PrioritySpectrumMeasurementResearchTopics................................................................5

2. WorkshopGoalsandOrganization..........................................................................................................7

2.1WelcomeandAgenda-DennisRoberson...................................................................................7

2.2 MeetingObjectivesandSurveyResults-ThyagaNandagopal.........................................8

3. OpeningKeynoteSpeaker-Dr.JamesTruchard(NationalInstruments)...........................10

4. KeyProjectsPanel-ModeratedbyMilindBuddhikot.................................................................10

4.1 HighlightsofPanelists’OpeningRemarks..............................................................................10

4.1.1 MikeCotton(ITS).........................................................................................................................10

4.1.2 PrestonMarshal(Google).........................................................................................................11

4.1.3 GregBuchwald(MotorolaSolutions)..................................................................................11

4.1.4 BertrandHochwald(NotreDame)......................................................................................11

4.1.5 PaulBrown(Paradigm4)..........................................................................................................11

4.1.6 JoydeepAcharya(Hitachi).......................................................................................................11

4.2 SummaryoftheKeyProjectsPanel...........................................................................................12

5. EquipmentPanel-ModeratedbyIvanSeskar................................................................................10

5.1 HighlightsofPanelists’OpeningRemarks..............................................................................10

5.1.1 AbhaySamant(NI).....................................................................................................................14

5.1.2 RaymondShen(Keysight).......................................................................................................11

5.1.3 SteveSatoh(PCTEL)...................................................................................................................11

5.1.4 SteveStanton(Tektronix)......................................................................................................114

5.1.5 RandyNeal(Rohde&Schwarz)...........................................................................................125

5.1.6 BruceDevine(SignalHound)..................................................................................................11

5.2 SummaryoftheEquipmentPanelInteractions.................................................................125

6.0 EquipmentDemoSession.........................................................................................................................13

7.0 SpectrumPopQuiz......................................................................................................................................13

8.0 KeynoteSpeaker-Dr.PaulKolodzy(Consultant).........................................................................16

9.0 FocusGroups-Day1Sessions...............................................................................................................13

9.1 OptimalFutureSpectrumMonitoringArchitecture...........................................................18

9.2 SpectrumMonitoringDataManagementArchitecture.....................................................18

9.3 RoleofSpectrumMeasurementinthevariousapplications........................................188

10.0KeynoteSpeaker-Dr.JoeEvans(DARPA)........................1Error!Bookmarknotdefined.

11.0TheDARPASpectrumChallenge-Dr.PaulTilghman(DARPA)..1Error!Bookmarknotdefined.

12.0FocusGroups-Day1ReadoutPanel.................................................................................................139

12.1 OptimalFutureSpectrumMonitoringArchitecture...........................................................17

12.2 SpectrumMonitoringDataManagementArchitecture.....................................................21

12.3 RoleofSpectrumMeasurementinthevariousapplications..........................................24

13.0FocusGroup-Day2Sessions.................................................................................................................24

13.1 RequirementsforFutureSpectrumMonitoringArchitectures.....................................25

13.2 CriticalResearchOpportunitiesandDeploymentEfforts...............................................26

13.3 RecommendedPriorityResearchandDevelopmentTopicPanel..............................26

14.0Wrap-up-ThyagaNandagopalandDennisRoberson.................................................................27

15.0OptionalSpectrumObservatoryTours-DennisRoberson.......................................................27

16.0Acknowledgements.....................................................................................................................................28

AppendixA:WorkshopOrganizatingCommittee.....................................................................................29

AppendixB:WorkshopAgenda........................................................................................................................29

AppendixC:Exhibitors.........................................................................................................................................32

AppendixD:ParticipantList..............................................................................................................................33

AppendixE:SpectrumMeasurementSurvey.............................................................................................33

AppendixF:ResourcesandReferences........................................................................................................32

4

1. ExecutiveSummary

TheNSFSpectrumMeasurementInfrastructureWorkshopwassponsoredandfundedbytheNationalScienceFoundationandwashostedatIllinoisInstituteofTechnologyinChicago,Illinoisonthe6thand7thofApril2016.Thisreportsummarizesthemotivation,goals,format,materialobservations,conclusionsandrecommendationsdrawnfromthatWorkshop.

Spectrummeasurementandtheunderstandingthatcomesfromtheseeffortshasbecomeanincreasingimportanttopicasweseektomoreefficientlyandeffectivelyutilizeournation’sincreasinglypreciousspectralresources.SeveralFederalGovernmentinitiatives,includingtwoPresidentialMemorandums1,andthePCAST(PresidentialCouncilofAdvisorsonScienceandTechnology)SpectrumPolicyreport2,haveadvocatedcollaborativeresearch,development,andtestingintheareaofenhancedmeasurementcapabilities,toadvancetemporalspectrumsharingtechnology,andrelatedregulatoryrule-making.CurrentlytherearespectrummeasurementrelatedeffortsbeingpursuedbyadvisorybodiesforboththeFCC(theTechnologicalAdvisoryCouncilorTAC)andtheNTIA(theCommerceSpectrumManagementAdvisoryCommitteeorCSMAC)thatfurtherunderscoretheimportanceofthisarea.Understandingthespectrumsharingenvironmentiscomplex.Whilespectrummeasurementsareperformedtodaybyindustry,academia,andgovernment,theseeffortsusuallytendstobenarrowlyfocusedtoalignwiththeirrespectivemission,and/orcurrentbusinessinterests.Dependingonthespecificpurposeandmethodofdataacquisition,spectrumobservationstendtobediverseandscatteredamongmanysources.Observationsalsovarywidelybasedonthemethodsusedandthetypeofdatarequested.Althoughtherearemanyapproachestomeasuringspectrumoccupancy,nosinglemethodisapplicableunderallcircumstances.Also,thedatarequirementsthemselvesarehighlyvariableanddependentontheintendeduse.

ThisWorkshopwasundertakentobringtogethergovernment,industry,andacademiaexpertstodiscussimprovementsinspectrummeasurementtechniquesandinfrastructuretobetterinformspectrumpolicyandmanagementdecisions,andtosupportmoreefficientanddynamicsharedspectrumusage.ThegoalsoftheWorkshopweretocapitalizeonthecollectiveexpertiseofthespectrummeasurementthoughtleadersto:

• Examinethecurrentstatusofspectrummeasurementeffortsandrelateddatacaptureandanalysiseffortstoimprovespectrumutilization

• Establishmeaningfulandachievablenationalgoalsrelatedtospectrummeasurement• Chartoutaroadmapforscalingspectrummeasurementeffortstoacountrywidelevel.

1SeePresidentialMemorandum:UnleashingtheWirelessBroadbandRevolution,http://www.whitehouse.gov/the-press-office/presidential-memorandum-unleashing-wireless-broadband-revolution,June2010;andPresidentialMemorandum:ExpandingAmerica’sLeadershipinWirelessInnovation,http://www.whitehouse.gov/the-press-office/2013/06/14/presidential-memorandum-expanding-americas-leadership-wireless-innovatio,June2013.2SeeReporttothePresident:RealizingtheFullPotentialofGovernment-HeldSpectrumtoSpurEconomicGrowth,at49-50(July2012),availableathttp://go.usa.gov/k27R(PCASTReport).

5

1.1 KeyFindings

Therewereavarietyofimportantfindingsemanatingfromourtwodaysession.Theseareprovidedthroughoutthisnowextensivereport.Criticalfindingsthatwerementionedinmanyplacesandinmanywaysincludedthatfactthat“onesizedefinitelydoesnotfitall”whenitcomestospectrummeasurementsystems.Therearemanydifferentgoalsthatarebeingpursuedorwillbepursuedbyvariousgroupsusingspectrummeasurementsystemsasameansofaccomplishingtheirobjectives.AsPaulKolodzy,oneofourKeynoteSpeakersnoted,thereareatleastfourkeyphasesofspectrummeasurementapplications,namelymeasurementsto:1)quantifyopportunitiesandsupportregulatoryactionPriortoSharing,2)OperationallySupportthesharingprocessoncethespectrumhasbeendesignatedforsharing,3)Assessusageandinterferencetrendsandtoassessfurtherrulemodificationsaftersharedspectrumoperationsareinplace,andfinally4)supportEnforcementrequirements.

Beyondthesephases,therearemanyotherdimensionsofspectrummeasurementrequirementsincludingtherangeofspectrumtobemeasurement,thegeographicareathatthespectrummeasurementsaretocover,thedurationforthemeasurement,therequirementresolutionbandwidth,themeasurementcyclerequirements,thespatialconsiderationofthedirectionthesignalislikelytobeemanatingfrom,thepowerlevelofthesignaltonamebutafewoftheconsiderations.Giventhenumerousconsiderationsanddecisionsthathavetobetakeninproperlydesigninganappropriatespectrummeasurementarchitecture,itiscriticalthattheobjectivesforthemeasurementeffortbecarefullyconsideredanddocumented.Thiswillenableapropersystemarchitectureandimplementationtobeestablished.

Thispluralityofneedsalsosuggeststhattherearemanydifferentkindsofspectrummonitoringsystemselementsthatneedtobedevelopedanddeployed.ASystemofSystemshierarchyofatleastthreeclassesofsensors:1)highcost/hightrustsensorsatfixedlocations,2)mid-cost/midtrustsensorsmorewidelydeployedgeographicallybetweenthefirstclassofinstallations,and3)crowdsourcedsensorsoccupyingthebottomtierofthestructure.Criticaltothisstructureisthesoftwaretoenablethedatagatheredfromthesedifferentclassestobeeffectively“gradedandintegrated”atanappropriatelevelofthedatastructurefortheover-allsystemtosupporttheanalysisneededtosatisfyvariousspectruminformationrequirements.Thisdiversityofelementsandstructuresinthespectrummeasurementarchitecturesuggeststheneedforawidevarietyofhopefullycollaborativeoratleastsynergisticresearcheffortstosupportthesevariedspectrummeasurementneeds.Italsosuggestssignificantbusinessopportunitiesforvendorstoproducethewidevarietyofinstrumentsthatwillbeneededtosupportthesespectrummeasurementsneeds.

1.2 PrioritySpectrumMeasurementResearchTopics

TheWorkshopdidconcludewithasolidsetoffocusareasforresearcheffortsthatwouldadvancethestateoftheartinthespectrummeasurementarchitecturearena.ThesearecapturedingreaterdetailinSection13ofthereportandarealsoavailableaspresentationsonthewebat-http://www.cs.albany.edu/~mariya/nsf_smsmw/.ThesummaryofthetopicalresearchareasasidentifiedbythefinaltwoFocusGroupsoftheWorkshoparelistedbelow.

TheDay2FocusGrouponSpectrumMeasurementArchitecturehighlightedtheneedforresearchinthefollowingprioritizedareas:

• SignalIdentificationRate• SignalIdentification

6

• GeneralDetectionorInformedDetection• PortablevHeterogeneousProcessingAlgorithms.

TheDay2FocusGroupexaminingthebroaderscopeofcriticalspectrummeasurementrelatedresearchtopicsestablishedthefollowinglistofresearchareaslistedinprioritysequence.

• Featuredetection&extraction-knownvsunknownsignals

• RFBigDataanalysis-metadata&schemas-lessonslearnedfromradioastronomy

• Crowdsourcingofmeasurement-consumervsprovider-incentivizedvspolicy

• Measurementfordirectionality

• Roleofedgeprocessing

• RFfrontendconsiderations-costs,re-configurability,filtering,bandwidth

• Handlingunplannedeventsandspectrumdynamics

• Compartmentalizedmeasurementdata-privacyandsecurity

• mmWaspectsofspectrummeasurement

• SpectrumdatafornonRFapplications.

Inadditiontoaccomplishingthemajorobjectiveofidentifyingkeyresearchtopicsthatrequirementin-depthinvestigation,manyvaluableexchangestookplacebetweenthevariousgovernmentagencyrepresentatives,industryrepresentatives,anduniversityresearcherspresentattheevent.Itishopedthattheserelationshipswillflourishovertimetoenhancetheover-allcollaborativeeffortsinthisimportantarea.

7

2. WorkshopGoalsandOrganization

Goals:Asthedemandforspectrum,thelifebloodofthewirelessworld,continuestoexponentiallyincrease,theinterestintheefficientutilizationofspectrumhasseenacorrespondingincrease.Thishasnaturallyledtoanexpandedfocusonspectrummeasurementasanincreasinglyvitalcomponentoffuturewirelesscommunicationplans.Thisistruewhethertheplansarefocusedonmobilebroadband,theInternetofThings,radar,orforpassivescientificuse.Withincentivesforspectrumsharingbecomingincreasinglylucrative,theneedtoaccuratelycharacterizethelevelofsharingandusageatanationalscaleisbeingfeltacutelybyallengagedstakeholders.Thegoalofthisworkshopwastobringtogetheracadreoftoptieracademic,governmentandindustryresearchersfocusedontheareaofspectrumoccupancyobservation,andencouragetheseattendeestoutilizetheircollectiveknowledgeinthescienceofspectrummeasurementtochartoutaroadmapforscalingspectrummeasurementeffortstoacountrywidelevel.Animportantcomponentofthiseffortfocusedonthemeansbywhichlarge-scalespectrumusageinformationiscaptured,maintained,curated,analyzedanddisseminatedtovariousstakeholders.Thiswasaccomplishedthroughaformatconsistingofkeynoteaddresses,paneldiscussionsandfocusgroupsessions.Akeyproductoftheworkshopisthisreportthatdocumentsthehigh-levelroadmapforanationalspectrummeasurementinfrastructure,thearchitecturalconsiderations,technicalchallengesinvolvedinrealizingsuchavisionandtheidentificationofkeyareasofresearchneededtomakethisvisionareality.AtourofIIT’sSpectrumObservatorywasprovidedtoillustrateoneexampleofaprototypefixedobservationstation.

This workshop utilized the collective expertise of spectrum management thought leaders fromindustry,academia,variousconsortia,andFederal,state,andlocalgovernmentagenciestoaddressthefollowingquestions:

1. Howcanincreasedavailabilityofspectrumoccupancydatabetterinformpolicydevelopment?

2. Wherecandatabeusedmosteffectivelytoimprovepolicydecisions?3. Inadata-drivenapproachtospectrummanagement,whatpolicyareasrequireattention,

suchasprivacyandsecurity?4. Howwilladvancesinmonitoringtechniquesanddatamanagementincludingvastlylower

costs,makespectrumenforcementmoreefficientandeffective?5. Howcanimprovementsinmonitoringandaccesstodataenablenewparadigmsofsharing,

includingautomateddynamicspectrumaccess?

2.1WelcomeandAgenda-DennisRoberson

DennisRoberson,IITViceProvostforResearch,ResearchProfessorinComputerScienceandworkshophost,openedthemeetingwelcomingthe60+attendeesfromacrosstheU.S.andindeedtheworld.ProfessorRobersonsummarizedtherigorousagendaforthetwodaysoftheWorkshophighlightingtheanticipatedengagementofallparticipantsinthevariousFocusGroupsessionstobeheld.HeprovidedspecialthankstotheNationalScienceFoundationforprovidingboththeideafortheWorkshopandthegrantthatenabledtheWorkshoptobeheld.HethenintroducedDr.ThyagaNandagopal,theNSFProgramDirectorwhopersonallyservedasthesponsorfortheevent.ThyagaoutlinedtheobjectivesfortheWorkshopandreviewedtheresultsoftheSpectrumMeasurementRequirementsSurveythatmostoftheattendeeshadfilledoutpriortothemeeting.

8

2.1MeetingObjectivesandSurveyResults-ThyagaNandagopal

MeetingObjectives:Giventheenormoussocietalandfinanciallydriveninterestinefficientspectrumutilization,thegoalofthismeetingistobetterunderstandhowtoenhanceandapplyadvancedspectrummeasurementandmonitoringtechniquestoimprovethisutilizationinthecontextoftemporalspectrumsharing.Specifically,themeetingwasmeanttofocusonwhatandhowtodeploylargescalemeasurementtechniquestosupportadvancedspectrumsharingapproaches.Inthiscontextthemeasurementandmonitoringtechniquesneedtosatisfyavarietyofconstituentneeds(e.g.operational,regulatoryassessments,enforcement,etc.)andsatisfytheseneedsinanefficientandcosteffectivemanner.Thisincludesdirectmeasurementandmonitoringconsiderations,datamanagementrequirements,analyticaltechniquesandvisualizationapproaches.TheWorkshopwasspecificallynotintendedtoexploregeneralpolicytopicsindependentofthetechnologicalimplementations.TheworkproductoftheWorkshopwasmeanttobethisreport,importantlyfocusingontheactionablerecommendationsthattheexpertsattendingthesessionmadeinlinewiththeGoalsdescribedabove.Theserecommendationsshouldguidebothresearchinvestmentsandrelevanttechnologybasedwirelesspolicydecisions.

SpectrumMeasurementRequirementsSurvey:AftersettingtheObjectives,Thyagaprovidedanoverviewofthe40Surveyresponsesprovidedbytheattendees.Therewasreasonablystrongconsensusontheapplicationofthemeasurementsystemstotheprocessesof:

1. Validatinganalyticalmethodsandassumptions;2. Establishingthereal-timeavailabilityofspectrumforentrantsandincumbentsfor

spectrumsharingdecisions;3. Identifyingunauthorizedspectrumuseandenforcingspectrumregulations;

andthatmeasurementsystemswouldberequiredtoperformmanyfunctionssimultaneously.Therewasalsoareasonablelevelofsupportfortheviewthatthesemeasurementsystemsshouldsupporttheidentificationofinstancesof“ducting”andotheranomalouspropagationeffects.

Geographically,therewasreasonablesupportforafocusonurbandeployments(i.e.wherethespectrumneedsandinterferenceissuesaremostsevere),thoughtherewasn’tastrongdisagreementthatruralsitesnearDoDinstallationswouldalsobeinterestingspatialareasforspectrumobservation.Inanycase,therewasstrongagreementthatanysystemshouldhavenearcontinuouscoverageoverthedeploymentarea.

Thesupportfortransmissiontypesrangedfrom:

1. strongsupportformeasuringtraditionalfixedandmobileterrestrialtransmitters2. reasonablesupportfortherequirementtobeabletoobserveintermittenttransmitterand

highlydirectionaltransmissionsystems3. limitedsupportforthecapabilitytosupportthemeasurementofman-madenoise,

spuriousemissions,inter-modulationandotherunintendedsignals4. verylimitedsupportforairbornetransmittermeasurements.

Fromaspectrumperspective,therewasverystrongsupportformeasuringtherangesofbandsbelow6GHzandlimitedsupportformeasurementsystemsexclusivelyfocusedonspectrumabove6GHzorsystemsthatcoverallspectrumbandsuptoandincludingmillimeterwavebands.

9

Fromameasurementperspectivetherewasgeneralagreementonthe:

1. Neednottobetime-synchronizedaslongasalignmentispost-facto2. Abilitytodeterminetheemissiontypeofsignals3. Localizationwith100meteraccuracy(asopposedto10m,1km,10km)4. Localizationaccuracyultimatelybeingdependentonthesignalbeingmeasured5. Needtohaveahighdynamicrangeinthespectrummeasurementsystem6. Needtoreacttoeventswithinseconds(e.g.30seconds)7. Abilitytoprovidelogfiles,I/Qhistoryanddetailedreports.

Ontheotherhand,therewasnoagreementonthe:

1. Calibrationlevels

2. Needtohavetighttimesynchronizationgoalsacrossunits

3. LimitingI/Qdatacollectionandretention(forprivacyreasons).

Therewasmoderatesupportfortheneedforhighdetectionsensitivitylevels(i.e.sub-noisefloordetection).

Finally,therewasnoconsensusonanyoftheproposedinstallationandoperationscostscategoriesofferedtothegroup.Thisquestionwaslikelyveryprematuresincethemeetingillustratedthatthereareaverywiderangeofpossibleandinmanycasesdeployed(atleastattheprototypelevel)spectrummeasurementarchitecturesandthefactthatnosinglearchitectureiscapableofcoveringthefullrangeofsignaltypesthatneedtobemeasured.TheSurveycanbefoundinAppendixEandtheSurveyresultsareavailableontheWorkshopwebsite(http://www.cs.albany.edu/~mariya/nsf_smsmw/docs/NSF_SMIW_survey_results.pdf).

WorkshopOverview:TheWorkshopopenedwithanoutstandingpresentationprovidedbyourFirstKeynoteSpeakerDr.JamesTruchard,President,CEOandCo-FounderofNationalInstrument.Dr.Truchardisalegendaryfigureintheautomatedtestequipmentandvirtualinstrumentationsoftwarefieldandhiscompanyisoneofthekeyprovidersofequipmentandbaselevelsoftwareforspectrummeasurement.ThissessionwasfollowedbyaKeyProjectsPanelandanEquipmentPanelthatleddirectlytoasetofdemonstrationsandexhibitsbykeyequipmentprovidersthroughanextendedlunchperiod.Dr.PaulKolodzy,afabledtechnologistwhoinitiatednumerouseffortsinthespectrummeasurementandsharingarenaatDARPAandwholedtheFCC’sSpectrumPolicyTaskForceintheearly2000sprovidedourafterlunchKeynoteaddressonthefirstday.ThisaddresswasfollowedbyourfirstoftwoFocusGroupbreak-outperiodsfeaturingthreegroupsworkingthroughverychallengingquestionsthatwillbediscussedlaterinthereport.

Afteranenjoyableevening“onthetown”inChicago,weopenDay2oftheWorkshopwithourthirdillustriousKeynoteSpeaker,Dr.JoeEvans,whoiscurrentlyservinginacriticalroleasaDARPAProgramManagerintheStrategicTechnologyOfficefocusingonwirelesstechnologieswhileonleavefromhispositionasaDistinguishedProfessorattheUniversityofKansas.HewasfollowedbyDr.PaulTilghman,alsoakeyDARPAProgramManager,whointroducethenewlyreleasedDARPASpectrumChallengetothegroup.APanelcomposedofthethreepairsofCo-ModeratorsfortheFocusGroupsprovidedread-outforeachoftheirFocusGroupsfollowedbyaPaneldiscussionontheresultsofthesessions.Afterashortbreak,thissessionwasfollowedbyourfinalpairofFocusGroupsseekingtoidentifythe“roadmap”ofrequirementsforfuturespectrummeasurementsystemsandtheresearchprioritiesthisareathattheWorkshopshouldrecommend.Afterlunch

10

theseFocusGroupsprovidedtheirread-outtothefullWorkshopinafinalPanelDiscussion.ThisleadtoashortWrap-uppresentationbyThyagaNandagopalandDennisRoberson.AnoptionaltouroftheIITSpectrumObservatoryfollowedtheconclusionoftheformalsession.

The following sections provide descriptions, details, and conclusions from each element of theworkshop.

3. OpeningKeynoteSpeech–Dr.JamesTruchard–NationalInstruments

Dr.Truchard(orDr.Tashelikestobecalled)openedourWorkshopwithanexpansivediscussionoftheworkbeingpursuedatNationalInstruments(NI)insupportofspectrummeasurementandconsiderablybeyond.AfterbrieflyintroducinghimselfandNationalInstrumentsheinitiallyfocusedontheimportanceofhardwareandsoftwareplatformstoenableprogressinavarietyofdomains.HethenappliedthisprincipletotheimportantrolethatLabVIEW,NationalInstruments’popularsoftwareplatform,playsinthedesignofcommunicationssystems.Heillustratedthisbydescribingthehistory,evolutionandthecapabilitiesofLabVIEWinvariousapplicationsareas.HethendescribedthearrayofproductsNIprovidestomeetawidevarietyofcommunicationssystemsandmeasurementsrequirements.IntheclosingportionofhispresentationhedescribedmanyofthenumerousapplicationsoftheNIproductfamilytoawideanddiversesetofproblems.InthissegmentheparticularlyfocusedonthewiderangeofpartnersthatNIhasestablishedovertimeandtheachievementsthatNIhasbeenabletosupport.ThetalkwasverywellpresentedandverywellreceivedservingtokicktheWorkshopoffonaverypositivenote.

4. KeyProjectsPanel

Thisopeningpanelwascomprisedofsixthoughtleadersengagedinthevariousareasrelatedtoourfocusonspectrummonitoringandanalysis.Thegoalwastoprovideacurrentperspectiveonthe“state-of-the-art”invariousaspectsofthespectrummeasurementspaceincludingseveralcriticalandhighprofileapplications.

4.1 HighlightsofPanelists’OpeningRemarks–MilindBuddhikot–Nokia–BellLabs

MilindBuddhikotfromNokia–BellLabsopenedthepanelwithashortstagesettingpresentationhighlighting thehistoryof spectrummeasurementsand thechallengesassociatedwith theuseofmeasurementsandsensingtoeffectpositiveimpactontheefficiencyofspectrumutilization.Hethenmoderated the opening presentations and the follow-on discussion between the subject matterexpertsonthePanel,offeringopportunitiesforquestionsfromtheaudiencethroughthePaneltimeperiod.Thefollowingdescribeseachofthepanelistsopeningremarks.

4.1.1 MikeCotton–NISTITS

Mikedescribedthemajorspectrummeasurements/monitoringprojectsthatarebeingpursuedatITSinBoulderandspecificallythegrowingnetworkofITSspectrummonitorsthataresupportingablendofrulemaking,engineering,spectrummanagement,andenforcementobjectiveswithacurrentfocusonthe3.5GHzband.Thepresentationillustratedthearchitectureofthenetwork,theimplementationofkeyelementsofthesystemandsomeofthechallengesassociatedwiththeseelements.Throughthedevelopmentanddeploymentofthisnetwork,acriticalgoalistodeterminewhetheramorecomprehensivemonitoringprogramwouldpositivelyimpacttheefficientuseofspectrumthroughsuchapproachesasmoreeffectivedynamicspectrumsharing.Heclosedby

11

providingreferencesforfourofthestudiesthegrouphasconductedoverthepastfewyears.ThisarecapturedasthelastfourentriesinAppendixFofthisreport.

4.1.2 PrestonMarshall–Google

Prestoncautionedusthatwhilefixedspectrumobservationmightbeusefultosomedegree,theultimatechallengeistounderstandtheenvironmentataspecificreceivertomakeappropriatedecisionsaboutitsuse,especiallyinadynamicsharingenvironment.Afundamentalchallengehereistheuncertaintyassociatedwiththeactualpropagationofasignalvs.thevariouspropagationmodelsthatareinusetoday.Heillustratedthischallengethoughaslideshowingthemeasuredpathlossvs.aFreeSpaceModelpredictedpathlosswhichindicatedthatthemodeledlosswasveryconservative.Useofthemodelwouldthereforehavetheeffectofdramaticallyreducingthepotentialspectrumefficiencythatmightbeattainedifeitherabettermodel,ormoreimportantlysensingatthereceiveritselfwereinplace.Asasolutionhesuggestedtheforwardlookingapproachofusingmicro-/nano-modelingfortodaytransitioningtosomeformofmandatedcrowd-sourcingbyreceiversinvolvedinasharedspectrumenvironmentinthefuture.

4.1.3 GregBuchwald–MotorolaSolutions

GregspoketotheimportanceofourmigrationtoaGeo-locationDatabasecentricSpectrumManagementapproach.Atthesametimehenotedsomeofthechallengesassociatedwiththisdirection,especiallyformobiledevices.Tosupportthisapproachheproposedthatanetworkoffixedsensingdevicessupplementedbycrowdsourcingfromdevicesdesiringshareduseofaspectralenvironmentunderapay(sensing)toplay(spectrumuse)protocol.Hefurtherhighlightedthenumerouschallengesassociatedwithsensingincludingtheclassicalhiddennodeissue,theneedto(oratleastthehighdesirabilityto)identifyspecificwaveforms,thechallengeofsensinglowpowersignalsbasedinpartonclassical“near-far”problems,andthevariationinprotectionrequirementsbyvarioususerclasses.

4.1.4 BertHochwald–NotreDame

BertdescribedthecharacteristicsoftheRadioHoundsystemsbeingdevelopedanddeployedatNotreDameasa“low-cost,pervasive,persistentspectrumsensor”.Thegoalforthisspectrumsensingsystemdevelopmenteffortistoproduceahighlycapablespectrumsensingcapabilitywhichissufficientlylowcostthatitcanbeverywidelydeployed.ThisisafullsystemincludingadatabasewithInternetaccesstoenableenhancedvisualizationincludinganotional“heatmap”illustratingthecoverageareasforthevarioustransmittersidentifiedbythewidelydeployedsensors.Thebulkofthepresentationcoveredthedetailsofthestatusofthedevelopmenteffortandtheplansforthefuturework.Pleaseseethewebsiteforadditionaldetails.

4.1.5 PaulBrown–Paradigm4

Paulshiftedthefocustothecriticalchallengesassociatedwiththemanagementofthespectrummeasurementdataandnotjustthe“gathering”ofthedata.Hepointedtotheneedtocapturedata(oftenreferredtoasmetadataordataaboutthecharacteristicsofthecollecteddata)fromavarietyofsources(e.g.geographic,temporalsignal,non-signaldata…)tobeabletosupportthespectrummanagementdesires.Healsopointedoutthatthereareaverywidevarietyofdatabasesystemsavailableforstoringthedata.Evenworsethesesystemsareeachuseful,butfordifferentpurposessoaligningyourselectionofasingleormorelikelyasetofdatabasetechnologiesthatmatchyourrequirementsiscritical.FromPaul’sperspectivethereisagreatdealofworktobedonetoenhancethebasesetofanalyticaltools(R,Pythoncustomsolutions,MATLAB…),ontheserverside

12

functionality,ontheintegrationoffileformats(e.g.HDF5)andmoregenerallythescale,performanceandreliabilityofthesystemsdeployedinthespectrumstorage,managementandanalysisspace.PaulclosedbyproposingthatacarefullyconstructedandprovenrelevantBenchmarkisneededtobeabletomeasuretherelativemeritofthevariousproposedapproachestospectrumdatamanagement.ThisBenchmarkwouldatminimumneedtoincludethedatacharacteristics,size,throughputrequirements,analyticworkflowandtheQualityofServiceexpectations.

4.1.6 JoydeepAcharya–Hitachi

JoydeepwasourfinalspeakerfortheOpeningPanelSeasonandhecontinuedthefocusonthedatacharacteristicsandimportantlytheanalyticsaspectofthespectrummeasurementchallengewithafocusonHitachi’seffortsinthisarea.Specificallyhehighlightedthedifferencebetweentraditional“DataatRest”wheredatais“ingested,stored,indexedandlateranalyzed”vs.“DatainMotion”wheredataisanalyzedasitisingestedandusedwithlowlatencytomakedecisionsandtakeactioninrealtime.Applyingthistothespectrummeasurementsenvironment,Dr.Acharyasuggestedthatthesetwodatastorageapproachesneededtobemergedtoenabletheuseofhistoricdatatoprovidetrendinformationtosupplementandcontextuallyenhancethenewlyacquireddatatodirectforexamplespectrumsharingdecisions.Hefurthersuggestedthepotentialforahybridstoragearchitecturewherethe“DataatRest”wascentralizedwhilethe“DatainMotion”andtheresultsoftheanalysisofthe“DataatRest”weremergedinanedgeprocessingenvironment.Thisshouldenablebetterinformeddecisionstobemadewithverylowlatencyenablingrelatedactionstobetakeninamoretimelymanner.Heclosedbyprovidinganarchitecturalviewofhowthismightbeimplemented.Again,pleaseseethewebsiteforadditionaldetails.

4.2 SummaryoftheKeyProjectsPanel

ThechallengesthepanelhighlightedinthediscussionperiodincludedMikeCotton’sobservationsontheoperationalchallengesofmaintainingspectrummeasurementsystems.Herehehighlightedtheseeminglymundane,butveryrealchallengeofrestartingremote(andpotentiallyveryremote)systemswhentheneedarose.Withawidelydeployedsystemthiscanentailplaneflightstoresolvea30secondprocessorrestartissue.

Prestonpointedoutthechallengesofinsuringthatthedatafromvariousmonitoringsourcescanbeproperlycomparedandsynergisticallyutilized.Keytothisistheneedtostandardizedataformatsandtoinsurethecaptureofdescriptivemetadatatoenabletherationalizationofdiscrepanciesinthedatafromvarioussources(e.g.IITSpectrumObservatoryontopofatallbuildingvs.Googledatagatheredatstreetlevel).

GregBuchwaldpointedouttheextremevalueassociatedwiththedensificationofsensors.Asanexample,thiswouldallowoverloadedsensordatatobediscardedandmoregenerallytheidentificationandrationalizationofspectrummeasurementsfromvarioussensorstodrawamoreaccurateunderstandingofthespectralenvironment.BertHochwaldaddedtheneedforabaselinesetofspecificationsforsensorsthatwouldenhancetheabilitytosharespectrumdatathathadbeenobtainedfromlargenumbersoflowcostsensors.

PaulBrownmovedthediscussiontoissueswiththedataitselfhighlightingtwochallenges.Firstaswithanylargedatamanagementprogram,someofthedatawillbe“dirty”basedontheinherent“noise”inanydatacollectionsystem.Thereforethedataneedstobe“cleansed”firstbeforeitcanbetrulyuseful.Secondistheinformationintegrationchallengewiththedata.Giventhevarietyof

13

datasources,thediversityinthecharacteristicsofthesesystems,likely70percentofthetimeassociatedwithanalyzingthedatawillbedevotedtorationalizingthevariousdatasourcestoacommonformatsothecombinedresultscanbeshared.JoydeepAcharyahighlightedthemachinelearningaspectofthedataanalysisproblemandperPaulBrowntheneedtoinsurethatthedataisrationalizedsothepowerfulmodern“bigdata”toolscanbeappliedtotheanalysisofthedata.

MilindfolloweduponGregBuchwald’sobservationaskingthePaneltoopineonthechallengesassociatedwiththeemergingworldofa“sea”ofinexpensiveandlessfunctionalsensorswhichcansupplementorevenreplacethecurrentworldofafewcarefullyplaceandmanagedexpensivesensors.Prestonpointedoutthechallengeofthediversityoftheenvironmentswherethesensorsmaybeplacedhavingapotentiallydramaticeffectontheobservedoutcomes.

Privacyisanothercriticalissueassociatedwiththewidescalegatheringofdatasinceagreatdealofinformationaboutindividualsandtheirhabitscanbegleanedfromthisdata.GregBuchwaldsuggestedthattheprivacyissuemaybeoneofseveralimportantreasonsfordeployingahybridsystemoffixedsensorsaugmentedbycrowdsourcing.InlinewithJoydeep’searliercomments,Gregalsohighlightedthehighvalueofbeingableutilizehistoricdata,evencrudedatatoderive“deeperknowledge”aboutthespectrumutilization.BurtHochwaldalsospoketothevalueof“anchorpoints”tohelprationalizeand“groundtruth”forthedatacomingfromaseaofinexpensivesensors.PaulKolodzyandMilindpointedoutthecriticalimportanceofunderstandingwhatthedataistobeusedfor,e.g.localizeddecisionmakingvs.macroscaleunderstandingofthespectralenvironment.Thisunderstandingcanbeveryhelpfulintheprivacyareaaswellsincethedetaileddataneedforlocalizeddecisionmakingcanbe“processedandusedattheedge”andneednoteverbepromulgatedandaccumulatedinapermanentcentralizeddatabase.

Prestonmadethesomewhatradicalpointthatin20yearsspectrumsensingasanindependentactivityshouldgoaway!Thesensingshouldinsteadbebuiltintotheradiosthemselves(i.e.theoriginalJoeMitolaconcept)wheretherealunderstandingofthespectralenvironmentisneeded.Theunderstandingofthemacroscopicspectrumenvironmentinthiscontextwillbecomelessandlessimportantfromhisperspective.Milindandothersdisagreedwithlackofimportanceoftheaccumulationofmacroscopicdataforover-allunderstandingofthespectralenvironmentandtheopportunitytomakemacroscopicimprovements,butdidacknowledgetheimportanceofthe“smartradio”pointthatPrestonraised.Thisconcludedthisimportantandthoughtfulsession.

5. EquipmentPanel

5.1 HighlightsofPanelists’OpeningRemarks–IvanSeskar–RutgersUniversity

IvanprovidedabriefoverviewofourPanelcomposedofrepresentativesofthemostoftheleadingprovidersofspectrummeasurementrelatedequipment.Theintentofthispanelwastotalkaboutthecurrentstateoftheartinspectrummeasurementequipmentrangingfromsophisticated,highfunction, performance and cost equipment to very inexpensive equipment with ever improvingfunctionalcapabilities.ThePanelwasalsoaskedtoprovidewhateverinsightstheyfeltcomfortablesharingonfuturecapabilitiesandperformancerecognizingthattheywereinthepresenceofmanyoftheirprimecompetitors.

5.1.1 AbhaySamant–NationalInstruments

AbhayexpandedonthethemesdevelopedintheopeningpresentationbyDr.TruchardandappliedthesemoreexplicitlytothechallengeofdevelopingSpectrumMonitoringSystems.Thetalk

14

initiallyfocusedonNI’semphasisonplatformsandspecificallytheimportanceofbuildingaproductfamilythatisbuiltonandthereforecompatiblewiththisplatform.InNI’scasethisisobviouslyLabVIEWwhichAbhaycharacterizedassupportingthe“HardPart”inthedevelopmentofSpectrumMonitoringsystems.Abhayalsopointedoutthatthisvirtualinstrumentationsoftwareisthemostimportantpartsinceitiswhatenablestheintegrationofalltheuniquespectrumobservationhardwarecomponentsandtheconnectionofthesystemtotherelatedstoragesystemandanalysiscapability.AbhaythenhighlightedthescalableplatformNIhasdevelopedtocoverthefullrangeofspectrumobservationneedsandbudgetarycapacityproviding“specsheet”descriptionsofmanyoftheseproductsandthesupportingelementsofNI’sproductfamilies.

5.1.2 RaymondShen–KeysightTechnologies

Raymondhighlightedthesignificantchangethatisoccurringinthespectrummonitoringarena.Evenascellularsystemsaremovingfromlarge,expensivemacroscellscoveringlargegeographicareastoachievecoveragegoalstoinexpensive“smallcells”tomeetthegrowingcapacityneeds,theneedformonitoringmustmoveinasimilardirection.RaymondreviewedacoupleofphysicallycompactKeysightproductsthataresuitedforthisevolvingrequirement.HisprimaryfocusforthepresentationwasonthesensorapplicationsthatKeysightbelievesaremostimportantnamely:NetworkPlanningandDeployment,RFSurveyandSignalClassification,EmitterLocationIdentification,SignalsAnalysis,andSpectrumDataandReportGeneration.RaymondidentifiedtheKeysighthardwareandsoftwareproductsthatfocusedonsupportingeachoftheseimportantandsomewhatuniqueapplicationareas.

5.1.3 SteveSatoh-PCTEL

StevedescribePCTEL’ssensorbusinessasprimarilysupportingthecellularcarriersintheunderstandingoftheircoveragecharacteristicsandincreasinglyalsomeetingtheirneedsforidentifyinganomalies,interferencesourcesandinsomecasesroguecarriersattemptingtoutilizespectrumthattheyaren’tentitledtouse.Today’schallengeforanyequipmentproviderishowtodealwithboththemacroscopicissuesofsize,weightandpowerwhilepreparingforthefuturedemandsforafullrangeofsensorsthatwillhandlemuchlowerlatency,higherreliability,andhighdatathroughputrequirements.PCTELwillneedandisplanningtocontinuetoscaletheirproductlinetomeettheeverevolvingandevermoredemandingneedsofthefuture(especially5G)whilealsoofferingderivativeproductsthatmeetthewidevarietyofspecializedneedsofthemarketplace.

5.1.4 SteveStanton-Tektronix

Steve introducedthe importantnotionof the“InterferenceofThings”ashetalkedabouttheevermore crowded spectrumenvironment, theneed for answers (andnotmoredata) evenwhen thesignalsatissuearetransientandfinallytheneedformorecosteffectivesolutions.Stevedescribethecritical requirements to be able to scan the environment, classify the signals found in theenvironment,locatethesourceoftransmissionsandtorecordandplaybackcapturedsignals.Stevehighlighted the Tektronix RSA family of low to midrange spectrum analyzers as having thecapabilities tohandlemostenvironments. Finallyheemphasized that the full rangeofTektronixspectrumanalyzersaresupportedbySignalVu,asinglepowerfulandeasytousesoftwarepackagethatcoversmostofstandardrequirementsforspectrummonitoringandanalysis.

5.1.5 RandyNeal–Rohde&Schwarz

Randyfocusedontheimportanceofsensitivity,especiallyinthe“WildWest”environmentofevermoredenselypackedtransmittersandtheneedtobeableto“see”signalseveninaneighborhood

15

ofmanymorepowerfultransmissions.Hepoundedhomethenotionthatreceiversmustbe“fitforpurpose”andthattheproposedneedmustbewellunderstoodinordertobeabletoidentifytherightsolutionforthemeasurement/monitoringactivity.Randyfocusedonseveralapplicationareasincludingbasicrecording(withthequestion–Recordingwhatbeingkey?),directionfinding,andsignalclassification.Since“onesizedefinitelydoesnotfitall”requirementsinthespectrummeasurementarenaRandystronglyencouragedtheaudiencetounderstandtheobjectivestheyaretryingtoachievepriortodefiningasolution.Further,thatwebecognizantoftheadditionalrequirementthatthemeasurementsmustbeefficientlygathered,reproducible,andeasilyreportabletothosewhoultimatelyneedtheinformation.

5.1.6 BruceDevine–SignalHound

Bruceintroducedhisportionoftheagendabyindicatinghispersonalinterestinhearingfromthedistinguishedaudienceontherequirementsthataremostimportanttothegroup.Hepointedoutthattodaythereare$1000and$100,000spectrumsensingsolutions.SignalHound’splaceintheecosystemistosupplyasmuchfunctionalityaspossibleforthelowestpossiblecost.Thismeansincludingasignificantprocessor(Inteli5)intheunittoprovidedesiredfunctionality,butthereisacosttrade-offassociatedwiththeprovisionofthisfunctionality.Thedynamicrangeandtheperformanceofthereceiverincludingappropriatefiltersisveryimportantaswell.Heisastrongbelieverinthe80/20rule,i.e.80%ofthefunctionalityfor20%ofthecostthat100%ofthedesiredfunctionalitywouldcosttodeliver.Thetrade-offofwhattoinclude“inthebox”andwhattomakeavailableoutsidetheunitforspecificpurposesisoneofthesignificantchallengesforallvendorsandtheWorkshopattendeesinputshouldbeofgreatvaluetothevendorsinattendance.

5.2 SummaryoftheEquipmentPanelInteractions

ThePaneladdressedtwoimportantquestionsatsomelength.First,theimportanceofstoringthesensorresultsvs.thereal-timeuseofthesenseinformationandsecondthevalueandavailabilityofdifferentkindsofantennasforthesensors.MostofthePanelistsspoketobothpointscreatingaveryrobustdiscussion.Thenetofbothconversations,andsomethingofathemeoftheWorkshopwasthefactthat“onesizedoesnotfitall”,sothereisaneedforbothreal-timeandlong-termcaptureofspectrumdataandthereisarequirementforawidevarietyofantennasolutions.

Specificallyinthecaseofdatastoragetheamountofsenseddatatobestoredandtheamountofback-endanalysistobeconductedishighlydependentonthetasktobeperformed,i.e.whyisthedatabeingcollectedinthefirstplace.Insomecasesreal-timedecisionsarerequiredandofnecessitythesewilllargelybemadedirectlyfromthesenseddata.Attheoppositeendofthecontinuum,thereareapplicationsin,forinstance,theregulatoryenvironmentwheretheavailabilityoflong-termdatawithextensiveanalysiswillbecritical.Itwaspointedoutthatitisnotjustthedirectsensorinformationthatisimportantinthatthemetadataortheinformationabouthowthedatawascollected,whereitwascollected,whenitwascollected,etc.areallveryimportant.Inmanycasesthedataneedstobedeliveredinlayerssincethereareavarietyofusersofthedata.Eachuserwillhavespecificcomponentsoftheinformationthatareimportanttothemwhilethisinformationhasnorelevancetootherswhointurnhaveotherportionsofthedatathatiscriticaltothem.Itwasalsopointedoutthatthesecurityofthedatawillbecriticalinmanycasessinceimportantdecisionswillbemadebasedontheinformationderivedfromthesenseddata.Allthisledtotheimportantcommentthatgiventhebreadthanddiversityoftheneedsforsensedinformation,manydifferentkindsofspectrumsensorsystemsareandwillberequired.

16

Commerciallythisprovidestheopportunityforavarietyofdifferentvendorstoeachflourishinasegmentofthespectrumsensorandsensorsystemmarketplace.

Onthequestionofantennas,itwasnotedthatmostspectrumsensorshavestandardportsthatenableawidevarietyofantennas(inonevendor’scaseover100antennasareofferedbythevendor)tobeconnectedtoandusedbythespectrumsensors.Thisspecificallyincludesrotatingantennas,steerableantennasandbeamformingantennaseachofwhichcanbeofspecificvalueinthegeo-locationofthesourceoftransmissions.Again,theantennaselectionmustbecarefullytiedtothetaskthattheuserofthesensorisattemptingtoperform.

Afinalobservationwasthatthebroaddeploymentofspectrumsensorsisnowfeasibleandevenrelativelyeconomicalgiventhehighpricethatspectrumnowdemands.Thecasewasmadethatataonekilometerspacing,Chicagocouldbeadequatelycoveredwith1500widebandwidthsensorsthatwouldprovideasolidperspectiveonspectrumutilizationinallsectionsoftheCity.Similarsystemscouldbedeployedinothermajormetropolitanareasofthecountryandindeedtheworldtobothaidinensuringefficientutilizationofthespectrumandtoassistwiththechallengingtaskofenforcingspectrumregulationsinanevermorecomplexspectrumenvironment.

6. LunchandDemo/ExhibitionSession

FollowingtheEquipmentPanelSessiontheaudiencewasgiventheopportunitytointeractwiththepresentersandinmanycasesadditionalsupportingpersonnelfromtheirequipmentcompaniesatdemonstrationtablessetuponeithersideoftheauditorium.ThisprovidedanexcellentopportunityfortheWorkshopattendeestoobtaina“hands-on”perspectiveonthehardwareandsoftwareproductsthathadjustbeendescribedandtoseeotherrelatedofferingsaswell.

7. SpectrumPopQuiz

FollowinglunchtheWorkshopattendeeswere“treated”toaPopQuizfromProfessorRobersonconsistingofasetofunlabeledmulti-monthspectrum“waterfall”chartswiththegoalthattheaudienceidentifythespectrumbandbeingplotted.Thegroupdidreasonablywellwiththeinitialchartofthe600MHztelevisionband,buthadconsiderabledifficultywithmostoftherestofthebandsincludingthe700MHzLTEandPublicSafetyband,the2.4GHzUnlicensedband,the3.5–3.7GHzband,the4.2–4.4GHzradioaltimeterband,the4.945–4.99GHzBroadbandPublicSafetyband,andthefinalchartsshowingthespectrumusageinthe5GHzband.SincetheafternoonKeynoteAddresswasfocusedonthe5GHzband,thesefinal“quiz”chartsservedasanintroductiontotheafternoontalk.

8. KeynoteSpeech–Dr.PaulKolodzy–KolodzyConsulting

PaulbasedmuchofhisinterestingandinformativetalkontheCommerceSpectrumManagementAdvisoryCommittee(CSMAC)subcommitteeheco-chairedfocusingonSpectrumMeasurementandSensinginthe5GHzBand.ThisworkwasaimedbothatbetterunderstandingtheopportunitiesforspectrummeasurementandsensingsystemsingeneralandspecificallyhowtheycouldbeappliedtotheproposednewspectrumsharinginitiativesintheU-NII-2B (5350-5470 MHz)andU-NII-4(5850-5925MHz)bands.Paulinitiallyidentifiedthefourkeyapplicationareasforspectrummeasurements,namelymeasurementsto:1)quantifyopportunitiesandsupportregulatoryactionPriortoSharing,2)OperationallySupportthesharingprocessoncethespectrumhasbeendesignatedforsharing,3)Assessusageandinterferencetrendsandtoassessfurtherrule

17

modificationsaftersharedspectrumoperationsareinplace,andfinally4)supportEnforcementrequirements.

Paulthenturnedtoadiscussionofwhatactuallyneedstobemeasured,howitmustbemeasured,andthelimitationsonmeasurementsandhowtoamelioratetheselimitationsineachofthefourapplicationareas.Hedescribedsevenemissionparametersthatneedtobeconsideredwhenmakingspectrummeasurementsandthecomplexitythatemergesfromtheconsiderationofthesesevenindependentparameters.Henextpointedouttheobviousconclusionthatnosinglespectrummeasurementarchitecturewouldbecapableofcoveringthisbroadsetofpotentialemissiontypes.ThisleadsdirectlytotheconsiderationofawidevarietyofdifferentspectrummeasurementarchitectureswhichPauldescribedashavingatleastfoursetsofindependentparameters.TofurtheremphasizethemeasurementchallengesPaulshowedaspreadsheetidentifyingexamplesofsomeofthespecificapplicationsandtheircharacterizationrelativetothesevenemissionparametersandasecondspreadsheetidentifyingtheapplicabilityofthevariousmeasurementarchitecturestoobserveasampleoftheemissionprofiles.

Usingthisinformationandknowledgeofthevariousoptionsthathavebeenadvanced,Pauldescribedspecificremediationtechniquesthatmightbeappliedtosupportthefourapplicationareasdescribedabove.HefollowedthisbytalkingaboutsomeofthecurrentandfuturechallengesformeasurementsystemscitingDistributedMultipleInput/MultipleOutput(MIMO)systemsasaparticularlychallengingemergingarea.ThisledtotheproposalofseveralsignificantmeasurementresearchchallengesthattheNSFshouldconsiderinfuturefundingeffortsincluding:theuseofstatisticalanalysismethodstosupportthemeasurementworkinthevariousapplicationareas,thechallengesofspatialconsiderationsincludingBeamforming,MIMOandpropagationmodelsinenvironmentallychallengingareas,advancedmeasurementarchitecturesapplyingtheparametersmentionaboveinuniqueconfigurations,andsortingthroughthepolicyaspectofmeasurementsincludingsortingthroughthecriticalbalancebetweenimprovedmeasurementsandmorecomprehensivedatabasesontheonehand,andsecurityandprivacyissuesontheother.

9. FocusGroups-Day1

Thereal“work”ofthefirstdayoftheWorkshopcommencedafteroursecondKeynoteAddress.Theattendeesweredividedintothreeroughlyequalsizedgroupseachwithroughlyequalproportionsofgovernment,corporateandacademicattendees.Thesewereparticularlylengthysessions(3hoursincludingabreakinthemiddle)withhighexpectationsforsignificantoutcomesfromthegroups.TheFocusGroupsessionsweredesignedtogatherperspectivesandrefine ideas in threedistinctaspectsoftheSpectrumMeasurementsInfrastructureecosystem.Thethreespecificareasoffocuswere:

• OptimalFutureSpectrumMonitoringArchitecture• SpectrumMonitoringDataManagementArchitecture• RoleofSpectrumMeasurementinthevariousapplications

TheremainderofthissectionwithprovideabriefoutlineofthetasksthatwereundertakenbyeachoftheFocusGroupswhiletheresultsoftheireffortswillbereviewedinSection11.

9.1 OptimalFutureSpectrumMonitoringArchitecture

Thissessionwasco-moderatedbyCraigPartridgefromRaytheon/BBNandYangWengfromtheNTIA.ThespecificquestiontheFocusGroupwasaskedtopursuewas:Whatistheoptimalfuture

18

architectureforspectrummonitoring–fixedsites,aeroplatforms,distributedsensors,crowdsourcing,etc.andwhyisthisoptimal?

9.2 SpectrumMonitoringDataManagementArchitecture

This breakout sessionwas co-moderatedbyPhil Fleming fromNokia andPrestonMarshall fromGoogle.Thetopicthattheywereaskedtoconsiderwas:Whatisthedatamanagementarchitecturein large-scale spectrum monitoring of the future, to ensure adequate support for measurement /analysis/dissemination/curation/standardization/repeatability,etc.?TowhatextentcantheBigDatacommunityhelp?

9.3 RoleofSpectrumMeasurementintheVariousApplications

Thisgroupwasco-moderatedbyWalter Johnston fromtheOfficeofEngineeringandTechnology(OET)attheFCCandRandallBerry,aProfessorintheDept.ofElectricalEngineeringandComputerScienceatNorthwesternUniversity.Thefocusofthisgroupwastoanswerthequestion:Howarethevarious roles of spectrum measurement related and different – pre-allocation, operational use(especiallyforspectrumsharing),postdeploymentassessmentandenforcement?

10. KeynoteSpeech–Dr.JoeEvans–DARPA

JoeprovideduswithanoverviewoftheAdvancedRFMappingtechnologybeingdevelopedundertheDARPARadioMapprogram.Throughthetalkhehighlightedthethreefoldpurposeoftheprogramfocusingon:1)SpectrumManagement,2)SpectrumSituationalAwareness(directlysupportingvariousDoDorganizationalneeds)and3)TechnicalInnovations.RadioMapeffectivelyprovidesaDoD“crowdsourcing”capabilitybyaddingsoftwaretomanyexistingDoDRFdevicestoenablethemtoobserveandreportontheirlocalspectralenvironment.Thishasthepotentialtogreatlyenhancethespectralsituationalawarenessforageographicareaofinterest(e.g.abattlefield).Beyondthesignificantmultiplierinthenumberofavailablesensors(albeitwithvaryinglevelsofavailabilityandfunctionality),newsoftwarehasbeencreatedtoassistinthegeo-locationofemitters,thedeterminationofthecalculatedfieldstrengthfortheemittersandtheinterpolationorextrapolationofthisdatatoestimatethespectrumintensity(andhencetheavailabilityofspectrumforsharedusage)acrossanenvironment.Additionalsensorsand/orsensorsinmotioncantestandrefinethecalculationsaspartoftheoveralldeployedsystem.ThissystemisnowbeingdemoedandevaluatedbytheMarineCorpforapotentialformaltransitioninduecourse.Thisdescriptionoftheapplicationofspectrumsensinginanarearelativeunfamiliartomostmembersoftheaudiencewasextremelyvaluableinexpandingthethinkingofthegroup.

11. TheDARPASpectrumCollaborationChallenge(SC2)–DrPaulTilghman–DARPA

PaulprovideduswithaverytimelypresentationonthedetailsofthenewlylaunchedDARPAGrandChallenge.ThisChallengewasissuedon23MarchoronlytwoweekspriortoourWorkshop,sothenewstrulywasveryfreshforthegroup.TheprimarygoalofSC2istogiveradiosadvancedmachine-learningcapabilitiessotheycancollectivelydevelopstrategiesthatoptimizeuseofthewirelessspectruminwaysnotpossiblewithtoday’sinefficientapproachofpre-allocatingexclusiveaccesstodesignatedfrequencies.Thechallengeisexpectedtotakeadvantageofrecentprogressinthefieldsofartificialintelligenceandmachinelearningandalsospurnewdevelopmentsinthoseresearchdomains,withpotentialapplicationsinotherfieldswherecollaborativedecision-makingiscritical.

19

PaultoldusthatDARPAChallengeshavetraditionallyrewardedteamsthatdominatetheircompetitors,butintheelectromagneticspectrumarenabeingagoodneighborisofoptimalimport.Therefore,theteamthatsharesmostintelligentlywillwinthisChallenge.TheChallengewillrunforthreeyearswithcheckpointsattheendofeachyear.Itwillconcludewithalivecompetitioninalargetestbedenvironment.TheteamwhoseradioscollaboratethemostefficientlyandeffectivewiththeotherfieldedradioswillwintheGrandChallengeprizeof$2M.

ThispresentationprovidedmoredetailsabouttheChallengethanmostoftheaudiencehadpreviouslybeenawareof(indeedmanywereunawareoftheChallengealltogether)soitengenderedaconsiderabledegreeofexcitementandnumerousquestions.

12. Day1FocusGroupRead-out

ThenextagendaitemwasthePanelRead-outonthethreemajorFocusGroupsthathadmeetforroughlythreehoursontheafternoonofthefirstdayoftheWorkshop.Theresultswereobviouslyofconsiderableinterest,especiallyasroughlytwo-thirdsoftheattendeeshadtheirfirstopportunitytohearabouttheeffortsandconclusionsfromtheotherone-thirdofthegroup.TheoutputsfromeachofthethreegroupsaredescribedbelowfollowedbythePaneldiscussionofthesefindings.

12.1 OptimalFutureSpectrumMonitoringArchitecture

Whatistheoptimalfuturearchitectureforspectrummonitoring–fixedsites,aeroplatforms,distributedsensors,crowdsourcing,etc.andwhyisthisoptimal?

TheFirstFocusGroupbegantheirdeliberationsbydecidingthatthefuturearchitecturemustbeonethat scaled with the ability to handle up to 500k devices per square kilometer in dense urbanenvironments at one end and could handle very rural areas where the metric might moreappropriatelybeasquarekilometersperdevice.Toachievethisflexibility,architecturallyaSystemofSystemswithaHierarchofTrustwouldseemtobethemostappropriateapproach.Thiswouldimply:

1) the deployment of high quality, special purpose, trusted measurement platforms whichbecauseofcostconsiderationswouldlikelybedistributedsparsely(1persq.kmorless);

2) the deployment of medium quality, less trustedmeasurement platforms including carrierequipmentoncelltowers,“volunteer”spectrumsensingfromuniversitiesandothers,andpotentiallyothersourcesofspectrummeasurementdata;and

3)theuseofpurely“volunteer”Group/CrowdSourcedapproachesliketheuseofindividuallyownedsmartphones,Wi-Fi,etc.devices.

Thechallengewillbeinintegratinginformationacrossthese“levels”toyieldpervasiveandcross-verifiedsensingcapabilities. AfterconsiderablediscussiontherewasunanimitywithintheGroupthatthiswas“thewaytogoforward”fromahighlevelstructureperspective.

LookingmoredeeplyatthespectrummeasurementsystemsarchitecturetheGroupidentifiedthattherewill likely be the need to support at least twomodes of use namely, long running sensingactivitiesto,forexample,understandthechangeinthenoisefloorovertime,andfocusedactivitiestoidentify“anomalies”andtosupportenforcementneedssuchasthelocationofthepizzadeliverycarusingGPSblocking. Importantly, thesensingshouldnotberestrictedtopassivesensingonlysinceinsomeinstancesactivesensing(i.e.pinging)maybeofconsiderablevalue.Thesystemsmust

20

notonlybecapableofhandlingstaticsensing,butmusthavetheabilitytohandlereactivetasking,thatistheabilitytomodifytheirfocusandsensingcapabilityovertimeasthespectrumsensingneedschange.Thereisalsoacriticalneedforastrongcapabilitytomanagethecollecteddata.TheDARPARadioMapprogramillustratesonewaytodothereactivesensingtaskinginthecontextofaplatformindependentpassivesensingandcollectionenvironment.

Therearearangeofchoicesforthespecificstructureofthearchitecture.Theseincludetheuseof:

1)localdevicesworkingcooperativelytoaccomplishthesensingtask;

2)proximitycontrollersinlocalcloudletstodirectthesensesinalocalarea;and

3)morecentralizedcontrollerstodirectthesensorsoverawidearea.

AnexamplethatwouldillustratehowaspecificstructuremightbeselectedwasthatofanairportsufferingfromGPSjamming.Inthiscaseitwasnotedthattherewouldbetoomanylocaldevicesforlocal coordination (passengersand theirmobiledevices). At the same time, coordination fromanational centerwould seem tobe too remote. Byprocessof elimination (and instinct), the localcloudletsolutionwouldseemtobemostappropriatesensingapproach.

Thestorageanddisseminationofthesenseddataisalsoaverycriticaltopic.Keyareasoffocusfromthe Group’s perspective include the direction that most of the data for distributed sensing beprocessedlocallytoreducethebackhaulcapacityrequirementsandcosts.Forthoseinstanceswherespecificdataisrequiredfromasensororgroupofsensors,asetofpredefinedcriteriatotriggerthedata transfershouldbeutilized(e.g. samplingsenseddataatspecific time intervals toenable thedeterminationofthechangeinthenoisefloorovertime).Finally,standardizingthedatainterfacesandstorageformatforthevarioussensorsdevicesisacriticaltaskthatneedstobecompleted.

With thesearchitecturalprinciples inplace theGroupdecided to “TestDrive” this structurewithvariousapplications(severalofwhicharereferencedabove).Thefirstapplicationismeasuringnoisetemperature (noise floor rise). Here in order to obtain “really goodmeasurements” specializedequipmentwithlimitedsensingrange(duetofrontendrequirements)willbeneeded.Thereforethearchitecturalchoicewouldbetheuseofspecialized,trusteddevicesinselectedareasaroundthecountry,whosedataprovidesbaseline/groundtruththatcanalsoleveragemobileself-reporteddata

AsecondapplicationistofindtheGPSblockerinthepizzadeliveryvehicle. InthiscaseatrusteddevicewouldberequiredtoreportaGPSinterferenceissue.Crowdsourcedevicescouldbeusedtobothconfirmthetrusteddevicesobservationandtogreatlyassistinidentifyingthespecificlocationoftheoffendingjammer.Itshouldbenotedthatthelossofaccurateclockisasignificantissuethatmayrequirearobust“GPSapplet”thatwillassistthedistributedcrowdsourcedevicesinmaintainingan accurate clock while suffering interference. The Group observed that the system of systemsarchitectureshouldworkunderthisscenario.Atthesametime,thisapplicationhighlightssomeofthechallengesassociatedwithbothidentifyingtheparametersofthechallengeandinidentifyingthechallengestoberesolvedbythearchitecture.

TheFocusGroupconcludedbynotingthattheabovedoesnotdescribea“solution“perse,ratheritisa“sturdyarchitectureframework“wheremanyofthedetailedelementsofthearchitecturemustbe instantiated through researchefforts thatarewellbeyond the scopeaffordedbya threehourFocusGroup.AtthesametimetheGroupisconfidentthatthemeasurementinfrastructuredescribedinthereportisbothfeasibleanddesireable.Fromacostestimateperspective,theassumptionswillhavemajor impact on the resulting estimate. Inparticular, thedensityofdeploymentof trustednodesandthewillingnessofotherstofreelypermituseoftheirdeviceswillhaveadramaticimpact

21

ontheresultingestimate.Toprovidearoughorderofmagnitudeestimate,ifweassume1trusteddeviceperurbansquarekilometer,usingtherestoftheassumptionsdescribedearlierinthissection,the cost would be $500M or less than 0.1% of the annual U.S. telecom revenue. The Group‘sassessment was that this was truly a terrific investment with beneficial returns based on theimprovementsinspectrumutilizationthatwouldaccrue.

12.2 SpectrumMonitoringDataManagementArchitecture

Whatisthedatamanagementarchitectureinlarge-scalespectrummonitoringofthefuture,toensureadequate support for measurement / analysis / dissemination / curation / standardization /repeatability,etc.?TowhatextentcantheBigDatacommunityhelp?

The group first focused on Data CollectionModels (or “how dowemake the datamost useful”)makingtheobviousobservationthatidentifyingtheplanneduseforthedataupfrontiscritical.ThegroupfeltthatthefouruseclassesidentifiedbyPaulKolodzyinhisKeynotewereaveryappropriatestartingpoint,namely:

1. Preparing to share (how will we make sharing work?)

2. Sharing (what can be shared right now?) 3. Post-sharing (how is sharing working?)

4. Enforcement (who’s cheating?) The group suggested that localized network optimization could be a fifth key use case. Astothedataitself,itwasfirstidentifiedthathowthedatawascollectedandmaintainediscriticallyimportanttoknowthelevelofcredibilitytoassigntothedataandthevaluethatitwillhavefortheintendedapplication.ThisledtoadiscussionofthenotionofDataProvenanceortheorigin,sourceandchainofownershiporcustodianshipforthedata.Thislatternotionisparticularlyimportantforuseofthedatainenforcementproceedings.Tomakethespectrummeasurementdatavaluableafullspecification is required that identifies the details of themeasurement system itself, the processutilizedinobtainingthedataandthesystemforstoringandmaintainingthedata.Thisiscriticaltopassthestandardscientifictestreproducibilitycriteriathatisapartoftherigorthatmustbeappliedforthedatatohavetruevalueforanysignificantapplication.

The elements of the spectrum measurement data that should ideally be captured include suchelementsasthe:

• Locationwherethedatawascaptured• Topographyoftheenvironment• Timeofcapture(year,month,day,hour,minute,second…)• Frequencybeingcaptured• ResolutionBandwidth• Distancefromthetransmitter(ifavailable).

Forthedatacollectionitself,capturingtheabstractions(i.e.themetadata)firstisacriticalnotion.ItwassuggestedthatMicrosoft’sextensibleschemamightbeagoodtoolforthispurpose.Soasnotto“re-inventthewheel”gaininganunderstandingoftheapproachbeingtakenbyotherdataintensivedisciplinessuchasastronomyandhigh-energyphysicsseemsveryappropriate.Itisalsoimportanttoutilize“edgeprocessing”inthisefforttofacilitatetheprocessingofthedatanearitscaptureas

22

opposedtoshufflingenormousamountsofdatabackandforthbetweenvarioussites.Asanaside,thegroupsuggestedthatgettingthisrightwouldbeverychallengingandcouldleadtothe“bloomingofathousanddissertations.”Thisisthereforeanimportantareawherefurtherresearchisrequired.

Itwasalsonotedthatthereareavarietyofapplicationsforthedataandmanydifferentcommunitieswithneedsforelementsofthedata.Thereforetryingtoanticipatealltheneedsisnotworthwhile.Insteadthedatashouldberenderedasopenaspossibletoallowthevariousneedstobesatisfied.Sincetherearemanyapproachestospectrummeasurementresultinginmanydifferentkindsofdata,thedataneedstobe“graded”orclassifiedbyitscharacteristics.Examplesofthismightinclude:

• I/Qsamples(Security/privacyissuesneedtobeaddressed)

• DecimatedI/Qsamples

• EnergyorPowerSpectralDensity

• SpectrumOccupancy (the presents or absence of a signal independent of form orpower)

• Levelofmetadatasupportingthemeasurementdata.

ThegroupthenturneditsfocustotheDataArchitectureitself,i.e.whatkindofdataarchitecturesareorwillinthefuturebeneeded.Again,arethereexistingdataarchitecturesthatareappropriateforre-useinthisenvironment(e.g.astronomydatastorageandretrievalmethods)orarethereuniquerequirementsthatexisttodayorarelikelytocomeintoplayovertimethateithercan’tbemetbyexistingmethodsornotoptimallyhandlebyexistingmethods.Someofthebasicelementsthatneedtobeexplicitlyincludedinthearchitectureandthemoreparticularlyintheimplementationofthearchitecturewouldinclude:

• Storagesize

• Access(latencyandfrequency)

• Formatting

• Archivingneedsandcharacteristics

• Uniquehardwarearchitecturalcharacteristicsorrequirements

• Uniquesoftwarearchitecturalcharacteristicsorrequirements

• Specializedquerylanguages

• Streaming/Real-timedataanalysis

• Detection/Classificationofanomalousbehavior.

Beyondthebaserequirements,someoftheideasandquestionsadvancedonhowtoconstructandtestthearchitectureincluded:

• Startingwithabenchmark–

o asampleof10commonqueries

o QoSgoals–dataintegrity,completeness,accessibility…

23

• What are the numerical “building blocks” that will be used by researchers andpractitioners?

• Shouldtherebeaninterpretationofthedataincludedinthedata?

• Howcantheresultsbemademoreaccessible?

• WhatisneededforVisualization?ForMachineLearning?

o Thiswillrequiresomeseriousinvestigationbutshouldbedoneinthecourseofresearchquestionsratherthanindependently

• Howcanwereducethelearningcurvefordoinganalyticsonthecollecteddata?

• Howdoweaddressthereal-timedataanalysisusecases?

• Howtoeffectivelyusespectrumbasedonspectrummonitoring?

• Howdowedopredictiveanalytics?

Fleshingout this list to includequantitativedetailsandahierarchyof importance for thevariousidentifiedparametersrepresentsanotherresearchareathatrequiresworkbeyondthetimeavailabletotheFocusGroup.

ThoughitwassomewhatbeyondtheoriginalscopeofthecharterfortheFocusGroup,theGroupdecided to explore the cost structure for a full SpectrumMeasurement Systemdeployment. TheGroup’sperspectivewasthatatleastoneandpossiblytwoormoresensorsareneededperAPorBSindenseurbanenvironmentsandlikelylessforlessdensenetworksenvironments(e.g.ruralareas).Theassumedsensorcostwouldwas$100.Backhaulcostswouldbehighunlessafiberinfrastructurewasalreadyinplace.Wirelessbackhaulwasnotviewedasreadyfordeploymentbythegroup,butmoreinvestigationwouldbehelpfulonthis.Itisfurtherestimatedthatitwillcostbetween$13and$60persensorpermonthtostoreandprocessthedata.TherearelikelysignificantOperationandManagementcoststhatneedalsoneedtobeinvestigated.Basedonthissetofassumptions,thebillforalargecitySpectrumMonitoringSystemwouldthereforebeasmuchas$300/yearpersensor,especiallyfortheinitialdeploymentyear(yikes!).

Basedontheabove,alevelofcreativitywillbeneededtomakesensor-supportedspectrumsharingwork.Examplesofareastobeexploredincludethepotentialforsomeformoflowbitratereportingoftheresultsofthemeasurementsasopposedtocapturingandcentrallystoringthespectrumdataitself.Anotherimportantconsiderationisunderstandingthepotentialstrengthsandweaknessesofusingextensivespectrummeasurementsbasedsystemsrelativetothedatabaseorientedspectrumsharingsystemsthatarecurrentlybeingdevelopedandtested.

The“business”modelsormoredirectly“whopays”modelsalsoneedtobeexploredandunderstood.Variousoptionsinclude:

• governmentpays(directlyorindirectly)tocollectthedatainanad-hocmanner

• itisanon-profitenterprisewithvolunteersprovidingdatatoabroker(e.g.WeatherorWikipedia)

• Someonemakesaprofitablebusinessoutofcollecting,storing,preparing(andetc.)thedataandmakesitavailabletopeoplewhopaytoaccessit

24

12.3 RoleofSpectrumMeasurementinthevariousapplications

Howarethevariousrolesofspectrummeasurementrelatedanddifferent–pre-allocation,operationaluse(especiallyforspectrumsharing),postdeploymentassessmentandenforcement?

The third Focus Group concentrated its efforts on the development of the following detailedrequirementschartwhichfocusesonthefourusecaseslistedaboveandpresentedinPaulKolodzy’skeynoteaddress. Thechart comparesandcontrasts the requiredcharacteristicsof the spectrummeasurementsystemforeachoftheseapplicationareas.Asnotedbelow,someoftherequirementsare consistent across all four application areas (e.g. frequency resolution),while others are verydifferent (e.g. test duration interval). The obvious observationhere is that once again, “one sizeclearlydoesn’tfitall”whenitcomestospectrummeasurementsystemssoeitheravarietyofdiscretesystemsorthe“systemofsystems”approachdescribedbythefirstFocusGroupwillberequiredtosatisfythefullrangeofrequirements.

13. FocusGroup2Sessions

ThesecondandfinalroundofFocusGroupsessioncommenceafterlunchwiththefollowingtwofocusareasthatbothbuiltonthefirstdayandsecondmorning’sKeynotetalksandontheFocusGroupsfromthefirstday.ThegoalfortheFocusGroupswastocometoclosureinidentifyingsomeofthekeyissuesfacingtheSpectrumMeasurementInfrastructureenvironmentandtheresultingresearchtopicsthatshouldbeaddresstoassistinresolvingtheseissues.ThechartersforthetwoFocusGroupswere:a)Defineandprioritizerequirementsforfuturemeasurementssystemsand

25

architectures,ledbyCo-Moderators:MarkMcHenry–SharedSpectrum/MikeCotton–ITS,andb)IdentifythecriticalresearchopportunitiesandassociateddeploymenteffortsthatareneededtomoveourspectrummeasurementscapabilitiesforwardledbyCo-Moderators:MarkGibson-Comsearch/PaulTilghman–DARPA.AftertheFocusGroupsmetindependentlyfor90minutesandafteralunchbreakthatenabledtheCo-Moderatorstoconsolidateandrefinethepresentationoftheirconclusions,MonishaGhoshfromtheUniversityofChicagoservedasModeratorforareportoutsessionandassociatedPaneloftheCo-ModeratorsenablingthefullWorkshopattendeegrouptoopineontheconclusionsdrawnbythetwoFocusGroups.

13.1 RecommendedResearchTopicsinSpectrumMeasurementSystemsandArchitecture

Theco-moderatorsforthefirstFocusGroupusedarelativelysophisticatedapproachtoidentifyandprioritizethepotentialresearchareasinthespectrummeasurementssystemsandarchitecturespace.Insequence,theindividualsintheFocusGroupwereaskedto:

1. PreparealistofrequirementsforanRFPforaspectrummeasurementsystem2. Quiza“virtualcustomer”toseehowmuchandwhereresearcheffortwouldberequired3. CategorizetheresultsintoRF,Algorithm,Network,etc.categories4. RanktheresultsaccordingtobothCostandlevelofrequiredResearch.

Usingthisprocessandrankingthecategoriesusingasimplepopularityapproach(i.e.howoftendidacategoryappearontheattendeeslistofpriorities),inorder,theperceivedcostdriversfromanRFPperspectivewere:

• Installation(including-network,siteaccess,antennamount,power)

• Dynamicrange(hardwareandsoftware)

• SignalParameters(whatsignalsneedtobecaptured)

• SignalIdentification

• Sensitivity

• Directionality.

Insimilarfashionthetoptechnicalchallengesthatrequireresearchfocuswereidentifiedinpriorityorderas:

• SignalIdentificationRate

• SignalIdentification

• GeneralDetectionorInformedDetection

• Portablevs.HeterogeneousProcessingAlgorithms.

Thechallengeisthatwhilethesewereclearlythetopresearchareasthatwereidentifiedwithsignalidentificationappearinginboththecostandtheresearchlists,therewerenumerousadditionalareasthatwereidentifiedbyindividualsorsmallnumbersofattendeesasrequiringadditionalattention(i.e.thecandidateresearchlisthadadistributionwithaverylongtail).

26

13.2 RecommendedPriorityResearchandDevelopmentTopics

The second Focus Group used an open format to solicit priority research topics from those who chose to be a part of this critical Focus Group. The group identified the following ten areas where additional research would be very valuable. After a great deal of discussion, the group used a simple voting approach (3 votes per Focus Group participant) to prioritize these identified areas. The results are shown in priority sequence.

(16)Featuredetection&extraction-knownvs.unknownsignals

(15)RFBigDataanalysis-metadata&schemas-lessonslearnedfromradioastronomy

(12)Crowdsourcingofmeasurement-consumervs.provider-incentivizedvs.policy

(8)Measurementfordirectionality

(6)Roleofedgeprocessingvs.centralprocessing

(5)RFfrontendconsiderations-costs,re-configurability,filtering,bandwidth

(4)Handlingunplannedeventsandspectrumdynamics

(3)Compartmentalizedmeasurementdata-privacyandsecurity

(3)mmWaspectsofspectrummeasurement

(1)SpectrumdatafornonRFapplications

13.3 RecommendedPriorityResearchandDevelopmentTopics

FollowingthepresentationoftheoutcomesofthetwoDay2FocusGroups,MonishaconvenedtheCo-ModeratorPaneltorespondtoquestionsfromtheaudience,MonishaandtheotherPanelists.Asaninitialfocus,Monishalookedforareasofcommonalitybetweentheprioritizedlistsfromthetwogroups.Thoughnotfullycomprehendedbythegroup,itshouldbenotedthatsignalidentificationandtherelatedtopicoffeaturedetection&extractiondidappearonallthreeprioritizedlists.Thishighlightstheimportanceofthisresearchtopic.

Thechallengeofdoinglong-term,largescalecollaborativeresearchintheseareaswasdiscussedbyseveraloftheWorkshopattendeeswithfundingbeingamajorinhibitor.Thyagachallengedtheattendeestosubmitproposalsthatwouldcomprehendthescopeoftheprojectsthatneededtobeaddressed.Thyagaalsochallengedthegrouptofocusonopportunitiesforcollaborationbetweeninstitutionstoachievetheneededscopetoaddresssomeofthemorechallengingresearchissues.ThedurationofNSFfundingandthenatureoftheresearch,i.e.performingresearchinasinglethreadofactivityrelatedtoasolicitation,thenpreparingappropriatepapersandreportstodocumenttheresults,werehighlightedasbeinginconsistentwiththelong-termfundamentaleffortsthatnowneedtobepursued.

ThisleadtoadiscussionoftheWirelessModelCitythathadoriginallybeenproposedinthecontextofthePCASTSpectrumPolicyProposal2andhowimplementationofthisproposalmighthelpsupportthelong-termfoundationaleffortsthatwereidentifiedinthisWorkshop.WalterJohnstonfromtheFCCrequestedthatthePanelandtheWorkshopattendeesingeneralprovidetheirinputsonthecharacteristicsthatshouldbepartoftheWirelessModelCitysincetheFCCandtheNTIAarecurrentlyworkingtoputtheserequirementstogether.Thyagachallengedtheattendeesto

27

establishlong-termcollaborativerelationshipsthatcanbeproductiveoveralongperiodoftime.Thesewillresultinbetterproposalsthatwillmorefrequentlybefundedestablishinga“virtuousresearchcycle”.

ConcernsabouttheregulatorychallengesassociatedwithspectrumsharingandespeciallythespeedofregulationapprovalwerevoicedfirstbyMonishaandsubsequentlyothersespeciallyasitrelatestotheTVWhiteSpacesharingissue.PrestonMarshallspokeupindefenseoftheFCCparticularlycitingtherapidactiontakenonthePCASTrecommendationconcerningthe3.5GHzband.ThyagaalsospoketothespeedandsupportthattheFCCwasprovidinginrecentsharingproceedings.MarkGibsonspoketotheAWS-3processthatwasinitiallyundertakenbytheNTIAandthroughtheCSMACgroupadvisingthecommittee.ThispavedthewayforrapidexecutionintheFCC.ExtendingthepartneringthemethatThyagastarted,Markpointedtothevalueofacademic/industrypartnershipsandhowthesecanbeextremelyvaluableinmakingrapidprogressonkeyresearchfronts.ThiswasapositiveendpointforthePanelasitconcluded.

14. Wrap-Up–ThyagaNandagopalandDennisRoberson

ThyagaconcludedtheworkshopbypointingoutthatthisWorkshopisbuildingontheeffortsthathavebeeninitiatedinotherpreviousgatheringsbothunderNSFauspicesandthosesupportedbyothers.Thechallengeistocometogethertofocusourresearcheffortstowardmeetingtheneedsofaconsolidatedspectrummeasurementarchitecture.WemadegoodprogressthroughtheWorkshoponthecharacteristicsofthecommonsensoranddatastructurearchitectureandtheresearchgoalsthatwereestablishedaredefinitelyworthyoffunding.ThyagawilllookforwardtoreceivingandfundingproposalsthatarefocusedonthetopicscomingoutoftheWorkshop.Thyaga’sbiggestchallengeisreadingvolumesofproposalsmanyofwhichareneitherproperlyfocused,norwrittenatlevelthatmeritsfunding.BeyondNSFfunding,giventheconstituencyoftheattendeesrepresentingacademiaandindustry,othermeansofcollaborativelyfundingresearchshouldbeavailabletothisgroup.ThyagaisclearlylookingforadditionalthoughtsonthisWorkshopandfeedbackonneededfutureWorkshops.HealsoinvitedSummerSchoolproposalsthatwouldsupporttheeducationofgraduatestudentsinthisimportantarea.ThyagaconcludedhisremarksbythankingallthosewhohadcomeouttotheWorkshopfortheirtimeandthoughtfulengagement.

DennisprovidedhisadditionalwordsofthankstotheKeynoteSpeakers,PanelModeratorsandPanelists,theCo-ModeratorsfortheFocusGroupsthatprovidedthecoreworkproductsfortheWorkshop,theSteeringCommitteefortheirsignificantplanningeffortleadinguptotheWorkshop.DennisthankedMaggieGarciaforhereffortstocoordinatethesession.HealsoexpressedhisappreciationtoMariyaZhelevafordevelopingtheWorkshopwebsite.Finally,DennisthankedThyagaforprovidingtheinspirationfortheWorkshopandofcoursethevitalfundingtoenabletheWorkshoptotakeplace.

15. OptionalSpectrumObservatoryTours-DennisRoberson

Followingtheformalagenda,thegroupwasprovidedwiththeopportunitytovisitIllinoisInstituteofTechnology’sWirelessNetworksandCommunicationsResearchCenter(WiNCom)andspecificallytheWorld’sFirstpermanentSpectrumObservatoryandtheInternationalSpectrumObservationCenter(ISOC).Thoughtheweatherwasveryuncooperative(i.e.cold,rain,hailandevensnowallinthematterofafewminutesandinAprilnoless),manymembersofthegroupbravedtheelementstovisittheantennafarmonthetopofthe22StoryIITTower.Theyalsosaw

28

thecontrolroomforthespectrumdatacapture,thelabwherethedataisstoredandofcoursethesixlargeflatscreendisplaysthatprovidethesurfaceusedtodisplaytheprocessedspectruminformationgeneratedbytheSpectrumObservatory.Thiswassupplementedbyasetofpostersdescribingthespecificresearchefforts(primarilywithfundsfromNSF)beingundertakenintheWiNComResearchCenter.ThiseventwasprimarysetupandconductedbytheWiNComResearchAssistantswhodeserveKudosfortheirefforts!

16. Acknowledgements

ObviouslythisWorkshopcouldnothavetakenplacewithoutthevisionandthefundingprovidedbyourpatronorganization,theNationalScienceFoundationandspecificallyThyagaNandagopalwhoadditionalservedwithdistinctiononourOrganizingCommittee.TheothermembersofourOrganizingCommitteealsodeservepraisefortheirconsiderableeffortstosettheagenda,toestablishboththestructureofthemeetinganditsobjects,determinetheappropriateinviteelist,recommendandapprovethekeynotespeakers,PanelistsandModeratorsforthePanels,FocusGroupCo-Chairsandfinallytoestablishandimplementthesurveythatwasconductedpriortothemeeting.TheSteeringCommitteeislistedinAppendixA.TheKeynotespeakersdidanoutstandingjobinprovidingenlighteningideasandinformationfortheattendeesattheWorkshoptoabsorbandconsider.InsimilarfashiontheModeratorsandmembersofthetwoopeningPanelshelpsetthecontextforthemeetingandprovideduswithmuchtothinkaboutasweenteredtheFocusGroupphaseoftheevent.Thespectrummeasurementequipmentvendorrepresentativesprovideduswithconcreteexamplesofinstrumentsandtools(oftenunknownoratleastunfamiliartotheaudience)toconsiderinthecontextofthefuturespectrummeasurementopportunities.TheCo-ChairsofthefiveFocusGroupsskillfullysteeredtheseeffortstoproduceinterestingandusefulresultstobeconsideredwellbeyondtheconclusionoftheWorkshop.TheWorkshopartifacts(agenda,plans,presentations,etc.)wereveryeffectivelycapturedbyourwebmaster,MariyaZhelevafromtheUniversityofAlbany.BehindthescenestherewereacadreofstudentsofteninvisiblysupportingvariousaspectsoftheeventincludingitsfilmingandofcoursethetouroftheSpectrumObservatoryandrelatedInternationalSpectrumObservationCenter.Finally,whatwouldwehavedonewithoutMaggieGarciawhohandledthemultitudeoflogisticsleadinguptotheeventandsupportingthevariousneedsoftheattendeesattheevent?

29

AppendixA:WorkshopOrganizingCommittee

Thefollowingweremembersoftheworkshopplanningcommittee:

PhilFleming-Nokia

WalterJohnston-FCC

MarkMcHenry–SharedSpectrumCompany

ThyagaNandagopal–FCC

DennisRoberson–IIT

AsnotedintheAcknowledgementsession,manythankstothisgroupfortheireffortstoorganizeandimplementthisimportantmeeting.

AppendixB:WorkshopAgenda

DAY1–6April

8:00-9:00-Demosetup8:15AM-Registration,MinglingandContinentalbreakfast

I. 9:00-9:05-WelcomeandOverview:DennisRoberson-IllinoisTech

II. 9:05-9:20-NSFWelcome,MeetingObjectivesandResultsofSpectrumMeasurementRequirementsSurvey:ThyagaNandagopal-NSF

III. 9:20-10:00-KeynoteSpeaker1-Dr.JamesTruchard–NationalInstruments

IV. 10:00-10:15-Break

V. 10:15-11:15-KeyProjectsPanelmoderatedbyMilindBuddhikot–Nokia(Goals:1.Communicatethestateofcurrentspectrummeasurementefforts.2.Describetheplansfortheimmediatefuture(whatisinthechartedroadmap,andwhatarethewishlistfeaturesthatyoucannothaveatthistime).3)Identifyhowthesemeasurementseffortsareinforminganalyticalspectrumusagemodels,andwheredosuchmeasurementeffortsfail)?Panelists:

a. MikeCotton–ITS

b. JoydeepAcharya–Hitachi

c. GregBuchwald–MotorolaSolutions

d. PrestonMarshall–Google

e. PaulBrown–Paradigm4

30

f. BertrandHochwald–NotreDame

VI. 11:15-12:30-EquipmentPanelmoderatedbyIvanSeskar(Goals:1.Describethe

currentstateoftheartinspectrummeasurementtoolsfromsophisticated/costlyinstrumentstowidelydeployablelowcostequipment.2.Describethedirectionfortheemergingandfuturetools).Panelists:

a. AbhaySamant–NI

b. RaymondShen–Keysight

c. SteveSatoh–PCTEL

d. SteveStanton–Tektronix

e. RandyNeal–Rohde&Schwarz

f. BruceDevine–SignalHound

VII. 12:30-2:00-LunchandDemo/ExhibitSession

a. LunchsetupinUTPAtrium

b. EquipmentDemosinUTPAtrium

i. KeysightTechnologies-RaymondShenii. NationalInstruments-AbhaySamant+TanimTaheriii. PCTEL-AmirSoltanian,MattLaurich,SteveSatohiv. Rohde&Schwarz-RandyNealv. TestEquipmentPlus-SignalHound-BruceDevinevi. Tektronix-SteveStanton-Tektronix

VIII. 2:00-2:30–Keynote2-PaulKolodzy–KolodzyAssociates

IX. 2:30-5:30-FocusGroups

a. Whatistheoptimalfuturearchitectureforspectrummonitoring–fixedsites,aeroplatforms,distributedsensors,crowdsourcing,etc.andwhyisthisoptimal?Co-moderators:CraigPartridge–BBN/YangWeng–NTIA

b. Whatisthedatamanagementarchitectureinlarge-scalespectrummonitoringofthefuture,toensureadequatesupportformeasurement/analysis/dissemination/curation/standardization/repeatability,etc.?TowhatextentcantheBigDatacommunityhelp?Co-moderators:PhilFleming-Nokia/PrestonMarshall–Google

c. Howarethevariousrolesofspectrummeasurementrelatedanddifferent–pre-allocation,operationaluse(especiallyforspectrumsharing),postdeploymentassessmentandenforcement?Co-moderators:WalterJohnston–FCC/RandyBerry–NorthwesternUniversity

31

X. [3:30-3:45-BreakforFocusGroupswiththeopportunitytoswitchgroupsforcross

fertilization]

XI. Dinner(AnightoutonthetowninChicago!)

DAY2–7April2016

XII. 8:00–ContinentalBreakfast

XIII. 8:30–8:35–SecondDayWelcomeandLogistics–DennisRoberson

XIV. 8:35–9:15–KeynoteSpeaker3–JoeEvans–DARPA

XV. 9:15–9:30–DARPASpectrumChallenge–PaulTilghman–DARPA

XVI. 9:30–10:45–FocusGroupRead-outsPanel–ModeratedbyDennisRoberson

Co-ModeratorsfromsessionIX

XVII. 10:45–11:00–MorningBreak

XVIII. 11:00–12:30–FocusGroupsTwo(Atriumconferencerooms)

a)DefineandprioritizerequirementsforfuturemeasurementssystemsandarchitecturesCo-Moderators:MarkMcHenry–SharedSpectrum/MikeCotton–ITSb)IdentifythecriticalresearchopportunitiesandassociateddeploymenteffortsthatareneededtomoveourspectrummeasurementscapabilitiesforwardCo-Moderators:MarkGibson-Comsearch/PaulTilghman–DARPA

XIX. 12:30–1:30–Lunch(intheAtrium)

XX. 1:30–2:15–Read-outfromFocusGroup2-Moderatedby:MonishaGhosh

a. Co-ModeratorsfromsessionXVII

XXI. 2:15–2:30-Wrap-up:ThyagaNandagopal/DennisRoberson

XXII. 2:30–5:00-OptionalToursofIllinoisTechSpectrumObservatory

32

AppendixC:Exhibitors

Teamsrepresentingsixkeymeasurementequipmentproviderssetupdemonstrationsandexhibitedofstate-of-the-artspectrummonitoringequipmentandsystems.Asnotedintheagenda,thesedemonstrationswhereavailablethroughtheextendedlunchhourandatthebreaksonthefirstday.Thecompaniesandorganizationswerechosenbytheplanningcommittee.

i. KeysightTechnologies-RaymondShenii. NationalInstruments-AbhaySamant+TanimTaheriii. PCTEL-AmirSoltanian,MattLaurich,SteveSatohiv. Rohde&Schwarz-RandyNealv. TestEquipmentPlus-SignalHound-BruceDevinevi. Tektronix-SteveStanton-Tektronix

AppendixD:ParticipantList

33

Briefbiographiesformostattendeesareavailableat:http://www.cs.albany.edu/~mariya/nsf_smsmw/docs/nsf_smiw_bios.pdf

AppendixE:SpectrumMeasurementSurvey

SurveyObjective:Theobjectiveofthissurveyistoobtaintheworkshopparticipant’sopinionontherequirementsofdistributedspectrummeasurementsystems.Thisincludestheapplication,thedeploymentarea,thetypesofsignalstobemeasured,themeasurementsystemcapabilities,andthesystemcosts.Thesurveyresultswillbeusedtosetacontextfortheworkshopandwillbediscussedintheopeningsectionoftheworkshop.

Instructions:Thesurveyhas20questions(plussub-questions).Pleaseprovideyourviewoftheimportanceofeachrequirementonascaleof5to0.Avalueof5meansthattherequirementiscritical.Avalueof0meansthattherequirementisnotimportantorevencounterproductive.Pleaseaddyournameonthebottomifyouwant.

34

Spectrum Measurements Infrastructure Requirements Survey

ID Requirement Importance (5=Agree, 0 = Disagree

Application Area

1 Measurements should inform the process of identifying and prioritizing bands for potential relocation or sharing by validating analytical methods, assumptions, and analysis approaches

2 Measurements should inform entrant users of the spectrum availability and the specific incumbent system operating locally to make near real time spectrum use decisions

3 Measurements should support spectrum enforcement where unauthorized or out –of-spec operations are characterized and localized

4 Measurements should support the identification of “ducting” and other anomalous propagation loss estimation

5 Measurements should support determining users with assigned spectrum that are not using the spectrum

6 The measurement system in any given geography will likely have to perform many functions simultaneously

Deployment Area

7 Measurement systems should be located mostly in urban areas where there is high commercial and private spectrum use

8 Measurement systems should initially be located mostly in rural areas where there is a transition between commercial and DoD spectrum use

9 Measurement systems should provide near continuous spatial coverage in the deployment area

Types of Signals to Be Measured

10a Measurement systems should focus on measuring airborne (including satellite) transmitters

10b Measurement systems should focus on measuring ground mobile transmitters

10c Measurement systems should focus on measuring terrestrial fixed transmitters

10d Measurement systems should focus on measuring transmitters with highly directional antennas

10e Measurement systems should focus on measuring intermittent and/or difficult to detect signals

10f Measurement systems should focus on measuring man-made noise, spurious emissions and inter-modulation emissions and other unintended signals

11a Measurement systems should focus on the 100 MHz to 1,000 MHz frequency range

11b Measurement systems should focus on the 1,000 MHz to 3,000 MHz frequency range

11c Measurement systems should focus on the 3,000 MHz to 6,000 MHz frequency range

11d Measurement systems should focus on >6,000 MHz frequency range

35

11e Measurement systems should not be focused and should cover the full frequency range to millimeter wave bands

Measurement System Capabilities and Features

12a Measurement systems need to be calibrated to within 0.5 dB accuracy (including antenna gain and power measurement)

12b Measurement systems need not be calibrated so long as they provide consistent measurements

12c Measurement systems need to be time synchronized to within 5 us accuracy

12d Measurement systems need not be time synchronized so long as they are means of there are means of aligning events after the fact.

13 Measurement systems need to determine the emission type of signals (aka the signature of the signal) and other detailed parameters (e.g., bandwidth, burst length, etc.)

14a Measurement systems need to localize signals to within 10 meter accuracy

14b Measurement systems need to localize signals to within 100 meter accuracy

14c Measurement systems need to localize signals to within 1 km accuracy

14d Measurement systems need to localize signals to within 10 km accuracy

14e Measurement localization accuracy will depend on the signal being analyzed

15 Measurement systems need to have high dynamic range to avoid inter-modulation and image signals

16 Measurement systems need to react to events within seconds. For example, if an unauthorized user is detected, a report needs to be generated within 30 seconds.

17 Measurement systems need to provide log files, I/Q signal history, and other detailed reports on events

18 Measurement systems need to limit the amount of data collected to avoid privacy issues and therefore should not collect and store I/Q data

19 Measurement systems need to have very high detection sensitivities (i.e., sub-noise detection)

System Costs

20a Measurement system costs (including sensor, installation, backhaul, etc.) for a major city like Chicago needs to be less than $1M (for all of the sensors) to install and $0.5 M per year to operate

20b Measurement system costs (including sensor, installation, backhaul, etc.) for a major city like Chicago needs to be less than $10M (for all of the sensors) to install and $1.0 M per year to operate

20c Measurement system costs (including sensor, installation, backhaul, etc.) for a major city like Chicago should be integrated with other sensors that measure for instance, pollution, noise, auto traffic, etc. with an incremental installation cost of less than $1M and incremental operational cost of less than $250k.

Name (Optional):

36

AppendixF:ResourcesandReferences

• AirborneL-BandRadioFrequencyInterferenceObservationsFromtheSMAPVEX08CampaignandAssociatedFlights,Park,Johnson,Majurec,Niamsuwan,Piepmeier,Mohammed,Ruf,Misra,Yueh,Dianardo,IEEEIGARSS,Vol.49,No.9,September2011.

• BroadbandSpectrumSurveyatSanDiego,CA,FrankSanders,BradleyRamsey,andVincentLawrence,NTIAReportTR-97-334,Dec.1996.

• DepartmentofDefenseElectromagneticSpectrumStrategy,September11,2013.• EnforcementandSpectrumSharing:CaseStudiesofFederal-CommercialSharing,

MohammedAltamimi,MartinWeiss,andMarkMcHenry,TPRC41,Mar.29,2013.• InterferenceLimitsPolicy:Theuseofharmclaimthresholdstoimprovetheinterference

toleranceofwirelesssystems,TAC,ReceiversandSpectrumWorkingGroup,Version1.00,WhitePaper(Section6:Enforcement),Feb.6,2013.

• Interference,SensitivityandCapacityCalculationsforMeasurement-basedWirelessAccessSpectrumSharing,Varma,V.K.,Arnold,H.W.,Devasirvatham,D.M.J.,Ranade,A.M.,Sutliff,L.G.,Proc.IEEE,Veh.Tech.Symp.,Secaucas,NJ,May1993.

• Newtimes,NewMethods:UpgradingSpectrumEnforcement,RoundtableDiscussionattheSiliconFlatironsConference,November2013.

• NewVisionforInterferenceResolutionandEnforcement,DaleHatfield,February2014.• NTIASpectrumMonitoringNOI+Responses(website)• ProposedFutureCSMACWork,Enforcement,NTIA,Aug.21,2013.• RadioFrequencyInterferenceMitigationforthePlannedSMAPRadarandRadiometer,

Spencer,Chan,Belz,NASAJPL,Piepmeier,Mohammed,Kim,NASA-Goddard,Johnson,OSU,IEEEIGARSS,2011

• RadioSpectrumPollution:FacingtheChallengeofaThreatenedResource,SiliconFlatironsConferenceReport,November2013.

• RadiowavePropagationMeasurementsforSharingSpectrumBetweenPoint-to-PointMicrowaveRadiosandPersonalCommunicationsSystems,Devasirvatham,D.M.J.,Seidel,S.Y.,Murray,R.R.,Arnold,H.W.,andSutliff,L.G.:Proc.IEEEUniversalPersonalCommunicationsConference,ICUPC94,pp.262-266,September27-October1,1994.

• RealizingtheFullPotentialofGovernmentHeldSpectrumtoSpurEconomicGrowth,PCASTreport,July2012.

• SharingSpectrumthroughSpectrumPolicyReformandCognitiveRadio,JohnM.Peha,ProceedingsoftheIEEE,Vol.97,No.4,Apr.2009,pp.708-719.

• SpectrumOccupancyMeasurementsofthe3550-3650MHzMaritimeRadarBandNearSanDiego,CA,MichaelCottonandRogerDalke,NTIAReportTR-14-500,Jan.2014.

• SpectrumSharingResearchandDevelopment,TelecommunicationsIndustryAssociation(TIA),December2013.

• TACEnforcementSlides,PreliminaryThoughtsonEnforcement:Background,Questions,andProposedDeliverables,DaleHatfield,SpectrumandReceiverPerformanceWorkGroup,Apr.10,2013.

• Souryal,etal.,“Real-TimeCentralizedSpectrumMonitoring:Feasibility,Architecture,andLatency,"inProc.IEEEDySPAN,Sep.2015.

• Wepman,etal.,“RFSensorsforSpectrumMonitoringApplications:FundamentalsandRFPerformanceTestPlan,”NTIATechnicalReportTR-15-519,Aug.2015.

37

• Cotton,etal.,“AnOverviewoftheNTIA/NISTSpectrumMonitoringPilotProgram,”IEEEInternationalWorkshoponSmartSpectrum,NewOrleans,Mar.9,2015.

• CottonandDalke,“SpectrumOccupancyMeasurementsofthe3550-3650MHzMaritimeRadarBandNearSanDiego,”NTIAReportTR-14-500,Jan2014.