Please note! This is a self-archived version of the original article.
Huom! Tämä on rinnakkaistallenne.
To cite this Article / Käytä viittauksessa alkuperäistä lähdettä:
Perttula, A., Pöyry, P. & Kujansuu, E. (2021) Automated Intelligent UAS-based Surveillance System for Urban Security Needs. Teoksessa Balandin, S., Röning, J. & Shatalova, T. (toim.) Proceeding of the 30th Conference of Fruct Association. FRUCT Oy, s. 400-402.
URL: https://www.fruct.org/publications/acm30/
TAMPEREEN AMMATTIKORKEAKOULU
Kuntokatu 3, 33520 Tampere www.tuni.fi/tamk | p. 0294 5222
$XWRPDWHG,QWHOOLJHQW8$6EDVHG 6XUYHLOODQFH 6\VWHPIRU8UEDQ6HFXULW\1HHGV
$QWWL3HUWWXOD3HNND3|\U\(VD.XMDQVXX 7DPSHUH8QLYHUVLW\RI$SSOLHG6FLHQFHV
7DPSHUH)LQODQG
DQWWLSHUWWXODSHNNDSR\U\HVDNXMDQVXX#WXQLIL
Abstract²,Q RUGHUWR LPSURYH WKH XVDJHRIGDWDIURP 8$9 PRXQWHG VXUYHLOODQFH FDPHUDV ZH FUHDWHG DQ DXWRQRPRXV LQWHOOLJHQWSLFWXUHDQDO\]LQJDQGIRUZDUGLQJV\VWHP 8$9 VHQGV DXWRPDWLFDOO\ UHDO WLPH SLFWXUHV GRZQ WR VHUYHU WR EH DQDO\]HG
$IWHU DQDO\]LQJ WKH SLFWXUHV FDQ EH EH VKDUHG ZLWK UHOHYDQW UHFLSLHQWVOLNH3ROLFHDQG6HDUFK 5HVFXH :HFRPSDUHG VHYHUDO DQDO\]LQJ DOJRULWKPV LQ WHUPV RI DFFXUDF\ VSHHG DQG RYHUDOO IXQFWLRQDOLW\LQRXUHQYLURQPHQW:H IRXQG WKDW<RORYZDVWKH PRVW VXLWDEOH FRPSURPLVH :H ZHUH DEOH WR GHPRQVWUDWH WKDW DIWHU WUDLQLQJ WKH DOJRULWKP ZLWK RYHU WKRXVDQG SLFWXUHV V\VWHP DFKLHYHV RYHUDFFXUDF\LQ FDWHJRUL]LQJ DQGFRXQWLQJ REMHFWV ULJKW
, ,1752'8&7,21
7KHDLPRI&LW\RI7DPSHUHµV685(6PDUWXUEDQVHFXULW\
DQGHYHQWUHVLOLHQFHSURMHFWLVWRLPSURYH VDIHW\DQGVHFXULW\
RIFLWL]HQV¶GDLO\OLYHV>@6HYHUDOFDPHUDVORFDWHGLQWKHFLW\
FHQWHU IRUP WKH IRXQGDWLRQ RI VHFXULW\ LQIRUPDWLRQ JDWKHULQJ V\VWHP RI WKH 685( SURMHFW 'HVSLWH RI ODUJH QXPEHU RI FDPHUDVWKHUHLVQ¶WIXOOFRYHUDJHRILPDJLQJLQDOOSDUWVRIWKH FLW\DWDOOWLPH%HFDXVHRIWKLVZHPDGHLWSRVVLEOHWRHQKDQFH WKH QHWZRUN RI IL[HG FDPHUD LQVWDOODWLRQ E\ FDPHUDV LQVWDOOHG RQ 8$9V ,Q 685( SURMHFW RQH RI WKH PDLQ IRFXVHV LV WR XQGHUVWDQG SRVVLEOH ULVN IDFWRUV ZKHUH SHRSOH DQG GLIIHUHQW NLQGV RI YHKLFOHV DUH LQYROYHG 7KXV DOVR RXU IRFXV ZDV RQ FRXQWLQJQXPEHUVRILQWHUHVWLQJREMHFWVSHUVRQFDUEXVYDQ DQGWUXFNZLWKLQGLFDWLRQRIWKHLUORFDWLRQV
,, ,0$*(6)5208$9
8$9¶V LPDJLQJ GRHVQ¶W KDYH WKH OLPLWDWLRQV ZKDW IL[HG FDPHUDV LQVWDOODWLRQ KDYH EXW WKH\ FDQ IO\ DQG WDNH SLFWXUHV YLUWXDOO\ DQ\ZKHUH 1RUPDO ZD\ WR DSSO\ SLFWXUHV WDNHQ E\ D 8$9LVWRVWRUHWKHPILUVWLQLWVPHPRU\ZKLOHGHYLFHLVIO\LQJ VWLOODQGMXVWODWHUDIWHUIOLJKWWRGRZQORDGWKHPWRVHUYHUIRU IXUWKHU SURFHVVLQJ +RZHYHU WKLV LV QRW D YLWDO RSWLRQ LQ VHFXULW\ PRQLWRULQJ DSSOLFDWLRQV EHFDXVH ZH QHHG WR JHW UHDO WLPH XQGHUVWDQGLQJ ZKDW LV KDSSHQLQJ 2QH RI WKH 8$9V ZH XVHGLQWKLVVWXG\ZDV'-,0DYLF$LUDVVKRZQRQWKH)LJ
)LJ '-,0DYLF$LU ZLWKWKHFRQWUROOHU>@
7KH /LJKWEULJGH WHFKQRORJ\ RI GURQHV PDNHV LW SRVVLEOH ZLWKDVPDUWSKRQHWRVHHOLYHYLGHRIURPWKH8$9DQGVWRUH YLGHR DQG VWLOO SLFWXUHV GLUHFWO\ IURP 8$9 '-, *2 LV DQ DSSOLFDWLRQ ZKLFK VXSSRUWV ERWK $QGURLG DQG L26 RSHUDWLQJ V\VWHPV:LWKWKLVDSSOLFDWLRQZHFDQFRQWURO8$9 FKDQJHLWV VHWWLQJV DQGVHH UHDO WLPH YLGHR IURP 8$9¶V FDPHUD)LJ VKRZV'-,*2LPDJHZKHQ8$9LVIO\LQJ
)LJ '-,*2LPDJHZKHQ8$9 LVIO\LQJ>@
$QGURLGLVDQRSHQVRXUFHPRELOHSODWIRUPDQGRQHRIWKH PRVW SRSXODU RSHUDWLRQ V\VWHPV GHYHORSHG IRU GHYLFHV ZLWK WRXFKVFUHHQ$SSOLFDWLRQVFDQEHSURJUDPPHGXVLQJ-DYDDQG .RWOLQ )LOH2EVHUYHU LV LQWHUQDO IXQFWLRQ RI $QGURLG ZKLFK PRQLWRUVDQGPDQDJHVFKDQJHVRIILOHV>@7KHVHFKDQJHVFDQ WULJJHUGHVLUHGRSHUDWLRQVLQWKHFRGHOLNHVHQGLQJDSLFWXUHWR VHUYHU 7R HQDEOH UHDOWLPH SLFWXUHV VKDULQJ ZH PDGH DQ
$QGURLGEDVHG DSSOLFDWLRQ DQG GHPRQVWUDWHG WKH IXQFWLRQDOLW\
ZLWK'-,¶V0DYLF$LU8$9
,,, ,17(//,*(17,0$*($1$/<=,1*
:LWKWKHQHZLPDJHREWDLQLQJVROXWLRQVZKLFKKDYHSOHQW\
RI KLJKUHVROXWLRQ FDPHUDV LW LV HDV\ WR JHW DFFHVV WR KXJH DPRXQW RI LPDJLQJ GDWD +RZHYHU GDWD LWVHOI KDV RQO\ OLWWOH YDOXH LI QRW SURFHVVHG SURSHU ZD\ /XFNLO\ WKHUH DUH VHYHUDO LQWHOOLJHQW SURFHVVLQJ WHFKQLTXHV IRU LPDJH UDZ GDWD UHVXOWLQJ HDV\XVHLQGLIIHUHQWDSSOLFDWLRQV7KHVHLQFOXGHFRPPRQIDFH UHFRJQLWLRQ DSSOLFDWLRQV RI VPDUW SKRQHV DQG URDG VLJQ GHWHFWLRQIRUYHKLFOHV
______________________________________________________PROCEEDING OF THE 30TH CONFERENCE OF FRUCT ASSOCIATION
ISSN 2305-7254
:HIRXQGVXLWDEOHREMHFWGHWHFWLRQPRGHOVRIZKLFK ZHUHVHOHFWHGIRUHYDOXDWLRQ7HVWGDWDFRQVLVWHGRIRYHU SLFWXUHV WDNHQ E\ GURQHV ,Q WKHVH SKRWRJUDSKV REMHFWV ZHUH DQQRWDWHG 5HVXOWV RI REMHFW GHWHFWLRQ WRROV DQG DFWXDO DQQRWDWHG UHVXOWV ZHUH FRPSDUHG :H IRXQG WKDW LQ WHUPV RI DFFXUDF\WKHEHVWWKUHHWRROVZHUH(IILFLHQW'HW'[
(IILFLHQW'HW ' [ DQG (IILFLHQW'HW ' [ +RZHYHUDVZHWULHGWRFUHDWHDVIDVWV\VWHPDVSRVVLEOHLPDJH SURFHVVLQJ VSHHG LV DOVR H[WUHPHO\ LPSRUWDQW 7KH IDVWHVW PRGHOV IRU RXU SXUSRVHV ZHUH &HQWHU1HW 5HVQHW 9 )31 .H\SRLQWV [ &HQWHU1HW 5HVQHW 9 .H\SRLQWV [ DQG )DVWHU 5&11 5HV1HW 9 [ >@
%HFDXVHZHZDQWHGWRRSWLPL]HERWKDFFXUDF\DQGVSHHGLQRXU RZQHQYLURQPHQWQRQHRIWKHSUHYLRXVRQHVZHUHYHU\VXLWDEOH 7KXV ZH VHOHFWHG DQRWKHU RQH EHWWHU RSWLPL]HG IRU RXU RZQ XVH<RORY
7KHPRVWLPSRUWDQWDQGWLPHFRQVXPLQJWDVNEHIRUHWDNLQJ WKHVHOHFWHGPRGHOLQXVHLVWRWUDLQLWZLWKUHDOSLFWXUHVWDNHQLQ DFWXDOHQYLURQPHQW7KHUHDUHYDVWQXPEHURIVDPSOHSLFWXUHV DYDLODEOH IRU WUDLQLQJ SXUSRVHV +RZHYHU PRVW RI WKHP ZHUH QRW XVDEOH IRU RXU SXUSRVH EHFDXVH RI GLIIHUHQW VFDOLQJ DQG DOWLWXGH RI FDPHUD ,Q DGGLWLRQ WKH EDFNJURXQGV DUH XVXDOO\
GLIIHUHQWWKDQZKDWZHKDYHLQ)LQODQG $OVRWKHUHDUHQRWWRR PDQ\ SLFWXUHV DYDLODEOH WDNHQ LQ ZLQWHUWLPH LQ SRRU OLJKW FRQGLWLRQV)LJVKRZVW\SLFDOVDPSOHSLFWXUHVIURP&RPPRQ 2EMHFWVLQ&RQWH[W&2&2
)LJ6DPSOHSLFWXUHVIURP&2&2>@
:HZHUHQRWDEOHWRDSSO\H[LVWLQJVDPSOHSLFWXUHVEXWKDG WR WDNH RZQ WUDLQLQJ SLFWXUHV IURP FLW\ RI 7DPSHUH XVLQJ GURQHV :HWUDLQHGWKHDOJRULWKPZLWKRYHUWKRXVDQGSLFWXUHV GXULQJ ZLQWHU DQG VXPPHU PRQWKV :H DQQRWDWHG WKH LQWHUHVWLQJREMHFWVRQSLFWXUHVIRUWKHDOJRULWKP )LJ VKRZV WKHQXPEHUVRIDQQRWDWHGFODVVHV
)LJ7RWDODQQRWDWHGFODVVHV >@
)LJ LOOXVWUDWHV H[DPSOHV RI SHUIRUPDQFH DIWHU WKH DOJRULWKPKDVEHHQWUDLQHG,QSUDFWLFHDOOFDWHJRUL]HGREMHFWV LQ GLIIHUHQW ZHDWKHU FRQGLWLRQV ZHUH IRXQG FRUUHFWO\ RQ WKH SLFWXUHV
)LJ 7KH DOJRULWKP KDV IRXQG DOO ZDQWHG REMHFWV RQSLFWXUHWDNHQE\
D 8$9 >@
)LJVKRZVDSLFWXUHWDNHQDWWKHXQLYHUVLW\FDPSXVDUHD DQGLWVKRZVJUHDWSHUIRUPDQFHDOVRLQZLQWHUFRQGLWLRQV
)LJ*RRGSHUIRUPDQFHLQZLWKHUFRQGLWLRQV>@
7DEOH , OLVWV WKH SHUIRUPDQFH UHVXOWV RI WKH PRGHO DIWHU WUDLQLQJ ZKLFK WDNHV DERXW KRXUV RQ D GHGLFDWHG VHUYHU
$IWHU WUDLQLQJ WKH DOJRULWKP FDQ DQDO\]H DQ\ QHZ SLFWXUHV LQ WHUPVRIVHFRQGV
7$%/(,3(5)250$1&( 5(68/76 >@
SHUVRQ$3 73 )3 FDU$3 73 )3 EXV$3 73 )3 YDQ$3 73 )3 WUXFN$3 73 )3
$3DYHUDJHSUHFLVLRQ73WUXHSRVLWLYH)3IDOVHSRVLWLYH ______________________________________________________PROCEEDING OF THE 30TH CONFERENCE OF FRUCT ASSOCIATION
--- 401 ---
,9 &21&/86,21
:H FUHDWHG D ZRUNLQJ V\VWHP ZKLFK DXWRQRPRXVO\ WDNH IRUZDUG DQG DQDO\]H SLFWXUHV WDNHQ E\ D 8$9PRXQWHG FDPHUD 7KH$QGURLGDSSOLFDWLRQVHQGVUHDOWLPHLPDJHIURPD GURQH WR VHUYHU ZKHUH DQRWKHU DOJRULWKP ORRNV IRU ILYH FDWHJRULHVLQ WKHSLFWXUHSHRSOHFDUVYDQVEXVHVDQGWUXFNV
$IWHUDQDO\]LQJWKHSLFWXUH DQGKLJKOLJKWLQJWKH REMHFWVLWFDQ EH VHQW WR DQRWKHU SODWIRUP IRU IXUWKHU XVH 7UDLQLQJ WKH DOJRULWKP LV YHU\ WLPH FRQVXPLQJ +RZHYHU DIWHU SURSHU WUDLQLQJ DQDO\]LQJ D QHZ LPDJH KDSSHQV DXWRQRPRXVO\ LQ VHFRQGV $OJRULWKP KDV YHU\ JRRG DFFXUDF\ YDU\LQJ EHWZHHQ WUXFNWREXV
5()(5(1&(6
>@ SPDUW8UEDQ6HFXULW\DQG(YHQW5HVLOLHQFH 685( RIILFLDOZHEVLWH KWWSVVXUHWDPSHUHILHYHQWVFRQIHUHQFHVSXEOLVKLQJWHPSODWHVKWPO
FLWHGRQ 2FW
>@ 9 +HOLQ Sending Images from a Drone to a Server 7DPSHUH 7DPSHUH8QLYHUVLW\RI$SSOLHG 6FLHQFHV FLWHGRQ 2FW
>@ $QGURLG 'HYHORSHUV SDJHV KWWSVGHYHORSHUDQGURLGFRPUHIHUHQFH DQGURLGRV)LOH2EVHUYHU FLWHGRQ 2FW
>@ G. Laitila, Evaluation of pre-trained object detection models for the use in the SURE project.7DPSHUH 7DPSHUH 8QLYHUVLW\ RI $SSOLHG 6FLHQFHV
>@ &2&2RIILFLDOZHEVLWH KWWSVFRFRGDWDVHWRUJKRPH FLWHGQ2FW
______________________________________________________PROCEEDING OF THE 30TH CONFERENCE OF FRUCT ASSOCIATION
--- 402 ---
