Drone School & Workshops: Deep learning and Computer vision for drone imaging and cinematography – Icarus

ABOUT DRONE SCHOOL & WORKSHOPS

Short description

The course provides an overview of the various computer vision and deep learning problems encountered in drone imaging and cinematography, which is one of the main application areas of drone technologies. The same machine learning and computer vision problems do occur in other drone applications as well, e.g., for land/marine surveillance, search&rescue, building and machine inspection. (The presentations will be in the English language)

WHEN?

The course will take place on the last days of summer, 29-31 August 2018.
(On the 28th, we are scheduling a trip to Meteora! )

WHERE?

28/8/2018: Drone educational excursion to Meteora

29-30/8/2018: Short course

31/8/2018: Hands-on experience workshop on drone imaging cinematography & Public awareness workshop on drones – Privacy protection

PROGRAMME

Hour	29/08/2018	30/08/2018	31/08/2018
9:00-10:00	Introduction in computer vision (Lecturer: Prof. I. Pitas, Aristotle University of Thessaloniki)	Drone cinematography (Lecturer: Prof. N. Nikolaidis, Aristotle University of Thessaloniki)	Hands-on experience workshop * i) Intro to OpenCv ii) Using OpenCv to detect and track faces in video. (Hands on Python programming)
10:00-11:00	Image acquisition, camera geometry (Lecturer: Prof. I. Pitas, Aristotle University of Thessaloniki)	Drone HCI issues (Lecturer: Prof. N. Nikolaidis, Aristotle University of Thessaloniki)	Hands-on experience workshop * i) Intro to OpenCv ii) Using OpenCv to detect and track faces in video. (Hands on Python programming)
11:00-11:30	Coffee break	Coffee break	Coffee break
11:30-12:30	Stereo and Multiview imaging (Lecturer: Prof. I. Pitas, Aristotle University of Thessaloniki)	Drone mission planning and control (Lecturer: B. Guerreiro, IST Portugal)	Hands-on experience workshop * i) Intro to TensorFlow ii) Using TensorFlow Object Detection API to train a custom object detector. (Hands on Python programming)
12:30-13:30	Mapping and localization (Lecturer: Prof. J. R. Martínez-de Dios, University of Seville)	Deep learning for target detection (Lecturer: Prof. A. Tefas, Aristotle University of Thessaloniki)	Hands-on experience workshop * i) Intro to TensorFlow ii) Using TensorFlow Object Detection API to train a custom object detector. (Hands on Python programming)
13:30-14:00	Lunch Break	Lunch Break	Hands-on experience workshop * i) Intro To GStreamer ii) Presentation of simple Pipelines and videostreaming
14:00-14:30	Audiovisual shooting	Lunch Break	Hands-on experience workshop * i) Intro To GStreamer ii) Presentation of simple Pipelines and videostreaming
14:30-15:30	Audiovisual shooting	2D Target tracking and 3D target localization (Lecturer: Prof. A. Tefas, Aristotle University of Thessaloniki)	Lunch Break
15:30-16:30	Motion Estimation (Lecturer: Prof. I. Pitas, Aristotle University of Thessaloniki)	Imaging for drone safety (Lecturer: Prof. N. Nikolaidis, Aristotle University of Thessaloniki)	Public awareness workshop on drones – Privacy protection*
16:30-17:00	Introduction to neural networks Perceptron backpropagation (Lecturer: Prof. A. Tefas, Aristotle University of Thessaloniki)	Coffee break	Public awareness workshop on drones – Privacy protection *
17:00-17:30	Introduction to neural networks Perceptron backpropagation (Lecturer: Prof. A. Tefas, Aristotle University of Thessaloniki)	Civil Drone Operations (Current & Future): Regulatory Matters – Challenges & Opportunities (Lecturer: Peter van Blyjenburgh, President, UVS International)	Public awareness workshop on drones – Privacy protection *
17:30-18:00	Coffee break	Civil Drone Operations (Current & Future): Regulatory Matters – Challenges & Opportunities (Lecturer: Peter van Blyjenburgh, President, UVS International)	Public awareness workshop on drones – Privacy protection *
18:00-19:00	Introduction to multiple drone imaging (Lecturer: Prof. I. Pitas, Aristotle University of Thessaloniki)	Drone mission simulations (Lecturer: Prof. N. Nikolaidis, Aristotle University of Thessaloniki)	Public awareness workshop on drones – Privacy protection *
19:00-20:00	Multidrone system architecture and communications (Lecturer: Prof. A. Tefas, Aristotle University of Thessaloniki)	Privacy protection, ethics, safety and regulatory issues (Lecturer: Prof. N. Heise, Deutsche Welle)
20:00-20:30	Deep neural networks. Convolutional NNs. (Lecturer: Prof. A. Tefas, Aristotle University of Thessaloniki)	Icarus SAG meeting
20:30-21:00	Deep neural networks. Convolutional NNs. (Lecturer: Prof. A. Tefas, Aristotle University of Thessaloniki)	Tavern and bar crawl
21:00-00:00	Welcome Party – “Treehouse”	Tavern and bar crawl – “Κιβωτός των γεύσεων”

Notes:

The presentations will be in the English language
Above hours are in the Eastern European Summer Time (EEST)

Presentations

You could find the presentations to the following links:

Multidrone presentations Part A & Multidrone presentations Part B & Others Presentations

Hands-on experience workshop on drone imaging cinematography (31/8/2018)*

Hour
9:00-11:00	i) Intro to OpenCv ii) Using OpenCv to detect and track faces in video. (Hands on Python programming)
11:30-13:30	i) Intro to TensorFlow ii) Using TensorFlow Object Detection API to train a custom object detector. (Hands on Python programming)
13:30-14:00	i) Intro To GStreamer ii) Presentation of simple Pipelines and videostreaming

SEE MORE INFORMATION

Public awareness workshop on privacy protection – drone technologies (31/8/2018) *

Hour
15:30-15:32	Address by I. Pitas, Scientifically Responsible of the project Multidrone
15:32-15:45	Address by Mitkas, Rector of the Aristotle University of Thessaloniki
15:45-15:50	Address by T. Kourakis, First Vice President of the Government
15:50-15:55	Address by I. Boutaris, Mayor of Thessaloniki
15:55-16:00	GDPR and private data protection policies (Lecturer: A. Papanastasiou, municipal councilor of Thessaloniki)
16:00-17:00	Civil Drone Regulations (Lecturer: Peter van Blyjenburgh, President, UVS International)
17:00-18:00	Privacy and ethics issues for drone technologies and AI (Lecturer: Prof. N. Heise, Deutsche Welle)
18:00-18:30	Public discussion on the above issues
18:30-19:00	Privacy-by design exercises to the DroneSchool students

(The presentations of the “Public awareness workshop on privacy protection – drone technologies” will be in the Greek and English language)

* The GDPR is a new legal framework from the EU that takes effect on May 25, 2018. It’s an updated version of the Data Protection Directive. This law is designed to accomplish two main things: a. Unify the current data protection privacy laws throughout the EU, and b. Enhance the rights of citizens of the EU to protect their personal information. The main focus of the General Data Protection Regulation (GDPR) is the protection of personal data and digital privacy. The GDPR applies to any business that does one or both of the following: a. Offers products or services to citizens of the EU b. Collects personal information from citizens of the EU. While the Data Protection Directive only applied to data controllers, the GDPR now applies to data processors as well.

SEE MORE INFORMATION

REGISTRATION (till 29/8/2018 9am)

Advance registration (till 13/7/2018):
	a) standard registration: 190 Euros
	b) reduced registration: 90 Euros for young professionals (up to 2 years after graduation)
	c) 30 Euros for students or unemployed

Late or on-site registration (after 13/7/2018):
	a) standard registration: 200 Euros
	b) reduced registration: 100 Euros for young professionals (up to 2 years after graduation)
	c) 40 Euros for students or unemployed

Registration will be waved for Multidrone researchers and volunteers.

Proof of recent graduation or student or unemployment status should be send by email to the secretariat (secretariat@aiia.csd.auth.gr) and to Margarita Saranti (smargarit@csd.auth.gr) during registration.

A certificate of attendance will be provided.

Cancellation policy: 80% refund up to 13/7/2018, no refund afterwards.

The places both for the trip to Meteora and the hands-on experience in the lab are 50 because of space limitations, so the participants will be selected in respectance with the date of their registration.

If by clicking on the “REGISTER NOW!” button the page that opens is in greek, please find on the upper right part of the page the option to change it to english (it is next to the search field).

IF I HAVE A QUESTION?

AGENDA

28/08/2018:

Before the start of the summer school there will be a showcase of an experimental media production with drones for rock climbing at the beautiful Meteora rocks and monasteries by Deutsche Welle (pending permissions), participation optional. If you are interested, you will sent an email to the secretariat (secretariat@aiia.csd.auth.gr). The bus transportation cost Thessaloniki-Meteora is extra and will be paid on site.

29/08/2018:

The lectures of Part A (first day, 8 hours) provide a solid background on the necessary topics of computer vision (Image acquisition, camera geometry, Stereo and Multiview imaging, Motion estimation) and machine learning (Introduction to neural networks, Perceptron, backpropagation, Deep neural networks, Convolutional NNs). It also provides an Introduction to multiple drone imaging. AV shooting workshop with a possible participation of Deutsche Welle.

30/08/2018:The lectures of Part B (second day, 8 hours) provide in-depth views of the various topics encountered in multiple drone cinematography, ranging from the definitions of drone audiovisual shooting types (Drone cinematography) to drone mission planning and control, drone localization and mapping, target detection and tracking, imaging for safety (crowd detection, emergency landing, map updating), privacy protection, ethics and regulatory issues.

31/08/2018:

Part C contains:
a) hands-on programming workshop on drones (e.g., on Python, C/C++, ROS),
b) Public awareness workshop on drones (with discussion at the end),

PART A (8 hours, sample topics):

Introduction to multiple drone imaging (1 hour)
Introduction in computer vision (1 hour)
Image acquisition, camera geometry (1 hour)
Stereo and Multiview imaging (1 hour)
AV shooting of extreme sports by Deutsche Welle
Motion estimation (1 hour)
Introduction to neural networks. Perceptron, backpropagation (1 hour)
Deep neural networks. Convolutional NNs. (1 hour)
Multiple drone architecture and communications (1 hour)
Localization and mapping (1 hour)

PART B (8 hours, sample topics):

Drone cinematography (1 hour)
Drone mission planning and control (1 hour)
Drone HCI issues (1 hour)
Civil Drone Operations (Current & Future): Regulatory Matters – Challenges & Opportunities (1 hour)
Deep learning for target detection (1 hour)
Target tracking and 3D localization (1 hour)
Imaging for drone safety (1 hour)
Privacy protection, ethics, safety and regulatory issues (1 hour)
Drone cinematography mission simulations (1 hour)

The course content and exact lecture topics may vary from the above ones depending on recent advances and will be finalized with the delivery of lecture slides.
When the content is finalized, we will also post the course’s analytical schedule.

PART C (8 hours):

Hands-on programming workshop on drones (lab)
Public Awareness workshop on drones
Practical experience with drone AV shooting

–And because a little trip is probably going to set a good mood for the lectures…
PART D (the day before, 28/8/2019) :

Experimental media production with drones for rock climbing at Meteora by Deutsche Welle (pending permissions). Travel cost Thessaloniki-Meteora-Thessaloniki by bus to be paid by the student participants on the spot.*

*Places on this trip are limited to 50 persons.

The Meteora is a rock formation in central Greece hosting one of the largest and most precipitously built complexes of Eastern Orthodox monasteries.