Projekt

Master thesis project - Data lake (big data management)

Udbyder

Vejleder

Sted

København og omegn

I am interested in supervising a master thesis project about data lake. 

With the increasing available data in smart energy, internet of things, and internet, it is often difficult to manage diverse data with large size, different format, and meanings. This project will create a data lake on our scientific cloud platform to manage the data from different sources. The tasks of this project will include: 
- Investigate the technologies for data lake, and setup in our private cloud environment (16 physical servers, 64 cores, 1/2T RAM);
- Develop data automation methods for data collection, cleansing, and loading;
- Metadata management, and data indexing method
-  Develop Data quality metric, and assurance methods

It would be preferable if you have the following knowledge:
- Linux operating system and shell programming;
- Python, Java, and SQL programming;
- Knowledge of data management systems (e.g., PostgreSQL, MySQL), and cloud computing
- Data mining and machine learning

If you are interested, please contact with me at Dr. Xiufeng Liu (xiuli@dtu.dk), Information about me: http://xiufengliu.github.io

Søg i opslag
Kontakt

Virksomhed/organisation

DTU Management

Navn

Xiufeng Liu

Stilling

Seniorforsker

Mail

xiuli@dtu.dk

Vejleder-info

Kandidatuddannelsen i Informationsteknologi

Vejleder

Xiufeng Liu

Type

Kandidatspeciale

OM DTU

DTU er et teknisk eliteuniversitet med international rækkevidde og standard. Vores mission er at udvikle og nyttiggøre naturvidenskab og teknisk videnskab til gavn for samfundet. 10.000 studerende uddanner sig her til fremtiden, og 5.700 medarbejdere har hver dag fokus på uddannelse, forskning, myndighedsrådgivning og innovation, som bidrager til øget vækst og velfærd.

Find os her

Anker Engelunds Vej 1
Bygning 101A
2800 Kgs. Lyngby


45 25 25 25

dtu@dtu.dk

CVR-nr. 30 06 09 46

Liste over EAN Numre

Job på DTU

Se alle jobs
 

loading..