Project

Master thesis project - Data lake (big data management)

Publisher

Supervisor

Location

Greater Copenhagen area

I am interested in supervising a master thesis project about data lake. 

With the increasing available data in smart energy, internet of things, and internet, it is often difficult to manage diverse data with large size, different format, and meanings. This project will create a data lake on our scientific cloud platform to manage the data from different sources. The tasks of this project will include: 
- Investigate the technologies for data lake, and setup in our private cloud environment (16 physical servers, 64 cores, 1/2T RAM);
- Develop data automation methods for data collection, cleansing, and loading;
- Metadata management, and data indexing method
-  Develop Data quality metric, and assurance methods

It would be preferable if you have the following knowledge:
- Linux operating system and shell programming;
- Python, Java, and SQL programming;
- Knowledge of data management systems (e.g., PostgreSQL, MySQL), and cloud computing
- Data mining and machine learning

If you are interested, please contact with me at Dr. Xiufeng Liu (xiuli@dtu.dk), Information about me: http://xiufengliu.github.io

Search in postings
Contact

Company / Organization

DTU Management

Name

Xiufeng Liu

Position

Seniorforsker

Mail

xiuli@dtu.dk

Supervisor info

MSc in Computer Science and Engineering

Supervisor

Xiufeng Liu

Type

MSc thesis

Technical University of Denmark

For almost two centuries DTU, Technical University of Denmark, has been dedicated to fulfilling the vision of H.C. Ørsted – the father of electromagnetism – who founded the university in 1829 to develop and create value using the natural sciences and the technical sciences to benefit society.


Today, DTU is ranked as one of the foremost technical universities in Europe, continues to set new records in the number of publications, and persistently increases and develops our partnerships with industry, and assignments accomplished by DTU’s public sector consultancy.

Find us here

Anker Engelunds Vej 1
Bygning 101A
2800 Kgs. Lyngby

Denmark



Tlf. (+45) 45 25 25 25

CVR-nr. 30 06 09 46

All vacant positions
 

loading..