Results of the Data Pipeline and Storage Manager with IAV (Video and Report, Winter 2023/24 Project)
This project is one of six Scrum projects with industry partners that were part of the Winter 2023/24 AMOS Projects. Below please find the video (you may also like the other videos) and the project summary which details the final result of the project. We run these projects every semester, so please be in touch if you would like to motivate one of your own!
Demo Video
Project Summary
| Project name | Data Pipeline and Storage Management |
| Project mission | The mission of the Data Pipeline and Storage Management project is to develop a cloud-native pipelining service that enables the analysis and management of project data. This involves storing raw data in a storage bucket, managing data pipeline requests, and providing a frontend for users to upload and access data for analysis. The project focuses on creating a system that facilitates efficient data handling and insight extraction, all within a cloud-based infrastructure |
| Industry partner | IAV GMBH |
| Team logo |  |
| Project summary | We have successfully completed the mission of developing a cloud-native pipelining service to facilitate the analysis and management of project data. The end-to-end service encompasses a robust storage system for raw data, an efficient management interface for data pipeline requests, and a user-friendly frontend for uploading and analysing data. This achievement marks a significant milestone in streamlining project data handling and analytics, providing a solid foundation for future advancements and utilisation. |
| Project illustration |  |
| Team photo | N/A |
| Project repository | GitHub – amosproj/amos2023ws04-pipeline-manager |