Scalable and Plug-and-play Platforms for Big Data Processing and Data Workflow Orchestration

The need to dynamically and rapidly process an ever-increasing amount of data (Smart Cities, Internet-of-Things, etc.) is driving innovation in Cloud technology and scalable data processing architectures.

At IDLab we therefore perform both industry-applied and fundamental research on:

  • Automated setup and configuration of highly scalable and efficient distributed big data processing architectures.
  • Optimisation of multi-cloud resource usage to e.g. minimise cost, improve application resilience or provide various cost/processing speed trade-off levels.
  • Distributed application development methods and tools focussed on enhancing developer productivity and with inherent support for application reliability levels and load balancing.
  • Efficient data placement strategies (e.g. for content distribution networks) taking into account the state of the interconnecting network.
  • Continuous optimization and reconfiguration / adaptation of cloud-based distributed (data) processing platforms

IDLab technologies like Tengu and LimeDS are core enablers of projects like iMinds’ City Of Things, in which hundreds of city-wide deployed smart sensors transform a city into a true Internet-of-Things living lab. In this project LimeDS allows developers to focus on rapidly creating and deploying novel services over this city-wide infrastructure, while Tengu takes care of automatically configuring and instantiating the required data processing infrastructure, based on monitored load.


Filip De Turck, Bruno Volckaert


Gregory Van Seghbroeck, Tim Wauters, Hendrik Moens, Thomas Vanhove, Merlijn Sebrechts, Leandro Ordonez, Rafael Xavier Dos Santos, Ankita Atrey, Maryam Barshan, Pieter-Jan Maenhout, Thomas Dupont, Wannes Kerckhove


  • ICON EMD Elastic Media Distribution
  • SBO DeCoMAdS Deployment and Configuration Middleware for Adaptive Software-as-a-Service
  • ICON Sequoia Safe Query Applications for Cloud-Based SaaS Applications
  • VIS Nebucom helping Belgian software companies explore the opportunities of SaaS
  • CityOfThings discover today the possibilities of tomorrow’s smart cities

Key publications

  • Live datastore transformation for optimizing big data applications in cloud environments, Thomas Vanhove; Gregory Van Seghbroeck; Tim Wauters; Filip De Turck, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM), Year: 2015, Pages: 1 - 8, DOI: 10.1109/INM.2015.7140270
  • Customizable Function Chains: Managing Service Chain Variability in Hybrid NFV Networks, Hendrik Moens; Filip De Turck, IEEE Transactions on Network and Service Management Year: 2016, Volume: PP, Issue: 99 Pages: 1 - 1, DOI: 10.1109/TNSM.2016.2580668
  • Adaptive virtual machine allocation algorithms for cloud-hosted elastic media services, Rafael Xavier; Hendrik Moens; Bruno Volckaert; Filip De Turck, NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium, Year: 2016, Pages: 564 - 570, DOI: 10.1109/NOMS.2016.7502859
  • Design and evaluation of Automatic Workflow Scaling Algorithms for Multi-tenant SaaS, Ankita Atrey, Hendrik Moens, Gregory Van Seghbroeck, Bruno Volckaert, Filip De Turck, 6th international conference on Cloud Computing and Services Science (CLOSER2016), Year: 2016, Pages 221-229, DOI: 10.5220/0005812002210229

Scalable data processing for the CityOfThings.
Scalable data processing for the CityOfThings.


Cloud-based elastic media distribution for next-gen professional collaboration applications
Cloud-based elastic media distribution for next-gen professional collaboration applications