Big Data Test Infrastructure#
The Big Data Test Infrastructure (BDTI) was created by the European Commission in 2019 and it is part of the Digital Europe Programme (DEP), which, with a planned overall budget of €7.5 billion, aims to accelerate the economic recovery and shape the digital transformation of Europe’s society and economy, increasing the easy availability, quality and usability of public sector information in compliance with the requirement of the Open Data Directive.
The DEP is one of the many activities that support the implementation of the European Data Strategy, adopted by the European Commission in 2020, which aims at creating a single market for data, ensuring that more data becomes available for use in the economy and society in Europe, keeping the companies and individuals who generate the data in control of them.
In response to the public consultation on the European Strategy for Data, the European Commission published the Data Governance Act in 2020, which is intended to foster a framework to facilitate data sharing across the EU and between sectors. During February 2022, the commission presented a new Data Act, that complement the Data Governance one, regulating who can access, use and under what conditions data generated in the EU in all economic sectors.
In this context, the concrete and immediate target of BDTI is making available some tools and an environment for public administrations to experiment on their data, in correspondence with the concept of data spaces, which contributes to the vision for having an easy way of sharing data.
BDTI provides a free of charge cloud-based analytics test environment for Public Administrations in the European Member States to experiment with open-source tools and to prototype solutions before deploying them in the production environment on their own premises. Any Public Administration at any level can request to use BDTI to perform analysis and experiments on their public sector information, for a period of six months, completely for free. The test environment provided by the BDTI consists of several open-source solutions, data sources and the required cloud infrastructure that includes the virtual machines, analytics clusters, storage facilities and networking facilities. BDTI offers the opportunity of starting to get insights from PAs public information, understanding how they can move towards data-driven decision making.
Drop us a line to learn more or request a BDTI pilot: EC-BDTI-PILOTS@ec.europa.eu
BDTI as a Service#
See below the BDTI service offering:
BDTI is a platform that helps users to focus on the data science and less on the underlying infrastructure.
BDTI Architectural Component Categories#
The components are grouped under the following functional categories:
- Data Lake
- Development Environments
- Advanced Processing
Please find below some interesting links providing more information on BDTI and DEP: