Full Time / Diemen/Amsterdam
Data Engineer, Everyday people employed through Randstad make sure your luggage gets onto the plane, your takeaway into your kitchen and that our most vulnerable are cared for. Everytime we place someone into a new role, they make an impact on our society, and we make an impact on their and their employer’s future. As a more and more data-driven organisation, data is a vital part of delivering on the promises we make to our candidates and customers.
Randstad, Yacht and Tempo-Team possess an enormous quantity of data: the characteristics of millions of candidates and business data on clients, potentials and our own organisation. Your team, DataHub, is responsible for providing the basis for our data infrastructure. Our data engineers work on a self-service data platform, making sure our data makes its way from a vast array of sources to the right place, enabling our Data Scientists and Operational Insights teams to for example build AI solutions.
DATA ENGINEER TEAM
The DataHub team is an agile team of 8 data engineers. The datalake we maintain is partly in Redshift, partly in S3. We created a Django based metadata catalog, that functions in the same time as a portal to monitor the data and to provide services for our consumers.
For general usage we offer the functionality of data subscriptions through scheduled unloads to a project space on S3. Furthermore we offer tools to work with machine learning models using Sagemaker.
The Data Engineer will be designing and setting up infrastructure on AWS for the expanding services of our platform and develop airflow dags that represent our data pipelines. Most of our coding is done in python.
WHAT WILL YOU BE DOING AS A DATA ENGINEER?
You will be part of an agile Data Engineer team and play a vital role in the design and development of a cloud-based data platform.
You will build and manage the DataHub frontend, which includes;
Develop ways to improve self-service data consumption and data publishing:
The Data Engineer will be responsible of producing high quality code and reusable components. Using containerization, CI/CD and other automation technologies, you will be responsible for creating a backend for high availability and scalability, while at the same time being easily deployable, manageable and secure.
Together with the rest of the team you will be involved in the full product development process, from design, implementation, to testing, documentation and automated deployment.
Respond to and resolve operational incidents, performing root cause analysis and managing changes required to prevent future occurrences.
In this team you will have a wide range of responsibilities and should be willing to adapt to many different challenges.
Discuss with the users of the platform requirements and future improvements, but also come with proposals for our user on how to use the platform.
Manage and develop our data persistence environments (data lake, storage, etc) to ensure that data is properly available to users and secured
Monitor systems for uptime and performance.
WHAT IS OUR STACK?
WHAT WE WOULD LIKE YOU TO KNOW AND BRING TO THE TABLE?
WHAT DO WE OFFER?
Does this sound like the right next step for you? Fantastic! We are looking forward to your application.