Data Platform Engineer
At the Rainforest Alliance, we use data to make informed decisions. Through our Data Analytics Platform (DAP), we provide access to crucial data. You will maintain, extend and scale the platform, while keeping it recoverable, secure, available and performant. Automation will be an important part of the job as well as uncovering ways to improve the platform. You will work close together with the data engineers in the data excellence team as well as the platform ops team. Another aspect is to adapt it as needed for new products (open data, ingestion of external sources, unstructured data, etc.).
We are looking for someone on the crossroads of platform ops and data engineering. If you have most of the skills but not all of them, you are also invited to apply.
The candidate should possess the technical skills to:
- Maintain the technical infrastructure of a cloud-based data platform and ensure its security
- Understand the specifics of a data platform and the way of working in a data team
- Build and/or assist in automated solutions for data pipelines and other supporting tools to increase speed of delivery
- Assist with the design of data warehouse components and quality monitoring solutions
- Maintain tools that make up the data analytics environment
RESPONSIBILITIES:
- Implements, maintains and actively monitors the servers, virtual machines, applications and software of the Azure data platform
- Develop, maintain and improve the data connections between data sources and the data analytics platform, using Terraform and Azure tools
- Maintain the high level of security and confidentiality of the data platform
- Develop, maintain and improve automation of data pipelines and other supporting processes for the data platform
- Performance tuning of the environment
- Follow processes and maintain version control over the code assets within the data analytics platform
- Be an active participant in the sprint planning and goal definition activities within the Data Engineering team
QUALIFICATIONS:
- Demonstrated ability (5 years) managing databases, database servers and their infrastructure
- Ability to coding in procedural SQL, and automation using scripting languages
- Working experience with technical infrastructure of business intelligence platforms
- Working experience as (SQL Server) DBA for a data (warehouse) environment
- Working experience with Azure cloud services
- English fluency
- Good communication skills with the ability to work with both technical and business minded colleagues
- Excellent analytical problem-solving skills, diagnostic skills and ability to prioritize own work.
- Pro-active demeanour and an ability to remain organised under pressure and see projects to completion.
- Working experience of source code repositories such as GIT
PLUS IF YOU HAVE:
- Familiarity with topics relevant to the work of Rainforest Alliance and certification is a strong plus
- Experience with Data Virtuality software and ANSI SQL
- Experience with Azure SQL Data Warehouse (Synapse)
- Experience with Scrum/Agile methodologies and working independently as a member of a virtual team
- Experience with infrastructure as code, especially Terraform
- Ability to program in languages like Java/Python/Scala and work with JSON and REST API’s
- Experience with designing and consuming REST API’s for loading data changes from source systems
- Experience with automated Business Intelligence tools