Senior Data Engineer

About the Unit

Yara aims to be the crop nutrition company for the future and is leading the development of sustainable agriculture and digital tools to contribute to solving global agricultural challenges. We have a worldwide presence with sales teams in ~150 countries and around 17,000 employees. Yara Farming Solutions, will lead the transformation towards more sustainable and efficient food production, by innovating our offerings and the way we work. Crop and Digital Solutions (Portfolio within Yara Farming Solutions) is responsible for developing and scaling new “on-farm” digital and integrated tools and solutions for an efficient and transparent food system. We believe that Yara Farm and Field Data Platform is a step in that direction to help shape future tools from Yara. This platform is a unified data store, data science and analytics processing and API serving platform that shall be used by stakeholder across Yara Farming Solutions. 

Responsibilities

• Your core deliverables will be to build and maintain Data Lake, Data Warehouse, Data Catalog, Data & Analytics APIs, experimentation workbench for Data Science, Geospatial Analysis and Business Intelligence

• You shall work closely with different Product and Engineering teams within DAS to build data flows, pipelines with traceable linkage and lineage

• You shall study the input data source to develop ETL specifications for data integration development and implementation

• Input Data Source could be Kafka Events, streaming data from IoT Sensors, Weather APIs, CSV Files, Image Files, Bulk Data Stores, Batch-loading

• Proficient in data transformations on source data, perform joins and aggregations, build Data Warehouse, feature engineering for Machine Learning and Business Intelligence

• Participate in Data Profiling, Data Cleaning and Quality Management to support Data Stewards and Data Scientists in the team

• You would help run proof-of-concepts to evaluate new tools/software to recommend as potential features to Yara Farm and Field Data Products

Profile

• 6+ years' experience working as a data engineer with hands on experience in data engineering projects such as writing SQL queries, data pipelining, API provisioning, database optimisation / maintenance etc.

• Knowledge of data architecture concepts such as database systems, schemas, schema registry, data warehousing etc.

• Worked with scalable architectures (micro-services, event-driven, data-mesh, kubernetes etc.) • Able to code in Python, our preferred tech stack

• Experience with Kafka, Kafka Connect, KSQL is preferred

• Comfortable working with our tools: AWS, Github, Helmcharts, Jira

• Aligned with our principles: agile, customer-centric, lean, service-oriented architecture, selforganization, transparency

• Hands on experience in metadata management, data modelling, data analysis, data integration tools

• Preferable experience in Agriculture Technology domain

• Experience in Agile (Scrum) way of working

• Experience of working with cross-geography teams

Additional Information

We strive to reflect the diversity in society and encourage all qualified applicants from all background to apply. We are committed to creating a work environment that fits gender equality and allows combining career progress with the needs of a family or other personal circumstances

Why us?

• Evolving tech development division of an established agricultural products and services company.
• Explore and develop digital, software, hardware products, which provide value to farmers, smallholder communities and the value chain.
• Be part of our mission to build sustainable solutions that benefit humanity and the environment.
• Support for personal development, training and continuous learning.
• Commitment to using new technologies and frameworks, meetups, and knowledge sharing.