#12248 | 2018-10-09 Gentofte, Denmark

Data Engineer

For a client in the energy industry we are looking for a Data Engineer to help define the data life cycle management processes required to support a data driven company.

Specifically, the Data Engineer:
  • Ensures a data life cycle management strategy is defined and followed in any development activity
  • Is responsible for the maintenance, improvement, cleaning, and manipulation of data in the business’s operational and analytics databases
  • Extracts, consolidates, cleanses, structures and provides data in a ready-to-use form to data scientists
  • Enables storing, archiving and deletion of data
  • Builds and configures data platforms and datamarts that enable critical recommendations and insights

Requirements:
  • Must have worked with big data technologies such as Spark, Apache NiFi, Hadoop, Hive, Kafka
  • Preferably experience in Databricks
  • Microsoft Azure experience
  • Ability to code in Python is a must, proficiency in C# or java is recommended
  • Extensive experience with data lake design, enabling data access for both data scientists and business analysts
  • Extensive experience building data pipelines: extracting information from source systems, consolidating, cleansing and structuring data
  • SAP experience is an advantage since SAP can potentially be a source for many data points


Start: ASAP
Duration: 2 months + option
Work location: Gentofte, Denmark
Requirements: Min. 5 years of professional IT experience.
Job type: Freelance

Job is closed

Sorry, we are no longer seeking consultants for this project.

Please click "Freelance jobs" to see the list of current projects.

If you are a client looking for this type of profile, use the "Review a consultant CV" form on our other website.

ProData Consult stores data in your browser/device using cookies for the purpose of statistics and optimization of our websites and optionally for targeted advertising. By accepting, you give us your consent to this use of cookies. Read our Privacy Policy for more information. You can always withdraw your consent here: Privacy policy & cookies

The website requires the use of "Necessary cookies". Our necessary cookies are only used for the purpose of delivering a functioning website and webservice.

Selected third party services may store cookies to place relevant adverts to be delivered to you on third party websites.