#14537 | 2019-08-26 Virum, Denmark

Data Engineer

For a client in the energy sector, we are looking for a data engineer.

Scope to be covered by the consultant:

  • Transform the delivered CSV files into Azure DW load format (Azure PolyBase based)
  • Simple SQL modelling.
  • Create model for handling documents connected to the SQL data model (assumed to be based on Data Lake storage gen. 2 BLOB to be accessed via http).
  • Create simple model for user access to data (assumed to be based to a simple Azure Power BI Dashboard).
  • Support the POC process to a stage where accepted by the stakeholders.
  • Build authorisations to restrict access to critical data (GDPS)

Data migration
  • Finalise the POC into production maturity.
  • Support the ongoing load process.
  • Adapt data type deviation as the occur during the data migration process.

Build/enhance user interface / reports.
  • Based on the developed data model.

General qualifications to solve the task:

General profile:
  • General understanding of DW/BI in an Azure Cloud technology environment
  • Experienced in Azure technology
  • SQL and data modeling
  • Data transformation in relation to loading data into the * Azure data containers
  • Experience with DataBricks (Python/SQL mapping) is an advantage

Data containers:
  • Azure DW
  • Azure SQL DB
  • Azure Data Lake storage gen 2 and BLOB storage

Data transformation:
  • Polybase (transformation and load data into Azure DW)
  • Python (data transformation)
  • Blob storage to handle documents/pictures etc. (incl. mime handling)

Data access:
  • Experienced with utilise Azure AD to protect access to data (authentication/authorisation)
  • Simple dashboards to support guided access to data.
  • SQL based access to support super users.

Start: ASAP
Duration: 30. Maj 2020
Work location: Virum, Denmark
Requirements: Min. 5 years of professional IT experience.
Job type: Freelance

Job is closed

Sorry, we are no longer seeking consultants for this project.

Please click "Freelance jobs" to see the list of current projects.

If you are a client looking for this type of profile, use the "Review a consultant CV" form on our other website.

ProData Consult stores data in your browser/device using cookies for the purpose of statistics and optimization of our websites and optionally for targeted advertising. By accepting, you give us your consent to this use of cookies. Read our Privacy Policy for more information. You can always withdraw your consent here: Privacy policy & cookies

The website requires the use of "Necessary cookies". Our necessary cookies are only used for the purpose of delivering a functioning website and webservice.

Selected third party services may store cookies to place relevant adverts to be delivered to you on third party websites.