​

​

Role: Azure Data Engineer

Initial contract duration:12 Months

Extension term: 12 months

Number of extensions:2

Location of work: ACT, NSW, VIC and SA

​

Overview:

Our large Federal Government client is seeking for an experienced data engineers with specific experience in Azure Databricks, Azure Data Factory and supporting services to drive the design and implementation of cloud-based data analytics infrastructure for key projects.

You will be required to:

• Conduct data modelling on existing and emerging transactional and business intelligence data assets to inform data architecture;

• Develop, implement and review data-related infrastructure, processes, and procedures;

• Develop infrastructure to support hybrid data and analytics projects, integrating cloud and on-premise hosted services;

• Work as a part of an data engineering and platform support team on project-based objectives to drive delivery of outcomes; and

• Work under limited direction and be accountable for undertaking planning, analysis, design, development, peer review, testing, and delivery activities within tight timeframes.

​

Criteria

Essential criteria

• Create, update, and maintain new data pipelines along with debugging and updating of existing data pipelines in pyspark/SQL. This includes building pipeline automation, linked services, and other supporting processes in Azure Data Factory

• Experience in: * using Azure resources such as keyvaults, contributor groups, storage containers, Access Control Lists; * using Databricks; coding in pyspark and SQL, integration with ADF and storage containers, SQL Endpoint usage with BI apps, dbfs usage, machine learning capabilities. * Generating supporting documentation of data pipelines, and other relevant processes.

• Ample experience in CI/CD deployment via Azure DevOps, using git repo, branching, merging, conflict resolution

• In-depth understanding of: * Data analysis and data science needs, such as data types, data cleansing, delta loads, Azure Cognitive Services, etc. * Azure Data Engineering along with related features, interested in learning and implementing new features available in the Azure platform over time.

• Ability to work: * Collaboratively in a team environment and contribute to continuous improvement of processes by understanding existing processes and provide innovative solutions as per the requirements. * With business areas and architectural teams to define technical design and approach to new projects and capabilities.

• A working knowledge of the legislative frameworks that govern data in the APS.

Desirable criteria

• Experience coding in R.

• Experience in provisioning Azure Data environments.

Please note, due to the nature of the work Australian Citizenship and an active Baseline clearance is mandatory

Interested?? Please hit APPLY NOW Button or you can also call on 0450813012 for a confidential discussion.

​

Shwetha Bhaskar
Candidate Manager

​

ManpowerGroup is committed to being a Diversity Confident Recruiter and encourages applications from people from a diverse range of backgrounds, including people with a disability. Please indicate your preferred method of communication in your resume and please let us know if you require any reasonable adjustments should you be contacted for an interview.

Aboriginal and Torres Strait Islander people are encouraged to apply.

By submitting your resume and other personal information with this application you are consenting to this information being collected in line with our privacy policy. Follow the link to learn more - www.manpowergroup.com.au/privacy-policy

Experis Pty Ltd is a wholly owned subsidiary of ManpowerGroup

State: QLD, licensee/s Manpower Services (Australia) Pty Ltd, LHL-02026-D5L4Q. State: QLD, licensee/s Experis Pty Ltd, LHL-02014-Y5F6D. State: SA, licensee/s Manpower Services (Australia) Pty Ltd, LHS 288856