Data Engineer

Our Commodities and Global Markets Data Transformation is an exciting program of work as we embark on our journey to build the innovative and future ready Data Platform that will help Macquarie businesses meet customer needs. At Macquarie, we are working to create lasting value for our communities, our clients and our people. We are a global financial services group operating in 34 markets and with 54 years of unbroken profitability. You’ll be part of a supportive team where everyone – no matter what role – contributes ideas and drive outcomes.

What role will you play?

As a Big Data Engineer, you will join our dynamic Engineering team developing cutting-edge applications. We are industry pioneers and we actively look for innovative ways to achieve great results, which do speak for themselves.

We have multiple positions at different levels and are very open to training and developing people. Perfection is not required – please apply if you do not meet all the criteria and we can consider where we can best support you!

What you offer?

Data warehousing experience with emphasis on Information management domain

Data modelling experience

Linux/Unix skills

Prior working experience with AWS – any or all of EC2, S3, EBS, ELB, RDS, Dynamo DB, EMR

Solid SQL experience, authoring complex queries and DDL

Big data querying tools like Hive, Spark, Presto

Working knowledge of API-based integration for modern system

Working knowledge of Data Pipelines tools like Apache Oozie, LUIGI or Airflow

Exposure to working in an Agile environment

Proven ability to troubleshoot and resolve production issues under a DevOps model

A track record of continuously identify opportunities to improve the performance and quality of your ecosystem

Experience monitoring performance and ensuring infrastructure is appropriately matched to support workload and SLAs

A broad knowledge of technical solutions, design patterns, and code for medium/complex applications deployed in clustered computing environment.

We are also interested in any of the below as desirable:
Good experience in programming languages like (Scala or Java or Python) in context of Big data technologies like Spark

Experience working in environments with Docker, Kubernetes, Openshift

Exposure to security concepts and best practices

Knowledge of machine learning (E.g. Spark ML or R)

Experience and knowledge of major Hadoop distribution such as Cloudera, MapR, Hortonworks HDP

Good experience with build tools like Maven, Gradle, Ant

We love hearing from anyone inspired to build a better future with us, if you’re excited about the role or working at Macquarie we encourage you to apply.

About the Corporate Operations Group

The Corporate Operations Group brings together specialist support services in Digital Transformation & Data, Technology, Operations, Human Resources, Business Services, Business Improvement & Strategy, and the Macquarie Group Foundation. We deliver service excellence to ensure Macquarie is open for business, deliver on transformational change, invest in our people and have deep relationships with our customers.

Our commitment to Diversity, Equity and Inclusion

The diversity of our people is one of our greatest strengths. An inclusive and equitable environment enables us to deliver innovative and sustainable outcomes for our people, clients, shareholders and communities. From day one, you’ll be encouraged to be yourself and supported to perform at your best. If our purpose of ‘empowering people to innovate and invest for a better future’ is as inspiring to you as it is to us, please apply. With the right technology, support and resources, our people can work in a range of flexible ways.

We are committed to providing a working environment that embraces and values diversity, equity and inclusion. We encourage candidates to speak with a member of our recruitment team if you require adjustments to our recruitment process to support you, and the type of working arrangements that would help you thrive.

About Macquarie

A career at Macquarie means you’ll have the opportunity to develop new skills, explore interesting fields and do challenging work that will impact the lives of people around the world—whether it’s accelerating the green energy transition, helping sustain global food supplies, financing social housing projects or investing in essential infrastructure. At Macquarie, we’re empowering people to innovate and invest for a better future.

Macquarie is a global financial group providing clients with asset management, retail and business banking, wealth management, leasing and asset financing, market access, commodity trading, renewables development, specialist advisory, capital raising and principal investment.

Job no: COG-974761

Work type: Permanent – Full time

Location: Sydney

Category: Mid-level, Data & Analytics

Group: Corporate Operations Group

Division: Technology

Recruiter: Tristan Walker

Opening Date: 20/9/2023