Note! This job has been aggregated through external sources, the Apply link will take you to the company's website.

DataOps Engineer Job in Australia
Versent , Australia

Never pay for job application, test/interview.
Safe Job Search | EEO Laws in Australia
Experience
1 Year
Salary
0 - 0
Job Type
Job Shift
Job Category
Requires Traveling
No
Career Level
Telecommute
No
Qualification
As mentioned in job details
Total Vacancies
1 Job
Posted on
Apr 7, 2021
Last Date
Jul 7, 2021
Location(s)

Job Description

Versent is an Australian-born technology company, focused on architecting, building amp; operating cloud native applications, data streams, platforms and services. Our solutions are centred around AWS and best of breed technology. From a stand-still start in 2014, we've grown to over 360 family members both locally and internationally. With a diversified offering in professional services, managed services and product, we are poised for significant growth in 2020.
At Versent, being a DataOps Engineer means that you will deliver scalable, automated, repeatable analytic patterns within the AWS stack.
You will work closely with our clients’ data teams, ensuring stability and quality of data landscape, optimisation and re-design of architecture to support the next generation of products and initiatives.
You will understand both data pipeline development, operations and management as well as delivery of automated data solutions that are ready for production operations. You will help respond to an incident, do root cause analysis, improve observability, plan changes/deployments and capacity planning. Responsibilities
  • Maintain data platforms and cloud infrastructure.
  • Ensure reliability and quality of ETL/ELT processes.
  • Work closely with customer data teams to design, implement and maintain ETL processes, infrastructure and tools.
  • Ability to communicate cross-functionally, derive requirements and advice on approaches; ability to synthesise, simplify and explain complex problems to different types of audiences.
  • Perform SRE tasks like incident, security, capacity, reliability, on-call and change management.
Experience required
  • High proficiency in the administration and troubleshooting of Linux based operating systems.
  • Extensive experience working with and maintaining Hadoop ecosystem components such as HDFS, Hbase, (py)Spark(SQL), Yarn, Hive, Impala etc.
  • Extensive experience in AWS, including security controls, storage and compute. S3, EC2, Lambda.
  • Good software engineering skills, including Python and use of modern engineering practices such as version control, continuous integration/delivery, DevOps, etc.
  • Experience with SQL RDBMS. e.g., debugging queries, troubleshooting and administration.
  • Experience in orchestrating data pipelines, e.g. using ETL tools like Apache AirFlow, Oozie, NiFi, Talend, StreamSets and etc.
  • Experience in DataOps Engineering on a large data-focused project.



OUR CULTURE
At the core of what we do, we're an engineering company. We value our people more than commercials and put culture at the centre of everything. Some of the things we do to bring the team together are monthly music jamming sessions and game nights, wine/beer tasting, both family and Versent Christmas parties and weekly knowledge sharing sessions.
We embrace the notion of Family at Versent, working together to achieve outstanding success. We have monthly social events to bring everyone together, often supporting charity initiatives such as TourXOz and RUOK Day. We're supportive of bringing both kids and dogs into the office (which makes it a bit more lively!) and have a flexible work environment.
VERSENT VALUES AND BEHAVIOURS
People: We believe in a positive team with family spirit, because life is too short for anything else.Customer: We create remarkable experiences for customers and treat them as we wish to be treated.Quality: Be Artisans who care for their craft and lead change through continuous improvement.Reliability: Do what we say we will do when we say we will do it, every time.Transparency: Full disclosure, integrity and honesty in all things.Reciprocate: Give back and assist as much as possible, whenever possible.

Job Specification

Versent

Information Technology and Services - Singapore, Singapore