Versent is an Australian-born technology company, focused on architecting, building amp; operating cloud native applications, data streams, platforms and services. Our solutions are centred around AWS and best of breed technology. From a stand-still start in 2014, we've grown to over 360 family members both locally and internationally. With a diversified offering in professional services, managed services and product, we are poised for significant growth in 2020.
At Versent, being a DataOps Engineer means that you will deliver scalable, automated, repeatable analytic patterns within the AWS stack.
You will work closely with our clients’ data teams, ensuring stability and quality of data landscape, optimisation and re-design of architecture to support the next generation of products and initiatives.
You will understand both data pipeline development, operations and management as well as delivery of automated data solutions that are ready for production operations. You will help respond to an incident, do root cause analysis, improve observability, plan changes/deployments and capacity planning. Responsibilities
- Maintain data platforms and cloud infrastructure.
- Ensure reliability and quality of ETL/ELT processes.
- Work closely with customer data teams to design, implement and maintain ETL processes, infrastructure and tools.
- Ability to communicate cross-functionally, derive requirements and advice on approaches; ability to synthesise, simplify and explain complex problems to different types of audiences.
- Perform SRE tasks like incident, security, capacity, reliability, on-call and change management.
Experience required
- High proficiency in the administration and troubleshooting of Linux based operating systems.
- Extensive experience working with and maintaining Hadoop ecosystem components such as HDFS, Hbase, (py)Spark(SQL), Yarn, Hive, Impala etc.
- Extensive experience in AWS, including security controls, storage and compute. S3, EC2, Lambda.
- Good software engineering skills, including Python and use of modern engineering practices such as version control, continuous integration/delivery, DevOps, etc.
- Experience with SQL RDBMS. e.g., debugging queries, troubleshooting and administration.
- Experience in orchestrating data pipelines, e.g. using ETL tools like Apache AirFlow, Oozie, NiFi, Talend, StreamSets and etc.
- Experience in DataOps Engineering on a large data-focused project.
OUR CULTUREAt the core of what we do, we're an engineering company. We value our people more than commercials and put culture at the centre of everything. Some of the things we do to bring the team together are monthly music jamming sessions and game nights, wine/beer tasting, both family and Versent Christmas parties and weekly knowledge sharing sessions.
We embrace the notion of Family at Versent, working together to achieve outstanding success. We have monthly social events to bring everyone together, often supporting charity initiatives such as TourXOz and RUOK Day. We're supportive of bringing both kids and dogs into the office (which makes it a bit more lively!) and have a flexible work environment.
VERSENT VALUES AND BEHAVIOURSPeople:
We believe in a positive team with family spirit, because life is too short for anything else.Customer:
We create remarkable experiences for customers and treat them as we wish to be treated.Quality:
Be Artisans who care for their craft and lead change through continuous improvement.Reliability:
Do what we say we will do when we say we will do it, every time.Transparency:
Full disclosure, integrity and honesty in all things.Reciprocate:
Give back and assist as much as possible, whenever possible.