Big Data Engineering Specialist - GCP
This job posting is no longer active.
Job ID : 6971
Category : Technology Solutions
Brand : Definity
Regular/Temporary : Regular
Fulltime/Parttime : Full Time
Location : Toronto, Canada
Posting Range : $68,100 - $136,200
Definity is the parent company to some of Canada’s most long-standing and innovative insurance brands, including Economical Insurance, Sonnet Insurance, Family Insurance Solutions, and Petline Insurance. Our ambition is to be one of Canada’s leading and most innovative property and casualty insurers. We can’t do that without our people, so we embrace and encourage a culture that’s collaborative, ambitious, rewarding, and empowering.
We offer a flexible, hybrid work experience where employees work from the office and virtually depending on the type of work they are doing and who they are working with. Bring your true self and be a part of our journey. It’s better here.
We are looking for a hands-on Big Data Engineer to join our Data Engineering team. The role of Big Data Engineer in our Datahub team is accountable for delivering the solutions of assigned big data applications throughout the complete use case lifecycle
What can you expect in this role?
- Data Engineer is expected to design, develop, test, implement data ingestion, transformation, and extraction to and from cloud platforms using tools and technologies including but not limited to spark frameworks, Python, Scala, Big query, Databricks, Datafusion, Kafka and shell scripting
- Hands-on application design, coding, and deployment of medium and significant Complex data Pipelines
- Close collaboration across engineering team on product strategies that align with business pain points and
- Ability to understand requirements, build business logic and ability to learn and quickly adopt for changing needs
- Actively participate in addressing non-functional requirements such as performance, security, scalability, continuous integration, migration and compatibility
- Contribute to Best practices of data ingestion, transformation and extraction solutions in big data platform (Datahub) and Cloud Data platforms
- Experience in building Data Architectures and exposure to Dimensional Data Modeling
- Take ownership from design of the feature through first lines of code to how it performs in production (You build it, you run it)
- Ensure fully automated testing by designing and writing automated unit, integration and acceptance tests
- Acts as a SME / Trusted day-to-day advisor to development teams on application portfolio, SDLC and development design frameworks, components and services re-use
- Provides key inputs into future technology direction and areas associated stability, performance, and roadmap strategy and development initiatives for applications in the portfolio
- Strong experience in using DevOps tools
- Champions a high-performance environment and contributes to an inclusive work environment
- Responsible for creating functions, applications or databases that run on the cloud
What do you bring to the role?
- BS/MS in computer science or equivalent technical experience
- Should have worked in Hadoop, cloud and Data engineering space for at least 2+ years
- Minimum of 4 to 6 years of development experience handling variety of data (structured/unstructured), data formats (flat files, XML, JSON, relational, legacy, parquet)
- Experience in Cloud Engineering (Google Cloud Experience is an asset)
- Experience in developing batch and real time data streams to create meaningful insights and analytics
- Strong understanding of different file formats (e.g. AVRO, ORC, Parquet, etc..) and data sources moving data into and out of Cloud
- Coding background in either Java, Spark or Python, some experience with Shell and Ansible writing
- Good knowledge of issue tracking (Jira), source code management (Bitbucket), Continuous Integrations tools (Jenkins), Linux/Mac OS administration, build tools, package management and testing framework.
- Good knowledge of networking, CPU, memory, storage
- Good to have Cloud Experience and cloud data technologies
- Working Experience with ETL/ELT tools
- Should have worked under agile methodology
- Efficient in communication, able to work with cross teams
Salary range is $68,100 - $136,200
Actual salary for the role may vary depending on work location of the successful candidate and other factors including but not limited to, skills, education, experience, working conditions and the local labour market. In addition to base pay, eligible employees may participate various incentive plans which are paid out at the discretion of the company and subject to individual and company performance.
We also take potential into consideration. If you don’t have this exact experience, but you know you have what it takes, be sure to give us more insight through your application and cover letter.
Go ahead and expect a lot — you deserve it, and we’ve got it:
- Hybrid work schedule for most roles
- Company share ownership program
- Pension and savings programs, with company-matched RRSP contributions
- Paid volunteer days and company matching on charitable donations
- Educational resources, tuition assistance, and paid time off to study for exams
- Focus on inclusion with employee groups, support for gender affirmation surgery, access to BIPOC counsellors, access to programs for working parents
- Wellness and recognition programs
- Discounts on products and services
Our inclusive work environment welcomes diversity and supports accessibility. If you require accommodation at any time during the recruitment process, please let us know by contacting: [email protected]
Background checks
This role requires successful clearance of a background check (including criminal checks and leadership references).
#LI-Hybrid