Join our Talent Network
Skip to main content

Big Data Engineer

Job ID : 5053
Category : Technology Solutions
Brand : Definity
Regular/Temporary : Regular
Fulltime/Parttime : Full Time
Location : Kitchener, Canada

Share : share to e-mail
Save job Saved

Economical is part of Definity, which includes some of Canada’s most long-standing and innovative insurance brands, including Economical Insurance, Sonnet Insurance, Family Insurance Solutions, and Petline Insurance. With strong roots that date back to 1871, Definity has grown to become a digital leader in the insurance industry. We’re proud to help our clients and communities adapt and thrive in a world of constant change.

Our promise to you: It’s better here. Why? Because we CARE, and we provide an employee experience that’s collaborative, ambitious, rewarding, and empowering.

Our ambition is to be one of Canada’s leading and most innovative P&C insurers. Come be a part of our journey, and love what you do.

What can you expect in this role?

We are looking for a hands-on Big Data Engineer to join our Data Engineering team. The role of Big Data Engineer in our Datahub team is accountable for delivering the infrastructure solutions of assigned big data applications throughout the complete use case lifecycle. Responsibilities include identifying and documenting big data use case requirements; leading the design and development of solutions; accountability for the implementation and production roll out of the solutions and training of the production staff for steady state assistance. The solution delivered need to be adoptable in various markets, resilient, scalable, secured and with high performance that meet all the functional and non-functional requirements. 

  • Data Engineer is expected to design, develop, test, implement data ingestion, transformation, and extraction to and from Big Data Platforms using tools and technologies including but not limited to spark frameworks, Sqoop, Hive, HBase, Impala, Python,Scala Control^M , and shell scripting
  • Hands-on application design, coding, and deployment of medium and significant Complex data Pipelines
  • Close collaboration across engineering team  on product strategies that align with business pain points and
  • Ability to understand requirements, create BSTM, build business logic and ability to learn and quickly adopt for changing needs
  • Actively participate in addressing non-functional requirements such as performance, security, scalability, continuous integration, migration and compatibility
  • Take ownership from design of the feature through first lines of code to how it performs in production (You build it, you run it)
  • Ensure fully automated testing by designing and writing automated unit, integration and acceptance tests
  • Contribute to Best practices of data ingestion, transformation and extraction solutions in big data platform (Datahub) and Cloud Data platforms
  • Acts as a SME / Trusted day-to-day advisor to development teams on application portfolio, SDLC and development design frameworks, components and services re-use
  • Provides key inputs into future technology direction and areas associated stability, performance, and roadmap strategy and development initiatives for applications in the portfolio
  • Experience in building Data Architectures and exposure o Dimensional Data Modeling
  • Strong experience in using DevOps tools
  • Champions a high-performance environment and contributes to an inclusive work environment

What do you bring to the role?

  • BS/MS in computer science or equivalent technical experience.
  • A coding background in either  Java ,Spark or Python, some experience with Shell and Ansible writing
  • Should have worked in Hadoop and Data Engineering space for at least 2 years in Apache Hadoop distributions.
  • Minimum of 4 to 5 years of development experience handling variety of data (structured/unstructured), data formats (flat files, XML, JSON, relational, legacy) and data storage (HDFS, Hbase, NoSQL databases)
  • Experience in developing batch and real time data streams to create meaningful insights and analytics
  • Experience with data loading tools like Flume, Sqoop, as well as different layers of Hadoop Framework – Storage (HDFS, HBASE), Analysis (Hive/Kudu/Druid etc.), Map Reduce Jobs, Engineering (Jobs and Workflows).
  • Strong understanding of different file formats (e.g. AVRO, ORC, Parquet, etc..) and data sources moving data into and out of HDFS.
  • Good knowledge of issue tracking (Jira), source code management (Bitbucket), Continuous Integrations tools (Jenkins), Linux/Mac OS administration, build tools, package management and testing framework

We also take potential into consideration. If you don’t have this exact experience, but you know you have what it takes, be sure to give us more insight through your application and cover letter.

Go ahead and expect a lot — you deserve it, and we’ve got it: 

  • Hybrid work schedule for most roles
  • Company share ownership program
  • Pension and savings programs, with company-matched RRSP contributions
  • Paid volunteer days and company matching on charitable donations
  • Educational resources, tuition assistance, and paid time off to study for exams
  • Focus on inclusion with employee groups, support for gender affirmation surgery, access to BIPOC counsellors, access to programs for working parents
  • Wellness and recognition programs
  • Discounts on products and services

Our inclusive work environment welcomes diversity and supports accessibility. If you require accommodation at any time during the recruitment process, please let us know by contacting: [email protected]

Background checks
This role requires successful clearance of a background check (including criminal checks and leadership references).

Share : share to e-mail

Similar jobs