Data Engineer - Vancouver, BC

PNI Digital Media is a leading tech industry e-commerce solutions provider, and we’re proud to be one of BC’s Top Employers.  We’re looking for a seasoned Data Engineer to join our Vancouver, BC team. 

This is a brand-new role for PNI.  The successful candidate will need to have the confidence and skills to be able to build a discipline that doesn’t exist today.  You’ll design, implement, and operate scalable data processing ETL/ELT platforms, and own end-to-end data flow.  You’ll have the opportunity to extend our current data pipelines by collecting, storing, processing, and transforming large data sets.  You’ll collaborate with cross-functional teams in order to better understand data requirements, and implement strategies for acquiring data in order to foster new insights.

To succeed in this role, you need to be skilled in the architecture of enterprise big data warehouse solutions using multiple platforms, and be excited about working with huge data sets.  You’re someone who loves to bring datasets together.  You’re passionate about solving complex problems, and you have an extraordinary degree of aptitude when it comes to learning new technologies.  You can multi-task, and can credibly interface between technical teams and business stakeholders. 

Role and Responsibilities:

  • Implement highly scalable big data analytics systems in a cloud environment.

  • Work in a multi-disciplinary scrum team, and collaborate with other teams, including SW Development, Product Management, UX Design, QA, Technical Support and DevOps.

  • Be constantly challenged to learn and grow with new technologies and complex problems

  • Have shared ownership of the cloud-based products and services you build.

  • Understand and be continuously aware of data security requirements of our various data sources.

  • Build new data engineering solutions that leverage the cloud architecture and extend or migrate our existing data pipelines to this architecture as needed.

Qualifications:

  • Bachelor’s Degree or higher in quantitative areas such as Computer Science, Information Management, Big Data & Analytics, or related field is desired.

  • Certifications in data engineering and development from AWS, Azure, GCP &/or Hadoop distributions.

  • 5+ years working in a data engineer role in an eCommerce environment

  • 2+ years of implementation experience with ingestion, data pipelines, and data lakes using the Azure platform including Azure Data Lake, Azure HDInsight, Azure Data Factory, Azure Databricks, etc.

  • Extensive experience in the design, creation, management and business use of extremely large datasets.

  • Implementation experience leveraging Hadoop ecosystem technologies such as HDFS, MapReduce, Pig, Sqoop, Spark, Hive, Kafka, etc. on-premise and/or in the cloud (e.g. AWS, Azure, GCP).

  • Experience with analysis, design, development, testing and deployment of data pipeline (ETL/ELT) services leveraging the Big Data technology stack for batch and/or real-time messaging/streaming environments.

  • Experience writing complex SQL queries, extracting and importing disparate data from source systems, and data manipulation based on requirements.

  • Experience with Agile development methods in data-oriented projects.

  • Programming experience in Spark using modern languages such as Python, Scala and/or Java.

 Nice to haves:

  • Experience with implementation of data security, encryption, identity and access management across sources and environments

  • Knowledge of software configuration management environments and tools such as JIRA, Git, Jenkins, Bitbucket, etc.

Soft Skills:

For this role, we need someone with strong technical, analytical, communication, and project management skills.  In addition, you are:

  • Willing and eager to learn

  • A supportive and collaborative team member

  • Flexible and reliable

  • Someone with a positive attitude

  • Someone who identifies and solves problems proactively.

What's it like to work at PNI Digital Media?

At PNI, we never settle for status quo.  We never forget that our customers are our business.  We’re efficient but diligent.  We value teamwork.  And above all, we know how to have fun.  We love dogs, video games, karaoke, popcorn and foosball.  We celebrate our successes, and we hold charity and fitness events throughout the year.  In addition to a fitness subsidy, mat leave top-ups and a dog-friendly workplace, we offer our staff free fitness and yoga classes each week.  Come and find out why we’re a consistently award-winning employer.  Some of our recent accolades:

  • Canada Top 100 Employers

  • BC's Top Employers

  • SME Canada Top Small & Medium Employers

  • BC's Top Technology Companies

  • Profit 500 Company

PNI builds on-demand personalized print solutions, transaction processing, and order routing services for the world's largest retailers.  We connect consumer-ordered digital content, whether from online, in-store kiosks, desktop software, or mobile phones, with retailers that have on-demand manufacturing capabilities, to produce personalized products.