Maplesoft Group is currently seeking a Sr Developer – ETL Pyspark for our client.

Background:
Our client is working on a program to build a scalable platform to provide public and private reporting products to their clients, utilizing new technology stack, standards and processes, in an Agile approach, and well integrated to the client's public website.

Our client requies a Senior ETL PySpark developer to work on the projects data platform and pipelines.

Services:
This Senior Consultant/Developer will work on creating, operating (run processes) and maintaining the portfolio of products assigned to them as well as, test, prepare deployment packages, deploy code/script changes, support user tests and inquires and perform or follow up on application administration tasks required for the products maintenance.

In summary, the main deliverables are:
• Understand systems and Business processes related to the products in their assigned portfolio
• Works closely with client analytical teams to develop, maintain and support products using Python and/or R and Spark programming languages.
• Provides support and guidance on creating top-quality clean code and participates in code review.
• Analyses Software deficiencies/problems and support to fix them
• Triages client analysts’ issues to proper administrators if required.
• Prepares documentation, reports, and presentations related to projects and activities.
• Shares knowledge and expertise across the organization; Provides learning opportunities and knowledge sharing to client staff related to advanced analytics, machine learning methods and data visualization.
• Process operational tasks in these products like running scripts in test and prod environments, change config files, etc, to support scheduled releases of the products
• Perform maintenance tasks in these products like changes to roll-over to next Fiscal Year and others
• Develop code changes as per approved product updates requirements to these products
• Test thoroughly the changes and maintain test scenarios as applicable
• Perform deployment to test environments and support QA team (as applicable) and users testing
• Support users inquiries
• Communicate well with Business users as well as other groups to ensure all tasks required for the products maintenance are covered
• Perform or follow up with application administration tasks as required
• Prepare deployment packages and required release tickets to deploy the changes
• Follow up on deployment tasks with all groups involved
• Create or modify documentation related to the changes in the products technical design, ETL mappings and others as advised by client internal IT team.

The successful candidate must have:
• Profound knowledge and experience in developing in PySpark data pipelines
• Experience with AWS EMR clusters
• High knowledge in shell scripting.
• Experience with Apache Airflow
• Proven ability to effectively manage multiple deliverables on time and first time right
• Ability to handle heavy workload
• Willingness to work on what is required for the products maintenance, being it operations, development or other tasks
• Strong trouble shooting and problem solving skills with logical and good attitude team player with strong oral and interpersonal skills
• Excellent communication skills
• Ability to communicate to different audience, being Business users or managers as well as technical peers
• Excellent collaboration with others in the teams and in other groups


Maplesoft Group prides itself on its distinct corporate culture and recognizes that success is a direct reflection of our most valuable asset - our people.  Therefore, attitude and ambition are key personality traits we seek out, along with skill and aptitude, in potential employees.

Maplesoft Group is committed to having a diverse, representative workforce and continuing to build an inclusive environment. We encourage applications from all qualified individuals. Maplesoft Group is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants irrespective of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veterans’ status, Aboriginal peoples or any other legally protected factors. 

All employment decisions are made based on business needs, job requirements, and individual qualifications. 

We are committed to developing inclusive, barrier-free recruitment and selection processes, and a work environment that supports our diverse workforce. Please let us know if you require accommodations at any stage of the recruitment process. We can be reached at Maplesoft Info at info@maplesoftgroup.com.

We thank you for your interest in Maplesoft Group and wish to advise you, that only candidates under consideration will be contacted.