Unlock to reveal name
Senior Data Engineer
- Location:
- Sri Lanka
- Sector:
- Engineering
- Profile Created:
- 1 month ago
Education
-
University of Kelaniya 2024 - 2025
Master’s in Data Analytics
-
University of Colombo 2015 - 2019
Bachelor of Science (Hons) Computational Physics Special
Experience
-
Arthur J. Gallagher Pvt Ltd, 2026 - Present
Senior Data Engineer
Monitor and support daily ETL workflows and data pipelines using Azure Synapse Analytics. Troubleshoot and resolve failures in Azure Synapse, SSIS, and SQL Server data loads. Develop and optimize T-SQL queries and stored procedures using SSMS Ensure data quality and integrity through validation and root cause analysis. Collaborate with cross-functional teams to maintain reliable data warehouse operations.
-
Superloop Communications Pvt Ltd 2025 - 2026
Data Engineer
Project – Data Migration from Redshift to Databricks Led the data migration project from Amazon Redshift to Databricks, where I designed and implemented data models in dbt, materialized them across development catalogs, and orchestrated workflows using Dagster and Databricks Lakeflow, leveraging Git for version control. Developed SQL and PySpark scripts within Databricks notebooks for data transformation and validation, and created dbt tests to ensure data quality. Integrated AWS S3 for extracting and loading data from Redshift, validated and tested migrated datasets for accuracy, and implemented API-based data ingestion pipelines to support dynamic and incremental updates.
-
2021 - 2025
Data Science Engineer
Project - ML-based Quoting Tool Developed a quotation application leveraging Named Entity Recognition (NER) to identify and match similar items within an inventory. Utilized Pinecone, a vector database, to store and manage item embeddings for efficient similarity searches. Additionally, contributed to building the frontend using Next.js and React, ensuring a seamless and responsive user experience. Project - ChatZO chatbot application with LLMs Developed a complete chatbot framework using Python, LangChain, and LlamaIndex, following a Test-Driven Development (TDD) approach. Adhered to best coding practices, including SOLID principles, version control, peer reviews, and retrospectives to ensure code quality and maintainability. Additionally, built a specialized database query tool enabling the chatbot to accurately answer questions related to database content. Project – Shelf Smart | Planogram Application Planogram compliance system for retail systems (YOLO) and shelf monitoring. Developed a planogram compliance system for supermarket shelves using Django and React, embedding a YOLO-based computer vision model for inference. Project – Telco Churn Prediction Project Developed a churn prediction system using Random Forest, performing EDA and data preprocessing to identify potential customer churn. Built and managed data pipelines in Databricks using PySpark and created interactive dashboards with Tableau and Power BI for business insights. Project – NTB Interactive Statements Developed PL/SQL queries using SQL Server to generate sample data for testing NTB Interactive Statements
-
THEEKSHANA RnD 2021 - 2021
Associate Software Engineer
Project - Worked on multiple government projects, including ePES for the Department of Manpower, e-Procurement Planning for the Finance Department, and the CAA System for the Civil Aviation Department, utilizing PHP, React Native, and MySQL for full-stack application development and deployment.
-
Sri Lankan Institute of Information Techology 2019 - 2020
Research Assistant
-
Associate Software Engineer 2019 - 2019
Associate Software Engineer
Project - Instructed Physical Science undergraduates
