Senior Data Engineer

The Senior Database Engineer is responsible for reviewing, analyzing, modifying, and developing applications for production Enterprise Resource Planning (ERP) and supporting applications.

• Serve as the subject matter expert for data replication tools (HVR and SQDR), ensuring the integrity, performance, and reliability of replication processes.
• Design, build, and maintain scalable data pipelines across ADLS, ADF, and Databricks.
• Develop, manage and monitor data pipeline to ensure timely and efficient data processing.
• Integrate external data sources using REST APIs for automated and on-demand data extraction.
• Contribute to the ongoing evolution of the analytics platform and integrated data model.
• Identify gaps in the data architecture and drive continuous improvement and learning within the team.
• Document data models, configurations, API specifications, and technical setups to ensure solution transparency and maintainability.
• Implement data validation and cleansing processes to uphold data quality and integrity.
• Collaborate cross-functionally to gather data requirements and deliver high-quality, reliable solutions.
• Take ownership of tasks and deliverables, working independently with minimal oversight.

• Bachelor's degree from an accredited institution or equivalent industry experience

• Minimum 10 years of IT professional experience in data engineering field

• Minimum 7 years of experience working/designing/optimizing on MS SQL, stored procedures, SSIS and relational databases and database design

• Minimum 4 years of experience in creating legacy application logic and functionality into Azure Data Factory/Data Lake, SQL Database and SQL Datawarehouse environment.
• Minimum 3 years of experience in working with dataflows in Azure Data Factory (ADF)
• Minimum 3 years of experience in working with data extraction from REST API call and SFTP.
• Minimum 3 years of experience in managing databases, Azure Data Platform services - Azure Data Lake (ADLS), Data factory (ADF), Databricks, SQL Server, Data Warehouse etc.
• Minimum 2 years of experience in Azure Databricks and Delta files.
• Experience with any data replication tools is a plus

• In-depth experience developing client/server applications and GUIs utilizing programming languages and tools in a Windows environment. Specifically, Microsoft SQL Server T-SQL programming language, Visual Basic .Net, SQL Server Reporting Services, Crystal Reports, VB Scripting, Microsoft C#, SQL Server Integration Services, ODBC, and ADO.NET
• Strong working knowledge of Windows OS, Microsoft Office, and other Windows-based programs
• Knowledge of UNIX is a plus
• Proficient Windows usage skills
• Required specific application experience customizing, administrating, and supporting the following programs: SQL Server and Syteline or Symix
• Uses experience and sound judgment to plan and accomplish goals. Performs various complicated tasks in a fast-paced, production-critical support environment. A certain degree of creativity and latitude is expected
• Strong written and verbal communications skills
• Excellent organizational skills, including the ability to multi-task and prioritize workload

The physical demands and work environment described here are representative of those that must be met and/or encountered by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is regularly required to use hands to finger, handle, or feel; reach with hands and arms; and communicate. The employee may be required to stand, walk, and sit. Specific vision abilities required by this job include the ability to view monitors, technical documents, and reference material. The noise level in the work environment is usually low to moderate.