Total-TECH Co.
” The Job Description”
- Collaborate with stakeholders to identify data requirements and design data pipelines accordingly.
- Extract data from various data sources, including SQL Server databases, CSV files, XML files, and Excel spreadsheets.
- Transform data to conform to data models and align it with business requirements.
- Load data into regular or distributed databases.
- Collaborate with the Data Platform Engineer to optimize the data model for performance and data retrieval efficiency.
- Write efficient SQL queries to extract data and calculate metrics to support business analytics.
- Troubleshoot technical issues related to the data pipeline and collaborate with data source providers to resolve any identified issues.
- Develop and maintain technical documentation, including data maps, data transformation rules and data lineage, and other documentations relevant to the solution.
- Collaborate with other members of the team to ensure efficient delivery of the solution.
- Mentor junior members in the team.
Requirements:
- Bachelor’s degree in Computer Engineering, Computer Science, Information Systems, or a related field from a reputable university.
- Minimum 3 years of relevant experience.
- Strong experience with SQL, database technologies, and database design and management.
- Hands-on experience in data modeling and in developing complex, but efficient, queries using SQL Server database.
- Strong experience in ETL using SSIS and other ETL tools and in the development of complex queries and data transformation rules.
- Strong experience in data warehousing and business intelligence solutions including working with large datasets from various sources.
- Programming skills in .NET is highly preferred.
- Hands-on experience with distributed databases such as Apache Ignite, Cassandra, etc. is preferred.
- Programming skills in other languages such as Python, Java or Scala is preferred.
- Good experience with microservices, DevOps tools and containerization technologies is preferred.
- Strong analytical and problem-solving skills, with the ability to analyze complex data-related issues and propose effective solutions.
- Excellent troubleshooting and debugging skills.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
- Attention to detail and a strong commitment to delivering high-quality work within established timelines.
- Ability to work independently and manage workload effectively.
- Strong oral and written communication and leadership skills to collaborate with stakeholders across different departments.
- Ability to multitask and prioritize workflow.
- Passion for learning new technologies and methodologies.
- A team player with a positive attitude and ability to work well in a fast-paced and dynamic environment.