| Senior Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: amelia, UNICORN [email protected] Reply to: [email protected] Hi Connections, Hope ypu all are doing good, Kindly go through the below JD and share suitable profiles. Role : Senior Data Engineer location : Remote Glider Test: It is a combination of Technical and Coding test which is being recorded and scores will be given at the same time or later. Job Description We are seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining scalable and reliable data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data availability, quality, and accessibility for various business needs. Responsibilities Data Architecture Design : Develop and maintain scalable data architectures and pipelines to support data integration, transformation, and visualization. ETL Development : Design, implement, and manage Extract, Transform, Load (ETL) processes to ensure the efficient flow of data from source systems to data warehouses and data lakes. Database Management : Optimize and manage relational and non- relational databases, ensuring high performance and data integrity. Data Quality Assurance : Implement data quality checks, validation processes, and monitoring to ensure data accuracy and consistency. Collaboration : Work collaboratively with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business objectives. Performance Tuning : Analyze and optimize data processing performance, including query tuning and resource allocation. Documentation : Create and maintain comprehensive documentation for data engineering processes, data flows, and data models. Security and Compliance : Implement data security and compliance measures to protect sensitive information and ensure adherence to regulatory requirements. Innovation : Stay up to date with the latest industry trends, tools, and technologies to continuously improve data engineering practices. Qualifications Education : Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field. Experience : Minimum of 5 years of experience in data engineering or a related field. Technical Skills : o Proficiency in programming languages such as Python, Java, or Scala. o Strong experience with SQL and database management systems (e.g., MySQL, PostgreSQL, Oracle). o Experience with big data technologies (e.g., Hadoop, Spark, Kafka). o Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services. o Knowledge of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery). o Experience with ETL tools (e.g., Apache NiFi, Informatica, Talend). o Strong understanding of data modeling, data structures, and algorithms. Soft Skills : o Excellent problem-solving and analytical skills. o Strong communication and collaboration abilities. o Ability to work independently and manage multiple tasks simultaneously. o Detail-oriented with a focus on data accuracy and quality. Preferred Qualifications Experience with machine learning pipelines and MLOps. Knowledge of data governance and data privacy standards. Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes). Keywords: information technology golang Senior Data Engineer [email protected] |
| [email protected] View all |
| Wed Sep 25 01:30:00 UTC 2024 |