| Lead Data Engineer in Pennsylvania (PA) C2C at Remote, Remote, USA |
| Email: ankul.kumar@dataqinc.com |
|
https://jobs.nvoids.com/job_details.jsp?id=2222304&uid= From: Ankul Kumar, Dataqinc ankul.kumar@dataqinc.com Reply to: ankul.kumar@dataqinc.com Job Summary: We are seeking a highly skilled Lead Data Engineer to design, develop, and manage data solutions that drive our analytics and business intelligence initiatives. This role requires expertise in data architecture, ETL processes, and big data technologies to ensure efficient data integration and processing. As a Lead Data Engineer, you will be responsible for mentoring a team of engineers, collaborating with cross-functional teams, and ensuring the scalability, performance, and security of our data platforms.Key Responsibilities: Data Architecture & Engineering: Design and implement robust data pipelines and architectures for structured and unstructured data sources. ETL Development: Develop and maintain ETL processes to support data ingestion, transformation, and storage. Big Data & Cloud Technologies: Utilize modern big data tools such as Spark, Hadoop, and cloud platforms like AWS, Azure, or Google Cloud for data processing and storage. Database Management: Optimize and manage relational (SQL) and NoSQL databases to support analytical and operational needs. Data Governance & Security: Ensure compliance with data governance policies and implement security best practices for data storage and access. Collaboration & Leadership: Lead a team of data engineers, collaborate with data scientists, analysts, and business stakeholders to deliver high-impact data solutions. Performance Optimization: Continuously monitor and improve data pipeline efficiency, reliability, and scalability.Required Qualifications: Experience: 7+ years in data engineering with at least 2 years in a lead role. Technical Skills: Proficiency in Python, Scala, or Java for data processing. Experience with Spark, Kafka, Airflow, and cloud-based data services (AWS Glue, Redshift, BigQuery, Databricks, etc.). Database Expertise: Strong knowledge of SQL, NoSQL databases (MongoDB, Cassandra), and data warehousing solutions. ETL & Data Integration: Hands-on experience in building scalable ETL pipelines and working with tools like Informatica, Talend, or Apache NiFi. Cloud Expertise: Hands-on experience in AWS, Azure, or GCP cloud platforms. Leadership & Communication: Proven ability to mentor engineers and communicate technical concepts to non-technical stakeholders. Problem-Solving: Strong analytical and problem-solving skills with a passion for optimizing data workflows.Preferred Qualifications: Experience in real-time data streaming technologies such as Apache Flink or Kinesis. Knowledge of ML Ops and integrating machine learning models into data pipelines. Familiarity with containerization and orchestration tools like Docker and Kubernetes. Certifications in cloud technologies (AWS Certified Data Analytics, Google Professional Data Engineer, etc.).Benefits: Competitive salary and performance-based bonuses. Comprehensive health, dental, and vision insurance. 401(k) with company match. Generous paid time off and flexible work arrangements. Professional development and certification reimbursement. Keywords: machine learning Lead Data Engineer in Pennsylvania (PA) C2C ankul.kumar@dataqinc.com https://jobs.nvoids.com/job_details.jsp?id=2222304&uid= |
| ankul.kumar@dataqinc.com View All |
| 01:00 AM 04-Mar-25 |