| Onsite - Senior Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
|
Processing description: http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2334601&uid= From: Nihitha, GAC Solutions [email protected] Reply to: [email protected] Hi, hope youre doing well!! This is Nihitha from GAC Solutions. regarding a fantastic job opportunity with our preferred client. So, please go through the below job description & let us know your interest. Title: Senior Data Engineer Location: Frisco/Atlanta/Overland Park Job Description: We are seeking a highly skilled Data Engineer to join our data engineering team. The ideal candidate will have extensive experience in building robust ETL pipelines, implementing efficient data ingestion strategies, and working with tools like Python, Spark, and Databricks. This role will involve collaborating with cross-functional teams to ensure data integrity, scalability, and optimal performance for our data-driven solutions. Key Responsibilities - Design, develop, and maintain scalable ETL pipelines to ingest and transform data from multiple sources. - Implement data integration strategies using Python, Spark, Snowflake and Databricks to enable seamless data ingestion and transformation. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions. - Develop and optimize data workflows to improve data quality, consistency, and performance. - Ensure data security, governance, and compliance best practices are followed. - Conduct performance tuning of Spark jobs and optimize data queries to minimize latency and improve efficiency. - Automate data pipelines using CI/CD tools and ensure continuous data delivery. - Troubleshoot data issues, identify root causes, and implement effective solutions. Required Qualifications - Strong proficiency in Python, with experience in data manipulation libraries like Pandas and PySpark. - Extensive experience with Apache Spark for data processing and analysis. - Hands-on experience with Databricks, Snowflake, Azure key vault, Azure fuctions, Power for building scalable data pipelines. - Experience with data lakes, data warehouses, and cloud platforms like AWS, Azure, or P. - Strong SQL skills for data extraction, transformation, and querying. - Familiarity with version control systems (e.g., Git) and CI/CD processes. - Excellent problem-solving skills, attention to detail, and ability to work collaboratively. Preferred Skills - Experience with workflow orchestration tools like Apache Airflow, Dagster, or Prefect. - Knowledge of data modeling techniques and best practices. - Familiarity with data visualization tools such as Power BI, Tableau. - Understanding of data privacy regulations and security protocols Keywords: continuous integration continuous deployment business intelligence golang Onsite - Senior Data Engineer [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2334601&uid= |
| [email protected] View All |
| 01:39 AM 11-Apr-25 |