| Data Engineer/ETL Developer :: Location : Las Vegas, NV (Onsite) at Las Vegas, Nevada, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2219948&uid= Need or - only Role: Data Engineer/ ETL Developer Location : Las Vegas, NV (Onsite) Position type : Contract Project Duration : Long Term Visa : , - only Detailed JD : Develop and maintain data pipelines, ELT processes , and workflow orchestration using Apache Airflow, Python and PySpark to ensure the efficient and reliable delivery of data. Design and implement custom connectors to facilitate the ingestion of diverse data sources into our platform, including structured and unstructured data from various document formats . Collaborate closely with cross-functional teams to gather requirements, understand data needs, and translate them into technical solutions. Implement DataOps principles and best practices to ensure robust data operations and efficient data delivery. Design and implement data CI/CD pipelines to enable automated and efficient data integration, transformation, and deployment processes. Monitor and troubleshoot data pipelines, proactively identifying and resolving issues related to data ingestion, transformation, and loading. Conduct data validation and testing to ensure the accuracy, consistency, and compliance of data. Stay up-to-date with emerging technologies and best practices in data engineering. Document data workflows, processes, and technical specifications to facilitate knowledge sharing and ensure data governance. Experience: Bachelors degree in computer science, Engineering, or a related field 8 + years experience in data engineering, ELT development, and data modeling. Proficiency in using Apache Airflow and Spark for data transformation, data integration, and data management. Experience implementing workflow orchestration using tools like Apache Airflow, SSIS or similar platforms. Demonstrated experience in developing custom connectors for data ingestion from various sources. Strong understanding of SQL and database concepts, with the ability to write efficient queries and optimize performance. Experience implementing DataOps principles and practices, including data CI/CD pipelines. Excellent problem-solving and troubleshooting skills, with a strong attention to detail. Effective communication and collaboration abilities, with a proven track record of working in cross-functional teams. Familiarity with data visualization tools Apache Superset and dashboard development. Understanding of distributed systems and working with large-scale datasets. Familiarity with data governance frameworks and practices. Knowledge of data streaming and real-time data processing technologies (e.g., Apache Kafka). Strong understanding of software development principles and practices, including version control (e.g., Git) and code review processes. Experience with Agile development methodologies and working in cross-functional Agile teams. Ability to adapt quickly to changing priorities and work effectively in a fast-paced environment. Excellent analytical and problem-solving skills, with a keen attention to detail. Strong written and verbal communication skills, with the ability to effectively communicate complex technical concepts to both technical and non-technical stakeholders. Required Skills Python, Pyspark, SQL, Airflow, Trino, Hive, Snowflake, Agile Scrum Good to have Linux,Openshift, Kubernentes, Superset Looking forward to work with you! Thanks & Regards Lokesh Yadav Sr. Technical Recruiter CloudThink Tech Inc E: [email protected] Website: https://cloudthinktech.com/ LinkedIn: https://www.linkedin.com/in/lokesh-yadav-35941b223/ Address: 10301 Northwest FWY STE 314, Houston TX, 77092 An E-Verify Company !! Please consider the environment before printing this e-mail. DISCLAIMER The information in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee. Access to this e-mail by anyone else is unauthorized. If you have received this communication in error, please notify the sender and delete the e-mail and destroy any copies of it. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Any opinions or advice contained in this e-mail are subject to the terms and conditions expressed in the governing Cloud Think Technologies client engagement letter. Opinions, conclusions and other information in this e-mail and any attachments that do not relate to the official business of the firm are neither given nor endorsed by it. Cloud Think Technologies cannot guarantee that e-mail communications are secure or error-free, as information could be intercepted, corrupted, amended, lost, destroyed, -- Keywords: continuous integration continuous deployment information technology Nevada Texas Data Engineer/ETL Developer :: Location : Las Vegas, NV (Onsite) [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2219948&uid= |
| [email protected] View All |
| 08:11 PM 03-Mar-25 |