| Hybrid Role::Data Engineer::Dallas, TX at Dallas, Texas, USA |
| Email: [email protected] |
| From: Pranav, Vastika Inc. [email protected] Reply to: [email protected] Role: Data Engineer Duration: 6 months CTH Location: Dallas, TX (Hybrid Role) MOI: Skype Visa: No H1/CPT/TN LinkedIn: Required Notes: Locals Only. Description: The Data Engineer unlocks the critical value of enterprise data and build a data-driven organization by making it as secure, easy, and scalable as possible. The Data Engineer will perform statistical analysis of large and varied dataset with high volumes of structured and unstructured data. This role directly impacts our product engineering team by ensuring the availability of high-quality data for analysis and insights. This role will also provide you with an opportunity to work with cutting-edge technologies and gain and gain hands-on experience in Spark, Python Design, develop, and maintain scalable and efficient data pipelines using GCP Dataflow, Apache Airflow, and other relevant technologies. Implement data transformations, ensuring accuracy, reliability, and performance. Leverage Apache Airflow and GCP Composer to orchestrate complex data workflows and manage dependencies between tasks. Utilize GCP Dataproc for efficient processing of large-scale data sets, optimizing for performance and cost-effectiveness. Data Warehousing: Work with Big Query to design and implement data models, ensuring data integrity and optimal query performance. Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions. Coding and Scripting: Demonstrate strong programming skills in Python, with the ability to write clean, maintainable, and efficient code. Experience in Java is a plus. Apply expertise in Google Cloud Platform to implement and optimize data solutions, staying current with the latest GCP technologies and best practices. Exhibit a strong understanding of SQL for data manipulation, extraction, and analysis. Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions. Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field. Proven experience as a Data Engineer, with a focus on GCP services. Strong proficiency in Python; experience with Java is a plus. In-depth knowledge of GCP Dataflow, Apache Airflow, GCP Composer, GCP Dataproc, and Big Query. Solid understanding of SQL and data modelling. Experience with cloud-based data storage solutions. Strong problem-solving and analytical skills. Excellent communication and collaboration abilities. Regards, Pranav Chand Vastika Inc. 1200 West Walnut Hill Lane, Suite# 2200, Irving, TX 75038 : [email protected] Cell Phone: 469-706-3634 Keywords: information technology trade national Tennessee Texas |
| [email protected] View all |
| Thu Dec 14 02:28:00 UTC 2023 |