| Urgent Need Data Engineer || Hybrid in GA need only Local at Atlanta, Georgia, USA |
| Email: [email protected] |
| From: Rajeev, Vyzeinc [email protected] Reply to: [email protected] Title : Data Engineer Location: Hybrid, Atlanta, GA MOI: Video 2 rounds Required Competencies The ideal candidate will have proven experience in data pipeline development and large-scale data processing, with a strong focus on using platforms like Databricks and Apache Spark. Responsibilities: Develop, construct, test, and maintain end-to-end data pipeline solutions encompassing data ingestion, extraction, transformation, enrichment, loading, validation, processing, monitoring, maintenance, governance, and security. Utilize Databricks and Apache Spark for large-scale data processing and analytics, data engineering, data science, and machine learning tasks. Ensure seamless data flow between various systems to support data-driven decision making. Utilize knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series to optimize data architecture. Work with both SQL and NoSQL databases like Teradata, MS SQL, DB2, Cassandra, and AWS S3. Apply knowledge of distributed data storage systems, data lakes, and data warehousing concepts to enhance our data infrastructure. Use programming languages like Python or Java for data manipulation and scripting. Collaborate effectively with cross-functional teams, translating complex data-related challenges into clear tasks and solutions. Qualifications: Demonstrable hands-on experience with Databricks and Apache Spark for large-scale data processing and analytics. Strong with Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series. Experience with SQL and NoSQL databases like Teradata, MS SQL, DB2, Cassandra, and AWS S3. Strong knowledge of distributed data storage systems, data lakes, and data warehousing concepts. Excellent programming skills in languages like Python or Java. Regards, Rajeev | Vyze Inc. 25179 Methley Plum Place, Aldie, VA 20105 : +1- 7038842727| Email: [email protected] Keywords: message queue sthree microsoft Georgia Virginia |
| [email protected] View all |
| Wed Sep 06 03:16:00 UTC 2023 |