| CA consultants, first priority :: Big-Data Engineer (10+ years experience) :: Sunnyvale, CA (Onsite Role) :: Contract Opportunity at Sunnyvale, California, USA |
| Email: [email protected] |
|
Processing description: http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=918003&uid= From: Akshat Gupta, Valiantica Inc. [email protected] Reply to: [email protected] Hello, I hope this email finds you well. This is Akshat Gupta from Valiantica Inc. This email is a reference to jobs Big-Data Engineer (10+ years experience) go through the job descriptions and let us know if you are interested in the same. Please reply with your updated resume and expected compensation. Position- Big-Data Engineer (10+ years experience) Location- Sunnyvale, CA (Onsite Role) Interview- Phone and Skype Duration- Contract Opportunity Need candidate with 10+years experience Job Description: Job description Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure etc.) to build batch data pipelines with strong focus on optimization, SLA adherence and fault tolerance. Expertise in building idempotent workflows using orchestrators like Automic, Airflow, Luigi etc. Expertise in writing SQL to analyze, optimize, profile data preferably in BigQuery or SPARK SQL Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development / data solution work Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process Ability to move at rapid pace with quality and start delivering with minimal ramp up time will be crucial to succeed in this initiative Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project Nice to have: Experience building complex near real time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability and SLA adherence. Good understanding of REST APIs working knowledge on Apache Druid, Redis, Elastic search, GraphQL or similar technologies. Understanding of API contracts, building telemetry, stress testing etc. Exposure in developing reports/dashboards using Looker/Tableau Experience in eCommerce domain. Tech stack : Google cloud, HDFS, SPARK, Scala, Python (optional), Automic/Airflow, BigQuery, Kafka, API, Druid Thanks, Akshat Gupta Valiantica Inc. 888 Saratoga Ave. #210 San Jose, CA 95129 Email ID: [email protected] URL: www.valiantica.com Keywords: golang California Idaho http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=918003&uid= |
| [email protected] View All |
| 08:41 PM 07-Dec-23 |