| Big Data Engineer with cloud experience Sunnyvale/Austin / Day 1 Onsite at Day, New York, USA |
| Email: [email protected] |
| Big Data Engineer with cloud experience Sunnyvale/Austin / Day 1 Onsite Job Description: Skills-Big Data, Tableau,Kafka,Iceberg,Spark Having 10 years of professional experience fields of software Analysis, Design, Development, Deployment and Maintenance of software and Big Data applications. Experience in Big data Implementation with strong experience on major components of Iceberg, Tableau, Kafka, Superset, Druid, Hive metastore, apache, ranger, security, AWS Experience in creating iceberg tables and loading the data from different file formats. Good Experience in Data importing and exporting to Hive and HDFS with Sqoop. Experience in using Producer and Consumer APIs of Apache Kafka. Skilled in integrating Kafka with Spark streaming for faster data processing. Experience in using Spark Streaming programming model for Real- time data processing. Experience dealing with the file formats like text files, Sequence files, JSON, Parquet, ORC. Extensively used Apache Kafka to collect the logs and error messages across the cluster. Excellent knowledge and understanding of Distributed Computing and Parallel processing frameworks. Experienced with Analytics with Hive Megastore. Experience with Superset, Druid. Experience working with EC2 (Elastic Compute Cloud) cluster instances, setup data buckets on S3 (Simple Storage Service), setting up EMR (Elastic MapReduce). Good experience working on Tableau and enabled the JDBC/ODBC data connectivity from those to Hive Metastore. Good with version control systems like GIT. Strong knowledge on UNIX/LINUX commands. Adequate Knowledge on Python scripting Language. Adequate knowledge of Scrum, Agile and Waterfall methodologies. Highly motivated and committed to the highest levels of professionalism. Exhibited strong written and oral communication skills. Rapidly learn and adapt quickly to emerging new technologies and paradigms. -- Tauheed Saleem | Talent Acquisition Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd 2838 E. Long Lake Road Suite 210, Troy, MI 48085 D : +1-214-856-8383 [email protected] Disclaimer This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to which they are addressed. If you have received this email in error please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. -- Keywords: sthree information technology Michigan |
| [email protected] View all |
| Tue Sep 19 22:17:00 UTC 2023 |