| Data Engineer @ Holmdel, NJ / Bethlehem, PA Onsite at Bethlehem, Connecticut, USA |
| Email: [email protected] |
| Hi, My name is Balaji and I'm an IT recruiter at Trident Consulting. Trident Consulting is seeking "Data Engineer for one of our clients in Holmdel, NJ / Bethlehem, PA Onsite. A global leader in business and technology services. Role: Data Engineer Location: Holmdel, NJ / Bethlehem, PA Onsite Type: Contract Roles & Responsibilities: 5+ years of experience with Bachelors / masters degree in computer science, Engineering, Applied mathematics or related field. Extensive hands-on development experience in writing complex SQL queries and good to have Python/Bash scripting knowledge. Extensive Experience in performance optimization of data pipelines. Experience working with cloud data warehouse and data lake platforms like Databricks, Redshift or Snowflake. Familiarity with building and deploying scalable data pipelines to develop and deploy Data Solutions using Python, SQL, PySpark. Extensive experience in all stages of software development and expertise in applying software engineering best practices. Experience in developing end-to-end orchestration layer for data pipelines using frameworks like Apache Airflow, Prefect, Databricks Workflow. Experience in creating and configuring continuous integration/continuous deployment using pipelines to build and deploy applications in various environments and use best practices for DevOps to migrate code to Production environment. Ability to investigate and repair application defects regardless of component: front-end, business logic, middleware, or database to improve code quality, consistency, delays and identify any bottlenecks or gaps in the implementation. Ability to write unit tests in SQL. Additional Qualifications (nice to have) Experience in using and implementing data observability platforms like Monte Carlo Data, Metaplane, Soda, bigeye or any other similar products. Expertise in debugging issues in Cloud environment by monitoring logs on the VM or using AWS features like Cloudwatch. Experience with DevOps tech stack like Jenkins and Terraform. Experience working with concept of Observability in software world and experience with tools like Splunk, Zenoss, Datadog or similar. Experience in developing and implementing Data Quality framework either home grown or using any open-source frameworks like Great Expectations, Soda, Deequ. Ability to learn and adapt to new concepts and frameworks and create proof of concept using newer technologies. Ability to use agile methodology throughout the development lifecycle and provide updates on regular basis, escalating issues, or delays in a timely manner. Familiar with RESTful Webservices (REST APIs) to be able to integrate with other services. API Gateways like APIGEE to secure webservice endpoints. Data pipelines, Concurrency and parallelism. About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology and engineering professionals in contract and full-time roles. Trident's commitment is to deliver the best and brightest individuals in the industry for our clients' toughest requirements. Some of our recent awards include: 2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area Sincerely yours, Balaji K Trident Consulting 6990 Village Parkway, Suit 212 Dublin, CA 94568 Phone: (925) 488-1999 Ext.427 India: +91 956-683-6349 Email: [email protected] https://www.tridentconsultinginc.com/Consultants/ Keywords: information technology California New Jersey Pennsylvania |
| [email protected] View all |
| Tue Feb 06 01:17:00 UTC 2024 |