Need-AWS Databricks Developer Boston, MA at Boston, Massachusetts, USA |
Email: [email protected] |
From: Vignesh Ramakrishnan, Teamware solutions [email protected] Reply to: [email protected] Hi, Hope you are doing well!! This is Vignesh from Teamware Solutions.... We have Job opening on AWS Databricks Developer Role: AWS Databricks Developer, Duration: Contract(Initial Remote), Location:Boston, MA Job Description: Role name: Developer Role Description: Role Summary Recognize the current application infrastructure and suggest new concepts to improve performance Document the best practices and strategies associated with application deployment and infrastructure support Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka and Lambda to build serverless applications Work jointly with the IT team and other departments to migrate data engineering and ML applications to Databricks/AWS Comfortable to work on tight timelines, when required. Core/Must have skills Good decision-making and problem solving skills Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse). Knowledge on medallion architecture, DLT and unity catalog within Databricks. Experience in migrating data from on-prem Hadoop to Databricks/AWS Understanding of core AWS services, uses, and AWS architecture best practices Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc. Solid knowledge on Airflow Solid knowledge on CI/CD pipeline in AWS technologies Application migration of RDBMS, java/python applications, model code, elastic etc. Solid programming background on scala, python Competencies: Digital : Amazon Web Service(AWS) Cloud Computing, Digital : Databricks Experience (Years): 6-8 Essential Skills: Role Summary Recognize the current application infrastructure and suggest new concepts to improve performance Document the best practices and strategies associated with application deployment and infrastructure support Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka and Lambda to build serverless applications Work jointly with the IT team and other departments to migrate data engineering and ML applications to Databricks/AWS Comfortable to work on tight timelines, when required. Core/Must have skills Good decision-making and problem solving skills Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse). Knowledge on medallion architecture, DLT and unity catalog within Databricks. Experience in migrating data from on-prem Hadoop to Databricks/AWS Understanding of core AWS services, uses, and AWS architecture best practices Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc. Solid knowledge on Airflow Solid knowledge on CI/CD pipeline in AWS technologies Application migration of RDBMS, java/python applications, model code, elastic etc. Solid programming background on scala, python Desirable Skills: Role Summary Recognize the current application infrastructure and suggest new concepts to improve performance Document the best practices and strategies associated with application deployment and infrastructure support Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka and Lambda to build serverless applications Work jointly with the IT team and other departments to migrate data engineering and ML applications to Databricks/AWS Comfortable to work on tight timelines, when required. Core/Must have skills Good decision-making and problem solving skills Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse). Knowledge on medallion architecture, DLT and unity catalog within Databricks. Experience in migrating data from on-prem Hadoop to Databricks/AWS Understanding of core AWS services, uses, and AWS architecture best practices Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc. Solid knowledge on Airflow Solid knowledge on CI/CD pipeline in AWS technologies Application migration of RDBMS, java/python applications, model code, elastic etc. Solid programming background on scala, python -- Thanks & Regards VIGNESH RAMAKRISHNAN |EXECUTIVE-Talent Acquisition ( US Division) Teamware Solutions Inc |8951 Cypress Waters Blvd, Suite #1092, Dallas, Texas - 75019 LinkedIn: linkedin.com/in/vignesh-ramakrishnan-bb7958179 : [email protected] Desk: +12145449254 Keywords: continuous integration continuous deployment machine learning sthree rlang information technology Massachusetts |
[email protected] View all |
Mon Jan 22 20:15:00 UTC 2024 |