| Azure Data Engineer with Python USC only at Remote, Remote, USA |
| Email: [email protected] |
| From: Sonali, kpg99 inc [email protected] Reply to: [email protected] Job Title: Fully Remote Azure Data Engineer with Python/C# Duration: 6 months Location: Remote PySpark or Scala Spark SQL Delta lakes * Python/C# PRIMARY DUTIES AND ACCOUNTABILITIES Item Accountability % 1 Create and maintain optimal data pipeline architecture 20 2 Assemble large, complex data sets that meet functional / non-functional business requirements. 20 3 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 20 4 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies. 20 5 Deliver automation & lean processes to ensure high quality throughput & performance of the entire data & analytics platform. 10 6 Work with data and analytics experts to strive for greater functionality in our analytics platforms. 10 POSITION SPECIFICATIONS Minimum: Preferred: Experience in building/operating/maintaining fault tolerant and scalable data processing integrations using Azure Strong problem-solving skills with emphasis on optimization data pipelines Excellent written and verbal communication skills for coordinating across teams A drive to learn and master new technologies and techniques Experienced in DevOps and Agile Experience using Docker or Kubernetes is a plus Demonstrated capabilities with cloud infrastructures and multi-cloud environments such as Azure, AWS, IBM cloud environments and using CI/CD pipelines. Experience with Delta Lakes Experienced using Databricks & Apache Spark Experienced using Azure Data Factory or Synapse Analytics Thanks & Regards Sonali Kumari Technical Recruiter KPG99, INC Keywords: csharp continuous integration continuous deployment Azure Data Engineer with Python USC only [email protected] |
| [email protected] View all |
| Tue Aug 27 01:27:00 UTC 2024 |