| Sr. AWS Databricks Developer - Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Laxmi Kumari, Smart IT Frame [email protected] Reply to: [email protected] Dear Vendor, Please help me with some appropriate profiles for the below closable job positions. Role: Sr. AWS Databricks Developer Location: Remote Duration: 12+ months Job Description: Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and AWS Databricks Delivering and presenting proofs of concept to of key technology components to project stakeholders. Developing scalable and re-usable frameworks for ingesting of geospatial data sets Integrating the end to end data pipleline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times Working with event based / streaming technologies to ingest and process data Working with other members of the project team to support delivery of additional project components (API interfaces, Search) Evaluating the performance and applicability of multiple tools against customer requirements Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. Strong knowledge of Data Management principles Experience in building ETL / data warehouse transformation processes Experience using geospatial frameworks on Apache Spark and associated design and development patterns Microsoft AWS Big Data Architecture certification. Experienced utilizing various AWS services such as: EC2, ELB, RDS, API Gateway, DynamoDB, AWS Lambda, Athena, S3, and CDN. Experience with Apache Kafka / Nifi for use with streaming data / event-based data Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala) Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J) Experience working with structured and unstructured data including imaging & geospatial data. Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Chef, Puppet or Terraform Best Regards Laxmi Kumari Smart IT Frame - An E-verify Employer 220 Davidson Ave, Suite #313, Somerset, NJ 08873 (Fax) 201-987-7575 [email protected] | www.smartitframe.com Keywords: sthree information technology New Jersey |
| [email protected] View all |
| Wed Jan 25 21:44:00 UTC 2023 |