| Need Only Locals for Data Engineer at Hartford, CT (Only Locals) at Hartford, Connecticut, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2247845&uid= From: Teja, insoursysinc [email protected] Reply to: [email protected] Role: Data Engineer Location: Hartford, CT (Only Locals) Job Description: Mandatory Skills Design, build, and maintain scalable data pipelines using Cloud Dataflow, Apache Beam, Apache Spark, or BigQuery. Develop ETL/ELT workflows for data ingestion, transformation, and processing using Cloud Composer (Airflow), TIDAL, Dataform, or custom scripts. Optimize BigQuery performance through partitioning, clustering, and query tuning. Implement data governance, security, and compliance best practices within P. Work with Cloud Storage, Pub/Sub,Ni-Fi, Cloud SQL and Bigtable for real-time and batch data processing. Monitor and troubleshoot data pipeline performance, failures, and cost efficiency. Collaborate with data scientists, analysts, and software engineers to support business requirements. Ensure data quality, validation, and integrity using appropriate testing frameworks. Strong expertise in P services (BigQuery, Dataflow, Cloud Storage, Pub/Sub, Bigtable, Firestore, etc.). Proficiency in SQL, Python, and Java for data processing and automation. Experience with ETL/ELT workflows using Cloud Composer, Dataflow, or Dataform. Strong understanding of data modeling, warehousing, and distributed computing. Experience with real-time and batch processing architectures. Knowledge of CI/CD pipelines, Git, and DevOps best practices. Understanding of security and compliance standards (IAM, encryption, GDPR, HIPAA, etc.). Preferred Qualifications: P certifications (e.g., Professional Data Engineer, Associate Cloud Engineer). Experience with machine learning pipelines on P (Vertex AI, AI Platform, etc.). Exposure to Kafka, Ni-Fi, or other streaming technologies. Experience with containerization and orchestration (Docker, Kubernetes, GKE). Thanks & Regards Tejaswi Athili Ph: 972-440-0065 Insoursys 1908 Thomes Ave, Cheyenne, WY 82001 Email : [email protected] Website: www.insoursys.com LinkedIn: Tejaswi Athili Keywords: continuous integration continuous deployment artificial intelligence Connecticut Wyoming Need Only Locals for Data Engineer at Hartford, CT (Only Locals) [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2247845&uid= |
| [email protected] View All |
| 02:07 AM 12-Mar-25 |