| : Senior ETL Developer|| Plano, TX- HYBRID at Plano, Texas, USA |
| Email: [email protected] |
| From: charu sharma, tek inspirations [email protected] Reply to: [email protected] Title: Senior ETL Developer Location: Plano, TX (HYBRID- 3 days in office Duration: 6 months Interview mode: video call Must be an expert: Python deep knowledge(Lead Expert): Boto3, Multiprocessing, Classes UNIX deep knowledge in development and scripting API development using AWS Snowflake expertise Java Script (Snowflake SP) AWS: Lambda, Triggers, EC2, S3, CloudWatch, Security. Snowflake: SQL & Stored Procedures Airflow: Celery, MQ Rabbit, Postgress Unix-Linux: Shell Scripting, admin experience Experience building APIs Looker Informatica Teradata 10 years of recent experience in data engineering and/or software development, ETL work A solid track record of data management showing your flawless execution and attention to detail. Programming experience,ideally in Python, Java Script and a willingness to learn new programming languages to meet goals and objectives. Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks. Good Understanding of Databases and Data warehouse tools This role is ideal for an experienced engineer who has a keen interest in working with large data sets to design and develop client facing platforms (measurement, attribution, reports, visualization, data feeds, yield, audience creation) for the complex Media & Advertising industry. Responsibilities Responsible for driving the design and implementation of specific data models to drive better business decisions through insights from a combination of 3rd party and1st party data assets. Accountable for developing the necessary enablers and data platform in a cloud Environment and has the responsibility of maintaining ts integrity during the life cycle phases. Define data requirements, gathera nd mine large scale of structured and unstructured data, and validate data byrunning various data tools. Support the standardization, customization, and ad-hoc data analysis, and willdevelop the mechanisms to ingest, analyze, validate, normalize, and clean data.Develop and maintain data engineering best practices and contribute to Insightson data analytics and visualization concepts, methods, and techniques. Design and develop data applications using selected tools and frameworks asrequired and requested. Collaborate with Engineers and Business to build intuitive products thataddress the needs of our customers. Read, extract, transform, stage and load data to selected tools andframeworks as required and requested. Gather and process raw data at scale. Perform tasks such as writing scripts, web scraping, calling-writing APIs,write SQL queries, etc. Work closely with the engineering team to integrate your work into ourproduction systems. Process unstructured data into a form suitable for analysis. Analyzeprocessed data. Participate in design and code reviews to ensure the quality of the productswe deliver. Mentor more junior engineers on designing robust applications andimplementing maintainable code. Establish a good working rapport with Development group, System Engineers,Quality Assurance/Testers, and Business users Develop scripts or workflows to facilitate complex ingress processes Design Participate in Daily Scrum calls as well as quarterly sprint planningsessions to support development efforts Willing to coordinate an offshore team (different time zone). Need for gurus in Python and UNIX, inaddition to the other listed required skills. Understanding in depth Pythonlike memory management (RAM level), Python to AWS locking, running Python withAWS Lambda, virtual environments, containers. UNIX exposure to deep commandsand scripting like arch, filters and socket manipulation. Warm Regards.. Charu Sharma IT Technical Recruiter TEK Inspirations LLC | 13573 Tabasco Cat Trail, Frisco, TX 75035 Email: [email protected] Disclaimer : If you are not interested in receiving our e-mails then please reply with a " REMOVE " in the subject line to [email protected] . And mention all the e-mail addresses to be removed with any e-mail addresses, which might be diverting the e-mails to you. We are sorry for the inconvenience Keywords: message queue sthree active directory information technology North Dakota Texas |
| [email protected] View all |
| Tue Jul 18 23:14:00 UTC 2023 |