Job Role: Senior Cloud Data Engineer
Location: USA Remote
Visa: USC H1B
Mode: C2C
Key Responsibilities
- Management and alignment of solutions across all technology platforms, working closely with architects, data, and infrastructure teams to optimize application code, ensuring data integrity, security, stability, resiliency, sustainability, growth, and performance.
- Conduct design and code reviews to ensure compliance with standards.
- Participate in knowledge sharing and own technical issue resolution.
- Produce high-quality code that is robust, efficient, testable, and easy to maintain.
- Deliver operational automation and tooling to minimize repeated manual tasks.
- Create and maintain systems to load and transform large data sets from various internal & external sources.
- Understand business goals and drivers and translate those into an appropriate technical cloud solution.
- Be the subject matter expert for technologies like MS-SQL Server, Redshift, AWS Glue, DMS, Step Functions, Lambda, Iceberg tables, Athena, and AWS Data Pipelines.
- Create conceptual, logical, and physical design for cloud-based solutions for Data, Infrastructure, and Application platforms.
- Team with Software Engineering teams and Product Owners to include new data sources and types in ETL processes and assist in deploying schema changes.
- Work with our Data Scientist and Business Intelligence team to create data-driven insights and reports for the organization.
- Perform daily monitoring, administration, repair, and maintenance related to databases and related technologies in all environments.
- Participate in an on-call rotation supporting production systems during off-hours.
- Regular, reliable attendance during normal business hours.
- In-person attendance and travel as requested.
- Other duties as assigned.
Education and Experience
Required:
- Bachelor of Science degree from an accredited university majoring in Computer Science or other Engineering discipline.
- 7+ years of related work experience, including experience in the following:
- Big Data, data streaming, data lake, Lake Formation & cloud-based platforms.
- ETL, Data Modeling, and Data Architecture.
- Experience with Big Data technologies such as Spark, PySpark, EMR, etc.
- Python for data processing and Scripting experience.
- Designing data warehouse solutions.
- Expertise in ETL optimization, designing, coding, and tuning extensive data processes using Apache Spark or similar technologies.
- AWS platform services, such as: compute, containers, integration, internet of things, storage, web, and DevOps.
- All offers are contingent upon signing a confidentiality agreement and satisfactory completion of drug screening and background checks. Employer observes federal standards for controlled substances.
Preferred:
- Experience operating very large data warehouses or data lakes.
- Experience building data pipelines and applications to stream and process datasets at low latencies.
- Knowledge of Engineering and Operational Excellence using standard methodologies.
- Experience in AWS in developing solutions using microservices.
- Proven track record of successfully architecting and deploying AWS solutions from End to End.
- Knowledge of defining solution architecture, design detailing, and technology delivery with a particular focus on AWS platform services, such as: compute, containers, integration, internet of things, storage, web, and DevOps.
Skills and Abilities
- Expert-level skills in writing and optimizing SQL.
- Proven efficiency in handling data, tracking data lineage, ensuring data quality, and improving discoverability of data.
- Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines and knows how to optimize the distribution, partitioning, and MPP of high-level data structures.
- Advanced problem-solving skills and the ability to optimize data for the best possible outcome.
- Ability to prioritize and manage multiple milestones and projects efficiently.
- A willingness to dig deep, learn from others, share your skills, and be part of a talented and dedicated team.
- Superior attention to detail.
- Highly adaptable, a driver of change, and capable of quickly rallying teams.
- Effectively prioritizes and executes tasks in a highly productive yet autonomous environment.
- Strong decision-making and problem-solving skills (i.e., design, debugging, and testing) and experience with software development projects.
- Ability to present technical ideas in concise, user-friendly, or layman's language.
- Strong interpersonal skills used in developing effective working relationships and listening skills.
- Result-driven and solutions-oriented with the ability to develop and implement the resolution in time-sensitive situations.
- Motivate and mentor team members to grow their skills and careers by creating a nurturing environment that encourages innovation and continual learning.
- Ability to work in a fast-paced, time-sensitive, and confidential environment.
- Excellent communication skills; able to communicate effectively both orally and in writing with professionalism, excellent grammar, respect, and courteousness.
- Possess a balance of assertiveness and diplomacy along with adaptability to communicate on all levels.
Physical Requirements
- Prolonged periods in a stationary seated position, such as working on a computer.
- Frequently move, transport, and manipulate computer equipment up to 15 pounds.
- Verbal communication sufficient to exchange accurate ideas and information.
- In-person attendance and travel as requested.
Benefits found in job post
- 401(k)
0 Comments