Full Time
ID : 24011
Location: Exton-PA or Any location as per client need
We are seeking a skilled Data Engineer to design, develop, and optimize data pipelines and infrastructure. This role involves building robust ETL pipelines, optimizing data storage solutions, and ensuring seamless data integration across various platforms. . This role requires strong expertise in SQL, Python, and data warehousing solutions to support data-driven decision-making across the organization.
Key Responsibilities:
- Design, build, and maintain scalable ETL/ELT pipelines for structured and unstructured data.
- Optimize data workflows to ensure efficiency, reliability, and scalability.
- Automate data integration processes using Python, Spark, or other tools.
- Develop and manage relational and NoSQL databases (PostgreSQL, MySQL, MongoDB, etc.).
- Implement and optimize data warehouse solutions (Snowflake, Redshift, BigQuery, etc.).
- Ensure data quality, governance, and consistency across platforms.
- Work with cloud platforms such as AWS, Azure, or Google Cloud for data storage and processing.
- Develop and maintain data lake architectures and distribute computing frameworks.
- Utilize Apache Spark, Hadoop, Kafka, or similar technologies for big data processing.
- Work closely with data scientists, analysts, and business teams to support data needs.
- Translate business requirements into technical solutions for data processing.
- Provide documentation and training on data infrastructure and best practices.
- Ensure compliance with data privacy laws and security standards (GDPR, CCPA, HIPAA, etc.).
- Implement role-based access controls and data encryption techniques.
Benefits:
- Salary Range: Based on Experience
- Flexible Time Off (FTO) is provided to salaried (exempt) employees and provides the opportunity to take time away from the office with pay for vacation, personal or short-term illness
Required Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field.
- 3+ years of experience in data engineering or related roles.
- Proficiency in SQL, Python, and ETL tools.
- Experience with cloud data services (AWS Glue, Azure Data Factory, Google Dataflow, etc.).
- Knowledge of big data frameworks (Hadoop, Spark, Kafka) is a plus.
- Strong problem-solving and analytical skills.
Are you a fit? Please Apply now by sending us your resume to careers@techmindsinc.com